2023-12-17T11:29:59.400 INFO:root:teuthology version: 0.0.1.dev216+g5f3731e 2023-12-17T11:29:59.401 DEBUG:teuthology.run:Teuthology command: teuthology --owner scheduled_rishabh@teuthology --description fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/xfstests-dev} --verbose --name rishabh-2023-12-17_11:19:43-fs-rishabh-2023dec11-testing-default-smithi --archive /home/teuthworker/archive/rishabh-2023-12-17_11:19:43-fs-rishabh-2023dec11-testing-default-smithi/7495164 -- /home/teuthworker/archive/rishabh-2023-12-17_11:19:43-fs-rishabh-2023dec11-testing-default-smithi/7495164/orig.config.yaml 2023-12-17T11:29:59.444 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-17T11:29:59.536 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/rishabh-2023-12-17_11:19:43-fs-rishabh-2023dec11-testing-default-smithi/7495164 branch: rishabh-2023dec11 description: fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/xfstests-dev} email: null first_in_suite: false job_id: '7495164' kernel: client: branch: testing flavor: default kdb: true sha1: cd68252d7b4d7802f3cae7f5945b38e9b20dad4c ktype: upstream last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: rishabh-2023-12-17_11:19:43-fs-rishabh-2023dec11-testing-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: rishabh-2023dec11 ceph: cephfs: ec_profile: - m=2 - k=2 - crush-failure-domain=osd conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 pid file: '' rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - \(POOL_APP_NOT_ENABLED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding sha1: a62fda73efba5520d409bb5a21bd8373289dda5d ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: a62fda73efba5520d409bb5a21bd8373289dda5d kclient: syntax: v1 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: rishabh-2023dec11 sha1: a62fda73efba5520d409bb5a21bd8373289dda5d owner: scheduled_rishabh@teuthology priority: 70 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 seed: 5791 sha1: a62fda73efba5520d409bb5a21bd8373289dda5d sleep_before_teardown: 0 subset: 209/512 suite: fs suite_branch: rishabh-2023dec11 suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_a62fda73efba5520d409bb5a21bd8373289dda5d/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: a62fda73efba5520d409bb5a21bd8373289dda5d syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi040.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLWHNNyqkae0DRXMVWx2DWbXcH5eUDG1KTTWcTgiXJgX/3w9PiDltQprvOhKBp4FD6+3e6EO9r+ek8NjkIrx8Pw= smithi159.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJbKPpsqqWKWXPNSW2zUbciZRP9KYVz9LJhEsCYzGol5/UMenmmky+Cequsw5pWAAPlX9TB2gL8KveVFZCOdjoo= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - kclient: null - cephfs_test_runner: fail_on_skip: false modules: - tasks.cephfs.tests_from_xfstests_dev teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73 timestamp: 2023-12-17_11:19:43 tube: smithi user: rishabh verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.1485078 2023-12-17T11:29:59.537 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_a62fda73efba5520d409bb5a21bd8373289dda5d/qa; will attempt to use it 2023-12-17T11:29:59.537 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_a62fda73efba5520d409bb5a21bd8373289dda5d/qa/tasks 2023-12-17T11:29:59.538 INFO:teuthology.run_tasks:Running task internal.check_packages... 2023-12-17T11:29:59.539 INFO:teuthology.task.internal:Checking packages... 2023-12-17T11:29:59.563 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash 'a62fda73efba5520d409bb5a21bd8373289dda5d' 2023-12-17T11:29:59.563 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-12-17T11:29:59.563 INFO:teuthology.packaging:ref: None 2023-12-17T11:29:59.563 INFO:teuthology.packaging:tag: None 2023-12-17T11:29:59.563 INFO:teuthology.packaging:branch: rishabh-2023dec11 2023-12-17T11:29:59.563 INFO:teuthology.packaging:sha1: a62fda73efba5520d409bb5a21bd8373289dda5d 2023-12-17T11:29:59.563 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=rishabh-2023dec11 2023-12-17T11:29:59.706 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-119.ga62fda73 2023-12-17T11:29:59.707 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2023-12-17T11:29:59.714 INFO:teuthology.task.internal:no buildpackages task found 2023-12-17T11:29:59.714 INFO:teuthology.run_tasks:Running task internal.save_config... 2023-12-17T11:29:59.736 INFO:teuthology.task.internal:Saving configuration 2023-12-17T11:29:59.752 INFO:teuthology.run_tasks:Running task internal.check_lock... 2023-12-17T11:29:59.758 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-17T11:29:59.784 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi040.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-12-17_11:19:43-fs-rishabh-2023dec11-testing-default-smithi/7495164', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-17 11:21:23.170780', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLWHNNyqkae0DRXMVWx2DWbXcH5eUDG1KTTWcTgiXJgX/3w9PiDltQprvOhKBp4FD6+3e6EO9r+ek8NjkIrx8Pw='} 2023-12-17T11:29:59.806 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi159.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-12-17_11:19:43-fs-rishabh-2023dec11-testing-default-smithi/7495164', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-17 11:21:23.169212', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJbKPpsqqWKWXPNSW2zUbciZRP9KYVz9LJhEsCYzGol5/UMenmmky+Cequsw5pWAAPlX9TB2gL8KveVFZCOdjoo='} 2023-12-17T11:29:59.806 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2023-12-17T11:29:59.812 INFO:teuthology.task.internal:roles: ubuntu@smithi040.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2023-12-17T11:29:59.812 INFO:teuthology.task.internal:roles: ubuntu@smithi159.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2023-12-17T11:29:59.812 INFO:teuthology.run_tasks:Running task console_log... 2023-12-17T11:29:59.891 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f7b09864dc0>, signals=[15]) 2023-12-17T11:29:59.892 INFO:teuthology.run_tasks:Running task internal.connect... 2023-12-17T11:29:59.899 INFO:teuthology.task.internal:Opening connections... 2023-12-17T11:29:59.899 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi040.front.sepia.ceph.com 2023-12-17T11:29:59.900 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi040.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-17T11:30:00.001 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi159.front.sepia.ceph.com 2023-12-17T11:30:00.002 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-17T11:30:00.084 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2023-12-17T11:30:00.090 DEBUG:teuthology.orchestra.run.smithi040:> uname -m 2023-12-17T11:30:00.110 INFO:teuthology.orchestra.run.smithi040.stdout:x86_64 2023-12-17T11:30:00.110 DEBUG:teuthology.orchestra.run.smithi040:> cat /etc/os-release 2023-12-17T11:30:00.167 INFO:teuthology.orchestra.run.smithi040.stdout:NAME="CentOS Stream" 2023-12-17T11:30:00.167 INFO:teuthology.orchestra.run.smithi040.stdout:VERSION="9" 2023-12-17T11:30:00.168 INFO:teuthology.orchestra.run.smithi040.stdout:ID="centos" 2023-12-17T11:30:00.168 INFO:teuthology.orchestra.run.smithi040.stdout:ID_LIKE="rhel fedora" 2023-12-17T11:30:00.168 INFO:teuthology.orchestra.run.smithi040.stdout:VERSION_ID="9" 2023-12-17T11:30:00.168 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM_ID="platform:el9" 2023-12-17T11:30:00.168 INFO:teuthology.orchestra.run.smithi040.stdout:PRETTY_NAME="CentOS Stream 9" 2023-12-17T11:30:00.168 INFO:teuthology.orchestra.run.smithi040.stdout:ANSI_COLOR="0;31" 2023-12-17T11:30:00.168 INFO:teuthology.orchestra.run.smithi040.stdout:LOGO="fedora-logo-icon" 2023-12-17T11:30:00.169 INFO:teuthology.orchestra.run.smithi040.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-12-17T11:30:00.169 INFO:teuthology.orchestra.run.smithi040.stdout:HOME_URL="https://centos.org/" 2023-12-17T11:30:00.169 INFO:teuthology.orchestra.run.smithi040.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-17T11:30:00.169 INFO:teuthology.orchestra.run.smithi040.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-12-17T11:30:00.169 INFO:teuthology.orchestra.run.smithi040.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-12-17T11:30:00.170 INFO:teuthology.lock.ops:Updating smithi040.front.sepia.ceph.com on lock server 2023-12-17T11:30:00.192 DEBUG:teuthology.orchestra.run.smithi159:> uname -m 2023-12-17T11:30:00.210 INFO:teuthology.orchestra.run.smithi159.stdout:x86_64 2023-12-17T11:30:00.210 DEBUG:teuthology.orchestra.run.smithi159:> cat /etc/os-release 2023-12-17T11:30:00.267 INFO:teuthology.orchestra.run.smithi159.stdout:NAME="CentOS Stream" 2023-12-17T11:30:00.267 INFO:teuthology.orchestra.run.smithi159.stdout:VERSION="9" 2023-12-17T11:30:00.267 INFO:teuthology.orchestra.run.smithi159.stdout:ID="centos" 2023-12-17T11:30:00.267 INFO:teuthology.orchestra.run.smithi159.stdout:ID_LIKE="rhel fedora" 2023-12-17T11:30:00.267 INFO:teuthology.orchestra.run.smithi159.stdout:VERSION_ID="9" 2023-12-17T11:30:00.267 INFO:teuthology.orchestra.run.smithi159.stdout:PLATFORM_ID="platform:el9" 2023-12-17T11:30:00.267 INFO:teuthology.orchestra.run.smithi159.stdout:PRETTY_NAME="CentOS Stream 9" 2023-12-17T11:30:00.267 INFO:teuthology.orchestra.run.smithi159.stdout:ANSI_COLOR="0;31" 2023-12-17T11:30:00.267 INFO:teuthology.orchestra.run.smithi159.stdout:LOGO="fedora-logo-icon" 2023-12-17T11:30:00.268 INFO:teuthology.orchestra.run.smithi159.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-12-17T11:30:00.268 INFO:teuthology.orchestra.run.smithi159.stdout:HOME_URL="https://centos.org/" 2023-12-17T11:30:00.268 INFO:teuthology.orchestra.run.smithi159.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-17T11:30:00.268 INFO:teuthology.orchestra.run.smithi159.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-12-17T11:30:00.268 INFO:teuthology.orchestra.run.smithi159.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-12-17T11:30:00.268 INFO:teuthology.lock.ops:Updating smithi159.front.sepia.ceph.com on lock server 2023-12-17T11:30:00.292 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2023-12-17T11:30:00.302 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2023-12-17T11:30:00.310 INFO:teuthology.task.internal:Checking for old test directory... 2023-12-17T11:30:00.310 DEBUG:teuthology.orchestra.run.smithi040:> test '!' -e /home/ubuntu/cephtest 2023-12-17T11:30:00.313 DEBUG:teuthology.orchestra.run.smithi159:> test '!' -e /home/ubuntu/cephtest 2023-12-17T11:30:00.328 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2023-12-17T11:30:00.334 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2023-12-17T11:30:00.335 DEBUG:teuthology.orchestra.run.smithi040:> test -z $(ls -A /var/lib/ceph) 2023-12-17T11:30:00.371 DEBUG:teuthology.orchestra.run.smithi159:> test -z $(ls -A /var/lib/ceph) 2023-12-17T11:30:00.704 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2023-12-17T11:30:00.761 INFO:teuthology.run_tasks:Running task kernel... 2023-12-17T11:30:00.775 INFO:teuthology.task.kernel:normalize config orig: {'client': {'branch': 'testing'}, 'flavor': 'default', 'kdb': True, 'sha1': 'cd68252d7b4d7802f3cae7f5945b38e9b20dad4c'} 2023-12-17T11:30:00.775 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'branch': 'testing'}, 'client.2': {'branch': 'testing'}, 'client.1': {'branch': 'testing'}, 'client.3': {'branch': 'testing'}} 2023-12-17T11:30:00.775 INFO:teuthology.task.kernel:config {'client.0': {'branch': 'testing'}, 'client.1': {'branch': 'testing'}}, timeout 300 2023-12-17T11:30:00.776 DEBUG:teuthology.orchestra.run.smithi040:> test -f /run/.containerenv -o -f /.dockerenv 2023-12-17T11:30:00.776 DEBUG:teuthology.orchestra.run.smithi159:> test -f /run/.containerenv -o -f /.dockerenv 2023-12-17T11:30:00.793 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-17T11:30:00.793 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&ref=testing 2023-12-17T11:30:00.797 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-17T11:30:00.797 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&ref=testing 2023-12-17T11:30:00.999 DEBUG:teuthology.task.kernel:sha1 for client.0 is cd68252d7b4d7802f3cae7f5945b38e9b20dad4c 2023-12-17T11:30:00.999 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "cd68252d7b4d7802f3cae7f5945b38e9b20dad4c"... 2023-12-17T11:30:00.999 DEBUG:teuthology.orchestra.run.smithi040:> uname -r 2023-12-17T11:30:01.001 DEBUG:teuthology.task.kernel:sha1 for client.1 is cd68252d7b4d7802f3cae7f5945b38e9b20dad4c 2023-12-17T11:30:01.001 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "cd68252d7b4d7802f3cae7f5945b38e9b20dad4c"... 2023-12-17T11:30:01.001 DEBUG:teuthology.orchestra.run.smithi159:> uname -r 2023-12-17T11:30:01.018 INFO:teuthology.orchestra.run.smithi159.stdout:5.14.0-361.el9.x86_64 2023-12-17T11:30:01.018 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-361.el9.x86_64 vs cd68252d7b4d7802f3cae7f5945b38e9b20dad4c 2023-12-17T11:30:01.018 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2023-12-17T11:30:01.019 DEBUG:teuthology.orchestra.run.smithi159:> sudo yum upgrade -y linux-firmware 2023-12-17T11:30:01.020 INFO:teuthology.orchestra.run.smithi040.stdout:5.14.0-361.el9.x86_64 2023-12-17T11:30:01.020 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-361.el9.x86_64 vs cd68252d7b4d7802f3cae7f5945b38e9b20dad4c 2023-12-17T11:30:01.020 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2023-12-17T11:30:01.020 DEBUG:teuthology.orchestra.run.smithi040:> sudo yum upgrade -y linux-firmware 2023-12-17T11:30:03.410 INFO:teuthology.orchestra.run.smithi040.stdout:CentOS-9 - AppStream 9.5 MB/s | 6.4 MB 00:00 2023-12-17T11:30:03.631 INFO:teuthology.orchestra.run.smithi159.stdout:CentOS-9 - AppStream 7.6 MB/s | 6.4 MB 00:00 2023-12-17T11:30:05.160 INFO:teuthology.orchestra.run.smithi040.stdout:CentOS-9 - BaseOS 3.1 MB/s | 2.0 MB 00:00 2023-12-17T11:30:05.314 INFO:teuthology.orchestra.run.smithi159.stdout:CentOS-9 - BaseOS 3.1 MB/s | 2.0 MB 00:00 2023-12-17T11:30:06.938 INFO:teuthology.orchestra.run.smithi159.stdout:CentOS Stream 9 - BaseOS 6.2 MB/s | 7.9 MB 00:01 2023-12-17T11:30:07.292 INFO:teuthology.orchestra.run.smithi040.stdout:CentOS Stream 9 - BaseOS 4.4 MB/s | 7.9 MB 00:01 2023-12-17T11:30:09.902 INFO:teuthology.orchestra.run.smithi040.stdout:CentOS Stream 9 - AppStream 12 MB/s | 18 MB 00:01 2023-12-17T11:30:10.555 INFO:teuthology.orchestra.run.smithi159.stdout:CentOS Stream 9 - AppStream 7.6 MB/s | 18 MB 00:02 2023-12-17T11:30:14.044 INFO:teuthology.orchestra.run.smithi040.stdout:CentOS Stream 9 - CRB 10 MB/s | 5.8 MB 00:00 2023-12-17T11:30:14.848 INFO:teuthology.orchestra.run.smithi159.stdout:CentOS Stream 9 - CRB 6.7 MB/s | 5.8 MB 00:00 2023-12-17T11:30:16.054 INFO:teuthology.orchestra.run.smithi040.stdout:CentOS Stream 9 - Extras packages 17 kB/s | 15 kB 00:00 2023-12-17T11:30:16.423 INFO:teuthology.orchestra.run.smithi159.stdout:CentOS Stream 9 - Extras packages 30 kB/s | 15 kB 00:00 2023-12-17T11:30:17.448 INFO:teuthology.orchestra.run.smithi040.stdout:Extra Packages for Enterprise Linux 16 MB/s | 20 MB 00:01 2023-12-17T11:30:17.661 INFO:teuthology.orchestra.run.smithi159.stdout:Extra Packages for Enterprise Linux 18 MB/s | 20 MB 00:01 2023-12-17T11:30:22.321 INFO:teuthology.orchestra.run.smithi040.stdout:lab-extras 26 kB/s | 1.7 kB 00:00 2023-12-17T11:30:22.433 INFO:teuthology.orchestra.run.smithi159.stdout:lab-extras 14 kB/s | 1.7 kB 00:00 2023-12-17T11:30:24.607 INFO:teuthology.orchestra.run.smithi159.stdout:Dependencies resolved. 2023-12-17T11:30:24.620 INFO:teuthology.orchestra.run.smithi040.stdout:Dependencies resolved. 2023-12-17T11:30:24.621 INFO:teuthology.orchestra.run.smithi159.stdout:================================================================================ 2023-12-17T11:30:24.621 INFO:teuthology.orchestra.run.smithi159.stdout: Package Arch Version Repository Size 2023-12-17T11:30:24.621 INFO:teuthology.orchestra.run.smithi159.stdout:================================================================================ 2023-12-17T11:30:24.621 INFO:teuthology.orchestra.run.smithi159.stdout:Upgrading: 2023-12-17T11:30:24.621 INFO:teuthology.orchestra.run.smithi159.stdout: linux-firmware noarch 20231030-141.el9 CentOS-BaseOS 328 M 2023-12-17T11:30:24.621 INFO:teuthology.orchestra.run.smithi159.stdout: 2023-12-17T11:30:24.621 INFO:teuthology.orchestra.run.smithi159.stdout:Transaction Summary 2023-12-17T11:30:24.621 INFO:teuthology.orchestra.run.smithi159.stdout:================================================================================ 2023-12-17T11:30:24.621 INFO:teuthology.orchestra.run.smithi159.stdout:Upgrade 1 Package 2023-12-17T11:30:24.622 INFO:teuthology.orchestra.run.smithi159.stdout: 2023-12-17T11:30:24.622 INFO:teuthology.orchestra.run.smithi159.stdout:Total download size: 328 M 2023-12-17T11:30:24.622 INFO:teuthology.orchestra.run.smithi159.stdout:Downloading Packages: 2023-12-17T11:30:24.627 INFO:teuthology.orchestra.run.smithi040.stdout:================================================================================ 2023-12-17T11:30:24.627 INFO:teuthology.orchestra.run.smithi040.stdout: Package Arch Version Repository Size 2023-12-17T11:30:24.627 INFO:teuthology.orchestra.run.smithi040.stdout:================================================================================ 2023-12-17T11:30:24.628 INFO:teuthology.orchestra.run.smithi040.stdout:Upgrading: 2023-12-17T11:30:24.628 INFO:teuthology.orchestra.run.smithi040.stdout: linux-firmware noarch 20231030-141.el9 CentOS-BaseOS 328 M 2023-12-17T11:30:24.628 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T11:30:24.628 INFO:teuthology.orchestra.run.smithi040.stdout:Transaction Summary 2023-12-17T11:30:24.628 INFO:teuthology.orchestra.run.smithi040.stdout:================================================================================ 2023-12-17T11:30:24.628 INFO:teuthology.orchestra.run.smithi040.stdout:Upgrade 1 Package 2023-12-17T11:30:24.628 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T11:30:24.628 INFO:teuthology.orchestra.run.smithi040.stdout:Total download size: 328 M 2023-12-17T11:30:24.629 INFO:teuthology.orchestra.run.smithi040.stdout:Downloading Packages: 2023-12-17T11:30:38.313 INFO:teuthology.orchestra.run.smithi040.stdout:linux-firmware-20231030-141.el9.noarch.rpm 24 MB/s | 328 MB 00:13 2023-12-17T11:30:38.314 INFO:teuthology.orchestra.run.smithi040.stdout:-------------------------------------------------------------------------------- 2023-12-17T11:30:38.314 INFO:teuthology.orchestra.run.smithi040.stdout:Total 24 MB/s | 328 MB 00:13 2023-12-17T11:30:38.315 INFO:teuthology.orchestra.run.smithi040.stdout:Running transaction check 2023-12-17T11:30:38.420 INFO:teuthology.orchestra.run.smithi040.stdout:Transaction check succeeded. 2023-12-17T11:30:38.420 INFO:teuthology.orchestra.run.smithi040.stdout:Running transaction test 2023-12-17T11:30:39.250 INFO:teuthology.orchestra.run.smithi159.stdout:linux-firmware-20231030-141.el9.noarch.rpm 22 MB/s | 328 MB 00:14 2023-12-17T11:30:39.251 INFO:teuthology.orchestra.run.smithi159.stdout:-------------------------------------------------------------------------------- 2023-12-17T11:30:39.251 INFO:teuthology.orchestra.run.smithi159.stdout:Total 22 MB/s | 328 MB 00:14 2023-12-17T11:30:39.251 INFO:teuthology.orchestra.run.smithi159.stdout:Running transaction check 2023-12-17T11:30:39.360 INFO:teuthology.orchestra.run.smithi159.stdout:Transaction check succeeded. 2023-12-17T11:30:39.360 INFO:teuthology.orchestra.run.smithi159.stdout:Running transaction test 2023-12-17T11:30:40.669 INFO:teuthology.orchestra.run.smithi040.stdout:Transaction test succeeded. 2023-12-17T11:30:40.669 INFO:teuthology.orchestra.run.smithi040.stdout:Running transaction 2023-12-17T11:30:41.496 INFO:teuthology.orchestra.run.smithi159.stdout:Transaction test succeeded. 2023-12-17T11:30:41.496 INFO:teuthology.orchestra.run.smithi159.stdout:Running transaction 2023-12-17T11:30:46.476 INFO:teuthology.orchestra.run.smithi040.stdout: Preparing : 1/1 2023-12-17T11:30:46.842 INFO:teuthology.orchestra.run.smithi040.stdout: Upgrading : linux-firmware-20231030-141.el9.noarch 1/2 2023-12-17T11:30:46.938 INFO:teuthology.orchestra.run.smithi040.stdout: Cleanup : linux-firmware-20230814-139.el9.noarch 2/2 2023-12-17T11:30:47.083 INFO:teuthology.orchestra.run.smithi159.stdout: Preparing : 1/1 2023-12-17T11:30:47.532 INFO:teuthology.orchestra.run.smithi159.stdout: Upgrading : linux-firmware-20231030-141.el9.noarch 1/2 2023-12-17T11:30:47.606 INFO:teuthology.orchestra.run.smithi159.stdout: Cleanup : linux-firmware-20230814-139.el9.noarch 2/2 2023-12-17T11:30:47.844 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: linux-firmware-20230814-139.el9.noarch 2/2 2023-12-17T11:30:47.844 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : linux-firmware-20231030-141.el9.noarch 1/2 2023-12-17T11:30:48.226 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : linux-firmware-20230814-139.el9.noarch 2/2 2023-12-17T11:30:48.226 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T11:30:48.226 INFO:teuthology.orchestra.run.smithi040.stdout:Upgraded: 2023-12-17T11:30:48.226 INFO:teuthology.orchestra.run.smithi040.stdout: linux-firmware-20231030-141.el9.noarch 2023-12-17T11:30:48.226 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T11:30:48.226 INFO:teuthology.orchestra.run.smithi040.stdout:Complete! 2023-12-17T11:30:48.502 INFO:teuthology.task.kernel:Downloading kernel cd68252d7b4d7802f3cae7f5945b38e9b20dad4c on client.0... 2023-12-17T11:30:48.503 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=cd68252d7b4d7802f3cae7f5945b38e9b20dad4c 2023-12-17T11:30:48.602 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: linux-firmware-20230814-139.el9.noarch 2/2 2023-12-17T11:30:48.602 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : linux-firmware-20231030-141.el9.noarch 1/2 2023-12-17T11:30:48.766 INFO:teuthology.task.kernel:fetching, builder baseurl is https://4.chacra.ceph.com/r/kernel/testing/cd68252d7b4d7802f3cae7f5945b38e9b20dad4c/centos/9/flavors/default/x86_64/ 2023-12-17T11:30:48.766 DEBUG:teuthology.orchestra.run.smithi040:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.6.0_gcd68252d7b4d-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://4.chacra.ceph.com/r/kernel/testing/cd68252d7b4d7802f3cae7f5945b38e9b20dad4c/centos/9/flavors/default/x86_64/ --input-file=- 2023-12-17T11:30:48.769 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi040.front.sepia.ceph.com to complete... 2023-12-17T11:30:49.000 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : linux-firmware-20230814-139.el9.noarch 2/2 2023-12-17T11:30:49.000 INFO:teuthology.orchestra.run.smithi159.stdout: 2023-12-17T11:30:49.000 INFO:teuthology.orchestra.run.smithi159.stdout:Upgraded: 2023-12-17T11:30:49.000 INFO:teuthology.orchestra.run.smithi159.stdout: linux-firmware-20231030-141.el9.noarch 2023-12-17T11:30:49.000 INFO:teuthology.orchestra.run.smithi159.stdout: 2023-12-17T11:30:49.000 INFO:teuthology.orchestra.run.smithi159.stdout:Complete! 2023-12-17T11:30:49.292 INFO:teuthology.task.kernel:Downloading kernel cd68252d7b4d7802f3cae7f5945b38e9b20dad4c on client.1... 2023-12-17T11:30:49.293 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=cd68252d7b4d7802f3cae7f5945b38e9b20dad4c 2023-12-17T11:30:49.652 INFO:teuthology.task.kernel:fetching, builder baseurl is https://4.chacra.ceph.com/r/kernel/testing/cd68252d7b4d7802f3cae7f5945b38e9b20dad4c/centos/9/flavors/default/x86_64/ 2023-12-17T11:30:49.652 DEBUG:teuthology.orchestra.run.smithi159:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.6.0_gcd68252d7b4d-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://4.chacra.ceph.com/r/kernel/testing/cd68252d7b4d7802f3cae7f5945b38e9b20dad4c/centos/9/flavors/default/x86_64/ --input-file=- 2023-12-17T11:30:49.655 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi159.front.sepia.ceph.com to complete... 2023-12-17T11:31:03.249 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17 11:31:03 URL:https://4.chacra.ceph.com/r/kernel/testing/cd68252d7b4d7802f3cae7f5945b38e9b20dad4c/centos/9/flavors/default/x86_64/kernel-6.6.0_gcd68252d7b4d-1.x86_64.rpm [321162729/321162729] -> "/tmp/kernel.x86_64.rpm" [1] 2023-12-17T11:31:03.249 INFO:teuthology.orchestra.run.smithi040.stderr:FINISHED --2023-12-17 11:31:03-- 2023-12-17T11:31:03.249 INFO:teuthology.orchestra.run.smithi040.stderr:Total wall clock time: 14s 2023-12-17T11:31:03.249 INFO:teuthology.orchestra.run.smithi040.stderr:Downloaded: 1 files, 306M in 14s (21.6 MB/s) 2023-12-17T11:31:03.252 INFO:teuthology.task.kernel:Installing kernel cd68252d7b4d7802f3cae7f5945b38e9b20dad4c on client.0... 2023-12-17T11:31:03.252 DEBUG:teuthology.orchestra.run.smithi040:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2023-12-17T11:31:05.199 INFO:teuthology.orchestra.run.smithi040.stdout:Verifying... ######################################## 2023-12-17T11:31:05.255 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing... ######################################## 2023-12-17T11:31:05.339 INFO:teuthology.orchestra.run.smithi040.stdout:Updating / installing... 2023-12-17T11:31:12.738 INFO:teuthology.orchestra.run.smithi040.stdout:kernel-6.6.0_gcd68252d7b4d-1 ######################################## 2023-12-17T11:31:28.157 INFO:teuthology.orchestra.run.smithi040.stderr:dracut: Disabling early microcode, because kernel does not support it. CONFIG_MICROCODE_[AMD|INTEL]!=y 2023-12-17T11:31:47.378 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17 11:31:47 URL:https://4.chacra.ceph.com/r/kernel/testing/cd68252d7b4d7802f3cae7f5945b38e9b20dad4c/centos/9/flavors/default/x86_64/kernel-6.6.0_gcd68252d7b4d-1.x86_64.rpm [321162729/321162729] -> "/tmp/kernel.x86_64.rpm" [1] 2023-12-17T11:31:47.378 INFO:teuthology.orchestra.run.smithi159.stderr:FINISHED --2023-12-17 11:31:47-- 2023-12-17T11:31:47.378 INFO:teuthology.orchestra.run.smithi159.stderr:Total wall clock time: 58s 2023-12-17T11:31:47.378 INFO:teuthology.orchestra.run.smithi159.stderr:Downloaded: 1 files, 306M in 57s (5.36 MB/s) 2023-12-17T11:31:47.381 INFO:teuthology.task.kernel:Installing kernel cd68252d7b4d7802f3cae7f5945b38e9b20dad4c on client.1... 2023-12-17T11:31:47.381 DEBUG:teuthology.orchestra.run.smithi159:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2023-12-17T11:31:49.231 INFO:teuthology.orchestra.run.smithi159.stdout:Verifying... ######################################## 2023-12-17T11:31:49.307 INFO:teuthology.orchestra.run.smithi159.stdout:Preparing... ######################################## 2023-12-17T11:31:49.387 INFO:teuthology.orchestra.run.smithi159.stdout:Updating / installing... 2023-12-17T11:31:50.071 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi040.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2023-12-17T11:31:50.071 DEBUG:teuthology.orchestra.run.smithi040:> rpm -qlp /tmp/kernel.x86_64.rpm 2023-12-17T11:31:50.150 INFO:teuthology.orchestra.run.smithi040.stdout:/boot/System.map-6.6.0-gcd68252d7b4d 2023-12-17T11:31:50.150 INFO:teuthology.orchestra.run.smithi040.stdout:/boot/config-6.6.0-gcd68252d7b4d 2023-12-17T11:31:50.150 INFO:teuthology.orchestra.run.smithi040.stdout:/boot/vmlinuz-6.6.0-gcd68252d7b4d 2023-12-17T11:31:50.150 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d 2023-12-17T11:31:50.150 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel 2023-12-17T11:31:50.150 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch 2023-12-17T11:31:50.150 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86 2023-12-17T11:31:50.150 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto 2023-12-17T11:31:50.150 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/blowfish-x86_64.ko 2023-12-17T11:31:50.151 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2023-12-17T11:31:50.151 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2023-12-17T11:31:50.151 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/camellia-x86_64.ko 2023-12-17T11:31:50.151 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2023-12-17T11:31:50.151 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2023-12-17T11:31:50.151 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/crc32-pclmul.ko 2023-12-17T11:31:50.151 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/crc32c-intel.ko 2023-12-17T11:31:50.151 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2023-12-17T11:31:50.151 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2023-12-17T11:31:50.151 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2023-12-17T11:31:50.151 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2023-12-17T11:31:50.151 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/serpent-avx2.ko 2023-12-17T11:31:50.152 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2023-12-17T11:31:50.152 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/sha1-ssse3.ko 2023-12-17T11:31:50.152 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/sha256-ssse3.ko 2023-12-17T11:31:50.152 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/sha512-ssse3.ko 2023-12-17T11:31:50.152 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2023-12-17T11:31:50.152 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2023-12-17T11:31:50.152 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/twofish-x86_64.ko 2023-12-17T11:31:50.152 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/kernel 2023-12-17T11:31:50.152 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/kernel/cpu 2023-12-17T11:31:50.152 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/kernel/cpu/mce 2023-12-17T11:31:50.152 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2023-12-17T11:31:50.152 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/kvm 2023-12-17T11:31:50.152 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/kvm/kvm-amd.ko 2023-12-17T11:31:50.152 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/kvm/kvm-intel.ko 2023-12-17T11:31:50.153 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/kvm/kvm.ko 2023-12-17T11:31:50.153 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto 2023-12-17T11:31:50.153 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/ansi_cprng.ko 2023-12-17T11:31:50.153 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/anubis.ko 2023-12-17T11:31:50.153 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/arc4.ko 2023-12-17T11:31:50.153 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/async_tx 2023-12-17T11:31:50.153 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/async_tx/async_memcpy.ko 2023-12-17T11:31:50.153 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/async_tx/async_pq.ko 2023-12-17T11:31:50.153 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/async_tx/async_raid6_recov.ko 2023-12-17T11:31:50.153 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/async_tx/async_tx.ko 2023-12-17T11:31:50.154 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/async_tx/async_xor.ko 2023-12-17T11:31:50.154 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/async_tx/raid6test.ko 2023-12-17T11:31:50.154 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/authenc.ko 2023-12-17T11:31:50.154 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/authencesn.ko 2023-12-17T11:31:50.154 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/blake2b_generic.ko 2023-12-17T11:31:50.154 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/blowfish_common.ko 2023-12-17T11:31:50.154 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/blowfish_generic.ko 2023-12-17T11:31:50.154 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/camellia_generic.ko 2023-12-17T11:31:50.154 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/cast5_generic.ko 2023-12-17T11:31:50.154 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/cast6_generic.ko 2023-12-17T11:31:50.154 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/cast_common.ko 2023-12-17T11:31:50.154 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/ccm.ko 2023-12-17T11:31:50.154 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/cmac.ko 2023-12-17T11:31:50.155 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/crc32_generic.ko 2023-12-17T11:31:50.155 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/crypto_engine.ko 2023-12-17T11:31:50.155 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/crypto_user.ko 2023-12-17T11:31:50.155 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/cts.ko 2023-12-17T11:31:50.155 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/des_generic.ko 2023-12-17T11:31:50.155 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/dh_generic.ko 2023-12-17T11:31:50.155 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/echainiv.ko 2023-12-17T11:31:50.155 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/essiv.ko 2023-12-17T11:31:50.155 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/fcrypt.ko 2023-12-17T11:31:50.155 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/khazad.ko 2023-12-17T11:31:50.155 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/lz4.ko 2023-12-17T11:31:50.155 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/lz4hc.ko 2023-12-17T11:31:50.155 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/md4.ko 2023-12-17T11:31:50.155 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/michael_mic.ko 2023-12-17T11:31:50.156 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/pcbc.ko 2023-12-17T11:31:50.156 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/pcrypt.ko 2023-12-17T11:31:50.156 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/rmd160.ko 2023-12-17T11:31:50.156 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/seed.ko 2023-12-17T11:31:50.156 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/serpent_generic.ko 2023-12-17T11:31:50.156 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/tcrypt.ko 2023-12-17T11:31:50.156 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/tea.ko 2023-12-17T11:31:50.156 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/twofish_common.ko 2023-12-17T11:31:50.156 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/twofish_generic.ko 2023-12-17T11:31:50.156 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/vmac.ko 2023-12-17T11:31:50.156 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/wp512.ko 2023-12-17T11:31:50.156 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/xcbc.ko 2023-12-17T11:31:50.156 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/xor.ko 2023-12-17T11:31:50.156 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/xxhash_generic.ko 2023-12-17T11:31:50.156 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers 2023-12-17T11:31:50.157 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/acpi 2023-12-17T11:31:50.157 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/acpi/acpi_ipmi.ko 2023-12-17T11:31:50.157 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/acpi/acpi_pad.ko 2023-12-17T11:31:50.157 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/acpi/custom_method.ko 2023-12-17T11:31:50.157 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/acpi/ec_sys.ko 2023-12-17T11:31:50.157 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/acpi/platform_profile.ko 2023-12-17T11:31:50.157 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/acpi/sbs.ko 2023-12-17T11:31:50.157 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/acpi/sbshc.ko 2023-12-17T11:31:50.157 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/acpi/video.ko 2023-12-17T11:31:50.157 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata 2023-12-17T11:31:50.157 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/acard-ahci.ko 2023-12-17T11:31:50.157 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/ahci_platform.ko 2023-12-17T11:31:50.158 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/ata_generic.ko 2023-12-17T11:31:50.158 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/libahci_platform.ko 2023-12-17T11:31:50.158 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_acpi.ko 2023-12-17T11:31:50.158 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_ali.ko 2023-12-17T11:31:50.158 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_amd.ko 2023-12-17T11:31:50.158 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_artop.ko 2023-12-17T11:31:50.158 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_atiixp.ko 2023-12-17T11:31:50.158 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_atp867x.ko 2023-12-17T11:31:50.158 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_cmd640.ko 2023-12-17T11:31:50.158 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_cmd64x.ko 2023-12-17T11:31:50.158 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_cypress.ko 2023-12-17T11:31:50.158 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_efar.ko 2023-12-17T11:31:50.158 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_hpt366.ko 2023-12-17T11:31:50.158 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_hpt37x.ko 2023-12-17T11:31:50.159 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_hpt3x2n.ko 2023-12-17T11:31:50.159 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_hpt3x3.ko 2023-12-17T11:31:50.159 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_it8213.ko 2023-12-17T11:31:50.159 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_it821x.ko 2023-12-17T11:31:50.159 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_jmicron.ko 2023-12-17T11:31:50.159 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_marvell.ko 2023-12-17T11:31:50.159 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_mpiix.ko 2023-12-17T11:31:50.159 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_netcell.ko 2023-12-17T11:31:50.159 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_ninja32.ko 2023-12-17T11:31:50.159 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_ns87410.ko 2023-12-17T11:31:50.159 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_ns87415.ko 2023-12-17T11:31:50.159 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_oldpiix.ko 2023-12-17T11:31:50.159 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_opti.ko 2023-12-17T11:31:50.159 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_optidma.ko 2023-12-17T11:31:50.159 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_pcmcia.ko 2023-12-17T11:31:50.160 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_pdc2027x.ko 2023-12-17T11:31:50.160 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_pdc202xx_old.ko 2023-12-17T11:31:50.160 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_piccolo.ko 2023-12-17T11:31:50.160 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_rdc.ko 2023-12-17T11:31:50.160 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_sch.ko 2023-12-17T11:31:50.160 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_serverworks.ko 2023-12-17T11:31:50.160 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_sil680.ko 2023-12-17T11:31:50.160 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_sis.ko 2023-12-17T11:31:50.160 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_sl82c105.ko 2023-12-17T11:31:50.160 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_triflex.ko 2023-12-17T11:31:50.160 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_via.ko 2023-12-17T11:31:50.160 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pdc_adma.ko 2023-12-17T11:31:50.160 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_inic162x.ko 2023-12-17T11:31:50.161 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_mv.ko 2023-12-17T11:31:50.161 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_nv.ko 2023-12-17T11:31:50.161 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_promise.ko 2023-12-17T11:31:50.161 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_qstor.ko 2023-12-17T11:31:50.161 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_sil.ko 2023-12-17T11:31:50.161 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_sil24.ko 2023-12-17T11:31:50.161 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_sis.ko 2023-12-17T11:31:50.161 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_svw.ko 2023-12-17T11:31:50.161 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_sx4.ko 2023-12-17T11:31:50.161 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_uli.ko 2023-12-17T11:31:50.161 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_via.ko 2023-12-17T11:31:50.161 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_vsc.ko 2023-12-17T11:31:50.161 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/auxdisplay 2023-12-17T11:31:50.162 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/auxdisplay/ks0108.ko 2023-12-17T11:31:50.162 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/base 2023-12-17T11:31:50.162 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/base/regmap 2023-12-17T11:31:50.162 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/base/regmap/regmap-i2c.ko 2023-12-17T11:31:50.162 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/base/regmap/regmap-mmio.ko 2023-12-17T11:31:50.162 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/bcma 2023-12-17T11:31:50.162 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/bcma/bcma.ko 2023-12-17T11:31:50.162 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block 2023-12-17T11:31:50.162 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/aoe 2023-12-17T11:31:50.162 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/aoe/aoe.ko 2023-12-17T11:31:50.162 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/brd.ko 2023-12-17T11:31:50.162 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/drbd 2023-12-17T11:31:50.162 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/drbd/drbd.ko 2023-12-17T11:31:50.162 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/floppy.ko 2023-12-17T11:31:50.163 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/loop.ko 2023-12-17T11:31:50.163 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/mtip32xx 2023-12-17T11:31:50.163 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/mtip32xx/mtip32xx.ko 2023-12-17T11:31:50.163 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/nbd.ko 2023-12-17T11:31:50.163 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/null_blk 2023-12-17T11:31:50.163 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/null_blk/null_blk.ko 2023-12-17T11:31:50.163 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/pktcdvd.ko 2023-12-17T11:31:50.163 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/rbd.ko 2023-12-17T11:31:50.163 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/virtio_blk.ko 2023-12-17T11:31:50.163 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/xen-blkback 2023-12-17T11:31:50.163 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/xen-blkback/xen-blkback.ko 2023-12-17T11:31:50.163 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/xen-blkfront.ko 2023-12-17T11:31:50.163 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/zram 2023-12-17T11:31:50.163 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/zram/zram.ko 2023-12-17T11:31:50.164 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char 2023-12-17T11:31:50.164 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/hangcheck-timer.ko 2023-12-17T11:31:50.164 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/hw_random 2023-12-17T11:31:50.164 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/hw_random/amd-rng.ko 2023-12-17T11:31:50.164 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/hw_random/intel-rng.ko 2023-12-17T11:31:50.164 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/hw_random/timeriomem-rng.ko 2023-12-17T11:31:50.164 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/hw_random/via-rng.ko 2023-12-17T11:31:50.164 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/hw_random/virtio-rng.ko 2023-12-17T11:31:50.164 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/ipmi 2023-12-17T11:31:50.164 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/ipmi/ipmi_devintf.ko 2023-12-17T11:31:50.164 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2023-12-17T11:31:50.164 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2023-12-17T11:31:50.164 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/ipmi/ipmi_si.ko 2023-12-17T11:31:50.164 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/ipmi/ipmi_ssif.ko 2023-12-17T11:31:50.164 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2023-12-17T11:31:50.165 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/lp.ko 2023-12-17T11:31:50.165 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/mwave 2023-12-17T11:31:50.165 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/mwave/mwave.ko 2023-12-17T11:31:50.165 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/ppdev.ko 2023-12-17T11:31:50.165 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/tlclk.ko 2023-12-17T11:31:50.165 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/tpm 2023-12-17T11:31:50.165 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/tpm/tpm.ko 2023-12-17T11:31:50.165 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/tpm/tpm_atmel.ko 2023-12-17T11:31:50.165 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/tpm/tpm_infineon.ko 2023-12-17T11:31:50.165 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/tpm/tpm_nsc.ko 2023-12-17T11:31:50.165 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/tpm/tpm_tis.ko 2023-12-17T11:31:50.165 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/tpm/tpm_tis_core.ko 2023-12-17T11:31:50.165 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/uv_mmtimer.ko 2023-12-17T11:31:50.165 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/virtio_console.ko 2023-12-17T11:31:50.166 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/cpufreq 2023-12-17T11:31:50.166 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/cpufreq/acpi-cpufreq.ko 2023-12-17T11:31:50.166 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2023-12-17T11:31:50.166 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/cpufreq/p4-clockmod.ko 2023-12-17T11:31:50.166 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/cpufreq/pcc-cpufreq.ko 2023-12-17T11:31:50.166 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/cpufreq/powernow-k8.ko 2023-12-17T11:31:50.166 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/cpufreq/speedstep-lib.ko 2023-12-17T11:31:50.166 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto 2023-12-17T11:31:50.166 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/ccp 2023-12-17T11:31:50.166 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/ccp/ccp-crypto.ko 2023-12-17T11:31:50.166 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/ccp/ccp.ko 2023-12-17T11:31:50.166 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/intel 2023-12-17T11:31:50.166 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/intel/qat 2023-12-17T11:31:50.167 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/intel/qat/qat_common 2023-12-17T11:31:50.167 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2023-12-17T11:31:50.167 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2023-12-17T11:31:50.167 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2023-12-17T11:31:50.167 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/padlock-aes.ko 2023-12-17T11:31:50.167 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/padlock-sha.ko 2023-12-17T11:31:50.167 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/virtio 2023-12-17T11:31:50.167 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/virtio/virtio_crypto.ko 2023-12-17T11:31:50.167 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/dca 2023-12-17T11:31:50.167 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/dca/dca.ko 2023-12-17T11:31:50.167 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/devfreq 2023-12-17T11:31:50.167 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/devfreq/governor_simpleondemand.ko 2023-12-17T11:31:50.167 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/dma 2023-12-17T11:31:50.168 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/dma/dw 2023-12-17T11:31:50.168 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/dma/dw/dw_dmac.ko 2023-12-17T11:31:50.168 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/dma/ioat 2023-12-17T11:31:50.168 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/dma/ioat/ioatdma.ko 2023-12-17T11:31:50.168 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac 2023-12-17T11:31:50.168 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/amd64_edac.ko 2023-12-17T11:31:50.168 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/e752x_edac.ko 2023-12-17T11:31:50.168 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/edac_mce_amd.ko 2023-12-17T11:31:50.168 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/i3000_edac.ko 2023-12-17T11:31:50.168 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/i3200_edac.ko 2023-12-17T11:31:50.168 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/i5100_edac.ko 2023-12-17T11:31:50.168 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/i5400_edac.ko 2023-12-17T11:31:50.168 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/i7300_edac.ko 2023-12-17T11:31:50.169 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/i7core_edac.ko 2023-12-17T11:31:50.169 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/i82975x_edac.ko 2023-12-17T11:31:50.169 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/ie31200_edac.ko 2023-12-17T11:31:50.169 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/sb_edac.ko 2023-12-17T11:31:50.169 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/x38_edac.ko 2023-12-17T11:31:50.169 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/firmware 2023-12-17T11:31:50.169 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/firmware/edd.ko 2023-12-17T11:31:50.169 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/firmware/iscsi_ibft.ko 2023-12-17T11:31:50.169 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio 2023-12-17T11:31:50.169 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-ich.ko 2023-12-17T11:31:50.169 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-viperboard.ko 2023-12-17T11:31:50.169 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid 2023-12-17T11:31:50.170 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-appleir.ko 2023-12-17T11:31:50.170 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-aureal.ko 2023-12-17T11:31:50.170 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-axff.ko 2023-12-17T11:31:50.170 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-dr.ko 2023-12-17T11:31:50.170 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-elecom.ko 2023-12-17T11:31:50.170 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-elo.ko 2023-12-17T11:31:50.170 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-emsff.ko 2023-12-17T11:31:50.170 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-gaff.ko 2023-12-17T11:31:50.170 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-gt683r.ko 2023-12-17T11:31:50.170 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-gyration.ko 2023-12-17T11:31:50.170 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-holtek-kbd.ko 2023-12-17T11:31:50.170 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-holtek-mouse.ko 2023-12-17T11:31:50.170 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-holtekff.ko 2023-12-17T11:31:50.171 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-hyperv.ko 2023-12-17T11:31:50.171 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-icade.ko 2023-12-17T11:31:50.171 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-keytouch.ko 2023-12-17T11:31:50.171 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-kye.ko 2023-12-17T11:31:50.171 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-lcpower.ko 2023-12-17T11:31:50.171 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-led.ko 2023-12-17T11:31:50.171 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-lenovo.ko 2023-12-17T11:31:50.171 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-logitech-dj.ko 2023-12-17T11:31:50.171 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-logitech-hidpp.ko 2023-12-17T11:31:50.171 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-multitouch.ko 2023-12-17T11:31:50.171 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-ortek.ko 2023-12-17T11:31:50.171 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-penmount.ko 2023-12-17T11:31:50.171 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-petalynx.ko 2023-12-17T11:31:50.171 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-picolcd.ko 2023-12-17T11:31:50.172 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-pl.ko 2023-12-17T11:31:50.172 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-plantronics.ko 2023-12-17T11:31:50.172 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-primax.ko 2023-12-17T11:31:50.172 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-rmi.ko 2023-12-17T11:31:50.172 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-arvo.ko 2023-12-17T11:31:50.172 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-common.ko 2023-12-17T11:31:50.172 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-isku.ko 2023-12-17T11:31:50.172 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-kone.ko 2023-12-17T11:31:50.172 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-koneplus.ko 2023-12-17T11:31:50.172 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-konepure.ko 2023-12-17T11:31:50.172 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-kovaplus.ko 2023-12-17T11:31:50.172 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-lua.ko 2023-12-17T11:31:50.172 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-pyra.ko 2023-12-17T11:31:50.172 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-ryos.ko 2023-12-17T11:31:50.173 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-savu.ko 2023-12-17T11:31:50.173 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat.ko 2023-12-17T11:31:50.173 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-saitek.ko 2023-12-17T11:31:50.173 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-samsung.ko 2023-12-17T11:31:50.173 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-sensor-hub.ko 2023-12-17T11:31:50.173 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-sjoy.ko 2023-12-17T11:31:50.173 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-sony.ko 2023-12-17T11:31:50.173 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-speedlink.ko 2023-12-17T11:31:50.173 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-steelseries.ko 2023-12-17T11:31:50.173 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-sunplus.ko 2023-12-17T11:31:50.173 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-thrustmaster.ko 2023-12-17T11:31:50.173 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-tivo.ko 2023-12-17T11:31:50.173 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-tmff.ko 2023-12-17T11:31:50.174 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-topseed.ko 2023-12-17T11:31:50.174 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-twinhan.ko 2023-12-17T11:31:50.174 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-uclogic.ko 2023-12-17T11:31:50.174 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-waltop.ko 2023-12-17T11:31:50.174 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-wiimote.ko 2023-12-17T11:31:50.174 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-xinmo.ko 2023-12-17T11:31:50.174 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-zpff.ko 2023-12-17T11:31:50.174 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-zydacron.ko 2023-12-17T11:31:50.174 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/uhid.ko 2023-12-17T11:31:50.174 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/wacom.ko 2023-12-17T11:31:50.174 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hv 2023-12-17T11:31:50.174 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hv/hv_balloon.ko 2023-12-17T11:31:50.174 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hv/hv_utils.ko 2023-12-17T11:31:50.174 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hv/hv_vmbus.ko 2023-12-17T11:31:50.175 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon 2023-12-17T11:31:50.175 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/abituguru.ko 2023-12-17T11:31:50.175 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/abituguru3.ko 2023-12-17T11:31:50.175 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/acpi_power_meter.ko 2023-12-17T11:31:50.175 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ad7414.ko 2023-12-17T11:31:50.175 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ad7418.ko 2023-12-17T11:31:50.175 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adc128d818.ko 2023-12-17T11:31:50.175 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adm1025.ko 2023-12-17T11:31:50.175 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adm1026.ko 2023-12-17T11:31:50.175 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adm1029.ko 2023-12-17T11:31:50.175 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adm1031.ko 2023-12-17T11:31:50.175 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adm9240.ko 2023-12-17T11:31:50.175 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ads7828.ko 2023-12-17T11:31:50.175 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adt7410.ko 2023-12-17T11:31:50.176 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adt7411.ko 2023-12-17T11:31:50.176 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adt7462.ko 2023-12-17T11:31:50.176 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adt7470.ko 2023-12-17T11:31:50.176 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adt7475.ko 2023-12-17T11:31:50.176 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adt7x10.ko 2023-12-17T11:31:50.176 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/amc6821.ko 2023-12-17T11:31:50.176 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/applesmc.ko 2023-12-17T11:31:50.176 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/asb100.ko 2023-12-17T11:31:50.176 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/asc7621.ko 2023-12-17T11:31:50.176 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/asus_atk0110.ko 2023-12-17T11:31:50.176 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/atxp1.ko 2023-12-17T11:31:50.176 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/coretemp.ko 2023-12-17T11:31:50.176 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/dell-smm-hwmon.ko 2023-12-17T11:31:50.177 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/dme1737.ko 2023-12-17T11:31:50.177 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ds1621.ko 2023-12-17T11:31:50.177 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ds620.ko 2023-12-17T11:31:50.177 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/emc1403.ko 2023-12-17T11:31:50.177 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/emc6w201.ko 2023-12-17T11:31:50.177 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/f71805f.ko 2023-12-17T11:31:50.177 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/f71882fg.ko 2023-12-17T11:31:50.177 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/f75375s.ko 2023-12-17T11:31:50.177 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/fam15h_power.ko 2023-12-17T11:31:50.177 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/fschmd.ko 2023-12-17T11:31:50.177 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/g760a.ko 2023-12-17T11:31:50.177 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/g762.ko 2023-12-17T11:31:50.177 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/gl518sm.ko 2023-12-17T11:31:50.177 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/gl520sm.ko 2023-12-17T11:31:50.178 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/hwmon-vid.ko 2023-12-17T11:31:50.178 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/i5500_temp.ko 2023-12-17T11:31:50.178 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/i5k_amb.ko 2023-12-17T11:31:50.178 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ibmaem.ko 2023-12-17T11:31:50.178 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ibmpex.ko 2023-12-17T11:31:50.178 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ina209.ko 2023-12-17T11:31:50.178 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ina2xx.ko 2023-12-17T11:31:50.178 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/it87.ko 2023-12-17T11:31:50.178 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/k10temp.ko 2023-12-17T11:31:50.178 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/k8temp.ko 2023-12-17T11:31:50.178 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lineage-pem.ko 2023-12-17T11:31:50.178 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm63.ko 2023-12-17T11:31:50.178 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm73.ko 2023-12-17T11:31:50.178 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm75.ko 2023-12-17T11:31:50.178 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm77.ko 2023-12-17T11:31:50.179 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm78.ko 2023-12-17T11:31:50.179 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm80.ko 2023-12-17T11:31:50.179 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm83.ko 2023-12-17T11:31:50.179 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm85.ko 2023-12-17T11:31:50.179 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm87.ko 2023-12-17T11:31:50.179 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm90.ko 2023-12-17T11:31:50.179 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm92.ko 2023-12-17T11:31:50.179 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm93.ko 2023-12-17T11:31:50.179 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm95234.ko 2023-12-17T11:31:50.179 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm95241.ko 2023-12-17T11:31:50.179 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm95245.ko 2023-12-17T11:31:50.179 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ltc2945.ko 2023-12-17T11:31:50.179 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ltc4151.ko 2023-12-17T11:31:50.179 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ltc4215.ko 2023-12-17T11:31:50.180 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ltc4222.ko 2023-12-17T11:31:50.180 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ltc4245.ko 2023-12-17T11:31:50.180 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ltc4260.ko 2023-12-17T11:31:50.180 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ltc4261.ko 2023-12-17T11:31:50.180 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/max16065.ko 2023-12-17T11:31:50.180 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/max1619.ko 2023-12-17T11:31:50.180 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/max1668.ko 2023-12-17T11:31:50.180 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/max197.ko 2023-12-17T11:31:50.180 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/max6639.ko 2023-12-17T11:31:50.180 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/max6650.ko 2023-12-17T11:31:50.180 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/max6697.ko 2023-12-17T11:31:50.180 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/mcp3021.ko 2023-12-17T11:31:50.180 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/nct6683.ko 2023-12-17T11:31:50.180 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/nct6775-core.ko 2023-12-17T11:31:50.181 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/nct6775.ko 2023-12-17T11:31:50.181 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/nct7802.ko 2023-12-17T11:31:50.181 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pc87360.ko 2023-12-17T11:31:50.181 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pc87427.ko 2023-12-17T11:31:50.181 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pcf8591.ko 2023-12-17T11:31:50.181 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus 2023-12-17T11:31:50.181 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/adm1275.ko 2023-12-17T11:31:50.181 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/lm25066.ko 2023-12-17T11:31:50.181 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/ltc2978.ko 2023-12-17T11:31:50.181 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/max16064.ko 2023-12-17T11:31:50.181 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/max34440.ko 2023-12-17T11:31:50.181 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/max8688.ko 2023-12-17T11:31:50.181 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/pmbus.ko 2023-12-17T11:31:50.181 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2023-12-17T11:31:50.182 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/tps40422.ko 2023-12-17T11:31:50.182 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/ucd9000.ko 2023-12-17T11:31:50.182 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/ucd9200.ko 2023-12-17T11:31:50.182 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/zl6100.ko 2023-12-17T11:31:50.182 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/powr1220.ko 2023-12-17T11:31:50.182 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/sch5627.ko 2023-12-17T11:31:50.182 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/sch5636.ko 2023-12-17T11:31:50.182 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/sch56xx-common.ko 2023-12-17T11:31:50.182 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/sht15.ko 2023-12-17T11:31:50.182 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/sht21.ko 2023-12-17T11:31:50.182 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/shtc1.ko 2023-12-17T11:31:50.182 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/sis5595.ko 2023-12-17T11:31:50.182 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/smsc47b397.ko 2023-12-17T11:31:50.182 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/smsc47m1.ko 2023-12-17T11:31:50.182 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/smsc47m192.ko 2023-12-17T11:31:50.182 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/thmc50.ko 2023-12-17T11:31:50.183 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/tmp102.ko 2023-12-17T11:31:50.183 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/tmp103.ko 2023-12-17T11:31:50.183 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/tmp401.ko 2023-12-17T11:31:50.183 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/tmp421.ko 2023-12-17T11:31:50.183 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/via-cputemp.ko 2023-12-17T11:31:50.183 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/via686a.ko 2023-12-17T11:31:50.183 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/vt1211.ko 2023-12-17T11:31:50.183 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/vt8231.ko 2023-12-17T11:31:50.183 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/w83627ehf.ko 2023-12-17T11:31:50.183 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/w83627hf.ko 2023-12-17T11:31:50.183 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/w83781d.ko 2023-12-17T11:31:50.183 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/w83791d.ko 2023-12-17T11:31:50.183 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/w83792d.ko 2023-12-17T11:31:50.183 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/w83793.ko 2023-12-17T11:31:50.183 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/w83795.ko 2023-12-17T11:31:50.184 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/w83l785ts.ko 2023-12-17T11:31:50.184 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/w83l786ng.ko 2023-12-17T11:31:50.184 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c 2023-12-17T11:31:50.184 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/algos 2023-12-17T11:31:50.184 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2023-12-17T11:31:50.184 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2023-12-17T11:31:50.184 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses 2023-12-17T11:31:50.184 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2023-12-17T11:31:50.184 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-amd756.ko 2023-12-17T11:31:50.184 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-amd8111.ko 2023-12-17T11:31:50.184 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2023-12-17T11:31:50.184 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-designware-core.ko 2023-12-17T11:31:50.184 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2023-12-17T11:31:50.184 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2023-12-17T11:31:50.184 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2023-12-17T11:31:50.185 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-i801.ko 2023-12-17T11:31:50.185 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-isch.ko 2023-12-17T11:31:50.185 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-ismt.ko 2023-12-17T11:31:50.185 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2023-12-17T11:31:50.185 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-nforce2.ko 2023-12-17T11:31:50.185 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-parport.ko 2023-12-17T11:31:50.185 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2023-12-17T11:31:50.185 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-piix4.ko 2023-12-17T11:31:50.185 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-scmi.ko 2023-12-17T11:31:50.185 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-simtec.ko 2023-12-17T11:31:50.185 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-sis96x.ko 2023-12-17T11:31:50.185 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2023-12-17T11:31:50.185 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-via.ko 2023-12-17T11:31:50.186 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-viapro.ko 2023-12-17T11:31:50.186 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-viperboard.ko 2023-12-17T11:31:50.186 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/i2c-dev.ko 2023-12-17T11:31:50.186 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/i2c-mux.ko 2023-12-17T11:31:50.186 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/i2c-slave-eeprom.ko 2023-12-17T11:31:50.186 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/i2c-smbus.ko 2023-12-17T11:31:50.186 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/i2c-stub.ko 2023-12-17T11:31:50.186 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband 2023-12-17T11:31:50.186 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/core 2023-12-17T11:31:50.186 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/core/ib_cm.ko 2023-12-17T11:31:50.186 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/core/ib_core.ko 2023-12-17T11:31:50.186 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/core/ib_umad.ko 2023-12-17T11:31:50.186 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/core/ib_uverbs.ko 2023-12-17T11:31:50.186 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/core/iw_cm.ko 2023-12-17T11:31:50.187 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/core/rdma_cm.ko 2023-12-17T11:31:50.187 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/core/rdma_ucm.ko 2023-12-17T11:31:50.187 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw 2023-12-17T11:31:50.187 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw/cxgb4 2023-12-17T11:31:50.187 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2023-12-17T11:31:50.187 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw/mlx4 2023-12-17T11:31:50.187 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2023-12-17T11:31:50.187 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw/mlx5 2023-12-17T11:31:50.187 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2023-12-17T11:31:50.187 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw/mthca 2023-12-17T11:31:50.187 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2023-12-17T11:31:50.187 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp 2023-12-17T11:31:50.187 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/ipoib 2023-12-17T11:31:50.187 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2023-12-17T11:31:50.187 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/iser 2023-12-17T11:31:50.188 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2023-12-17T11:31:50.188 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/isert 2023-12-17T11:31:50.188 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2023-12-17T11:31:50.188 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/srp 2023-12-17T11:31:50.188 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2023-12-17T11:31:50.188 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/srpt 2023-12-17T11:31:50.188 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2023-12-17T11:31:50.188 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input 2023-12-17T11:31:50.188 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/gameport 2023-12-17T11:31:50.188 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/gameport/emu10k1-gp.ko 2023-12-17T11:31:50.188 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/gameport/fm801-gp.ko 2023-12-17T11:31:50.188 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/gameport/gameport.ko 2023-12-17T11:31:50.188 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/joydev.ko 2023-12-17T11:31:50.188 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard 2023-12-17T11:31:50.188 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard/gpio_keys.ko 2023-12-17T11:31:50.189 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/mouse 2023-12-17T11:31:50.189 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/mouse/appletouch.ko 2023-12-17T11:31:50.189 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/mouse/bcm5974.ko 2023-12-17T11:31:50.189 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/mouse/cyapatp.ko 2023-12-17T11:31:50.189 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/mouse/elan_i2c.ko 2023-12-17T11:31:50.189 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/mouse/sermouse.ko 2023-12-17T11:31:50.189 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/mouse/synaptics_i2c.ko 2023-12-17T11:31:50.189 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/mouse/synaptics_usb.ko 2023-12-17T11:31:50.189 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/mouse/vsxxxaa.ko 2023-12-17T11:31:50.189 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/rmi4 2023-12-17T11:31:50.189 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/rmi4/rmi_core.ko 2023-12-17T11:31:50.189 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/serio 2023-12-17T11:31:50.189 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/serio/altera_ps2.ko 2023-12-17T11:31:50.190 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/serio/arc_ps2.ko 2023-12-17T11:31:50.190 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/serio/hyperv-keyboard.ko 2023-12-17T11:31:50.190 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/serio/serio_raw.ko 2023-12-17T11:31:50.190 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/sparse-keymap.ko 2023-12-17T11:31:50.190 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/iommu 2023-12-17T11:31:50.190 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/iommu/amd 2023-12-17T11:31:50.190 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/iommu/amd/iommu_v2.ko 2023-12-17T11:31:50.190 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds 2023-12-17T11:31:50.190 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-blinkm.ko 2023-12-17T11:31:50.190 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-lm3530.ko 2023-12-17T11:31:50.190 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-lp3944.ko 2023-12-17T11:31:50.190 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-ss4200.ko 2023-12-17T11:31:50.190 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/trigger 2023-12-17T11:31:50.190 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/trigger/ledtrig-audio.ko 2023-12-17T11:31:50.190 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2023-12-17T11:31:50.191 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/trigger/ledtrig-camera.ko 2023-12-17T11:31:50.191 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2023-12-17T11:31:50.191 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2023-12-17T11:31:50.191 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2023-12-17T11:31:50.191 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/trigger/ledtrig-timer.ko 2023-12-17T11:31:50.191 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/trigger/ledtrig-transient.ko 2023-12-17T11:31:50.191 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md 2023-12-17T11:31:50.191 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/bcache 2023-12-17T11:31:50.191 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/bcache/bcache.ko 2023-12-17T11:31:50.191 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-bio-prison.ko 2023-12-17T11:31:50.191 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-cache-smq.ko 2023-12-17T11:31:50.191 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-cache.ko 2023-12-17T11:31:50.191 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-crypt.ko 2023-12-17T11:31:50.191 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-delay.ko 2023-12-17T11:31:50.191 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-flakey.ko 2023-12-17T11:31:50.191 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-log-userspace.ko 2023-12-17T11:31:50.192 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-multipath.ko 2023-12-17T11:31:50.192 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-queue-length.ko 2023-12-17T11:31:50.192 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-raid.ko 2023-12-17T11:31:50.192 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-round-robin.ko 2023-12-17T11:31:50.192 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-service-time.ko 2023-12-17T11:31:50.192 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-switch.ko 2023-12-17T11:31:50.192 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-thin-pool.ko 2023-12-17T11:31:50.192 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-verity.ko 2023-12-17T11:31:50.192 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/faulty.ko 2023-12-17T11:31:50.192 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/linear.ko 2023-12-17T11:31:50.192 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/multipath.ko 2023-12-17T11:31:50.192 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/persistent-data 2023-12-17T11:31:50.192 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2023-12-17T11:31:50.192 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/raid0.ko 2023-12-17T11:31:50.193 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/raid1.ko 2023-12-17T11:31:50.193 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/raid10.ko 2023-12-17T11:31:50.193 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/raid456.ko 2023-12-17T11:31:50.193 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/message 2023-12-17T11:31:50.193 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/message/fusion 2023-12-17T11:31:50.193 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/message/fusion/mptbase.ko 2023-12-17T11:31:50.193 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/message/fusion/mptctl.ko 2023-12-17T11:31:50.193 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/message/fusion/mptfc.ko 2023-12-17T11:31:50.193 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/message/fusion/mptlan.ko 2023-12-17T11:31:50.193 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/message/fusion/mptsas.ko 2023-12-17T11:31:50.194 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/message/fusion/mptscsih.ko 2023-12-17T11:31:50.194 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/message/fusion/mptspi.ko 2023-12-17T11:31:50.194 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd 2023-12-17T11:31:50.194 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/lpc_ich.ko 2023-12-17T11:31:50.194 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/lpc_sch.ko 2023-12-17T11:31:50.194 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/mfd-core.ko 2023-12-17T11:31:50.194 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/sm501.ko 2023-12-17T11:31:50.194 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/viperboard.ko 2023-12-17T11:31:50.194 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/vx855.ko 2023-12-17T11:31:50.194 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/wl1273-core.ko 2023-12-17T11:31:50.194 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc 2023-12-17T11:31:50.194 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/altera-stapl 2023-12-17T11:31:50.194 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2023-12-17T11:31:50.194 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/apds9802als.ko 2023-12-17T11:31:50.194 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/apds990x.ko 2023-12-17T11:31:50.195 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/bh1770glc.ko 2023-12-17T11:31:50.195 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/cb710 2023-12-17T11:31:50.195 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/cb710/cb710.ko 2023-12-17T11:31:50.195 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/eeprom 2023-12-17T11:31:50.195 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/eeprom/at24.ko 2023-12-17T11:31:50.195 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/eeprom/eeprom.ko 2023-12-17T11:31:50.195 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2023-12-17T11:31:50.195 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/eeprom/max6875.ko 2023-12-17T11:31:50.195 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/enclosure.ko 2023-12-17T11:31:50.195 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/hpilo.ko 2023-12-17T11:31:50.195 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/isl29003.ko 2023-12-17T11:31:50.195 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/isl29020.ko 2023-12-17T11:31:50.195 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/lis3lv02d 2023-12-17T11:31:50.195 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2023-12-17T11:31:50.195 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2023-12-17T11:31:50.195 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/mei 2023-12-17T11:31:50.196 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/mei/mei-me.ko 2023-12-17T11:31:50.196 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/mei/mei-txe.ko 2023-12-17T11:31:50.196 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/mei/mei.ko 2023-12-17T11:31:50.196 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/sgi-gru 2023-12-17T11:31:50.196 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/sgi-gru/gru.ko 2023-12-17T11:31:50.196 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/sgi-xp 2023-12-17T11:31:50.196 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/sgi-xp/xp.ko 2023-12-17T11:31:50.196 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/sgi-xp/xpc.ko 2023-12-17T11:31:50.196 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/sgi-xp/xpnet.ko 2023-12-17T11:31:50.196 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/tifm_7xx1.ko 2023-12-17T11:31:50.196 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/tifm_core.ko 2023-12-17T11:31:50.196 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/tsl2550.ko 2023-12-17T11:31:50.196 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/vmw_balloon.ko 2023-12-17T11:31:50.196 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/vmw_vmci 2023-12-17T11:31:50.197 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2023-12-17T11:31:50.197 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net 2023-12-17T11:31:50.197 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/bonding 2023-12-17T11:31:50.197 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/bonding/bonding.ko 2023-12-17T11:31:50.197 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/dsa 2023-12-17T11:31:50.197 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/dsa/b53 2023-12-17T11:31:50.197 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/dsa/b53/b53_common.ko 2023-12-17T11:31:50.197 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/dsa/bcm-sf2.ko 2023-12-17T11:31:50.197 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/dsa/mv88e6060.ko 2023-12-17T11:31:50.197 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/dsa/mv88e6xxx 2023-12-17T11:31:50.197 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2023-12-17T11:31:50.197 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/dummy.ko 2023-12-17T11:31:50.197 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/eql.ko 2023-12-17T11:31:50.198 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet 2023-12-17T11:31:50.198 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/3com 2023-12-17T11:31:50.198 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2023-12-17T11:31:50.198 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2023-12-17T11:31:50.198 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/3com/3c59x.ko 2023-12-17T11:31:50.198 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/3com/typhoon.ko 2023-12-17T11:31:50.198 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/8390 2023-12-17T11:31:50.198 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/8390/8390.ko 2023-12-17T11:31:50.198 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2023-12-17T11:31:50.198 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2023-12-17T11:31:50.198 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2023-12-17T11:31:50.198 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/adaptec 2023-12-17T11:31:50.198 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/adaptec/starfire.ko 2023-12-17T11:31:50.198 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/agere 2023-12-17T11:31:50.198 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/agere/et131x.ko 2023-12-17T11:31:50.198 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/alteon 2023-12-17T11:31:50.199 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/alteon/acenic.ko 2023-12-17T11:31:50.199 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/altera 2023-12-17T11:31:50.199 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/altera/altera_tse.ko 2023-12-17T11:31:50.199 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/amd 2023-12-17T11:31:50.199 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/amd/amd8111e.ko 2023-12-17T11:31:50.199 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2023-12-17T11:31:50.199 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/amd/pcnet32.ko 2023-12-17T11:31:50.199 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros 2023-12-17T11:31:50.199 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros/alx 2023-12-17T11:31:50.199 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2023-12-17T11:31:50.199 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros/atl1c 2023-12-17T11:31:50.199 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2023-12-17T11:31:50.199 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros/atl1e 2023-12-17T11:31:50.199 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2023-12-17T11:31:50.199 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros/atlx 2023-12-17T11:31:50.200 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2023-12-17T11:31:50.200 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2023-12-17T11:31:50.200 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/broadcom 2023-12-17T11:31:50.200 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/broadcom/b44.ko 2023-12-17T11:31:50.200 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2023-12-17T11:31:50.200 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/broadcom/bnx2x 2023-12-17T11:31:50.200 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2023-12-17T11:31:50.200 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/broadcom/cnic.ko 2023-12-17T11:31:50.200 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/broadcom/genet 2023-12-17T11:31:50.200 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2023-12-17T11:31:50.200 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/broadcom/tg3.ko 2023-12-17T11:31:50.200 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/brocade 2023-12-17T11:31:50.200 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/brocade/bna 2023-12-17T11:31:50.200 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2023-12-17T11:31:50.200 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio 2023-12-17T11:31:50.201 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/cxgb 2023-12-17T11:31:50.201 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2023-12-17T11:31:50.201 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/cxgb3 2023-12-17T11:31:50.201 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2023-12-17T11:31:50.201 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/cxgb4 2023-12-17T11:31:50.201 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2023-12-17T11:31:50.201 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2023-12-17T11:31:50.201 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2023-12-17T11:31:50.201 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/libcxgb 2023-12-17T11:31:50.201 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2023-12-17T11:31:50.202 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/cisco 2023-12-17T11:31:50.202 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/cisco/enic 2023-12-17T11:31:50.202 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2023-12-17T11:31:50.202 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dec 2023-12-17T11:31:50.202 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dec/tulip 2023-12-17T11:31:50.202 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2023-12-17T11:31:50.202 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2023-12-17T11:31:50.202 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2023-12-17T11:31:50.202 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2023-12-17T11:31:50.202 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2023-12-17T11:31:50.202 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2023-12-17T11:31:50.202 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dlink 2023-12-17T11:31:50.202 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dlink/dl2k.ko 2023-12-17T11:31:50.202 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dlink/sundance.ko 2023-12-17T11:31:50.202 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dnet.ko 2023-12-17T11:31:50.203 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/emulex 2023-12-17T11:31:50.203 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/emulex/benet 2023-12-17T11:31:50.203 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2023-12-17T11:31:50.203 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/ethoc.ko 2023-12-17T11:31:50.203 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/fealnx.ko 2023-12-17T11:31:50.203 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel 2023-12-17T11:31:50.203 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/e100.ko 2023-12-17T11:31:50.203 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/e1000 2023-12-17T11:31:50.203 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2023-12-17T11:31:50.203 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/e1000e 2023-12-17T11:31:50.203 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2023-12-17T11:31:50.203 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/fm10k 2023-12-17T11:31:50.203 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2023-12-17T11:31:50.203 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/i40e 2023-12-17T11:31:50.204 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2023-12-17T11:31:50.204 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/iavf 2023-12-17T11:31:50.204 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2023-12-17T11:31:50.204 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/igb 2023-12-17T11:31:50.204 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/igb/igb.ko 2023-12-17T11:31:50.204 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/igbvf 2023-12-17T11:31:50.204 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2023-12-17T11:31:50.204 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/ixgbe 2023-12-17T11:31:50.204 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2023-12-17T11:31:50.204 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/ixgbevf 2023-12-17T11:31:50.204 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2023-12-17T11:31:50.204 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/jme.ko 2023-12-17T11:31:50.204 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/marvell 2023-12-17T11:31:50.204 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2023-12-17T11:31:50.205 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/marvell/skge.ko 2023-12-17T11:31:50.205 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/marvell/sky2.ko 2023-12-17T11:31:50.205 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/mellanox 2023-12-17T11:31:50.205 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/mellanox/mlx4 2023-12-17T11:31:50.205 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2023-12-17T11:31:50.205 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2023-12-17T11:31:50.205 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/mellanox/mlx5 2023-12-17T11:31:50.205 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/mellanox/mlx5/core 2023-12-17T11:31:50.205 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2023-12-17T11:31:50.205 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/micrel 2023-12-17T11:31:50.205 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2023-12-17T11:31:50.205 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/myricom 2023-12-17T11:31:50.205 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/myricom/myri10ge 2023-12-17T11:31:50.205 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2023-12-17T11:31:50.205 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/natsemi 2023-12-17T11:31:50.206 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2023-12-17T11:31:50.206 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2023-12-17T11:31:50.206 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/neterion 2023-12-17T11:31:50.206 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/neterion/s2io.ko 2023-12-17T11:31:50.206 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/nvidia 2023-12-17T11:31:50.206 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2023-12-17T11:31:50.206 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/packetengines 2023-12-17T11:31:50.206 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2023-12-17T11:31:50.206 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2023-12-17T11:31:50.206 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/qlogic 2023-12-17T11:31:50.206 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/qlogic/netxen 2023-12-17T11:31:50.206 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2023-12-17T11:31:50.206 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2023-12-17T11:31:50.206 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/qlogic/qlcnic 2023-12-17T11:31:50.206 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2023-12-17T11:31:50.207 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/rdc 2023-12-17T11:31:50.207 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/rdc/r6040.ko 2023-12-17T11:31:50.207 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/realtek 2023-12-17T11:31:50.207 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/realtek/8139cp.ko 2023-12-17T11:31:50.207 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/realtek/8139too.ko 2023-12-17T11:31:50.207 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/realtek/atp.ko 2023-12-17T11:31:50.207 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/realtek/r8169.ko 2023-12-17T11:31:50.207 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/rocker 2023-12-17T11:31:50.207 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/rocker/rocker.ko 2023-12-17T11:31:50.207 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sfc 2023-12-17T11:31:50.207 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sfc/sfc.ko 2023-12-17T11:31:50.207 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/silan 2023-12-17T11:31:50.207 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/silan/sc92031.ko 2023-12-17T11:31:50.207 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sis 2023-12-17T11:31:50.208 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sis/sis190.ko 2023-12-17T11:31:50.208 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sis/sis900.ko 2023-12-17T11:31:50.208 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/smsc 2023-12-17T11:31:50.208 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/smsc/epic100.ko 2023-12-17T11:31:50.208 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2023-12-17T11:31:50.208 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2023-12-17T11:31:50.208 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2023-12-17T11:31:50.208 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/stmicro 2023-12-17T11:31:50.208 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/stmicro/stmmac 2023-12-17T11:31:50.208 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2023-12-17T11:31:50.208 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2023-12-17T11:31:50.208 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sun 2023-12-17T11:31:50.208 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sun/cassini.ko 2023-12-17T11:31:50.208 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sun/niu.ko 2023-12-17T11:31:50.208 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sun/sungem.ko 2023-12-17T11:31:50.209 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sun/sunhme.ko 2023-12-17T11:31:50.209 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/tehuti 2023-12-17T11:31:50.209 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2023-12-17T11:31:50.209 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/ti 2023-12-17T11:31:50.209 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/ti/tlan.ko 2023-12-17T11:31:50.209 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/via 2023-12-17T11:31:50.209 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/via/via-rhine.ko 2023-12-17T11:31:50.209 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/via/via-velocity.ko 2023-12-17T11:31:50.209 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/wiznet 2023-12-17T11:31:50.209 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/wiznet/w5100.ko 2023-12-17T11:31:50.209 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/wiznet/w5300.ko 2023-12-17T11:31:50.209 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/xircom 2023-12-17T11:31:50.209 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2023-12-17T11:31:50.209 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/geneve.ko 2023-12-17T11:31:50.209 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/hyperv 2023-12-17T11:31:50.210 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/hyperv/hv_netvsc.ko 2023-12-17T11:31:50.210 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ieee802154 2023-12-17T11:31:50.210 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ieee802154/fakelb.ko 2023-12-17T11:31:50.210 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ifb.ko 2023-12-17T11:31:50.210 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ipvlan 2023-12-17T11:31:50.210 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ipvlan/ipvlan.ko 2023-12-17T11:31:50.210 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/macvlan.ko 2023-12-17T11:31:50.210 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/macvtap.ko 2023-12-17T11:31:50.210 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/mdio 2023-12-17T11:31:50.210 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/mdio.ko 2023-12-17T11:31:50.210 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2023-12-17T11:31:50.210 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/mdio/mdio-bitbang.ko 2023-12-17T11:31:50.210 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/mdio/mdio-regmap.ko 2023-12-17T11:31:50.210 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/mii.ko 2023-12-17T11:31:50.211 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/net_failover.ko 2023-12-17T11:31:50.211 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/netconsole.ko 2023-12-17T11:31:50.211 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/nlmon.ko 2023-12-17T11:31:50.211 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/pcs 2023-12-17T11:31:50.211 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/pcs/pcs-lynx.ko 2023-12-17T11:31:50.211 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/pcs/pcs_xpcs.ko 2023-12-17T11:31:50.211 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy 2023-12-17T11:31:50.211 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/amd.ko 2023-12-17T11:31:50.211 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/bcm-phy-lib.ko 2023-12-17T11:31:50.211 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/bcm-phy-ptp.ko 2023-12-17T11:31:50.211 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/bcm7xxx.ko 2023-12-17T11:31:50.211 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/bcm87xx.ko 2023-12-17T11:31:50.211 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/broadcom.ko 2023-12-17T11:31:50.211 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/cicada.ko 2023-12-17T11:31:50.211 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/davicom.ko 2023-12-17T11:31:50.211 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/dp83640.ko 2023-12-17T11:31:50.211 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/et1011c.ko 2023-12-17T11:31:50.212 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/icplus.ko 2023-12-17T11:31:50.212 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/lxt.ko 2023-12-17T11:31:50.212 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/marvell.ko 2023-12-17T11:31:50.212 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/micrel.ko 2023-12-17T11:31:50.212 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/national.ko 2023-12-17T11:31:50.212 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/phylink.ko 2023-12-17T11:31:50.212 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/qsemi.ko 2023-12-17T11:31:50.212 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/realtek.ko 2023-12-17T11:31:50.212 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/smsc.ko 2023-12-17T11:31:50.212 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/ste10Xp.ko 2023-12-17T11:31:50.212 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/vitesse.ko 2023-12-17T11:31:50.212 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ppp 2023-12-17T11:31:50.212 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ppp/bsd_comp.ko 2023-12-17T11:31:50.212 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ppp/ppp_async.ko 2023-12-17T11:31:50.212 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ppp/ppp_deflate.ko 2023-12-17T11:31:50.212 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ppp/ppp_generic.ko 2023-12-17T11:31:50.213 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ppp/ppp_mppe.ko 2023-12-17T11:31:50.213 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ppp/ppp_synctty.ko 2023-12-17T11:31:50.213 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ppp/pppoe.ko 2023-12-17T11:31:50.213 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ppp/pppox.ko 2023-12-17T11:31:50.213 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ppp/pptp.ko 2023-12-17T11:31:50.213 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/slip 2023-12-17T11:31:50.213 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/slip/slhc.ko 2023-12-17T11:31:50.213 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/slip/slip.ko 2023-12-17T11:31:50.213 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/sungem_phy.ko 2023-12-17T11:31:50.213 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/tap.ko 2023-12-17T11:31:50.213 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/team 2023-12-17T11:31:50.213 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/team/team.ko 2023-12-17T11:31:50.213 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/team/team_mode_activebackup.ko 2023-12-17T11:31:50.213 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/team/team_mode_broadcast.ko 2023-12-17T11:31:50.213 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/team/team_mode_loadbalance.ko 2023-12-17T11:31:50.214 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/team/team_mode_random.ko 2023-12-17T11:31:50.214 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/team/team_mode_roundrobin.ko 2023-12-17T11:31:50.214 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/tun.ko 2023-12-17T11:31:50.214 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/veth.ko 2023-12-17T11:31:50.214 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/virtio_net.ko 2023-12-17T11:31:50.214 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/vmxnet3 2023-12-17T11:31:50.214 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/vmxnet3/vmxnet3.ko 2023-12-17T11:31:50.214 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/vxlan 2023-12-17T11:31:50.214 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/vxlan/vxlan.ko 2023-12-17T11:31:50.214 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/xen-netback 2023-12-17T11:31:50.214 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/xen-netback/xen-netback.ko 2023-12-17T11:31:50.214 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/xen-netfront.ko 2023-12-17T11:31:50.214 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ntb 2023-12-17T11:31:50.214 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ntb/ntb.ko 2023-12-17T11:31:50.214 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/nvme 2023-12-17T11:31:50.214 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/nvme/host 2023-12-17T11:31:50.215 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/nvme/host/nvme-core.ko 2023-12-17T11:31:50.215 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/nvme/host/nvme.ko 2023-12-17T11:31:50.215 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/parport 2023-12-17T11:31:50.215 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/parport/parport.ko 2023-12-17T11:31:50.215 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/parport/parport_cs.ko 2023-12-17T11:31:50.215 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/parport/parport_pc.ko 2023-12-17T11:31:50.215 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/parport/parport_serial.ko 2023-12-17T11:31:50.215 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pci 2023-12-17T11:31:50.215 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pci/hotplug 2023-12-17T11:31:50.215 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2023-12-17T11:31:50.215 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pci/pcie 2023-12-17T11:31:50.215 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pci/pcie/aer_inject.ko 2023-12-17T11:31:50.215 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pci/xen-pcifront.ko 2023-12-17T11:31:50.215 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pcmcia 2023-12-17T11:31:50.215 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pcmcia/i82092.ko 2023-12-17T11:31:50.215 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pcmcia/pd6729.ko 2023-12-17T11:31:50.215 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pcmcia/yenta_socket.ko 2023-12-17T11:31:50.216 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pinctrl 2023-12-17T11:31:50.216 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pinctrl/intel 2023-12-17T11:31:50.216 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2023-12-17T11:31:50.216 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform 2023-12-17T11:31:50.216 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86 2023-12-17T11:31:50.216 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/acer-wmi.ko 2023-12-17T11:31:50.216 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/acerhdf.ko 2023-12-17T11:31:50.216 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/apple-gmux.ko 2023-12-17T11:31:50.216 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/asus-laptop.ko 2023-12-17T11:31:50.216 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/asus-nb-wmi.ko 2023-12-17T11:31:50.216 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/asus-wmi.ko 2023-12-17T11:31:50.216 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/classmate-laptop.ko 2023-12-17T11:31:50.216 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/eeepc-laptop.ko 2023-12-17T11:31:50.216 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/eeepc-wmi.ko 2023-12-17T11:31:50.216 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/fujitsu-laptop.ko 2023-12-17T11:31:50.216 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/fujitsu-tablet.ko 2023-12-17T11:31:50.217 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/hdaps.ko 2023-12-17T11:31:50.217 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/intel 2023-12-17T11:31:50.217 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/intel/intel-rst.ko 2023-12-17T11:31:50.217 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/intel_ips.ko 2023-12-17T11:31:50.217 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/msi-wmi.ko 2023-12-17T11:31:50.217 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/mxm-wmi.ko 2023-12-17T11:31:50.217 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/panasonic-laptop.ko 2023-12-17T11:31:50.217 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/samsung-laptop.ko 2023-12-17T11:31:50.217 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/samsung-q10.ko 2023-12-17T11:31:50.217 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/topstar-laptop.ko 2023-12-17T11:31:50.217 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2023-12-17T11:31:50.217 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/toshiba_haps.ko 2023-12-17T11:31:50.217 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/wmi-bmof.ko 2023-12-17T11:31:50.218 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/wmi.ko 2023-12-17T11:31:50.218 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/powercap 2023-12-17T11:31:50.218 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/powercap/intel_rapl_common.ko 2023-12-17T11:31:50.218 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/powercap/intel_rapl_msr.ko 2023-12-17T11:31:50.218 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pps 2023-12-17T11:31:50.218 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pps/clients 2023-12-17T11:31:50.218 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pps/clients/pps-gpio.ko 2023-12-17T11:31:50.218 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pps/clients/pps-ldisc.ko 2023-12-17T11:31:50.218 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pps/clients/pps_parport.ko 2023-12-17T11:31:50.218 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pps/pps_core.ko 2023-12-17T11:31:50.218 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ptp 2023-12-17T11:31:50.218 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ptp/ptp.ko 2023-12-17T11:31:50.218 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ptp/ptp_kvm.ko 2023-12-17T11:31:50.218 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc 2023-12-17T11:31:50.218 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-bq32k.ko 2023-12-17T11:31:50.219 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-ds1286.ko 2023-12-17T11:31:50.219 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-ds1307.ko 2023-12-17T11:31:50.219 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-ds1374.ko 2023-12-17T11:31:50.219 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-ds1511.ko 2023-12-17T11:31:50.219 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-ds1553.ko 2023-12-17T11:31:50.219 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-ds1672.ko 2023-12-17T11:31:50.219 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-ds1742.ko 2023-12-17T11:31:50.219 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-ds2404.ko 2023-12-17T11:31:50.219 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-ds3232.ko 2023-12-17T11:31:50.219 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-em3027.ko 2023-12-17T11:31:50.219 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-fm3130.ko 2023-12-17T11:31:50.219 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-isl12022.ko 2023-12-17T11:31:50.219 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-isl1208.ko 2023-12-17T11:31:50.219 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-m41t80.ko 2023-12-17T11:31:50.220 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-m48t35.ko 2023-12-17T11:31:50.220 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-m48t59.ko 2023-12-17T11:31:50.220 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-max6900.ko 2023-12-17T11:31:50.220 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-msm6242.ko 2023-12-17T11:31:50.220 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-pcf2127.ko 2023-12-17T11:31:50.220 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-pcf85063.ko 2023-12-17T11:31:50.220 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-pcf8523.ko 2023-12-17T11:31:50.220 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-pcf8563.ko 2023-12-17T11:31:50.220 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-pcf8583.ko 2023-12-17T11:31:50.220 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-rp5c01.ko 2023-12-17T11:31:50.220 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-rs5c372.ko 2023-12-17T11:31:50.220 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-rv3029c2.ko 2023-12-17T11:31:50.220 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-rx8025.ko 2023-12-17T11:31:50.221 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-rx8581.ko 2023-12-17T11:31:50.221 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-stk17ta8.ko 2023-12-17T11:31:50.221 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-x1205.ko 2023-12-17T11:31:50.221 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi 2023-12-17T11:31:50.221 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/3w-9xxx.ko 2023-12-17T11:31:50.221 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/3w-sas.ko 2023-12-17T11:31:50.221 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/3w-xxxx.ko 2023-12-17T11:31:50.221 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/BusLogic.ko 2023-12-17T11:31:50.221 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/a100u2w.ko 2023-12-17T11:31:50.221 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/aacraid 2023-12-17T11:31:50.221 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/aacraid/aacraid.ko 2023-12-17T11:31:50.221 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/advansys.ko 2023-12-17T11:31:50.221 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/aic7xxx 2023-12-17T11:31:50.221 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2023-12-17T11:31:50.222 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2023-12-17T11:31:50.222 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/am53c974.ko 2023-12-17T11:31:50.222 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/arcmsr 2023-12-17T11:31:50.222 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/arcmsr/arcmsr.ko 2023-12-17T11:31:50.222 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/atp870u.ko 2023-12-17T11:31:50.222 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/be2iscsi 2023-12-17T11:31:50.222 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2023-12-17T11:31:50.222 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/bfa 2023-12-17T11:31:50.222 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/bfa/bfa.ko 2023-12-17T11:31:50.222 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/bnx2fc 2023-12-17T11:31:50.222 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2023-12-17T11:31:50.222 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/bnx2i 2023-12-17T11:31:50.222 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/bnx2i/bnx2i.ko 2023-12-17T11:31:50.222 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/ch.ko 2023-12-17T11:31:50.222 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/csiostor 2023-12-17T11:31:50.223 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/csiostor/csiostor.ko 2023-12-17T11:31:50.223 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/cxgbi 2023-12-17T11:31:50.223 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/cxgbi/cxgb3i 2023-12-17T11:31:50.223 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2023-12-17T11:31:50.223 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/cxgbi/cxgb4i 2023-12-17T11:31:50.223 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2023-12-17T11:31:50.223 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2023-12-17T11:31:50.223 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/dc395x.ko 2023-12-17T11:31:50.223 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/device_handler 2023-12-17T11:31:50.223 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2023-12-17T11:31:50.223 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2023-12-17T11:31:50.223 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2023-12-17T11:31:50.223 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2023-12-17T11:31:50.223 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/dmx3191d.ko 2023-12-17T11:31:50.223 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/esas2r 2023-12-17T11:31:50.224 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/esas2r/esas2r.ko 2023-12-17T11:31:50.224 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/esp_scsi.ko 2023-12-17T11:31:50.224 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/fcoe 2023-12-17T11:31:50.224 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/fcoe/fcoe.ko 2023-12-17T11:31:50.224 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/fcoe/libfcoe.ko 2023-12-17T11:31:50.224 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/fnic 2023-12-17T11:31:50.224 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/fnic/fnic.ko 2023-12-17T11:31:50.224 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/hpsa.ko 2023-12-17T11:31:50.224 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/hptiop.ko 2023-12-17T11:31:50.224 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/hv_storvsc.ko 2023-12-17T11:31:50.224 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/initio.ko 2023-12-17T11:31:50.224 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/ipr.ko 2023-12-17T11:31:50.224 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/ips.ko 2023-12-17T11:31:50.224 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/isci 2023-12-17T11:31:50.224 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/isci/isci.ko 2023-12-17T11:31:50.225 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2023-12-17T11:31:50.225 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/iscsi_tcp.ko 2023-12-17T11:31:50.225 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/libfc 2023-12-17T11:31:50.225 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/libfc/libfc.ko 2023-12-17T11:31:50.225 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/libiscsi.ko 2023-12-17T11:31:50.225 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/libiscsi_tcp.ko 2023-12-17T11:31:50.225 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/libsas 2023-12-17T11:31:50.225 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/libsas/libsas.ko 2023-12-17T11:31:50.225 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/lpfc 2023-12-17T11:31:50.225 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/lpfc/lpfc.ko 2023-12-17T11:31:50.225 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/megaraid 2023-12-17T11:31:50.226 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/megaraid.ko 2023-12-17T11:31:50.226 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2023-12-17T11:31:50.226 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2023-12-17T11:31:50.226 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2023-12-17T11:31:50.226 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/mpt3sas 2023-12-17T11:31:50.226 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2023-12-17T11:31:50.226 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/mvsas 2023-12-17T11:31:50.226 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/mvsas/mvsas.ko 2023-12-17T11:31:50.226 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/mvumi.ko 2023-12-17T11:31:50.226 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/pm8001 2023-12-17T11:31:50.226 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/pm8001/pm80xx.ko 2023-12-17T11:31:50.226 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/pmcraid.ko 2023-12-17T11:31:50.227 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/qla1280.ko 2023-12-17T11:31:50.227 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/qla2xxx 2023-12-17T11:31:50.227 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2023-12-17T11:31:50.227 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2023-12-17T11:31:50.227 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/qla4xxx 2023-12-17T11:31:50.227 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2023-12-17T11:31:50.227 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/raid_class.ko 2023-12-17T11:31:50.227 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/scsi_debug.ko 2023-12-17T11:31:50.227 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/scsi_transport_fc.ko 2023-12-17T11:31:50.227 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/scsi_transport_iscsi.ko 2023-12-17T11:31:50.227 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/scsi_transport_sas.ko 2023-12-17T11:31:50.227 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/scsi_transport_spi.ko 2023-12-17T11:31:50.227 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/scsi_transport_srp.ko 2023-12-17T11:31:50.227 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/ses.ko 2023-12-17T11:31:50.228 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/st.ko 2023-12-17T11:31:50.228 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/stex.ko 2023-12-17T11:31:50.228 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/sym53c8xx_2 2023-12-17T11:31:50.228 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2023-12-17T11:31:50.228 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/virtio_scsi.ko 2023-12-17T11:31:50.228 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/vmw_pvscsi.ko 2023-12-17T11:31:50.228 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/wd719x.ko 2023-12-17T11:31:50.228 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ssb 2023-12-17T11:31:50.228 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ssb/ssb.ko 2023-12-17T11:31:50.228 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target 2023-12-17T11:31:50.228 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/iscsi 2023-12-17T11:31:50.228 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2023-12-17T11:31:50.228 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/loopback 2023-12-17T11:31:50.228 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/loopback/tcm_loop.ko 2023-12-17T11:31:50.229 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/target_core_file.ko 2023-12-17T11:31:50.229 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/target_core_iblock.ko 2023-12-17T11:31:50.229 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/target_core_mod.ko 2023-12-17T11:31:50.229 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/target_core_pscsi.ko 2023-12-17T11:31:50.229 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/target_core_user.ko 2023-12-17T11:31:50.229 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/tcm_fc 2023-12-17T11:31:50.229 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/tcm_fc/tcm_fc.ko 2023-12-17T11:31:50.229 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal 2023-12-17T11:31:50.229 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel 2023-12-17T11:31:50.229 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal 2023-12-17T11:31:50.229 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2023-12-17T11:31:50.229 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2023-12-17T11:31:50.229 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2023-12-17T11:31:50.230 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2023-12-17T11:31:50.230 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2023-12-17T11:31:50.230 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2023-12-17T11:31:50.230 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2023-12-17T11:31:50.230 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2023-12-17T11:31:50.230 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2023-12-17T11:31:50.230 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2023-12-17T11:31:50.230 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2023-12-17T11:31:50.230 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2023-12-17T11:31:50.230 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2023-12-17T11:31:50.230 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2023-12-17T11:31:50.230 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2023-12-17T11:31:50.231 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty 2023-12-17T11:31:50.231 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/ipwireless 2023-12-17T11:31:50.231 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/ipwireless/ipwireless.ko 2023-12-17T11:31:50.231 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/n_gsm.ko 2023-12-17T11:31:50.231 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/n_hdlc.ko 2023-12-17T11:31:50.231 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/nozomi.ko 2023-12-17T11:31:50.231 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/serial 2023-12-17T11:31:50.231 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/serial/8250 2023-12-17T11:31:50.231 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/serial/8250/serial_cs.ko 2023-12-17T11:31:50.231 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/serial/arc_uart.ko 2023-12-17T11:31:50.231 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/serial/jsm 2023-12-17T11:31:50.231 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/serial/jsm/jsm.ko 2023-12-17T11:31:50.231 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ufs 2023-12-17T11:31:50.231 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ufs/core 2023-12-17T11:31:50.232 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ufs/core/ufshcd-core.ko 2023-12-17T11:31:50.232 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ufs/host 2023-12-17T11:31:50.232 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ufs/host/ufshcd-pci.ko 2023-12-17T11:31:50.232 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/uio 2023-12-17T11:31:50.232 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/uio/uio.ko 2023-12-17T11:31:50.232 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/uio/uio_aec.ko 2023-12-17T11:31:50.232 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/uio/uio_cif.ko 2023-12-17T11:31:50.232 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/uio/uio_pci_generic.ko 2023-12-17T11:31:50.232 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/uio/uio_sercos3.ko 2023-12-17T11:31:50.232 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb 2023-12-17T11:31:50.233 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/class 2023-12-17T11:31:50.233 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/class/cdc-acm.ko 2023-12-17T11:31:50.233 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/class/cdc-wdm.ko 2023-12-17T11:31:50.233 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/class/usblp.ko 2023-12-17T11:31:50.233 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/class/usbtmc.ko 2023-12-17T11:31:50.233 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/host 2023-12-17T11:31:50.233 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/host/sl811-hcd.ko 2023-12-17T11:31:50.233 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/image 2023-12-17T11:31:50.233 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/image/mdc800.ko 2023-12-17T11:31:50.233 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/image/microtek.ko 2023-12-17T11:31:50.233 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc 2023-12-17T11:31:50.233 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/adutux.ko 2023-12-17T11:31:50.233 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/appledisplay.ko 2023-12-17T11:31:50.234 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/emi26.ko 2023-12-17T11:31:50.234 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/emi62.ko 2023-12-17T11:31:50.234 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/ezusb.ko 2023-12-17T11:31:50.234 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/idmouse.ko 2023-12-17T11:31:50.234 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/iowarrior.ko 2023-12-17T11:31:50.234 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/isight_firmware.ko 2023-12-17T11:31:50.234 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/ldusb.ko 2023-12-17T11:31:50.234 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/legousbtower.ko 2023-12-17T11:31:50.234 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/sisusbvga 2023-12-17T11:31:50.234 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2023-12-17T11:31:50.234 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/trancevibrator.ko 2023-12-17T11:31:50.234 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/usb3503.ko 2023-12-17T11:31:50.234 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/usblcd.ko 2023-12-17T11:31:50.234 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/usbsevseg.ko 2023-12-17T11:31:50.235 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/uss720.ko 2023-12-17T11:31:50.235 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/yurex.ko 2023-12-17T11:31:50.235 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/phy 2023-12-17T11:31:50.235 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/phy/phy-generic.ko 2023-12-17T11:31:50.235 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial 2023-12-17T11:31:50.235 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/aircable.ko 2023-12-17T11:31:50.235 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/ark3116.ko 2023-12-17T11:31:50.235 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/belkin_sa.ko 2023-12-17T11:31:50.235 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/ch341.ko 2023-12-17T11:31:50.235 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/cp210x.ko 2023-12-17T11:31:50.235 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/cyberjack.ko 2023-12-17T11:31:50.235 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/cypress_m8.ko 2023-12-17T11:31:50.236 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/digi_acceleport.ko 2023-12-17T11:31:50.236 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/empeg.ko 2023-12-17T11:31:50.236 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/ftdi_sio.ko 2023-12-17T11:31:50.236 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/garmin_gps.ko 2023-12-17T11:31:50.236 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/io_edgeport.ko 2023-12-17T11:31:50.236 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/io_ti.ko 2023-12-17T11:31:50.236 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/ipaq.ko 2023-12-17T11:31:50.236 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/ipw.ko 2023-12-17T11:31:50.236 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/ir-usb.ko 2023-12-17T11:31:50.236 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/iuu_phoenix.ko 2023-12-17T11:31:50.236 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/keyspan.ko 2023-12-17T11:31:50.236 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/keyspan_pda.ko 2023-12-17T11:31:50.236 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/kl5kusb105.ko 2023-12-17T11:31:50.236 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/kobil_sct.ko 2023-12-17T11:31:50.237 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/mct_u232.ko 2023-12-17T11:31:50.237 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/mos7720.ko 2023-12-17T11:31:50.237 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/mos7840.ko 2023-12-17T11:31:50.237 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/navman.ko 2023-12-17T11:31:50.237 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/omninet.ko 2023-12-17T11:31:50.237 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/opticon.ko 2023-12-17T11:31:50.237 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/option.ko 2023-12-17T11:31:50.237 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/oti6858.ko 2023-12-17T11:31:50.237 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/pl2303.ko 2023-12-17T11:31:50.237 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/qcaux.ko 2023-12-17T11:31:50.237 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/qcserial.ko 2023-12-17T11:31:50.237 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/quatech2.ko 2023-12-17T11:31:50.237 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/safe_serial.ko 2023-12-17T11:31:50.237 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/sierra.ko 2023-12-17T11:31:50.238 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/spcp8x5.ko 2023-12-17T11:31:50.238 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/ssu100.ko 2023-12-17T11:31:50.238 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/symbolserial.ko 2023-12-17T11:31:50.238 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2023-12-17T11:31:50.238 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/usb-serial-simple.ko 2023-12-17T11:31:50.238 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/usb_debug.ko 2023-12-17T11:31:50.238 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/usb_wwan.ko 2023-12-17T11:31:50.238 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/visor.ko 2023-12-17T11:31:50.238 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/whiteheat.ko 2023-12-17T11:31:50.238 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/xsens_mt.ko 2023-12-17T11:31:50.238 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage 2023-12-17T11:31:50.238 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/uas.ko 2023-12-17T11:31:50.238 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-alauda.ko 2023-12-17T11:31:50.238 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-cypress.ko 2023-12-17T11:31:50.238 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-datafab.ko 2023-12-17T11:31:50.239 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-eneub6250.ko 2023-12-17T11:31:50.239 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-freecom.ko 2023-12-17T11:31:50.239 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-isd200.ko 2023-12-17T11:31:50.239 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-jumpshot.ko 2023-12-17T11:31:50.239 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-karma.ko 2023-12-17T11:31:50.239 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-onetouch.ko 2023-12-17T11:31:50.239 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-realtek.ko 2023-12-17T11:31:50.239 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-sddr09.ko 2023-12-17T11:31:50.239 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-sddr55.ko 2023-12-17T11:31:50.240 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-usbat.ko 2023-12-17T11:31:50.240 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/usb-storage.ko 2023-12-17T11:31:50.240 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/usbip 2023-12-17T11:31:50.240 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/usbip/usbip-core.ko 2023-12-17T11:31:50.240 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/usbip/usbip-host.ko 2023-12-17T11:31:50.240 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/usbip/vhci-hcd.ko 2023-12-17T11:31:50.240 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vfio 2023-12-17T11:31:50.241 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vfio/pci 2023-12-17T11:31:50.241 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vfio/pci/vfio-pci-core.ko 2023-12-17T11:31:50.241 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vfio/pci/vfio-pci.ko 2023-12-17T11:31:50.241 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vfio/vfio.ko 2023-12-17T11:31:50.241 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vfio/vfio_iommu_type1.ko 2023-12-17T11:31:50.241 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vhost 2023-12-17T11:31:50.242 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vhost/vhost.ko 2023-12-17T11:31:50.242 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vhost/vhost_iotlb.ko 2023-12-17T11:31:50.242 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vhost/vhost_net.ko 2023-12-17T11:31:50.242 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vhost/vhost_scsi.ko 2023-12-17T11:31:50.242 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video 2023-12-17T11:31:50.242 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight 2023-12-17T11:31:50.242 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight/apple_bl.ko 2023-12-17T11:31:50.242 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight/lcd.ko 2023-12-17T11:31:50.242 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight/platform_lcd.ko 2023-12-17T11:31:50.243 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/virtio 2023-12-17T11:31:50.243 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/virtio/virtio.ko 2023-12-17T11:31:50.243 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/virtio/virtio_balloon.ko 2023-12-17T11:31:50.243 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/virtio/virtio_mmio.ko 2023-12-17T11:31:50.243 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/virtio/virtio_pci.ko 2023-12-17T11:31:50.243 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2023-12-17T11:31:50.243 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2023-12-17T11:31:50.243 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/virtio/virtio_ring.ko 2023-12-17T11:31:50.243 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1 2023-12-17T11:31:50.244 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/masters 2023-12-17T11:31:50.244 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/masters/ds2482.ko 2023-12-17T11:31:50.244 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/masters/ds2490.ko 2023-12-17T11:31:50.244 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves 2023-12-17T11:31:50.244 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_ds2406.ko 2023-12-17T11:31:50.244 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_ds2408.ko 2023-12-17T11:31:50.244 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_ds2413.ko 2023-12-17T11:31:50.244 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_ds2423.ko 2023-12-17T11:31:50.244 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_ds2431.ko 2023-12-17T11:31:50.245 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_ds2433.ko 2023-12-17T11:31:50.245 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_ds2780.ko 2023-12-17T11:31:50.245 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_ds2781.ko 2023-12-17T11:31:50.245 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_ds28e04.ko 2023-12-17T11:31:50.245 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_smem.ko 2023-12-17T11:31:50.245 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_therm.ko 2023-12-17T11:31:50.245 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/wire.ko 2023-12-17T11:31:50.245 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog 2023-12-17T11:31:50.246 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/alim1535_wdt.ko 2023-12-17T11:31:50.246 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/alim7101_wdt.ko 2023-12-17T11:31:50.246 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/f71808e_wdt.ko 2023-12-17T11:31:50.246 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/hpwdt.ko 2023-12-17T11:31:50.246 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/i6300esb.ko 2023-12-17T11:31:50.246 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/iTCO_vendor_support.ko 2023-12-17T11:31:50.246 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/iTCO_wdt.ko 2023-12-17T11:31:50.246 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/ib700wdt.ko 2023-12-17T11:31:50.246 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/ibmasr.ko 2023-12-17T11:31:50.246 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/ie6xx_wdt.ko 2023-12-17T11:31:50.246 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/it8712f_wdt.ko 2023-12-17T11:31:50.247 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/it87_wdt.ko 2023-12-17T11:31:50.247 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/machzwd.ko 2023-12-17T11:31:50.247 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/nv_tco.ko 2023-12-17T11:31:50.247 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/pcwd_pci.ko 2023-12-17T11:31:50.247 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/pcwd_usb.ko 2023-12-17T11:31:50.247 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2023-12-17T11:31:50.247 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/sch311x_wdt.ko 2023-12-17T11:31:50.247 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/softdog.ko 2023-12-17T11:31:50.247 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/sp5100_tco.ko 2023-12-17T11:31:50.247 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/via_wdt.ko 2023-12-17T11:31:50.247 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/w83627hf_wdt.ko 2023-12-17T11:31:50.247 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/w83877f_wdt.ko 2023-12-17T11:31:50.247 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/w83977f_wdt.ko 2023-12-17T11:31:50.247 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/wdt_pci.ko 2023-12-17T11:31:50.248 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/xen_wdt.ko 2023-12-17T11:31:50.248 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen 2023-12-17T11:31:50.248 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen/xen-acpi-processor.ko 2023-12-17T11:31:50.248 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen/xen-evtchn.ko 2023-12-17T11:31:50.248 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen/xen-gntalloc.ko 2023-12-17T11:31:50.248 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen/xen-gntdev.ko 2023-12-17T11:31:50.248 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen/xen-pciback 2023-12-17T11:31:50.248 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2023-12-17T11:31:50.248 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen/xen-privcmd.ko 2023-12-17T11:31:50.248 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen/xenfs 2023-12-17T11:31:50.248 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen/xenfs/xenfs.ko 2023-12-17T11:31:50.248 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs 2023-12-17T11:31:50.248 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/9p 2023-12-17T11:31:50.248 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/9p/9p.ko 2023-12-17T11:31:50.248 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/affs 2023-12-17T11:31:50.249 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/affs/affs.ko 2023-12-17T11:31:50.249 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/befs 2023-12-17T11:31:50.249 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/befs/befs.ko 2023-12-17T11:31:50.249 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/binfmt_misc.ko 2023-12-17T11:31:50.249 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/btrfs 2023-12-17T11:31:50.249 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/btrfs/btrfs.ko 2023-12-17T11:31:50.249 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/cachefiles 2023-12-17T11:31:50.249 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/cachefiles/cachefiles.ko 2023-12-17T11:31:50.249 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ceph 2023-12-17T11:31:50.249 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ceph/ceph.ko 2023-12-17T11:31:50.249 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/coda 2023-12-17T11:31:50.249 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/coda/coda.ko 2023-12-17T11:31:50.249 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/cramfs 2023-12-17T11:31:50.250 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/cramfs/cramfs.ko 2023-12-17T11:31:50.250 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/dlm 2023-12-17T11:31:50.250 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/dlm/dlm.ko 2023-12-17T11:31:50.250 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ecryptfs 2023-12-17T11:31:50.250 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ecryptfs/ecryptfs.ko 2023-12-17T11:31:50.250 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/f2fs 2023-12-17T11:31:50.250 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/f2fs/f2fs.ko 2023-12-17T11:31:50.250 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/fat 2023-12-17T11:31:50.250 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/fat/fat.ko 2023-12-17T11:31:50.250 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/fat/msdos.ko 2023-12-17T11:31:50.250 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/fat/vfat.ko 2023-12-17T11:31:50.250 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/fscache 2023-12-17T11:31:50.250 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/fscache/fscache.ko 2023-12-17T11:31:50.250 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/fuse 2023-12-17T11:31:50.250 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/fuse/cuse.ko 2023-12-17T11:31:50.251 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/fuse/fuse.ko 2023-12-17T11:31:50.251 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/gfs2 2023-12-17T11:31:50.251 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/gfs2/gfs2.ko 2023-12-17T11:31:50.251 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/hfs 2023-12-17T11:31:50.251 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/hfs/hfs.ko 2023-12-17T11:31:50.251 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/hfsplus 2023-12-17T11:31:50.251 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/hfsplus/hfsplus.ko 2023-12-17T11:31:50.251 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/isofs 2023-12-17T11:31:50.251 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/isofs/isofs.ko 2023-12-17T11:31:50.251 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/jfs 2023-12-17T11:31:50.251 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/jfs/jfs.ko 2023-12-17T11:31:50.251 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/lockd 2023-12-17T11:31:50.251 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/lockd/lockd.ko 2023-12-17T11:31:50.251 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/minix 2023-12-17T11:31:50.252 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/minix/minix.ko 2023-12-17T11:31:50.252 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/netfs 2023-12-17T11:31:50.252 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/netfs/netfs.ko 2023-12-17T11:31:50.252 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs 2023-12-17T11:31:50.252 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs/blocklayout 2023-12-17T11:31:50.252 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2023-12-17T11:31:50.252 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs/filelayout 2023-12-17T11:31:50.252 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2023-12-17T11:31:50.252 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs/flexfilelayout 2023-12-17T11:31:50.252 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2023-12-17T11:31:50.252 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs/nfs.ko 2023-12-17T11:31:50.253 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs/nfsv3.ko 2023-12-17T11:31:50.253 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs/nfsv4.ko 2023-12-17T11:31:50.253 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs_common 2023-12-17T11:31:50.253 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs_common/grace.ko 2023-12-17T11:31:50.253 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs_common/nfs_acl.ko 2023-12-17T11:31:50.253 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfsd 2023-12-17T11:31:50.253 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfsd/nfsd.ko 2023-12-17T11:31:50.253 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nilfs2 2023-12-17T11:31:50.253 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nilfs2/nilfs2.ko 2023-12-17T11:31:50.253 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls 2023-12-17T11:31:50.253 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-celtic.ko 2023-12-17T11:31:50.253 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-centeuro.ko 2023-12-17T11:31:50.253 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-croatian.ko 2023-12-17T11:31:50.254 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-cyrillic.ko 2023-12-17T11:31:50.254 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-gaelic.ko 2023-12-17T11:31:50.254 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-greek.ko 2023-12-17T11:31:50.254 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-iceland.ko 2023-12-17T11:31:50.254 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-inuit.ko 2023-12-17T11:31:50.254 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-roman.ko 2023-12-17T11:31:50.254 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-romanian.ko 2023-12-17T11:31:50.254 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-turkish.ko 2023-12-17T11:31:50.254 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp1250.ko 2023-12-17T11:31:50.254 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp1251.ko 2023-12-17T11:31:50.254 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp1255.ko 2023-12-17T11:31:50.254 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp737.ko 2023-12-17T11:31:50.254 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp775.ko 2023-12-17T11:31:50.254 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp850.ko 2023-12-17T11:31:50.254 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp852.ko 2023-12-17T11:31:50.254 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp855.ko 2023-12-17T11:31:50.255 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp857.ko 2023-12-17T11:31:50.255 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp860.ko 2023-12-17T11:31:50.255 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp861.ko 2023-12-17T11:31:50.255 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp862.ko 2023-12-17T11:31:50.255 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp863.ko 2023-12-17T11:31:50.255 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp864.ko 2023-12-17T11:31:50.255 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp865.ko 2023-12-17T11:31:50.255 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp866.ko 2023-12-17T11:31:50.255 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp869.ko 2023-12-17T11:31:50.255 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp874.ko 2023-12-17T11:31:50.255 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp932.ko 2023-12-17T11:31:50.255 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp936.ko 2023-12-17T11:31:50.255 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp949.ko 2023-12-17T11:31:50.255 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp950.ko 2023-12-17T11:31:50.255 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_euc-jp.ko 2023-12-17T11:31:50.255 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-1.ko 2023-12-17T11:31:50.256 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-13.ko 2023-12-17T11:31:50.256 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-14.ko 2023-12-17T11:31:50.256 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-15.ko 2023-12-17T11:31:50.256 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-2.ko 2023-12-17T11:31:50.256 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-3.ko 2023-12-17T11:31:50.256 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-4.ko 2023-12-17T11:31:50.256 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-5.ko 2023-12-17T11:31:50.256 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-6.ko 2023-12-17T11:31:50.256 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-7.ko 2023-12-17T11:31:50.256 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-9.ko 2023-12-17T11:31:50.256 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_koi8-r.ko 2023-12-17T11:31:50.256 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_koi8-ru.ko 2023-12-17T11:31:50.256 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_koi8-u.ko 2023-12-17T11:31:50.256 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_ucs2_utils.ko 2023-12-17T11:31:50.257 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_utf8.ko 2023-12-17T11:31:50.257 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2 2023-12-17T11:31:50.257 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/cluster 2023-12-17T11:31:50.257 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2023-12-17T11:31:50.257 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/dlm 2023-12-17T11:31:50.257 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2023-12-17T11:31:50.257 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/dlmfs 2023-12-17T11:31:50.257 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2023-12-17T11:31:50.257 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/ocfs2.ko 2023-12-17T11:31:50.257 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2023-12-17T11:31:50.257 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/ocfs2_stack_user.ko 2023-12-17T11:31:50.257 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/ocfs2_stackglue.ko 2023-12-17T11:31:50.257 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/overlayfs 2023-12-17T11:31:50.257 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/overlayfs/overlay.ko 2023-12-17T11:31:50.258 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/pstore 2023-12-17T11:31:50.258 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/pstore/ramoops.ko 2023-12-17T11:31:50.258 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/reiserfs 2023-12-17T11:31:50.258 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/reiserfs/reiserfs.ko 2023-12-17T11:31:50.258 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/romfs 2023-12-17T11:31:50.258 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/romfs/romfs.ko 2023-12-17T11:31:50.258 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/smb 2023-12-17T11:31:50.258 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/smb/client 2023-12-17T11:31:50.258 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/smb/client/cifs.ko 2023-12-17T11:31:50.258 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/smb/common 2023-12-17T11:31:50.258 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/smb/common/cifs_arc4.ko 2023-12-17T11:31:50.258 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/smb/common/cifs_md4.ko 2023-12-17T11:31:50.258 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/squashfs 2023-12-17T11:31:50.258 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/squashfs/squashfs.ko 2023-12-17T11:31:50.258 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/sysv 2023-12-17T11:31:50.259 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/sysv/sysv.ko 2023-12-17T11:31:50.259 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/udf 2023-12-17T11:31:50.259 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/udf/udf.ko 2023-12-17T11:31:50.259 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ufs 2023-12-17T11:31:50.259 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ufs/ufs.ko 2023-12-17T11:31:50.259 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/xfs 2023-12-17T11:31:50.259 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/xfs/xfs.ko 2023-12-17T11:31:50.259 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/kernel 2023-12-17T11:31:50.259 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/kernel/rcu 2023-12-17T11:31:50.259 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/kernel/rcu/rcutorture.ko 2023-12-17T11:31:50.259 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/kernel/torture.ko 2023-12-17T11:31:50.259 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/kernel/trace 2023-12-17T11:31:50.259 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/kernel/trace/ring_buffer_benchmark.ko 2023-12-17T11:31:50.259 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib 2023-12-17T11:31:50.259 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/asn1_encoder.ko 2023-12-17T11:31:50.260 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/crc-itu-t.ko 2023-12-17T11:31:50.260 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/crc8.ko 2023-12-17T11:31:50.260 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/crypto 2023-12-17T11:31:50.260 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/crypto/libarc4.ko 2023-12-17T11:31:50.260 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/crypto/libdes.ko 2023-12-17T11:31:50.260 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/libcrc32c.ko 2023-12-17T11:31:50.260 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/lru_cache.ko 2023-12-17T11:31:50.260 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/lz4 2023-12-17T11:31:50.260 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/lz4/lz4_compress.ko 2023-12-17T11:31:50.260 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/lz4/lz4hc_compress.ko 2023-12-17T11:31:50.260 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/math 2023-12-17T11:31:50.260 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/math/cordic.ko 2023-12-17T11:31:50.260 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/raid6 2023-12-17T11:31:50.261 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/raid6/raid6_pq.ko 2023-12-17T11:31:50.261 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/reed_solomon 2023-12-17T11:31:50.261 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/reed_solomon/reed_solomon.ko 2023-12-17T11:31:50.261 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/ts_bm.ko 2023-12-17T11:31:50.261 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/ts_fsm.ko 2023-12-17T11:31:50.261 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/ts_kmp.ko 2023-12-17T11:31:50.261 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/zstd 2023-12-17T11:31:50.261 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/zstd/zstd_compress.ko 2023-12-17T11:31:50.261 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/mm 2023-12-17T11:31:50.261 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/mm/hwpoison-inject.ko 2023-12-17T11:31:50.261 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net 2023-12-17T11:31:50.261 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/6lowpan 2023-12-17T11:31:50.261 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/6lowpan/6lowpan.ko 2023-12-17T11:31:50.262 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/6lowpan/nhc_dest.ko 2023-12-17T11:31:50.262 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/6lowpan/nhc_fragment.ko 2023-12-17T11:31:50.262 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/6lowpan/nhc_hop.ko 2023-12-17T11:31:50.262 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/6lowpan/nhc_ipv6.ko 2023-12-17T11:31:50.262 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/6lowpan/nhc_mobility.ko 2023-12-17T11:31:50.262 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/6lowpan/nhc_routing.ko 2023-12-17T11:31:50.262 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/6lowpan/nhc_udp.ko 2023-12-17T11:31:50.262 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/802 2023-12-17T11:31:50.262 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/802/garp.ko 2023-12-17T11:31:50.262 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/802/mrp.ko 2023-12-17T11:31:50.262 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/802/p8022.ko 2023-12-17T11:31:50.262 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/802/psnap.ko 2023-12-17T11:31:50.262 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/802/stp.ko 2023-12-17T11:31:50.262 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/8021q 2023-12-17T11:31:50.262 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/8021q/8021q.ko 2023-12-17T11:31:50.263 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/9p 2023-12-17T11:31:50.263 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/9p/9pnet.ko 2023-12-17T11:31:50.263 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/9p/9pnet_fd.ko 2023-12-17T11:31:50.263 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/9p/9pnet_rdma.ko 2023-12-17T11:31:50.263 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/9p/9pnet_virtio.ko 2023-12-17T11:31:50.263 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/batman-adv 2023-12-17T11:31:50.263 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/batman-adv/batman-adv.ko 2023-12-17T11:31:50.263 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge 2023-12-17T11:31:50.263 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/br_netfilter.ko 2023-12-17T11:31:50.263 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/bridge.ko 2023-12-17T11:31:50.263 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter 2023-12-17T11:31:50.264 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_802_3.ko 2023-12-17T11:31:50.264 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_among.ko 2023-12-17T11:31:50.264 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_arp.ko 2023-12-17T11:31:50.264 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_arpreply.ko 2023-12-17T11:31:50.264 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_dnat.ko 2023-12-17T11:31:50.264 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_ip.ko 2023-12-17T11:31:50.264 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_ip6.ko 2023-12-17T11:31:50.264 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_limit.ko 2023-12-17T11:31:50.264 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_log.ko 2023-12-17T11:31:50.264 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_mark.ko 2023-12-17T11:31:50.264 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_mark_m.ko 2023-12-17T11:31:50.264 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_nflog.ko 2023-12-17T11:31:50.264 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_pkttype.ko 2023-12-17T11:31:50.264 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_redirect.ko 2023-12-17T11:31:50.265 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_snat.ko 2023-12-17T11:31:50.265 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_stp.ko 2023-12-17T11:31:50.265 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_vlan.ko 2023-12-17T11:31:50.265 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebtable_broute.ko 2023-12-17T11:31:50.265 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebtable_filter.ko 2023-12-17T11:31:50.265 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebtable_nat.ko 2023-12-17T11:31:50.265 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebtables.ko 2023-12-17T11:31:50.265 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2023-12-17T11:31:50.265 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2023-12-17T11:31:50.265 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2023-12-17T11:31:50.265 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ceph 2023-12-17T11:31:50.265 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ceph/libceph.ko 2023-12-17T11:31:50.265 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/core 2023-12-17T11:31:50.266 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/core/failover.ko 2023-12-17T11:31:50.266 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/core/pktgen.ko 2023-12-17T11:31:50.266 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dccp 2023-12-17T11:31:50.266 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dccp/dccp.ko 2023-12-17T11:31:50.266 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dccp/dccp_diag.ko 2023-12-17T11:31:50.266 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dccp/dccp_ipv4.ko 2023-12-17T11:31:50.266 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dccp/dccp_ipv6.ko 2023-12-17T11:31:50.266 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dns_resolver 2023-12-17T11:31:50.266 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dns_resolver/dns_resolver.ko 2023-12-17T11:31:50.266 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dsa 2023-12-17T11:31:50.266 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dsa/dsa_core.ko 2023-12-17T11:31:50.266 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dsa/tag_brcm.ko 2023-12-17T11:31:50.266 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dsa/tag_dsa.ko 2023-12-17T11:31:50.266 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dsa/tag_none.ko 2023-12-17T11:31:50.267 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dsa/tag_trailer.ko 2023-12-17T11:31:50.267 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ieee802154 2023-12-17T11:31:50.267 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ieee802154/6lowpan 2023-12-17T11:31:50.267 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2023-12-17T11:31:50.267 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ieee802154/ieee802154.ko 2023-12-17T11:31:50.267 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ieee802154/ieee802154_socket.ko 2023-12-17T11:31:50.267 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4 2023-12-17T11:31:50.267 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/ah4.ko 2023-12-17T11:31:50.267 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/esp4.ko 2023-12-17T11:31:50.267 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/fou.ko 2023-12-17T11:31:50.267 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/gre.ko 2023-12-17T11:31:50.267 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/inet_diag.ko 2023-12-17T11:31:50.267 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/ip_gre.ko 2023-12-17T11:31:50.267 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/ip_tunnel.ko 2023-12-17T11:31:50.268 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/ip_vti.ko 2023-12-17T11:31:50.268 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/ipcomp.ko 2023-12-17T11:31:50.268 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/ipip.ko 2023-12-17T11:31:50.268 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter 2023-12-17T11:31:50.268 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/arp_tables.ko 2023-12-17T11:31:50.268 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/arpt_mangle.ko 2023-12-17T11:31:50.268 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/arptable_filter.ko 2023-12-17T11:31:50.268 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/ipt_ECN.ko 2023-12-17T11:31:50.268 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2023-12-17T11:31:50.268 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/ipt_ah.ko 2023-12-17T11:31:50.268 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2023-12-17T11:31:50.268 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/iptable_mangle.ko 2023-12-17T11:31:50.268 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/iptable_nat.ko 2023-12-17T11:31:50.268 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/iptable_raw.ko 2023-12-17T11:31:50.268 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/iptable_security.ko 2023-12-17T11:31:50.269 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2023-12-17T11:31:50.269 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2023-12-17T11:31:50.269 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2023-12-17T11:31:50.269 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2023-12-17T11:31:50.269 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2023-12-17T11:31:50.269 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2023-12-17T11:31:50.269 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2023-12-17T11:31:50.269 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2023-12-17T11:31:50.269 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2023-12-17T11:31:50.269 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2023-12-17T11:31:50.269 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_bic.ko 2023-12-17T11:31:50.269 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_dctcp.ko 2023-12-17T11:31:50.269 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_diag.ko 2023-12-17T11:31:50.269 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_highspeed.ko 2023-12-17T11:31:50.270 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_htcp.ko 2023-12-17T11:31:50.270 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_hybla.ko 2023-12-17T11:31:50.270 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_illinois.ko 2023-12-17T11:31:50.270 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_lp.ko 2023-12-17T11:31:50.270 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_scalable.ko 2023-12-17T11:31:50.270 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_vegas.ko 2023-12-17T11:31:50.270 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_veno.ko 2023-12-17T11:31:50.270 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_westwood.ko 2023-12-17T11:31:50.270 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_yeah.ko 2023-12-17T11:31:50.270 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tunnel4.ko 2023-12-17T11:31:50.270 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/udp_diag.ko 2023-12-17T11:31:50.270 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/udp_tunnel.ko 2023-12-17T11:31:50.270 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/xfrm4_tunnel.ko 2023-12-17T11:31:50.270 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6 2023-12-17T11:31:50.271 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/ah6.ko 2023-12-17T11:31:50.271 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/esp6.ko 2023-12-17T11:31:50.271 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/fou6.ko 2023-12-17T11:31:50.271 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/ip6_tunnel.ko 2023-12-17T11:31:50.271 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/ip6_udp_tunnel.ko 2023-12-17T11:31:50.271 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/ip6_vti.ko 2023-12-17T11:31:50.271 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/ipcomp6.ko 2023-12-17T11:31:50.271 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter 2023-12-17T11:31:50.271 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6_tables.ko 2023-12-17T11:31:50.271 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2023-12-17T11:31:50.271 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2023-12-17T11:31:50.271 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_ah.ko 2023-12-17T11:31:50.271 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2023-12-17T11:31:50.272 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_frag.ko 2023-12-17T11:31:50.272 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2023-12-17T11:31:50.272 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2023-12-17T11:31:50.272 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_mh.ko 2023-12-17T11:31:50.272 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2023-12-17T11:31:50.272 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_rt.ko 2023-12-17T11:31:50.272 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6table_filter.ko 2023-12-17T11:31:50.272 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2023-12-17T11:31:50.272 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6table_nat.ko 2023-12-17T11:31:50.272 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6table_raw.ko 2023-12-17T11:31:50.272 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6table_security.ko 2023-12-17T11:31:50.272 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2023-12-17T11:31:50.272 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2023-12-17T11:31:50.272 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2023-12-17T11:31:50.273 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2023-12-17T11:31:50.273 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2023-12-17T11:31:50.273 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2023-12-17T11:31:50.273 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2023-12-17T11:31:50.273 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2023-12-17T11:31:50.273 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/sit.ko 2023-12-17T11:31:50.273 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/tunnel6.ko 2023-12-17T11:31:50.273 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/xfrm6_tunnel.ko 2023-12-17T11:31:50.273 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/key 2023-12-17T11:31:50.273 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/key/af_key.ko 2023-12-17T11:31:50.273 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/l2tp 2023-12-17T11:31:50.273 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/l2tp/l2tp_core.ko 2023-12-17T11:31:50.273 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/l2tp/l2tp_debugfs.ko 2023-12-17T11:31:50.274 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/l2tp/l2tp_eth.ko 2023-12-17T11:31:50.274 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/l2tp/l2tp_ip.ko 2023-12-17T11:31:50.274 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/l2tp/l2tp_ip6.ko 2023-12-17T11:31:50.274 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/l2tp/l2tp_netlink.ko 2023-12-17T11:31:50.274 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/l2tp/l2tp_ppp.ko 2023-12-17T11:31:50.274 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/llc 2023-12-17T11:31:50.274 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/llc/llc.ko 2023-12-17T11:31:50.274 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/mac802154 2023-12-17T11:31:50.274 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/mac802154/mac802154.ko 2023-12-17T11:31:50.274 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/mpls 2023-12-17T11:31:50.274 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/mpls/mpls_gso.ko 2023-12-17T11:31:50.274 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter 2023-12-17T11:31:50.274 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset 2023-12-17T11:31:50.274 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set.ko 2023-12-17T11:31:50.274 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2023-12-17T11:31:50.275 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2023-12-17T11:31:50.275 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2023-12-17T11:31:50.275 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2023-12-17T11:31:50.275 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2023-12-17T11:31:50.275 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2023-12-17T11:31:50.275 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2023-12-17T11:31:50.275 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2023-12-17T11:31:50.275 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2023-12-17T11:31:50.275 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2023-12-17T11:31:50.275 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2023-12-17T11:31:50.275 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2023-12-17T11:31:50.275 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2023-12-17T11:31:50.275 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2023-12-17T11:31:50.275 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_list_set.ko 2023-12-17T11:31:50.275 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs 2023-12-17T11:31:50.275 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs.ko 2023-12-17T11:31:50.276 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2023-12-17T11:31:50.276 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2023-12-17T11:31:50.276 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2023-12-17T11:31:50.276 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2023-12-17T11:31:50.276 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2023-12-17T11:31:50.276 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2023-12-17T11:31:50.276 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2023-12-17T11:31:50.276 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2023-12-17T11:31:50.276 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2023-12-17T11:31:50.276 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2023-12-17T11:31:50.276 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2023-12-17T11:31:50.276 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2023-12-17T11:31:50.276 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2023-12-17T11:31:50.276 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conncount.ko 2023-12-17T11:31:50.277 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack.ko 2023-12-17T11:31:50.277 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_amanda.ko 2023-12-17T11:31:50.277 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_broadcast.ko 2023-12-17T11:31:50.277 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_ftp.ko 2023-12-17T11:31:50.277 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_h323.ko 2023-12-17T11:31:50.277 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_irc.ko 2023-12-17T11:31:50.277 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2023-12-17T11:31:50.277 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_netlink.ko 2023-12-17T11:31:50.277 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_pptp.ko 2023-12-17T11:31:50.277 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_sane.ko 2023-12-17T11:31:50.277 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_sip.ko 2023-12-17T11:31:50.277 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_snmp.ko 2023-12-17T11:31:50.277 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_tftp.ko 2023-12-17T11:31:50.278 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_dup_netdev.ko 2023-12-17T11:31:50.278 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_flow_table.ko 2023-12-17T11:31:50.278 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_flow_table_inet.ko 2023-12-17T11:31:50.278 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_log_syslog.ko 2023-12-17T11:31:50.278 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_nat.ko 2023-12-17T11:31:50.278 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_nat_amanda.ko 2023-12-17T11:31:50.278 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_nat_ftp.ko 2023-12-17T11:31:50.278 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_nat_irc.ko 2023-12-17T11:31:50.278 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_nat_sip.ko 2023-12-17T11:31:50.278 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_nat_tftp.ko 2023-12-17T11:31:50.278 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_synproxy_core.ko 2023-12-17T11:31:50.278 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_tables.ko 2023-12-17T11:31:50.278 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nfnetlink.ko 2023-12-17T11:31:50.278 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nfnetlink_acct.ko 2023-12-17T11:31:50.278 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nfnetlink_log.ko 2023-12-17T11:31:50.278 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nfnetlink_osf.ko 2023-12-17T11:31:50.279 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nfnetlink_queue.ko 2023-12-17T11:31:50.279 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_chain_nat.ko 2023-12-17T11:31:50.279 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_compat.ko 2023-12-17T11:31:50.279 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_ct.ko 2023-12-17T11:31:50.279 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_dup_netdev.ko 2023-12-17T11:31:50.279 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_fib.ko 2023-12-17T11:31:50.279 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_fwd_netdev.ko 2023-12-17T11:31:50.279 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_hash.ko 2023-12-17T11:31:50.279 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_limit.ko 2023-12-17T11:31:50.279 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_log.ko 2023-12-17T11:31:50.279 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_masq.ko 2023-12-17T11:31:50.279 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_nat.ko 2023-12-17T11:31:50.279 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_numgen.ko 2023-12-17T11:31:50.279 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_queue.ko 2023-12-17T11:31:50.279 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_quota.ko 2023-12-17T11:31:50.279 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_redir.ko 2023-12-17T11:31:50.280 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_reject.ko 2023-12-17T11:31:50.280 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_reject_inet.ko 2023-12-17T11:31:50.280 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_socket.ko 2023-12-17T11:31:50.280 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_tunnel.ko 2023-12-17T11:31:50.280 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_AUDIT.ko 2023-12-17T11:31:50.280 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_CHECKSUM.ko 2023-12-17T11:31:50.280 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_CLASSIFY.ko 2023-12-17T11:31:50.280 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_CONNSECMARK.ko 2023-12-17T11:31:50.280 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_CT.ko 2023-12-17T11:31:50.280 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_DSCP.ko 2023-12-17T11:31:50.280 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_HL.ko 2023-12-17T11:31:50.280 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_HMARK.ko 2023-12-17T11:31:50.280 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_IDLETIMER.ko 2023-12-17T11:31:50.280 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_LED.ko 2023-12-17T11:31:50.280 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_LOG.ko 2023-12-17T11:31:50.280 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_MASQUERADE.ko 2023-12-17T11:31:50.281 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_NETMAP.ko 2023-12-17T11:31:50.281 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_NFLOG.ko 2023-12-17T11:31:50.281 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_NFQUEUE.ko 2023-12-17T11:31:50.281 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_RATEEST.ko 2023-12-17T11:31:50.281 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_REDIRECT.ko 2023-12-17T11:31:50.281 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_SECMARK.ko 2023-12-17T11:31:50.281 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_TCPMSS.ko 2023-12-17T11:31:50.281 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2023-12-17T11:31:50.281 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_TEE.ko 2023-12-17T11:31:50.281 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_TPROXY.ko 2023-12-17T11:31:50.281 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_TRACE.ko 2023-12-17T11:31:50.281 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_addrtype.ko 2023-12-17T11:31:50.281 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_bpf.ko 2023-12-17T11:31:50.281 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_cgroup.ko 2023-12-17T11:31:50.282 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_cluster.ko 2023-12-17T11:31:50.282 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_comment.ko 2023-12-17T11:31:50.282 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_connbytes.ko 2023-12-17T11:31:50.282 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_connlabel.ko 2023-12-17T11:31:50.282 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_connlimit.ko 2023-12-17T11:31:50.282 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_connmark.ko 2023-12-17T11:31:50.282 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_conntrack.ko 2023-12-17T11:31:50.282 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_cpu.ko 2023-12-17T11:31:50.282 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_dccp.ko 2023-12-17T11:31:50.282 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_devgroup.ko 2023-12-17T11:31:50.282 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_dscp.ko 2023-12-17T11:31:50.282 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_ecn.ko 2023-12-17T11:31:50.282 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_esp.ko 2023-12-17T11:31:50.282 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_hashlimit.ko 2023-12-17T11:31:50.282 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_helper.ko 2023-12-17T11:31:50.282 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_hl.ko 2023-12-17T11:31:50.282 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_ipcomp.ko 2023-12-17T11:31:50.283 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_iprange.ko 2023-12-17T11:31:50.283 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_ipvs.ko 2023-12-17T11:31:50.283 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_l2tp.ko 2023-12-17T11:31:50.283 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_length.ko 2023-12-17T11:31:50.283 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_limit.ko 2023-12-17T11:31:50.283 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_mac.ko 2023-12-17T11:31:50.283 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_mark.ko 2023-12-17T11:31:50.283 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_multiport.ko 2023-12-17T11:31:50.283 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_nat.ko 2023-12-17T11:31:50.283 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_nfacct.ko 2023-12-17T11:31:50.283 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_osf.ko 2023-12-17T11:31:50.283 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_owner.ko 2023-12-17T11:31:50.283 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_physdev.ko 2023-12-17T11:31:50.283 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_pkttype.ko 2023-12-17T11:31:50.283 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_policy.ko 2023-12-17T11:31:50.284 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_quota.ko 2023-12-17T11:31:50.284 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_rateest.ko 2023-12-17T11:31:50.284 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_realm.ko 2023-12-17T11:31:50.284 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_recent.ko 2023-12-17T11:31:50.284 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_sctp.ko 2023-12-17T11:31:50.284 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_set.ko 2023-12-17T11:31:50.284 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_socket.ko 2023-12-17T11:31:50.284 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_state.ko 2023-12-17T11:31:50.284 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_statistic.ko 2023-12-17T11:31:50.284 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_string.ko 2023-12-17T11:31:50.284 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_tcpmss.ko 2023-12-17T11:31:50.284 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_time.ko 2023-12-17T11:31:50.284 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_u32.ko 2023-12-17T11:31:50.284 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netlink 2023-12-17T11:31:50.284 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netlink/netlink_diag.ko 2023-12-17T11:31:50.285 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/nsh 2023-12-17T11:31:50.285 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/nsh/nsh.ko 2023-12-17T11:31:50.285 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/openvswitch 2023-12-17T11:31:50.285 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/openvswitch/openvswitch.ko 2023-12-17T11:31:50.285 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/openvswitch/vport-geneve.ko 2023-12-17T11:31:50.285 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/openvswitch/vport-gre.ko 2023-12-17T11:31:50.285 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/openvswitch/vport-vxlan.ko 2023-12-17T11:31:50.285 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/packet 2023-12-17T11:31:50.285 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/packet/af_packet_diag.ko 2023-12-17T11:31:50.285 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/rds 2023-12-17T11:31:50.285 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/rds/rds.ko 2023-12-17T11:31:50.285 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/rds/rds_rdma.ko 2023-12-17T11:31:50.285 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/rds/rds_tcp.ko 2023-12-17T11:31:50.285 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched 2023-12-17T11:31:50.286 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_csum.ko 2023-12-17T11:31:50.286 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_gact.ko 2023-12-17T11:31:50.286 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_ipt.ko 2023-12-17T11:31:50.286 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_mirred.ko 2023-12-17T11:31:50.286 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_nat.ko 2023-12-17T11:31:50.286 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_pedit.ko 2023-12-17T11:31:50.286 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_police.ko 2023-12-17T11:31:50.286 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_simple.ko 2023-12-17T11:31:50.286 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_skbedit.ko 2023-12-17T11:31:50.286 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_vlan.ko 2023-12-17T11:31:50.286 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/cls_basic.ko 2023-12-17T11:31:50.286 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/cls_bpf.ko 2023-12-17T11:31:50.286 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/cls_flow.ko 2023-12-17T11:31:50.286 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/cls_fw.ko 2023-12-17T11:31:50.286 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/cls_route.ko 2023-12-17T11:31:50.286 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/cls_u32.ko 2023-12-17T11:31:50.287 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/em_cmp.ko 2023-12-17T11:31:50.287 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/em_ipset.ko 2023-12-17T11:31:50.287 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/em_meta.ko 2023-12-17T11:31:50.287 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/em_nbyte.ko 2023-12-17T11:31:50.287 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/em_text.ko 2023-12-17T11:31:50.287 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/em_u32.ko 2023-12-17T11:31:50.287 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_choke.ko 2023-12-17T11:31:50.287 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_codel.ko 2023-12-17T11:31:50.287 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_drr.ko 2023-12-17T11:31:50.287 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_fq.ko 2023-12-17T11:31:50.287 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_gred.ko 2023-12-17T11:31:50.287 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_hfsc.ko 2023-12-17T11:31:50.287 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_hhf.ko 2023-12-17T11:31:50.287 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_htb.ko 2023-12-17T11:31:50.288 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_ingress.ko 2023-12-17T11:31:50.288 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_mqprio.ko 2023-12-17T11:31:50.288 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_mqprio_lib.ko 2023-12-17T11:31:50.288 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_multiq.ko 2023-12-17T11:31:50.288 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_netem.ko 2023-12-17T11:31:50.288 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_pie.ko 2023-12-17T11:31:50.288 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_plug.ko 2023-12-17T11:31:50.288 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_prio.ko 2023-12-17T11:31:50.288 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_qfq.ko 2023-12-17T11:31:50.288 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_red.ko 2023-12-17T11:31:50.288 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_sfb.ko 2023-12-17T11:31:50.288 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_sfq.ko 2023-12-17T11:31:50.288 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_tbf.ko 2023-12-17T11:31:50.288 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_teql.ko 2023-12-17T11:31:50.288 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sctp 2023-12-17T11:31:50.289 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sctp/sctp.ko 2023-12-17T11:31:50.289 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sctp/sctp_diag.ko 2023-12-17T11:31:50.289 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sunrpc 2023-12-17T11:31:50.289 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sunrpc/auth_gss 2023-12-17T11:31:50.289 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2023-12-17T11:31:50.289 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2023-12-17T11:31:50.289 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sunrpc/sunrpc.ko 2023-12-17T11:31:50.289 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sunrpc/xprtrdma 2023-12-17T11:31:50.289 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2023-12-17T11:31:50.289 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/tipc 2023-12-17T11:31:50.289 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/tipc/diag.ko 2023-12-17T11:31:50.289 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/tipc/tipc.ko 2023-12-17T11:31:50.289 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/unix 2023-12-17T11:31:50.289 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/unix/unix_diag.ko 2023-12-17T11:31:50.290 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/vmw_vsock 2023-12-17T11:31:50.290 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2023-12-17T11:31:50.290 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2023-12-17T11:31:50.290 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/vmw_vsock/vsock.ko 2023-12-17T11:31:50.290 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/vmw_vsock/vsock_diag.ko 2023-12-17T11:31:50.290 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/vmw_vsock/vsock_loopback.ko 2023-12-17T11:31:50.290 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/xfrm 2023-12-17T11:31:50.290 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/xfrm/xfrm_ipcomp.ko 2023-12-17T11:31:50.290 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/security 2023-12-17T11:31:50.290 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/security/keys 2023-12-17T11:31:50.290 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/security/keys/encrypted-keys 2023-12-17T11:31:50.290 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2023-12-17T11:31:50.290 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/security/keys/trusted-keys 2023-12-17T11:31:50.290 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/security/keys/trusted-keys/trusted.ko 2023-12-17T11:31:50.290 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/virt 2023-12-17T11:31:50.291 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/virt/lib 2023-12-17T11:31:50.291 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/virt/lib/irqbypass.ko 2023-12-17T11:31:50.291 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/modules.alias 2023-12-17T11:31:50.291 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/modules.alias.bin 2023-12-17T11:31:50.291 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/modules.builtin 2023-12-17T11:31:50.291 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/modules.builtin.alias.bin 2023-12-17T11:31:50.291 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/modules.builtin.bin 2023-12-17T11:31:50.291 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/modules.builtin.modinfo 2023-12-17T11:31:50.291 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/modules.dep 2023-12-17T11:31:50.291 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/modules.dep.bin 2023-12-17T11:31:50.291 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/modules.devname 2023-12-17T11:31:50.291 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/modules.order 2023-12-17T11:31:50.291 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/modules.softdep 2023-12-17T11:31:50.291 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/modules.symbols 2023-12-17T11:31:50.292 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.6.0-gcd68252d7b4d/modules.symbols.bin 2023-12-17T11:31:50.292 DEBUG:teuthology.task.kernel:get_image_version: 6.6.0-gcd68252d7b4d 2023-12-17T11:31:50.292 DEBUG:teuthology.orchestra.run.smithi040:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2023-12-17T11:31:50.315 INFO:teuthology.orchestra.run.smithi040.stdout:postinstall scriptlet (using /bin/sh): 2023-12-17T11:31:50.315 INFO:teuthology.orchestra.run.smithi040.stdout:if [ -x /sbin/installkernel -a -r /boot/vmlinuz-6.6.0-gcd68252d7b4d -a -r /boot/System.map-6.6.0-gcd68252d7b4d ]; then 2023-12-17T11:31:50.315 INFO:teuthology.orchestra.run.smithi040.stdout:cp /boot/vmlinuz-6.6.0-gcd68252d7b4d /boot/.vmlinuz-6.6.0-gcd68252d7b4d-rpm 2023-12-17T11:31:50.315 INFO:teuthology.orchestra.run.smithi040.stdout:cp /boot/System.map-6.6.0-gcd68252d7b4d /boot/.System.map-6.6.0-gcd68252d7b4d-rpm 2023-12-17T11:31:50.315 INFO:teuthology.orchestra.run.smithi040.stdout:rm -f /boot/vmlinuz-6.6.0-gcd68252d7b4d /boot/System.map-6.6.0-gcd68252d7b4d 2023-12-17T11:31:50.316 INFO:teuthology.orchestra.run.smithi040.stdout:/sbin/installkernel 6.6.0-gcd68252d7b4d /boot/.vmlinuz-6.6.0-gcd68252d7b4d-rpm /boot/.System.map-6.6.0-gcd68252d7b4d-rpm 2023-12-17T11:31:50.316 INFO:teuthology.orchestra.run.smithi040.stdout:rm -f /boot/.vmlinuz-6.6.0-gcd68252d7b4d-rpm /boot/.System.map-6.6.0-gcd68252d7b4d-rpm 2023-12-17T11:31:50.316 INFO:teuthology.orchestra.run.smithi040.stdout:fi 2023-12-17T11:31:50.316 INFO:teuthology.orchestra.run.smithi040.stdout:preuninstall scriptlet (using /bin/sh): 2023-12-17T11:31:50.316 INFO:teuthology.orchestra.run.smithi040.stdout:if [ -x /sbin/new-kernel-pkg ]; then 2023-12-17T11:31:50.316 INFO:teuthology.orchestra.run.smithi040.stdout:new-kernel-pkg --remove 6.6.0-gcd68252d7b4d --rminitrd --initrdfile=/boot/initramfs-6.6.0-gcd68252d7b4d.img 2023-12-17T11:31:50.316 INFO:teuthology.orchestra.run.smithi040.stdout:elif [ -x /usr/bin/kernel-install ]; then 2023-12-17T11:31:50.316 INFO:teuthology.orchestra.run.smithi040.stdout:kernel-install remove 6.6.0-gcd68252d7b4d 2023-12-17T11:31:50.316 INFO:teuthology.orchestra.run.smithi040.stdout:fi 2023-12-17T11:31:50.316 INFO:teuthology.orchestra.run.smithi040.stdout:postuninstall scriptlet (using /bin/sh): 2023-12-17T11:31:50.316 INFO:teuthology.orchestra.run.smithi040.stdout:if [ -x /sbin/update-bootloader ]; then 2023-12-17T11:31:50.316 INFO:teuthology.orchestra.run.smithi040.stdout:/sbin/update-bootloader --remove 6.6.0-gcd68252d7b4d 2023-12-17T11:31:50.316 INFO:teuthology.orchestra.run.smithi040.stdout:fi 2023-12-17T11:31:50.317 DEBUG:teuthology.orchestra.run.smithi040:> sudo rpm -qi grub2-tools 2023-12-17T11:31:50.403 INFO:teuthology.orchestra.run.smithi040.stdout:Name : grub2-tools 2023-12-17T11:31:50.403 INFO:teuthology.orchestra.run.smithi040.stdout:Epoch : 1 2023-12-17T11:31:50.403 INFO:teuthology.orchestra.run.smithi040.stdout:Version : 2.06 2023-12-17T11:31:50.403 INFO:teuthology.orchestra.run.smithi040.stdout:Release : 68.el9 2023-12-17T11:31:50.403 INFO:teuthology.orchestra.run.smithi040.stdout:Architecture: x86_64 2023-12-17T11:31:50.403 INFO:teuthology.orchestra.run.smithi040.stdout:Install Date: Fri 01 Sep 2023 09:14:30 PM UTC 2023-12-17T11:31:50.403 INFO:teuthology.orchestra.run.smithi040.stdout:Group : Unspecified 2023-12-17T11:31:50.403 INFO:teuthology.orchestra.run.smithi040.stdout:Size : 8264254 2023-12-17T11:31:50.403 INFO:teuthology.orchestra.run.smithi040.stdout:License : GPLv3+ 2023-12-17T11:31:50.403 INFO:teuthology.orchestra.run.smithi040.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2023-12-17T11:31:50.404 INFO:teuthology.orchestra.run.smithi040.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2023-12-17T11:31:50.404 INFO:teuthology.orchestra.run.smithi040.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2023-12-17T11:31:50.404 INFO:teuthology.orchestra.run.smithi040.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2023-12-17T11:31:50.404 INFO:teuthology.orchestra.run.smithi040.stdout:Packager : builder@centos.org 2023-12-17T11:31:50.404 INFO:teuthology.orchestra.run.smithi040.stdout:Vendor : CentOS 2023-12-17T11:31:50.404 INFO:teuthology.orchestra.run.smithi040.stdout:URL : http://www.gnu.org/software/grub/ 2023-12-17T11:31:50.404 INFO:teuthology.orchestra.run.smithi040.stdout:Summary : Support tools for GRUB. 2023-12-17T11:31:50.404 INFO:teuthology.orchestra.run.smithi040.stdout:Description : 2023-12-17T11:31:50.404 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T11:31:50.404 INFO:teuthology.orchestra.run.smithi040.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-12-17T11:31:50.404 INFO:teuthology.orchestra.run.smithi040.stdout:customizable bootloader with modular architecture. It supports a rich 2023-12-17T11:31:50.404 INFO:teuthology.orchestra.run.smithi040.stdout:variety of kernel formats, file systems, computer architectures and 2023-12-17T11:31:50.404 INFO:teuthology.orchestra.run.smithi040.stdout:hardware devices. 2023-12-17T11:31:50.404 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T11:31:50.405 INFO:teuthology.orchestra.run.smithi040.stdout:This subpackage provides tools for support of all platforms. 2023-12-17T11:31:50.406 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-12-17T11:31:50.406 INFO:teuthology.task.kernel:Updating grub on smithi040 to boot 6.6.0-gcd68252d7b4d 2023-12-17T11:31:50.406 DEBUG:teuthology.orchestra.run.smithi040:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-12-17T11:31:51.024 INFO:teuthology.orchestra.run.smithi040.stderr:Generating grub configuration file ... 2023-12-17T11:31:52.446 INFO:teuthology.orchestra.run.smithi040.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2023-12-17T11:31:52.481 INFO:teuthology.orchestra.run.smithi040.stderr:done 2023-12-17T11:31:52.483 DEBUG:teuthology.orchestra.run.smithi040:> mktemp 2023-12-17T11:31:52.498 INFO:teuthology.orchestra.run.smithi040.stdout:/tmp/tmp.A6qWx54DJ9 2023-12-17T11:31:52.498 DEBUG:teuthology.orchestra.run.smithi040:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.A6qWx54DJ9 2023-12-17T11:31:52.571 DEBUG:teuthology.orchestra.run.smithi040:> sudo chmod 0666 /tmp/tmp.A6qWx54DJ9 2023-12-17T11:31:52.706 DEBUG:teuthology.orchestra.remote:smithi040:/tmp/tmp.A6qWx54DJ9 is 6KB 2023-12-17T11:31:52.726 DEBUG:teuthology.orchestra.run.smithi040:> rm -fr /tmp/tmp.A6qWx54DJ9 2023-12-17T11:31:52.741 DEBUG:teuthology.orchestra.run.smithi040:> sudo /bin/ls /boot/loader/entries || true 2023-12-17T11:31:52.810 INFO:teuthology.orchestra.run.smithi040.stdout:15949e3c88704300882482eddfd7baae-0-rescue.conf 2023-12-17T11:31:52.810 INFO:teuthology.orchestra.run.smithi040.stdout:15949e3c88704300882482eddfd7baae-5.14.0-239.el9.x86_64.conf 2023-12-17T11:31:52.810 INFO:teuthology.orchestra.run.smithi040.stdout:15949e3c88704300882482eddfd7baae-5.14.0-361.el9.x86_64.conf 2023-12-17T11:31:52.810 INFO:teuthology.orchestra.run.smithi040.stdout:15949e3c88704300882482eddfd7baae-6.6.0-gcd68252d7b4d.conf 2023-12-17T11:31:52.811 DEBUG:teuthology.orchestra.run.smithi040:> sudo grub2-set-default 15949e3c88704300882482eddfd7baae-6.6.0-gcd68252d7b4d 2023-12-17T11:31:52.970 DEBUG:teuthology.orchestra.run.smithi040:> sudo shutdown -r now 2023-12-17T11:31:56.438 INFO:teuthology.orchestra.run.smithi159.stdout:kernel-6.6.0_gcd68252d7b4d-1 ######################################## 2023-12-17T11:32:10.803 INFO:teuthology.orchestra.run.smithi159.stderr:dracut: Disabling early microcode, because kernel does not support it. CONFIG_MICROCODE_[AMD|INTEL]!=y 2023-12-17T11:32:22.972 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2023-12-17T11:32:22.972 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi040.front.sepia.ceph.com' 2023-12-17T11:32:22.973 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi040.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-17T11:32:32.077 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi159.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2023-12-17T11:32:32.077 DEBUG:teuthology.orchestra.run.smithi159:> rpm -qlp /tmp/kernel.x86_64.rpm 2023-12-17T11:32:32.152 INFO:teuthology.orchestra.run.smithi159.stdout:/boot/System.map-6.6.0-gcd68252d7b4d 2023-12-17T11:32:32.152 INFO:teuthology.orchestra.run.smithi159.stdout:/boot/config-6.6.0-gcd68252d7b4d 2023-12-17T11:32:32.152 INFO:teuthology.orchestra.run.smithi159.stdout:/boot/vmlinuz-6.6.0-gcd68252d7b4d 2023-12-17T11:32:32.152 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d 2023-12-17T11:32:32.152 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel 2023-12-17T11:32:32.152 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch 2023-12-17T11:32:32.152 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86 2023-12-17T11:32:32.152 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto 2023-12-17T11:32:32.153 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/blowfish-x86_64.ko 2023-12-17T11:32:32.153 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2023-12-17T11:32:32.153 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2023-12-17T11:32:32.153 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/camellia-x86_64.ko 2023-12-17T11:32:32.153 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2023-12-17T11:32:32.153 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2023-12-17T11:32:32.153 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/crc32-pclmul.ko 2023-12-17T11:32:32.153 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/crc32c-intel.ko 2023-12-17T11:32:32.153 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2023-12-17T11:32:32.153 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2023-12-17T11:32:32.153 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2023-12-17T11:32:32.153 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2023-12-17T11:32:32.153 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/serpent-avx2.ko 2023-12-17T11:32:32.153 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2023-12-17T11:32:32.154 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/sha1-ssse3.ko 2023-12-17T11:32:32.154 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/sha256-ssse3.ko 2023-12-17T11:32:32.154 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/sha512-ssse3.ko 2023-12-17T11:32:32.154 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2023-12-17T11:32:32.154 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2023-12-17T11:32:32.154 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/twofish-x86_64.ko 2023-12-17T11:32:32.154 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/kernel 2023-12-17T11:32:32.154 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/kernel/cpu 2023-12-17T11:32:32.154 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/kernel/cpu/mce 2023-12-17T11:32:32.154 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2023-12-17T11:32:32.154 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/kvm 2023-12-17T11:32:32.154 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/kvm/kvm-amd.ko 2023-12-17T11:32:32.154 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/kvm/kvm-intel.ko 2023-12-17T11:32:32.155 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/kvm/kvm.ko 2023-12-17T11:32:32.155 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto 2023-12-17T11:32:32.155 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/ansi_cprng.ko 2023-12-17T11:32:32.155 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/anubis.ko 2023-12-17T11:32:32.155 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/arc4.ko 2023-12-17T11:32:32.155 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/async_tx 2023-12-17T11:32:32.155 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/async_tx/async_memcpy.ko 2023-12-17T11:32:32.155 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/async_tx/async_pq.ko 2023-12-17T11:32:32.155 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/async_tx/async_raid6_recov.ko 2023-12-17T11:32:32.155 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/async_tx/async_tx.ko 2023-12-17T11:32:32.155 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/async_tx/async_xor.ko 2023-12-17T11:32:32.155 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/async_tx/raid6test.ko 2023-12-17T11:32:32.155 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/authenc.ko 2023-12-17T11:32:32.155 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/authencesn.ko 2023-12-17T11:32:32.156 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/blake2b_generic.ko 2023-12-17T11:32:32.156 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/blowfish_common.ko 2023-12-17T11:32:32.156 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/blowfish_generic.ko 2023-12-17T11:32:32.156 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/camellia_generic.ko 2023-12-17T11:32:32.156 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/cast5_generic.ko 2023-12-17T11:32:32.156 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/cast6_generic.ko 2023-12-17T11:32:32.156 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/cast_common.ko 2023-12-17T11:32:32.156 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/ccm.ko 2023-12-17T11:32:32.156 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/cmac.ko 2023-12-17T11:32:32.156 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/crc32_generic.ko 2023-12-17T11:32:32.156 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/crypto_engine.ko 2023-12-17T11:32:32.156 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/crypto_user.ko 2023-12-17T11:32:32.156 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/cts.ko 2023-12-17T11:32:32.156 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/des_generic.ko 2023-12-17T11:32:32.157 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/dh_generic.ko 2023-12-17T11:32:32.157 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/echainiv.ko 2023-12-17T11:32:32.157 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/essiv.ko 2023-12-17T11:32:32.157 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/fcrypt.ko 2023-12-17T11:32:32.157 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/khazad.ko 2023-12-17T11:32:32.157 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/lz4.ko 2023-12-17T11:32:32.157 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/lz4hc.ko 2023-12-17T11:32:32.157 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/md4.ko 2023-12-17T11:32:32.157 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/michael_mic.ko 2023-12-17T11:32:32.157 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/pcbc.ko 2023-12-17T11:32:32.157 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/pcrypt.ko 2023-12-17T11:32:32.157 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/rmd160.ko 2023-12-17T11:32:32.157 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/seed.ko 2023-12-17T11:32:32.157 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/serpent_generic.ko 2023-12-17T11:32:32.158 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/tcrypt.ko 2023-12-17T11:32:32.158 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/tea.ko 2023-12-17T11:32:32.158 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/twofish_common.ko 2023-12-17T11:32:32.158 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/twofish_generic.ko 2023-12-17T11:32:32.158 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/vmac.ko 2023-12-17T11:32:32.158 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/wp512.ko 2023-12-17T11:32:32.158 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/xcbc.ko 2023-12-17T11:32:32.158 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/xor.ko 2023-12-17T11:32:32.158 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/xxhash_generic.ko 2023-12-17T11:32:32.158 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers 2023-12-17T11:32:32.158 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/acpi 2023-12-17T11:32:32.158 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/acpi/acpi_ipmi.ko 2023-12-17T11:32:32.158 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/acpi/acpi_pad.ko 2023-12-17T11:32:32.158 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/acpi/custom_method.ko 2023-12-17T11:32:32.159 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/acpi/ec_sys.ko 2023-12-17T11:32:32.159 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/acpi/platform_profile.ko 2023-12-17T11:32:32.159 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/acpi/sbs.ko 2023-12-17T11:32:32.159 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/acpi/sbshc.ko 2023-12-17T11:32:32.159 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/acpi/video.ko 2023-12-17T11:32:32.159 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata 2023-12-17T11:32:32.159 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/acard-ahci.ko 2023-12-17T11:32:32.159 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/ahci_platform.ko 2023-12-17T11:32:32.159 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/ata_generic.ko 2023-12-17T11:32:32.159 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/libahci_platform.ko 2023-12-17T11:32:32.159 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_acpi.ko 2023-12-17T11:32:32.159 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_ali.ko 2023-12-17T11:32:32.159 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_amd.ko 2023-12-17T11:32:32.159 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_artop.ko 2023-12-17T11:32:32.160 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_atiixp.ko 2023-12-17T11:32:32.160 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_atp867x.ko 2023-12-17T11:32:32.160 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_cmd640.ko 2023-12-17T11:32:32.160 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_cmd64x.ko 2023-12-17T11:32:32.160 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_cypress.ko 2023-12-17T11:32:32.160 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_efar.ko 2023-12-17T11:32:32.160 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_hpt366.ko 2023-12-17T11:32:32.160 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_hpt37x.ko 2023-12-17T11:32:32.160 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_hpt3x2n.ko 2023-12-17T11:32:32.160 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_hpt3x3.ko 2023-12-17T11:32:32.160 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_it8213.ko 2023-12-17T11:32:32.160 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_it821x.ko 2023-12-17T11:32:32.160 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_jmicron.ko 2023-12-17T11:32:32.160 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_marvell.ko 2023-12-17T11:32:32.160 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_mpiix.ko 2023-12-17T11:32:32.161 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_netcell.ko 2023-12-17T11:32:32.161 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_ninja32.ko 2023-12-17T11:32:32.161 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_ns87410.ko 2023-12-17T11:32:32.161 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_ns87415.ko 2023-12-17T11:32:32.161 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_oldpiix.ko 2023-12-17T11:32:32.161 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_opti.ko 2023-12-17T11:32:32.161 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_optidma.ko 2023-12-17T11:32:32.161 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_pcmcia.ko 2023-12-17T11:32:32.161 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_pdc2027x.ko 2023-12-17T11:32:32.161 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_pdc202xx_old.ko 2023-12-17T11:32:32.161 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_piccolo.ko 2023-12-17T11:32:32.161 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_rdc.ko 2023-12-17T11:32:32.161 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_sch.ko 2023-12-17T11:32:32.162 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_serverworks.ko 2023-12-17T11:32:32.162 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_sil680.ko 2023-12-17T11:32:32.162 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_sis.ko 2023-12-17T11:32:32.162 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_sl82c105.ko 2023-12-17T11:32:32.162 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_triflex.ko 2023-12-17T11:32:32.162 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_via.ko 2023-12-17T11:32:32.162 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pdc_adma.ko 2023-12-17T11:32:32.162 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_inic162x.ko 2023-12-17T11:32:32.162 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_mv.ko 2023-12-17T11:32:32.162 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_nv.ko 2023-12-17T11:32:32.162 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_promise.ko 2023-12-17T11:32:32.162 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_qstor.ko 2023-12-17T11:32:32.162 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_sil.ko 2023-12-17T11:32:32.163 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_sil24.ko 2023-12-17T11:32:32.163 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_sis.ko 2023-12-17T11:32:32.163 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_svw.ko 2023-12-17T11:32:32.163 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_sx4.ko 2023-12-17T11:32:32.163 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_uli.ko 2023-12-17T11:32:32.163 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_via.ko 2023-12-17T11:32:32.163 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_vsc.ko 2023-12-17T11:32:32.163 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/auxdisplay 2023-12-17T11:32:32.163 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/auxdisplay/ks0108.ko 2023-12-17T11:32:32.163 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/base 2023-12-17T11:32:32.163 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/base/regmap 2023-12-17T11:32:32.163 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/base/regmap/regmap-i2c.ko 2023-12-17T11:32:32.163 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/base/regmap/regmap-mmio.ko 2023-12-17T11:32:32.163 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/bcma 2023-12-17T11:32:32.164 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/bcma/bcma.ko 2023-12-17T11:32:32.164 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block 2023-12-17T11:32:32.164 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/aoe 2023-12-17T11:32:32.164 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/aoe/aoe.ko 2023-12-17T11:32:32.164 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/brd.ko 2023-12-17T11:32:32.164 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/drbd 2023-12-17T11:32:32.164 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/drbd/drbd.ko 2023-12-17T11:32:32.164 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/floppy.ko 2023-12-17T11:32:32.164 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/loop.ko 2023-12-17T11:32:32.164 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/mtip32xx 2023-12-17T11:32:32.164 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/mtip32xx/mtip32xx.ko 2023-12-17T11:32:32.164 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/nbd.ko 2023-12-17T11:32:32.164 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/null_blk 2023-12-17T11:32:32.164 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/null_blk/null_blk.ko 2023-12-17T11:32:32.165 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/pktcdvd.ko 2023-12-17T11:32:32.165 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/rbd.ko 2023-12-17T11:32:32.165 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/virtio_blk.ko 2023-12-17T11:32:32.165 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/xen-blkback 2023-12-17T11:32:32.165 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/xen-blkback/xen-blkback.ko 2023-12-17T11:32:32.165 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/xen-blkfront.ko 2023-12-17T11:32:32.165 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/zram 2023-12-17T11:32:32.165 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/zram/zram.ko 2023-12-17T11:32:32.165 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char 2023-12-17T11:32:32.165 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/hangcheck-timer.ko 2023-12-17T11:32:32.165 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/hw_random 2023-12-17T11:32:32.165 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/hw_random/amd-rng.ko 2023-12-17T11:32:32.166 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/hw_random/intel-rng.ko 2023-12-17T11:32:32.166 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/hw_random/timeriomem-rng.ko 2023-12-17T11:32:32.166 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/hw_random/via-rng.ko 2023-12-17T11:32:32.166 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/hw_random/virtio-rng.ko 2023-12-17T11:32:32.166 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/ipmi 2023-12-17T11:32:32.166 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/ipmi/ipmi_devintf.ko 2023-12-17T11:32:32.166 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2023-12-17T11:32:32.166 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2023-12-17T11:32:32.166 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/ipmi/ipmi_si.ko 2023-12-17T11:32:32.166 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/ipmi/ipmi_ssif.ko 2023-12-17T11:32:32.166 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2023-12-17T11:32:32.166 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/lp.ko 2023-12-17T11:32:32.166 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/mwave 2023-12-17T11:32:32.166 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/mwave/mwave.ko 2023-12-17T11:32:32.166 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/ppdev.ko 2023-12-17T11:32:32.167 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/tlclk.ko 2023-12-17T11:32:32.167 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/tpm 2023-12-17T11:32:32.167 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/tpm/tpm.ko 2023-12-17T11:32:32.167 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/tpm/tpm_atmel.ko 2023-12-17T11:32:32.167 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/tpm/tpm_infineon.ko 2023-12-17T11:32:32.167 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/tpm/tpm_nsc.ko 2023-12-17T11:32:32.167 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/tpm/tpm_tis.ko 2023-12-17T11:32:32.167 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/tpm/tpm_tis_core.ko 2023-12-17T11:32:32.167 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/uv_mmtimer.ko 2023-12-17T11:32:32.167 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/virtio_console.ko 2023-12-17T11:32:32.167 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/cpufreq 2023-12-17T11:32:32.167 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/cpufreq/acpi-cpufreq.ko 2023-12-17T11:32:32.167 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2023-12-17T11:32:32.167 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/cpufreq/p4-clockmod.ko 2023-12-17T11:32:32.168 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/cpufreq/pcc-cpufreq.ko 2023-12-17T11:32:32.168 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/cpufreq/powernow-k8.ko 2023-12-17T11:32:32.168 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/cpufreq/speedstep-lib.ko 2023-12-17T11:32:32.168 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto 2023-12-17T11:32:32.168 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/ccp 2023-12-17T11:32:32.168 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/ccp/ccp-crypto.ko 2023-12-17T11:32:32.168 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/ccp/ccp.ko 2023-12-17T11:32:32.168 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/intel 2023-12-17T11:32:32.168 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/intel/qat 2023-12-17T11:32:32.168 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/intel/qat/qat_common 2023-12-17T11:32:32.168 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2023-12-17T11:32:32.168 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2023-12-17T11:32:32.168 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2023-12-17T11:32:32.168 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/padlock-aes.ko 2023-12-17T11:32:32.169 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/padlock-sha.ko 2023-12-17T11:32:32.169 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/virtio 2023-12-17T11:32:32.169 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/virtio/virtio_crypto.ko 2023-12-17T11:32:32.169 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/dca 2023-12-17T11:32:32.169 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/dca/dca.ko 2023-12-17T11:32:32.169 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/devfreq 2023-12-17T11:32:32.169 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/devfreq/governor_simpleondemand.ko 2023-12-17T11:32:32.169 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/dma 2023-12-17T11:32:32.169 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/dma/dw 2023-12-17T11:32:32.169 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/dma/dw/dw_dmac.ko 2023-12-17T11:32:32.169 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/dma/ioat 2023-12-17T11:32:32.169 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/dma/ioat/ioatdma.ko 2023-12-17T11:32:32.169 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac 2023-12-17T11:32:32.169 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/amd64_edac.ko 2023-12-17T11:32:32.170 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/e752x_edac.ko 2023-12-17T11:32:32.170 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/edac_mce_amd.ko 2023-12-17T11:32:32.170 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/i3000_edac.ko 2023-12-17T11:32:32.170 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/i3200_edac.ko 2023-12-17T11:32:32.170 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/i5100_edac.ko 2023-12-17T11:32:32.170 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/i5400_edac.ko 2023-12-17T11:32:32.170 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/i7300_edac.ko 2023-12-17T11:32:32.170 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/i7core_edac.ko 2023-12-17T11:32:32.170 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/i82975x_edac.ko 2023-12-17T11:32:32.170 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/ie31200_edac.ko 2023-12-17T11:32:32.170 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/sb_edac.ko 2023-12-17T11:32:32.170 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/x38_edac.ko 2023-12-17T11:32:32.170 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/firmware 2023-12-17T11:32:32.170 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/firmware/edd.ko 2023-12-17T11:32:32.171 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/firmware/iscsi_ibft.ko 2023-12-17T11:32:32.171 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio 2023-12-17T11:32:32.171 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-ich.ko 2023-12-17T11:32:32.171 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-viperboard.ko 2023-12-17T11:32:32.171 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid 2023-12-17T11:32:32.171 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-appleir.ko 2023-12-17T11:32:32.171 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-aureal.ko 2023-12-17T11:32:32.171 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-axff.ko 2023-12-17T11:32:32.171 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-dr.ko 2023-12-17T11:32:32.171 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-elecom.ko 2023-12-17T11:32:32.171 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-elo.ko 2023-12-17T11:32:32.171 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-emsff.ko 2023-12-17T11:32:32.171 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-gaff.ko 2023-12-17T11:32:32.171 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-gt683r.ko 2023-12-17T11:32:32.172 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-gyration.ko 2023-12-17T11:32:32.172 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-holtek-kbd.ko 2023-12-17T11:32:32.172 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-holtek-mouse.ko 2023-12-17T11:32:32.172 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-holtekff.ko 2023-12-17T11:32:32.172 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-hyperv.ko 2023-12-17T11:32:32.172 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-icade.ko 2023-12-17T11:32:32.172 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-keytouch.ko 2023-12-17T11:32:32.172 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-kye.ko 2023-12-17T11:32:32.172 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-lcpower.ko 2023-12-17T11:32:32.172 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-led.ko 2023-12-17T11:32:32.172 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-lenovo.ko 2023-12-17T11:32:32.172 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-logitech-dj.ko 2023-12-17T11:32:32.172 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-logitech-hidpp.ko 2023-12-17T11:32:32.172 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-multitouch.ko 2023-12-17T11:32:32.173 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-ortek.ko 2023-12-17T11:32:32.173 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-penmount.ko 2023-12-17T11:32:32.173 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-petalynx.ko 2023-12-17T11:32:32.173 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-picolcd.ko 2023-12-17T11:32:32.173 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-pl.ko 2023-12-17T11:32:32.173 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-plantronics.ko 2023-12-17T11:32:32.173 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-primax.ko 2023-12-17T11:32:32.173 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-rmi.ko 2023-12-17T11:32:32.173 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-arvo.ko 2023-12-17T11:32:32.173 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-common.ko 2023-12-17T11:32:32.173 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-isku.ko 2023-12-17T11:32:32.173 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-kone.ko 2023-12-17T11:32:32.173 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-koneplus.ko 2023-12-17T11:32:32.173 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-konepure.ko 2023-12-17T11:32:32.174 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-kovaplus.ko 2023-12-17T11:32:32.174 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-lua.ko 2023-12-17T11:32:32.174 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-pyra.ko 2023-12-17T11:32:32.174 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-ryos.ko 2023-12-17T11:32:32.174 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-savu.ko 2023-12-17T11:32:32.174 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat.ko 2023-12-17T11:32:32.174 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-saitek.ko 2023-12-17T11:32:32.174 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-samsung.ko 2023-12-17T11:32:32.174 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-sensor-hub.ko 2023-12-17T11:32:32.174 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-sjoy.ko 2023-12-17T11:32:32.174 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-sony.ko 2023-12-17T11:32:32.174 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-speedlink.ko 2023-12-17T11:32:32.174 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-steelseries.ko 2023-12-17T11:32:32.174 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-sunplus.ko 2023-12-17T11:32:32.175 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-thrustmaster.ko 2023-12-17T11:32:32.175 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-tivo.ko 2023-12-17T11:32:32.175 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-tmff.ko 2023-12-17T11:32:32.175 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-topseed.ko 2023-12-17T11:32:32.175 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-twinhan.ko 2023-12-17T11:32:32.175 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-uclogic.ko 2023-12-17T11:32:32.175 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-waltop.ko 2023-12-17T11:32:32.175 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-wiimote.ko 2023-12-17T11:32:32.175 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-xinmo.ko 2023-12-17T11:32:32.175 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-zpff.ko 2023-12-17T11:32:32.175 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-zydacron.ko 2023-12-17T11:32:32.175 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/uhid.ko 2023-12-17T11:32:32.175 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/wacom.ko 2023-12-17T11:32:32.175 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hv 2023-12-17T11:32:32.176 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hv/hv_balloon.ko 2023-12-17T11:32:32.176 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hv/hv_utils.ko 2023-12-17T11:32:32.176 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hv/hv_vmbus.ko 2023-12-17T11:32:32.176 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon 2023-12-17T11:32:32.176 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/abituguru.ko 2023-12-17T11:32:32.176 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/abituguru3.ko 2023-12-17T11:32:32.176 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/acpi_power_meter.ko 2023-12-17T11:32:32.176 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ad7414.ko 2023-12-17T11:32:32.176 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ad7418.ko 2023-12-17T11:32:32.176 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adc128d818.ko 2023-12-17T11:32:32.176 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adm1025.ko 2023-12-17T11:32:32.176 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adm1026.ko 2023-12-17T11:32:32.176 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adm1029.ko 2023-12-17T11:32:32.176 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adm1031.ko 2023-12-17T11:32:32.176 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adm9240.ko 2023-12-17T11:32:32.177 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ads7828.ko 2023-12-17T11:32:32.177 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adt7410.ko 2023-12-17T11:32:32.177 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adt7411.ko 2023-12-17T11:32:32.177 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adt7462.ko 2023-12-17T11:32:32.177 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adt7470.ko 2023-12-17T11:32:32.177 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adt7475.ko 2023-12-17T11:32:32.177 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adt7x10.ko 2023-12-17T11:32:32.177 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/amc6821.ko 2023-12-17T11:32:32.177 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/applesmc.ko 2023-12-17T11:32:32.177 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/asb100.ko 2023-12-17T11:32:32.177 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/asc7621.ko 2023-12-17T11:32:32.177 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/asus_atk0110.ko 2023-12-17T11:32:32.177 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/atxp1.ko 2023-12-17T11:32:32.177 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/coretemp.ko 2023-12-17T11:32:32.178 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/dell-smm-hwmon.ko 2023-12-17T11:32:32.178 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/dme1737.ko 2023-12-17T11:32:32.178 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ds1621.ko 2023-12-17T11:32:32.178 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ds620.ko 2023-12-17T11:32:32.178 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/emc1403.ko 2023-12-17T11:32:32.178 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/emc6w201.ko 2023-12-17T11:32:32.178 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/f71805f.ko 2023-12-17T11:32:32.178 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/f71882fg.ko 2023-12-17T11:32:32.178 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/f75375s.ko 2023-12-17T11:32:32.178 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/fam15h_power.ko 2023-12-17T11:32:32.178 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/fschmd.ko 2023-12-17T11:32:32.178 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/g760a.ko 2023-12-17T11:32:32.178 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/g762.ko 2023-12-17T11:32:32.178 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/gl518sm.ko 2023-12-17T11:32:32.178 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/gl520sm.ko 2023-12-17T11:32:32.179 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/hwmon-vid.ko 2023-12-17T11:32:32.179 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/i5500_temp.ko 2023-12-17T11:32:32.179 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/i5k_amb.ko 2023-12-17T11:32:32.179 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ibmaem.ko 2023-12-17T11:32:32.179 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ibmpex.ko 2023-12-17T11:32:32.179 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ina209.ko 2023-12-17T11:32:32.179 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ina2xx.ko 2023-12-17T11:32:32.179 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/it87.ko 2023-12-17T11:32:32.179 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/k10temp.ko 2023-12-17T11:32:32.179 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/k8temp.ko 2023-12-17T11:32:32.179 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lineage-pem.ko 2023-12-17T11:32:32.179 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm63.ko 2023-12-17T11:32:32.179 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm73.ko 2023-12-17T11:32:32.179 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm75.ko 2023-12-17T11:32:32.180 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm77.ko 2023-12-17T11:32:32.180 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm78.ko 2023-12-17T11:32:32.180 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm80.ko 2023-12-17T11:32:32.180 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm83.ko 2023-12-17T11:32:32.180 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm85.ko 2023-12-17T11:32:32.180 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm87.ko 2023-12-17T11:32:32.180 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm90.ko 2023-12-17T11:32:32.180 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm92.ko 2023-12-17T11:32:32.180 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm93.ko 2023-12-17T11:32:32.180 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm95234.ko 2023-12-17T11:32:32.180 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm95241.ko 2023-12-17T11:32:32.181 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm95245.ko 2023-12-17T11:32:32.181 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ltc2945.ko 2023-12-17T11:32:32.181 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ltc4151.ko 2023-12-17T11:32:32.181 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ltc4215.ko 2023-12-17T11:32:32.181 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ltc4222.ko 2023-12-17T11:32:32.181 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ltc4245.ko 2023-12-17T11:32:32.181 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ltc4260.ko 2023-12-17T11:32:32.181 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ltc4261.ko 2023-12-17T11:32:32.181 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/max16065.ko 2023-12-17T11:32:32.181 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/max1619.ko 2023-12-17T11:32:32.181 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/max1668.ko 2023-12-17T11:32:32.181 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/max197.ko 2023-12-17T11:32:32.182 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/max6639.ko 2023-12-17T11:32:32.182 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/max6650.ko 2023-12-17T11:32:32.182 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/max6697.ko 2023-12-17T11:32:32.182 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/mcp3021.ko 2023-12-17T11:32:32.182 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/nct6683.ko 2023-12-17T11:32:32.182 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/nct6775-core.ko 2023-12-17T11:32:32.182 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/nct6775.ko 2023-12-17T11:32:32.182 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/nct7802.ko 2023-12-17T11:32:32.182 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pc87360.ko 2023-12-17T11:32:32.182 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pc87427.ko 2023-12-17T11:32:32.182 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pcf8591.ko 2023-12-17T11:32:32.182 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus 2023-12-17T11:32:32.182 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/adm1275.ko 2023-12-17T11:32:32.182 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/lm25066.ko 2023-12-17T11:32:32.183 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/ltc2978.ko 2023-12-17T11:32:32.183 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/max16064.ko 2023-12-17T11:32:32.183 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/max34440.ko 2023-12-17T11:32:32.183 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/max8688.ko 2023-12-17T11:32:32.183 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/pmbus.ko 2023-12-17T11:32:32.183 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2023-12-17T11:32:32.183 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/tps40422.ko 2023-12-17T11:32:32.183 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/ucd9000.ko 2023-12-17T11:32:32.183 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/ucd9200.ko 2023-12-17T11:32:32.183 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/zl6100.ko 2023-12-17T11:32:32.183 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/powr1220.ko 2023-12-17T11:32:32.183 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/sch5627.ko 2023-12-17T11:32:32.183 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/sch5636.ko 2023-12-17T11:32:32.183 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/sch56xx-common.ko 2023-12-17T11:32:32.184 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/sht15.ko 2023-12-17T11:32:32.184 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/sht21.ko 2023-12-17T11:32:32.184 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/shtc1.ko 2023-12-17T11:32:32.184 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/sis5595.ko 2023-12-17T11:32:32.184 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/smsc47b397.ko 2023-12-17T11:32:32.184 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/smsc47m1.ko 2023-12-17T11:32:32.184 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/smsc47m192.ko 2023-12-17T11:32:32.184 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/thmc50.ko 2023-12-17T11:32:32.184 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/tmp102.ko 2023-12-17T11:32:32.184 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/tmp103.ko 2023-12-17T11:32:32.184 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/tmp401.ko 2023-12-17T11:32:32.184 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/tmp421.ko 2023-12-17T11:32:32.184 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/via-cputemp.ko 2023-12-17T11:32:32.184 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/via686a.ko 2023-12-17T11:32:32.185 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/vt1211.ko 2023-12-17T11:32:32.185 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/vt8231.ko 2023-12-17T11:32:32.185 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/w83627ehf.ko 2023-12-17T11:32:32.185 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/w83627hf.ko 2023-12-17T11:32:32.185 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/w83781d.ko 2023-12-17T11:32:32.185 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/w83791d.ko 2023-12-17T11:32:32.185 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/w83792d.ko 2023-12-17T11:32:32.185 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/w83793.ko 2023-12-17T11:32:32.185 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/w83795.ko 2023-12-17T11:32:32.185 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/w83l785ts.ko 2023-12-17T11:32:32.185 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/w83l786ng.ko 2023-12-17T11:32:32.185 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c 2023-12-17T11:32:32.185 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/algos 2023-12-17T11:32:32.186 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2023-12-17T11:32:32.186 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2023-12-17T11:32:32.186 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses 2023-12-17T11:32:32.186 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2023-12-17T11:32:32.186 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-amd756.ko 2023-12-17T11:32:32.186 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-amd8111.ko 2023-12-17T11:32:32.186 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2023-12-17T11:32:32.186 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-designware-core.ko 2023-12-17T11:32:32.186 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2023-12-17T11:32:32.186 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2023-12-17T11:32:32.186 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2023-12-17T11:32:32.186 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-i801.ko 2023-12-17T11:32:32.186 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-isch.ko 2023-12-17T11:32:32.186 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-ismt.ko 2023-12-17T11:32:32.187 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2023-12-17T11:32:32.187 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-nforce2.ko 2023-12-17T11:32:32.187 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-parport.ko 2023-12-17T11:32:32.187 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2023-12-17T11:32:32.187 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-piix4.ko 2023-12-17T11:32:32.187 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-scmi.ko 2023-12-17T11:32:32.187 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-simtec.ko 2023-12-17T11:32:32.187 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-sis96x.ko 2023-12-17T11:32:32.187 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2023-12-17T11:32:32.187 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-via.ko 2023-12-17T11:32:32.187 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-viapro.ko 2023-12-17T11:32:32.187 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-viperboard.ko 2023-12-17T11:32:32.187 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/i2c-dev.ko 2023-12-17T11:32:32.187 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/i2c-mux.ko 2023-12-17T11:32:32.187 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/i2c-slave-eeprom.ko 2023-12-17T11:32:32.188 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/i2c-smbus.ko 2023-12-17T11:32:32.188 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/i2c-stub.ko 2023-12-17T11:32:32.188 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband 2023-12-17T11:32:32.188 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/core 2023-12-17T11:32:32.188 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/core/ib_cm.ko 2023-12-17T11:32:32.188 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/core/ib_core.ko 2023-12-17T11:32:32.188 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/core/ib_umad.ko 2023-12-17T11:32:32.188 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/core/ib_uverbs.ko 2023-12-17T11:32:32.188 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/core/iw_cm.ko 2023-12-17T11:32:32.188 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/core/rdma_cm.ko 2023-12-17T11:32:32.188 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/core/rdma_ucm.ko 2023-12-17T11:32:32.188 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw 2023-12-17T11:32:32.188 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw/cxgb4 2023-12-17T11:32:32.188 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2023-12-17T11:32:32.189 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw/mlx4 2023-12-17T11:32:32.189 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2023-12-17T11:32:32.189 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw/mlx5 2023-12-17T11:32:32.189 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2023-12-17T11:32:32.189 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw/mthca 2023-12-17T11:32:32.189 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2023-12-17T11:32:32.189 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp 2023-12-17T11:32:32.189 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/ipoib 2023-12-17T11:32:32.189 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2023-12-17T11:32:32.189 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/iser 2023-12-17T11:32:32.189 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2023-12-17T11:32:32.189 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/isert 2023-12-17T11:32:32.189 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2023-12-17T11:32:32.190 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/srp 2023-12-17T11:32:32.190 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2023-12-17T11:32:32.190 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/srpt 2023-12-17T11:32:32.190 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2023-12-17T11:32:32.190 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input 2023-12-17T11:32:32.190 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/gameport 2023-12-17T11:32:32.190 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/gameport/emu10k1-gp.ko 2023-12-17T11:32:32.190 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/gameport/fm801-gp.ko 2023-12-17T11:32:32.190 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/gameport/gameport.ko 2023-12-17T11:32:32.190 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/joydev.ko 2023-12-17T11:32:32.190 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard 2023-12-17T11:32:32.190 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard/gpio_keys.ko 2023-12-17T11:32:32.190 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/mouse 2023-12-17T11:32:32.190 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/mouse/appletouch.ko 2023-12-17T11:32:32.191 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/mouse/bcm5974.ko 2023-12-17T11:32:32.191 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/mouse/cyapatp.ko 2023-12-17T11:32:32.191 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/mouse/elan_i2c.ko 2023-12-17T11:32:32.191 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/mouse/sermouse.ko 2023-12-17T11:32:32.191 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/mouse/synaptics_i2c.ko 2023-12-17T11:32:32.191 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/mouse/synaptics_usb.ko 2023-12-17T11:32:32.191 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/mouse/vsxxxaa.ko 2023-12-17T11:32:32.191 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/rmi4 2023-12-17T11:32:32.191 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/rmi4/rmi_core.ko 2023-12-17T11:32:32.191 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/serio 2023-12-17T11:32:32.191 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/serio/altera_ps2.ko 2023-12-17T11:32:32.191 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/serio/arc_ps2.ko 2023-12-17T11:32:32.191 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/serio/hyperv-keyboard.ko 2023-12-17T11:32:32.191 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/serio/serio_raw.ko 2023-12-17T11:32:32.192 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/sparse-keymap.ko 2023-12-17T11:32:32.192 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/iommu 2023-12-17T11:32:32.192 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/iommu/amd 2023-12-17T11:32:32.192 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/iommu/amd/iommu_v2.ko 2023-12-17T11:32:32.192 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds 2023-12-17T11:32:32.192 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-blinkm.ko 2023-12-17T11:32:32.192 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-lm3530.ko 2023-12-17T11:32:32.192 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-lp3944.ko 2023-12-17T11:32:32.192 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-ss4200.ko 2023-12-17T11:32:32.192 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/trigger 2023-12-17T11:32:32.192 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/trigger/ledtrig-audio.ko 2023-12-17T11:32:32.192 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2023-12-17T11:32:32.192 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/trigger/ledtrig-camera.ko 2023-12-17T11:32:32.193 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2023-12-17T11:32:32.193 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2023-12-17T11:32:32.193 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2023-12-17T11:32:32.193 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/trigger/ledtrig-timer.ko 2023-12-17T11:32:32.193 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/trigger/ledtrig-transient.ko 2023-12-17T11:32:32.193 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md 2023-12-17T11:32:32.193 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/bcache 2023-12-17T11:32:32.193 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/bcache/bcache.ko 2023-12-17T11:32:32.193 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-bio-prison.ko 2023-12-17T11:32:32.193 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-cache-smq.ko 2023-12-17T11:32:32.193 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-cache.ko 2023-12-17T11:32:32.193 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-crypt.ko 2023-12-17T11:32:32.193 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-delay.ko 2023-12-17T11:32:32.194 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-flakey.ko 2023-12-17T11:32:32.194 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-log-userspace.ko 2023-12-17T11:32:32.194 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-multipath.ko 2023-12-17T11:32:32.194 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-queue-length.ko 2023-12-17T11:32:32.194 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-raid.ko 2023-12-17T11:32:32.194 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-round-robin.ko 2023-12-17T11:32:32.194 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-service-time.ko 2023-12-17T11:32:32.194 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-switch.ko 2023-12-17T11:32:32.194 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-thin-pool.ko 2023-12-17T11:32:32.194 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-verity.ko 2023-12-17T11:32:32.194 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/faulty.ko 2023-12-17T11:32:32.194 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/linear.ko 2023-12-17T11:32:32.194 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/multipath.ko 2023-12-17T11:32:32.194 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/persistent-data 2023-12-17T11:32:32.195 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2023-12-17T11:32:32.195 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/raid0.ko 2023-12-17T11:32:32.195 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/raid1.ko 2023-12-17T11:32:32.195 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/raid10.ko 2023-12-17T11:32:32.195 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/raid456.ko 2023-12-17T11:32:32.195 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/message 2023-12-17T11:32:32.195 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/message/fusion 2023-12-17T11:32:32.195 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/message/fusion/mptbase.ko 2023-12-17T11:32:32.195 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/message/fusion/mptctl.ko 2023-12-17T11:32:32.195 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/message/fusion/mptfc.ko 2023-12-17T11:32:32.195 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/message/fusion/mptlan.ko 2023-12-17T11:32:32.195 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/message/fusion/mptsas.ko 2023-12-17T11:32:32.195 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/message/fusion/mptscsih.ko 2023-12-17T11:32:32.195 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/message/fusion/mptspi.ko 2023-12-17T11:32:32.195 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd 2023-12-17T11:32:32.196 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/lpc_ich.ko 2023-12-17T11:32:32.196 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/lpc_sch.ko 2023-12-17T11:32:32.196 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/mfd-core.ko 2023-12-17T11:32:32.196 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/sm501.ko 2023-12-17T11:32:32.196 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/viperboard.ko 2023-12-17T11:32:32.196 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/vx855.ko 2023-12-17T11:32:32.196 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/wl1273-core.ko 2023-12-17T11:32:32.196 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc 2023-12-17T11:32:32.196 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/altera-stapl 2023-12-17T11:32:32.196 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2023-12-17T11:32:32.196 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/apds9802als.ko 2023-12-17T11:32:32.196 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/apds990x.ko 2023-12-17T11:32:32.196 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/bh1770glc.ko 2023-12-17T11:32:32.196 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/cb710 2023-12-17T11:32:32.197 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/cb710/cb710.ko 2023-12-17T11:32:32.197 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/eeprom 2023-12-17T11:32:32.197 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/eeprom/at24.ko 2023-12-17T11:32:32.197 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/eeprom/eeprom.ko 2023-12-17T11:32:32.197 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2023-12-17T11:32:32.197 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/eeprom/max6875.ko 2023-12-17T11:32:32.197 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/enclosure.ko 2023-12-17T11:32:32.197 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/hpilo.ko 2023-12-17T11:32:32.197 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/isl29003.ko 2023-12-17T11:32:32.197 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/isl29020.ko 2023-12-17T11:32:32.197 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/lis3lv02d 2023-12-17T11:32:32.197 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2023-12-17T11:32:32.197 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2023-12-17T11:32:32.198 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/mei 2023-12-17T11:32:32.198 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/mei/mei-me.ko 2023-12-17T11:32:32.198 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/mei/mei-txe.ko 2023-12-17T11:32:32.198 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/mei/mei.ko 2023-12-17T11:32:32.198 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/sgi-gru 2023-12-17T11:32:32.198 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/sgi-gru/gru.ko 2023-12-17T11:32:32.198 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/sgi-xp 2023-12-17T11:32:32.198 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/sgi-xp/xp.ko 2023-12-17T11:32:32.198 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/sgi-xp/xpc.ko 2023-12-17T11:32:32.198 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/sgi-xp/xpnet.ko 2023-12-17T11:32:32.198 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/tifm_7xx1.ko 2023-12-17T11:32:32.198 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/tifm_core.ko 2023-12-17T11:32:32.198 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/tsl2550.ko 2023-12-17T11:32:32.198 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/vmw_balloon.ko 2023-12-17T11:32:32.198 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/vmw_vmci 2023-12-17T11:32:32.199 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2023-12-17T11:32:32.199 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net 2023-12-17T11:32:32.199 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/bonding 2023-12-17T11:32:32.199 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/bonding/bonding.ko 2023-12-17T11:32:32.199 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/dsa 2023-12-17T11:32:32.199 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/dsa/b53 2023-12-17T11:32:32.199 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/dsa/b53/b53_common.ko 2023-12-17T11:32:32.199 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/dsa/bcm-sf2.ko 2023-12-17T11:32:32.199 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/dsa/mv88e6060.ko 2023-12-17T11:32:32.199 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/dsa/mv88e6xxx 2023-12-17T11:32:32.199 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2023-12-17T11:32:32.199 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/dummy.ko 2023-12-17T11:32:32.199 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/eql.ko 2023-12-17T11:32:32.199 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet 2023-12-17T11:32:32.199 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/3com 2023-12-17T11:32:32.200 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2023-12-17T11:32:32.200 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2023-12-17T11:32:32.200 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/3com/3c59x.ko 2023-12-17T11:32:32.200 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/3com/typhoon.ko 2023-12-17T11:32:32.200 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/8390 2023-12-17T11:32:32.200 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/8390/8390.ko 2023-12-17T11:32:32.200 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2023-12-17T11:32:32.200 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2023-12-17T11:32:32.200 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2023-12-17T11:32:32.200 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/adaptec 2023-12-17T11:32:32.200 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/adaptec/starfire.ko 2023-12-17T11:32:32.200 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/agere 2023-12-17T11:32:32.200 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/agere/et131x.ko 2023-12-17T11:32:32.200 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/alteon 2023-12-17T11:32:32.201 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/alteon/acenic.ko 2023-12-17T11:32:32.201 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/altera 2023-12-17T11:32:32.201 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/altera/altera_tse.ko 2023-12-17T11:32:32.201 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/amd 2023-12-17T11:32:32.201 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/amd/amd8111e.ko 2023-12-17T11:32:32.201 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2023-12-17T11:32:32.201 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/amd/pcnet32.ko 2023-12-17T11:32:32.201 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros 2023-12-17T11:32:32.201 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros/alx 2023-12-17T11:32:32.201 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2023-12-17T11:32:32.201 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros/atl1c 2023-12-17T11:32:32.201 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2023-12-17T11:32:32.201 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros/atl1e 2023-12-17T11:32:32.201 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2023-12-17T11:32:32.202 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros/atlx 2023-12-17T11:32:32.202 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2023-12-17T11:32:32.202 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2023-12-17T11:32:32.202 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/broadcom 2023-12-17T11:32:32.202 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/broadcom/b44.ko 2023-12-17T11:32:32.202 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2023-12-17T11:32:32.202 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/broadcom/bnx2x 2023-12-17T11:32:32.202 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2023-12-17T11:32:32.202 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/broadcom/cnic.ko 2023-12-17T11:32:32.202 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/broadcom/genet 2023-12-17T11:32:32.202 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2023-12-17T11:32:32.202 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/broadcom/tg3.ko 2023-12-17T11:32:32.202 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/brocade 2023-12-17T11:32:32.202 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/brocade/bna 2023-12-17T11:32:32.203 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2023-12-17T11:32:32.203 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio 2023-12-17T11:32:32.203 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/cxgb 2023-12-17T11:32:32.203 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2023-12-17T11:32:32.203 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/cxgb3 2023-12-17T11:32:32.203 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2023-12-17T11:32:32.203 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/cxgb4 2023-12-17T11:32:32.203 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2023-12-17T11:32:32.203 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2023-12-17T11:32:32.203 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2023-12-17T11:32:32.203 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/libcxgb 2023-12-17T11:32:32.203 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2023-12-17T11:32:32.203 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/cisco 2023-12-17T11:32:32.203 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/cisco/enic 2023-12-17T11:32:32.203 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2023-12-17T11:32:32.204 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dec 2023-12-17T11:32:32.204 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dec/tulip 2023-12-17T11:32:32.204 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2023-12-17T11:32:32.204 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2023-12-17T11:32:32.204 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2023-12-17T11:32:32.204 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2023-12-17T11:32:32.204 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2023-12-17T11:32:32.204 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2023-12-17T11:32:32.204 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dlink 2023-12-17T11:32:32.204 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dlink/dl2k.ko 2023-12-17T11:32:32.204 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dlink/sundance.ko 2023-12-17T11:32:32.204 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dnet.ko 2023-12-17T11:32:32.204 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/emulex 2023-12-17T11:32:32.204 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/emulex/benet 2023-12-17T11:32:32.205 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2023-12-17T11:32:32.205 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/ethoc.ko 2023-12-17T11:32:32.205 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/fealnx.ko 2023-12-17T11:32:32.205 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel 2023-12-17T11:32:32.205 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/e100.ko 2023-12-17T11:32:32.205 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/e1000 2023-12-17T11:32:32.205 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2023-12-17T11:32:32.205 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/e1000e 2023-12-17T11:32:32.205 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2023-12-17T11:32:32.205 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/fm10k 2023-12-17T11:32:32.205 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2023-12-17T11:32:32.205 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/i40e 2023-12-17T11:32:32.205 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2023-12-17T11:32:32.205 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/iavf 2023-12-17T11:32:32.206 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2023-12-17T11:32:32.206 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/igb 2023-12-17T11:32:32.206 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/igb/igb.ko 2023-12-17T11:32:32.206 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/igbvf 2023-12-17T11:32:32.206 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2023-12-17T11:32:32.206 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/ixgbe 2023-12-17T11:32:32.206 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2023-12-17T11:32:32.206 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/ixgbevf 2023-12-17T11:32:32.206 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2023-12-17T11:32:32.206 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/jme.ko 2023-12-17T11:32:32.206 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/marvell 2023-12-17T11:32:32.206 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2023-12-17T11:32:32.206 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/marvell/skge.ko 2023-12-17T11:32:32.206 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/marvell/sky2.ko 2023-12-17T11:32:32.207 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/mellanox 2023-12-17T11:32:32.207 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/mellanox/mlx4 2023-12-17T11:32:32.207 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2023-12-17T11:32:32.207 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2023-12-17T11:32:32.207 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/mellanox/mlx5 2023-12-17T11:32:32.207 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/mellanox/mlx5/core 2023-12-17T11:32:32.207 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2023-12-17T11:32:32.207 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/micrel 2023-12-17T11:32:32.207 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2023-12-17T11:32:32.207 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/myricom 2023-12-17T11:32:32.207 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/myricom/myri10ge 2023-12-17T11:32:32.208 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2023-12-17T11:32:32.208 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/natsemi 2023-12-17T11:32:32.208 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2023-12-17T11:32:32.208 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2023-12-17T11:32:32.208 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/neterion 2023-12-17T11:32:32.208 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/neterion/s2io.ko 2023-12-17T11:32:32.208 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/nvidia 2023-12-17T11:32:32.208 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2023-12-17T11:32:32.208 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/packetengines 2023-12-17T11:32:32.208 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2023-12-17T11:32:32.208 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2023-12-17T11:32:32.208 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/qlogic 2023-12-17T11:32:32.208 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/qlogic/netxen 2023-12-17T11:32:32.208 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2023-12-17T11:32:32.209 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2023-12-17T11:32:32.209 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/qlogic/qlcnic 2023-12-17T11:32:32.209 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2023-12-17T11:32:32.209 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/rdc 2023-12-17T11:32:32.209 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/rdc/r6040.ko 2023-12-17T11:32:32.209 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/realtek 2023-12-17T11:32:32.209 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/realtek/8139cp.ko 2023-12-17T11:32:32.209 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/realtek/8139too.ko 2023-12-17T11:32:32.209 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/realtek/atp.ko 2023-12-17T11:32:32.209 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/realtek/r8169.ko 2023-12-17T11:32:32.209 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/rocker 2023-12-17T11:32:32.209 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/rocker/rocker.ko 2023-12-17T11:32:32.209 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sfc 2023-12-17T11:32:32.210 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sfc/sfc.ko 2023-12-17T11:32:32.210 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/silan 2023-12-17T11:32:32.210 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/silan/sc92031.ko 2023-12-17T11:32:32.210 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sis 2023-12-17T11:32:32.210 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sis/sis190.ko 2023-12-17T11:32:32.210 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sis/sis900.ko 2023-12-17T11:32:32.210 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/smsc 2023-12-17T11:32:32.210 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/smsc/epic100.ko 2023-12-17T11:32:32.210 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2023-12-17T11:32:32.210 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2023-12-17T11:32:32.210 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2023-12-17T11:32:32.210 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/stmicro 2023-12-17T11:32:32.210 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/stmicro/stmmac 2023-12-17T11:32:32.210 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2023-12-17T11:32:32.211 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2023-12-17T11:32:32.211 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sun 2023-12-17T11:32:32.211 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sun/cassini.ko 2023-12-17T11:32:32.211 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sun/niu.ko 2023-12-17T11:32:32.211 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sun/sungem.ko 2023-12-17T11:32:32.211 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sun/sunhme.ko 2023-12-17T11:32:32.211 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/tehuti 2023-12-17T11:32:32.211 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2023-12-17T11:32:32.211 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/ti 2023-12-17T11:32:32.211 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/ti/tlan.ko 2023-12-17T11:32:32.211 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/via 2023-12-17T11:32:32.211 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/via/via-rhine.ko 2023-12-17T11:32:32.211 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/via/via-velocity.ko 2023-12-17T11:32:32.211 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/wiznet 2023-12-17T11:32:32.212 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/wiznet/w5100.ko 2023-12-17T11:32:32.212 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/wiznet/w5300.ko 2023-12-17T11:32:32.212 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/xircom 2023-12-17T11:32:32.212 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2023-12-17T11:32:32.212 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/geneve.ko 2023-12-17T11:32:32.212 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/hyperv 2023-12-17T11:32:32.212 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/hyperv/hv_netvsc.ko 2023-12-17T11:32:32.212 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ieee802154 2023-12-17T11:32:32.212 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ieee802154/fakelb.ko 2023-12-17T11:32:32.212 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ifb.ko 2023-12-17T11:32:32.212 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ipvlan 2023-12-17T11:32:32.212 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ipvlan/ipvlan.ko 2023-12-17T11:32:32.212 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/macvlan.ko 2023-12-17T11:32:32.212 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/macvtap.ko 2023-12-17T11:32:32.212 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/mdio 2023-12-17T11:32:32.213 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/mdio.ko 2023-12-17T11:32:32.213 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2023-12-17T11:32:32.213 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/mdio/mdio-bitbang.ko 2023-12-17T11:32:32.213 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/mdio/mdio-regmap.ko 2023-12-17T11:32:32.213 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/mii.ko 2023-12-17T11:32:32.213 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/net_failover.ko 2023-12-17T11:32:32.213 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/netconsole.ko 2023-12-17T11:32:32.213 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/nlmon.ko 2023-12-17T11:32:32.213 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/pcs 2023-12-17T11:32:32.213 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/pcs/pcs-lynx.ko 2023-12-17T11:32:32.213 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/pcs/pcs_xpcs.ko 2023-12-17T11:32:32.213 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy 2023-12-17T11:32:32.214 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/amd.ko 2023-12-17T11:32:32.214 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/bcm-phy-lib.ko 2023-12-17T11:32:32.214 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/bcm-phy-ptp.ko 2023-12-17T11:32:32.214 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/bcm7xxx.ko 2023-12-17T11:32:32.214 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/bcm87xx.ko 2023-12-17T11:32:32.214 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/broadcom.ko 2023-12-17T11:32:32.214 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/cicada.ko 2023-12-17T11:32:32.214 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/davicom.ko 2023-12-17T11:32:32.214 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/dp83640.ko 2023-12-17T11:32:32.214 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/et1011c.ko 2023-12-17T11:32:32.214 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/icplus.ko 2023-12-17T11:32:32.214 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/lxt.ko 2023-12-17T11:32:32.214 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/marvell.ko 2023-12-17T11:32:32.214 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/micrel.ko 2023-12-17T11:32:32.214 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/national.ko 2023-12-17T11:32:32.215 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/phylink.ko 2023-12-17T11:32:32.215 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/qsemi.ko 2023-12-17T11:32:32.215 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/realtek.ko 2023-12-17T11:32:32.215 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/smsc.ko 2023-12-17T11:32:32.215 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/ste10Xp.ko 2023-12-17T11:32:32.215 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/vitesse.ko 2023-12-17T11:32:32.215 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ppp 2023-12-17T11:32:32.215 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ppp/bsd_comp.ko 2023-12-17T11:32:32.215 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ppp/ppp_async.ko 2023-12-17T11:32:32.215 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ppp/ppp_deflate.ko 2023-12-17T11:32:32.215 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ppp/ppp_generic.ko 2023-12-17T11:32:32.215 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ppp/ppp_mppe.ko 2023-12-17T11:32:32.215 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ppp/ppp_synctty.ko 2023-12-17T11:32:32.216 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ppp/pppoe.ko 2023-12-17T11:32:32.216 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ppp/pppox.ko 2023-12-17T11:32:32.216 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ppp/pptp.ko 2023-12-17T11:32:32.216 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/slip 2023-12-17T11:32:32.216 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/slip/slhc.ko 2023-12-17T11:32:32.216 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/slip/slip.ko 2023-12-17T11:32:32.216 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/sungem_phy.ko 2023-12-17T11:32:32.216 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/tap.ko 2023-12-17T11:32:32.216 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/team 2023-12-17T11:32:32.216 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/team/team.ko 2023-12-17T11:32:32.216 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/team/team_mode_activebackup.ko 2023-12-17T11:32:32.216 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/team/team_mode_broadcast.ko 2023-12-17T11:32:32.216 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/team/team_mode_loadbalance.ko 2023-12-17T11:32:32.216 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/team/team_mode_random.ko 2023-12-17T11:32:32.217 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/team/team_mode_roundrobin.ko 2023-12-17T11:32:32.217 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/tun.ko 2023-12-17T11:32:32.217 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/veth.ko 2023-12-17T11:32:32.217 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/virtio_net.ko 2023-12-17T11:32:32.217 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/vmxnet3 2023-12-17T11:32:32.217 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/vmxnet3/vmxnet3.ko 2023-12-17T11:32:32.217 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/vxlan 2023-12-17T11:32:32.217 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/vxlan/vxlan.ko 2023-12-17T11:32:32.217 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/xen-netback 2023-12-17T11:32:32.217 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/xen-netback/xen-netback.ko 2023-12-17T11:32:32.217 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/xen-netfront.ko 2023-12-17T11:32:32.217 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ntb 2023-12-17T11:32:32.217 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ntb/ntb.ko 2023-12-17T11:32:32.217 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/nvme 2023-12-17T11:32:32.218 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/nvme/host 2023-12-17T11:32:32.218 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/nvme/host/nvme-core.ko 2023-12-17T11:32:32.218 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/nvme/host/nvme.ko 2023-12-17T11:32:32.218 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/parport 2023-12-17T11:32:32.218 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/parport/parport.ko 2023-12-17T11:32:32.218 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/parport/parport_cs.ko 2023-12-17T11:32:32.218 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/parport/parport_pc.ko 2023-12-17T11:32:32.218 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/parport/parport_serial.ko 2023-12-17T11:32:32.218 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pci 2023-12-17T11:32:32.218 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pci/hotplug 2023-12-17T11:32:32.218 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2023-12-17T11:32:32.218 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pci/pcie 2023-12-17T11:32:32.218 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pci/pcie/aer_inject.ko 2023-12-17T11:32:32.218 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pci/xen-pcifront.ko 2023-12-17T11:32:32.219 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pcmcia 2023-12-17T11:32:32.219 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pcmcia/i82092.ko 2023-12-17T11:32:32.219 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pcmcia/pd6729.ko 2023-12-17T11:32:32.219 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pcmcia/yenta_socket.ko 2023-12-17T11:32:32.219 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pinctrl 2023-12-17T11:32:32.219 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pinctrl/intel 2023-12-17T11:32:32.219 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2023-12-17T11:32:32.219 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform 2023-12-17T11:32:32.219 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86 2023-12-17T11:32:32.219 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/acer-wmi.ko 2023-12-17T11:32:32.219 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/acerhdf.ko 2023-12-17T11:32:32.219 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/apple-gmux.ko 2023-12-17T11:32:32.219 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/asus-laptop.ko 2023-12-17T11:32:32.219 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/asus-nb-wmi.ko 2023-12-17T11:32:32.220 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/asus-wmi.ko 2023-12-17T11:32:32.220 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/classmate-laptop.ko 2023-12-17T11:32:32.220 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/eeepc-laptop.ko 2023-12-17T11:32:32.220 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/eeepc-wmi.ko 2023-12-17T11:32:32.220 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/fujitsu-laptop.ko 2023-12-17T11:32:32.220 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/fujitsu-tablet.ko 2023-12-17T11:32:32.220 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/hdaps.ko 2023-12-17T11:32:32.220 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/intel 2023-12-17T11:32:32.220 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/intel/intel-rst.ko 2023-12-17T11:32:32.220 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/intel_ips.ko 2023-12-17T11:32:32.220 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/msi-wmi.ko 2023-12-17T11:32:32.220 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/mxm-wmi.ko 2023-12-17T11:32:32.220 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/panasonic-laptop.ko 2023-12-17T11:32:32.220 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/samsung-laptop.ko 2023-12-17T11:32:32.221 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/samsung-q10.ko 2023-12-17T11:32:32.221 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/topstar-laptop.ko 2023-12-17T11:32:32.221 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2023-12-17T11:32:32.221 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/toshiba_haps.ko 2023-12-17T11:32:32.221 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/wmi-bmof.ko 2023-12-17T11:32:32.221 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/wmi.ko 2023-12-17T11:32:32.221 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/powercap 2023-12-17T11:32:32.221 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/powercap/intel_rapl_common.ko 2023-12-17T11:32:32.221 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/powercap/intel_rapl_msr.ko 2023-12-17T11:32:32.221 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pps 2023-12-17T11:32:32.221 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pps/clients 2023-12-17T11:32:32.221 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pps/clients/pps-gpio.ko 2023-12-17T11:32:32.221 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pps/clients/pps-ldisc.ko 2023-12-17T11:32:32.221 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pps/clients/pps_parport.ko 2023-12-17T11:32:32.222 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pps/pps_core.ko 2023-12-17T11:32:32.222 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ptp 2023-12-17T11:32:32.222 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ptp/ptp.ko 2023-12-17T11:32:32.222 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ptp/ptp_kvm.ko 2023-12-17T11:32:32.222 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc 2023-12-17T11:32:32.222 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-bq32k.ko 2023-12-17T11:32:32.222 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-ds1286.ko 2023-12-17T11:32:32.222 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-ds1307.ko 2023-12-17T11:32:32.222 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-ds1374.ko 2023-12-17T11:32:32.222 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-ds1511.ko 2023-12-17T11:32:32.222 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-ds1553.ko 2023-12-17T11:32:32.222 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-ds1672.ko 2023-12-17T11:32:32.222 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-ds1742.ko 2023-12-17T11:32:32.222 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-ds2404.ko 2023-12-17T11:32:32.223 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-ds3232.ko 2023-12-17T11:32:32.223 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-em3027.ko 2023-12-17T11:32:32.223 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-fm3130.ko 2023-12-17T11:32:32.223 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-isl12022.ko 2023-12-17T11:32:32.223 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-isl1208.ko 2023-12-17T11:32:32.223 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-m41t80.ko 2023-12-17T11:32:32.223 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-m48t35.ko 2023-12-17T11:32:32.223 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-m48t59.ko 2023-12-17T11:32:32.223 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-max6900.ko 2023-12-17T11:32:32.223 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-msm6242.ko 2023-12-17T11:32:32.223 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-pcf2127.ko 2023-12-17T11:32:32.223 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-pcf85063.ko 2023-12-17T11:32:32.223 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-pcf8523.ko 2023-12-17T11:32:32.223 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-pcf8563.ko 2023-12-17T11:32:32.224 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-pcf8583.ko 2023-12-17T11:32:32.224 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-rp5c01.ko 2023-12-17T11:32:32.224 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-rs5c372.ko 2023-12-17T11:32:32.224 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-rv3029c2.ko 2023-12-17T11:32:32.224 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-rx8025.ko 2023-12-17T11:32:32.224 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-rx8581.ko 2023-12-17T11:32:32.224 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-stk17ta8.ko 2023-12-17T11:32:32.224 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-x1205.ko 2023-12-17T11:32:32.224 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi 2023-12-17T11:32:32.224 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/3w-9xxx.ko 2023-12-17T11:32:32.224 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/3w-sas.ko 2023-12-17T11:32:32.224 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/3w-xxxx.ko 2023-12-17T11:32:32.224 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/BusLogic.ko 2023-12-17T11:32:32.224 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/a100u2w.ko 2023-12-17T11:32:32.225 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/aacraid 2023-12-17T11:32:32.225 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/aacraid/aacraid.ko 2023-12-17T11:32:32.225 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/advansys.ko 2023-12-17T11:32:32.225 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/aic7xxx 2023-12-17T11:32:32.225 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2023-12-17T11:32:32.225 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2023-12-17T11:32:32.225 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/am53c974.ko 2023-12-17T11:32:32.225 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/arcmsr 2023-12-17T11:32:32.225 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/arcmsr/arcmsr.ko 2023-12-17T11:32:32.225 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/atp870u.ko 2023-12-17T11:32:32.225 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/be2iscsi 2023-12-17T11:32:32.225 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2023-12-17T11:32:32.225 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/bfa 2023-12-17T11:32:32.225 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/bfa/bfa.ko 2023-12-17T11:32:32.226 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/bnx2fc 2023-12-17T11:32:32.226 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2023-12-17T11:32:32.226 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/bnx2i 2023-12-17T11:32:32.226 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/bnx2i/bnx2i.ko 2023-12-17T11:32:32.226 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/ch.ko 2023-12-17T11:32:32.226 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/csiostor 2023-12-17T11:32:32.226 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/csiostor/csiostor.ko 2023-12-17T11:32:32.226 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/cxgbi 2023-12-17T11:32:32.226 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/cxgbi/cxgb3i 2023-12-17T11:32:32.226 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2023-12-17T11:32:32.226 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/cxgbi/cxgb4i 2023-12-17T11:32:32.226 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2023-12-17T11:32:32.226 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2023-12-17T11:32:32.226 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/dc395x.ko 2023-12-17T11:32:32.227 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/device_handler 2023-12-17T11:32:32.227 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2023-12-17T11:32:32.227 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2023-12-17T11:32:32.227 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2023-12-17T11:32:32.227 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2023-12-17T11:32:32.227 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/dmx3191d.ko 2023-12-17T11:32:32.227 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/esas2r 2023-12-17T11:32:32.227 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/esas2r/esas2r.ko 2023-12-17T11:32:32.227 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/esp_scsi.ko 2023-12-17T11:32:32.227 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/fcoe 2023-12-17T11:32:32.227 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/fcoe/fcoe.ko 2023-12-17T11:32:32.227 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/fcoe/libfcoe.ko 2023-12-17T11:32:32.227 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/fnic 2023-12-17T11:32:32.227 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/fnic/fnic.ko 2023-12-17T11:32:32.228 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/hpsa.ko 2023-12-17T11:32:32.228 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/hptiop.ko 2023-12-17T11:32:32.228 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/hv_storvsc.ko 2023-12-17T11:32:32.228 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/initio.ko 2023-12-17T11:32:32.228 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/ipr.ko 2023-12-17T11:32:32.228 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/ips.ko 2023-12-17T11:32:32.228 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/isci 2023-12-17T11:32:32.228 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/isci/isci.ko 2023-12-17T11:32:32.228 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2023-12-17T11:32:32.228 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/iscsi_tcp.ko 2023-12-17T11:32:32.228 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/libfc 2023-12-17T11:32:32.228 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/libfc/libfc.ko 2023-12-17T11:32:32.228 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/libiscsi.ko 2023-12-17T11:32:32.228 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/libiscsi_tcp.ko 2023-12-17T11:32:32.228 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/libsas 2023-12-17T11:32:32.229 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/libsas/libsas.ko 2023-12-17T11:32:32.229 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/lpfc 2023-12-17T11:32:32.229 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/lpfc/lpfc.ko 2023-12-17T11:32:32.229 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/megaraid 2023-12-17T11:32:32.229 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/megaraid.ko 2023-12-17T11:32:32.229 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2023-12-17T11:32:32.229 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2023-12-17T11:32:32.229 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2023-12-17T11:32:32.229 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/mpt3sas 2023-12-17T11:32:32.229 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2023-12-17T11:32:32.229 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/mvsas 2023-12-17T11:32:32.229 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/mvsas/mvsas.ko 2023-12-17T11:32:32.229 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/mvumi.ko 2023-12-17T11:32:32.229 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/pm8001 2023-12-17T11:32:32.230 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/pm8001/pm80xx.ko 2023-12-17T11:32:32.230 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/pmcraid.ko 2023-12-17T11:32:32.230 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/qla1280.ko 2023-12-17T11:32:32.230 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/qla2xxx 2023-12-17T11:32:32.230 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2023-12-17T11:32:32.230 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2023-12-17T11:32:32.230 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/qla4xxx 2023-12-17T11:32:32.230 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2023-12-17T11:32:32.230 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/raid_class.ko 2023-12-17T11:32:32.230 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/scsi_debug.ko 2023-12-17T11:32:32.230 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/scsi_transport_fc.ko 2023-12-17T11:32:32.230 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/scsi_transport_iscsi.ko 2023-12-17T11:32:32.230 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/scsi_transport_sas.ko 2023-12-17T11:32:32.231 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/scsi_transport_spi.ko 2023-12-17T11:32:32.231 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/scsi_transport_srp.ko 2023-12-17T11:32:32.231 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/ses.ko 2023-12-17T11:32:32.231 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/st.ko 2023-12-17T11:32:32.231 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/stex.ko 2023-12-17T11:32:32.231 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/sym53c8xx_2 2023-12-17T11:32:32.231 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2023-12-17T11:32:32.231 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/virtio_scsi.ko 2023-12-17T11:32:32.231 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/vmw_pvscsi.ko 2023-12-17T11:32:32.231 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/wd719x.ko 2023-12-17T11:32:32.231 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ssb 2023-12-17T11:32:32.231 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ssb/ssb.ko 2023-12-17T11:32:32.231 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target 2023-12-17T11:32:32.231 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/iscsi 2023-12-17T11:32:32.231 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2023-12-17T11:32:32.232 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/loopback 2023-12-17T11:32:32.232 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/loopback/tcm_loop.ko 2023-12-17T11:32:32.232 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/target_core_file.ko 2023-12-17T11:32:32.232 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/target_core_iblock.ko 2023-12-17T11:32:32.232 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/target_core_mod.ko 2023-12-17T11:32:32.232 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/target_core_pscsi.ko 2023-12-17T11:32:32.232 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/target_core_user.ko 2023-12-17T11:32:32.232 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/tcm_fc 2023-12-17T11:32:32.232 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/tcm_fc/tcm_fc.ko 2023-12-17T11:32:32.232 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal 2023-12-17T11:32:32.232 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel 2023-12-17T11:32:32.232 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal 2023-12-17T11:32:32.232 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2023-12-17T11:32:32.232 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2023-12-17T11:32:32.233 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2023-12-17T11:32:32.233 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2023-12-17T11:32:32.233 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2023-12-17T11:32:32.233 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2023-12-17T11:32:32.233 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2023-12-17T11:32:32.233 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2023-12-17T11:32:32.233 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2023-12-17T11:32:32.233 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2023-12-17T11:32:32.233 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2023-12-17T11:32:32.233 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2023-12-17T11:32:32.233 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2023-12-17T11:32:32.233 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2023-12-17T11:32:32.233 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2023-12-17T11:32:32.233 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty 2023-12-17T11:32:32.234 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/ipwireless 2023-12-17T11:32:32.234 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/ipwireless/ipwireless.ko 2023-12-17T11:32:32.234 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/n_gsm.ko 2023-12-17T11:32:32.234 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/n_hdlc.ko 2023-12-17T11:32:32.234 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/nozomi.ko 2023-12-17T11:32:32.234 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/serial 2023-12-17T11:32:32.234 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/serial/8250 2023-12-17T11:32:32.234 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/serial/8250/serial_cs.ko 2023-12-17T11:32:32.234 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/serial/arc_uart.ko 2023-12-17T11:32:32.234 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/serial/jsm 2023-12-17T11:32:32.234 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/serial/jsm/jsm.ko 2023-12-17T11:32:32.234 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ufs 2023-12-17T11:32:32.234 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ufs/core 2023-12-17T11:32:32.234 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ufs/core/ufshcd-core.ko 2023-12-17T11:32:32.235 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ufs/host 2023-12-17T11:32:32.235 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ufs/host/ufshcd-pci.ko 2023-12-17T11:32:32.235 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/uio 2023-12-17T11:32:32.235 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/uio/uio.ko 2023-12-17T11:32:32.235 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/uio/uio_aec.ko 2023-12-17T11:32:32.235 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/uio/uio_cif.ko 2023-12-17T11:32:32.235 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/uio/uio_pci_generic.ko 2023-12-17T11:32:32.235 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/uio/uio_sercos3.ko 2023-12-17T11:32:32.235 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb 2023-12-17T11:32:32.235 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/class 2023-12-17T11:32:32.235 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/class/cdc-acm.ko 2023-12-17T11:32:32.235 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/class/cdc-wdm.ko 2023-12-17T11:32:32.235 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/class/usblp.ko 2023-12-17T11:32:32.235 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/class/usbtmc.ko 2023-12-17T11:32:32.236 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/host 2023-12-17T11:32:32.236 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/host/sl811-hcd.ko 2023-12-17T11:32:32.236 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/image 2023-12-17T11:32:32.236 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/image/mdc800.ko 2023-12-17T11:32:32.236 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/image/microtek.ko 2023-12-17T11:32:32.236 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc 2023-12-17T11:32:32.236 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/adutux.ko 2023-12-17T11:32:32.236 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/appledisplay.ko 2023-12-17T11:32:32.236 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/emi26.ko 2023-12-17T11:32:32.236 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/emi62.ko 2023-12-17T11:32:32.236 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/ezusb.ko 2023-12-17T11:32:32.236 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/idmouse.ko 2023-12-17T11:32:32.236 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/iowarrior.ko 2023-12-17T11:32:32.236 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/isight_firmware.ko 2023-12-17T11:32:32.237 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/ldusb.ko 2023-12-17T11:32:32.237 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/legousbtower.ko 2023-12-17T11:32:32.237 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/sisusbvga 2023-12-17T11:32:32.237 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2023-12-17T11:32:32.237 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/trancevibrator.ko 2023-12-17T11:32:32.237 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/usb3503.ko 2023-12-17T11:32:32.237 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/usblcd.ko 2023-12-17T11:32:32.237 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/usbsevseg.ko 2023-12-17T11:32:32.237 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/uss720.ko 2023-12-17T11:32:32.237 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/yurex.ko 2023-12-17T11:32:32.237 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/phy 2023-12-17T11:32:32.237 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/phy/phy-generic.ko 2023-12-17T11:32:32.237 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial 2023-12-17T11:32:32.237 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/aircable.ko 2023-12-17T11:32:32.238 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/ark3116.ko 2023-12-17T11:32:32.238 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/belkin_sa.ko 2023-12-17T11:32:32.238 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/ch341.ko 2023-12-17T11:32:32.238 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/cp210x.ko 2023-12-17T11:32:32.238 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/cyberjack.ko 2023-12-17T11:32:32.238 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/cypress_m8.ko 2023-12-17T11:32:32.238 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/digi_acceleport.ko 2023-12-17T11:32:32.238 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/empeg.ko 2023-12-17T11:32:32.238 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/ftdi_sio.ko 2023-12-17T11:32:32.238 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/garmin_gps.ko 2023-12-17T11:32:32.238 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/io_edgeport.ko 2023-12-17T11:32:32.238 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/io_ti.ko 2023-12-17T11:32:32.238 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/ipaq.ko 2023-12-17T11:32:32.238 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/ipw.ko 2023-12-17T11:32:32.239 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/ir-usb.ko 2023-12-17T11:32:32.239 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/iuu_phoenix.ko 2023-12-17T11:32:32.239 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/keyspan.ko 2023-12-17T11:32:32.239 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/keyspan_pda.ko 2023-12-17T11:32:32.239 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/kl5kusb105.ko 2023-12-17T11:32:32.239 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/kobil_sct.ko 2023-12-17T11:32:32.239 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/mct_u232.ko 2023-12-17T11:32:32.239 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/mos7720.ko 2023-12-17T11:32:32.239 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/mos7840.ko 2023-12-17T11:32:32.239 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/navman.ko 2023-12-17T11:32:32.239 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/omninet.ko 2023-12-17T11:32:32.239 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/opticon.ko 2023-12-17T11:32:32.239 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/option.ko 2023-12-17T11:32:32.239 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/oti6858.ko 2023-12-17T11:32:32.240 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/pl2303.ko 2023-12-17T11:32:32.240 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/qcaux.ko 2023-12-17T11:32:32.240 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/qcserial.ko 2023-12-17T11:32:32.240 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/quatech2.ko 2023-12-17T11:32:32.240 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/safe_serial.ko 2023-12-17T11:32:32.240 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/sierra.ko 2023-12-17T11:32:32.240 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/spcp8x5.ko 2023-12-17T11:32:32.240 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/ssu100.ko 2023-12-17T11:32:32.240 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/symbolserial.ko 2023-12-17T11:32:32.240 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2023-12-17T11:32:32.240 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/usb-serial-simple.ko 2023-12-17T11:32:32.240 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/usb_debug.ko 2023-12-17T11:32:32.240 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/usb_wwan.ko 2023-12-17T11:32:32.240 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/visor.ko 2023-12-17T11:32:32.241 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/whiteheat.ko 2023-12-17T11:32:32.241 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/xsens_mt.ko 2023-12-17T11:32:32.241 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage 2023-12-17T11:32:32.241 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/uas.ko 2023-12-17T11:32:32.241 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-alauda.ko 2023-12-17T11:32:32.241 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-cypress.ko 2023-12-17T11:32:32.241 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-datafab.ko 2023-12-17T11:32:32.241 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-eneub6250.ko 2023-12-17T11:32:32.241 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-freecom.ko 2023-12-17T11:32:32.241 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-isd200.ko 2023-12-17T11:32:32.241 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-jumpshot.ko 2023-12-17T11:32:32.241 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-karma.ko 2023-12-17T11:32:32.241 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-onetouch.ko 2023-12-17T11:32:32.241 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-realtek.ko 2023-12-17T11:32:32.242 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-sddr09.ko 2023-12-17T11:32:32.242 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-sddr55.ko 2023-12-17T11:32:32.242 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-usbat.ko 2023-12-17T11:32:32.242 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/usb-storage.ko 2023-12-17T11:32:32.242 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/usbip 2023-12-17T11:32:32.242 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/usbip/usbip-core.ko 2023-12-17T11:32:32.242 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/usbip/usbip-host.ko 2023-12-17T11:32:32.242 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/usbip/vhci-hcd.ko 2023-12-17T11:32:32.242 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vfio 2023-12-17T11:32:32.242 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vfio/pci 2023-12-17T11:32:32.242 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vfio/pci/vfio-pci-core.ko 2023-12-17T11:32:32.242 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vfio/pci/vfio-pci.ko 2023-12-17T11:32:32.242 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vfio/vfio.ko 2023-12-17T11:32:32.242 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vfio/vfio_iommu_type1.ko 2023-12-17T11:32:32.243 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vhost 2023-12-17T11:32:32.243 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vhost/vhost.ko 2023-12-17T11:32:32.243 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vhost/vhost_iotlb.ko 2023-12-17T11:32:32.243 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vhost/vhost_net.ko 2023-12-17T11:32:32.243 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vhost/vhost_scsi.ko 2023-12-17T11:32:32.243 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video 2023-12-17T11:32:32.243 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight 2023-12-17T11:32:32.243 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight/apple_bl.ko 2023-12-17T11:32:32.243 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight/lcd.ko 2023-12-17T11:32:32.243 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight/platform_lcd.ko 2023-12-17T11:32:32.243 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/virtio 2023-12-17T11:32:32.243 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/virtio/virtio.ko 2023-12-17T11:32:32.243 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/virtio/virtio_balloon.ko 2023-12-17T11:32:32.243 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/virtio/virtio_mmio.ko 2023-12-17T11:32:32.243 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/virtio/virtio_pci.ko 2023-12-17T11:32:32.244 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2023-12-17T11:32:32.244 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2023-12-17T11:32:32.244 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/virtio/virtio_ring.ko 2023-12-17T11:32:32.244 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1 2023-12-17T11:32:32.244 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/masters 2023-12-17T11:32:32.244 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/masters/ds2482.ko 2023-12-17T11:32:32.244 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/masters/ds2490.ko 2023-12-17T11:32:32.244 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves 2023-12-17T11:32:32.244 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_ds2406.ko 2023-12-17T11:32:32.244 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_ds2408.ko 2023-12-17T11:32:32.244 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_ds2413.ko 2023-12-17T11:32:32.244 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_ds2423.ko 2023-12-17T11:32:32.244 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_ds2431.ko 2023-12-17T11:32:32.244 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_ds2433.ko 2023-12-17T11:32:32.245 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_ds2780.ko 2023-12-17T11:32:32.245 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_ds2781.ko 2023-12-17T11:32:32.245 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_ds28e04.ko 2023-12-17T11:32:32.245 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_smem.ko 2023-12-17T11:32:32.245 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_therm.ko 2023-12-17T11:32:32.245 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/wire.ko 2023-12-17T11:32:32.245 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog 2023-12-17T11:32:32.245 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/alim1535_wdt.ko 2023-12-17T11:32:32.245 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/alim7101_wdt.ko 2023-12-17T11:32:32.245 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/f71808e_wdt.ko 2023-12-17T11:32:32.245 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/hpwdt.ko 2023-12-17T11:32:32.245 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/i6300esb.ko 2023-12-17T11:32:32.245 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/iTCO_vendor_support.ko 2023-12-17T11:32:32.245 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/iTCO_wdt.ko 2023-12-17T11:32:32.245 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/ib700wdt.ko 2023-12-17T11:32:32.246 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/ibmasr.ko 2023-12-17T11:32:32.246 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/ie6xx_wdt.ko 2023-12-17T11:32:32.246 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/it8712f_wdt.ko 2023-12-17T11:32:32.246 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/it87_wdt.ko 2023-12-17T11:32:32.246 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/machzwd.ko 2023-12-17T11:32:32.246 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/nv_tco.ko 2023-12-17T11:32:32.246 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/pcwd_pci.ko 2023-12-17T11:32:32.246 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/pcwd_usb.ko 2023-12-17T11:32:32.246 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2023-12-17T11:32:32.246 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/sch311x_wdt.ko 2023-12-17T11:32:32.246 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/softdog.ko 2023-12-17T11:32:32.246 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/sp5100_tco.ko 2023-12-17T11:32:32.246 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/via_wdt.ko 2023-12-17T11:32:32.246 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/w83627hf_wdt.ko 2023-12-17T11:32:32.247 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/w83877f_wdt.ko 2023-12-17T11:32:32.247 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/w83977f_wdt.ko 2023-12-17T11:32:32.247 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/wdt_pci.ko 2023-12-17T11:32:32.247 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/xen_wdt.ko 2023-12-17T11:32:32.247 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen 2023-12-17T11:32:32.247 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen/xen-acpi-processor.ko 2023-12-17T11:32:32.247 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen/xen-evtchn.ko 2023-12-17T11:32:32.247 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen/xen-gntalloc.ko 2023-12-17T11:32:32.247 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen/xen-gntdev.ko 2023-12-17T11:32:32.247 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen/xen-pciback 2023-12-17T11:32:32.247 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2023-12-17T11:32:32.247 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen/xen-privcmd.ko 2023-12-17T11:32:32.247 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen/xenfs 2023-12-17T11:32:32.248 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen/xenfs/xenfs.ko 2023-12-17T11:32:32.248 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs 2023-12-17T11:32:32.248 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/9p 2023-12-17T11:32:32.248 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/9p/9p.ko 2023-12-17T11:32:32.248 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/affs 2023-12-17T11:32:32.248 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/affs/affs.ko 2023-12-17T11:32:32.248 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/befs 2023-12-17T11:32:32.248 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/befs/befs.ko 2023-12-17T11:32:32.248 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/binfmt_misc.ko 2023-12-17T11:32:32.248 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/btrfs 2023-12-17T11:32:32.248 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/btrfs/btrfs.ko 2023-12-17T11:32:32.248 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/cachefiles 2023-12-17T11:32:32.248 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/cachefiles/cachefiles.ko 2023-12-17T11:32:32.248 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ceph 2023-12-17T11:32:32.249 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ceph/ceph.ko 2023-12-17T11:32:32.249 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/coda 2023-12-17T11:32:32.249 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/coda/coda.ko 2023-12-17T11:32:32.249 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/cramfs 2023-12-17T11:32:32.249 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/cramfs/cramfs.ko 2023-12-17T11:32:32.249 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/dlm 2023-12-17T11:32:32.249 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/dlm/dlm.ko 2023-12-17T11:32:32.249 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ecryptfs 2023-12-17T11:32:32.249 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ecryptfs/ecryptfs.ko 2023-12-17T11:32:32.249 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/f2fs 2023-12-17T11:32:32.249 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/f2fs/f2fs.ko 2023-12-17T11:32:32.249 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/fat 2023-12-17T11:32:32.249 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/fat/fat.ko 2023-12-17T11:32:32.250 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/fat/msdos.ko 2023-12-17T11:32:32.250 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/fat/vfat.ko 2023-12-17T11:32:32.250 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/fscache 2023-12-17T11:32:32.250 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/fscache/fscache.ko 2023-12-17T11:32:32.250 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/fuse 2023-12-17T11:32:32.250 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/fuse/cuse.ko 2023-12-17T11:32:32.250 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/fuse/fuse.ko 2023-12-17T11:32:32.250 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/gfs2 2023-12-17T11:32:32.250 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/gfs2/gfs2.ko 2023-12-17T11:32:32.250 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/hfs 2023-12-17T11:32:32.250 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/hfs/hfs.ko 2023-12-17T11:32:32.250 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/hfsplus 2023-12-17T11:32:32.250 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/hfsplus/hfsplus.ko 2023-12-17T11:32:32.250 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/isofs 2023-12-17T11:32:32.251 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/isofs/isofs.ko 2023-12-17T11:32:32.251 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/jfs 2023-12-17T11:32:32.251 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/jfs/jfs.ko 2023-12-17T11:32:32.251 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/lockd 2023-12-17T11:32:32.251 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/lockd/lockd.ko 2023-12-17T11:32:32.251 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/minix 2023-12-17T11:32:32.251 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/minix/minix.ko 2023-12-17T11:32:32.251 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/netfs 2023-12-17T11:32:32.251 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/netfs/netfs.ko 2023-12-17T11:32:32.251 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs 2023-12-17T11:32:32.251 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs/blocklayout 2023-12-17T11:32:32.251 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2023-12-17T11:32:32.251 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs/filelayout 2023-12-17T11:32:32.251 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2023-12-17T11:32:32.252 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs/flexfilelayout 2023-12-17T11:32:32.252 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2023-12-17T11:32:32.252 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs/nfs.ko 2023-12-17T11:32:32.252 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs/nfsv3.ko 2023-12-17T11:32:32.252 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs/nfsv4.ko 2023-12-17T11:32:32.252 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs_common 2023-12-17T11:32:32.252 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs_common/grace.ko 2023-12-17T11:32:32.252 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs_common/nfs_acl.ko 2023-12-17T11:32:32.252 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfsd 2023-12-17T11:32:32.252 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfsd/nfsd.ko 2023-12-17T11:32:32.252 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nilfs2 2023-12-17T11:32:32.252 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nilfs2/nilfs2.ko 2023-12-17T11:32:32.252 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls 2023-12-17T11:32:32.252 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-celtic.ko 2023-12-17T11:32:32.253 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-centeuro.ko 2023-12-17T11:32:32.253 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-croatian.ko 2023-12-17T11:32:32.253 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-cyrillic.ko 2023-12-17T11:32:32.253 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-gaelic.ko 2023-12-17T11:32:32.253 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-greek.ko 2023-12-17T11:32:32.253 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-iceland.ko 2023-12-17T11:32:32.253 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-inuit.ko 2023-12-17T11:32:32.253 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-roman.ko 2023-12-17T11:32:32.253 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-romanian.ko 2023-12-17T11:32:32.253 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-turkish.ko 2023-12-17T11:32:32.253 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp1250.ko 2023-12-17T11:32:32.253 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp1251.ko 2023-12-17T11:32:32.253 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp1255.ko 2023-12-17T11:32:32.253 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp737.ko 2023-12-17T11:32:32.254 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp775.ko 2023-12-17T11:32:32.254 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp850.ko 2023-12-17T11:32:32.254 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp852.ko 2023-12-17T11:32:32.254 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp855.ko 2023-12-17T11:32:32.254 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp857.ko 2023-12-17T11:32:32.254 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp860.ko 2023-12-17T11:32:32.254 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp861.ko 2023-12-17T11:32:32.254 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp862.ko 2023-12-17T11:32:32.254 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp863.ko 2023-12-17T11:32:32.254 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp864.ko 2023-12-17T11:32:32.254 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp865.ko 2023-12-17T11:32:32.254 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp866.ko 2023-12-17T11:32:32.254 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp869.ko 2023-12-17T11:32:32.254 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp874.ko 2023-12-17T11:32:32.255 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp932.ko 2023-12-17T11:32:32.255 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp936.ko 2023-12-17T11:32:32.255 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp949.ko 2023-12-17T11:32:32.255 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp950.ko 2023-12-17T11:32:32.255 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_euc-jp.ko 2023-12-17T11:32:32.255 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-1.ko 2023-12-17T11:32:32.255 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-13.ko 2023-12-17T11:32:32.255 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-14.ko 2023-12-17T11:32:32.255 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-15.ko 2023-12-17T11:32:32.255 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-2.ko 2023-12-17T11:32:32.255 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-3.ko 2023-12-17T11:32:32.255 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-4.ko 2023-12-17T11:32:32.255 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-5.ko 2023-12-17T11:32:32.255 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-6.ko 2023-12-17T11:32:32.255 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-7.ko 2023-12-17T11:32:32.256 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-9.ko 2023-12-17T11:32:32.256 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_koi8-r.ko 2023-12-17T11:32:32.256 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_koi8-ru.ko 2023-12-17T11:32:32.256 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_koi8-u.ko 2023-12-17T11:32:32.256 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_ucs2_utils.ko 2023-12-17T11:32:32.256 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_utf8.ko 2023-12-17T11:32:32.256 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2 2023-12-17T11:32:32.256 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/cluster 2023-12-17T11:32:32.256 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2023-12-17T11:32:32.256 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/dlm 2023-12-17T11:32:32.256 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2023-12-17T11:32:32.256 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/dlmfs 2023-12-17T11:32:32.256 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2023-12-17T11:32:32.256 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/ocfs2.ko 2023-12-17T11:32:32.257 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2023-12-17T11:32:32.257 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/ocfs2_stack_user.ko 2023-12-17T11:32:32.257 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/ocfs2_stackglue.ko 2023-12-17T11:32:32.257 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/overlayfs 2023-12-17T11:32:32.257 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/overlayfs/overlay.ko 2023-12-17T11:32:32.257 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/pstore 2023-12-17T11:32:32.257 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/pstore/ramoops.ko 2023-12-17T11:32:32.257 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/reiserfs 2023-12-17T11:32:32.257 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/reiserfs/reiserfs.ko 2023-12-17T11:32:32.257 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/romfs 2023-12-17T11:32:32.257 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/romfs/romfs.ko 2023-12-17T11:32:32.257 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/smb 2023-12-17T11:32:32.257 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/smb/client 2023-12-17T11:32:32.258 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/smb/client/cifs.ko 2023-12-17T11:32:32.258 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/smb/common 2023-12-17T11:32:32.258 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/smb/common/cifs_arc4.ko 2023-12-17T11:32:32.258 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/smb/common/cifs_md4.ko 2023-12-17T11:32:32.258 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/squashfs 2023-12-17T11:32:32.258 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/squashfs/squashfs.ko 2023-12-17T11:32:32.258 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/sysv 2023-12-17T11:32:32.258 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/sysv/sysv.ko 2023-12-17T11:32:32.258 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/udf 2023-12-17T11:32:32.258 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/udf/udf.ko 2023-12-17T11:32:32.258 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ufs 2023-12-17T11:32:32.258 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ufs/ufs.ko 2023-12-17T11:32:32.258 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/xfs 2023-12-17T11:32:32.258 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/xfs/xfs.ko 2023-12-17T11:32:32.259 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/kernel 2023-12-17T11:32:32.259 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/kernel/rcu 2023-12-17T11:32:32.259 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/kernel/rcu/rcutorture.ko 2023-12-17T11:32:32.259 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/kernel/torture.ko 2023-12-17T11:32:32.259 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/kernel/trace 2023-12-17T11:32:32.259 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/kernel/trace/ring_buffer_benchmark.ko 2023-12-17T11:32:32.259 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib 2023-12-17T11:32:32.259 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/asn1_encoder.ko 2023-12-17T11:32:32.259 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/crc-itu-t.ko 2023-12-17T11:32:32.259 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/crc8.ko 2023-12-17T11:32:32.259 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/crypto 2023-12-17T11:32:32.259 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/crypto/libarc4.ko 2023-12-17T11:32:32.259 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/crypto/libdes.ko 2023-12-17T11:32:32.259 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/libcrc32c.ko 2023-12-17T11:32:32.260 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/lru_cache.ko 2023-12-17T11:32:32.260 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/lz4 2023-12-17T11:32:32.260 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/lz4/lz4_compress.ko 2023-12-17T11:32:32.260 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/lz4/lz4hc_compress.ko 2023-12-17T11:32:32.260 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/math 2023-12-17T11:32:32.260 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/math/cordic.ko 2023-12-17T11:32:32.260 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/raid6 2023-12-17T11:32:32.260 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/raid6/raid6_pq.ko 2023-12-17T11:32:32.260 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/reed_solomon 2023-12-17T11:32:32.260 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/reed_solomon/reed_solomon.ko 2023-12-17T11:32:32.260 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/ts_bm.ko 2023-12-17T11:32:32.260 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/ts_fsm.ko 2023-12-17T11:32:32.260 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/ts_kmp.ko 2023-12-17T11:32:32.260 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/zstd 2023-12-17T11:32:32.260 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/zstd/zstd_compress.ko 2023-12-17T11:32:32.261 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/mm 2023-12-17T11:32:32.261 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/mm/hwpoison-inject.ko 2023-12-17T11:32:32.261 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net 2023-12-17T11:32:32.261 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/6lowpan 2023-12-17T11:32:32.261 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/6lowpan/6lowpan.ko 2023-12-17T11:32:32.261 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/6lowpan/nhc_dest.ko 2023-12-17T11:32:32.261 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/6lowpan/nhc_fragment.ko 2023-12-17T11:32:32.261 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/6lowpan/nhc_hop.ko 2023-12-17T11:32:32.261 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/6lowpan/nhc_ipv6.ko 2023-12-17T11:32:32.261 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/6lowpan/nhc_mobility.ko 2023-12-17T11:32:32.261 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/6lowpan/nhc_routing.ko 2023-12-17T11:32:32.261 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/6lowpan/nhc_udp.ko 2023-12-17T11:32:32.261 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/802 2023-12-17T11:32:32.262 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/802/garp.ko 2023-12-17T11:32:32.262 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/802/mrp.ko 2023-12-17T11:32:32.262 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/802/p8022.ko 2023-12-17T11:32:32.262 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/802/psnap.ko 2023-12-17T11:32:32.262 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/802/stp.ko 2023-12-17T11:32:32.262 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/8021q 2023-12-17T11:32:32.262 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/8021q/8021q.ko 2023-12-17T11:32:32.262 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/9p 2023-12-17T11:32:32.262 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/9p/9pnet.ko 2023-12-17T11:32:32.262 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/9p/9pnet_fd.ko 2023-12-17T11:32:32.262 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/9p/9pnet_rdma.ko 2023-12-17T11:32:32.262 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/9p/9pnet_virtio.ko 2023-12-17T11:32:32.262 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/batman-adv 2023-12-17T11:32:32.262 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/batman-adv/batman-adv.ko 2023-12-17T11:32:32.262 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge 2023-12-17T11:32:32.263 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/br_netfilter.ko 2023-12-17T11:32:32.263 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/bridge.ko 2023-12-17T11:32:32.263 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter 2023-12-17T11:32:32.263 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_802_3.ko 2023-12-17T11:32:32.263 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_among.ko 2023-12-17T11:32:32.263 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_arp.ko 2023-12-17T11:32:32.263 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_arpreply.ko 2023-12-17T11:32:32.263 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_dnat.ko 2023-12-17T11:32:32.263 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_ip.ko 2023-12-17T11:32:32.263 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_ip6.ko 2023-12-17T11:32:32.263 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_limit.ko 2023-12-17T11:32:32.263 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_log.ko 2023-12-17T11:32:32.263 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_mark.ko 2023-12-17T11:32:32.263 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_mark_m.ko 2023-12-17T11:32:32.263 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_nflog.ko 2023-12-17T11:32:32.264 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_pkttype.ko 2023-12-17T11:32:32.264 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_redirect.ko 2023-12-17T11:32:32.264 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_snat.ko 2023-12-17T11:32:32.264 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_stp.ko 2023-12-17T11:32:32.264 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_vlan.ko 2023-12-17T11:32:32.264 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebtable_broute.ko 2023-12-17T11:32:32.264 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebtable_filter.ko 2023-12-17T11:32:32.264 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebtable_nat.ko 2023-12-17T11:32:32.264 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebtables.ko 2023-12-17T11:32:32.264 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2023-12-17T11:32:32.264 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2023-12-17T11:32:32.264 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2023-12-17T11:32:32.264 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ceph 2023-12-17T11:32:32.264 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ceph/libceph.ko 2023-12-17T11:32:32.265 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/core 2023-12-17T11:32:32.265 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/core/failover.ko 2023-12-17T11:32:32.265 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/core/pktgen.ko 2023-12-17T11:32:32.265 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dccp 2023-12-17T11:32:32.265 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dccp/dccp.ko 2023-12-17T11:32:32.265 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dccp/dccp_diag.ko 2023-12-17T11:32:32.265 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dccp/dccp_ipv4.ko 2023-12-17T11:32:32.265 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dccp/dccp_ipv6.ko 2023-12-17T11:32:32.265 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dns_resolver 2023-12-17T11:32:32.265 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dns_resolver/dns_resolver.ko 2023-12-17T11:32:32.265 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dsa 2023-12-17T11:32:32.265 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dsa/dsa_core.ko 2023-12-17T11:32:32.266 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dsa/tag_brcm.ko 2023-12-17T11:32:32.266 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dsa/tag_dsa.ko 2023-12-17T11:32:32.266 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dsa/tag_none.ko 2023-12-17T11:32:32.266 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dsa/tag_trailer.ko 2023-12-17T11:32:32.266 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ieee802154 2023-12-17T11:32:32.266 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ieee802154/6lowpan 2023-12-17T11:32:32.266 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2023-12-17T11:32:32.266 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ieee802154/ieee802154.ko 2023-12-17T11:32:32.266 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ieee802154/ieee802154_socket.ko 2023-12-17T11:32:32.266 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4 2023-12-17T11:32:32.266 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/ah4.ko 2023-12-17T11:32:32.266 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/esp4.ko 2023-12-17T11:32:32.266 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/fou.ko 2023-12-17T11:32:32.266 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/gre.ko 2023-12-17T11:32:32.267 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/inet_diag.ko 2023-12-17T11:32:32.267 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/ip_gre.ko 2023-12-17T11:32:32.267 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/ip_tunnel.ko 2023-12-17T11:32:32.267 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/ip_vti.ko 2023-12-17T11:32:32.267 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/ipcomp.ko 2023-12-17T11:32:32.267 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/ipip.ko 2023-12-17T11:32:32.267 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter 2023-12-17T11:32:32.267 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/arp_tables.ko 2023-12-17T11:32:32.267 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/arpt_mangle.ko 2023-12-17T11:32:32.267 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/arptable_filter.ko 2023-12-17T11:32:32.267 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/ipt_ECN.ko 2023-12-17T11:32:32.267 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2023-12-17T11:32:32.267 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/ipt_ah.ko 2023-12-17T11:32:32.267 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2023-12-17T11:32:32.268 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/iptable_mangle.ko 2023-12-17T11:32:32.268 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/iptable_nat.ko 2023-12-17T11:32:32.268 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/iptable_raw.ko 2023-12-17T11:32:32.268 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/iptable_security.ko 2023-12-17T11:32:32.268 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2023-12-17T11:32:32.268 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2023-12-17T11:32:32.268 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2023-12-17T11:32:32.268 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2023-12-17T11:32:32.268 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2023-12-17T11:32:32.268 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2023-12-17T11:32:32.268 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2023-12-17T11:32:32.268 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2023-12-17T11:32:32.268 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2023-12-17T11:32:32.268 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2023-12-17T11:32:32.269 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_bic.ko 2023-12-17T11:32:32.269 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_dctcp.ko 2023-12-17T11:32:32.269 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_diag.ko 2023-12-17T11:32:32.269 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_highspeed.ko 2023-12-17T11:32:32.269 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_htcp.ko 2023-12-17T11:32:32.269 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_hybla.ko 2023-12-17T11:32:32.269 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_illinois.ko 2023-12-17T11:32:32.269 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_lp.ko 2023-12-17T11:32:32.269 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_scalable.ko 2023-12-17T11:32:32.269 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_vegas.ko 2023-12-17T11:32:32.269 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_veno.ko 2023-12-17T11:32:32.269 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_westwood.ko 2023-12-17T11:32:32.269 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_yeah.ko 2023-12-17T11:32:32.269 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tunnel4.ko 2023-12-17T11:32:32.270 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/udp_diag.ko 2023-12-17T11:32:32.270 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/udp_tunnel.ko 2023-12-17T11:32:32.270 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/xfrm4_tunnel.ko 2023-12-17T11:32:32.270 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6 2023-12-17T11:32:32.270 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/ah6.ko 2023-12-17T11:32:32.270 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/esp6.ko 2023-12-17T11:32:32.270 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/fou6.ko 2023-12-17T11:32:32.270 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/ip6_tunnel.ko 2023-12-17T11:32:32.270 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/ip6_udp_tunnel.ko 2023-12-17T11:32:32.270 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/ip6_vti.ko 2023-12-17T11:32:32.270 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/ipcomp6.ko 2023-12-17T11:32:32.270 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter 2023-12-17T11:32:32.270 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6_tables.ko 2023-12-17T11:32:32.270 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2023-12-17T11:32:32.271 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2023-12-17T11:32:32.271 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_ah.ko 2023-12-17T11:32:32.271 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2023-12-17T11:32:32.271 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_frag.ko 2023-12-17T11:32:32.271 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2023-12-17T11:32:32.271 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2023-12-17T11:32:32.271 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_mh.ko 2023-12-17T11:32:32.271 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2023-12-17T11:32:32.271 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_rt.ko 2023-12-17T11:32:32.271 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6table_filter.ko 2023-12-17T11:32:32.271 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2023-12-17T11:32:32.271 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6table_nat.ko 2023-12-17T11:32:32.271 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6table_raw.ko 2023-12-17T11:32:32.271 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6table_security.ko 2023-12-17T11:32:32.272 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2023-12-17T11:32:32.272 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2023-12-17T11:32:32.272 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2023-12-17T11:32:32.272 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2023-12-17T11:32:32.272 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2023-12-17T11:32:32.272 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2023-12-17T11:32:32.272 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2023-12-17T11:32:32.272 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2023-12-17T11:32:32.272 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/sit.ko 2023-12-17T11:32:32.272 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/tunnel6.ko 2023-12-17T11:32:32.272 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/xfrm6_tunnel.ko 2023-12-17T11:32:32.272 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/key 2023-12-17T11:32:32.272 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/key/af_key.ko 2023-12-17T11:32:32.272 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/l2tp 2023-12-17T11:32:32.272 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/l2tp/l2tp_core.ko 2023-12-17T11:32:32.273 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/l2tp/l2tp_debugfs.ko 2023-12-17T11:32:32.273 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/l2tp/l2tp_eth.ko 2023-12-17T11:32:32.273 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/l2tp/l2tp_ip.ko 2023-12-17T11:32:32.273 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/l2tp/l2tp_ip6.ko 2023-12-17T11:32:32.273 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/l2tp/l2tp_netlink.ko 2023-12-17T11:32:32.273 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/l2tp/l2tp_ppp.ko 2023-12-17T11:32:32.273 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/llc 2023-12-17T11:32:32.273 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/llc/llc.ko 2023-12-17T11:32:32.273 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/mac802154 2023-12-17T11:32:32.273 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/mac802154/mac802154.ko 2023-12-17T11:32:32.273 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/mpls 2023-12-17T11:32:32.273 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/mpls/mpls_gso.ko 2023-12-17T11:32:32.273 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter 2023-12-17T11:32:32.274 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset 2023-12-17T11:32:32.274 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set.ko 2023-12-17T11:32:32.274 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2023-12-17T11:32:32.274 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2023-12-17T11:32:32.274 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2023-12-17T11:32:32.274 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2023-12-17T11:32:32.274 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2023-12-17T11:32:32.274 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2023-12-17T11:32:32.274 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2023-12-17T11:32:32.274 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2023-12-17T11:32:32.274 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2023-12-17T11:32:32.274 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2023-12-17T11:32:32.274 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2023-12-17T11:32:32.274 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2023-12-17T11:32:32.275 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2023-12-17T11:32:32.275 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2023-12-17T11:32:32.275 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_list_set.ko 2023-12-17T11:32:32.275 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs 2023-12-17T11:32:32.275 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs.ko 2023-12-17T11:32:32.275 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2023-12-17T11:32:32.275 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2023-12-17T11:32:32.275 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2023-12-17T11:32:32.275 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2023-12-17T11:32:32.275 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2023-12-17T11:32:32.275 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2023-12-17T11:32:32.275 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2023-12-17T11:32:32.275 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2023-12-17T11:32:32.275 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2023-12-17T11:32:32.276 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2023-12-17T11:32:32.276 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2023-12-17T11:32:32.276 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2023-12-17T11:32:32.276 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2023-12-17T11:32:32.276 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conncount.ko 2023-12-17T11:32:32.276 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack.ko 2023-12-17T11:32:32.276 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_amanda.ko 2023-12-17T11:32:32.276 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_broadcast.ko 2023-12-17T11:32:32.276 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_ftp.ko 2023-12-17T11:32:32.276 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_h323.ko 2023-12-17T11:32:32.276 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_irc.ko 2023-12-17T11:32:32.276 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2023-12-17T11:32:32.276 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_netlink.ko 2023-12-17T11:32:32.276 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_pptp.ko 2023-12-17T11:32:32.277 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_sane.ko 2023-12-17T11:32:32.277 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_sip.ko 2023-12-17T11:32:32.277 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_snmp.ko 2023-12-17T11:32:32.277 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_tftp.ko 2023-12-17T11:32:32.277 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_dup_netdev.ko 2023-12-17T11:32:32.277 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_flow_table.ko 2023-12-17T11:32:32.277 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_flow_table_inet.ko 2023-12-17T11:32:32.277 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_log_syslog.ko 2023-12-17T11:32:32.277 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_nat.ko 2023-12-17T11:32:32.277 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_nat_amanda.ko 2023-12-17T11:32:32.277 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_nat_ftp.ko 2023-12-17T11:32:32.277 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_nat_irc.ko 2023-12-17T11:32:32.277 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_nat_sip.ko 2023-12-17T11:32:32.277 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_nat_tftp.ko 2023-12-17T11:32:32.277 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_synproxy_core.ko 2023-12-17T11:32:32.278 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_tables.ko 2023-12-17T11:32:32.278 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nfnetlink.ko 2023-12-17T11:32:32.278 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nfnetlink_acct.ko 2023-12-17T11:32:32.278 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nfnetlink_log.ko 2023-12-17T11:32:32.278 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nfnetlink_osf.ko 2023-12-17T11:32:32.278 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nfnetlink_queue.ko 2023-12-17T11:32:32.278 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_chain_nat.ko 2023-12-17T11:32:32.278 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_compat.ko 2023-12-17T11:32:32.278 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_ct.ko 2023-12-17T11:32:32.278 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_dup_netdev.ko 2023-12-17T11:32:32.278 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_fib.ko 2023-12-17T11:32:32.278 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_fwd_netdev.ko 2023-12-17T11:32:32.278 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_hash.ko 2023-12-17T11:32:32.278 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_limit.ko 2023-12-17T11:32:32.279 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_log.ko 2023-12-17T11:32:32.279 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_masq.ko 2023-12-17T11:32:32.279 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_nat.ko 2023-12-17T11:32:32.279 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_numgen.ko 2023-12-17T11:32:32.279 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_queue.ko 2023-12-17T11:32:32.279 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_quota.ko 2023-12-17T11:32:32.279 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_redir.ko 2023-12-17T11:32:32.279 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_reject.ko 2023-12-17T11:32:32.279 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_reject_inet.ko 2023-12-17T11:32:32.279 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_socket.ko 2023-12-17T11:32:32.279 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_tunnel.ko 2023-12-17T11:32:32.279 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_AUDIT.ko 2023-12-17T11:32:32.279 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_CHECKSUM.ko 2023-12-17T11:32:32.279 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_CLASSIFY.ko 2023-12-17T11:32:32.280 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_CONNSECMARK.ko 2023-12-17T11:32:32.280 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_CT.ko 2023-12-17T11:32:32.280 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_DSCP.ko 2023-12-17T11:32:32.280 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_HL.ko 2023-12-17T11:32:32.280 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_HMARK.ko 2023-12-17T11:32:32.280 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_IDLETIMER.ko 2023-12-17T11:32:32.280 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_LED.ko 2023-12-17T11:32:32.280 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_LOG.ko 2023-12-17T11:32:32.280 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_MASQUERADE.ko 2023-12-17T11:32:32.280 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_NETMAP.ko 2023-12-17T11:32:32.280 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_NFLOG.ko 2023-12-17T11:32:32.280 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_NFQUEUE.ko 2023-12-17T11:32:32.280 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_RATEEST.ko 2023-12-17T11:32:32.280 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_REDIRECT.ko 2023-12-17T11:32:32.280 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_SECMARK.ko 2023-12-17T11:32:32.281 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_TCPMSS.ko 2023-12-17T11:32:32.281 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2023-12-17T11:32:32.281 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_TEE.ko 2023-12-17T11:32:32.281 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_TPROXY.ko 2023-12-17T11:32:32.281 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_TRACE.ko 2023-12-17T11:32:32.281 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_addrtype.ko 2023-12-17T11:32:32.281 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_bpf.ko 2023-12-17T11:32:32.281 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_cgroup.ko 2023-12-17T11:32:32.281 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_cluster.ko 2023-12-17T11:32:32.281 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_comment.ko 2023-12-17T11:32:32.281 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_connbytes.ko 2023-12-17T11:32:32.282 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_connlabel.ko 2023-12-17T11:32:32.282 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_connlimit.ko 2023-12-17T11:32:32.282 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_connmark.ko 2023-12-17T11:32:32.282 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_conntrack.ko 2023-12-17T11:32:32.282 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_cpu.ko 2023-12-17T11:32:32.282 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_dccp.ko 2023-12-17T11:32:32.282 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_devgroup.ko 2023-12-17T11:32:32.282 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_dscp.ko 2023-12-17T11:32:32.282 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_ecn.ko 2023-12-17T11:32:32.282 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_esp.ko 2023-12-17T11:32:32.282 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_hashlimit.ko 2023-12-17T11:32:32.282 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_helper.ko 2023-12-17T11:32:32.282 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_hl.ko 2023-12-17T11:32:32.282 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_ipcomp.ko 2023-12-17T11:32:32.282 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_iprange.ko 2023-12-17T11:32:32.283 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_ipvs.ko 2023-12-17T11:32:32.283 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_l2tp.ko 2023-12-17T11:32:32.283 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_length.ko 2023-12-17T11:32:32.283 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_limit.ko 2023-12-17T11:32:32.283 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_mac.ko 2023-12-17T11:32:32.283 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_mark.ko 2023-12-17T11:32:32.283 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_multiport.ko 2023-12-17T11:32:32.283 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_nat.ko 2023-12-17T11:32:32.283 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_nfacct.ko 2023-12-17T11:32:32.283 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_osf.ko 2023-12-17T11:32:32.283 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_owner.ko 2023-12-17T11:32:32.283 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_physdev.ko 2023-12-17T11:32:32.283 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_pkttype.ko 2023-12-17T11:32:32.283 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_policy.ko 2023-12-17T11:32:32.284 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_quota.ko 2023-12-17T11:32:32.284 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_rateest.ko 2023-12-17T11:32:32.284 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_realm.ko 2023-12-17T11:32:32.284 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_recent.ko 2023-12-17T11:32:32.284 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_sctp.ko 2023-12-17T11:32:32.284 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_set.ko 2023-12-17T11:32:32.284 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_socket.ko 2023-12-17T11:32:32.284 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_state.ko 2023-12-17T11:32:32.284 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_statistic.ko 2023-12-17T11:32:32.284 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_string.ko 2023-12-17T11:32:32.284 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_tcpmss.ko 2023-12-17T11:32:32.284 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_time.ko 2023-12-17T11:32:32.284 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_u32.ko 2023-12-17T11:32:32.284 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netlink 2023-12-17T11:32:32.285 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netlink/netlink_diag.ko 2023-12-17T11:32:32.285 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/nsh 2023-12-17T11:32:32.285 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/nsh/nsh.ko 2023-12-17T11:32:32.285 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/openvswitch 2023-12-17T11:32:32.285 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/openvswitch/openvswitch.ko 2023-12-17T11:32:32.285 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/openvswitch/vport-geneve.ko 2023-12-17T11:32:32.285 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/openvswitch/vport-gre.ko 2023-12-17T11:32:32.285 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/openvswitch/vport-vxlan.ko 2023-12-17T11:32:32.285 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/packet 2023-12-17T11:32:32.285 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/packet/af_packet_diag.ko 2023-12-17T11:32:32.285 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/rds 2023-12-17T11:32:32.285 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/rds/rds.ko 2023-12-17T11:32:32.285 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/rds/rds_rdma.ko 2023-12-17T11:32:32.285 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/rds/rds_tcp.ko 2023-12-17T11:32:32.286 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched 2023-12-17T11:32:32.286 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_csum.ko 2023-12-17T11:32:32.286 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_gact.ko 2023-12-17T11:32:32.286 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_ipt.ko 2023-12-17T11:32:32.286 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_mirred.ko 2023-12-17T11:32:32.286 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_nat.ko 2023-12-17T11:32:32.286 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_pedit.ko 2023-12-17T11:32:32.286 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_police.ko 2023-12-17T11:32:32.286 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_simple.ko 2023-12-17T11:32:32.286 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_skbedit.ko 2023-12-17T11:32:32.286 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_vlan.ko 2023-12-17T11:32:32.286 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/cls_basic.ko 2023-12-17T11:32:32.286 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/cls_bpf.ko 2023-12-17T11:32:32.286 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/cls_flow.ko 2023-12-17T11:32:32.287 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/cls_fw.ko 2023-12-17T11:32:32.287 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/cls_route.ko 2023-12-17T11:32:32.287 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/cls_u32.ko 2023-12-17T11:32:32.287 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/em_cmp.ko 2023-12-17T11:32:32.287 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/em_ipset.ko 2023-12-17T11:32:32.287 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/em_meta.ko 2023-12-17T11:32:32.287 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/em_nbyte.ko 2023-12-17T11:32:32.287 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/em_text.ko 2023-12-17T11:32:32.287 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/em_u32.ko 2023-12-17T11:32:32.287 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_choke.ko 2023-12-17T11:32:32.287 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_codel.ko 2023-12-17T11:32:32.287 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_drr.ko 2023-12-17T11:32:32.287 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_fq.ko 2023-12-17T11:32:32.287 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_gred.ko 2023-12-17T11:32:32.288 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_hfsc.ko 2023-12-17T11:32:32.288 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_hhf.ko 2023-12-17T11:32:32.288 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_htb.ko 2023-12-17T11:32:32.288 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_ingress.ko 2023-12-17T11:32:32.288 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_mqprio.ko 2023-12-17T11:32:32.288 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_mqprio_lib.ko 2023-12-17T11:32:32.288 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_multiq.ko 2023-12-17T11:32:32.288 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_netem.ko 2023-12-17T11:32:32.288 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_pie.ko 2023-12-17T11:32:32.288 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_plug.ko 2023-12-17T11:32:32.288 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_prio.ko 2023-12-17T11:32:32.288 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_qfq.ko 2023-12-17T11:32:32.288 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_red.ko 2023-12-17T11:32:32.288 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_sfb.ko 2023-12-17T11:32:32.289 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_sfq.ko 2023-12-17T11:32:32.289 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_tbf.ko 2023-12-17T11:32:32.289 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_teql.ko 2023-12-17T11:32:32.289 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sctp 2023-12-17T11:32:32.289 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sctp/sctp.ko 2023-12-17T11:32:32.289 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sctp/sctp_diag.ko 2023-12-17T11:32:32.289 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sunrpc 2023-12-17T11:32:32.289 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sunrpc/auth_gss 2023-12-17T11:32:32.289 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2023-12-17T11:32:32.289 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2023-12-17T11:32:32.289 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sunrpc/sunrpc.ko 2023-12-17T11:32:32.289 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sunrpc/xprtrdma 2023-12-17T11:32:32.289 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2023-12-17T11:32:32.289 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/tipc 2023-12-17T11:32:32.290 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/tipc/diag.ko 2023-12-17T11:32:32.290 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/tipc/tipc.ko 2023-12-17T11:32:32.290 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/unix 2023-12-17T11:32:32.290 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/unix/unix_diag.ko 2023-12-17T11:32:32.290 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/vmw_vsock 2023-12-17T11:32:32.290 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2023-12-17T11:32:32.290 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2023-12-17T11:32:32.290 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/vmw_vsock/vsock.ko 2023-12-17T11:32:32.290 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/vmw_vsock/vsock_diag.ko 2023-12-17T11:32:32.290 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/vmw_vsock/vsock_loopback.ko 2023-12-17T11:32:32.290 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/xfrm 2023-12-17T11:32:32.290 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/xfrm/xfrm_ipcomp.ko 2023-12-17T11:32:32.290 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/security 2023-12-17T11:32:32.290 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/security/keys 2023-12-17T11:32:32.291 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/security/keys/encrypted-keys 2023-12-17T11:32:32.291 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2023-12-17T11:32:32.291 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/security/keys/trusted-keys 2023-12-17T11:32:32.291 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/security/keys/trusted-keys/trusted.ko 2023-12-17T11:32:32.291 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/virt 2023-12-17T11:32:32.291 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/virt/lib 2023-12-17T11:32:32.291 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/virt/lib/irqbypass.ko 2023-12-17T11:32:32.291 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/modules.alias 2023-12-17T11:32:32.291 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/modules.alias.bin 2023-12-17T11:32:32.291 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/modules.builtin 2023-12-17T11:32:32.291 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/modules.builtin.alias.bin 2023-12-17T11:32:32.291 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/modules.builtin.bin 2023-12-17T11:32:32.291 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/modules.builtin.modinfo 2023-12-17T11:32:32.291 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/modules.dep 2023-12-17T11:32:32.291 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/modules.dep.bin 2023-12-17T11:32:32.292 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/modules.devname 2023-12-17T11:32:32.292 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/modules.order 2023-12-17T11:32:32.292 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/modules.softdep 2023-12-17T11:32:32.292 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/modules.symbols 2023-12-17T11:32:32.292 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.6.0-gcd68252d7b4d/modules.symbols.bin 2023-12-17T11:32:32.292 DEBUG:teuthology.task.kernel:get_image_version: 6.6.0-gcd68252d7b4d 2023-12-17T11:32:32.293 DEBUG:teuthology.orchestra.run.smithi159:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2023-12-17T11:32:32.315 INFO:teuthology.orchestra.run.smithi159.stdout:postinstall scriptlet (using /bin/sh): 2023-12-17T11:32:32.315 INFO:teuthology.orchestra.run.smithi159.stdout:if [ -x /sbin/installkernel -a -r /boot/vmlinuz-6.6.0-gcd68252d7b4d -a -r /boot/System.map-6.6.0-gcd68252d7b4d ]; then 2023-12-17T11:32:32.315 INFO:teuthology.orchestra.run.smithi159.stdout:cp /boot/vmlinuz-6.6.0-gcd68252d7b4d /boot/.vmlinuz-6.6.0-gcd68252d7b4d-rpm 2023-12-17T11:32:32.315 INFO:teuthology.orchestra.run.smithi159.stdout:cp /boot/System.map-6.6.0-gcd68252d7b4d /boot/.System.map-6.6.0-gcd68252d7b4d-rpm 2023-12-17T11:32:32.315 INFO:teuthology.orchestra.run.smithi159.stdout:rm -f /boot/vmlinuz-6.6.0-gcd68252d7b4d /boot/System.map-6.6.0-gcd68252d7b4d 2023-12-17T11:32:32.315 INFO:teuthology.orchestra.run.smithi159.stdout:/sbin/installkernel 6.6.0-gcd68252d7b4d /boot/.vmlinuz-6.6.0-gcd68252d7b4d-rpm /boot/.System.map-6.6.0-gcd68252d7b4d-rpm 2023-12-17T11:32:32.315 INFO:teuthology.orchestra.run.smithi159.stdout:rm -f /boot/.vmlinuz-6.6.0-gcd68252d7b4d-rpm /boot/.System.map-6.6.0-gcd68252d7b4d-rpm 2023-12-17T11:32:32.315 INFO:teuthology.orchestra.run.smithi159.stdout:fi 2023-12-17T11:32:32.316 INFO:teuthology.orchestra.run.smithi159.stdout:preuninstall scriptlet (using /bin/sh): 2023-12-17T11:32:32.316 INFO:teuthology.orchestra.run.smithi159.stdout:if [ -x /sbin/new-kernel-pkg ]; then 2023-12-17T11:32:32.316 INFO:teuthology.orchestra.run.smithi159.stdout:new-kernel-pkg --remove 6.6.0-gcd68252d7b4d --rminitrd --initrdfile=/boot/initramfs-6.6.0-gcd68252d7b4d.img 2023-12-17T11:32:32.316 INFO:teuthology.orchestra.run.smithi159.stdout:elif [ -x /usr/bin/kernel-install ]; then 2023-12-17T11:32:32.316 INFO:teuthology.orchestra.run.smithi159.stdout:kernel-install remove 6.6.0-gcd68252d7b4d 2023-12-17T11:32:32.316 INFO:teuthology.orchestra.run.smithi159.stdout:fi 2023-12-17T11:32:32.316 INFO:teuthology.orchestra.run.smithi159.stdout:postuninstall scriptlet (using /bin/sh): 2023-12-17T11:32:32.316 INFO:teuthology.orchestra.run.smithi159.stdout:if [ -x /sbin/update-bootloader ]; then 2023-12-17T11:32:32.316 INFO:teuthology.orchestra.run.smithi159.stdout:/sbin/update-bootloader --remove 6.6.0-gcd68252d7b4d 2023-12-17T11:32:32.316 INFO:teuthology.orchestra.run.smithi159.stdout:fi 2023-12-17T11:32:32.317 DEBUG:teuthology.orchestra.run.smithi159:> sudo rpm -qi grub2-tools 2023-12-17T11:32:32.398 INFO:teuthology.orchestra.run.smithi159.stdout:Name : grub2-tools 2023-12-17T11:32:32.398 INFO:teuthology.orchestra.run.smithi159.stdout:Epoch : 1 2023-12-17T11:32:32.398 INFO:teuthology.orchestra.run.smithi159.stdout:Version : 2.06 2023-12-17T11:32:32.398 INFO:teuthology.orchestra.run.smithi159.stdout:Release : 68.el9 2023-12-17T11:32:32.398 INFO:teuthology.orchestra.run.smithi159.stdout:Architecture: x86_64 2023-12-17T11:32:32.398 INFO:teuthology.orchestra.run.smithi159.stdout:Install Date: Fri 01 Sep 2023 09:14:30 PM UTC 2023-12-17T11:32:32.398 INFO:teuthology.orchestra.run.smithi159.stdout:Group : Unspecified 2023-12-17T11:32:32.398 INFO:teuthology.orchestra.run.smithi159.stdout:Size : 8264254 2023-12-17T11:32:32.398 INFO:teuthology.orchestra.run.smithi159.stdout:License : GPLv3+ 2023-12-17T11:32:32.398 INFO:teuthology.orchestra.run.smithi159.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2023-12-17T11:32:32.399 INFO:teuthology.orchestra.run.smithi159.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2023-12-17T11:32:32.399 INFO:teuthology.orchestra.run.smithi159.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2023-12-17T11:32:32.399 INFO:teuthology.orchestra.run.smithi159.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2023-12-17T11:32:32.399 INFO:teuthology.orchestra.run.smithi159.stdout:Packager : builder@centos.org 2023-12-17T11:32:32.399 INFO:teuthology.orchestra.run.smithi159.stdout:Vendor : CentOS 2023-12-17T11:32:32.399 INFO:teuthology.orchestra.run.smithi159.stdout:URL : http://www.gnu.org/software/grub/ 2023-12-17T11:32:32.399 INFO:teuthology.orchestra.run.smithi159.stdout:Summary : Support tools for GRUB. 2023-12-17T11:32:32.399 INFO:teuthology.orchestra.run.smithi159.stdout:Description : 2023-12-17T11:32:32.399 INFO:teuthology.orchestra.run.smithi159.stdout: 2023-12-17T11:32:32.399 INFO:teuthology.orchestra.run.smithi159.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-12-17T11:32:32.399 INFO:teuthology.orchestra.run.smithi159.stdout:customizable bootloader with modular architecture. It supports a rich 2023-12-17T11:32:32.399 INFO:teuthology.orchestra.run.smithi159.stdout:variety of kernel formats, file systems, computer architectures and 2023-12-17T11:32:32.399 INFO:teuthology.orchestra.run.smithi159.stdout:hardware devices. 2023-12-17T11:32:32.399 INFO:teuthology.orchestra.run.smithi159.stdout: 2023-12-17T11:32:32.399 INFO:teuthology.orchestra.run.smithi159.stdout:This subpackage provides tools for support of all platforms. 2023-12-17T11:32:32.400 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-12-17T11:32:32.400 INFO:teuthology.task.kernel:Updating grub on smithi159 to boot 6.6.0-gcd68252d7b4d 2023-12-17T11:32:32.401 DEBUG:teuthology.orchestra.run.smithi159:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-12-17T11:32:32.993 INFO:teuthology.orchestra.run.smithi159.stderr:Generating grub configuration file ... 2023-12-17T11:32:34.429 INFO:teuthology.orchestra.run.smithi159.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2023-12-17T11:32:34.458 INFO:teuthology.orchestra.run.smithi159.stderr:done 2023-12-17T11:32:34.467 DEBUG:teuthology.orchestra.run.smithi159:> mktemp 2023-12-17T11:32:34.498 INFO:teuthology.orchestra.run.smithi159.stdout:/tmp/tmp.ahvzqEkqDm 2023-12-17T11:32:34.498 DEBUG:teuthology.orchestra.run.smithi159:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.ahvzqEkqDm 2023-12-17T11:32:34.568 DEBUG:teuthology.orchestra.run.smithi159:> sudo chmod 0666 /tmp/tmp.ahvzqEkqDm 2023-12-17T11:32:34.713 DEBUG:teuthology.orchestra.remote:smithi159:/tmp/tmp.ahvzqEkqDm is 6KB 2023-12-17T11:32:34.761 DEBUG:teuthology.orchestra.run.smithi159:> rm -fr /tmp/tmp.ahvzqEkqDm 2023-12-17T11:32:34.775 DEBUG:teuthology.orchestra.run.smithi159:> sudo /bin/ls /boot/loader/entries || true 2023-12-17T11:32:34.840 INFO:teuthology.orchestra.run.smithi159.stdout:15949e3c88704300882482eddfd7baae-0-rescue.conf 2023-12-17T11:32:34.840 INFO:teuthology.orchestra.run.smithi159.stdout:15949e3c88704300882482eddfd7baae-5.14.0-239.el9.x86_64.conf 2023-12-17T11:32:34.840 INFO:teuthology.orchestra.run.smithi159.stdout:15949e3c88704300882482eddfd7baae-5.14.0-361.el9.x86_64.conf 2023-12-17T11:32:34.840 INFO:teuthology.orchestra.run.smithi159.stdout:15949e3c88704300882482eddfd7baae-6.6.0-gcd68252d7b4d.conf 2023-12-17T11:32:34.841 DEBUG:teuthology.orchestra.run.smithi159:> sudo grub2-set-default 15949e3c88704300882482eddfd7baae-6.6.0-gcd68252d7b4d 2023-12-17T11:32:35.000 DEBUG:teuthology.orchestra.run.smithi159:> sudo shutdown -r now 2023-12-17T11:32:41.361 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.40 2023-12-17T11:32:50.370 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi040.front.sepia.ceph.com' 2023-12-17T11:32:50.371 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi040.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-17T11:33:05.017 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2023-12-17T11:33:05.018 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi159.front.sepia.ceph.com' 2023-12-17T11:33:05.018 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-17T11:33:23.345 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.159 2023-12-17T11:33:32.353 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi159.front.sepia.ceph.com' 2023-12-17T11:33:32.354 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-17T11:33:35.413 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.159 2023-12-17T11:33:47.433 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi159.front.sepia.ceph.com' 2023-12-17T11:33:47.434 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-17T11:33:50.375 DEBUG:teuthology.orchestra.remote:timed out 2023-12-17T11:34:02.385 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi040.front.sepia.ceph.com' 2023-12-17T11:34:02.386 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi040.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-17T11:34:02.753 DEBUG:teuthology.orchestra.run.smithi040:> true 2023-12-17T11:34:03.378 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi040.front.sepia.ceph.com' 2023-12-17T11:34:03.379 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.6.0-gcd68252d7b4d"... 2023-12-17T11:34:03.379 DEBUG:teuthology.orchestra.run.smithi040:> uname -r 2023-12-17T11:34:03.437 INFO:teuthology.orchestra.run.smithi040.stdout:6.6.0-gcd68252d7b4d 2023-12-17T11:34:03.438 DEBUG:teuthology.task.kernel:current kernel version is 6.6.0-gcd68252d7b4d vs 6.6.0-gcd68252d7b4d 2023-12-17T11:34:03.438 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-12-17T11:34:03.438 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2023-12-17T11:34:04.439 DEBUG:teuthology.parallel:result is None 2023-12-17T11:34:05.841 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.159 2023-12-17T11:34:20.842 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi159.front.sepia.ceph.com' 2023-12-17T11:34:20.843 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-17T11:34:23.483 DEBUG:teuthology.orchestra.run.smithi159:> true 2023-12-17T11:34:24.167 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi159.front.sepia.ceph.com' 2023-12-17T11:34:24.167 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.6.0-gcd68252d7b4d"... 2023-12-17T11:34:24.167 DEBUG:teuthology.orchestra.run.smithi159:> uname -r 2023-12-17T11:34:24.213 INFO:teuthology.orchestra.run.smithi159.stdout:6.6.0-gcd68252d7b4d 2023-12-17T11:34:24.213 DEBUG:teuthology.task.kernel:current kernel version is 6.6.0-gcd68252d7b4d vs 6.6.0-gcd68252d7b4d 2023-12-17T11:34:24.213 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-12-17T11:34:24.213 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2023-12-17T11:34:25.217 DEBUG:teuthology.parallel:result is None 2023-12-17T11:34:25.218 INFO:teuthology.run_tasks:Running task internal.base... 2023-12-17T11:34:25.225 INFO:teuthology.task.internal:Creating test directory... 2023-12-17T11:34:25.226 DEBUG:teuthology.orchestra.run.smithi040:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-12-17T11:34:25.235 DEBUG:teuthology.orchestra.run.smithi159:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-12-17T11:34:25.297 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2023-12-17T11:34:25.307 INFO:teuthology.run_tasks:Running task internal.archive... 2023-12-17T11:34:25.315 INFO:teuthology.task.internal:Creating archive directory... 2023-12-17T11:34:25.316 DEBUG:teuthology.orchestra.run.smithi040:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-12-17T11:34:25.325 DEBUG:teuthology.orchestra.run.smithi159:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-12-17T11:34:25.391 INFO:teuthology.run_tasks:Running task internal.coredump... 2023-12-17T11:34:25.399 INFO:teuthology.task.internal:Enabling coredump saving... 2023-12-17T11:34:25.399 DEBUG:teuthology.orchestra.run.smithi040:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-12-17T11:34:25.405 DEBUG:teuthology.orchestra.run.smithi159:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-12-17T11:34:25.517 INFO:teuthology.orchestra.run.smithi159.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-12-17T11:34:25.571 INFO:teuthology.orchestra.run.smithi159.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-12-17T11:34:25.576 INFO:teuthology.orchestra.run.smithi040.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-12-17T11:34:25.660 INFO:teuthology.orchestra.run.smithi040.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-12-17T11:34:25.666 INFO:teuthology.run_tasks:Running task internal.sudo... 2023-12-17T11:34:25.673 INFO:teuthology.task.internal:Configuring sudo... 2023-12-17T11:34:25.673 DEBUG:teuthology.orchestra.run.smithi040:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-12-17T11:34:25.680 DEBUG:teuthology.orchestra.run.smithi159:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-12-17T11:34:25.781 INFO:teuthology.run_tasks:Running task internal.syslog... 2023-12-17T11:34:25.790 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2023-12-17T11:34:25.791 DEBUG:teuthology.orchestra.run.smithi040:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-12-17T11:34:25.799 DEBUG:teuthology.orchestra.run.smithi159:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-12-17T11:34:25.851 DEBUG:teuthology.orchestra.run.smithi040:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-12-17T11:34:25.940 DEBUG:teuthology.orchestra.run.smithi040:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-12-17T11:34:26.053 DEBUG:teuthology.orchestra.run.smithi040:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-12-17T11:34:26.146 DEBUG:teuthology.orchestra.run.smithi040:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-12-17T11:34:26.257 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2023-12-17T11:34:26.257 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-12-17T11:34:26.364 DEBUG:teuthology.orchestra.run.smithi159:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-12-17T11:34:26.445 DEBUG:teuthology.orchestra.run.smithi159:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-12-17T11:34:26.538 DEBUG:teuthology.orchestra.run.smithi159:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-12-17T11:34:26.608 DEBUG:teuthology.orchestra.run.smithi159:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-12-17T11:34:26.706 DEBUG:teuthology.orchestra.run.smithi159:> set -ex 2023-12-17T11:34:26.706 DEBUG:teuthology.orchestra.run.smithi159:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-12-17T11:34:26.799 DEBUG:teuthology.orchestra.run.smithi040:> sudo service rsyslog restart 2023-12-17T11:34:26.808 DEBUG:teuthology.orchestra.run.smithi159:> sudo service rsyslog restart 2023-12-17T11:34:26.916 INFO:teuthology.orchestra.run.smithi159.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-12-17T11:34:26.940 INFO:teuthology.orchestra.run.smithi040.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-12-17T11:34:27.438 INFO:teuthology.run_tasks:Running task internal.timer... 2023-12-17T11:34:27.447 INFO:teuthology.task.internal:Starting timer... 2023-12-17T11:34:27.447 INFO:teuthology.run_tasks:Running task pcp... 2023-12-17T11:34:27.499 INFO:teuthology.run_tasks:Running task selinux... 2023-12-17T11:34:27.508 DEBUG:teuthology.orchestra.run.smithi040:> sudo service auditd rotate 2023-12-17T11:34:27.657 INFO:teuthology.orchestra.run.smithi040.stdout:Rotating logs: 2023-12-17T11:34:27.662 DEBUG:teuthology.orchestra.run.smithi159:> sudo service auditd rotate 2023-12-17T11:34:27.803 INFO:teuthology.orchestra.run.smithi159.stdout:Rotating logs: 2023-12-17T11:34:27.808 DEBUG:teuthology.task.selinux:Getting current SELinux state 2023-12-17T11:34:27.808 DEBUG:teuthology.orchestra.run.smithi040:> /usr/sbin/getenforce 2023-12-17T11:34:27.876 INFO:teuthology.orchestra.run.smithi040.stdout:Permissive 2023-12-17T11:34:27.877 DEBUG:teuthology.orchestra.run.smithi159:> /usr/sbin/getenforce 2023-12-17T11:34:27.930 INFO:teuthology.orchestra.run.smithi159.stdout:Permissive 2023-12-17T11:34:27.931 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi040.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi159.front.sepia.ceph.com': 'permissive'} 2023-12-17T11:34:27.931 DEBUG:teuthology.orchestra.run.smithi040:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-12-17T11:34:28.032 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-17T11:34:28.033 DEBUG:teuthology.orchestra.run.smithi159:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-12-17T11:34:28.112 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-17T11:34:28.113 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2023-12-17T11:34:28.113 DEBUG:teuthology.orchestra.run.smithi040:> sudo /usr/sbin/setenforce permissive 2023-12-17T11:34:28.213 DEBUG:teuthology.orchestra.run.smithi159:> sudo /usr/sbin/setenforce permissive 2023-12-17T11:34:28.328 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2023-12-17T11:34:28.338 INFO:teuthology.repo_utils:/home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main was just updated or references a specific commit; assuming it is current 2023-12-17T11:34:28.339 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2023-12-17T11:34:28.357 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2023-12-17T11:34:28.358 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi040.front.sepia.ceph.com,smithi159.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2023-12-17T11:44:50.607 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi040.front.sepia.ceph.com'), Remote(name='ubuntu@smithi159.front.sepia.ceph.com')] 2023-12-17T11:44:50.608 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi040.front.sepia.ceph.com' 2023-12-17T11:44:50.609 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi040.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-17T11:44:50.749 DEBUG:teuthology.orchestra.run.smithi040:> true 2023-12-17T11:44:50.913 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi040.front.sepia.ceph.com' 2023-12-17T11:44:50.914 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi159.front.sepia.ceph.com' 2023-12-17T11:44:50.914 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-17T11:44:51.054 DEBUG:teuthology.orchestra.run.smithi159:> true 2023-12-17T11:44:51.202 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi159.front.sepia.ceph.com' 2023-12-17T11:44:51.203 INFO:teuthology.run_tasks:Running task clock... 2023-12-17T11:44:51.213 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2023-12-17T11:44:51.213 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-12-17T11:44:51.213 DEBUG:teuthology.orchestra.run.smithi040:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-12-17T11:44:51.224 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-12-17T11:44:51.249 DEBUG:teuthology.orchestra.run.smithi159:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-12-17T11:44:51.331 INFO:teuthology.orchestra.run.smithi040.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-12-17T11:44:51.357 INFO:teuthology.orchestra.run.smithi159.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-12-17T11:44:51.386 INFO:teuthology.orchestra.run.smithi040.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-12-17T11:44:51.408 INFO:teuthology.orchestra.run.smithi159.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-12-17T11:44:51.491 INFO:teuthology.orchestra.run.smithi040.stderr:sudo: ntpd: command not found 2023-12-17T11:44:51.502 INFO:teuthology.orchestra.run.smithi159.stderr:sudo: ntpd: command not found 2023-12-17T11:44:51.539 INFO:teuthology.orchestra.run.smithi040.stdout:506 Cannot talk to daemon 2023-12-17T11:44:51.544 INFO:teuthology.orchestra.run.smithi159.stdout:506 Cannot talk to daemon 2023-12-17T11:44:51.593 INFO:teuthology.orchestra.run.smithi040.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-12-17T11:44:51.596 INFO:teuthology.orchestra.run.smithi159.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-12-17T11:44:51.649 INFO:teuthology.orchestra.run.smithi159.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-12-17T11:44:51.650 INFO:teuthology.orchestra.run.smithi040.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-12-17T11:44:51.773 INFO:teuthology.orchestra.run.smithi159.stderr:bash: line 1: ntpq: command not found 2023-12-17T11:44:51.775 INFO:teuthology.orchestra.run.smithi040.stderr:bash: line 1: ntpq: command not found 2023-12-17T11:44:51.781 INFO:teuthology.orchestra.run.smithi159.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-12-17T11:44:51.781 INFO:teuthology.orchestra.run.smithi159.stdout:=============================================================================== 2023-12-17T11:44:51.781 INFO:teuthology.orchestra.run.smithi159.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-17T11:44:51.781 INFO:teuthology.orchestra.run.smithi159.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-17T11:44:51.781 INFO:teuthology.orchestra.run.smithi159.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-17T11:44:51.781 INFO:teuthology.orchestra.run.smithi159.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-17T11:44:51.784 INFO:teuthology.orchestra.run.smithi040.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-12-17T11:44:51.784 INFO:teuthology.orchestra.run.smithi040.stdout:=============================================================================== 2023-12-17T11:44:51.785 INFO:teuthology.orchestra.run.smithi040.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-17T11:44:51.785 INFO:teuthology.orchestra.run.smithi040.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-17T11:44:51.785 INFO:teuthology.orchestra.run.smithi040.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-17T11:44:51.785 INFO:teuthology.orchestra.run.smithi040.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-17T11:44:51.786 INFO:teuthology.run_tasks:Running task install... 2023-12-17T11:44:51.795 DEBUG:teuthology.task.install:project ceph 2023-12-17T11:44:51.795 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'a62fda73efba5520d409bb5a21bd8373289dda5d'}} 2023-12-17T11:44:51.796 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'a62fda73efba5520d409bb5a21bd8373289dda5d'} 2023-12-17T11:44:51.796 INFO:teuthology.task.install:Using flavor: default 2023-12-17T11:44:51.802 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2023-12-17T11:44:51.802 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']} 2023-12-17T11:44:51.802 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'a62fda73efba5520d409bb5a21bd8373289dda5d', 'tag': None, 'wait_for_package': False} 2023-12-17T11:44:51.803 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=a62fda73efba5520d409bb5a21bd8373289dda5d 2023-12-17T11:44:51.805 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'a62fda73efba5520d409bb5a21bd8373289dda5d', 'tag': None, 'wait_for_package': False} 2023-12-17T11:44:51.805 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=a62fda73efba5520d409bb5a21bd8373289dda5d 2023-12-17T11:44:51.947 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/rishabh-2023dec11/a62fda73efba5520d409bb5a21bd8373289dda5d/centos/9/flavors/default/ 2023-12-17T11:44:51.948 INFO:teuthology.task.install.rpm:Package version is 19.0.0-119.ga62fda73 2023-12-17T11:44:51.952 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/rishabh-2023dec11/a62fda73efba5520d409bb5a21bd8373289dda5d/centos/9/flavors/default/ 2023-12-17T11:44:51.952 INFO:teuthology.task.install.rpm:Package version is 19.0.0-119.ga62fda73 2023-12-17T11:44:52.325 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/rishabh-2023dec11/a62fda73efba5520d409bb5a21bd8373289dda5d/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/rishabh-2023dec11/a62fda73efba5520d409bb5a21bd8373289dda5d/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/rishabh-2023dec11/a62fda73efba5520d409bb5a21bd8373289dda5d/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-12-17T11:44:52.325 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2023-12-17T11:44:52.325 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-12-17T11:44:52.332 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/rishabh-2023dec11/a62fda73efba5520d409bb5a21bd8373289dda5d/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/rishabh-2023dec11/a62fda73efba5520d409bb5a21bd8373289dda5d/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/rishabh-2023dec11/a62fda73efba5520d409bb5a21bd8373289dda5d/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-12-17T11:44:52.332 DEBUG:teuthology.orchestra.run.smithi159:> set -ex 2023-12-17T11:44:52.332 DEBUG:teuthology.orchestra.run.smithi159:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-12-17T11:44:52.434 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2023-12-17T11:44:52.435 DEBUG:teuthology.orchestra.run.smithi159:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/a62fda73efba5520d409bb5a21bd8373289dda5d/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-12-17T11:44:52.437 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2023-12-17T11:44:52.437 DEBUG:teuthology.orchestra.run.smithi040:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/a62fda73efba5520d409bb5a21bd8373289dda5d/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-12-17T11:44:52.576 DEBUG:teuthology.orchestra.run.smithi159:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-12-17T11:44:52.589 DEBUG:teuthology.orchestra.run.smithi040:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-12-17T11:44:52.707 DEBUG:teuthology.orchestra.run.smithi159:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-12-17T11:44:52.729 DEBUG:teuthology.orchestra.run.smithi040:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-12-17T11:44:52.797 INFO:teuthology.orchestra.run.smithi159.stdout:check_obsoletes = 1 2023-12-17T11:44:52.802 DEBUG:teuthology.orchestra.run.smithi159:> sudo yum clean all 2023-12-17T11:44:52.824 INFO:teuthology.orchestra.run.smithi040.stdout:check_obsoletes = 1 2023-12-17T11:44:52.828 DEBUG:teuthology.orchestra.run.smithi040:> sudo yum clean all 2023-12-17T11:44:53.159 INFO:teuthology.orchestra.run.smithi159.stdout:73 files removed 2023-12-17T11:44:53.192 INFO:teuthology.orchestra.run.smithi040.stdout:73 files removed 2023-12-17T11:44:53.197 DEBUG:teuthology.orchestra.run.smithi159:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2023-12-17T11:44:53.231 DEBUG:teuthology.orchestra.run.smithi040:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2023-12-17T11:44:54.692 INFO:teuthology.orchestra.run.smithi159.stdout:ceph packages for x86_64 79 kB/s | 78 kB 00:00 2023-12-17T11:44:54.775 INFO:teuthology.orchestra.run.smithi040.stdout:ceph packages for x86_64 77 kB/s | 78 kB 00:01 2023-12-17T11:44:55.676 INFO:teuthology.orchestra.run.smithi159.stdout:ceph noarch packages 11 kB/s | 9.5 kB 00:00 2023-12-17T11:44:55.717 INFO:teuthology.orchestra.run.smithi040.stdout:ceph noarch packages 11 kB/s | 9.5 kB 00:00 2023-12-17T11:44:56.587 INFO:teuthology.orchestra.run.smithi159.stdout:ceph source packages 2.2 kB/s | 1.9 kB 00:00 2023-12-17T11:44:56.626 INFO:teuthology.orchestra.run.smithi040.stdout:ceph source packages 2.2 kB/s | 1.9 kB 00:00 2023-12-17T11:44:57.299 INFO:teuthology.orchestra.run.smithi159.stdout:CentOS-9 - AppStream 10 MB/s | 6.4 MB 00:00 2023-12-17T11:44:57.330 INFO:teuthology.orchestra.run.smithi040.stdout:CentOS-9 - AppStream 10 MB/s | 6.4 MB 00:00 2023-12-17T11:44:58.983 INFO:teuthology.orchestra.run.smithi159.stdout:CentOS-9 - BaseOS 4.4 MB/s | 2.0 MB 00:00 2023-12-17T11:44:59.164 INFO:teuthology.orchestra.run.smithi040.stdout:CentOS-9 - BaseOS 3.5 MB/s | 2.0 MB 00:00 2023-12-17T11:45:01.099 INFO:teuthology.orchestra.run.smithi040.stdout:CentOS Stream 9 - BaseOS 5.2 MB/s | 7.9 MB 00:01 2023-12-17T11:45:02.904 INFO:teuthology.orchestra.run.smithi159.stdout:CentOS Stream 9 - BaseOS 2.2 MB/s | 7.9 MB 00:03 2023-12-17T11:45:03.578 INFO:teuthology.orchestra.run.smithi040.stdout:CentOS Stream 9 - AppStream 15 MB/s | 18 MB 00:01 2023-12-17T11:45:05.780 INFO:teuthology.orchestra.run.smithi159.stdout:CentOS Stream 9 - AppStream 11 MB/s | 18 MB 00:01 2023-12-17T11:45:08.204 INFO:teuthology.orchestra.run.smithi040.stdout:CentOS Stream 9 - CRB 7.7 MB/s | 5.8 MB 00:00 2023-12-17T11:45:09.888 INFO:teuthology.orchestra.run.smithi040.stdout:CentOS Stream 9 - Extras packages 42 kB/s | 15 kB 00:00 2023-12-17T11:45:10.297 INFO:teuthology.orchestra.run.smithi159.stdout:CentOS Stream 9 - CRB 7.6 MB/s | 5.8 MB 00:00 2023-12-17T11:45:11.803 INFO:teuthology.orchestra.run.smithi040.stdout:Extra Packages for Enterprise Linux 11 MB/s | 20 MB 00:01 2023-12-17T11:45:12.318 INFO:teuthology.orchestra.run.smithi159.stdout:CentOS Stream 9 - Extras packages 20 kB/s | 15 kB 00:00 2023-12-17T11:45:13.692 INFO:teuthology.orchestra.run.smithi159.stdout:Extra Packages for Enterprise Linux 17 MB/s | 20 MB 00:01 2023-12-17T11:45:17.616 INFO:teuthology.orchestra.run.smithi040.stdout:lab-extras 28 kB/s | 1.7 kB 00:00 2023-12-17T11:45:19.217 INFO:teuthology.orchestra.run.smithi159.stdout:lab-extras 32 kB/s | 1.7 kB 00:00 2023-12-17T11:45:20.377 INFO:teuthology.orchestra.run.smithi040.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2023-12-17T11:45:20.379 INFO:teuthology.orchestra.run.smithi040.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2023-12-17T11:45:20.402 INFO:teuthology.orchestra.run.smithi040.stdout:Package NetworkManager-1:1.44.0-2.el9.x86_64 is already installed. 2023-12-17T11:45:20.403 INFO:teuthology.orchestra.run.smithi040.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2023-12-17T11:45:20.405 INFO:teuthology.orchestra.run.smithi040.stdout:Package util-linux-2.37.4-15.el9.x86_64 is already installed. 2023-12-17T11:45:20.407 INFO:teuthology.orchestra.run.smithi040.stdout:Package libacl-devel-2.3.1-3.el9.x86_64 is already installed. 2023-12-17T11:45:20.409 INFO:teuthology.orchestra.run.smithi040.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2023-12-17T11:45:20.413 INFO:teuthology.orchestra.run.smithi040.stdout:Package xfsdump-3.1.12-3.el9.x86_64 is already installed. 2023-12-17T11:45:20.415 INFO:teuthology.orchestra.run.smithi040.stdout:Package xfsprogs-5.19.0-4.el9.x86_64 is already installed. 2023-12-17T11:45:20.501 INFO:teuthology.orchestra.run.smithi040.stdout:Dependencies resolved. 2023-12-17T11:45:20.515 INFO:teuthology.orchestra.run.smithi040.stdout:=========================================================================================== 2023-12-17T11:45:20.515 INFO:teuthology.orchestra.run.smithi040.stdout: Package Arch Version Repository Size 2023-12-17T11:45:20.515 INFO:teuthology.orchestra.run.smithi040.stdout:=========================================================================================== 2023-12-17T11:45:20.515 INFO:teuthology.orchestra.run.smithi040.stdout:Installing: 2023-12-17T11:45:20.515 INFO:teuthology.orchestra.run.smithi040.stdout: bison x86_64 3.7.4-5.el9 CentOS-AppStream 920 k 2023-12-17T11:45:20.516 INFO:teuthology.orchestra.run.smithi040.stdout: ceph x86_64 2:19.0.0-119.ga62fda73.el9 ceph 6.5 k 2023-12-17T11:45:20.516 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-base x86_64 2:19.0.0-119.ga62fda73.el9 ceph 5.2 M 2023-12-17T11:45:20.516 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-fuse x86_64 2:19.0.0-119.ga62fda73.el9 ceph 859 k 2023-12-17T11:45:20.516 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-119.ga62fda73.el9 ceph 141 k 2023-12-17T11:45:20.516 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-mgr x86_64 2:19.0.0-119.ga62fda73.el9 ceph 1.5 M 2023-12-17T11:45:20.516 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-mgr-cephadm noarch 2:19.0.0-119.ga62fda73.el9 ceph-noarch 133 k 2023-12-17T11:45:20.516 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-mgr-dashboard noarch 2:19.0.0-119.ga62fda73.el9 ceph-noarch 1.8 M 2023-12-17T11:45:20.516 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-119.ga62fda73.el9 ceph-noarch 7.4 M 2023-12-17T11:45:20.516 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-mgr-rook noarch 2:19.0.0-119.ga62fda73.el9 ceph-noarch 50 k 2023-12-17T11:45:20.516 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-radosgw x86_64 2:19.0.0-119.ga62fda73.el9 ceph 8.6 M 2023-12-17T11:45:20.516 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-test x86_64 2:19.0.0-119.ga62fda73.el9 ceph 41 M 2023-12-17T11:45:20.516 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-volume noarch 2:19.0.0-119.ga62fda73.el9 ceph-noarch 262 k 2023-12-17T11:45:20.516 INFO:teuthology.orchestra.run.smithi040.stdout: cephadm noarch 2:19.0.0-119.ga62fda73.el9 ceph-noarch 803 k 2023-12-17T11:45:20.517 INFO:teuthology.orchestra.run.smithi040.stdout: cephfs-mirror x86_64 2:19.0.0-119.ga62fda73.el9 ceph 217 k 2023-12-17T11:45:20.517 INFO:teuthology.orchestra.run.smithi040.stdout: cephfs-top noarch 2:19.0.0-119.ga62fda73.el9 ceph-noarch 18 k 2023-12-17T11:45:20.517 INFO:teuthology.orchestra.run.smithi040.stdout: elfutils-libelf-devel x86_64 0.190-1.el9 CentOS-AppStream 21 k 2023-12-17T11:45:20.517 INFO:teuthology.orchestra.run.smithi040.stdout: flex x86_64 2.6.4-9.el9 CentOS-AppStream 307 k 2023-12-17T11:45:20.517 INFO:teuthology.orchestra.run.smithi040.stdout: libaio-devel x86_64 0.3.111-13.el9 CentOS-AppStream 10 k 2023-12-17T11:45:20.517 INFO:teuthology.orchestra.run.smithi040.stdout: libcephfs-devel x86_64 2:19.0.0-119.ga62fda73.el9 ceph 31 k 2023-12-17T11:45:20.517 INFO:teuthology.orchestra.run.smithi040.stdout: libcephfs2 x86_64 2:19.0.0-119.ga62fda73.el9 ceph 718 k 2023-12-17T11:45:20.517 INFO:teuthology.orchestra.run.smithi040.stdout: librados-devel x86_64 2:19.0.0-119.ga62fda73.el9 ceph 127 k 2023-12-17T11:45:20.517 INFO:teuthology.orchestra.run.smithi040.stdout: libtool x86_64 2.4.6-45.el9 CentOS-AppStream 578 k 2023-12-17T11:45:20.517 INFO:teuthology.orchestra.run.smithi040.stdout: libuuid-devel x86_64 2.37.4-15.el9 CentOS-AppStream 24 k 2023-12-17T11:45:20.517 INFO:teuthology.orchestra.run.smithi040.stdout: openssl-devel x86_64 1:3.0.7-25.el9 appstream 4.1 M 2023-12-17T11:45:20.517 INFO:teuthology.orchestra.run.smithi040.stdout: postgresql x86_64 13.11-1.el9 CentOS-AppStream 1.5 M 2023-12-17T11:45:20.518 INFO:teuthology.orchestra.run.smithi040.stdout: postgresql-contrib x86_64 13.11-1.el9 CentOS-AppStream 811 k 2023-12-17T11:45:20.518 INFO:teuthology.orchestra.run.smithi040.stdout: postgresql-server x86_64 13.11-1.el9 CentOS-AppStream 5.7 M 2023-12-17T11:45:20.518 INFO:teuthology.orchestra.run.smithi040.stdout: python3-cephfs x86_64 2:19.0.0-119.ga62fda73.el9 ceph 161 k 2023-12-17T11:45:20.518 INFO:teuthology.orchestra.run.smithi040.stdout: python3-rados x86_64 2:19.0.0-119.ga62fda73.el9 ceph 321 k 2023-12-17T11:45:20.518 INFO:teuthology.orchestra.run.smithi040.stdout: python3-rbd x86_64 2:19.0.0-119.ga62fda73.el9 ceph 298 k 2023-12-17T11:45:20.518 INFO:teuthology.orchestra.run.smithi040.stdout: python3-rgw x86_64 2:19.0.0-119.ga62fda73.el9 ceph 99 k 2023-12-17T11:45:20.518 INFO:teuthology.orchestra.run.smithi040.stdout: rbd-fuse x86_64 2:19.0.0-119.ga62fda73.el9 ceph 85 k 2023-12-17T11:45:20.518 INFO:teuthology.orchestra.run.smithi040.stdout: rbd-mirror x86_64 2:19.0.0-119.ga62fda73.el9 ceph 3.0 M 2023-12-17T11:45:20.518 INFO:teuthology.orchestra.run.smithi040.stdout: rbd-nbd x86_64 2:19.0.0-119.ga62fda73.el9 ceph 170 k 2023-12-17T11:45:20.518 INFO:teuthology.orchestra.run.smithi040.stdout: xfsprogs-devel x86_64 5.19.0-4.el9 CentOS-AppStream 85 k 2023-12-17T11:45:20.518 INFO:teuthology.orchestra.run.smithi040.stdout:Upgrading: 2023-12-17T11:45:20.518 INFO:teuthology.orchestra.run.smithi040.stdout: NetworkManager x86_64 1:1.45.7-1.el9 baseos 2.3 M 2023-12-17T11:45:20.518 INFO:teuthology.orchestra.run.smithi040.stdout: NetworkManager-libnm x86_64 1:1.45.7-1.el9 baseos 1.8 M 2023-12-17T11:45:20.519 INFO:teuthology.orchestra.run.smithi040.stdout: NetworkManager-team x86_64 1:1.45.7-1.el9 baseos 43 k 2023-12-17T11:45:20.519 INFO:teuthology.orchestra.run.smithi040.stdout: NetworkManager-tui x86_64 1:1.45.7-1.el9 baseos 246 k 2023-12-17T11:45:20.519 INFO:teuthology.orchestra.run.smithi040.stdout: acl x86_64 2.3.1-4.el9 CentOS-BaseOS 69 k 2023-12-17T11:45:20.519 INFO:teuthology.orchestra.run.smithi040.stdout: elfutils-debuginfod-client x86_64 0.190-1.el9 CentOS-BaseOS 36 k 2023-12-17T11:45:20.519 INFO:teuthology.orchestra.run.smithi040.stdout: elfutils-libelf x86_64 0.190-1.el9 CentOS-BaseOS 192 k 2023-12-17T11:45:20.519 INFO:teuthology.orchestra.run.smithi040.stdout: elfutils-libs x86_64 0.190-1.el9 CentOS-BaseOS 255 k 2023-12-17T11:45:20.519 INFO:teuthology.orchestra.run.smithi040.stdout: libacl x86_64 2.3.1-4.el9 CentOS-BaseOS 22 k 2023-12-17T11:45:20.519 INFO:teuthology.orchestra.run.smithi040.stdout: libacl-devel x86_64 2.3.1-4.el9 CentOS-AppStream 68 k 2023-12-17T11:45:20.519 INFO:teuthology.orchestra.run.smithi040.stdout: librados2 x86_64 2:19.0.0-119.ga62fda73.el9 ceph 3.3 M 2023-12-17T11:45:20.519 INFO:teuthology.orchestra.run.smithi040.stdout: librbd1 x86_64 2:19.0.0-119.ga62fda73.el9 ceph 3.0 M 2023-12-17T11:45:20.519 INFO:teuthology.orchestra.run.smithi040.stdout: openssl x86_64 1:3.0.7-25.el9 baseos 1.2 M 2023-12-17T11:45:20.519 INFO:teuthology.orchestra.run.smithi040.stdout: openssl-libs x86_64 1:3.0.7-25.el9 baseos 2.2 M 2023-12-17T11:45:20.519 INFO:teuthology.orchestra.run.smithi040.stdout: xfsdump x86_64 3.1.12-4.el9 CentOS-BaseOS 321 k 2023-12-17T11:45:20.520 INFO:teuthology.orchestra.run.smithi040.stdout:Installing dependencies: 2023-12-17T11:45:20.520 INFO:teuthology.orchestra.run.smithi040.stdout: automake noarch 1.16.2-8.el9 CentOS-AppStream 662 k 2023-12-17T11:45:20.520 INFO:teuthology.orchestra.run.smithi040.stdout: boost-program-options x86_64 1.75.0-8.el9 CentOS-AppStream 106 k 2023-12-17T11:45:20.520 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-common x86_64 2:19.0.0-119.ga62fda73.el9 ceph 19 M 2023-12-17T11:45:20.520 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-grafana-dashboards noarch 2:19.0.0-119.ga62fda73.el9 ceph-noarch 28 k 2023-12-17T11:45:20.520 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-mds x86_64 2:19.0.0-119.ga62fda73.el9 ceph 2.1 M 2023-12-17T11:45:20.520 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-mgr-modules-core noarch 2:19.0.0-119.ga62fda73.el9 ceph-noarch 243 k 2023-12-17T11:45:20.520 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-mon x86_64 2:19.0.0-119.ga62fda73.el9 ceph 4.4 M 2023-12-17T11:45:20.520 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-osd x86_64 2:19.0.0-119.ga62fda73.el9 ceph 18 M 2023-12-17T11:45:20.520 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-prometheus-alerts noarch 2:19.0.0-119.ga62fda73.el9 ceph-noarch 15 k 2023-12-17T11:45:20.520 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-selinux x86_64 2:19.0.0-119.ga62fda73.el9 ceph 24 k 2023-12-17T11:45:20.520 INFO:teuthology.orchestra.run.smithi040.stdout: flexiblas x86_64 3.0.4-8.el9 CentOS-AppStream 32 k 2023-12-17T11:45:20.520 INFO:teuthology.orchestra.run.smithi040.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 CentOS-AppStream 3.0 M 2023-12-17T11:45:20.520 INFO:teuthology.orchestra.run.smithi040.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 CentOS-AppStream 17 k 2023-12-17T11:45:20.521 INFO:teuthology.orchestra.run.smithi040.stdout: fuse x86_64 2.9.9-15.el9 CentOS-BaseOS 79 k 2023-12-17T11:45:20.521 INFO:teuthology.orchestra.run.smithi040.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2023-12-17T11:45:20.521 INFO:teuthology.orchestra.run.smithi040.stdout: jq x86_64 1.6-16.el9 CentOS-AppStream 186 k 2023-12-17T11:45:20.521 INFO:teuthology.orchestra.run.smithi040.stdout: libarrow x86_64 9.0.0-10.el9 epel 4.4 M 2023-12-17T11:45:20.521 INFO:teuthology.orchestra.run.smithi040.stdout: libarrow-doc noarch 9.0.0-10.el9 epel 26 k 2023-12-17T11:45:20.521 INFO:teuthology.orchestra.run.smithi040.stdout: libcephsqlite x86_64 2:19.0.0-119.ga62fda73.el9 ceph 163 k 2023-12-17T11:45:20.521 INFO:teuthology.orchestra.run.smithi040.stdout: libgfortran x86_64 11.4.1-2.3.el9 CentOS-BaseOS 803 k 2023-12-17T11:45:20.522 INFO:teuthology.orchestra.run.smithi040.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2023-12-17T11:45:20.522 INFO:teuthology.orchestra.run.smithi040.stdout: libpmemobj x86_64 1.12.1-1.el9 CentOS-AppStream 159 k 2023-12-17T11:45:20.522 INFO:teuthology.orchestra.run.smithi040.stdout: libquadmath x86_64 11.4.1-2.3.el9 CentOS-BaseOS 195 k 2023-12-17T11:45:20.522 INFO:teuthology.orchestra.run.smithi040.stdout: librabbitmq x86_64 0.11.0-7.el9 CentOS-AppStream 44 k 2023-12-17T11:45:20.522 INFO:teuthology.orchestra.run.smithi040.stdout: libradosstriper1 x86_64 2:19.0.0-119.ga62fda73.el9 ceph 476 k 2023-12-17T11:45:20.522 INFO:teuthology.orchestra.run.smithi040.stdout: librdkafka x86_64 1.6.1-102.el9 CentOS-AppStream 661 k 2023-12-17T11:45:20.522 INFO:teuthology.orchestra.run.smithi040.stdout: librgw2 x86_64 2:19.0.0-119.ga62fda73.el9 ceph 4.8 M 2023-12-17T11:45:20.522 INFO:teuthology.orchestra.run.smithi040.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2023-12-17T11:45:20.522 INFO:teuthology.orchestra.run.smithi040.stdout: libzstd-devel x86_64 1.5.1-2.el9 CentOS-AppStream 46 k 2023-12-17T11:45:20.522 INFO:teuthology.orchestra.run.smithi040.stdout: lttng-ust x86_64 2.12.0-6.el9 CentOS-AppStream 282 k 2023-12-17T11:45:20.522 INFO:teuthology.orchestra.run.smithi040.stdout: lua x86_64 5.4.4-4.el9 CentOS-AppStream 187 k 2023-12-17T11:45:20.522 INFO:teuthology.orchestra.run.smithi040.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2023-12-17T11:45:20.523 INFO:teuthology.orchestra.run.smithi040.stdout: oniguruma x86_64 6.9.6-1.el9.5 CentOS-AppStream 217 k 2023-12-17T11:45:20.523 INFO:teuthology.orchestra.run.smithi040.stdout: openblas x86_64 0.3.21-2.el9 CentOS-AppStream 34 k 2023-12-17T11:45:20.523 INFO:teuthology.orchestra.run.smithi040.stdout: openblas-openmp x86_64 0.3.21-2.el9 CentOS-AppStream 4.7 M 2023-12-17T11:45:20.523 INFO:teuthology.orchestra.run.smithi040.stdout: parquet-libs x86_64 9.0.0-10.el9 epel 838 k 2023-12-17T11:45:20.523 INFO:teuthology.orchestra.run.smithi040.stdout: postgresql-private-libs x86_64 13.11-1.el9 CentOS-AppStream 134 k 2023-12-17T11:45:20.523 INFO:teuthology.orchestra.run.smithi040.stdout: python3-asyncssh noarch 2.13.2-3.el9 epel 548 k 2023-12-17T11:45:20.523 INFO:teuthology.orchestra.run.smithi040.stdout: python3-babel noarch 2.9.1-2.el9 CentOS-AppStream 5.8 M 2023-12-17T11:45:20.523 INFO:teuthology.orchestra.run.smithi040.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2023-12-17T11:45:20.523 INFO:teuthology.orchestra.run.smithi040.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2023-12-17T11:45:20.523 INFO:teuthology.orchestra.run.smithi040.stdout: python3-ceph-argparse x86_64 2:19.0.0-119.ga62fda73.el9 ceph 45 k 2023-12-17T11:45:20.523 INFO:teuthology.orchestra.run.smithi040.stdout: python3-ceph-common x86_64 2:19.0.0-119.ga62fda73.el9 ceph 129 k 2023-12-17T11:45:20.523 INFO:teuthology.orchestra.run.smithi040.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2023-12-17T11:45:20.523 INFO:teuthology.orchestra.run.smithi040.stdout: python3-cffi x86_64 1.14.5-5.el9 CentOS-BaseOS 241 k 2023-12-17T11:45:20.523 INFO:teuthology.orchestra.run.smithi040.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2023-12-17T11:45:20.524 INFO:teuthology.orchestra.run.smithi040.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2023-12-17T11:45:20.524 INFO:teuthology.orchestra.run.smithi040.stdout: python3-cryptography x86_64 36.0.1-4.el9 CentOS-BaseOS 1.1 M 2023-12-17T11:45:20.524 INFO:teuthology.orchestra.run.smithi040.stdout: python3-devel x86_64 3.9.17-2.el9 appstream 245 k 2023-12-17T11:45:20.524 INFO:teuthology.orchestra.run.smithi040.stdout: python3-google-auth noarch 1:2.23.4-1.el9 epel 197 k 2023-12-17T11:45:20.524 INFO:teuthology.orchestra.run.smithi040.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2023-12-17T11:45:20.524 INFO:teuthology.orchestra.run.smithi040.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2023-12-17T11:45:20.524 INFO:teuthology.orchestra.run.smithi040.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2023-12-17T11:45:20.524 INFO:teuthology.orchestra.run.smithi040.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2023-12-17T11:45:20.524 INFO:teuthology.orchestra.run.smithi040.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2023-12-17T11:45:20.524 INFO:teuthology.orchestra.run.smithi040.stdout: python3-jinja2 noarch 2.11.3-4.el9 CentOS-AppStream 228 k 2023-12-17T11:45:20.524 INFO:teuthology.orchestra.run.smithi040.stdout: python3-jsonpatch noarch 1.21-16.el9 CentOS-AppStream 24 k 2023-12-17T11:45:20.524 INFO:teuthology.orchestra.run.smithi040.stdout: python3-jsonpointer noarch 2.0-4.el9 CentOS-AppStream 18 k 2023-12-17T11:45:20.524 INFO:teuthology.orchestra.run.smithi040.stdout: python3-jwt noarch 2.4.0-1.el9 epel 41 k 2023-12-17T11:45:20.525 INFO:teuthology.orchestra.run.smithi040.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2023-12-17T11:45:20.525 INFO:teuthology.orchestra.run.smithi040.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2023-12-17T11:45:20.525 INFO:teuthology.orchestra.run.smithi040.stdout: python3-mako noarch 1.1.4-6.el9 CentOS-AppStream 144 k 2023-12-17T11:45:20.525 INFO:teuthology.orchestra.run.smithi040.stdout: python3-markupsafe x86_64 1.1.1-12.el9 CentOS-AppStream 32 k 2023-12-17T11:45:20.525 INFO:teuthology.orchestra.run.smithi040.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2023-12-17T11:45:20.525 INFO:teuthology.orchestra.run.smithi040.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2023-12-17T11:45:20.525 INFO:teuthology.orchestra.run.smithi040.stdout: python3-numpy x86_64 1:1.20.1-5.el9 CentOS-AppStream 4.8 M 2023-12-17T11:45:20.525 INFO:teuthology.orchestra.run.smithi040.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 CentOS-AppStream 217 k 2023-12-17T11:45:20.525 INFO:teuthology.orchestra.run.smithi040.stdout: python3-oauthlib noarch 3.1.1-5.el9 CentOS-AppStream 174 k 2023-12-17T11:45:20.525 INFO:teuthology.orchestra.run.smithi040.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2023-12-17T11:45:20.525 INFO:teuthology.orchestra.run.smithi040.stdout: python3-ply noarch 3.11-14.el9 CentOS-BaseOS 103 k 2023-12-17T11:45:20.525 INFO:teuthology.orchestra.run.smithi040.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2023-12-17T11:45:20.525 INFO:teuthology.orchestra.run.smithi040.stdout: python3-prettytable noarch 0.7.2-27.el9 CentOS-AppStream 41 k 2023-12-17T11:45:20.525 INFO:teuthology.orchestra.run.smithi040.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2023-12-17T11:45:20.526 INFO:teuthology.orchestra.run.smithi040.stdout: python3-pyasn1 noarch 0.4.8-6.el9 CentOS-AppStream 132 k 2023-12-17T11:45:20.526 INFO:teuthology.orchestra.run.smithi040.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 CentOS-AppStream 211 k 2023-12-17T11:45:20.526 INFO:teuthology.orchestra.run.smithi040.stdout: python3-pycparser noarch 2.20-6.el9 CentOS-BaseOS 124 k 2023-12-17T11:45:20.526 INFO:teuthology.orchestra.run.smithi040.stdout: python3-pytz noarch 2021.1-5.el9 CentOS-AppStream 47 k 2023-12-17T11:45:20.526 INFO:teuthology.orchestra.run.smithi040.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2023-12-17T11:45:20.526 INFO:teuthology.orchestra.run.smithi040.stdout: python3-requests noarch 2.25.1-7.el9 CentOS-BaseOS 113 k 2023-12-17T11:45:20.526 INFO:teuthology.orchestra.run.smithi040.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 CentOS-AppStream 43 k 2023-12-17T11:45:20.526 INFO:teuthology.orchestra.run.smithi040.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2023-12-17T11:45:20.526 INFO:teuthology.orchestra.run.smithi040.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2023-12-17T11:45:20.526 INFO:teuthology.orchestra.run.smithi040.stdout: python3-scipy x86_64 1.6.2-8.el9 CentOS-AppStream 16 M 2023-12-17T11:45:20.526 INFO:teuthology.orchestra.run.smithi040.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2023-12-17T11:45:20.526 INFO:teuthology.orchestra.run.smithi040.stdout: python3-toml noarch 0.10.2-6.el9 CentOS-AppStream 39 k 2023-12-17T11:45:20.527 INFO:teuthology.orchestra.run.smithi040.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2023-12-17T11:45:20.527 INFO:teuthology.orchestra.run.smithi040.stdout: python3-urllib3 noarch 1.26.5-4.el9 CentOS-BaseOS 187 k 2023-12-17T11:45:20.527 INFO:teuthology.orchestra.run.smithi040.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2023-12-17T11:45:20.527 INFO:teuthology.orchestra.run.smithi040.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2023-12-17T11:45:20.527 INFO:teuthology.orchestra.run.smithi040.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2023-12-17T11:45:20.527 INFO:teuthology.orchestra.run.smithi040.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2023-12-17T11:45:20.527 INFO:teuthology.orchestra.run.smithi040.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2023-12-17T11:45:20.527 INFO:teuthology.orchestra.run.smithi040.stdout: socat x86_64 1.7.4.1-5.el9 CentOS-AppStream 300 k 2023-12-17T11:45:20.527 INFO:teuthology.orchestra.run.smithi040.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2023-12-17T11:45:20.527 INFO:teuthology.orchestra.run.smithi040.stdout: uuid x86_64 1.6.2-55.el9 CentOS-AppStream 56 k 2023-12-17T11:45:20.527 INFO:teuthology.orchestra.run.smithi040.stdout: xmlstarlet x86_64 1.6.1-20.el9 CentOS-AppStream 63 k 2023-12-17T11:45:20.527 INFO:teuthology.orchestra.run.smithi040.stdout: zlib-devel x86_64 1.2.11-40.el9 CentOS-AppStream 44 k 2023-12-17T11:45:20.528 INFO:teuthology.orchestra.run.smithi040.stdout:Installing weak dependencies: 2023-12-17T11:45:20.528 INFO:teuthology.orchestra.run.smithi040.stdout: python3-jwt+crypto noarch 2.4.0-1.el9 epel 9.0 k 2023-12-17T11:45:20.528 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T11:45:20.528 INFO:teuthology.orchestra.run.smithi040.stdout:Transaction Summary 2023-12-17T11:45:20.528 INFO:teuthology.orchestra.run.smithi040.stdout:=========================================================================================== 2023-12-17T11:45:20.528 INFO:teuthology.orchestra.run.smithi040.stdout:Install 134 Packages 2023-12-17T11:45:20.528 INFO:teuthology.orchestra.run.smithi040.stdout:Upgrade 15 Packages 2023-12-17T11:45:20.528 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T11:45:20.529 INFO:teuthology.orchestra.run.smithi040.stdout:Total download size: 204 M 2023-12-17T11:45:20.529 INFO:teuthology.orchestra.run.smithi040.stdout:Downloading Packages: 2023-12-17T11:45:21.476 INFO:teuthology.orchestra.run.smithi040.stdout:(1/149): ceph-19.0.0-119.ga62fda73.el9.x86_64.r 13 kB/s | 6.5 kB 00:00 2023-12-17T11:45:21.857 INFO:teuthology.orchestra.run.smithi159.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2023-12-17T11:45:21.859 INFO:teuthology.orchestra.run.smithi159.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2023-12-17T11:45:21.879 INFO:teuthology.orchestra.run.smithi159.stdout:Package NetworkManager-1:1.44.0-2.el9.x86_64 is already installed. 2023-12-17T11:45:21.881 INFO:teuthology.orchestra.run.smithi159.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2023-12-17T11:45:21.882 INFO:teuthology.orchestra.run.smithi159.stdout:Package util-linux-2.37.4-15.el9.x86_64 is already installed. 2023-12-17T11:45:21.883 INFO:teuthology.orchestra.run.smithi159.stdout:Package libacl-devel-2.3.1-3.el9.x86_64 is already installed. 2023-12-17T11:45:21.886 INFO:teuthology.orchestra.run.smithi159.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2023-12-17T11:45:21.890 INFO:teuthology.orchestra.run.smithi159.stdout:Package xfsdump-3.1.12-3.el9.x86_64 is already installed. 2023-12-17T11:45:21.891 INFO:teuthology.orchestra.run.smithi159.stdout:Package xfsprogs-5.19.0-4.el9.x86_64 is already installed. 2023-12-17T11:45:21.971 INFO:teuthology.orchestra.run.smithi159.stdout:Dependencies resolved. 2023-12-17T11:45:21.987 INFO:teuthology.orchestra.run.smithi159.stdout:=========================================================================================== 2023-12-17T11:45:21.987 INFO:teuthology.orchestra.run.smithi159.stdout: Package Arch Version Repository Size 2023-12-17T11:45:21.987 INFO:teuthology.orchestra.run.smithi159.stdout:=========================================================================================== 2023-12-17T11:45:21.987 INFO:teuthology.orchestra.run.smithi159.stdout:Installing: 2023-12-17T11:45:21.987 INFO:teuthology.orchestra.run.smithi159.stdout: bison x86_64 3.7.4-5.el9 CentOS-AppStream 920 k 2023-12-17T11:45:21.988 INFO:teuthology.orchestra.run.smithi159.stdout: ceph x86_64 2:19.0.0-119.ga62fda73.el9 ceph 6.5 k 2023-12-17T11:45:21.988 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-base x86_64 2:19.0.0-119.ga62fda73.el9 ceph 5.2 M 2023-12-17T11:45:21.988 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-fuse x86_64 2:19.0.0-119.ga62fda73.el9 ceph 859 k 2023-12-17T11:45:21.988 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-119.ga62fda73.el9 ceph 141 k 2023-12-17T11:45:21.988 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-mgr x86_64 2:19.0.0-119.ga62fda73.el9 ceph 1.5 M 2023-12-17T11:45:21.988 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-mgr-cephadm noarch 2:19.0.0-119.ga62fda73.el9 ceph-noarch 133 k 2023-12-17T11:45:21.988 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-mgr-dashboard noarch 2:19.0.0-119.ga62fda73.el9 ceph-noarch 1.8 M 2023-12-17T11:45:21.988 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-119.ga62fda73.el9 ceph-noarch 7.4 M 2023-12-17T11:45:21.988 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-mgr-rook noarch 2:19.0.0-119.ga62fda73.el9 ceph-noarch 50 k 2023-12-17T11:45:21.988 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-radosgw x86_64 2:19.0.0-119.ga62fda73.el9 ceph 8.6 M 2023-12-17T11:45:21.988 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-test x86_64 2:19.0.0-119.ga62fda73.el9 ceph 41 M 2023-12-17T11:45:21.988 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-volume noarch 2:19.0.0-119.ga62fda73.el9 ceph-noarch 262 k 2023-12-17T11:45:21.988 INFO:teuthology.orchestra.run.smithi159.stdout: cephadm noarch 2:19.0.0-119.ga62fda73.el9 ceph-noarch 803 k 2023-12-17T11:45:21.989 INFO:teuthology.orchestra.run.smithi159.stdout: cephfs-mirror x86_64 2:19.0.0-119.ga62fda73.el9 ceph 217 k 2023-12-17T11:45:21.989 INFO:teuthology.orchestra.run.smithi159.stdout: cephfs-top noarch 2:19.0.0-119.ga62fda73.el9 ceph-noarch 18 k 2023-12-17T11:45:21.989 INFO:teuthology.orchestra.run.smithi159.stdout: elfutils-libelf-devel x86_64 0.190-1.el9 CentOS-AppStream 21 k 2023-12-17T11:45:21.989 INFO:teuthology.orchestra.run.smithi159.stdout: flex x86_64 2.6.4-9.el9 CentOS-AppStream 307 k 2023-12-17T11:45:21.989 INFO:teuthology.orchestra.run.smithi159.stdout: libaio-devel x86_64 0.3.111-13.el9 CentOS-AppStream 10 k 2023-12-17T11:45:21.989 INFO:teuthology.orchestra.run.smithi159.stdout: libcephfs-devel x86_64 2:19.0.0-119.ga62fda73.el9 ceph 31 k 2023-12-17T11:45:21.989 INFO:teuthology.orchestra.run.smithi159.stdout: libcephfs2 x86_64 2:19.0.0-119.ga62fda73.el9 ceph 718 k 2023-12-17T11:45:21.989 INFO:teuthology.orchestra.run.smithi159.stdout: librados-devel x86_64 2:19.0.0-119.ga62fda73.el9 ceph 127 k 2023-12-17T11:45:21.989 INFO:teuthology.orchestra.run.smithi159.stdout: libtool x86_64 2.4.6-45.el9 CentOS-AppStream 578 k 2023-12-17T11:45:21.989 INFO:teuthology.orchestra.run.smithi159.stdout: libuuid-devel x86_64 2.37.4-15.el9 CentOS-AppStream 24 k 2023-12-17T11:45:21.989 INFO:teuthology.orchestra.run.smithi159.stdout: openssl-devel x86_64 1:3.0.7-25.el9 appstream 4.1 M 2023-12-17T11:45:21.989 INFO:teuthology.orchestra.run.smithi159.stdout: postgresql x86_64 13.11-1.el9 CentOS-AppStream 1.5 M 2023-12-17T11:45:21.990 INFO:teuthology.orchestra.run.smithi159.stdout: postgresql-contrib x86_64 13.11-1.el9 CentOS-AppStream 811 k 2023-12-17T11:45:21.990 INFO:teuthology.orchestra.run.smithi159.stdout: postgresql-server x86_64 13.11-1.el9 CentOS-AppStream 5.7 M 2023-12-17T11:45:21.990 INFO:teuthology.orchestra.run.smithi159.stdout: python3-cephfs x86_64 2:19.0.0-119.ga62fda73.el9 ceph 161 k 2023-12-17T11:45:21.990 INFO:teuthology.orchestra.run.smithi159.stdout: python3-rados x86_64 2:19.0.0-119.ga62fda73.el9 ceph 321 k 2023-12-17T11:45:21.990 INFO:teuthology.orchestra.run.smithi159.stdout: python3-rbd x86_64 2:19.0.0-119.ga62fda73.el9 ceph 298 k 2023-12-17T11:45:21.990 INFO:teuthology.orchestra.run.smithi159.stdout: python3-rgw x86_64 2:19.0.0-119.ga62fda73.el9 ceph 99 k 2023-12-17T11:45:21.990 INFO:teuthology.orchestra.run.smithi159.stdout: rbd-fuse x86_64 2:19.0.0-119.ga62fda73.el9 ceph 85 k 2023-12-17T11:45:21.990 INFO:teuthology.orchestra.run.smithi159.stdout: rbd-mirror x86_64 2:19.0.0-119.ga62fda73.el9 ceph 3.0 M 2023-12-17T11:45:21.991 INFO:teuthology.orchestra.run.smithi159.stdout: rbd-nbd x86_64 2:19.0.0-119.ga62fda73.el9 ceph 170 k 2023-12-17T11:45:21.991 INFO:teuthology.orchestra.run.smithi159.stdout: xfsprogs-devel x86_64 5.19.0-4.el9 CentOS-AppStream 85 k 2023-12-17T11:45:21.991 INFO:teuthology.orchestra.run.smithi159.stdout:Upgrading: 2023-12-17T11:45:21.991 INFO:teuthology.orchestra.run.smithi159.stdout: NetworkManager x86_64 1:1.45.7-1.el9 baseos 2.3 M 2023-12-17T11:45:21.991 INFO:teuthology.orchestra.run.smithi159.stdout: NetworkManager-libnm x86_64 1:1.45.7-1.el9 baseos 1.8 M 2023-12-17T11:45:21.991 INFO:teuthology.orchestra.run.smithi159.stdout: NetworkManager-team x86_64 1:1.45.7-1.el9 baseos 43 k 2023-12-17T11:45:21.991 INFO:teuthology.orchestra.run.smithi159.stdout: NetworkManager-tui x86_64 1:1.45.7-1.el9 baseos 246 k 2023-12-17T11:45:21.991 INFO:teuthology.orchestra.run.smithi159.stdout: acl x86_64 2.3.1-4.el9 CentOS-BaseOS 69 k 2023-12-17T11:45:21.992 INFO:teuthology.orchestra.run.smithi159.stdout: elfutils-debuginfod-client x86_64 0.190-1.el9 CentOS-BaseOS 36 k 2023-12-17T11:45:21.992 INFO:teuthology.orchestra.run.smithi159.stdout: elfutils-libelf x86_64 0.190-1.el9 CentOS-BaseOS 192 k 2023-12-17T11:45:21.992 INFO:teuthology.orchestra.run.smithi159.stdout: elfutils-libs x86_64 0.190-1.el9 CentOS-BaseOS 255 k 2023-12-17T11:45:21.992 INFO:teuthology.orchestra.run.smithi159.stdout: libacl x86_64 2.3.1-4.el9 CentOS-BaseOS 22 k 2023-12-17T11:45:21.992 INFO:teuthology.orchestra.run.smithi159.stdout: libacl-devel x86_64 2.3.1-4.el9 CentOS-AppStream 68 k 2023-12-17T11:45:21.992 INFO:teuthology.orchestra.run.smithi159.stdout: librados2 x86_64 2:19.0.0-119.ga62fda73.el9 ceph 3.3 M 2023-12-17T11:45:21.992 INFO:teuthology.orchestra.run.smithi159.stdout: librbd1 x86_64 2:19.0.0-119.ga62fda73.el9 ceph 3.0 M 2023-12-17T11:45:21.992 INFO:teuthology.orchestra.run.smithi159.stdout: openssl x86_64 1:3.0.7-25.el9 baseos 1.2 M 2023-12-17T11:45:21.992 INFO:teuthology.orchestra.run.smithi159.stdout: openssl-libs x86_64 1:3.0.7-25.el9 baseos 2.2 M 2023-12-17T11:45:21.992 INFO:teuthology.orchestra.run.smithi159.stdout: xfsdump x86_64 3.1.12-4.el9 CentOS-BaseOS 321 k 2023-12-17T11:45:21.992 INFO:teuthology.orchestra.run.smithi159.stdout:Installing dependencies: 2023-12-17T11:45:21.992 INFO:teuthology.orchestra.run.smithi159.stdout: automake noarch 1.16.2-8.el9 CentOS-AppStream 662 k 2023-12-17T11:45:21.992 INFO:teuthology.orchestra.run.smithi159.stdout: boost-program-options x86_64 1.75.0-8.el9 CentOS-AppStream 106 k 2023-12-17T11:45:21.993 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-common x86_64 2:19.0.0-119.ga62fda73.el9 ceph 19 M 2023-12-17T11:45:21.993 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-grafana-dashboards noarch 2:19.0.0-119.ga62fda73.el9 ceph-noarch 28 k 2023-12-17T11:45:21.993 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-mds x86_64 2:19.0.0-119.ga62fda73.el9 ceph 2.1 M 2023-12-17T11:45:21.993 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-mgr-modules-core noarch 2:19.0.0-119.ga62fda73.el9 ceph-noarch 243 k 2023-12-17T11:45:21.993 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-mon x86_64 2:19.0.0-119.ga62fda73.el9 ceph 4.4 M 2023-12-17T11:45:21.993 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-osd x86_64 2:19.0.0-119.ga62fda73.el9 ceph 18 M 2023-12-17T11:45:21.993 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-prometheus-alerts noarch 2:19.0.0-119.ga62fda73.el9 ceph-noarch 15 k 2023-12-17T11:45:21.993 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-selinux x86_64 2:19.0.0-119.ga62fda73.el9 ceph 24 k 2023-12-17T11:45:21.993 INFO:teuthology.orchestra.run.smithi159.stdout: flexiblas x86_64 3.0.4-8.el9 CentOS-AppStream 32 k 2023-12-17T11:45:21.993 INFO:teuthology.orchestra.run.smithi159.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 CentOS-AppStream 3.0 M 2023-12-17T11:45:21.993 INFO:teuthology.orchestra.run.smithi159.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 CentOS-AppStream 17 k 2023-12-17T11:45:21.993 INFO:teuthology.orchestra.run.smithi159.stdout: fuse x86_64 2.9.9-15.el9 CentOS-BaseOS 79 k 2023-12-17T11:45:21.994 INFO:teuthology.orchestra.run.smithi159.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2023-12-17T11:45:21.994 INFO:teuthology.orchestra.run.smithi159.stdout: jq x86_64 1.6-16.el9 CentOS-AppStream 186 k 2023-12-17T11:45:21.994 INFO:teuthology.orchestra.run.smithi159.stdout: libarrow x86_64 9.0.0-10.el9 epel 4.4 M 2023-12-17T11:45:21.994 INFO:teuthology.orchestra.run.smithi159.stdout: libarrow-doc noarch 9.0.0-10.el9 epel 26 k 2023-12-17T11:45:21.994 INFO:teuthology.orchestra.run.smithi159.stdout: libcephsqlite x86_64 2:19.0.0-119.ga62fda73.el9 ceph 163 k 2023-12-17T11:45:21.994 INFO:teuthology.orchestra.run.smithi159.stdout: libgfortran x86_64 11.4.1-2.3.el9 CentOS-BaseOS 803 k 2023-12-17T11:45:21.994 INFO:teuthology.orchestra.run.smithi159.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2023-12-17T11:45:21.994 INFO:teuthology.orchestra.run.smithi159.stdout: libpmemobj x86_64 1.12.1-1.el9 CentOS-AppStream 159 k 2023-12-17T11:45:21.994 INFO:teuthology.orchestra.run.smithi159.stdout: libquadmath x86_64 11.4.1-2.3.el9 CentOS-BaseOS 195 k 2023-12-17T11:45:21.994 INFO:teuthology.orchestra.run.smithi159.stdout: librabbitmq x86_64 0.11.0-7.el9 CentOS-AppStream 44 k 2023-12-17T11:45:21.994 INFO:teuthology.orchestra.run.smithi159.stdout: libradosstriper1 x86_64 2:19.0.0-119.ga62fda73.el9 ceph 476 k 2023-12-17T11:45:21.995 INFO:teuthology.orchestra.run.smithi159.stdout: librdkafka x86_64 1.6.1-102.el9 CentOS-AppStream 661 k 2023-12-17T11:45:21.995 INFO:teuthology.orchestra.run.smithi159.stdout: librgw2 x86_64 2:19.0.0-119.ga62fda73.el9 ceph 4.8 M 2023-12-17T11:45:21.995 INFO:teuthology.orchestra.run.smithi159.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2023-12-17T11:45:21.995 INFO:teuthology.orchestra.run.smithi159.stdout: libzstd-devel x86_64 1.5.1-2.el9 CentOS-AppStream 46 k 2023-12-17T11:45:21.995 INFO:teuthology.orchestra.run.smithi159.stdout: lttng-ust x86_64 2.12.0-6.el9 CentOS-AppStream 282 k 2023-12-17T11:45:21.995 INFO:teuthology.orchestra.run.smithi159.stdout: lua x86_64 5.4.4-4.el9 CentOS-AppStream 187 k 2023-12-17T11:45:21.995 INFO:teuthology.orchestra.run.smithi159.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2023-12-17T11:45:21.995 INFO:teuthology.orchestra.run.smithi159.stdout: oniguruma x86_64 6.9.6-1.el9.5 CentOS-AppStream 217 k 2023-12-17T11:45:21.995 INFO:teuthology.orchestra.run.smithi159.stdout: openblas x86_64 0.3.21-2.el9 CentOS-AppStream 34 k 2023-12-17T11:45:21.995 INFO:teuthology.orchestra.run.smithi159.stdout: openblas-openmp x86_64 0.3.21-2.el9 CentOS-AppStream 4.7 M 2023-12-17T11:45:21.995 INFO:teuthology.orchestra.run.smithi159.stdout: parquet-libs x86_64 9.0.0-10.el9 epel 838 k 2023-12-17T11:45:21.995 INFO:teuthology.orchestra.run.smithi159.stdout: postgresql-private-libs x86_64 13.11-1.el9 CentOS-AppStream 134 k 2023-12-17T11:45:21.995 INFO:teuthology.orchestra.run.smithi159.stdout: python3-asyncssh noarch 2.13.2-3.el9 epel 548 k 2023-12-17T11:45:21.996 INFO:teuthology.orchestra.run.smithi159.stdout: python3-babel noarch 2.9.1-2.el9 CentOS-AppStream 5.8 M 2023-12-17T11:45:21.996 INFO:teuthology.orchestra.run.smithi159.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2023-12-17T11:45:21.996 INFO:teuthology.orchestra.run.smithi159.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2023-12-17T11:45:21.996 INFO:teuthology.orchestra.run.smithi159.stdout: python3-ceph-argparse x86_64 2:19.0.0-119.ga62fda73.el9 ceph 45 k 2023-12-17T11:45:21.996 INFO:teuthology.orchestra.run.smithi159.stdout: python3-ceph-common x86_64 2:19.0.0-119.ga62fda73.el9 ceph 129 k 2023-12-17T11:45:21.996 INFO:teuthology.orchestra.run.smithi159.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2023-12-17T11:45:21.996 INFO:teuthology.orchestra.run.smithi159.stdout: python3-cffi x86_64 1.14.5-5.el9 CentOS-BaseOS 241 k 2023-12-17T11:45:21.996 INFO:teuthology.orchestra.run.smithi159.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2023-12-17T11:45:21.996 INFO:teuthology.orchestra.run.smithi159.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2023-12-17T11:45:21.996 INFO:teuthology.orchestra.run.smithi159.stdout: python3-cryptography x86_64 36.0.1-4.el9 CentOS-BaseOS 1.1 M 2023-12-17T11:45:21.996 INFO:teuthology.orchestra.run.smithi159.stdout: python3-devel x86_64 3.9.17-2.el9 appstream 245 k 2023-12-17T11:45:21.997 INFO:teuthology.orchestra.run.smithi159.stdout: python3-google-auth noarch 1:2.23.4-1.el9 epel 197 k 2023-12-17T11:45:21.997 INFO:teuthology.orchestra.run.smithi159.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2023-12-17T11:45:21.997 INFO:teuthology.orchestra.run.smithi159.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2023-12-17T11:45:21.997 INFO:teuthology.orchestra.run.smithi159.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2023-12-17T11:45:21.997 INFO:teuthology.orchestra.run.smithi159.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2023-12-17T11:45:21.997 INFO:teuthology.orchestra.run.smithi159.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2023-12-17T11:45:21.997 INFO:teuthology.orchestra.run.smithi159.stdout: python3-jinja2 noarch 2.11.3-4.el9 CentOS-AppStream 228 k 2023-12-17T11:45:21.998 INFO:teuthology.orchestra.run.smithi159.stdout: python3-jsonpatch noarch 1.21-16.el9 CentOS-AppStream 24 k 2023-12-17T11:45:21.998 INFO:teuthology.orchestra.run.smithi159.stdout: python3-jsonpointer noarch 2.0-4.el9 CentOS-AppStream 18 k 2023-12-17T11:45:21.998 INFO:teuthology.orchestra.run.smithi159.stdout: python3-jwt noarch 2.4.0-1.el9 epel 41 k 2023-12-17T11:45:21.998 INFO:teuthology.orchestra.run.smithi159.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2023-12-17T11:45:21.998 INFO:teuthology.orchestra.run.smithi159.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2023-12-17T11:45:21.998 INFO:teuthology.orchestra.run.smithi159.stdout: python3-mako noarch 1.1.4-6.el9 CentOS-AppStream 144 k 2023-12-17T11:45:21.998 INFO:teuthology.orchestra.run.smithi159.stdout: python3-markupsafe x86_64 1.1.1-12.el9 CentOS-AppStream 32 k 2023-12-17T11:45:21.998 INFO:teuthology.orchestra.run.smithi159.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2023-12-17T11:45:21.999 INFO:teuthology.orchestra.run.smithi159.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2023-12-17T11:45:21.999 INFO:teuthology.orchestra.run.smithi159.stdout: python3-numpy x86_64 1:1.20.1-5.el9 CentOS-AppStream 4.8 M 2023-12-17T11:45:21.999 INFO:teuthology.orchestra.run.smithi159.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 CentOS-AppStream 217 k 2023-12-17T11:45:21.999 INFO:teuthology.orchestra.run.smithi159.stdout: python3-oauthlib noarch 3.1.1-5.el9 CentOS-AppStream 174 k 2023-12-17T11:45:21.999 INFO:teuthology.orchestra.run.smithi159.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2023-12-17T11:45:21.999 INFO:teuthology.orchestra.run.smithi159.stdout: python3-ply noarch 3.11-14.el9 CentOS-BaseOS 103 k 2023-12-17T11:45:21.999 INFO:teuthology.orchestra.run.smithi159.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2023-12-17T11:45:21.999 INFO:teuthology.orchestra.run.smithi159.stdout: python3-prettytable noarch 0.7.2-27.el9 CentOS-AppStream 41 k 2023-12-17T11:45:21.999 INFO:teuthology.orchestra.run.smithi159.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2023-12-17T11:45:21.999 INFO:teuthology.orchestra.run.smithi159.stdout: python3-pyasn1 noarch 0.4.8-6.el9 CentOS-AppStream 132 k 2023-12-17T11:45:21.999 INFO:teuthology.orchestra.run.smithi159.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 CentOS-AppStream 211 k 2023-12-17T11:45:21.999 INFO:teuthology.orchestra.run.smithi159.stdout: python3-pycparser noarch 2.20-6.el9 CentOS-BaseOS 124 k 2023-12-17T11:45:21.999 INFO:teuthology.orchestra.run.smithi159.stdout: python3-pytz noarch 2021.1-5.el9 CentOS-AppStream 47 k 2023-12-17T11:45:21.999 INFO:teuthology.orchestra.run.smithi159.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2023-12-17T11:45:21.999 INFO:teuthology.orchestra.run.smithi159.stdout: python3-requests noarch 2.25.1-7.el9 CentOS-BaseOS 113 k 2023-12-17T11:45:22.000 INFO:teuthology.orchestra.run.smithi159.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 CentOS-AppStream 43 k 2023-12-17T11:45:22.000 INFO:teuthology.orchestra.run.smithi159.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2023-12-17T11:45:22.000 INFO:teuthology.orchestra.run.smithi159.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2023-12-17T11:45:22.000 INFO:teuthology.orchestra.run.smithi159.stdout: python3-scipy x86_64 1.6.2-8.el9 CentOS-AppStream 16 M 2023-12-17T11:45:22.000 INFO:teuthology.orchestra.run.smithi159.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2023-12-17T11:45:22.000 INFO:teuthology.orchestra.run.smithi159.stdout: python3-toml noarch 0.10.2-6.el9 CentOS-AppStream 39 k 2023-12-17T11:45:22.000 INFO:teuthology.orchestra.run.smithi159.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2023-12-17T11:45:22.000 INFO:teuthology.orchestra.run.smithi159.stdout: python3-urllib3 noarch 1.26.5-4.el9 CentOS-BaseOS 187 k 2023-12-17T11:45:22.000 INFO:teuthology.orchestra.run.smithi159.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2023-12-17T11:45:22.000 INFO:teuthology.orchestra.run.smithi159.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2023-12-17T11:45:22.000 INFO:teuthology.orchestra.run.smithi159.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2023-12-17T11:45:22.000 INFO:teuthology.orchestra.run.smithi159.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2023-12-17T11:45:22.000 INFO:teuthology.orchestra.run.smithi159.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2023-12-17T11:45:22.000 INFO:teuthology.orchestra.run.smithi159.stdout: socat x86_64 1.7.4.1-5.el9 CentOS-AppStream 300 k 2023-12-17T11:45:22.001 INFO:teuthology.orchestra.run.smithi159.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2023-12-17T11:45:22.001 INFO:teuthology.orchestra.run.smithi159.stdout: uuid x86_64 1.6.2-55.el9 CentOS-AppStream 56 k 2023-12-17T11:45:22.001 INFO:teuthology.orchestra.run.smithi159.stdout: xmlstarlet x86_64 1.6.1-20.el9 CentOS-AppStream 63 k 2023-12-17T11:45:22.001 INFO:teuthology.orchestra.run.smithi159.stdout: zlib-devel x86_64 1.2.11-40.el9 CentOS-AppStream 44 k 2023-12-17T11:45:22.001 INFO:teuthology.orchestra.run.smithi159.stdout:Installing weak dependencies: 2023-12-17T11:45:22.001 INFO:teuthology.orchestra.run.smithi159.stdout: python3-jwt+crypto noarch 2.4.0-1.el9 epel 9.0 k 2023-12-17T11:45:22.001 INFO:teuthology.orchestra.run.smithi159.stdout: 2023-12-17T11:45:22.001 INFO:teuthology.orchestra.run.smithi159.stdout:Transaction Summary 2023-12-17T11:45:22.001 INFO:teuthology.orchestra.run.smithi159.stdout:=========================================================================================== 2023-12-17T11:45:22.002 INFO:teuthology.orchestra.run.smithi159.stdout:Install 134 Packages 2023-12-17T11:45:22.002 INFO:teuthology.orchestra.run.smithi159.stdout:Upgrade 15 Packages 2023-12-17T11:45:22.002 INFO:teuthology.orchestra.run.smithi159.stdout: 2023-12-17T11:45:22.002 INFO:teuthology.orchestra.run.smithi159.stdout:Total download size: 204 M 2023-12-17T11:45:22.002 INFO:teuthology.orchestra.run.smithi159.stdout:Downloading Packages: 2023-12-17T11:45:22.360 INFO:teuthology.orchestra.run.smithi040.stdout:(2/149): ceph-fuse-19.0.0-119.ga62fda73.el9.x86 974 kB/s | 859 kB 00:00 2023-12-17T11:45:22.539 INFO:teuthology.orchestra.run.smithi040.stdout:(3/149): ceph-immutable-object-cache-19.0.0-119 793 kB/s | 141 kB 00:00 2023-12-17T11:45:22.553 INFO:teuthology.orchestra.run.smithi159.stdout:(1/149): ceph-19.0.0-119.ga62fda73.el9.x86_64.r 19 kB/s | 6.5 kB 00:00 2023-12-17T11:45:22.660 INFO:teuthology.orchestra.run.smithi040.stdout:(4/149): ceph-base-19.0.0-119.ga62fda73.el9.x86 3.1 MB/s | 5.2 MB 00:01 2023-12-17T11:45:23.043 INFO:teuthology.orchestra.run.smithi040.stdout:(5/149): ceph-mgr-19.0.0-119.ga62fda73.el9.x86_ 3.8 MB/s | 1.5 MB 00:00 2023-12-17T11:45:23.552 INFO:teuthology.orchestra.run.smithi159.stdout:(2/149): ceph-fuse-19.0.0-119.ga62fda73.el9.x86 860 kB/s | 859 kB 00:00 2023-12-17T11:45:23.636 INFO:teuthology.orchestra.run.smithi040.stdout:(6/149): ceph-mds-19.0.0-119.ga62fda73.el9.x86_ 1.9 MB/s | 2.1 MB 00:01 2023-12-17T11:45:23.727 INFO:teuthology.orchestra.run.smithi159.stdout:(3/149): ceph-immutable-object-cache-19.0.0-119 813 kB/s | 141 kB 00:00 2023-12-17T11:45:23.911 INFO:teuthology.orchestra.run.smithi040.stdout:(7/149): ceph-mon-19.0.0-119.ga62fda73.el9.x86_ 5.1 MB/s | 4.4 MB 00:00 2023-12-17T11:45:25.294 INFO:teuthology.orchestra.run.smithi159.stdout:(4/149): ceph-base-19.0.0-119.ga62fda73.el9.x86 1.7 MB/s | 5.2 MB 00:03 2023-12-17T11:45:25.486 INFO:teuthology.orchestra.run.smithi040.stdout:(8/149): ceph-radosgw-19.0.0-119.ga62fda73.el9. 5.5 MB/s | 8.6 MB 00:01 2023-12-17T11:45:25.594 INFO:teuthology.orchestra.run.smithi040.stdout:(9/149): ceph-selinux-19.0.0-119.ga62fda73.el9. 226 kB/s | 24 kB 00:00 2023-12-17T11:45:25.669 INFO:teuthology.orchestra.run.smithi159.stdout:(5/149): ceph-mds-19.0.0-119.ga62fda73.el9.x86_ 1.1 MB/s | 2.1 MB 00:01 2023-12-17T11:45:26.036 INFO:teuthology.orchestra.run.smithi159.stdout:(6/149): ceph-mgr-19.0.0-119.ga62fda73.el9.x86_ 2.0 MB/s | 1.5 MB 00:00 2023-12-17T11:45:29.519 INFO:teuthology.orchestra.run.smithi159.stdout:(7/149): ceph-mon-19.0.0-119.ga62fda73.el9.x86_ 1.1 MB/s | 4.4 MB 00:03 2023-12-17T11:45:30.878 INFO:teuthology.orchestra.run.smithi040.stdout:(10/149): ceph-osd-19.0.0-119.ga62fda73.el9.x86 2.4 MB/s | 18 MB 00:07 2023-12-17T11:45:31.053 INFO:teuthology.orchestra.run.smithi040.stdout:(11/149): cephfs-mirror-19.0.0-119.ga62fda73.el 1.2 MB/s | 217 kB 00:00 2023-12-17T11:45:31.153 INFO:teuthology.orchestra.run.smithi040.stdout:(12/149): libcephfs-devel-19.0.0-119.ga62fda73. 314 kB/s | 31 kB 00:00 2023-12-17T11:45:31.553 INFO:teuthology.orchestra.run.smithi040.stdout:(13/149): libcephfs2-19.0.0-119.ga62fda73.el9.x 1.8 MB/s | 718 kB 00:00 2023-12-17T11:45:31.712 INFO:teuthology.orchestra.run.smithi040.stdout:(14/149): libcephsqlite-19.0.0-119.ga62fda73.el 1.0 MB/s | 163 kB 00:00 2023-12-17T11:45:31.812 INFO:teuthology.orchestra.run.smithi040.stdout:(15/149): librados-devel-19.0.0-119.ga62fda73.e 1.2 MB/s | 127 kB 00:00 2023-12-17T11:45:32.137 INFO:teuthology.orchestra.run.smithi040.stdout:(16/149): libradosstriper1-19.0.0-119.ga62fda73 1.4 MB/s | 476 kB 00:00 2023-12-17T11:45:34.244 INFO:teuthology.orchestra.run.smithi159.stdout:(8/149): ceph-radosgw-19.0.0-119.ga62fda73.el9. 1.8 MB/s | 8.6 MB 00:04 2023-12-17T11:45:34.335 INFO:teuthology.orchestra.run.smithi159.stdout:(9/149): ceph-selinux-19.0.0-119.ga62fda73.el9. 266 kB/s | 24 kB 00:00 2023-12-17T11:45:34.562 INFO:teuthology.orchestra.run.smithi040.stdout:(17/149): librgw2-19.0.0-119.ga62fda73.el9.x86_ 2.0 MB/s | 4.8 MB 00:02 2023-12-17T11:45:34.805 INFO:teuthology.orchestra.run.smithi040.stdout:(18/149): ceph-common-19.0.0-119.ga62fda73.el9. 1.4 MB/s | 19 MB 00:13 2023-12-17T11:45:34.830 INFO:teuthology.orchestra.run.smithi040.stdout:(19/149): python3-ceph-argparse-19.0.0-119.ga62 169 kB/s | 45 kB 00:00 2023-12-17T11:45:34.972 INFO:teuthology.orchestra.run.smithi040.stdout:(20/149): python3-ceph-common-19.0.0-119.ga62fd 778 kB/s | 129 kB 00:00 2023-12-17T11:45:34.998 INFO:teuthology.orchestra.run.smithi040.stdout:(21/149): python3-cephfs-19.0.0-119.ga62fda73.e 971 kB/s | 161 kB 00:00 2023-12-17T11:45:35.247 INFO:teuthology.orchestra.run.smithi040.stdout:(22/149): python3-rbd-19.0.0-119.ga62fda73.el9. 1.2 MB/s | 298 kB 00:00 2023-12-17T11:45:35.281 INFO:teuthology.orchestra.run.smithi040.stdout:(23/149): python3-rados-19.0.0-119.ga62fda73.el 1.0 MB/s | 321 kB 00:00 2023-12-17T11:45:35.331 INFO:teuthology.orchestra.run.smithi040.stdout:(24/149): python3-rgw-19.0.0-119.ga62fda73.el9. 1.2 MB/s | 99 kB 00:00 2023-12-17T11:45:35.381 INFO:teuthology.orchestra.run.smithi040.stdout:(25/149): rbd-fuse-19.0.0-119.ga62fda73.el9.x86 857 kB/s | 85 kB 00:00 2023-12-17T11:45:35.540 INFO:teuthology.orchestra.run.smithi040.stdout:(26/149): rbd-nbd-19.0.0-119.ga62fda73.el9.x86_ 1.1 MB/s | 170 kB 00:00 2023-12-17T11:45:35.552 INFO:teuthology.orchestra.run.smithi159.stdout:(10/149): ceph-common-19.0.0-119.ga62fda73.el9. 1.4 MB/s | 19 MB 00:13 2023-12-17T11:45:35.624 INFO:teuthology.orchestra.run.smithi040.stdout:(27/149): ceph-grafana-dashboards-19.0.0-119.ga 339 kB/s | 28 kB 00:00 2023-12-17T11:45:35.811 INFO:teuthology.orchestra.run.smithi159.stdout:(11/149): cephfs-mirror-19.0.0-119.ga62fda73.el 845 kB/s | 217 kB 00:00 2023-12-17T11:45:35.912 INFO:teuthology.orchestra.run.smithi159.stdout:(12/149): libcephfs-devel-19.0.0-119.ga62fda73. 313 kB/s | 31 kB 00:00 2023-12-17T11:45:36.074 INFO:teuthology.orchestra.run.smithi040.stdout:(28/149): ceph-test-19.0.0-119.ga62fda73.el9.x8 3.9 MB/s | 41 MB 00:10 2023-12-17T11:45:36.108 INFO:teuthology.orchestra.run.smithi040.stdout:(29/149): ceph-mgr-cephadm-19.0.0-119.ga62fda73 275 kB/s | 133 kB 00:00 2023-12-17T11:45:36.445 INFO:teuthology.orchestra.run.smithi159.stdout:(13/149): libcephfs2-19.0.0-119.ga62fda73.el9.x 1.3 MB/s | 718 kB 00:00 2023-12-17T11:45:36.687 INFO:teuthology.orchestra.run.smithi159.stdout:(14/149): ceph-osd-19.0.0-119.ga62fda73.el9.x86 1.7 MB/s | 18 MB 00:10 2023-12-17T11:45:36.712 INFO:teuthology.orchestra.run.smithi159.stdout:(15/149): libcephsqlite-19.0.0-119.ga62fda73.el 613 kB/s | 163 kB 00:00 2023-12-17T11:45:36.733 INFO:teuthology.orchestra.run.smithi040.stdout:(30/149): ceph-mgr-dashboard-19.0.0-119.ga62fda 2.7 MB/s | 1.8 MB 00:00 2023-12-17T11:45:36.850 INFO:teuthology.orchestra.run.smithi040.stdout:(31/149): ceph-mgr-modules-core-19.0.0-119.ga62 2.1 MB/s | 243 kB 00:00 2023-12-17T11:45:36.879 INFO:teuthology.orchestra.run.smithi159.stdout:(16/149): librados-devel-19.0.0-119.ga62fda73.e 665 kB/s | 127 kB 00:00 2023-12-17T11:45:36.950 INFO:teuthology.orchestra.run.smithi040.stdout:(32/149): ceph-mgr-rook-19.0.0-119.ga62fda73.el 506 kB/s | 50 kB 00:00 2023-12-17T11:45:37.034 INFO:teuthology.orchestra.run.smithi040.stdout:(33/149): rbd-mirror-19.0.0-119.ga62fda73.el9.x 1.8 MB/s | 3.0 MB 00:01 2023-12-17T11:45:37.059 INFO:teuthology.orchestra.run.smithi040.stdout:(34/149): ceph-prometheus-alerts-19.0.0-119.ga6 140 kB/s | 15 kB 00:00 2023-12-17T11:45:37.071 INFO:teuthology.orchestra.run.smithi159.stdout:(17/149): libradosstriper1-19.0.0-119.ga62fda73 1.3 MB/s | 476 kB 00:00 2023-12-17T11:45:37.188 INFO:teuthology.orchestra.run.smithi159.stdout:(18/149): python3-ceph-argparse-19.0.0-119.ga62 388 kB/s | 45 kB 00:00 2023-12-17T11:45:37.313 INFO:teuthology.orchestra.run.smithi159.stdout:(19/149): python3-ceph-common-19.0.0-119.ga62fd 1.0 MB/s | 129 kB 00:00 2023-12-17T11:45:37.351 INFO:teuthology.orchestra.run.smithi040.stdout:(35/149): cephadm-19.0.0-119.ga62fda73.el9.noar 2.7 MB/s | 803 kB 00:00 2023-12-17T11:45:37.435 INFO:teuthology.orchestra.run.smithi040.stdout:(36/149): ceph-volume-19.0.0-119.ga62fda73.el9. 657 kB/s | 262 kB 00:00 2023-12-17T11:45:37.468 INFO:teuthology.orchestra.run.smithi040.stdout:(37/149): cephfs-top-19.0.0-119.ga62fda73.el9.n 157 kB/s | 18 kB 00:00 2023-12-17T11:45:37.489 INFO:teuthology.orchestra.run.smithi159.stdout:(20/149): python3-cephfs-19.0.0-119.ga62fda73.e 927 kB/s | 161 kB 00:00 2023-12-17T11:45:37.702 INFO:teuthology.orchestra.run.smithi040.stdout:(38/149): automake-1.16.2-8.el9.noarch.rpm 2.4 MB/s | 662 kB 00:00 2023-12-17T11:45:37.731 INFO:teuthology.orchestra.run.smithi159.stdout:(21/149): python3-rados-19.0.0-119.ga62fda73.el 1.3 MB/s | 321 kB 00:00 2023-12-17T11:45:37.752 INFO:teuthology.orchestra.run.smithi040.stdout:(39/149): bison-3.7.4-5.el9.x86_64.rpm 4.2 MB/s | 920 kB 00:00 2023-12-17T11:45:37.777 INFO:teuthology.orchestra.run.smithi040.stdout:(40/149): boost-program-options-1.75.0-8.el9.x8 1.5 MB/s | 106 kB 00:00 2023-12-17T11:45:37.803 INFO:teuthology.orchestra.run.smithi040.stdout:(41/149): elfutils-libelf-devel-0.190-1.el9.x86 446 kB/s | 21 kB 00:00 2023-12-17T11:45:37.836 INFO:teuthology.orchestra.run.smithi040.stdout:(42/149): flex-2.6.4-9.el9.x86_64.rpm 5.2 MB/s | 307 kB 00:00 2023-12-17T11:45:37.862 INFO:teuthology.orchestra.run.smithi040.stdout:(43/149): flexiblas-3.0.4-8.el9.x86_64.rpm 577 kB/s | 32 kB 00:00 2023-12-17T11:45:37.956 INFO:teuthology.orchestra.run.smithi159.stdout:(22/149): python3-rbd-19.0.0-119.ga62fda73.el9. 1.3 MB/s | 298 kB 00:00 2023-12-17T11:45:37.962 INFO:teuthology.orchestra.run.smithi040.stdout:(44/149): flexiblas-netlib-3.0.4-8.el9.x86_64.r 24 MB/s | 3.0 MB 00:00 2023-12-17T11:45:37.978 INFO:teuthology.orchestra.run.smithi040.stdout:(45/149): flexiblas-openblas-openmp-3.0.4-8.el9 171 kB/s | 17 kB 00:00 2023-12-17T11:45:38.004 INFO:teuthology.orchestra.run.smithi040.stdout:(46/149): libaio-devel-0.3.111-13.el9.x86_64.rp 428 kB/s | 10 kB 00:00 2023-12-17T11:45:38.037 INFO:teuthology.orchestra.run.smithi040.stdout:(47/149): jq-1.6-16.el9.x86_64.rpm 3.2 MB/s | 186 kB 00:00 2023-12-17T11:45:38.056 INFO:teuthology.orchestra.run.smithi159.stdout:(23/149): python3-rgw-19.0.0-119.ga62fda73.el9. 1.0 MB/s | 99 kB 00:00 2023-12-17T11:45:38.062 INFO:teuthology.orchestra.run.smithi040.stdout:(48/149): libpmemobj-1.12.1-1.el9.x86_64.rpm 2.8 MB/s | 159 kB 00:00 2023-12-17T11:45:38.088 INFO:teuthology.orchestra.run.smithi040.stdout:(49/149): librabbitmq-0.11.0-7.el9.x86_64.rpm 922 kB/s | 44 kB 00:00 2023-12-17T11:45:38.130 INFO:teuthology.orchestra.run.smithi040.stdout:(50/149): librdkafka-1.6.1-102.el9.x86_64.rpm 9.8 MB/s | 661 kB 00:00 2023-12-17T11:45:38.156 INFO:teuthology.orchestra.run.smithi159.stdout:(24/149): rbd-fuse-19.0.0-119.ga62fda73.el9.x86 859 kB/s | 85 kB 00:00 2023-12-17T11:45:38.163 INFO:teuthology.orchestra.run.smithi040.stdout:(51/149): libtool-2.4.6-45.el9.x86_64.rpm 8.3 MB/s | 578 kB 00:00 2023-12-17T11:45:38.189 INFO:teuthology.orchestra.run.smithi040.stdout:(52/149): libuuid-devel-2.37.4-15.el9.x86_64.rp 455 kB/s | 24 kB 00:00 2023-12-17T11:45:38.214 INFO:teuthology.orchestra.run.smithi040.stdout:(53/149): libzstd-devel-1.5.1-2.el9.x86_64.rpm 947 kB/s | 46 kB 00:00 2023-12-17T11:45:38.248 INFO:teuthology.orchestra.run.smithi040.stdout:(54/149): lttng-ust-2.12.0-6.el9.x86_64.rpm 4.8 MB/s | 282 kB 00:00 2023-12-17T11:45:38.281 INFO:teuthology.orchestra.run.smithi040.stdout:(55/149): lua-5.4.4-4.el9.x86_64.rpm 2.9 MB/s | 187 kB 00:00 2023-12-17T11:45:38.315 INFO:teuthology.orchestra.run.smithi040.stdout:(56/149): oniguruma-6.9.6-1.el9.5.x86_64.rpm 3.3 MB/s | 217 kB 00:00 2023-12-17T11:45:38.340 INFO:teuthology.orchestra.run.smithi040.stdout:(57/149): openblas-0.3.21-2.el9.x86_64.rpm 614 kB/s | 34 kB 00:00 2023-12-17T11:45:38.491 INFO:teuthology.orchestra.run.smithi040.stdout:(58/149): openblas-openmp-0.3.21-2.el9.x86_64.r 27 MB/s | 4.7 MB 00:00 2023-12-17T11:45:38.541 INFO:teuthology.orchestra.run.smithi040.stdout:(59/149): postgresql-13.11-1.el9.x86_64.rpm 8.3 MB/s | 1.5 MB 00:00 2023-12-17T11:45:38.583 INFO:teuthology.orchestra.run.smithi040.stdout:(60/149): postgresql-contrib-13.11-1.el9.x86_64 8.8 MB/s | 811 kB 00:00 2023-12-17T11:45:38.608 INFO:teuthology.orchestra.run.smithi040.stdout:(61/149): postgresql-private-libs-13.11-1.el9.x 2.3 MB/s | 134 kB 00:00 2023-12-17T11:45:38.942 INFO:teuthology.orchestra.run.smithi040.stdout:(62/149): postgresql-server-13.11-1.el9.x86_64. 16 MB/s | 5.7 MB 00:00 2023-12-17T11:45:39.076 INFO:teuthology.orchestra.run.smithi040.stdout:(63/149): python3-babel-2.9.1-2.el9.noarch.rpm 13 MB/s | 5.8 MB 00:00 2023-12-17T11:45:39.101 INFO:teuthology.orchestra.run.smithi040.stdout:(64/149): python3-jinja2-2.11.3-4.el9.noarch.rp 1.6 MB/s | 228 kB 00:00 2023-12-17T11:45:39.134 INFO:teuthology.orchestra.run.smithi040.stdout:(65/149): python3-jsonpatch-1.21-16.el9.noarch. 765 kB/s | 24 kB 00:00 2023-12-17T11:45:39.160 INFO:teuthology.orchestra.run.smithi040.stdout:(66/149): python3-jsonpointer-2.0-4.el9.noarch. 318 kB/s | 18 kB 00:00 2023-12-17T11:45:39.202 INFO:teuthology.orchestra.run.smithi040.stdout:(67/149): python3-markupsafe-1.1.1-12.el9.x86_6 784 kB/s | 32 kB 00:00 2023-12-17T11:45:39.227 INFO:teuthology.orchestra.run.smithi040.stdout:(68/149): python3-mako-1.1.4-6.el9.noarch.rpm 2.1 MB/s | 144 kB 00:00 2023-12-17T11:45:39.307 INFO:teuthology.orchestra.run.smithi159.stdout:(25/149): librgw2-19.0.0-119.ga62fda73.el9.x86_ 2.0 MB/s | 4.8 MB 00:02 2023-12-17T11:45:39.386 INFO:teuthology.orchestra.run.smithi040.stdout:(69/149): python3-numpy-1.20.1-5.el9.x86_64.rpm 26 MB/s | 4.8 MB 00:00 2023-12-17T11:45:39.415 INFO:teuthology.orchestra.run.smithi159.stdout:(26/149): rbd-nbd-19.0.0-119.ga62fda73.el9.x86_ 1.5 MB/s | 170 kB 00:00 2023-12-17T11:45:39.419 INFO:teuthology.orchestra.run.smithi040.stdout:(70/149): python3-numpy-f2py-1.20.1-5.el9.x86_6 1.2 MB/s | 217 kB 00:00 2023-12-17T11:45:39.453 INFO:teuthology.orchestra.run.smithi040.stdout:(71/149): python3-oauthlib-3.1.1-5.el9.noarch.r 2.6 MB/s | 174 kB 00:00 2023-12-17T11:45:39.478 INFO:teuthology.orchestra.run.smithi040.stdout:(72/149): python3-prettytable-0.7.2-27.el9.noar 735 kB/s | 41 kB 00:00 2023-12-17T11:45:39.503 INFO:teuthology.orchestra.run.smithi040.stdout:(73/149): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.6 MB/s | 132 kB 00:00 2023-12-17T11:45:39.532 INFO:teuthology.orchestra.run.smithi159.stdout:(27/149): ceph-grafana-dashboards-19.0.0-119.ga 243 kB/s | 28 kB 00:00 2023-12-17T11:45:39.537 INFO:teuthology.orchestra.run.smithi040.stdout:(74/149): python3-pyasn1-modules-0.4.8-6.el9.no 3.6 MB/s | 211 kB 00:00 2023-12-17T11:45:39.571 INFO:teuthology.orchestra.run.smithi040.stdout:(75/149): python3-pytz-2021.1-5.el9.noarch.rpm 737 kB/s | 47 kB 00:00 2023-12-17T11:45:39.596 INFO:teuthology.orchestra.run.smithi040.stdout:(76/149): python3-requests-oauthlib-1.3.0-12.el 750 kB/s | 43 kB 00:00 2023-12-17T11:45:39.657 INFO:teuthology.orchestra.run.smithi159.stdout:(28/149): ceph-mgr-cephadm-19.0.0-119.ga62fda73 1.0 MB/s | 133 kB 00:00 2023-12-17T11:45:39.938 INFO:teuthology.orchestra.run.smithi040.stdout:(77/149): python3-scipy-1.6.2-8.el9.x86_64.rpm 43 MB/s | 16 MB 00:00 2023-12-17T11:45:39.963 INFO:teuthology.orchestra.run.smithi040.stdout:(78/149): python3-toml-0.10.2-6.el9.noarch.rpm 111 kB/s | 39 kB 00:00 2023-12-17T11:45:40.005 INFO:teuthology.orchestra.run.smithi040.stdout:(79/149): uuid-1.6.2-55.el9.x86_64.rpm 1.4 MB/s | 56 kB 00:00 2023-12-17T11:45:40.038 INFO:teuthology.orchestra.run.smithi040.stdout:(80/149): socat-1.7.4.1-5.el9.x86_64.rpm 4.0 MB/s | 300 kB 00:00 2023-12-17T11:45:40.063 INFO:teuthology.orchestra.run.smithi040.stdout:(81/149): xfsprogs-devel-5.19.0-4.el9.x86_64.rp 1.5 MB/s | 85 kB 00:00 2023-12-17T11:45:40.089 INFO:teuthology.orchestra.run.smithi040.stdout:(82/149): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.2 MB/s | 63 kB 00:00 2023-12-17T11:45:40.114 INFO:teuthology.orchestra.run.smithi040.stdout:(83/149): zlib-devel-1.2.11-40.el9.x86_64.rpm 898 kB/s | 44 kB 00:00 2023-12-17T11:45:40.116 INFO:teuthology.orchestra.run.smithi159.stdout:(29/149): rbd-mirror-19.0.0-119.ga62fda73.el9.x 1.5 MB/s | 3.0 MB 00:01 2023-12-17T11:45:40.139 INFO:teuthology.orchestra.run.smithi040.stdout:(84/149): fuse-2.9.9-15.el9.x86_64.rpm 1.6 MB/s | 79 kB 00:00 2023-12-17T11:45:40.182 INFO:teuthology.orchestra.run.smithi040.stdout:(85/149): libgfortran-11.4.1-2.3.el9.x86_64.rpm 12 MB/s | 803 kB 00:00 2023-12-17T11:45:40.215 INFO:teuthology.orchestra.run.smithi040.stdout:(86/149): libquadmath-11.4.1-2.3.el9.x86_64.rpm 2.9 MB/s | 195 kB 00:00 2023-12-17T11:45:40.243 INFO:teuthology.orchestra.run.smithi040.stdout:(87/149): python3-cffi-1.14.5-5.el9.x86_64.rpm 4.1 MB/s | 241 kB 00:00 2023-12-17T11:45:40.293 INFO:teuthology.orchestra.run.smithi040.stdout:(88/149): python3-cryptography-36.0.1-4.el9.x86 15 MB/s | 1.1 MB 00:00 2023-12-17T11:45:40.318 INFO:teuthology.orchestra.run.smithi040.stdout:(89/149): python3-ply-3.11-14.el9.noarch.rpm 1.6 MB/s | 103 kB 00:00 2023-12-17T11:45:40.344 INFO:teuthology.orchestra.run.smithi040.stdout:(90/149): python3-pycparser-2.20-6.el9.noarch.r 2.5 MB/s | 124 kB 00:00 2023-12-17T11:45:40.369 INFO:teuthology.orchestra.run.smithi040.stdout:(91/149): python3-requests-2.25.1-7.el9.noarch. 2.3 MB/s | 113 kB 00:00 2023-12-17T11:45:40.405 INFO:teuthology.orchestra.run.smithi040.stdout:(92/149): python3-urllib3-1.26.5-4.el9.noarch.r 3.2 MB/s | 187 kB 00:00 2023-12-17T11:45:40.569 INFO:teuthology.orchestra.run.smithi040.stdout:(93/149): python3-devel-3.9.17-2.el9.x86_64.rpm 1.4 MB/s | 245 kB 00:00 2023-12-17T11:45:40.625 INFO:teuthology.orchestra.run.smithi159.stdout:(30/149): ceph-mgr-dashboard-19.0.0-119.ga62fda 1.8 MB/s | 1.8 MB 00:00 2023-12-17T11:45:40.703 INFO:teuthology.orchestra.run.smithi040.stdout:(94/149): gperftools-libs-2.9.1-2.el9.x86_64.rp 2.3 MB/s | 309 kB 00:00 2023-12-17T11:45:40.803 INFO:teuthology.orchestra.run.smithi040.stdout:(95/149): openssl-devel-3.0.7-25.el9.x86_64.rpm 9.6 MB/s | 4.1 MB 00:00 2023-12-17T11:45:40.912 INFO:teuthology.orchestra.run.smithi040.stdout:(96/149): libarrow-doc-9.0.0-10.el9.noarch.rpm 242 kB/s | 26 kB 00:00 2023-12-17T11:45:40.992 INFO:teuthology.orchestra.run.smithi159.stdout:(31/149): ceph-mgr-modules-core-19.0.0-119.ga62 665 kB/s | 243 kB 00:00 2023-12-17T11:45:41.012 INFO:teuthology.orchestra.run.smithi040.stdout:(97/149): libarrow-9.0.0-10.el9.x86_64.rpm 14 MB/s | 4.4 MB 00:00 2023-12-17T11:45:41.038 INFO:teuthology.orchestra.run.smithi040.stdout:(98/149): liboath-2.6.7-2.el9.x86_64.rpm 391 kB/s | 49 kB 00:00 2023-12-17T11:45:41.054 INFO:teuthology.orchestra.run.smithi040.stdout:(99/149): libunwind-1.6.2-1.el9.x86_64.rpm 1.6 MB/s | 67 kB 00:00 2023-12-17T11:45:41.142 INFO:teuthology.orchestra.run.smithi159.stdout:(32/149): ceph-mgr-rook-19.0.0-119.ga62fda73.el 336 kB/s | 50 kB 00:00 2023-12-17T11:45:41.146 INFO:teuthology.orchestra.run.smithi040.stdout:(100/149): luarocks-3.9.2-1.el9.noarch.rpm 1.4 MB/s | 151 kB 00:00 2023-12-17T11:45:41.259 INFO:teuthology.orchestra.run.smithi159.stdout:(33/149): ceph-prometheus-alerts-19.0.0-119.ga6 130 kB/s | 15 kB 00:00 2023-12-17T11:45:41.272 INFO:teuthology.orchestra.run.smithi040.stdout:(101/149): ceph-mgr-diskprediction-local-19.0.0 1.4 MB/s | 7.4 MB 00:05 2023-12-17T11:45:41.355 INFO:teuthology.orchestra.run.smithi040.stdout:(102/149): python3-bcrypt-3.2.2-1.el9.x86_64.rp 528 kB/s | 43 kB 00:00 2023-12-17T11:45:41.422 INFO:teuthology.orchestra.run.smithi040.stdout:(103/149): parquet-libs-9.0.0-10.el9.x86_64.rpm 2.2 MB/s | 838 kB 00:00 2023-12-17T11:45:41.442 INFO:teuthology.orchestra.run.smithi159.stdout:(34/149): ceph-volume-19.0.0-119.ga62fda73.el9. 1.4 MB/s | 262 kB 00:00 2023-12-17T11:45:41.556 INFO:teuthology.orchestra.run.smithi040.stdout:(104/149): python3-cachetools-4.2.4-1.el9.noarc 161 kB/s | 32 kB 00:00 2023-12-17T11:45:41.589 INFO:teuthology.orchestra.run.smithi040.stdout:(105/149): python3-asyncssh-2.13.2-3.el9.noarch 1.2 MB/s | 548 kB 00:00 2023-12-17T11:45:41.623 INFO:teuthology.orchestra.run.smithi040.stdout:(106/149): python3-certifi-2021.10.8-2.el9.noar 75 kB/s | 15 kB 00:00 2023-12-17T11:45:41.682 INFO:teuthology.orchestra.run.smithi040.stdout:(107/149): python3-cherrypy-18.6.1-2.el9.noarch 3.8 MB/s | 358 kB 00:00 2023-12-17T11:45:41.748 INFO:teuthology.orchestra.run.smithi040.stdout:(108/149): python3-cheroot-8.6.0-4.el9.noarch.r 896 kB/s | 172 kB 00:00 2023-12-17T11:45:41.782 INFO:teuthology.orchestra.run.smithi040.stdout:(109/149): python3-jaraco-classes-3.2.1-5.el9.n 544 kB/s | 18 kB 00:00 2023-12-17T11:45:41.824 INFO:teuthology.orchestra.run.smithi040.stdout:(110/149): python3-jaraco-collections-3.0.0-8.e 564 kB/s | 23 kB 00:00 2023-12-17T11:45:41.841 INFO:teuthology.orchestra.run.smithi040.stdout:(111/149): python3-google-auth-2.23.4-1.el9.noa 910 kB/s | 197 kB 00:00 2023-12-17T11:45:41.866 INFO:teuthology.orchestra.run.smithi040.stdout:(112/149): python3-jaraco-8.2.1-3.el9.noarch.rp 58 kB/s | 11 kB 00:00 2023-12-17T11:45:41.892 INFO:teuthology.orchestra.run.smithi040.stdout:(113/149): python3-jaraco-functools-3.5.0-2.el9 293 kB/s | 19 kB 00:00 2023-12-17T11:45:41.917 INFO:teuthology.orchestra.run.smithi040.stdout:(114/149): python3-jaraco-text-3.2.0-6.el9.noar 264 kB/s | 20 kB 00:00 2023-12-17T11:45:41.926 INFO:teuthology.orchestra.run.smithi159.stdout:(35/149): cephadm-19.0.0-119.ga62fda73.el9.noar 1.6 MB/s | 803 kB 00:00 2023-12-17T11:45:41.942 INFO:teuthology.orchestra.run.smithi040.stdout:(115/149): python3-jwt+crypto-2.4.0-1.el9.noarc 121 kB/s | 9.0 kB 00:00 2023-12-17T11:45:41.967 INFO:teuthology.orchestra.run.smithi040.stdout:(116/149): python3-jwt-2.4.0-1.el9.noarch.rpm 549 kB/s | 41 kB 00:00 2023-12-17T11:45:42.009 INFO:teuthology.orchestra.run.smithi040.stdout:(117/149): python3-logutils-0.3.5-21.el9.noarch 706 kB/s | 46 kB 00:00 2023-12-17T11:45:42.051 INFO:teuthology.orchestra.run.smithi159.stdout:(36/149): cephfs-top-19.0.0-119.ga62fda73.el9.n 147 kB/s | 18 kB 00:00 2023-12-17T11:45:42.135 INFO:teuthology.orchestra.run.smithi040.stdout:(118/149): python3-natsort-7.1.1-5.el9.noarch.r 463 kB/s | 58 kB 00:00 2023-12-17T11:45:42.243 INFO:teuthology.orchestra.run.smithi159.stdout:(37/149): automake-1.16.2-8.el9.noarch.rpm 3.4 MB/s | 662 kB 00:00 2023-12-17T11:45:42.302 INFO:teuthology.orchestra.run.smithi159.stdout:(38/149): bison-3.7.4-5.el9.x86_64.rpm 16 MB/s | 920 kB 00:00 2023-12-17T11:45:42.318 INFO:teuthology.orchestra.run.smithi040.stdout:(119/149): python3-kubernetes-26.1.0-2.el9.noar 2.7 MB/s | 1.0 MB 00:00 2023-12-17T11:45:42.344 INFO:teuthology.orchestra.run.smithi159.stdout:(39/149): boost-program-options-1.75.0-8.el9.x8 2.5 MB/s | 106 kB 00:00 2023-12-17T11:45:42.352 INFO:teuthology.orchestra.run.smithi040.stdout:(120/149): python3-pecan-1.4.2-3.el9.noarch.rpm 1.2 MB/s | 272 kB 00:00 2023-12-17T11:45:42.394 INFO:teuthology.orchestra.run.smithi159.stdout:(40/149): elfutils-libelf-devel-0.190-1.el9.x86 435 kB/s | 21 kB 00:00 2023-12-17T11:45:42.436 INFO:teuthology.orchestra.run.smithi159.stdout:(41/149): flex-2.6.4-9.el9.x86_64.rpm 7.3 MB/s | 307 kB 00:00 2023-12-17T11:45:42.477 INFO:teuthology.orchestra.run.smithi040.stdout:(121/149): python3-more-itertools-8.12.0-2.el9. 155 kB/s | 79 kB 00:00 2023-12-17T11:45:42.502 INFO:teuthology.orchestra.run.smithi040.stdout:(122/149): python3-portend-3.1.0-2.el9.noarch.r 90 kB/s | 16 kB 00:00 2023-12-17T11:45:42.503 INFO:teuthology.orchestra.run.smithi159.stdout:(42/149): flexiblas-3.0.4-8.el9.x86_64.rpm 478 kB/s | 32 kB 00:00 2023-12-17T11:45:42.528 INFO:teuthology.orchestra.run.smithi040.stdout:(123/149): python3-repoze-lru-0.7-16.el9.noarch 621 kB/s | 31 kB 00:00 2023-12-17T11:45:42.570 INFO:teuthology.orchestra.run.smithi040.stdout:(124/149): python3-routes-2.5.1-5.el9.noarch.rp 2.8 MB/s | 188 kB 00:00 2023-12-17T11:45:42.620 INFO:teuthology.orchestra.run.smithi159.stdout:(43/149): flexiblas-netlib-3.0.4-8.el9.x86_64.r 26 MB/s | 3.0 MB 00:00 2023-12-17T11:45:42.670 INFO:teuthology.orchestra.run.smithi159.stdout:(44/149): flexiblas-openblas-openmp-3.0.4-8.el9 348 kB/s | 17 kB 00:00 2023-12-17T11:45:42.714 INFO:teuthology.orchestra.run.smithi159.stdout:(45/149): jq-1.6-16.el9.x86_64.rpm 4.2 MB/s | 186 kB 00:00 2023-12-17T11:45:42.782 INFO:teuthology.orchestra.run.smithi159.stdout:(46/149): libaio-devel-0.3.111-13.el9.x86_64.rp 153 kB/s | 10 kB 00:00 2023-12-17T11:45:42.823 INFO:teuthology.orchestra.run.smithi159.stdout:(47/149): libpmemobj-1.12.1-1.el9.x86_64.rpm 3.8 MB/s | 159 kB 00:00 2023-12-17T11:45:42.882 INFO:teuthology.orchestra.run.smithi159.stdout:(48/149): librabbitmq-0.11.0-7.el9.x86_64.rpm 764 kB/s | 44 kB 00:00 2023-12-17T11:45:42.940 INFO:teuthology.orchestra.run.smithi159.stdout:(49/149): librdkafka-1.6.1-102.el9.x86_64.rpm 11 MB/s | 661 kB 00:00 2023-12-17T11:45:42.978 INFO:teuthology.orchestra.run.smithi040.stdout:(125/149): python3-rsa-4.9-2.el9.noarch.rpm 131 kB/s | 59 kB 00:00 2023-12-17T11:45:42.999 INFO:teuthology.orchestra.run.smithi159.stdout:(50/149): libtool-2.4.6-45.el9.x86_64.rpm 9.7 MB/s | 578 kB 00:00 2023-12-17T11:45:43.003 INFO:teuthology.orchestra.run.smithi040.stdout:(126/149): python3-tempora-5.0.0-2.el9.noarch.r 83 kB/s | 36 kB 00:00 2023-12-17T11:45:43.029 INFO:teuthology.orchestra.run.smithi040.stdout:(127/149): python3-typing-extensions-4.4.0-2.el 1.0 MB/s | 51 kB 00:00 2023-12-17T11:45:43.050 INFO:teuthology.orchestra.run.smithi159.stdout:(51/149): libuuid-devel-2.37.4-15.el9.x86_64.rp 498 kB/s | 24 kB 00:00 2023-12-17T11:45:43.117 INFO:teuthology.orchestra.run.smithi159.stdout:(52/149): libzstd-devel-1.5.1-2.el9.x86_64.rpm 705 kB/s | 46 kB 00:00 2023-12-17T11:45:43.171 INFO:teuthology.orchestra.run.smithi040.stdout:(128/149): python3-websocket-client-1.2.3-2.el9 636 kB/s | 90 kB 00:00 2023-12-17T11:45:43.192 INFO:teuthology.orchestra.run.smithi159.stdout:(53/149): lttng-ust-2.12.0-6.el9.x86_64.rpm 3.7 MB/s | 282 kB 00:00 2023-12-17T11:45:43.204 INFO:teuthology.orchestra.run.smithi040.stdout:(129/149): python3-webob-1.8.7-6.el9.noarch.rpm 1.1 MB/s | 230 kB 00:00 2023-12-17T11:45:43.234 INFO:teuthology.orchestra.run.smithi159.stdout:(54/149): lua-5.4.4-4.el9.x86_64.rpm 4.5 MB/s | 187 kB 00:00 2023-12-17T11:45:43.238 INFO:teuthology.orchestra.run.smithi040.stdout:(130/149): python3-werkzeug-2.0.3-3.el9.1.noarc 6.3 MB/s | 427 kB 00:00 2023-12-17T11:45:43.277 INFO:teuthology.orchestra.run.smithi159.stdout:(55/149): oniguruma-6.9.6-1.el9.5.x86_64.rpm 5.2 MB/s | 217 kB 00:00 2023-12-17T11:45:43.288 INFO:teuthology.orchestra.run.smithi040.stdout:(131/149): python3-pyOpenSSL-21.0.0-1.el9.noarc 96 kB/s | 90 kB 00:00 2023-12-17T11:45:43.313 INFO:teuthology.orchestra.run.smithi040.stdout:(132/149): python3-zc-lockfile-2.0-10.el9.noarc 185 kB/s | 20 kB 00:00 2023-12-17T11:45:43.326 INFO:teuthology.orchestra.run.smithi159.stdout:(56/149): openblas-0.3.21-2.el9.x86_64.rpm 695 kB/s | 34 kB 00:00 2023-12-17T11:45:43.372 INFO:teuthology.orchestra.run.smithi040.stdout:(133/149): re2-20211101-3.el9.x86_64.rpm 1.4 MB/s | 192 kB 00:00 2023-12-17T11:45:43.477 INFO:teuthology.orchestra.run.smithi159.stdout:(57/149): openblas-openmp-0.3.21-2.el9.x86_64.r 32 MB/s | 4.7 MB 00:00 2023-12-17T11:45:43.522 INFO:teuthology.orchestra.run.smithi040.stdout:(134/149): thrift-0.15.0-2.el9.x86_64.rpm 6.8 MB/s | 1.6 MB 00:00 2023-12-17T11:45:43.552 INFO:teuthology.orchestra.run.smithi159.stdout:(58/149): postgresql-13.11-1.el9.x86_64.rpm 21 MB/s | 1.5 MB 00:00 2023-12-17T11:45:43.556 INFO:teuthology.orchestra.run.smithi040.stdout:(135/149): libacl-devel-2.3.1-4.el9.x86_64.rpm 2.0 MB/s | 68 kB 00:00 2023-12-17T11:45:43.598 INFO:teuthology.orchestra.run.smithi040.stdout:(136/149): acl-2.3.1-4.el9.x86_64.rpm 1.6 MB/s | 69 kB 00:00 2023-12-17T11:45:43.640 INFO:teuthology.orchestra.run.smithi040.stdout:(137/149): elfutils-debuginfod-client-0.190-1.e 893 kB/s | 36 kB 00:00 2023-12-17T11:45:43.690 INFO:teuthology.orchestra.run.smithi040.stdout:(138/149): elfutils-libelf-0.190-1.el9.x86_64.r 3.8 MB/s | 192 kB 00:00 2023-12-17T11:45:43.749 INFO:teuthology.orchestra.run.smithi040.stdout:(139/149): elfutils-libs-0.190-1.el9.x86_64.rpm 4.3 MB/s | 255 kB 00:00 2023-12-17T11:45:43.782 INFO:teuthology.orchestra.run.smithi040.stdout:(140/149): libacl-2.3.1-4.el9.x86_64.rpm 672 kB/s | 22 kB 00:00 2023-12-17T11:45:43.785 INFO:teuthology.orchestra.run.smithi159.stdout:(59/149): postgresql-contrib-13.11-1.el9.x86_64 3.4 MB/s | 811 kB 00:00 2023-12-17T11:45:43.828 INFO:teuthology.orchestra.run.smithi159.stdout:(60/149): postgresql-private-libs-13.11-1.el9.x 3.2 MB/s | 134 kB 00:00 2023-12-17T11:45:43.866 INFO:teuthology.orchestra.run.smithi040.stdout:(141/149): xfsdump-3.1.12-4.el9.x86_64.rpm 3.8 MB/s | 321 kB 00:00 2023-12-17T11:45:43.995 INFO:teuthology.orchestra.run.smithi159.stdout:(61/149): postgresql-server-13.11-1.el9.x86_64. 34 MB/s | 5.7 MB 00:00 2023-12-17T11:45:44.125 INFO:teuthology.orchestra.run.smithi040.stdout:(142/149): NetworkManager-1.45.7-1.el9.x86_64.r 8.8 MB/s | 2.3 MB 00:00 2023-12-17T11:45:44.128 INFO:teuthology.orchestra.run.smithi159.stdout:(62/149): ceph-mgr-diskprediction-local-19.0.0- 1.8 MB/s | 7.4 MB 00:04 2023-12-17T11:45:44.225 INFO:teuthology.orchestra.run.smithi040.stdout:(143/149): NetworkManager-libnm-1.45.7-1.el9.x8 18 MB/s | 1.8 MB 00:00 2023-12-17T11:45:44.270 INFO:teuthology.orchestra.run.smithi159.stdout:(63/149): python3-babel-2.9.1-2.el9.noarch.rpm 21 MB/s | 5.8 MB 00:00 2023-12-17T11:45:44.275 INFO:teuthology.orchestra.run.smithi040.stdout:(144/149): NetworkManager-team-1.45.7-1.el9.x86 884 kB/s | 43 kB 00:00 2023-12-17T11:45:44.296 INFO:teuthology.orchestra.run.smithi159.stdout:(64/149): python3-jinja2-2.11.3-4.el9.noarch.rp 1.5 MB/s | 228 kB 00:00 2023-12-17T11:45:44.334 INFO:teuthology.orchestra.run.smithi040.stdout:(145/149): NetworkManager-tui-1.45.7-1.el9.x86_ 4.2 MB/s | 246 kB 00:00 2023-12-17T11:45:44.346 INFO:teuthology.orchestra.run.smithi159.stdout:(65/149): python3-jsonpatch-1.21-16.el9.noarch. 500 kB/s | 24 kB 00:00 2023-12-17T11:45:44.388 INFO:teuthology.orchestra.run.smithi159.stdout:(66/149): python3-jsonpointer-2.0-4.el9.noarch. 200 kB/s | 18 kB 00:00 2023-12-17T11:45:44.446 INFO:teuthology.orchestra.run.smithi159.stdout:(67/149): python3-markupsafe-1.1.1-12.el9.x86_6 554 kB/s | 32 kB 00:00 2023-12-17T11:45:44.451 INFO:teuthology.orchestra.run.smithi040.stdout:(146/149): openssl-3.0.7-25.el9.x86_64.rpm 10 MB/s | 1.2 MB 00:00 2023-12-17T11:45:44.472 INFO:teuthology.orchestra.run.smithi159.stdout:(68/149): python3-mako-1.1.4-6.el9.noarch.rpm 1.7 MB/s | 144 kB 00:00 2023-12-17T11:45:44.568 INFO:teuthology.orchestra.run.smithi040.stdout:(147/149): openssl-libs-3.0.7-25.el9.x86_64.rpm 19 MB/s | 2.2 MB 00:00 2023-12-17T11:45:44.622 INFO:teuthology.orchestra.run.smithi159.stdout:(69/149): python3-numpy-1.20.1-5.el9.x86_64.rpm 28 MB/s | 4.8 MB 00:00 2023-12-17T11:45:44.643 INFO:teuthology.orchestra.run.smithi040.stdout:(148/149): librbd1-19.0.0-119.ga62fda73.el9.x86 2.4 MB/s | 3.0 MB 00:01 2023-12-17T11:45:44.647 INFO:teuthology.orchestra.run.smithi159.stdout:(70/149): python3-numpy-f2py-1.20.1-5.el9.x86_6 1.4 MB/s | 217 kB 00:00 2023-12-17T11:45:44.689 INFO:teuthology.orchestra.run.smithi159.stdout:(71/149): python3-oauthlib-3.1.1-5.el9.noarch.r 4.2 MB/s | 174 kB 00:00 2023-12-17T11:45:44.731 INFO:teuthology.orchestra.run.smithi159.stdout:(72/149): python3-prettytable-0.7.2-27.el9.noar 500 kB/s | 41 kB 00:00 2023-12-17T11:45:44.773 INFO:teuthology.orchestra.run.smithi159.stdout:(73/149): python3-pyasn1-0.4.8-6.el9.noarch.rpm 3.2 MB/s | 132 kB 00:00 2023-12-17T11:45:44.798 INFO:teuthology.orchestra.run.smithi159.stdout:(74/149): python3-pyasn1-modules-0.4.8-6.el9.no 3.1 MB/s | 211 kB 00:00 2023-12-17T11:45:44.849 INFO:teuthology.orchestra.run.smithi159.stdout:(75/149): python3-requests-oauthlib-1.3.0-12.el 879 kB/s | 43 kB 00:00 2023-12-17T11:45:44.891 INFO:teuthology.orchestra.run.smithi159.stdout:(76/149): python3-pytz-2021.1-5.el9.noarch.rpm 520 kB/s | 47 kB 00:00 2023-12-17T11:45:45.232 INFO:teuthology.orchestra.run.smithi159.stdout:(77/149): python3-scipy-1.6.2-8.el9.x86_64.rpm 41 MB/s | 16 MB 00:00 2023-12-17T11:45:45.283 INFO:teuthology.orchestra.run.smithi159.stdout:(78/149): python3-toml-0.10.2-6.el9.noarch.rpm 104 kB/s | 39 kB 00:00 2023-12-17T11:45:45.316 INFO:teuthology.orchestra.run.smithi159.stdout:(79/149): socat-1.7.4.1-5.el9.x86_64.rpm 3.5 MB/s | 300 kB 00:00 2023-12-17T11:45:45.326 INFO:teuthology.orchestra.run.smithi040.stdout:(149/149): librados2-19.0.0-119.ga62fda73.el9.x 1.6 MB/s | 3.3 MB 00:02 2023-12-17T11:45:45.336 INFO:teuthology.orchestra.run.smithi040.stdout:-------------------------------------------------------------------------------- 2023-12-17T11:45:45.337 INFO:teuthology.orchestra.run.smithi040.stdout:Total 8.2 MB/s | 204 MB 00:24 2023-12-17T11:45:45.367 INFO:teuthology.orchestra.run.smithi159.stdout:(80/149): uuid-1.6.2-55.el9.x86_64.rpm 701 kB/s | 56 kB 00:00 2023-12-17T11:45:45.392 INFO:teuthology.orchestra.run.smithi159.stdout:(81/149): xfsprogs-devel-5.19.0-4.el9.x86_64.rp 1.1 MB/s | 85 kB 00:00 2023-12-17T11:45:45.442 INFO:teuthology.orchestra.run.smithi159.stdout:(82/149): xmlstarlet-1.6.1-20.el9.x86_64.rpm 850 kB/s | 63 kB 00:00 2023-12-17T11:45:45.493 INFO:teuthology.orchestra.run.smithi159.stdout:(83/149): zlib-devel-1.2.11-40.el9.x86_64.rpm 445 kB/s | 44 kB 00:00 2023-12-17T11:45:45.526 INFO:teuthology.orchestra.run.smithi159.stdout:(84/149): fuse-2.9.9-15.el9.x86_64.rpm 955 kB/s | 79 kB 00:00 2023-12-17T11:45:45.568 INFO:teuthology.orchestra.run.smithi159.stdout:(85/149): libgfortran-11.4.1-2.3.el9.x86_64.rpm 11 MB/s | 803 kB 00:00 2023-12-17T11:45:45.602 INFO:teuthology.orchestra.run.smithi159.stdout:(86/149): libquadmath-11.4.1-2.3.el9.x86_64.rpm 2.8 MB/s | 195 kB 00:00 2023-12-17T11:45:45.636 INFO:teuthology.orchestra.run.smithi159.stdout:(87/149): python3-cffi-1.14.5-5.el9.x86_64.rpm 3.7 MB/s | 241 kB 00:00 2023-12-17T11:45:45.694 INFO:teuthology.orchestra.run.smithi159.stdout:(88/149): python3-cryptography-36.0.1-4.el9.x86 13 MB/s | 1.1 MB 00:00 2023-12-17T11:45:45.720 INFO:teuthology.orchestra.run.smithi159.stdout:(89/149): python3-ply-3.11-14.el9.noarch.rpm 1.4 MB/s | 103 kB 00:00 2023-12-17T11:45:45.753 INFO:teuthology.orchestra.run.smithi159.stdout:(90/149): python3-pycparser-2.20-6.el9.noarch.r 2.1 MB/s | 124 kB 00:00 2023-12-17T11:45:45.775 INFO:teuthology.orchestra.run.smithi040.stdout:Running transaction check 2023-12-17T11:45:45.778 INFO:teuthology.orchestra.run.smithi159.stdout:(91/149): python3-requests-2.25.1-7.el9.noarch. 1.9 MB/s | 113 kB 00:00 2023-12-17T11:45:45.812 INFO:teuthology.orchestra.run.smithi159.stdout:(92/149): python3-urllib3-1.26.5-4.el9.noarch.r 3.2 MB/s | 187 kB 00:00 2023-12-17T11:45:46.074 INFO:teuthology.orchestra.run.smithi040.stdout:Transaction check succeeded. 2023-12-17T11:45:46.074 INFO:teuthology.orchestra.run.smithi040.stdout:Running transaction test 2023-12-17T11:45:46.663 INFO:teuthology.orchestra.run.smithi159.stdout:(93/149): python3-devel-3.9.17-2.el9.x86_64.rpm 289 kB/s | 245 kB 00:00 2023-12-17T11:45:47.104 INFO:teuthology.orchestra.run.smithi159.stdout:(94/149): openssl-devel-3.0.7-25.el9.x86_64.rpm 3.1 MB/s | 4.1 MB 00:01 2023-12-17T11:45:47.271 INFO:teuthology.orchestra.run.smithi159.stdout:(95/149): gperftools-libs-2.9.1-2.el9.x86_64.rp 510 kB/s | 309 kB 00:00 2023-12-17T11:45:47.380 INFO:teuthology.orchestra.run.smithi159.stdout:(96/149): libarrow-doc-9.0.0-10.el9.noarch.rpm 241 kB/s | 26 kB 00:00 2023-12-17T11:45:47.497 INFO:teuthology.orchestra.run.smithi159.stdout:(97/149): liboath-2.6.7-2.el9.x86_64.rpm 418 kB/s | 49 kB 00:00 2023-12-17T11:45:47.597 INFO:teuthology.orchestra.run.smithi159.stdout:(98/149): libunwind-1.6.2-1.el9.x86_64.rpm 679 kB/s | 67 kB 00:00 2023-12-17T11:45:47.748 INFO:teuthology.orchestra.run.smithi159.stdout:(99/149): luarocks-3.9.2-1.el9.noarch.rpm 1.0 MB/s | 151 kB 00:00 2023-12-17T11:45:47.931 INFO:teuthology.orchestra.run.smithi159.stdout:(100/149): libarrow-9.0.0-10.el9.x86_64.rpm 5.4 MB/s | 4.4 MB 00:00 2023-12-17T11:45:48.031 INFO:teuthology.orchestra.run.smithi159.stdout:(101/149): parquet-libs-9.0.0-10.el9.x86_64.rpm 2.9 MB/s | 838 kB 00:00 2023-12-17T11:45:48.073 INFO:teuthology.orchestra.run.smithi159.stdout:(102/149): python3-asyncssh-2.13.2-3.el9.noarch 3.8 MB/s | 548 kB 00:00 2023-12-17T11:45:48.124 INFO:teuthology.orchestra.run.smithi159.stdout:(103/149): python3-bcrypt-3.2.2-1.el9.x86_64.rp 476 kB/s | 43 kB 00:00 2023-12-17T11:45:48.149 INFO:teuthology.orchestra.run.smithi159.stdout:(104/149): python3-cachetools-4.2.4-1.el9.noarc 431 kB/s | 32 kB 00:00 2023-12-17T11:45:48.208 INFO:teuthology.orchestra.run.smithi159.stdout:(105/149): python3-certifi-2021.10.8-2.el9.noar 180 kB/s | 15 kB 00:00 2023-12-17T11:45:48.241 INFO:teuthology.orchestra.run.smithi159.stdout:(106/149): python3-cheroot-8.6.0-4.el9.noarch.r 1.8 MB/s | 172 kB 00:00 2023-12-17T11:45:48.308 INFO:teuthology.orchestra.run.smithi159.stdout:(107/149): python3-cherrypy-18.6.1-2.el9.noarch 3.5 MB/s | 358 kB 00:00 2023-12-17T11:45:48.327 INFO:teuthology.orchestra.run.smithi040.stdout:Transaction test succeeded. 2023-12-17T11:45:48.328 INFO:teuthology.orchestra.run.smithi040.stdout:Running transaction 2023-12-17T11:45:48.342 INFO:teuthology.orchestra.run.smithi159.stdout:(108/149): python3-google-auth-2.23.4-1.el9.noa 1.9 MB/s | 197 kB 00:00 2023-12-17T11:45:48.393 INFO:teuthology.orchestra.run.smithi159.stdout:(109/149): python3-jaraco-8.2.1-3.el9.noarch.rp 129 kB/s | 11 kB 00:00 2023-12-17T11:45:48.418 INFO:teuthology.orchestra.run.smithi159.stdout:(110/149): python3-jaraco-classes-3.2.1-5.el9.n 237 kB/s | 18 kB 00:00 2023-12-17T11:45:48.468 INFO:teuthology.orchestra.run.smithi159.stdout:(111/149): python3-jaraco-collections-3.0.0-8.e 311 kB/s | 23 kB 00:00 2023-12-17T11:45:48.493 INFO:teuthology.orchestra.run.smithi159.stdout:(112/149): python3-jaraco-functools-3.5.0-2.el9 261 kB/s | 19 kB 00:00 2023-12-17T11:45:48.544 INFO:teuthology.orchestra.run.smithi159.stdout:(113/149): python3-jaraco-text-3.2.0-6.el9.noar 264 kB/s | 20 kB 00:00 2023-12-17T11:45:48.569 INFO:teuthology.orchestra.run.smithi159.stdout:(114/149): python3-jwt+crypto-2.4.0-1.el9.noarc 121 kB/s | 9.0 kB 00:00 2023-12-17T11:45:48.619 INFO:teuthology.orchestra.run.smithi159.stdout:(115/149): python3-jwt-2.4.0-1.el9.noarch.rpm 548 kB/s | 41 kB 00:00 2023-12-17T11:45:48.686 INFO:teuthology.orchestra.run.smithi159.stdout:(116/149): python3-kubernetes-26.1.0-2.el9.noar 8.8 MB/s | 1.0 MB 00:00 2023-12-17T11:45:48.711 INFO:teuthology.orchestra.run.smithi159.stdout:(117/149): python3-logutils-0.3.5-21.el9.noarch 508 kB/s | 46 kB 00:00 2023-12-17T11:45:48.878 INFO:teuthology.orchestra.run.smithi159.stdout:(118/149): python3-more-itertools-8.12.0-2.el9. 412 kB/s | 79 kB 00:00 2023-12-17T11:45:48.903 INFO:teuthology.orchestra.run.smithi159.stdout:(119/149): python3-natsort-7.1.1-5.el9.noarch.r 301 kB/s | 58 kB 00:00 2023-12-17T11:45:48.979 INFO:teuthology.orchestra.run.smithi159.stdout:(120/149): python3-pecan-1.4.2-3.el9.noarch.rpm 2.7 MB/s | 272 kB 00:00 2023-12-17T11:45:49.004 INFO:teuthology.orchestra.run.smithi159.stdout:(121/149): python3-portend-3.1.0-2.el9.noarch.r 164 kB/s | 16 kB 00:00 2023-12-17T11:45:49.055 INFO:teuthology.orchestra.run.smithi159.stdout:(122/149): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.2 MB/s | 90 kB 00:00 2023-12-17T11:45:49.097 INFO:teuthology.orchestra.run.smithi159.stdout:(123/149): python3-repoze-lru-0.7-16.el9.noarch 337 kB/s | 31 kB 00:00 2023-12-17T11:45:49.147 INFO:teuthology.orchestra.run.smithi159.stdout:(124/149): python3-routes-2.5.1-5.el9.noarch.rp 2.0 MB/s | 188 kB 00:00 2023-12-17T11:45:49.181 INFO:teuthology.orchestra.run.smithi159.stdout:(125/149): python3-rsa-4.9-2.el9.noarch.rpm 711 kB/s | 59 kB 00:00 2023-12-17T11:45:49.239 INFO:teuthology.orchestra.run.smithi159.stdout:(126/149): python3-tempora-5.0.0-2.el9.noarch.r 391 kB/s | 36 kB 00:00 2023-12-17T11:45:49.264 INFO:teuthology.orchestra.run.smithi159.stdout:(127/149): python3-typing-extensions-4.4.0-2.el 615 kB/s | 51 kB 00:00 2023-12-17T11:45:49.332 INFO:teuthology.orchestra.run.smithi159.stdout:(128/149): python3-webob-1.8.7-6.el9.noarch.rpm 2.5 MB/s | 230 kB 00:00 2023-12-17T11:45:49.357 INFO:teuthology.orchestra.run.smithi159.stdout:(129/149): python3-websocket-client-1.2.3-2.el9 978 kB/s | 90 kB 00:00 2023-12-17T11:45:49.790 INFO:teuthology.orchestra.run.smithi159.stdout:(130/149): ceph-test-19.0.0-119.ga62fda73.el9.x 2.7 MB/s | 41 MB 00:15 2023-12-17T11:45:49.816 INFO:teuthology.orchestra.run.smithi159.stdout:(131/149): python3-zc-lockfile-2.0-10.el9.noarc 44 kB/s | 20 kB 00:00 2023-12-17T11:45:49.849 INFO:teuthology.orchestra.run.smithi159.stdout:(132/149): python3-werkzeug-2.0.3-3.el9.1.noarc 827 kB/s | 427 kB 00:00 2023-12-17T11:45:50.033 INFO:teuthology.orchestra.run.smithi159.stdout:(133/149): thrift-0.15.0-2.el9.x86_64.rpm 7.3 MB/s | 1.6 MB 00:00 2023-12-17T11:45:50.250 INFO:teuthology.orchestra.run.smithi159.stdout:(134/149): re2-20211101-3.el9.x86_64.rpm 418 kB/s | 192 kB 00:00 2023-12-17T11:45:50.292 INFO:teuthology.orchestra.run.smithi159.stdout:(135/149): libacl-devel-2.3.1-4.el9.x86_64.rpm 1.6 MB/s | 68 kB 00:00 2023-12-17T11:45:50.359 INFO:teuthology.orchestra.run.smithi159.stdout:(136/149): acl-2.3.1-4.el9.x86_64.rpm 1.0 MB/s | 69 kB 00:00 2023-12-17T11:45:50.409 INFO:teuthology.orchestra.run.smithi159.stdout:(137/149): elfutils-debuginfod-client-0.190-1.e 739 kB/s | 36 kB 00:00 2023-12-17T11:45:50.451 INFO:teuthology.orchestra.run.smithi159.stdout:(138/149): elfutils-libelf-0.190-1.el9.x86_64.r 4.6 MB/s | 192 kB 00:00 2023-12-17T11:45:50.493 INFO:teuthology.orchestra.run.smithi159.stdout:(139/149): elfutils-libs-0.190-1.el9.x86_64.rpm 6.1 MB/s | 255 kB 00:00 2023-12-17T11:45:50.552 INFO:teuthology.orchestra.run.smithi159.stdout:(140/149): libacl-2.3.1-4.el9.x86_64.rpm 381 kB/s | 22 kB 00:00 2023-12-17T11:45:50.594 INFO:teuthology.orchestra.run.smithi159.stdout:(141/149): xfsdump-3.1.12-4.el9.x86_64.rpm 7.7 MB/s | 321 kB 00:00 2023-12-17T11:45:50.719 INFO:teuthology.orchestra.run.smithi159.stdout:(142/149): librados2-19.0.0-119.ga62fda73.el9.x 4.1 MB/s | 3.3 MB 00:00 2023-12-17T11:45:50.895 INFO:teuthology.orchestra.run.smithi159.stdout:(143/149): NetworkManager-1.45.7-1.el9.x86_64.r 7.5 MB/s | 2.3 MB 00:00 2023-12-17T11:45:50.945 INFO:teuthology.orchestra.run.smithi159.stdout:(144/149): NetworkManager-libnm-1.45.7-1.el9.x8 7.9 MB/s | 1.8 MB 00:00 2023-12-17T11:45:51.029 INFO:teuthology.orchestra.run.smithi159.stdout:(145/149): NetworkManager-team-1.45.7-1.el9.x86 325 kB/s | 43 kB 00:00 2023-12-17T11:45:51.087 INFO:teuthology.orchestra.run.smithi159.stdout:(146/149): NetworkManager-tui-1.45.7-1.el9.x86_ 1.7 MB/s | 246 kB 00:00 2023-12-17T11:45:51.204 INFO:teuthology.orchestra.run.smithi159.stdout:(147/149): openssl-3.0.7-25.el9.x86_64.rpm 7.0 MB/s | 1.2 MB 00:00 2023-12-17T11:45:51.388 INFO:teuthology.orchestra.run.smithi159.stdout:(148/149): openssl-libs-3.0.7-25.el9.x86_64.rpm 7.2 MB/s | 2.2 MB 00:00 2023-12-17T11:45:52.402 INFO:teuthology.orchestra.run.smithi159.stdout:(149/149): librbd1-19.0.0-119.ga62fda73.el9.x86 1.3 MB/s | 3.0 MB 00:02 2023-12-17T11:45:52.421 INFO:teuthology.orchestra.run.smithi159.stdout:-------------------------------------------------------------------------------- 2023-12-17T11:45:52.421 INFO:teuthology.orchestra.run.smithi159.stdout:Total 6.7 MB/s | 204 MB 00:30 2023-12-17T11:45:52.830 INFO:teuthology.orchestra.run.smithi159.stdout:Running transaction check 2023-12-17T11:45:53.089 INFO:teuthology.orchestra.run.smithi159.stdout:Transaction check succeeded. 2023-12-17T11:45:53.090 INFO:teuthology.orchestra.run.smithi159.stdout:Running transaction test 2023-12-17T11:45:54.873 INFO:teuthology.orchestra.run.smithi040.stdout: Preparing : 1/1 2023-12-17T11:45:55.044 INFO:teuthology.orchestra.run.smithi040.stdout: Upgrading : openssl-libs-1:3.0.7-25.el9.x86_64 1/164 2023-12-17T11:45:55.076 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : thrift-0.15.0-2.el9.x86_64 2/164 2023-12-17T11:45:55.323 INFO:teuthology.orchestra.run.smithi159.stdout:Transaction test succeeded. 2023-12-17T11:45:55.323 INFO:teuthology.orchestra.run.smithi159.stdout:Running transaction 2023-12-17T11:45:55.329 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 3/164 2023-12-17T11:45:55.403 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 4/164 2023-12-17T11:45:55.436 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/164 2023-12-17T11:45:55.543 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/164 2023-12-17T11:45:55.998 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/164 2023-12-17T11:45:56.049 INFO:teuthology.orchestra.run.smithi040.stdout: Upgrading : librados2-2:19.0.0-119.ga62fda73.el9.x86_64 8/164 2023-12-17T11:45:56.202 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: librados2-2:19.0.0-119.ga62fda73.el9.x86_64 8/164 2023-12-17T11:45:56.234 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : libcephfs2-2:19.0.0-119.ga62fda73.el9.x86_64 9/164 2023-12-17T11:45:56.394 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: libcephfs2-2:19.0.0-119.ga62fda73.el9.x86_64 9/164 2023-12-17T11:45:56.427 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-rados-2:19.0.0-119.ga62fda73.el9.x86_64 10/164 2023-12-17T11:45:56.490 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : postgresql-private-libs-13.11-1.el9.x86_64 11/164 2023-12-17T11:45:56.783 INFO:teuthology.orchestra.run.smithi040.stdout: Upgrading : elfutils-libelf-0.190-1.el9.x86_64 12/164 2023-12-17T11:45:56.847 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : postgresql-13.11-1.el9.x86_64 13/164 2023-12-17T11:45:56.872 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : libcephsqlite-2:19.0.0-119.ga62fda73.el9.x86_64 14/164 2023-12-17T11:45:57.042 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: libcephsqlite-2:19.0.0-119.ga62fda73.el9.x86_64 14/164 2023-12-17T11:45:57.096 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : libradosstriper1-2:19.0.0-119.ga62fda73.el9.x86_ 15/164 2023-12-17T11:45:57.505 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: libradosstriper1-2:19.0.0-119.ga62fda73.el9.x86_ 15/164 2023-12-17T11:45:57.670 INFO:teuthology.orchestra.run.smithi040.stdout: Upgrading : NetworkManager-libnm-1:1.45.7-1.el9.x86_64 16/164 2023-12-17T11:45:57.759 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: NetworkManager-libnm-1:1.45.7-1.el9.x86_64 16/164 2023-12-17T11:45:57.970 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: NetworkManager-1:1.45.7-1.el9.x86_64 17/164 2023-12-17T11:45:58.022 INFO:teuthology.orchestra.run.smithi040.stdout: Upgrading : NetworkManager-1:1.45.7-1.el9.x86_64 17/164 2023-12-17T11:45:58.374 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: NetworkManager-1:1.45.7-1.el9.x86_64 17/164 2023-12-17T11:45:58.562 INFO:teuthology.orchestra.run.smithi040.stdout: Upgrading : libacl-2.3.1-4.el9.x86_64 18/164 2023-12-17T11:45:58.603 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 19/164 2023-12-17T11:45:58.711 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : liboath-2.6.7-2.el9.x86_64 20/164 2023-12-17T11:45:58.787 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-urllib3-1.26.5-4.el9.noarch 21/164 2023-12-17T11:45:58.824 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-requests-2.25.1-7.el9.noarch 22/164 2023-12-17T11:45:58.883 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : libquadmath-11.4.1-2.3.el9.x86_64 23/164 2023-12-17T11:45:58.938 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : libgfortran-11.4.1-2.3.el9.x86_64 24/164 2023-12-17T11:45:59.051 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 25/164 2023-12-17T11:45:59.094 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 26/164 2023-12-17T11:45:59.127 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 27/164 2023-12-17T11:45:59.246 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 28/164 2023-12-17T11:45:59.282 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-ceph-common-2:19.0.0-119.ga62fda73.el9.x 29/164 2023-12-17T11:45:59.334 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-ceph-argparse-2:19.0.0-119.ga62fda73.el9 30/164 2023-12-17T11:45:59.453 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-cephfs-2:19.0.0-119.ga62fda73.el9.x86_64 31/164 2023-12-17T11:45:59.650 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 32/164 2023-12-17T11:45:59.717 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 33/164 2023-12-17T11:46:00.452 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-rsa-4.9-2.el9.noarch 34/164 2023-12-17T11:46:00.552 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 35/164 2023-12-17T11:46:00.595 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-jinja2-2.11.3-4.el9.noarch 36/164 2023-12-17T11:46:00.654 INFO:teuthology.orchestra.run.smithi040.stdout: Upgrading : elfutils-libs-0.190-1.el9.x86_64 37/164 2023-12-17T11:46:00.694 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : librados-devel-2:19.0.0-119.ga62fda73.el9.x86_64 38/164 2023-12-17T11:46:00.756 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 39/164 2023-12-17T11:46:00.962 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 40/164 2023-12-17T11:46:01.042 INFO:teuthology.orchestra.run.smithi040.stdout: Upgrading : openssl-1:3.0.7-25.el9.x86_64 41/164 2023-12-17T11:46:01.200 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : re2-1:20211101-3.el9.x86_64 42/164 2023-12-17T11:46:01.238 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : libarrow-9.0.0-10.el9.x86_64 43/164 2023-12-17T11:46:01.319 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 44/164 2023-12-17T11:46:01.412 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 45/164 2023-12-17T11:46:01.455 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 46/164 2023-12-17T11:46:01.495 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 47/164 2023-12-17T11:46:01.565 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 48/164 2023-12-17T11:46:01.627 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 49/164 2023-12-17T11:46:01.671 INFO:teuthology.orchestra.run.smithi159.stdout: Preparing : 1/1 2023-12-17T11:46:01.688 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 50/164 2023-12-17T11:46:01.827 INFO:teuthology.orchestra.run.smithi159.stdout: Upgrading : openssl-libs-1:3.0.7-25.el9.x86_64 1/164 2023-12-17T11:46:01.862 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : thrift-0.15.0-2.el9.x86_64 2/164 2023-12-17T11:46:01.897 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 51/164 2023-12-17T11:46:01.936 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 3/164 2023-12-17T11:46:01.945 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 52/164 2023-12-17T11:46:01.990 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 4/164 2023-12-17T11:46:02.003 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 53/164 2023-12-17T11:46:02.012 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/164 2023-12-17T11:46:02.095 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/164 2023-12-17T11:46:02.160 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 54/164 2023-12-17T11:46:02.220 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-google-auth-1:2.23.4-1.el9.noarch 55/164 2023-12-17T11:46:02.270 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 56/164 2023-12-17T11:46:02.302 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 57/164 2023-12-17T11:46:02.462 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : libarrow-doc-9.0.0-10.el9.noarch 58/164 2023-12-17T11:46:02.486 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/164 2023-12-17T11:46:02.516 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 59/164 2023-12-17T11:46:02.544 INFO:teuthology.orchestra.run.smithi159.stdout: Upgrading : librados2-2:19.0.0-119.ga62fda73.el9.x86_64 8/164 2023-12-17T11:46:02.588 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-ply-3.11-14.el9.noarch 60/164 2023-12-17T11:46:02.669 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 61/164 2023-12-17T11:46:02.699 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: librados2-2:19.0.0-119.ga62fda73.el9.x86_64 8/164 2023-12-17T11:46:02.729 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : libcephfs2-2:19.0.0-119.ga62fda73.el9.x86_64 9/164 2023-12-17T11:46:02.834 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: libcephfs2-2:19.0.0-119.ga62fda73.el9.x86_64 9/164 2023-12-17T11:46:02.878 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-rados-2:19.0.0-119.ga62fda73.el9.x86_64 10/164 2023-12-17T11:46:02.935 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 62/164 2023-12-17T11:46:02.938 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : postgresql-private-libs-13.11-1.el9.x86_64 11/164 2023-12-17T11:46:03.002 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 63/164 2023-12-17T11:46:03.186 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 64/164 2023-12-17T11:46:03.216 INFO:teuthology.orchestra.run.smithi159.stdout: Upgrading : elfutils-libelf-0.190-1.el9.x86_64 12/164 2023-12-17T11:46:03.247 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-asyncssh-2.13.2-3.el9.noarch 65/164 2023-12-17T11:46:03.276 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : postgresql-13.11-1.el9.x86_64 13/164 2023-12-17T11:46:03.279 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-jwt-2.4.0-1.el9.noarch 66/164 2023-12-17T11:46:03.300 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : libcephsqlite-2:19.0.0-119.ga62fda73.el9.x86_64 14/164 2023-12-17T11:46:03.319 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-jwt+crypto-2.4.0-1.el9.noarch 67/164 2023-12-17T11:46:03.371 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 68/164 2023-12-17T11:46:03.424 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : fuse-2.9.9-15.el9.x86_64 69/164 2023-12-17T11:46:03.437 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: libcephsqlite-2:19.0.0-119.ga62fda73.el9.x86_64 14/164 2023-12-17T11:46:03.469 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : libradosstriper1-2:19.0.0-119.ga62fda73.el9.x86_ 15/164 2023-12-17T11:46:03.469 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : zlib-devel-1.2.11-40.el9.x86_64 70/164 2023-12-17T11:46:03.530 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 71/164 2023-12-17T11:46:03.601 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : uuid-1.6.2-55.el9.x86_64 72/164 2023-12-17T11:46:03.651 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 73/164 2023-12-17T11:46:03.751 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: libradosstriper1-2:19.0.0-119.ga62fda73.el9.x86_ 15/164 2023-12-17T11:46:03.797 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 74/164 2023-12-17T11:46:03.835 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 75/164 2023-12-17T11:46:03.870 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 76/164 2023-12-17T11:46:03.932 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 77/164 2023-12-17T11:46:03.957 INFO:teuthology.orchestra.run.smithi159.stdout: Upgrading : NetworkManager-libnm-1:1.45.7-1.el9.x86_64 16/164 2023-12-17T11:46:03.973 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 78/164 2023-12-17T11:46:04.045 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: NetworkManager-libnm-1:1.45.7-1.el9.x86_64 16/164 2023-12-17T11:46:04.152 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 79/164 2023-12-17T11:46:04.206 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 80/164 2023-12-17T11:46:04.227 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: NetworkManager-1:1.45.7-1.el9.x86_64 17/164 2023-12-17T11:46:04.276 INFO:teuthology.orchestra.run.smithi159.stdout: Upgrading : NetworkManager-1:1.45.7-1.el9.x86_64 17/164 2023-12-17T11:46:04.361 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 81/164 2023-12-17T11:46:04.429 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 82/164 2023-12-17T11:46:04.630 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: NetworkManager-1:1.45.7-1.el9.x86_64 17/164 2023-12-17T11:46:04.805 INFO:teuthology.orchestra.run.smithi159.stdout: Upgrading : libacl-2.3.1-4.el9.x86_64 18/164 2023-12-17T11:46:04.848 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 19/164 2023-12-17T11:46:04.960 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : liboath-2.6.7-2.el9.x86_64 20/164 2023-12-17T11:46:05.022 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-urllib3-1.26.5-4.el9.noarch 21/164 2023-12-17T11:46:05.062 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-requests-2.25.1-7.el9.noarch 22/164 2023-12-17T11:46:05.117 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : libquadmath-11.4.1-2.3.el9.x86_64 23/164 2023-12-17T11:46:05.174 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : libgfortran-11.4.1-2.3.el9.x86_64 24/164 2023-12-17T11:46:05.277 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 25/164 2023-12-17T11:46:05.322 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 26/164 2023-12-17T11:46:05.356 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 27/164 2023-12-17T11:46:05.458 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 83/164 2023-12-17T11:46:05.465 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 28/164 2023-12-17T11:46:05.503 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-ceph-common-2:19.0.0-119.ga62fda73.el9.x 29/164 2023-12-17T11:46:05.518 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 84/164 2023-12-17T11:46:05.545 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-ceph-argparse-2:19.0.0-119.ga62fda73.el9 30/164 2023-12-17T11:46:05.552 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 85/164 2023-12-17T11:46:05.586 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 86/164 2023-12-17T11:46:05.627 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-cephfs-2:19.0.0-119.ga62fda73.el9.x86_64 31/164 2023-12-17T11:46:05.804 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 32/164 2023-12-17T11:46:05.842 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : openblas-0.3.21-2.el9.x86_64 87/164 2023-12-17T11:46:05.871 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 33/164 2023-12-17T11:46:05.881 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 88/164 2023-12-17T11:46:05.978 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 89/164 2023-12-17T11:46:06.552 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-rsa-4.9-2.el9.noarch 34/164 2023-12-17T11:46:06.642 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 35/164 2023-12-17T11:46:06.710 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-jinja2-2.11.3-4.el9.noarch 36/164 2023-12-17T11:46:06.769 INFO:teuthology.orchestra.run.smithi159.stdout: Upgrading : elfutils-libs-0.190-1.el9.x86_64 37/164 2023-12-17T11:46:06.826 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : librados-devel-2:19.0.0-119.ga62fda73.el9.x86_64 38/164 2023-12-17T11:46:06.832 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 90/164 2023-12-17T11:46:06.889 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 39/164 2023-12-17T11:46:06.981 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 91/164 2023-12-17T11:46:07.087 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 40/164 2023-12-17T11:46:07.137 INFO:teuthology.orchestra.run.smithi159.stdout: Upgrading : openssl-1:3.0.7-25.el9.x86_64 41/164 2023-12-17T11:46:07.289 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : re2-1:20211101-3.el9.x86_64 42/164 2023-12-17T11:46:07.323 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : libarrow-9.0.0-10.el9.x86_64 43/164 2023-12-17T11:46:07.386 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 44/164 2023-12-17T11:46:07.541 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 45/164 2023-12-17T11:46:07.583 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 46/164 2023-12-17T11:46:07.631 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 47/164 2023-12-17T11:46:07.702 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 48/164 2023-12-17T11:46:07.763 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 49/164 2023-12-17T11:46:07.846 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 50/164 2023-12-17T11:46:08.042 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 51/164 2023-12-17T11:46:08.090 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 52/164 2023-12-17T11:46:08.136 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 53/164 2023-12-17T11:46:08.262 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 54/164 2023-12-17T11:46:08.307 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-google-auth-1:2.23.4-1.el9.noarch 55/164 2023-12-17T11:46:08.355 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 56/164 2023-12-17T11:46:08.388 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 57/164 2023-12-17T11:46:08.543 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : libarrow-doc-9.0.0-10.el9.noarch 58/164 2023-12-17T11:46:08.593 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 59/164 2023-12-17T11:46:08.660 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-ply-3.11-14.el9.noarch 60/164 2023-12-17T11:46:08.694 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 92/164 2023-12-17T11:46:08.733 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 61/164 2023-12-17T11:46:08.777 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 93/164 2023-12-17T11:46:08.814 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 94/164 2023-12-17T11:46:08.858 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : jq-1.6-16.el9.x86_64 95/164 2023-12-17T11:46:08.983 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 62/164 2023-12-17T11:46:08.997 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : lua-5.4.4-4.el9.x86_64 96/164 2023-12-17T11:46:09.038 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : luarocks-3.9.2-1.el9.noarch 97/164 2023-12-17T11:46:09.048 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 63/164 2023-12-17T11:46:09.079 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 98/164 2023-12-17T11:46:09.122 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : libuuid-devel-2.37.4-15.el9.x86_64 99/164 2023-12-17T11:46:09.219 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 64/164 2023-12-17T11:46:09.267 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-asyncssh-2.13.2-3.el9.noarch 65/164 2023-12-17T11:46:09.291 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-jwt-2.4.0-1.el9.noarch 66/164 2023-12-17T11:46:09.329 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-jwt+crypto-2.4.0-1.el9.noarch 67/164 2023-12-17T11:46:09.372 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 68/164 2023-12-17T11:46:09.410 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : fuse-2.9.9-15.el9.x86_64 69/164 2023-12-17T11:46:09.451 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : zlib-devel-1.2.11-40.el9.x86_64 70/164 2023-12-17T11:46:09.506 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 71/164 2023-12-17T11:46:09.515 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 100/164 2023-12-17T11:46:09.545 INFO:teuthology.orchestra.run.smithi040.stdout: Upgrading : librbd1-2:19.0.0-119.ga62fda73.el9.x86_64 101/164 2023-12-17T11:46:09.565 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : uuid-1.6.2-55.el9.x86_64 72/164 2023-12-17T11:46:09.613 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 73/164 2023-12-17T11:46:09.668 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: librbd1-2:19.0.0-119.ga62fda73.el9.x86_64 101/164 2023-12-17T11:46:09.701 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-rbd-2:19.0.0-119.ga62fda73.el9.x86_64 102/164 2023-12-17T11:46:09.739 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 74/164 2023-12-17T11:46:09.757 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 103/164 2023-12-17T11:46:09.781 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 75/164 2023-12-17T11:46:09.824 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 76/164 2023-12-17T11:46:09.905 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 77/164 2023-12-17T11:46:09.945 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 78/164 2023-12-17T11:46:10.088 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 79/164 2023-12-17T11:46:10.135 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 80/164 2023-12-17T11:46:10.285 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : parquet-libs-9.0.0-10.el9.x86_64 104/164 2023-12-17T11:46:10.286 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 81/164 2023-12-17T11:46:10.322 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : librgw2-2:19.0.0-119.ga62fda73.el9.x86_64 105/164 2023-12-17T11:46:10.356 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 82/164 2023-12-17T11:46:10.424 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: librgw2-2:19.0.0-119.ga62fda73.el9.x86_64 105/164 2023-12-17T11:46:10.505 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-rgw-2:19.0.0-119.ga62fda73.el9.x86_64 106/164 2023-12-17T11:46:11.274 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 83/164 2023-12-17T11:46:11.330 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 84/164 2023-12-17T11:46:11.364 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 85/164 2023-12-17T11:46:11.398 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 86/164 2023-12-17T11:46:11.640 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : openblas-0.3.21-2.el9.x86_64 87/164 2023-12-17T11:46:11.677 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 88/164 2023-12-17T11:46:11.770 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 89/164 2023-12-17T11:46:12.573 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 90/164 2023-12-17T11:46:12.706 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 91/164 2023-12-17T11:46:13.389 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: ceph-common-2:19.0.0-119.ga62fda73.el9.x86_64 107/164 2023-12-17T11:46:13.430 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : ceph-common-2:19.0.0-119.ga62fda73.el9.x86_64 107/164 2023-12-17T11:46:14.094 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: ceph-common-2:19.0.0-119.ga62fda73.el9.x86_64 107/164 2023-12-17T11:46:14.141 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : ceph-base-2:19.0.0-119.ga62fda73.el9.x86_64 108/164 2023-12-17T11:46:14.257 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 92/164 2023-12-17T11:46:14.356 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 93/164 2023-12-17T11:46:14.366 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: ceph-base-2:19.0.0-119.ga62fda73.el9.x86_64 108/164 2023-12-17T11:46:14.367 INFO:teuthology.orchestra.run.smithi040.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2023-12-17T11:46:14.367 INFO:teuthology.orchestra.run.smithi040.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2023-12-17T11:46:14.367 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T11:46:14.406 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 94/164 2023-12-17T11:46:14.417 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : ceph-selinux-2:19.0.0-119.ga62fda73.el9.x86_64 109/164 2023-12-17T11:46:14.459 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : jq-1.6-16.el9.x86_64 95/164 2023-12-17T11:46:14.578 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : lua-5.4.4-4.el9.x86_64 96/164 2023-12-17T11:46:14.618 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : luarocks-3.9.2-1.el9.noarch 97/164 2023-12-17T11:46:14.658 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 98/164 2023-12-17T11:46:14.692 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : libuuid-devel-2.37.4-15.el9.x86_64 99/164 2023-12-17T11:46:15.079 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 100/164 2023-12-17T11:46:15.124 INFO:teuthology.orchestra.run.smithi159.stdout: Upgrading : librbd1-2:19.0.0-119.ga62fda73.el9.x86_64 101/164 2023-12-17T11:46:15.247 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: librbd1-2:19.0.0-119.ga62fda73.el9.x86_64 101/164 2023-12-17T11:46:15.281 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-rbd-2:19.0.0-119.ga62fda73.el9.x86_64 102/164 2023-12-17T11:46:15.338 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 103/164 2023-12-17T11:46:15.854 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : parquet-libs-9.0.0-10.el9.x86_64 104/164 2023-12-17T11:46:15.885 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : librgw2-2:19.0.0-119.ga62fda73.el9.x86_64 105/164 2023-12-17T11:46:15.982 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: librgw2-2:19.0.0-119.ga62fda73.el9.x86_64 105/164 2023-12-17T11:46:16.029 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-rgw-2:19.0.0-119.ga62fda73.el9.x86_64 106/164 2023-12-17T11:46:18.426 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: ceph-common-2:19.0.0-119.ga62fda73.el9.x86_64 107/164 2023-12-17T11:46:18.467 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : ceph-common-2:19.0.0-119.ga62fda73.el9.x86_64 107/164 2023-12-17T11:46:19.090 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: ceph-common-2:19.0.0-119.ga62fda73.el9.x86_64 107/164 2023-12-17T11:46:19.138 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : ceph-base-2:19.0.0-119.ga62fda73.el9.x86_64 108/164 2023-12-17T11:46:19.304 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: ceph-base-2:19.0.0-119.ga62fda73.el9.x86_64 108/164 2023-12-17T11:46:19.304 INFO:teuthology.orchestra.run.smithi159.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2023-12-17T11:46:19.304 INFO:teuthology.orchestra.run.smithi159.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2023-12-17T11:46:19.304 INFO:teuthology.orchestra.run.smithi159.stdout: 2023-12-17T11:46:19.347 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : ceph-selinux-2:19.0.0-119.ga62fda73.el9.x86_64 109/164 2023-12-17T11:46:27.597 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: ceph-selinux-2:19.0.0-119.ga62fda73.el9.x86_64 109/164 2023-12-17T11:46:27.598 INFO:teuthology.orchestra.run.smithi040.stdout:skipping the directory /sys 2023-12-17T11:46:27.598 INFO:teuthology.orchestra.run.smithi040.stdout:skipping the directory /proc 2023-12-17T11:46:27.598 INFO:teuthology.orchestra.run.smithi040.stdout:skipping the directory /mnt 2023-12-17T11:46:27.598 INFO:teuthology.orchestra.run.smithi040.stdout:skipping the directory /var/tmp 2023-12-17T11:46:27.598 INFO:teuthology.orchestra.run.smithi040.stdout:skipping the directory /home 2023-12-17T11:46:27.598 INFO:teuthology.orchestra.run.smithi040.stdout:skipping the directory /root 2023-12-17T11:46:27.598 INFO:teuthology.orchestra.run.smithi040.stdout:skipping the directory /tmp 2023-12-17T11:46:27.598 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T11:46:27.806 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : ceph-volume-2:19.0.0-119.ga62fda73.el9.noarch 110/164 2023-12-17T11:46:27.856 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: ceph-volume-2:19.0.0-119.ga62fda73.el9.noarch 110/164 2023-12-17T11:46:27.856 INFO:teuthology.orchestra.run.smithi040.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-17T11:46:27.856 INFO:teuthology.orchestra.run.smithi040.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2023-12-17T11:46:27.856 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T11:46:29.608 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : ceph-osd-2:19.0.0-119.ga62fda73.el9.x86_64 111/164 2023-12-17T11:46:29.692 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: ceph-osd-2:19.0.0-119.ga62fda73.el9.x86_64 111/164 2023-12-17T11:46:29.693 INFO:teuthology.orchestra.run.smithi040.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-17T11:46:29.693 INFO:teuthology.orchestra.run.smithi040.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2023-12-17T11:46:29.693 INFO:teuthology.orchestra.run.smithi040.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2023-12-17T11:46:29.694 INFO:teuthology.orchestra.run.smithi040.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2023-12-17T11:46:29.694 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T11:46:29.933 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : ceph-mds-2:19.0.0-119.ga62fda73.el9.x86_64 112/164 2023-12-17T11:46:30.010 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: ceph-mds-2:19.0.0-119.ga62fda73.el9.x86_64 112/164 2023-12-17T11:46:30.011 INFO:teuthology.orchestra.run.smithi040.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-17T11:46:30.011 INFO:teuthology.orchestra.run.smithi040.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2023-12-17T11:46:30.011 INFO:teuthology.orchestra.run.smithi040.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2023-12-17T11:46:30.011 INFO:teuthology.orchestra.run.smithi040.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2023-12-17T11:46:30.011 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T11:46:30.550 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : ceph-mon-2:19.0.0-119.ga62fda73.el9.x86_64 113/164 2023-12-17T11:46:30.629 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: ceph-mon-2:19.0.0-119.ga62fda73.el9.x86_64 113/164 2023-12-17T11:46:30.629 INFO:teuthology.orchestra.run.smithi040.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-17T11:46:30.629 INFO:teuthology.orchestra.run.smithi040.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2023-12-17T11:46:30.629 INFO:teuthology.orchestra.run.smithi040.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2023-12-17T11:46:30.629 INFO:teuthology.orchestra.run.smithi040.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2023-12-17T11:46:30.629 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T11:46:30.752 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : automake-1.16.2-8.el9.noarch 114/164 2023-12-17T11:46:31.322 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: cephadm-2:19.0.0-119.ga62fda73.el9.noarch 115/164 2023-12-17T11:46:31.362 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : cephadm-2:19.0.0-119.ga62fda73.el9.noarch 115/164 2023-12-17T11:46:31.409 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-119.ga62fda73.el 116/164 2023-12-17T11:46:31.529 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-119.ga62fda73.e 117/164 2023-12-17T11:46:31.557 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-119.ga62fda73.el9.noar 118/164 2023-12-17T11:46:31.897 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-119.ga62fda73.el9.noar 118/164 2023-12-17T11:46:31.935 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-119.ga62fda73.el9.no 119/164 2023-12-17T11:46:32.027 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: ceph-selinux-2:19.0.0-119.ga62fda73.el9.x86_64 109/164 2023-12-17T11:46:32.027 INFO:teuthology.orchestra.run.smithi159.stdout:skipping the directory /sys 2023-12-17T11:46:32.027 INFO:teuthology.orchestra.run.smithi159.stdout:skipping the directory /proc 2023-12-17T11:46:32.027 INFO:teuthology.orchestra.run.smithi159.stdout:skipping the directory /mnt 2023-12-17T11:46:32.027 INFO:teuthology.orchestra.run.smithi159.stdout:skipping the directory /var/tmp 2023-12-17T11:46:32.028 INFO:teuthology.orchestra.run.smithi159.stdout:skipping the directory /home 2023-12-17T11:46:32.028 INFO:teuthology.orchestra.run.smithi159.stdout:skipping the directory /root 2023-12-17T11:46:32.028 INFO:teuthology.orchestra.run.smithi159.stdout:skipping the directory /tmp 2023-12-17T11:46:32.028 INFO:teuthology.orchestra.run.smithi159.stdout: 2023-12-17T11:46:32.251 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : ceph-volume-2:19.0.0-119.ga62fda73.el9.noarch 110/164 2023-12-17T11:46:32.298 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: ceph-volume-2:19.0.0-119.ga62fda73.el9.noarch 110/164 2023-12-17T11:46:32.298 INFO:teuthology.orchestra.run.smithi159.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-17T11:46:32.298 INFO:teuthology.orchestra.run.smithi159.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2023-12-17T11:46:32.298 INFO:teuthology.orchestra.run.smithi159.stdout: 2023-12-17T11:46:33.126 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-119.ga62fda73.el9.no 119/164 2023-12-17T11:46:33.150 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-119.ga62f 120/164 2023-12-17T11:46:33.299 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-119.ga62f 120/164 2023-12-17T11:46:33.483 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-119.ga62fda73.el9 121/164 2023-12-17T11:46:33.510 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : ceph-mgr-2:19.0.0-119.ga62fda73.el9.x86_64 122/164 2023-12-17T11:46:33.588 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: ceph-mgr-2:19.0.0-119.ga62fda73.el9.x86_64 122/164 2023-12-17T11:46:33.588 INFO:teuthology.orchestra.run.smithi040.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-17T11:46:33.589 INFO:teuthology.orchestra.run.smithi040.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2023-12-17T11:46:33.589 INFO:teuthology.orchestra.run.smithi040.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2023-12-17T11:46:33.589 INFO:teuthology.orchestra.run.smithi040.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2023-12-17T11:46:33.589 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T11:46:33.644 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : ceph-mgr-rook-2:19.0.0-119.ga62fda73.el9.noarch 123/164 2023-12-17T11:46:33.687 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-119.ga62fda73.el9.noarch 123/164 2023-12-17T11:46:33.775 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : ceph-2:19.0.0-119.ga62fda73.el9.x86_64 124/164 2023-12-17T11:46:34.046 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : ceph-osd-2:19.0.0-119.ga62fda73.el9.x86_64 111/164 2023-12-17T11:46:34.140 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: ceph-osd-2:19.0.0-119.ga62fda73.el9.x86_64 111/164 2023-12-17T11:46:34.140 INFO:teuthology.orchestra.run.smithi159.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-17T11:46:34.140 INFO:teuthology.orchestra.run.smithi159.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2023-12-17T11:46:34.140 INFO:teuthology.orchestra.run.smithi159.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2023-12-17T11:46:34.141 INFO:teuthology.orchestra.run.smithi159.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2023-12-17T11:46:34.141 INFO:teuthology.orchestra.run.smithi159.stdout: 2023-12-17T11:46:34.379 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : ceph-mds-2:19.0.0-119.ga62fda73.el9.x86_64 112/164 2023-12-17T11:46:34.454 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: ceph-mds-2:19.0.0-119.ga62fda73.el9.x86_64 112/164 2023-12-17T11:46:34.454 INFO:teuthology.orchestra.run.smithi159.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-17T11:46:34.454 INFO:teuthology.orchestra.run.smithi159.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2023-12-17T11:46:34.454 INFO:teuthology.orchestra.run.smithi159.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2023-12-17T11:46:34.454 INFO:teuthology.orchestra.run.smithi159.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2023-12-17T11:46:34.454 INFO:teuthology.orchestra.run.smithi159.stdout: 2023-12-17T11:46:34.681 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : libtool-2.4.6-45.el9.x86_64 125/164 2023-12-17T11:46:34.713 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : ceph-radosgw-2:19.0.0-119.ga62fda73.el9.x86_64 126/164 2023-12-17T11:46:34.789 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-119.ga62fda73.el9.x86_64 126/164 2023-12-17T11:46:34.789 INFO:teuthology.orchestra.run.smithi040.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-17T11:46:34.789 INFO:teuthology.orchestra.run.smithi040.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2023-12-17T11:46:34.789 INFO:teuthology.orchestra.run.smithi040.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2023-12-17T11:46:34.789 INFO:teuthology.orchestra.run.smithi040.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2023-12-17T11:46:34.789 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T11:46:34.839 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-119.ga62fda 127/164 2023-12-17T11:46:34.915 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-119.ga62fda 127/164 2023-12-17T11:46:34.915 INFO:teuthology.orchestra.run.smithi040.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-17T11:46:34.915 INFO:teuthology.orchestra.run.smithi040.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2023-12-17T11:46:34.915 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T11:46:34.955 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : ceph-mon-2:19.0.0-119.ga62fda73.el9.x86_64 113/164 2023-12-17T11:46:34.989 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : cephfs-mirror-2:19.0.0-119.ga62fda73.el9.x86_64 128/164 2023-12-17T11:46:35.027 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: ceph-mon-2:19.0.0-119.ga62fda73.el9.x86_64 113/164 2023-12-17T11:46:35.027 INFO:teuthology.orchestra.run.smithi159.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-17T11:46:35.027 INFO:teuthology.orchestra.run.smithi159.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2023-12-17T11:46:35.027 INFO:teuthology.orchestra.run.smithi159.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2023-12-17T11:46:35.027 INFO:teuthology.orchestra.run.smithi159.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2023-12-17T11:46:35.027 INFO:teuthology.orchestra.run.smithi159.stdout: 2023-12-17T11:46:35.089 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-119.ga62fda73.el9.x86_64 128/164 2023-12-17T11:46:35.089 INFO:teuthology.orchestra.run.smithi040.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-17T11:46:35.089 INFO:teuthology.orchestra.run.smithi040.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2023-12-17T11:46:35.090 INFO:teuthology.orchestra.run.smithi040.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2023-12-17T11:46:35.090 INFO:teuthology.orchestra.run.smithi040.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2023-12-17T11:46:35.090 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T11:46:35.152 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : automake-1.16.2-8.el9.noarch 114/164 2023-12-17T11:46:35.473 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : rbd-mirror-2:19.0.0-119.ga62fda73.el9.x86_64 129/164 2023-12-17T11:46:35.559 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: rbd-mirror-2:19.0.0-119.ga62fda73.el9.x86_64 129/164 2023-12-17T11:46:35.560 INFO:teuthology.orchestra.run.smithi040.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-17T11:46:35.560 INFO:teuthology.orchestra.run.smithi040.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2023-12-17T11:46:35.560 INFO:teuthology.orchestra.run.smithi040.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2023-12-17T11:46:35.560 INFO:teuthology.orchestra.run.smithi040.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2023-12-17T11:46:35.560 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T11:46:35.929 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: cephadm-2:19.0.0-119.ga62fda73.el9.noarch 115/164 2023-12-17T11:46:35.958 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : cephadm-2:19.0.0-119.ga62fda73.el9.noarch 115/164 2023-12-17T11:46:35.994 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-119.ga62fda73.el 116/164 2023-12-17T11:46:36.076 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-119.ga62fda73.e 117/164 2023-12-17T11:46:36.112 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-119.ga62fda73.el9.noar 118/164 2023-12-17T11:46:36.430 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-119.ga62fda73.el9.noar 118/164 2023-12-17T11:46:36.472 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-119.ga62fda73.el9.no 119/164 2023-12-17T11:46:37.603 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-119.ga62fda73.el9.no 119/164 2023-12-17T11:46:37.639 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-119.ga62f 120/164 2023-12-17T11:46:37.783 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-119.ga62f 120/164 2023-12-17T11:46:37.947 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-119.ga62fda73.el9 121/164 2023-12-17T11:46:37.974 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : ceph-mgr-2:19.0.0-119.ga62fda73.el9.x86_64 122/164 2023-12-17T11:46:38.046 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: ceph-mgr-2:19.0.0-119.ga62fda73.el9.x86_64 122/164 2023-12-17T11:46:38.046 INFO:teuthology.orchestra.run.smithi159.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-17T11:46:38.046 INFO:teuthology.orchestra.run.smithi159.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2023-12-17T11:46:38.046 INFO:teuthology.orchestra.run.smithi159.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2023-12-17T11:46:38.046 INFO:teuthology.orchestra.run.smithi159.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2023-12-17T11:46:38.046 INFO:teuthology.orchestra.run.smithi159.stdout: 2023-12-17T11:46:38.100 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : ceph-mgr-rook-2:19.0.0-119.ga62fda73.el9.noarch 123/164 2023-12-17T11:46:38.141 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-119.ga62fda73.el9.noarch 123/164 2023-12-17T11:46:38.194 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : ceph-2:19.0.0-119.ga62fda73.el9.x86_64 124/164 2023-12-17T11:46:39.032 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : libtool-2.4.6-45.el9.x86_64 125/164 2023-12-17T11:46:39.069 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : ceph-radosgw-2:19.0.0-119.ga62fda73.el9.x86_64 126/164 2023-12-17T11:46:39.142 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-119.ga62fda73.el9.x86_64 126/164 2023-12-17T11:46:39.142 INFO:teuthology.orchestra.run.smithi159.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-17T11:46:39.143 INFO:teuthology.orchestra.run.smithi159.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2023-12-17T11:46:39.143 INFO:teuthology.orchestra.run.smithi159.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2023-12-17T11:46:39.143 INFO:teuthology.orchestra.run.smithi159.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2023-12-17T11:46:39.143 INFO:teuthology.orchestra.run.smithi159.stdout: 2023-12-17T11:46:39.194 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-119.ga62fda 127/164 2023-12-17T11:46:39.276 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-119.ga62fda 127/164 2023-12-17T11:46:39.276 INFO:teuthology.orchestra.run.smithi159.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-17T11:46:39.276 INFO:teuthology.orchestra.run.smithi159.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2023-12-17T11:46:39.276 INFO:teuthology.orchestra.run.smithi159.stdout: 2023-12-17T11:46:39.362 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : cephfs-mirror-2:19.0.0-119.ga62fda73.el9.x86_64 128/164 2023-12-17T11:46:39.443 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-119.ga62fda73.el9.x86_64 128/164 2023-12-17T11:46:39.443 INFO:teuthology.orchestra.run.smithi159.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-17T11:46:39.443 INFO:teuthology.orchestra.run.smithi159.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2023-12-17T11:46:39.443 INFO:teuthology.orchestra.run.smithi159.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2023-12-17T11:46:39.443 INFO:teuthology.orchestra.run.smithi159.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2023-12-17T11:46:39.443 INFO:teuthology.orchestra.run.smithi159.stdout: 2023-12-17T11:46:39.812 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : rbd-mirror-2:19.0.0-119.ga62fda73.el9.x86_64 129/164 2023-12-17T11:46:39.885 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: rbd-mirror-2:19.0.0-119.ga62fda73.el9.x86_64 129/164 2023-12-17T11:46:39.885 INFO:teuthology.orchestra.run.smithi159.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-17T11:46:39.885 INFO:teuthology.orchestra.run.smithi159.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2023-12-17T11:46:39.885 INFO:teuthology.orchestra.run.smithi159.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2023-12-17T11:46:39.885 INFO:teuthology.orchestra.run.smithi159.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2023-12-17T11:46:39.885 INFO:teuthology.orchestra.run.smithi159.stdout: 2023-12-17T11:46:39.972 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : ceph-test-2:19.0.0-119.ga62fda73.el9.x86_64 130/164 2023-12-17T11:46:40.029 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : rbd-fuse-2:19.0.0-119.ga62fda73.el9.x86_64 131/164 2023-12-17T11:46:40.092 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : rbd-nbd-2:19.0.0-119.ga62fda73.el9.x86_64 132/164 2023-12-17T11:46:40.129 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : xfsprogs-devel-5.19.0-4.el9.x86_64 133/164 2023-12-17T11:46:40.416 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : elfutils-libelf-devel-0.190-1.el9.x86_64 134/164 2023-12-17T11:46:40.542 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : postgresql-contrib-13.11-1.el9.x86_64 135/164 2023-12-17T11:46:40.582 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : ceph-fuse-2:19.0.0-119.ga62fda73.el9.x86_64 136/164 2023-12-17T11:46:40.616 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : libcephfs-devel-2:19.0.0-119.ga62fda73.el9.x86_6 137/164 2023-12-17T11:46:40.705 INFO:teuthology.orchestra.run.smithi040.stdout: Upgrading : elfutils-debuginfod-client-0.190-1.el9.x86_64 138/164 2023-12-17T11:46:40.761 INFO:teuthology.orchestra.run.smithi040.stdout: Upgrading : libacl-devel-2.3.1-4.el9.x86_64 139/164 2023-12-17T11:46:40.801 INFO:teuthology.orchestra.run.smithi040.stdout: Upgrading : acl-2.3.1-4.el9.x86_64 140/164 2023-12-17T11:46:40.857 INFO:teuthology.orchestra.run.smithi040.stdout: Upgrading : NetworkManager-team-1:1.45.7-1.el9.x86_64 141/164 2023-12-17T11:46:40.901 INFO:teuthology.orchestra.run.smithi040.stdout: Upgrading : NetworkManager-tui-1:1.45.7-1.el9.x86_64 142/164 2023-12-17T11:46:41.891 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 143/164 2023-12-17T11:46:41.934 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : postgresql-server-13.11-1.el9.x86_64 143/164 2023-12-17T11:46:41.999 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 143/164 2023-12-17T11:46:43.433 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : cephfs-top-2:19.0.0-119.ga62fda73.el9.noarch 144/164 2023-12-17T11:46:43.552 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : openssl-devel-1:3.0.7-25.el9.x86_64 145/164 2023-12-17T11:46:43.622 INFO:teuthology.orchestra.run.smithi040.stdout: Upgrading : xfsdump-3.1.12-4.el9.x86_64 146/164 2023-12-17T11:46:43.694 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 147/164 2023-12-17T11:46:43.857 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : flex-2.6.4-9.el9.x86_64 148/164 2023-12-17T11:46:43.892 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : bison-3.7.4-5.el9.x86_64 149/164 2023-12-17T11:46:43.926 INFO:teuthology.orchestra.run.smithi040.stdout: Cleanup : NetworkManager-tui-1:1.44.0-2.el9.x86_64 150/164 2023-12-17T11:46:43.960 INFO:teuthology.orchestra.run.smithi040.stdout: Cleanup : elfutils-debuginfod-client-0.189-3.el9.x86_64 151/164 2023-12-17T11:46:44.002 INFO:teuthology.orchestra.run.smithi040.stdout: Cleanup : elfutils-libs-0.189-3.el9.x86_64 152/164 2023-12-17T11:46:44.002 INFO:teuthology.orchestra.run.smithi040.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 153/164 2023-12-17T11:46:44.065 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : ceph-test-2:19.0.0-119.ga62fda73.el9.x86_64 130/164 2023-12-17T11:46:44.134 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 153/164 2023-12-17T11:46:44.138 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : rbd-fuse-2:19.0.0-119.ga62fda73.el9.x86_64 131/164 2023-12-17T11:46:44.178 INFO:teuthology.orchestra.run.smithi040.stdout: Cleanup : libacl-devel-2.3.1-3.el9.x86_64 154/164 2023-12-17T11:46:44.204 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : rbd-nbd-2:19.0.0-119.ga62fda73.el9.x86_64 132/164 2023-12-17T11:46:44.223 INFO:teuthology.orchestra.run.smithi040.stdout: Cleanup : openssl-1:3.0.7-24.el9.x86_64 155/164 2023-12-17T11:46:44.237 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : xfsprogs-devel-5.19.0-4.el9.x86_64 133/164 2023-12-17T11:46:44.255 INFO:teuthology.orchestra.run.smithi040.stdout: Cleanup : acl-2.3.1-3.el9.x86_64 156/164 2023-12-17T11:46:44.256 INFO:teuthology.orchestra.run.smithi040.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 157/164 2023-12-17T11:46:44.393 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 157/164 2023-12-17T11:46:44.424 INFO:teuthology.orchestra.run.smithi040.stdout: Cleanup : NetworkManager-team-1:1.44.0-2.el9.x86_64 158/164 2023-12-17T11:46:44.464 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 159/164 2023-12-17T11:46:44.465 INFO:teuthology.orchestra.run.smithi040.stdout: Cleanup : NetworkManager-1:1.44.0-2.el9.x86_64 159/164 2023-12-17T11:46:44.514 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : elfutils-libelf-devel-0.190-1.el9.x86_64 134/164 2023-12-17T11:46:44.636 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : postgresql-contrib-13.11-1.el9.x86_64 135/164 2023-12-17T11:46:44.673 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : ceph-fuse-2:19.0.0-119.ga62fda73.el9.x86_64 136/164 2023-12-17T11:46:44.713 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : libcephfs-devel-2:19.0.0-119.ga62fda73.el9.x86_6 137/164 2023-12-17T11:46:44.798 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 159/164 2023-12-17T11:46:44.798 INFO:teuthology.orchestra.run.smithi040.stdout: Cleanup : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 160/164 2023-12-17T11:46:44.801 INFO:teuthology.orchestra.run.smithi159.stdout: Upgrading : elfutils-debuginfod-client-0.190-1.el9.x86_64 138/164 2023-12-17T11:46:44.860 INFO:teuthology.orchestra.run.smithi159.stdout: Upgrading : libacl-devel-2.3.1-4.el9.x86_64 139/164 2023-12-17T11:46:44.901 INFO:teuthology.orchestra.run.smithi159.stdout: Upgrading : acl-2.3.1-4.el9.x86_64 140/164 2023-12-17T11:46:44.940 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: NetworkManager-libnm-1:1.44.0-2.el9.x86_64 160/164 2023-12-17T11:46:44.951 INFO:teuthology.orchestra.run.smithi159.stdout: Upgrading : NetworkManager-team-1:1.45.7-1.el9.x86_64 141/164 2023-12-17T11:46:44.976 INFO:teuthology.orchestra.run.smithi040.stdout: Cleanup : openssl-libs-1:3.0.7-24.el9.x86_64 161/164 2023-12-17T11:46:45.001 INFO:teuthology.orchestra.run.smithi159.stdout: Upgrading : NetworkManager-tui-1:1.45.7-1.el9.x86_64 142/164 2023-12-17T11:46:45.010 INFO:teuthology.orchestra.run.smithi040.stdout: Cleanup : libacl-2.3.1-3.el9.x86_64 162/164 2023-12-17T11:46:45.045 INFO:teuthology.orchestra.run.smithi040.stdout: Cleanup : elfutils-libelf-0.189-3.el9.x86_64 163/164 2023-12-17T11:46:45.176 INFO:teuthology.orchestra.run.smithi040.stdout: Cleanup : xfsdump-3.1.12-3.el9.x86_64 164/164 2023-12-17T11:46:45.476 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: xfsdump-3.1.12-3.el9.x86_64 164/164 2023-12-17T11:46:45.476 INFO:teuthology.orchestra.run.smithi040.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2023-12-17T11:46:45.476 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T11:46:45.879 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 143/164 2023-12-17T11:46:45.924 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : postgresql-server-13.11-1.el9.x86_64 143/164 2023-12-17T11:46:45.984 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 143/164 2023-12-17T11:46:47.259 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : cephfs-top-2:19.0.0-119.ga62fda73.el9.noarch 144/164 2023-12-17T11:46:47.381 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : openssl-devel-1:3.0.7-25.el9.x86_64 145/164 2023-12-17T11:46:47.428 INFO:teuthology.orchestra.run.smithi159.stdout: Upgrading : xfsdump-3.1.12-4.el9.x86_64 146/164 2023-12-17T11:46:47.493 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 147/164 2023-12-17T11:46:47.647 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : flex-2.6.4-9.el9.x86_64 148/164 2023-12-17T11:46:47.691 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : bison-3.7.4-5.el9.x86_64 149/164 2023-12-17T11:46:47.724 INFO:teuthology.orchestra.run.smithi159.stdout: Cleanup : NetworkManager-tui-1:1.44.0-2.el9.x86_64 150/164 2023-12-17T11:46:47.758 INFO:teuthology.orchestra.run.smithi159.stdout: Cleanup : elfutils-debuginfod-client-0.189-3.el9.x86_64 151/164 2023-12-17T11:46:47.801 INFO:teuthology.orchestra.run.smithi159.stdout: Cleanup : elfutils-libs-0.189-3.el9.x86_64 152/164 2023-12-17T11:46:47.801 INFO:teuthology.orchestra.run.smithi159.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 153/164 2023-12-17T11:46:47.932 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 153/164 2023-12-17T11:46:47.975 INFO:teuthology.orchestra.run.smithi159.stdout: Cleanup : libacl-devel-2.3.1-3.el9.x86_64 154/164 2023-12-17T11:46:48.022 INFO:teuthology.orchestra.run.smithi159.stdout: Cleanup : openssl-1:3.0.7-24.el9.x86_64 155/164 2023-12-17T11:46:48.054 INFO:teuthology.orchestra.run.smithi159.stdout: Cleanup : acl-2.3.1-3.el9.x86_64 156/164 2023-12-17T11:46:48.054 INFO:teuthology.orchestra.run.smithi159.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 157/164 2023-12-17T11:46:48.207 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 157/164 2023-12-17T11:46:48.238 INFO:teuthology.orchestra.run.smithi159.stdout: Cleanup : NetworkManager-team-1:1.44.0-2.el9.x86_64 158/164 2023-12-17T11:46:48.277 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 159/164 2023-12-17T11:46:48.280 INFO:teuthology.orchestra.run.smithi159.stdout: Cleanup : NetworkManager-1:1.44.0-2.el9.x86_64 159/164 2023-12-17T11:46:48.596 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 159/164 2023-12-17T11:46:48.596 INFO:teuthology.orchestra.run.smithi159.stdout: Cleanup : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 160/164 2023-12-17T11:46:48.738 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: NetworkManager-libnm-1:1.44.0-2.el9.x86_64 160/164 2023-12-17T11:46:48.774 INFO:teuthology.orchestra.run.smithi159.stdout: Cleanup : openssl-libs-1:3.0.7-24.el9.x86_64 161/164 2023-12-17T11:46:48.807 INFO:teuthology.orchestra.run.smithi159.stdout: Cleanup : libacl-2.3.1-3.el9.x86_64 162/164 2023-12-17T11:46:48.843 INFO:teuthology.orchestra.run.smithi159.stdout: Cleanup : elfutils-libelf-0.189-3.el9.x86_64 163/164 2023-12-17T11:46:48.967 INFO:teuthology.orchestra.run.smithi159.stdout: Cleanup : xfsdump-3.1.12-3.el9.x86_64 164/164 2023-12-17T11:46:49.229 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: xfsdump-3.1.12-3.el9.x86_64 164/164 2023-12-17T11:46:49.229 INFO:teuthology.orchestra.run.smithi159.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2023-12-17T11:46:49.229 INFO:teuthology.orchestra.run.smithi159.stdout: 2023-12-17T11:46:50.466 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : ceph-2:19.0.0-119.ga62fda73.el9.x86_64 1/164 2023-12-17T11:46:50.467 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : ceph-base-2:19.0.0-119.ga62fda73.el9.x86_64 2/164 2023-12-17T11:46:50.467 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : ceph-common-2:19.0.0-119.ga62fda73.el9.x86_64 3/164 2023-12-17T11:46:50.467 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : ceph-fuse-2:19.0.0-119.ga62fda73.el9.x86_64 4/164 2023-12-17T11:46:50.467 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-119.ga62fda 5/164 2023-12-17T11:46:50.467 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : ceph-mds-2:19.0.0-119.ga62fda73.el9.x86_64 6/164 2023-12-17T11:46:50.467 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : ceph-mgr-2:19.0.0-119.ga62fda73.el9.x86_64 7/164 2023-12-17T11:46:50.467 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : ceph-mon-2:19.0.0-119.ga62fda73.el9.x86_64 8/164 2023-12-17T11:46:50.467 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : ceph-osd-2:19.0.0-119.ga62fda73.el9.x86_64 9/164 2023-12-17T11:46:50.467 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : ceph-radosgw-2:19.0.0-119.ga62fda73.el9.x86_64 10/164 2023-12-17T11:46:50.467 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : ceph-selinux-2:19.0.0-119.ga62fda73.el9.x86_64 11/164 2023-12-17T11:46:50.467 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : ceph-test-2:19.0.0-119.ga62fda73.el9.x86_64 12/164 2023-12-17T11:46:50.467 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : cephfs-mirror-2:19.0.0-119.ga62fda73.el9.x86_64 13/164 2023-12-17T11:46:50.467 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : libcephfs-devel-2:19.0.0-119.ga62fda73.el9.x86_6 14/164 2023-12-17T11:46:50.468 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : libcephfs2-2:19.0.0-119.ga62fda73.el9.x86_64 15/164 2023-12-17T11:46:50.468 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : libcephsqlite-2:19.0.0-119.ga62fda73.el9.x86_64 16/164 2023-12-17T11:46:50.468 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : librados-devel-2:19.0.0-119.ga62fda73.el9.x86_64 17/164 2023-12-17T11:46:50.468 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : libradosstriper1-2:19.0.0-119.ga62fda73.el9.x86_ 18/164 2023-12-17T11:46:50.468 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : librgw2-2:19.0.0-119.ga62fda73.el9.x86_64 19/164 2023-12-17T11:46:50.468 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-ceph-argparse-2:19.0.0-119.ga62fda73.el9 20/164 2023-12-17T11:46:50.468 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-ceph-common-2:19.0.0-119.ga62fda73.el9.x 21/164 2023-12-17T11:46:50.468 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-cephfs-2:19.0.0-119.ga62fda73.el9.x86_64 22/164 2023-12-17T11:46:50.468 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-rados-2:19.0.0-119.ga62fda73.el9.x86_64 23/164 2023-12-17T11:46:50.468 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-rbd-2:19.0.0-119.ga62fda73.el9.x86_64 24/164 2023-12-17T11:46:50.468 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-rgw-2:19.0.0-119.ga62fda73.el9.x86_64 25/164 2023-12-17T11:46:50.468 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : rbd-fuse-2:19.0.0-119.ga62fda73.el9.x86_64 26/164 2023-12-17T11:46:50.468 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : rbd-mirror-2:19.0.0-119.ga62fda73.el9.x86_64 27/164 2023-12-17T11:46:50.481 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : rbd-nbd-2:19.0.0-119.ga62fda73.el9.x86_64 28/164 2023-12-17T11:46:50.481 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-119.ga62fda73.e 29/164 2023-12-17T11:46:50.481 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-119.ga62fda73.el9.noar 30/164 2023-12-17T11:46:50.481 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-119.ga62fda73.el9.no 31/164 2023-12-17T11:46:50.481 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-119.ga62f 32/164 2023-12-17T11:46:50.481 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-119.ga62fda73.el9 33/164 2023-12-17T11:46:50.481 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : ceph-mgr-rook-2:19.0.0-119.ga62fda73.el9.noarch 34/164 2023-12-17T11:46:50.481 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-119.ga62fda73.el 35/164 2023-12-17T11:46:50.482 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : ceph-volume-2:19.0.0-119.ga62fda73.el9.noarch 36/164 2023-12-17T11:46:50.482 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : cephadm-2:19.0.0-119.ga62fda73.el9.noarch 37/164 2023-12-17T11:46:50.482 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : cephfs-top-2:19.0.0-119.ga62fda73.el9.noarch 38/164 2023-12-17T11:46:50.482 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : automake-1.16.2-8.el9.noarch 39/164 2023-12-17T11:46:50.482 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : bison-3.7.4-5.el9.x86_64 40/164 2023-12-17T11:46:50.482 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 41/164 2023-12-17T11:46:50.482 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : elfutils-libelf-devel-0.190-1.el9.x86_64 42/164 2023-12-17T11:46:50.482 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : flex-2.6.4-9.el9.x86_64 43/164 2023-12-17T11:46:50.482 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 44/164 2023-12-17T11:46:50.482 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 45/164 2023-12-17T11:46:50.482 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 46/164 2023-12-17T11:46:50.482 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : jq-1.6-16.el9.x86_64 47/164 2023-12-17T11:46:50.482 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 48/164 2023-12-17T11:46:50.483 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 49/164 2023-12-17T11:46:50.483 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 50/164 2023-12-17T11:46:50.483 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 51/164 2023-12-17T11:46:50.483 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 52/164 2023-12-17T11:46:50.483 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : libuuid-devel-2.37.4-15.el9.x86_64 53/164 2023-12-17T11:46:50.483 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 54/164 2023-12-17T11:46:50.483 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 55/164 2023-12-17T11:46:50.483 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : lua-5.4.4-4.el9.x86_64 56/164 2023-12-17T11:46:50.483 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 57/164 2023-12-17T11:46:50.483 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 58/164 2023-12-17T11:46:50.483 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 59/164 2023-12-17T11:46:50.483 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : postgresql-13.11-1.el9.x86_64 60/164 2023-12-17T11:46:50.483 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : postgresql-contrib-13.11-1.el9.x86_64 61/164 2023-12-17T11:46:50.484 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : postgresql-private-libs-13.11-1.el9.x86_64 62/164 2023-12-17T11:46:50.484 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : postgresql-server-13.11-1.el9.x86_64 63/164 2023-12-17T11:46:50.484 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 64/164 2023-12-17T11:46:50.484 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-jinja2-2.11.3-4.el9.noarch 65/164 2023-12-17T11:46:50.484 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 66/164 2023-12-17T11:46:50.484 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 67/164 2023-12-17T11:46:50.484 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 68/164 2023-12-17T11:46:50.484 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 69/164 2023-12-17T11:46:50.484 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 70/164 2023-12-17T11:46:50.484 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 71/164 2023-12-17T11:46:50.484 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 72/164 2023-12-17T11:46:50.484 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 73/164 2023-12-17T11:46:50.484 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 74/164 2023-12-17T11:46:50.484 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 75/164 2023-12-17T11:46:50.485 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 76/164 2023-12-17T11:46:50.485 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 77/164 2023-12-17T11:46:50.485 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 78/164 2023-12-17T11:46:50.485 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 79/164 2023-12-17T11:46:50.485 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 80/164 2023-12-17T11:46:50.485 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 81/164 2023-12-17T11:46:50.485 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : xfsprogs-devel-5.19.0-4.el9.x86_64 82/164 2023-12-17T11:46:50.485 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 83/164 2023-12-17T11:46:50.485 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : zlib-devel-1.2.11-40.el9.x86_64 84/164 2023-12-17T11:46:50.485 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 85/164 2023-12-17T11:46:50.485 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : libgfortran-11.4.1-2.3.el9.x86_64 86/164 2023-12-17T11:46:50.485 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : libquadmath-11.4.1-2.3.el9.x86_64 87/164 2023-12-17T11:46:50.485 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 88/164 2023-12-17T11:46:50.486 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 89/164 2023-12-17T11:46:50.486 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-ply-3.11-14.el9.noarch 90/164 2023-12-17T11:46:50.486 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 91/164 2023-12-17T11:46:50.486 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-requests-2.25.1-7.el9.noarch 92/164 2023-12-17T11:46:50.486 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-urllib3-1.26.5-4.el9.noarch 93/164 2023-12-17T11:46:50.486 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : openssl-devel-1:3.0.7-25.el9.x86_64 94/164 2023-12-17T11:46:50.486 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 95/164 2023-12-17T11:46:50.486 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 96/164 2023-12-17T11:46:50.486 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : libarrow-9.0.0-10.el9.x86_64 97/164 2023-12-17T11:46:50.487 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : libarrow-doc-9.0.0-10.el9.noarch 98/164 2023-12-17T11:46:50.487 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 99/164 2023-12-17T11:46:50.487 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 100/164 2023-12-17T11:46:50.487 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 101/164 2023-12-17T11:46:50.487 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : parquet-libs-9.0.0-10.el9.x86_64 102/164 2023-12-17T11:46:50.487 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-asyncssh-2.13.2-3.el9.noarch 103/164 2023-12-17T11:46:50.487 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 104/164 2023-12-17T11:46:50.487 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 105/164 2023-12-17T11:46:50.487 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 106/164 2023-12-17T11:46:50.487 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 107/164 2023-12-17T11:46:50.487 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 108/164 2023-12-17T11:46:50.487 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-google-auth-1:2.23.4-1.el9.noarch 109/164 2023-12-17T11:46:50.487 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 110/164 2023-12-17T11:46:50.488 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 111/164 2023-12-17T11:46:50.488 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 112/164 2023-12-17T11:46:50.488 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 113/164 2023-12-17T11:46:50.488 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 114/164 2023-12-17T11:46:50.488 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-jwt+crypto-2.4.0-1.el9.noarch 115/164 2023-12-17T11:46:50.488 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-jwt-2.4.0-1.el9.noarch 116/164 2023-12-17T11:46:50.488 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 117/164 2023-12-17T11:46:50.488 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 118/164 2023-12-17T11:46:50.488 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 119/164 2023-12-17T11:46:50.488 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 120/164 2023-12-17T11:46:50.488 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 121/164 2023-12-17T11:46:50.488 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 122/164 2023-12-17T11:46:50.488 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 123/164 2023-12-17T11:46:50.488 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 124/164 2023-12-17T11:46:50.489 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 125/164 2023-12-17T11:46:50.489 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 126/164 2023-12-17T11:46:50.489 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 127/164 2023-12-17T11:46:50.489 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 128/164 2023-12-17T11:46:50.489 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 129/164 2023-12-17T11:46:50.489 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 130/164 2023-12-17T11:46:50.489 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 131/164 2023-12-17T11:46:50.489 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 132/164 2023-12-17T11:46:50.489 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : re2-1:20211101-3.el9.x86_64 133/164 2023-12-17T11:46:50.489 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 134/164 2023-12-17T11:46:50.490 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : librados2-2:19.0.0-119.ga62fda73.el9.x86_64 135/164 2023-12-17T11:46:50.490 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 136/164 2023-12-17T11:46:50.490 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : librbd1-2:19.0.0-119.ga62fda73.el9.x86_64 137/164 2023-12-17T11:46:50.490 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 138/164 2023-12-17T11:46:50.490 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : libacl-devel-2.3.1-4.el9.x86_64 139/164 2023-12-17T11:46:50.490 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : libacl-devel-2.3.1-3.el9.x86_64 140/164 2023-12-17T11:46:50.490 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : acl-2.3.1-4.el9.x86_64 141/164 2023-12-17T11:46:50.490 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : acl-2.3.1-3.el9.x86_64 142/164 2023-12-17T11:46:50.490 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : elfutils-debuginfod-client-0.190-1.el9.x86_64 143/164 2023-12-17T11:46:50.490 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : elfutils-debuginfod-client-0.189-3.el9.x86_64 144/164 2023-12-17T11:46:50.490 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : elfutils-libelf-0.190-1.el9.x86_64 145/164 2023-12-17T11:46:50.490 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : elfutils-libelf-0.189-3.el9.x86_64 146/164 2023-12-17T11:46:50.490 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : elfutils-libs-0.190-1.el9.x86_64 147/164 2023-12-17T11:46:50.490 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : elfutils-libs-0.189-3.el9.x86_64 148/164 2023-12-17T11:46:50.490 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : libacl-2.3.1-4.el9.x86_64 149/164 2023-12-17T11:46:50.491 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : libacl-2.3.1-3.el9.x86_64 150/164 2023-12-17T11:46:50.491 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : xfsdump-3.1.12-4.el9.x86_64 151/164 2023-12-17T11:46:50.491 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : xfsdump-3.1.12-3.el9.x86_64 152/164 2023-12-17T11:46:50.491 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : NetworkManager-1:1.45.7-1.el9.x86_64 153/164 2023-12-17T11:46:50.491 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : NetworkManager-1:1.44.0-2.el9.x86_64 154/164 2023-12-17T11:46:50.491 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : NetworkManager-libnm-1:1.45.7-1.el9.x86_64 155/164 2023-12-17T11:46:50.491 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 156/164 2023-12-17T11:46:50.491 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : NetworkManager-team-1:1.45.7-1.el9.x86_64 157/164 2023-12-17T11:46:50.491 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : NetworkManager-team-1:1.44.0-2.el9.x86_64 158/164 2023-12-17T11:46:50.491 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : NetworkManager-tui-1:1.45.7-1.el9.x86_64 159/164 2023-12-17T11:46:50.491 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : NetworkManager-tui-1:1.44.0-2.el9.x86_64 160/164 2023-12-17T11:46:50.491 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : openssl-1:3.0.7-25.el9.x86_64 161/164 2023-12-17T11:46:50.491 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : openssl-1:3.0.7-24.el9.x86_64 162/164 2023-12-17T11:46:50.491 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : openssl-libs-1:3.0.7-25.el9.x86_64 163/164 2023-12-17T11:46:52.747 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : openssl-libs-1:3.0.7-24.el9.x86_64 164/164 2023-12-17T11:46:52.747 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T11:46:52.747 INFO:teuthology.orchestra.run.smithi040.stdout:Upgraded: 2023-12-17T11:46:52.747 INFO:teuthology.orchestra.run.smithi040.stdout: NetworkManager-1:1.45.7-1.el9.x86_64 2023-12-17T11:46:52.748 INFO:teuthology.orchestra.run.smithi040.stdout: NetworkManager-libnm-1:1.45.7-1.el9.x86_64 2023-12-17T11:46:52.748 INFO:teuthology.orchestra.run.smithi040.stdout: NetworkManager-team-1:1.45.7-1.el9.x86_64 2023-12-17T11:46:52.748 INFO:teuthology.orchestra.run.smithi040.stdout: NetworkManager-tui-1:1.45.7-1.el9.x86_64 2023-12-17T11:46:52.748 INFO:teuthology.orchestra.run.smithi040.stdout: acl-2.3.1-4.el9.x86_64 2023-12-17T11:46:52.748 INFO:teuthology.orchestra.run.smithi040.stdout: elfutils-debuginfod-client-0.190-1.el9.x86_64 2023-12-17T11:46:52.748 INFO:teuthology.orchestra.run.smithi040.stdout: elfutils-libelf-0.190-1.el9.x86_64 2023-12-17T11:46:52.748 INFO:teuthology.orchestra.run.smithi040.stdout: elfutils-libs-0.190-1.el9.x86_64 2023-12-17T11:46:52.748 INFO:teuthology.orchestra.run.smithi040.stdout: libacl-2.3.1-4.el9.x86_64 2023-12-17T11:46:52.748 INFO:teuthology.orchestra.run.smithi040.stdout: libacl-devel-2.3.1-4.el9.x86_64 2023-12-17T11:46:52.748 INFO:teuthology.orchestra.run.smithi040.stdout: librados2-2:19.0.0-119.ga62fda73.el9.x86_64 2023-12-17T11:46:52.748 INFO:teuthology.orchestra.run.smithi040.stdout: librbd1-2:19.0.0-119.ga62fda73.el9.x86_64 2023-12-17T11:46:52.748 INFO:teuthology.orchestra.run.smithi040.stdout: openssl-1:3.0.7-25.el9.x86_64 2023-12-17T11:46:52.748 INFO:teuthology.orchestra.run.smithi040.stdout: openssl-libs-1:3.0.7-25.el9.x86_64 2023-12-17T11:46:52.749 INFO:teuthology.orchestra.run.smithi040.stdout: xfsdump-3.1.12-4.el9.x86_64 2023-12-17T11:46:52.749 INFO:teuthology.orchestra.run.smithi040.stdout:Installed: 2023-12-17T11:46:52.749 INFO:teuthology.orchestra.run.smithi040.stdout: automake-1.16.2-8.el9.noarch 2023-12-17T11:46:52.749 INFO:teuthology.orchestra.run.smithi040.stdout: bison-3.7.4-5.el9.x86_64 2023-12-17T11:46:52.749 INFO:teuthology.orchestra.run.smithi040.stdout: boost-program-options-1.75.0-8.el9.x86_64 2023-12-17T11:46:52.749 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-2:19.0.0-119.ga62fda73.el9.x86_64 2023-12-17T11:46:52.749 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-base-2:19.0.0-119.ga62fda73.el9.x86_64 2023-12-17T11:46:52.749 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-common-2:19.0.0-119.ga62fda73.el9.x86_64 2023-12-17T11:46:52.749 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-fuse-2:19.0.0-119.ga62fda73.el9.x86_64 2023-12-17T11:46:52.749 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-grafana-dashboards-2:19.0.0-119.ga62fda73.el9.noarch 2023-12-17T11:46:52.749 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-immutable-object-cache-2:19.0.0-119.ga62fda73.el9.x86_64 2023-12-17T11:46:52.749 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-mds-2:19.0.0-119.ga62fda73.el9.x86_64 2023-12-17T11:46:52.749 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-mgr-2:19.0.0-119.ga62fda73.el9.x86_64 2023-12-17T11:46:52.749 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-mgr-cephadm-2:19.0.0-119.ga62fda73.el9.noarch 2023-12-17T11:46:52.750 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-mgr-dashboard-2:19.0.0-119.ga62fda73.el9.noarch 2023-12-17T11:46:52.750 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-mgr-diskprediction-local-2:19.0.0-119.ga62fda73.el9.noarch 2023-12-17T11:46:52.750 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-mgr-modules-core-2:19.0.0-119.ga62fda73.el9.noarch 2023-12-17T11:46:52.750 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-mgr-rook-2:19.0.0-119.ga62fda73.el9.noarch 2023-12-17T11:46:52.750 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-mon-2:19.0.0-119.ga62fda73.el9.x86_64 2023-12-17T11:46:52.750 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-osd-2:19.0.0-119.ga62fda73.el9.x86_64 2023-12-17T11:46:52.750 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-prometheus-alerts-2:19.0.0-119.ga62fda73.el9.noarch 2023-12-17T11:46:52.750 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-radosgw-2:19.0.0-119.ga62fda73.el9.x86_64 2023-12-17T11:46:52.750 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-selinux-2:19.0.0-119.ga62fda73.el9.x86_64 2023-12-17T11:46:52.750 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-test-2:19.0.0-119.ga62fda73.el9.x86_64 2023-12-17T11:46:52.750 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-volume-2:19.0.0-119.ga62fda73.el9.noarch 2023-12-17T11:46:52.750 INFO:teuthology.orchestra.run.smithi040.stdout: cephadm-2:19.0.0-119.ga62fda73.el9.noarch 2023-12-17T11:46:52.750 INFO:teuthology.orchestra.run.smithi040.stdout: cephfs-mirror-2:19.0.0-119.ga62fda73.el9.x86_64 2023-12-17T11:46:52.750 INFO:teuthology.orchestra.run.smithi040.stdout: cephfs-top-2:19.0.0-119.ga62fda73.el9.noarch 2023-12-17T11:46:52.751 INFO:teuthology.orchestra.run.smithi040.stdout: elfutils-libelf-devel-0.190-1.el9.x86_64 2023-12-17T11:46:52.751 INFO:teuthology.orchestra.run.smithi040.stdout: flex-2.6.4-9.el9.x86_64 2023-12-17T11:46:52.751 INFO:teuthology.orchestra.run.smithi040.stdout: flexiblas-3.0.4-8.el9.x86_64 2023-12-17T11:46:52.751 INFO:teuthology.orchestra.run.smithi040.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2023-12-17T11:46:52.751 INFO:teuthology.orchestra.run.smithi040.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2023-12-17T11:46:52.751 INFO:teuthology.orchestra.run.smithi040.stdout: fuse-2.9.9-15.el9.x86_64 2023-12-17T11:46:52.751 INFO:teuthology.orchestra.run.smithi040.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2023-12-17T11:46:52.751 INFO:teuthology.orchestra.run.smithi040.stdout: jq-1.6-16.el9.x86_64 2023-12-17T11:46:52.751 INFO:teuthology.orchestra.run.smithi040.stdout: libaio-devel-0.3.111-13.el9.x86_64 2023-12-17T11:46:52.751 INFO:teuthology.orchestra.run.smithi040.stdout: libarrow-9.0.0-10.el9.x86_64 2023-12-17T11:46:52.751 INFO:teuthology.orchestra.run.smithi040.stdout: libarrow-doc-9.0.0-10.el9.noarch 2023-12-17T11:46:52.751 INFO:teuthology.orchestra.run.smithi040.stdout: libcephfs-devel-2:19.0.0-119.ga62fda73.el9.x86_64 2023-12-17T11:46:52.751 INFO:teuthology.orchestra.run.smithi040.stdout: libcephfs2-2:19.0.0-119.ga62fda73.el9.x86_64 2023-12-17T11:46:52.751 INFO:teuthology.orchestra.run.smithi040.stdout: libcephsqlite-2:19.0.0-119.ga62fda73.el9.x86_64 2023-12-17T11:46:52.751 INFO:teuthology.orchestra.run.smithi040.stdout: libgfortran-11.4.1-2.3.el9.x86_64 2023-12-17T11:46:52.752 INFO:teuthology.orchestra.run.smithi040.stdout: liboath-2.6.7-2.el9.x86_64 2023-12-17T11:46:52.752 INFO:teuthology.orchestra.run.smithi040.stdout: libpmemobj-1.12.1-1.el9.x86_64 2023-12-17T11:46:52.752 INFO:teuthology.orchestra.run.smithi040.stdout: libquadmath-11.4.1-2.3.el9.x86_64 2023-12-17T11:46:52.752 INFO:teuthology.orchestra.run.smithi040.stdout: librabbitmq-0.11.0-7.el9.x86_64 2023-12-17T11:46:52.752 INFO:teuthology.orchestra.run.smithi040.stdout: librados-devel-2:19.0.0-119.ga62fda73.el9.x86_64 2023-12-17T11:46:52.752 INFO:teuthology.orchestra.run.smithi040.stdout: libradosstriper1-2:19.0.0-119.ga62fda73.el9.x86_64 2023-12-17T11:46:52.752 INFO:teuthology.orchestra.run.smithi040.stdout: librdkafka-1.6.1-102.el9.x86_64 2023-12-17T11:46:52.752 INFO:teuthology.orchestra.run.smithi040.stdout: librgw2-2:19.0.0-119.ga62fda73.el9.x86_64 2023-12-17T11:46:52.752 INFO:teuthology.orchestra.run.smithi040.stdout: libtool-2.4.6-45.el9.x86_64 2023-12-17T11:46:52.752 INFO:teuthology.orchestra.run.smithi040.stdout: libunwind-1.6.2-1.el9.x86_64 2023-12-17T11:46:52.752 INFO:teuthology.orchestra.run.smithi040.stdout: libuuid-devel-2.37.4-15.el9.x86_64 2023-12-17T11:46:52.752 INFO:teuthology.orchestra.run.smithi040.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2023-12-17T11:46:52.752 INFO:teuthology.orchestra.run.smithi040.stdout: lttng-ust-2.12.0-6.el9.x86_64 2023-12-17T11:46:52.752 INFO:teuthology.orchestra.run.smithi040.stdout: lua-5.4.4-4.el9.x86_64 2023-12-17T11:46:52.753 INFO:teuthology.orchestra.run.smithi040.stdout: luarocks-3.9.2-1.el9.noarch 2023-12-17T11:46:52.753 INFO:teuthology.orchestra.run.smithi040.stdout: oniguruma-6.9.6-1.el9.5.x86_64 2023-12-17T11:46:52.753 INFO:teuthology.orchestra.run.smithi040.stdout: openblas-0.3.21-2.el9.x86_64 2023-12-17T11:46:52.753 INFO:teuthology.orchestra.run.smithi040.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2023-12-17T11:46:52.753 INFO:teuthology.orchestra.run.smithi040.stdout: openssl-devel-1:3.0.7-25.el9.x86_64 2023-12-17T11:46:52.753 INFO:teuthology.orchestra.run.smithi040.stdout: parquet-libs-9.0.0-10.el9.x86_64 2023-12-17T11:46:52.753 INFO:teuthology.orchestra.run.smithi040.stdout: postgresql-13.11-1.el9.x86_64 2023-12-17T11:46:52.753 INFO:teuthology.orchestra.run.smithi040.stdout: postgresql-contrib-13.11-1.el9.x86_64 2023-12-17T11:46:52.753 INFO:teuthology.orchestra.run.smithi040.stdout: postgresql-private-libs-13.11-1.el9.x86_64 2023-12-17T11:46:52.753 INFO:teuthology.orchestra.run.smithi040.stdout: postgresql-server-13.11-1.el9.x86_64 2023-12-17T11:46:52.753 INFO:teuthology.orchestra.run.smithi040.stdout: python3-asyncssh-2.13.2-3.el9.noarch 2023-12-17T11:46:52.753 INFO:teuthology.orchestra.run.smithi040.stdout: python3-babel-2.9.1-2.el9.noarch 2023-12-17T11:46:52.753 INFO:teuthology.orchestra.run.smithi040.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2023-12-17T11:46:52.753 INFO:teuthology.orchestra.run.smithi040.stdout: python3-cachetools-4.2.4-1.el9.noarch 2023-12-17T11:46:52.754 INFO:teuthology.orchestra.run.smithi040.stdout: python3-ceph-argparse-2:19.0.0-119.ga62fda73.el9.x86_64 2023-12-17T11:46:52.754 INFO:teuthology.orchestra.run.smithi040.stdout: python3-ceph-common-2:19.0.0-119.ga62fda73.el9.x86_64 2023-12-17T11:46:52.754 INFO:teuthology.orchestra.run.smithi040.stdout: python3-cephfs-2:19.0.0-119.ga62fda73.el9.x86_64 2023-12-17T11:46:52.754 INFO:teuthology.orchestra.run.smithi040.stdout: python3-certifi-2021.10.8-2.el9.noarch 2023-12-17T11:46:52.754 INFO:teuthology.orchestra.run.smithi040.stdout: python3-cffi-1.14.5-5.el9.x86_64 2023-12-17T11:46:52.754 INFO:teuthology.orchestra.run.smithi040.stdout: python3-cheroot-8.6.0-4.el9.noarch 2023-12-17T11:46:52.754 INFO:teuthology.orchestra.run.smithi040.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2023-12-17T11:46:52.754 INFO:teuthology.orchestra.run.smithi040.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2023-12-17T11:46:52.754 INFO:teuthology.orchestra.run.smithi040.stdout: python3-devel-3.9.17-2.el9.x86_64 2023-12-17T11:46:52.754 INFO:teuthology.orchestra.run.smithi040.stdout: python3-google-auth-1:2.23.4-1.el9.noarch 2023-12-17T11:46:52.754 INFO:teuthology.orchestra.run.smithi040.stdout: python3-jaraco-8.2.1-3.el9.noarch 2023-12-17T11:46:52.754 INFO:teuthology.orchestra.run.smithi040.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2023-12-17T11:46:52.754 INFO:teuthology.orchestra.run.smithi040.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2023-12-17T11:46:52.754 INFO:teuthology.orchestra.run.smithi040.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2023-12-17T11:46:52.755 INFO:teuthology.orchestra.run.smithi040.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2023-12-17T11:46:52.755 INFO:teuthology.orchestra.run.smithi040.stdout: python3-jinja2-2.11.3-4.el9.noarch 2023-12-17T11:46:52.755 INFO:teuthology.orchestra.run.smithi040.stdout: python3-jsonpatch-1.21-16.el9.noarch 2023-12-17T11:46:52.755 INFO:teuthology.orchestra.run.smithi040.stdout: python3-jsonpointer-2.0-4.el9.noarch 2023-12-17T11:46:52.755 INFO:teuthology.orchestra.run.smithi040.stdout: python3-jwt-2.4.0-1.el9.noarch 2023-12-17T11:46:52.755 INFO:teuthology.orchestra.run.smithi040.stdout: python3-jwt+crypto-2.4.0-1.el9.noarch 2023-12-17T11:46:52.755 INFO:teuthology.orchestra.run.smithi040.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2023-12-17T11:46:52.755 INFO:teuthology.orchestra.run.smithi040.stdout: python3-logutils-0.3.5-21.el9.noarch 2023-12-17T11:46:52.755 INFO:teuthology.orchestra.run.smithi040.stdout: python3-mako-1.1.4-6.el9.noarch 2023-12-17T11:46:52.755 INFO:teuthology.orchestra.run.smithi040.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2023-12-17T11:46:52.755 INFO:teuthology.orchestra.run.smithi040.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2023-12-17T11:46:52.755 INFO:teuthology.orchestra.run.smithi040.stdout: python3-natsort-7.1.1-5.el9.noarch 2023-12-17T11:46:52.755 INFO:teuthology.orchestra.run.smithi040.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2023-12-17T11:46:52.755 INFO:teuthology.orchestra.run.smithi040.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2023-12-17T11:46:52.756 INFO:teuthology.orchestra.run.smithi040.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2023-12-17T11:46:52.756 INFO:teuthology.orchestra.run.smithi040.stdout: python3-pecan-1.4.2-3.el9.noarch 2023-12-17T11:46:52.756 INFO:teuthology.orchestra.run.smithi040.stdout: python3-ply-3.11-14.el9.noarch 2023-12-17T11:46:52.756 INFO:teuthology.orchestra.run.smithi040.stdout: python3-portend-3.1.0-2.el9.noarch 2023-12-17T11:46:52.756 INFO:teuthology.orchestra.run.smithi040.stdout: python3-prettytable-0.7.2-27.el9.noarch 2023-12-17T11:46:52.756 INFO:teuthology.orchestra.run.smithi040.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2023-12-17T11:46:52.756 INFO:teuthology.orchestra.run.smithi040.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2023-12-17T11:46:52.756 INFO:teuthology.orchestra.run.smithi040.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2023-12-17T11:46:52.756 INFO:teuthology.orchestra.run.smithi040.stdout: python3-pycparser-2.20-6.el9.noarch 2023-12-17T11:46:52.756 INFO:teuthology.orchestra.run.smithi040.stdout: python3-pytz-2021.1-5.el9.noarch 2023-12-17T11:46:52.756 INFO:teuthology.orchestra.run.smithi040.stdout: python3-rados-2:19.0.0-119.ga62fda73.el9.x86_64 2023-12-17T11:46:52.756 INFO:teuthology.orchestra.run.smithi040.stdout: python3-rbd-2:19.0.0-119.ga62fda73.el9.x86_64 2023-12-17T11:46:52.756 INFO:teuthology.orchestra.run.smithi040.stdout: python3-repoze-lru-0.7-16.el9.noarch 2023-12-17T11:46:52.756 INFO:teuthology.orchestra.run.smithi040.stdout: python3-requests-2.25.1-7.el9.noarch 2023-12-17T11:46:52.756 INFO:teuthology.orchestra.run.smithi040.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2023-12-17T11:46:52.757 INFO:teuthology.orchestra.run.smithi040.stdout: python3-rgw-2:19.0.0-119.ga62fda73.el9.x86_64 2023-12-17T11:46:52.757 INFO:teuthology.orchestra.run.smithi040.stdout: python3-routes-2.5.1-5.el9.noarch 2023-12-17T11:46:52.757 INFO:teuthology.orchestra.run.smithi040.stdout: python3-rsa-4.9-2.el9.noarch 2023-12-17T11:46:52.757 INFO:teuthology.orchestra.run.smithi040.stdout: python3-scipy-1.6.2-8.el9.x86_64 2023-12-17T11:46:52.757 INFO:teuthology.orchestra.run.smithi040.stdout: python3-tempora-5.0.0-2.el9.noarch 2023-12-17T11:46:52.757 INFO:teuthology.orchestra.run.smithi040.stdout: python3-toml-0.10.2-6.el9.noarch 2023-12-17T11:46:52.757 INFO:teuthology.orchestra.run.smithi040.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2023-12-17T11:46:52.757 INFO:teuthology.orchestra.run.smithi040.stdout: python3-urllib3-1.26.5-4.el9.noarch 2023-12-17T11:46:52.757 INFO:teuthology.orchestra.run.smithi040.stdout: python3-webob-1.8.7-6.el9.noarch 2023-12-17T11:46:52.757 INFO:teuthology.orchestra.run.smithi040.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2023-12-17T11:46:52.757 INFO:teuthology.orchestra.run.smithi040.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2023-12-17T11:46:52.757 INFO:teuthology.orchestra.run.smithi040.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2023-12-17T11:46:52.757 INFO:teuthology.orchestra.run.smithi040.stdout: rbd-fuse-2:19.0.0-119.ga62fda73.el9.x86_64 2023-12-17T11:46:52.757 INFO:teuthology.orchestra.run.smithi040.stdout: rbd-mirror-2:19.0.0-119.ga62fda73.el9.x86_64 2023-12-17T11:46:52.758 INFO:teuthology.orchestra.run.smithi040.stdout: rbd-nbd-2:19.0.0-119.ga62fda73.el9.x86_64 2023-12-17T11:46:52.758 INFO:teuthology.orchestra.run.smithi040.stdout: re2-1:20211101-3.el9.x86_64 2023-12-17T11:46:52.758 INFO:teuthology.orchestra.run.smithi040.stdout: socat-1.7.4.1-5.el9.x86_64 2023-12-17T11:46:52.758 INFO:teuthology.orchestra.run.smithi040.stdout: thrift-0.15.0-2.el9.x86_64 2023-12-17T11:46:52.758 INFO:teuthology.orchestra.run.smithi040.stdout: uuid-1.6.2-55.el9.x86_64 2023-12-17T11:46:52.758 INFO:teuthology.orchestra.run.smithi040.stdout: xfsprogs-devel-5.19.0-4.el9.x86_64 2023-12-17T11:46:52.758 INFO:teuthology.orchestra.run.smithi040.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2023-12-17T11:46:52.758 INFO:teuthology.orchestra.run.smithi040.stdout: zlib-devel-1.2.11-40.el9.x86_64 2023-12-17T11:46:52.759 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T11:46:52.759 INFO:teuthology.orchestra.run.smithi040.stdout:Complete! 2023-12-17T11:46:53.361 DEBUG:teuthology.parallel:result is None 2023-12-17T11:46:53.876 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : ceph-2:19.0.0-119.ga62fda73.el9.x86_64 1/164 2023-12-17T11:46:53.877 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : ceph-base-2:19.0.0-119.ga62fda73.el9.x86_64 2/164 2023-12-17T11:46:53.877 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : ceph-common-2:19.0.0-119.ga62fda73.el9.x86_64 3/164 2023-12-17T11:46:53.877 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : ceph-fuse-2:19.0.0-119.ga62fda73.el9.x86_64 4/164 2023-12-17T11:46:53.877 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-119.ga62fda 5/164 2023-12-17T11:46:53.877 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : ceph-mds-2:19.0.0-119.ga62fda73.el9.x86_64 6/164 2023-12-17T11:46:53.877 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : ceph-mgr-2:19.0.0-119.ga62fda73.el9.x86_64 7/164 2023-12-17T11:46:53.877 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : ceph-mon-2:19.0.0-119.ga62fda73.el9.x86_64 8/164 2023-12-17T11:46:53.878 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : ceph-osd-2:19.0.0-119.ga62fda73.el9.x86_64 9/164 2023-12-17T11:46:53.878 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : ceph-radosgw-2:19.0.0-119.ga62fda73.el9.x86_64 10/164 2023-12-17T11:46:53.878 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : ceph-selinux-2:19.0.0-119.ga62fda73.el9.x86_64 11/164 2023-12-17T11:46:53.878 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : ceph-test-2:19.0.0-119.ga62fda73.el9.x86_64 12/164 2023-12-17T11:46:53.878 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : cephfs-mirror-2:19.0.0-119.ga62fda73.el9.x86_64 13/164 2023-12-17T11:46:53.878 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : libcephfs-devel-2:19.0.0-119.ga62fda73.el9.x86_6 14/164 2023-12-17T11:46:53.878 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : libcephfs2-2:19.0.0-119.ga62fda73.el9.x86_64 15/164 2023-12-17T11:46:53.878 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : libcephsqlite-2:19.0.0-119.ga62fda73.el9.x86_64 16/164 2023-12-17T11:46:53.879 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : librados-devel-2:19.0.0-119.ga62fda73.el9.x86_64 17/164 2023-12-17T11:46:53.879 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : libradosstriper1-2:19.0.0-119.ga62fda73.el9.x86_ 18/164 2023-12-17T11:46:53.879 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : librgw2-2:19.0.0-119.ga62fda73.el9.x86_64 19/164 2023-12-17T11:46:53.879 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-ceph-argparse-2:19.0.0-119.ga62fda73.el9 20/164 2023-12-17T11:46:53.879 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-ceph-common-2:19.0.0-119.ga62fda73.el9.x 21/164 2023-12-17T11:46:53.879 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-cephfs-2:19.0.0-119.ga62fda73.el9.x86_64 22/164 2023-12-17T11:46:53.879 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-rados-2:19.0.0-119.ga62fda73.el9.x86_64 23/164 2023-12-17T11:46:53.879 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-rbd-2:19.0.0-119.ga62fda73.el9.x86_64 24/164 2023-12-17T11:46:53.879 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-rgw-2:19.0.0-119.ga62fda73.el9.x86_64 25/164 2023-12-17T11:46:53.880 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : rbd-fuse-2:19.0.0-119.ga62fda73.el9.x86_64 26/164 2023-12-17T11:46:53.880 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : rbd-mirror-2:19.0.0-119.ga62fda73.el9.x86_64 27/164 2023-12-17T11:46:53.880 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : rbd-nbd-2:19.0.0-119.ga62fda73.el9.x86_64 28/164 2023-12-17T11:46:53.895 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-119.ga62fda73.e 29/164 2023-12-17T11:46:53.895 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-119.ga62fda73.el9.noar 30/164 2023-12-17T11:46:53.895 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-119.ga62fda73.el9.no 31/164 2023-12-17T11:46:53.895 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-119.ga62f 32/164 2023-12-17T11:46:53.896 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-119.ga62fda73.el9 33/164 2023-12-17T11:46:53.896 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : ceph-mgr-rook-2:19.0.0-119.ga62fda73.el9.noarch 34/164 2023-12-17T11:46:53.896 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-119.ga62fda73.el 35/164 2023-12-17T11:46:53.896 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : ceph-volume-2:19.0.0-119.ga62fda73.el9.noarch 36/164 2023-12-17T11:46:53.896 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : cephadm-2:19.0.0-119.ga62fda73.el9.noarch 37/164 2023-12-17T11:46:53.896 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : cephfs-top-2:19.0.0-119.ga62fda73.el9.noarch 38/164 2023-12-17T11:46:53.896 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : automake-1.16.2-8.el9.noarch 39/164 2023-12-17T11:46:53.897 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : bison-3.7.4-5.el9.x86_64 40/164 2023-12-17T11:46:53.897 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 41/164 2023-12-17T11:46:53.897 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : elfutils-libelf-devel-0.190-1.el9.x86_64 42/164 2023-12-17T11:46:53.897 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : flex-2.6.4-9.el9.x86_64 43/164 2023-12-17T11:46:53.897 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 44/164 2023-12-17T11:46:53.897 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 45/164 2023-12-17T11:46:53.897 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 46/164 2023-12-17T11:46:53.897 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : jq-1.6-16.el9.x86_64 47/164 2023-12-17T11:46:53.897 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 48/164 2023-12-17T11:46:53.897 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 49/164 2023-12-17T11:46:53.898 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 50/164 2023-12-17T11:46:53.898 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 51/164 2023-12-17T11:46:53.898 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 52/164 2023-12-17T11:46:53.898 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : libuuid-devel-2.37.4-15.el9.x86_64 53/164 2023-12-17T11:46:53.898 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 54/164 2023-12-17T11:46:53.898 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 55/164 2023-12-17T11:46:53.898 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : lua-5.4.4-4.el9.x86_64 56/164 2023-12-17T11:46:53.898 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 57/164 2023-12-17T11:46:53.898 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 58/164 2023-12-17T11:46:53.898 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 59/164 2023-12-17T11:46:53.898 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : postgresql-13.11-1.el9.x86_64 60/164 2023-12-17T11:46:53.898 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : postgresql-contrib-13.11-1.el9.x86_64 61/164 2023-12-17T11:46:53.898 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : postgresql-private-libs-13.11-1.el9.x86_64 62/164 2023-12-17T11:46:53.898 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : postgresql-server-13.11-1.el9.x86_64 63/164 2023-12-17T11:46:53.899 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 64/164 2023-12-17T11:46:53.899 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-jinja2-2.11.3-4.el9.noarch 65/164 2023-12-17T11:46:53.899 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 66/164 2023-12-17T11:46:53.899 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 67/164 2023-12-17T11:46:53.899 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 68/164 2023-12-17T11:46:53.899 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 69/164 2023-12-17T11:46:53.899 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 70/164 2023-12-17T11:46:53.899 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 71/164 2023-12-17T11:46:53.899 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 72/164 2023-12-17T11:46:53.899 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 73/164 2023-12-17T11:46:53.899 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 74/164 2023-12-17T11:46:53.899 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 75/164 2023-12-17T11:46:53.900 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 76/164 2023-12-17T11:46:53.900 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 77/164 2023-12-17T11:46:53.900 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 78/164 2023-12-17T11:46:53.900 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 79/164 2023-12-17T11:46:53.900 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 80/164 2023-12-17T11:46:53.900 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 81/164 2023-12-17T11:46:53.900 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : xfsprogs-devel-5.19.0-4.el9.x86_64 82/164 2023-12-17T11:46:53.900 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 83/164 2023-12-17T11:46:53.900 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : zlib-devel-1.2.11-40.el9.x86_64 84/164 2023-12-17T11:46:53.901 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 85/164 2023-12-17T11:46:53.901 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : libgfortran-11.4.1-2.3.el9.x86_64 86/164 2023-12-17T11:46:53.901 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : libquadmath-11.4.1-2.3.el9.x86_64 87/164 2023-12-17T11:46:53.901 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 88/164 2023-12-17T11:46:53.901 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 89/164 2023-12-17T11:46:53.901 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-ply-3.11-14.el9.noarch 90/164 2023-12-17T11:46:53.901 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 91/164 2023-12-17T11:46:53.901 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-requests-2.25.1-7.el9.noarch 92/164 2023-12-17T11:46:53.901 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-urllib3-1.26.5-4.el9.noarch 93/164 2023-12-17T11:46:53.901 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : openssl-devel-1:3.0.7-25.el9.x86_64 94/164 2023-12-17T11:46:53.902 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 95/164 2023-12-17T11:46:53.902 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 96/164 2023-12-17T11:46:53.902 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : libarrow-9.0.0-10.el9.x86_64 97/164 2023-12-17T11:46:53.902 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : libarrow-doc-9.0.0-10.el9.noarch 98/164 2023-12-17T11:46:53.902 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 99/164 2023-12-17T11:46:53.902 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 100/164 2023-12-17T11:46:53.902 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 101/164 2023-12-17T11:46:53.902 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : parquet-libs-9.0.0-10.el9.x86_64 102/164 2023-12-17T11:46:53.902 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-asyncssh-2.13.2-3.el9.noarch 103/164 2023-12-17T11:46:53.902 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 104/164 2023-12-17T11:46:53.902 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 105/164 2023-12-17T11:46:53.903 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 106/164 2023-12-17T11:46:53.903 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 107/164 2023-12-17T11:46:53.903 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 108/164 2023-12-17T11:46:53.903 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-google-auth-1:2.23.4-1.el9.noarch 109/164 2023-12-17T11:46:53.903 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 110/164 2023-12-17T11:46:53.903 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 111/164 2023-12-17T11:46:53.903 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 112/164 2023-12-17T11:46:53.903 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 113/164 2023-12-17T11:46:53.903 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 114/164 2023-12-17T11:46:53.904 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-jwt+crypto-2.4.0-1.el9.noarch 115/164 2023-12-17T11:46:53.904 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-jwt-2.4.0-1.el9.noarch 116/164 2023-12-17T11:46:53.904 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 117/164 2023-12-17T11:46:53.904 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 118/164 2023-12-17T11:46:53.904 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 119/164 2023-12-17T11:46:53.904 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 120/164 2023-12-17T11:46:53.904 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 121/164 2023-12-17T11:46:53.904 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 122/164 2023-12-17T11:46:53.904 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 123/164 2023-12-17T11:46:53.904 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 124/164 2023-12-17T11:46:53.904 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 125/164 2023-12-17T11:46:53.904 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 126/164 2023-12-17T11:46:53.904 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 127/164 2023-12-17T11:46:53.904 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 128/164 2023-12-17T11:46:53.905 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 129/164 2023-12-17T11:46:53.905 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 130/164 2023-12-17T11:46:53.905 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 131/164 2023-12-17T11:46:53.905 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 132/164 2023-12-17T11:46:53.905 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : re2-1:20211101-3.el9.x86_64 133/164 2023-12-17T11:46:53.905 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 134/164 2023-12-17T11:46:53.905 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : librados2-2:19.0.0-119.ga62fda73.el9.x86_64 135/164 2023-12-17T11:46:53.905 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 136/164 2023-12-17T11:46:53.905 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : librbd1-2:19.0.0-119.ga62fda73.el9.x86_64 137/164 2023-12-17T11:46:53.905 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 138/164 2023-12-17T11:46:53.905 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : libacl-devel-2.3.1-4.el9.x86_64 139/164 2023-12-17T11:46:53.905 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : libacl-devel-2.3.1-3.el9.x86_64 140/164 2023-12-17T11:46:53.905 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : acl-2.3.1-4.el9.x86_64 141/164 2023-12-17T11:46:53.906 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : acl-2.3.1-3.el9.x86_64 142/164 2023-12-17T11:46:53.906 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : elfutils-debuginfod-client-0.190-1.el9.x86_64 143/164 2023-12-17T11:46:53.906 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : elfutils-debuginfod-client-0.189-3.el9.x86_64 144/164 2023-12-17T11:46:53.906 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : elfutils-libelf-0.190-1.el9.x86_64 145/164 2023-12-17T11:46:53.906 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : elfutils-libelf-0.189-3.el9.x86_64 146/164 2023-12-17T11:46:53.906 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : elfutils-libs-0.190-1.el9.x86_64 147/164 2023-12-17T11:46:53.906 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : elfutils-libs-0.189-3.el9.x86_64 148/164 2023-12-17T11:46:53.906 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : libacl-2.3.1-4.el9.x86_64 149/164 2023-12-17T11:46:53.906 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : libacl-2.3.1-3.el9.x86_64 150/164 2023-12-17T11:46:53.906 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : xfsdump-3.1.12-4.el9.x86_64 151/164 2023-12-17T11:46:53.906 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : xfsdump-3.1.12-3.el9.x86_64 152/164 2023-12-17T11:46:53.907 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : NetworkManager-1:1.45.7-1.el9.x86_64 153/164 2023-12-17T11:46:53.907 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : NetworkManager-1:1.44.0-2.el9.x86_64 154/164 2023-12-17T11:46:53.907 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : NetworkManager-libnm-1:1.45.7-1.el9.x86_64 155/164 2023-12-17T11:46:53.907 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 156/164 2023-12-17T11:46:53.907 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : NetworkManager-team-1:1.45.7-1.el9.x86_64 157/164 2023-12-17T11:46:53.907 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : NetworkManager-team-1:1.44.0-2.el9.x86_64 158/164 2023-12-17T11:46:53.907 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : NetworkManager-tui-1:1.45.7-1.el9.x86_64 159/164 2023-12-17T11:46:53.907 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : NetworkManager-tui-1:1.44.0-2.el9.x86_64 160/164 2023-12-17T11:46:53.907 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : openssl-1:3.0.7-25.el9.x86_64 161/164 2023-12-17T11:46:53.907 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : openssl-1:3.0.7-24.el9.x86_64 162/164 2023-12-17T11:46:53.907 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : openssl-libs-1:3.0.7-25.el9.x86_64 163/164 2023-12-17T11:46:56.046 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : openssl-libs-1:3.0.7-24.el9.x86_64 164/164 2023-12-17T11:46:56.046 INFO:teuthology.orchestra.run.smithi159.stdout: 2023-12-17T11:46:56.046 INFO:teuthology.orchestra.run.smithi159.stdout:Upgraded: 2023-12-17T11:46:56.046 INFO:teuthology.orchestra.run.smithi159.stdout: NetworkManager-1:1.45.7-1.el9.x86_64 2023-12-17T11:46:56.046 INFO:teuthology.orchestra.run.smithi159.stdout: NetworkManager-libnm-1:1.45.7-1.el9.x86_64 2023-12-17T11:46:56.047 INFO:teuthology.orchestra.run.smithi159.stdout: NetworkManager-team-1:1.45.7-1.el9.x86_64 2023-12-17T11:46:56.047 INFO:teuthology.orchestra.run.smithi159.stdout: NetworkManager-tui-1:1.45.7-1.el9.x86_64 2023-12-17T11:46:56.047 INFO:teuthology.orchestra.run.smithi159.stdout: acl-2.3.1-4.el9.x86_64 2023-12-17T11:46:56.047 INFO:teuthology.orchestra.run.smithi159.stdout: elfutils-debuginfod-client-0.190-1.el9.x86_64 2023-12-17T11:46:56.047 INFO:teuthology.orchestra.run.smithi159.stdout: elfutils-libelf-0.190-1.el9.x86_64 2023-12-17T11:46:56.047 INFO:teuthology.orchestra.run.smithi159.stdout: elfutils-libs-0.190-1.el9.x86_64 2023-12-17T11:46:56.047 INFO:teuthology.orchestra.run.smithi159.stdout: libacl-2.3.1-4.el9.x86_64 2023-12-17T11:46:56.047 INFO:teuthology.orchestra.run.smithi159.stdout: libacl-devel-2.3.1-4.el9.x86_64 2023-12-17T11:46:56.047 INFO:teuthology.orchestra.run.smithi159.stdout: librados2-2:19.0.0-119.ga62fda73.el9.x86_64 2023-12-17T11:46:56.047 INFO:teuthology.orchestra.run.smithi159.stdout: librbd1-2:19.0.0-119.ga62fda73.el9.x86_64 2023-12-17T11:46:56.047 INFO:teuthology.orchestra.run.smithi159.stdout: openssl-1:3.0.7-25.el9.x86_64 2023-12-17T11:46:56.047 INFO:teuthology.orchestra.run.smithi159.stdout: openssl-libs-1:3.0.7-25.el9.x86_64 2023-12-17T11:46:56.048 INFO:teuthology.orchestra.run.smithi159.stdout: xfsdump-3.1.12-4.el9.x86_64 2023-12-17T11:46:56.048 INFO:teuthology.orchestra.run.smithi159.stdout:Installed: 2023-12-17T11:46:56.048 INFO:teuthology.orchestra.run.smithi159.stdout: automake-1.16.2-8.el9.noarch 2023-12-17T11:46:56.048 INFO:teuthology.orchestra.run.smithi159.stdout: bison-3.7.4-5.el9.x86_64 2023-12-17T11:46:56.048 INFO:teuthology.orchestra.run.smithi159.stdout: boost-program-options-1.75.0-8.el9.x86_64 2023-12-17T11:46:56.048 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-2:19.0.0-119.ga62fda73.el9.x86_64 2023-12-17T11:46:56.048 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-base-2:19.0.0-119.ga62fda73.el9.x86_64 2023-12-17T11:46:56.048 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-common-2:19.0.0-119.ga62fda73.el9.x86_64 2023-12-17T11:46:56.048 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-fuse-2:19.0.0-119.ga62fda73.el9.x86_64 2023-12-17T11:46:56.048 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-grafana-dashboards-2:19.0.0-119.ga62fda73.el9.noarch 2023-12-17T11:46:56.048 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-immutable-object-cache-2:19.0.0-119.ga62fda73.el9.x86_64 2023-12-17T11:46:56.048 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-mds-2:19.0.0-119.ga62fda73.el9.x86_64 2023-12-17T11:46:56.048 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-mgr-2:19.0.0-119.ga62fda73.el9.x86_64 2023-12-17T11:46:56.049 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-mgr-cephadm-2:19.0.0-119.ga62fda73.el9.noarch 2023-12-17T11:46:56.049 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-mgr-dashboard-2:19.0.0-119.ga62fda73.el9.noarch 2023-12-17T11:46:56.049 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-mgr-diskprediction-local-2:19.0.0-119.ga62fda73.el9.noarch 2023-12-17T11:46:56.049 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-mgr-modules-core-2:19.0.0-119.ga62fda73.el9.noarch 2023-12-17T11:46:56.049 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-mgr-rook-2:19.0.0-119.ga62fda73.el9.noarch 2023-12-17T11:46:56.049 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-mon-2:19.0.0-119.ga62fda73.el9.x86_64 2023-12-17T11:46:56.049 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-osd-2:19.0.0-119.ga62fda73.el9.x86_64 2023-12-17T11:46:56.049 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-prometheus-alerts-2:19.0.0-119.ga62fda73.el9.noarch 2023-12-17T11:46:56.049 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-radosgw-2:19.0.0-119.ga62fda73.el9.x86_64 2023-12-17T11:46:56.049 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-selinux-2:19.0.0-119.ga62fda73.el9.x86_64 2023-12-17T11:46:56.049 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-test-2:19.0.0-119.ga62fda73.el9.x86_64 2023-12-17T11:46:56.049 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-volume-2:19.0.0-119.ga62fda73.el9.noarch 2023-12-17T11:46:56.050 INFO:teuthology.orchestra.run.smithi159.stdout: cephadm-2:19.0.0-119.ga62fda73.el9.noarch 2023-12-17T11:46:56.050 INFO:teuthology.orchestra.run.smithi159.stdout: cephfs-mirror-2:19.0.0-119.ga62fda73.el9.x86_64 2023-12-17T11:46:56.050 INFO:teuthology.orchestra.run.smithi159.stdout: cephfs-top-2:19.0.0-119.ga62fda73.el9.noarch 2023-12-17T11:46:56.050 INFO:teuthology.orchestra.run.smithi159.stdout: elfutils-libelf-devel-0.190-1.el9.x86_64 2023-12-17T11:46:56.050 INFO:teuthology.orchestra.run.smithi159.stdout: flex-2.6.4-9.el9.x86_64 2023-12-17T11:46:56.050 INFO:teuthology.orchestra.run.smithi159.stdout: flexiblas-3.0.4-8.el9.x86_64 2023-12-17T11:46:56.050 INFO:teuthology.orchestra.run.smithi159.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2023-12-17T11:46:56.050 INFO:teuthology.orchestra.run.smithi159.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2023-12-17T11:46:56.050 INFO:teuthology.orchestra.run.smithi159.stdout: fuse-2.9.9-15.el9.x86_64 2023-12-17T11:46:56.050 INFO:teuthology.orchestra.run.smithi159.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2023-12-17T11:46:56.050 INFO:teuthology.orchestra.run.smithi159.stdout: jq-1.6-16.el9.x86_64 2023-12-17T11:46:56.051 INFO:teuthology.orchestra.run.smithi159.stdout: libaio-devel-0.3.111-13.el9.x86_64 2023-12-17T11:46:56.051 INFO:teuthology.orchestra.run.smithi159.stdout: libarrow-9.0.0-10.el9.x86_64 2023-12-17T11:46:56.051 INFO:teuthology.orchestra.run.smithi159.stdout: libarrow-doc-9.0.0-10.el9.noarch 2023-12-17T11:46:56.051 INFO:teuthology.orchestra.run.smithi159.stdout: libcephfs-devel-2:19.0.0-119.ga62fda73.el9.x86_64 2023-12-17T11:46:56.051 INFO:teuthology.orchestra.run.smithi159.stdout: libcephfs2-2:19.0.0-119.ga62fda73.el9.x86_64 2023-12-17T11:46:56.051 INFO:teuthology.orchestra.run.smithi159.stdout: libcephsqlite-2:19.0.0-119.ga62fda73.el9.x86_64 2023-12-17T11:46:56.051 INFO:teuthology.orchestra.run.smithi159.stdout: libgfortran-11.4.1-2.3.el9.x86_64 2023-12-17T11:46:56.051 INFO:teuthology.orchestra.run.smithi159.stdout: liboath-2.6.7-2.el9.x86_64 2023-12-17T11:46:56.051 INFO:teuthology.orchestra.run.smithi159.stdout: libpmemobj-1.12.1-1.el9.x86_64 2023-12-17T11:46:56.051 INFO:teuthology.orchestra.run.smithi159.stdout: libquadmath-11.4.1-2.3.el9.x86_64 2023-12-17T11:46:56.051 INFO:teuthology.orchestra.run.smithi159.stdout: librabbitmq-0.11.0-7.el9.x86_64 2023-12-17T11:46:56.051 INFO:teuthology.orchestra.run.smithi159.stdout: librados-devel-2:19.0.0-119.ga62fda73.el9.x86_64 2023-12-17T11:46:56.051 INFO:teuthology.orchestra.run.smithi159.stdout: libradosstriper1-2:19.0.0-119.ga62fda73.el9.x86_64 2023-12-17T11:46:56.051 INFO:teuthology.orchestra.run.smithi159.stdout: librdkafka-1.6.1-102.el9.x86_64 2023-12-17T11:46:56.052 INFO:teuthology.orchestra.run.smithi159.stdout: librgw2-2:19.0.0-119.ga62fda73.el9.x86_64 2023-12-17T11:46:56.052 INFO:teuthology.orchestra.run.smithi159.stdout: libtool-2.4.6-45.el9.x86_64 2023-12-17T11:46:56.052 INFO:teuthology.orchestra.run.smithi159.stdout: libunwind-1.6.2-1.el9.x86_64 2023-12-17T11:46:56.052 INFO:teuthology.orchestra.run.smithi159.stdout: libuuid-devel-2.37.4-15.el9.x86_64 2023-12-17T11:46:56.052 INFO:teuthology.orchestra.run.smithi159.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2023-12-17T11:46:56.052 INFO:teuthology.orchestra.run.smithi159.stdout: lttng-ust-2.12.0-6.el9.x86_64 2023-12-17T11:46:56.052 INFO:teuthology.orchestra.run.smithi159.stdout: lua-5.4.4-4.el9.x86_64 2023-12-17T11:46:56.052 INFO:teuthology.orchestra.run.smithi159.stdout: luarocks-3.9.2-1.el9.noarch 2023-12-17T11:46:56.052 INFO:teuthology.orchestra.run.smithi159.stdout: oniguruma-6.9.6-1.el9.5.x86_64 2023-12-17T11:46:56.052 INFO:teuthology.orchestra.run.smithi159.stdout: openblas-0.3.21-2.el9.x86_64 2023-12-17T11:46:56.052 INFO:teuthology.orchestra.run.smithi159.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2023-12-17T11:46:56.052 INFO:teuthology.orchestra.run.smithi159.stdout: openssl-devel-1:3.0.7-25.el9.x86_64 2023-12-17T11:46:56.052 INFO:teuthology.orchestra.run.smithi159.stdout: parquet-libs-9.0.0-10.el9.x86_64 2023-12-17T11:46:56.053 INFO:teuthology.orchestra.run.smithi159.stdout: postgresql-13.11-1.el9.x86_64 2023-12-17T11:46:56.053 INFO:teuthology.orchestra.run.smithi159.stdout: postgresql-contrib-13.11-1.el9.x86_64 2023-12-17T11:46:56.053 INFO:teuthology.orchestra.run.smithi159.stdout: postgresql-private-libs-13.11-1.el9.x86_64 2023-12-17T11:46:56.053 INFO:teuthology.orchestra.run.smithi159.stdout: postgresql-server-13.11-1.el9.x86_64 2023-12-17T11:46:56.053 INFO:teuthology.orchestra.run.smithi159.stdout: python3-asyncssh-2.13.2-3.el9.noarch 2023-12-17T11:46:56.053 INFO:teuthology.orchestra.run.smithi159.stdout: python3-babel-2.9.1-2.el9.noarch 2023-12-17T11:46:56.053 INFO:teuthology.orchestra.run.smithi159.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2023-12-17T11:46:56.053 INFO:teuthology.orchestra.run.smithi159.stdout: python3-cachetools-4.2.4-1.el9.noarch 2023-12-17T11:46:56.053 INFO:teuthology.orchestra.run.smithi159.stdout: python3-ceph-argparse-2:19.0.0-119.ga62fda73.el9.x86_64 2023-12-17T11:46:56.053 INFO:teuthology.orchestra.run.smithi159.stdout: python3-ceph-common-2:19.0.0-119.ga62fda73.el9.x86_64 2023-12-17T11:46:56.053 INFO:teuthology.orchestra.run.smithi159.stdout: python3-cephfs-2:19.0.0-119.ga62fda73.el9.x86_64 2023-12-17T11:46:56.053 INFO:teuthology.orchestra.run.smithi159.stdout: python3-certifi-2021.10.8-2.el9.noarch 2023-12-17T11:46:56.053 INFO:teuthology.orchestra.run.smithi159.stdout: python3-cffi-1.14.5-5.el9.x86_64 2023-12-17T11:46:56.053 INFO:teuthology.orchestra.run.smithi159.stdout: python3-cheroot-8.6.0-4.el9.noarch 2023-12-17T11:46:56.054 INFO:teuthology.orchestra.run.smithi159.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2023-12-17T11:46:56.054 INFO:teuthology.orchestra.run.smithi159.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2023-12-17T11:46:56.054 INFO:teuthology.orchestra.run.smithi159.stdout: python3-devel-3.9.17-2.el9.x86_64 2023-12-17T11:46:56.054 INFO:teuthology.orchestra.run.smithi159.stdout: python3-google-auth-1:2.23.4-1.el9.noarch 2023-12-17T11:46:56.054 INFO:teuthology.orchestra.run.smithi159.stdout: python3-jaraco-8.2.1-3.el9.noarch 2023-12-17T11:46:56.054 INFO:teuthology.orchestra.run.smithi159.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2023-12-17T11:46:56.054 INFO:teuthology.orchestra.run.smithi159.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2023-12-17T11:46:56.054 INFO:teuthology.orchestra.run.smithi159.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2023-12-17T11:46:56.054 INFO:teuthology.orchestra.run.smithi159.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2023-12-17T11:46:56.054 INFO:teuthology.orchestra.run.smithi159.stdout: python3-jinja2-2.11.3-4.el9.noarch 2023-12-17T11:46:56.054 INFO:teuthology.orchestra.run.smithi159.stdout: python3-jsonpatch-1.21-16.el9.noarch 2023-12-17T11:46:56.054 INFO:teuthology.orchestra.run.smithi159.stdout: python3-jsonpointer-2.0-4.el9.noarch 2023-12-17T11:46:56.054 INFO:teuthology.orchestra.run.smithi159.stdout: python3-jwt-2.4.0-1.el9.noarch 2023-12-17T11:46:56.054 INFO:teuthology.orchestra.run.smithi159.stdout: python3-jwt+crypto-2.4.0-1.el9.noarch 2023-12-17T11:46:56.055 INFO:teuthology.orchestra.run.smithi159.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2023-12-17T11:46:56.055 INFO:teuthology.orchestra.run.smithi159.stdout: python3-logutils-0.3.5-21.el9.noarch 2023-12-17T11:46:56.055 INFO:teuthology.orchestra.run.smithi159.stdout: python3-mako-1.1.4-6.el9.noarch 2023-12-17T11:46:56.055 INFO:teuthology.orchestra.run.smithi159.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2023-12-17T11:46:56.055 INFO:teuthology.orchestra.run.smithi159.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2023-12-17T11:46:56.055 INFO:teuthology.orchestra.run.smithi159.stdout: python3-natsort-7.1.1-5.el9.noarch 2023-12-17T11:46:56.055 INFO:teuthology.orchestra.run.smithi159.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2023-12-17T11:46:56.055 INFO:teuthology.orchestra.run.smithi159.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2023-12-17T11:46:56.055 INFO:teuthology.orchestra.run.smithi159.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2023-12-17T11:46:56.055 INFO:teuthology.orchestra.run.smithi159.stdout: python3-pecan-1.4.2-3.el9.noarch 2023-12-17T11:46:56.055 INFO:teuthology.orchestra.run.smithi159.stdout: python3-ply-3.11-14.el9.noarch 2023-12-17T11:46:56.055 INFO:teuthology.orchestra.run.smithi159.stdout: python3-portend-3.1.0-2.el9.noarch 2023-12-17T11:46:56.055 INFO:teuthology.orchestra.run.smithi159.stdout: python3-prettytable-0.7.2-27.el9.noarch 2023-12-17T11:46:56.055 INFO:teuthology.orchestra.run.smithi159.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2023-12-17T11:46:56.056 INFO:teuthology.orchestra.run.smithi159.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2023-12-17T11:46:56.056 INFO:teuthology.orchestra.run.smithi159.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2023-12-17T11:46:56.056 INFO:teuthology.orchestra.run.smithi159.stdout: python3-pycparser-2.20-6.el9.noarch 2023-12-17T11:46:56.056 INFO:teuthology.orchestra.run.smithi159.stdout: python3-pytz-2021.1-5.el9.noarch 2023-12-17T11:46:56.056 INFO:teuthology.orchestra.run.smithi159.stdout: python3-rados-2:19.0.0-119.ga62fda73.el9.x86_64 2023-12-17T11:46:56.056 INFO:teuthology.orchestra.run.smithi159.stdout: python3-rbd-2:19.0.0-119.ga62fda73.el9.x86_64 2023-12-17T11:46:56.056 INFO:teuthology.orchestra.run.smithi159.stdout: python3-repoze-lru-0.7-16.el9.noarch 2023-12-17T11:46:56.056 INFO:teuthology.orchestra.run.smithi159.stdout: python3-requests-2.25.1-7.el9.noarch 2023-12-17T11:46:56.056 INFO:teuthology.orchestra.run.smithi159.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2023-12-17T11:46:56.056 INFO:teuthology.orchestra.run.smithi159.stdout: python3-rgw-2:19.0.0-119.ga62fda73.el9.x86_64 2023-12-17T11:46:56.056 INFO:teuthology.orchestra.run.smithi159.stdout: python3-routes-2.5.1-5.el9.noarch 2023-12-17T11:46:56.056 INFO:teuthology.orchestra.run.smithi159.stdout: python3-rsa-4.9-2.el9.noarch 2023-12-17T11:46:56.056 INFO:teuthology.orchestra.run.smithi159.stdout: python3-scipy-1.6.2-8.el9.x86_64 2023-12-17T11:46:56.056 INFO:teuthology.orchestra.run.smithi159.stdout: python3-tempora-5.0.0-2.el9.noarch 2023-12-17T11:46:56.057 INFO:teuthology.orchestra.run.smithi159.stdout: python3-toml-0.10.2-6.el9.noarch 2023-12-17T11:46:56.057 INFO:teuthology.orchestra.run.smithi159.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2023-12-17T11:46:56.057 INFO:teuthology.orchestra.run.smithi159.stdout: python3-urllib3-1.26.5-4.el9.noarch 2023-12-17T11:46:56.057 INFO:teuthology.orchestra.run.smithi159.stdout: python3-webob-1.8.7-6.el9.noarch 2023-12-17T11:46:56.057 INFO:teuthology.orchestra.run.smithi159.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2023-12-17T11:46:56.057 INFO:teuthology.orchestra.run.smithi159.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2023-12-17T11:46:56.057 INFO:teuthology.orchestra.run.smithi159.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2023-12-17T11:46:56.057 INFO:teuthology.orchestra.run.smithi159.stdout: rbd-fuse-2:19.0.0-119.ga62fda73.el9.x86_64 2023-12-17T11:46:56.057 INFO:teuthology.orchestra.run.smithi159.stdout: rbd-mirror-2:19.0.0-119.ga62fda73.el9.x86_64 2023-12-17T11:46:56.057 INFO:teuthology.orchestra.run.smithi159.stdout: rbd-nbd-2:19.0.0-119.ga62fda73.el9.x86_64 2023-12-17T11:46:56.057 INFO:teuthology.orchestra.run.smithi159.stdout: re2-1:20211101-3.el9.x86_64 2023-12-17T11:46:56.057 INFO:teuthology.orchestra.run.smithi159.stdout: socat-1.7.4.1-5.el9.x86_64 2023-12-17T11:46:56.057 INFO:teuthology.orchestra.run.smithi159.stdout: thrift-0.15.0-2.el9.x86_64 2023-12-17T11:46:56.058 INFO:teuthology.orchestra.run.smithi159.stdout: uuid-1.6.2-55.el9.x86_64 2023-12-17T11:46:56.058 INFO:teuthology.orchestra.run.smithi159.stdout: xfsprogs-devel-5.19.0-4.el9.x86_64 2023-12-17T11:46:56.058 INFO:teuthology.orchestra.run.smithi159.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2023-12-17T11:46:56.058 INFO:teuthology.orchestra.run.smithi159.stdout: zlib-devel-1.2.11-40.el9.x86_64 2023-12-17T11:46:56.058 INFO:teuthology.orchestra.run.smithi159.stdout: 2023-12-17T11:46:56.058 INFO:teuthology.orchestra.run.smithi159.stdout:Complete! 2023-12-17T11:46:56.648 DEBUG:teuthology.parallel:result is None 2023-12-17T11:46:56.649 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=a62fda73efba5520d409bb5a21bd8373289dda5d 2023-12-17T11:46:59.777 DEBUG:teuthology.orchestra.run.smithi040:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-12-17T11:46:59.837 INFO:teuthology.orchestra.run.smithi040.stdout:19.0.0-119.ga62fda73.el9 2023-12-17T11:46:59.838 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-119.ga62fda73.el9 2023-12-17T11:46:59.838 INFO:teuthology.task.install:The correct ceph version 19.0.0-119.ga62fda73 is installed. 2023-12-17T11:46:59.840 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=a62fda73efba5520d409bb5a21bd8373289dda5d 2023-12-17T11:47:03.792 DEBUG:teuthology.orchestra.run.smithi159:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-12-17T11:47:03.865 INFO:teuthology.orchestra.run.smithi159.stdout:19.0.0-119.ga62fda73.el9 2023-12-17T11:47:03.865 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-119.ga62fda73.el9 2023-12-17T11:47:03.866 INFO:teuthology.task.install:The correct ceph version 19.0.0-119.ga62fda73 is installed. 2023-12-17T11:47:03.867 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2023-12-17T11:47:03.868 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2023-12-17T11:47:03.868 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-12-17T11:47:03.959 DEBUG:teuthology.orchestra.run.smithi159:> set -ex 2023-12-17T11:47:03.959 DEBUG:teuthology.orchestra.run.smithi159:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-12-17T11:47:04.109 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2023-12-17T11:47:04.110 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2023-12-17T11:47:04.110 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd of=/usr/bin/daemon-helper 2023-12-17T11:47:04.202 DEBUG:teuthology.orchestra.run.smithi040:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-12-17T11:47:04.287 DEBUG:teuthology.orchestra.run.smithi159:> set -ex 2023-12-17T11:47:04.288 DEBUG:teuthology.orchestra.run.smithi159:> sudo dd of=/usr/bin/daemon-helper 2023-12-17T11:47:04.379 DEBUG:teuthology.orchestra.run.smithi159:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-12-17T11:47:04.461 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2023-12-17T11:47:04.461 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2023-12-17T11:47:04.461 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd of=/usr/bin/adjust-ulimits 2023-12-17T11:47:04.554 DEBUG:teuthology.orchestra.run.smithi040:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-12-17T11:47:04.694 DEBUG:teuthology.orchestra.run.smithi159:> set -ex 2023-12-17T11:47:04.694 DEBUG:teuthology.orchestra.run.smithi159:> sudo dd of=/usr/bin/adjust-ulimits 2023-12-17T11:47:04.777 DEBUG:teuthology.orchestra.run.smithi159:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-12-17T11:47:04.890 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2023-12-17T11:47:04.891 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2023-12-17T11:47:04.891 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd of=/usr/bin/stdin-killer 2023-12-17T11:47:04.978 DEBUG:teuthology.orchestra.run.smithi040:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-12-17T11:47:05.121 DEBUG:teuthology.orchestra.run.smithi159:> set -ex 2023-12-17T11:47:05.121 DEBUG:teuthology.orchestra.run.smithi159:> sudo dd of=/usr/bin/stdin-killer 2023-12-17T11:47:05.218 DEBUG:teuthology.orchestra.run.smithi159:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-12-17T11:47:05.347 INFO:teuthology.run_tasks:Running task ceph... 2023-12-17T11:47:05.420 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2023-12-17T11:47:05.421 DEBUG:teuthology.orchestra.run.smithi040:> sudo chmod 777 /var/log/ceph 2023-12-17T11:47:05.430 DEBUG:teuthology.orchestra.run.smithi159:> sudo chmod 777 /var/log/ceph 2023-12-17T11:47:05.529 INFO:tasks.ceph:Disabling ceph logrotate... 2023-12-17T11:47:05.529 DEBUG:teuthology.orchestra.run.smithi040:> sudo rm -f -- /etc/logrotate.d/ceph 2023-12-17T11:47:05.537 DEBUG:teuthology.orchestra.run.smithi159:> sudo rm -f -- /etc/logrotate.d/ceph 2023-12-17T11:47:05.633 INFO:tasks.ceph:Creating extra log directories... 2023-12-17T11:47:05.633 DEBUG:teuthology.orchestra.run.smithi040:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-12-17T11:47:05.642 DEBUG:teuthology.orchestra.run.smithi159:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-12-17T11:47:05.747 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2023-12-17T11:47:05.748 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2023-12-17T11:47:05.748 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2023-12-17T11:47:05.748 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2023-12-17T11:47:05.748 DEBUG:teuthology.orchestra.run.smithi040:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-12-17T11:47:05.808 DEBUG:teuthology.orchestra.run.smithi040:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-12-17T11:47:06.100 DEBUG:teuthology.orchestra.run.smithi040:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2023-12-17T11:47:06.211 DEBUG:teuthology.orchestra.run.smithi159:> set -ex 2023-12-17T11:47:06.211 DEBUG:teuthology.orchestra.run.smithi159:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-12-17T11:47:06.272 DEBUG:teuthology.orchestra.run.smithi159:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-12-17T11:47:06.546 DEBUG:teuthology.orchestra.run.smithi159:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2023-12-17T11:47:06.656 INFO:tasks.ceph:Creating ceph cluster ceph... 2023-12-17T11:47:06.656 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2023-12-17T11:47:06.656 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/rishabh-2023-12-17_11:19:43-fs-rishabh-2023dec11-testing-default-smithi/7495164', 'branch': 'rishabh-2023dec11', 'description': 'fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/xfstests-dev}', 'email': None, 'first_in_suite': False, 'job_id': '7495164', 'kernel': {'client': {'branch': 'testing'}, 'flavor': 'default', 'kdb': True, 'sha1': 'cd68252d7b4d7802f3cae7f5945b38e9b20dad4c'}, 'ktype': 'upstream', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'rishabh-2023-12-17_11:19:43-fs-rishabh-2023dec11-testing-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'rishabh-2023dec11'}, 'ceph': {'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'sha1': 'a62fda73efba5520d409bb5a21bd8373289dda5d'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'a62fda73efba5520d409bb5a21bd8373289dda5d'}}, 'kclient': {'syntax': 'v1'}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'rishabh-2023dec11', 'sha1': 'a62fda73efba5520d409bb5a21bd8373289dda5d'}}, 'owner': 'scheduled_rishabh@teuthology', 'priority': 70, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'seed': 5791, 'sha1': 'a62fda73efba5520d409bb5a21bd8373289dda5d', 'sleep_before_teardown': 0, 'subset': '209/512', 'suite': 'fs', 'suite_branch': 'rishabh-2023dec11', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_a62fda73efba5520d409bb5a21bd8373289dda5d/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': 'a62fda73efba5520d409bb5a21bd8373289dda5d', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi040.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLWHNNyqkae0DRXMVWx2DWbXcH5eUDG1KTTWcTgiXJgX/3w9PiDltQprvOhKBp4FD6+3e6EO9r+ek8NjkIrx8Pw=', 'smithi159.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJbKPpsqqWKWXPNSW2zUbciZRP9KYVz9LJhEsCYzGol5/UMenmmky+Cequsw5pWAAPlX9TB2gL8KveVFZCOdjoo='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'client': {'branch': 'testing'}, 'flavor': 'default', 'kdb': True, 'sha1': 'cd68252d7b4d7802f3cae7f5945b38e9b20dad4c'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'a62fda73efba5520d409bb5a21bd8373289dda5d'}}, {'ceph': {'create_rbd_pool': False, 'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'sha1': 'a62fda73efba5520d409bb5a21bd8373289dda5d', 'cluster': 'ceph'}}, {'kclient': None}, {'cephfs_test_runner': {'fail_on_skip': False, 'modules': ['tasks.cephfs.tests_from_xfstests_dev']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ["local function is_kupstream() return yaml.ktype == 'upstream' end", "local function is_kdistro() return yaml.ktype == 'distro' end", 'local function is_fuse() return false end', 'local function syntax_version() return yaml.overrides.kclient.syntax end']}, 'teuthology_branch': 'main', 'teuthology_sha1': '5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73', 'timestamp': '2023-12-17_11:19:43', 'tube': 'smithi', 'user': 'rishabh', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.1485078'} 2023-12-17T11:47:06.657 DEBUG:teuthology.orchestra.run.smithi040:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-12-17T11:47:06.667 DEBUG:teuthology.orchestra.run.smithi159:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-12-17T11:47:06.724 DEBUG:teuthology.orchestra.run.smithi040:> sudo install -d -m0777 -- /var/run/ceph 2023-12-17T11:47:06.730 DEBUG:teuthology.orchestra.run.smithi159:> sudo install -d -m0777 -- /var/run/ceph 2023-12-17T11:47:06.830 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2023-12-17T11:47:06.830 DEBUG:teuthology.orchestra.run.smithi040:> dd if=/scratch_devs of=/dev/stdout 2023-12-17T11:47:06.892 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-12-17T11:47:06.892 DEBUG:teuthology.orchestra.run.smithi040:> stat /dev/vg_nvme/lv_1 2023-12-17T11:47:06.954 INFO:teuthology.orchestra.run.smithi040.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-12-17T11:47:06.954 INFO:teuthology.orchestra.run.smithi040.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-17T11:47:06.954 INFO:teuthology.orchestra.run.smithi040.stdout:Device: 5h/5d Inode: 633 Links: 1 2023-12-17T11:47:06.955 INFO:teuthology.orchestra.run.smithi040.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-17T11:47:06.955 INFO:teuthology.orchestra.run.smithi040.stdout:Context: system_u:object_r:device_t:s0 2023-12-17T11:47:06.955 INFO:teuthology.orchestra.run.smithi040.stdout:Access: 2023-12-17 11:46:45.985321944 +0000 2023-12-17T11:47:06.955 INFO:teuthology.orchestra.run.smithi040.stdout:Modify: 2023-12-17 11:44:01.613408135 +0000 2023-12-17T11:47:06.955 INFO:teuthology.orchestra.run.smithi040.stdout:Change: 2023-12-17 11:44:01.613408135 +0000 2023-12-17T11:47:06.955 INFO:teuthology.orchestra.run.smithi040.stdout: Birth: 2023-12-17 11:44:01.613408135 +0000 2023-12-17T11:47:06.955 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-12-17T11:47:07.056 INFO:teuthology.orchestra.run.smithi040.stderr:1+0 records in 2023-12-17T11:47:07.057 INFO:teuthology.orchestra.run.smithi040.stderr:1+0 records out 2023-12-17T11:47:07.057 INFO:teuthology.orchestra.run.smithi040.stderr:512 bytes copied, 0.000365096 s, 1.4 MB/s 2023-12-17T11:47:07.061 DEBUG:teuthology.orchestra.run.smithi040:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-12-17T11:47:07.126 DEBUG:teuthology.orchestra.run.smithi040:> stat /dev/vg_nvme/lv_2 2023-12-17T11:47:07.179 INFO:teuthology.orchestra.run.smithi040.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-12-17T11:47:07.179 INFO:teuthology.orchestra.run.smithi040.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-17T11:47:07.179 INFO:teuthology.orchestra.run.smithi040.stdout:Device: 5h/5d Inode: 651 Links: 1 2023-12-17T11:47:07.179 INFO:teuthology.orchestra.run.smithi040.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-17T11:47:07.179 INFO:teuthology.orchestra.run.smithi040.stdout:Context: system_u:object_r:device_t:s0 2023-12-17T11:47:07.179 INFO:teuthology.orchestra.run.smithi040.stdout:Access: 2023-12-17 11:46:45.987321919 +0000 2023-12-17T11:47:07.179 INFO:teuthology.orchestra.run.smithi040.stdout:Modify: 2023-12-17 11:44:02.693394863 +0000 2023-12-17T11:47:07.179 INFO:teuthology.orchestra.run.smithi040.stdout:Change: 2023-12-17 11:44:02.693394863 +0000 2023-12-17T11:47:07.179 INFO:teuthology.orchestra.run.smithi040.stdout: Birth: 2023-12-17 11:44:02.693394863 +0000 2023-12-17T11:47:07.180 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-12-17T11:47:07.268 INFO:teuthology.orchestra.run.smithi040.stderr:1+0 records in 2023-12-17T11:47:07.268 INFO:teuthology.orchestra.run.smithi040.stderr:1+0 records out 2023-12-17T11:47:07.268 INFO:teuthology.orchestra.run.smithi040.stderr:512 bytes copied, 0.000375332 s, 1.4 MB/s 2023-12-17T11:47:07.272 DEBUG:teuthology.orchestra.run.smithi040:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-12-17T11:47:07.332 DEBUG:teuthology.orchestra.run.smithi040:> stat /dev/vg_nvme/lv_3 2023-12-17T11:47:07.389 INFO:teuthology.orchestra.run.smithi040.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-12-17T11:47:07.389 INFO:teuthology.orchestra.run.smithi040.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-17T11:47:07.390 INFO:teuthology.orchestra.run.smithi040.stdout:Device: 5h/5d Inode: 669 Links: 1 2023-12-17T11:47:07.390 INFO:teuthology.orchestra.run.smithi040.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-17T11:47:07.390 INFO:teuthology.orchestra.run.smithi040.stdout:Context: system_u:object_r:device_t:s0 2023-12-17T11:47:07.390 INFO:teuthology.orchestra.run.smithi040.stdout:Access: 2023-12-17 11:46:45.987321919 +0000 2023-12-17T11:47:07.390 INFO:teuthology.orchestra.run.smithi040.stdout:Modify: 2023-12-17 11:44:03.740381997 +0000 2023-12-17T11:47:07.390 INFO:teuthology.orchestra.run.smithi040.stdout:Change: 2023-12-17 11:44:03.740381997 +0000 2023-12-17T11:47:07.390 INFO:teuthology.orchestra.run.smithi040.stdout: Birth: 2023-12-17 11:44:03.740381997 +0000 2023-12-17T11:47:07.391 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-12-17T11:47:07.488 INFO:teuthology.orchestra.run.smithi040.stderr:1+0 records in 2023-12-17T11:47:07.488 INFO:teuthology.orchestra.run.smithi040.stderr:1+0 records out 2023-12-17T11:47:07.488 INFO:teuthology.orchestra.run.smithi040.stderr:512 bytes copied, 0.000508808 s, 1.0 MB/s 2023-12-17T11:47:07.492 DEBUG:teuthology.orchestra.run.smithi040:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-12-17T11:47:07.552 DEBUG:teuthology.orchestra.run.smithi040:> stat /dev/vg_nvme/lv_4 2023-12-17T11:47:07.607 INFO:teuthology.orchestra.run.smithi040.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-12-17T11:47:07.607 INFO:teuthology.orchestra.run.smithi040.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-17T11:47:07.607 INFO:teuthology.orchestra.run.smithi040.stdout:Device: 5h/5d Inode: 689 Links: 1 2023-12-17T11:47:07.607 INFO:teuthology.orchestra.run.smithi040.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-17T11:47:07.607 INFO:teuthology.orchestra.run.smithi040.stdout:Context: system_u:object_r:device_t:s0 2023-12-17T11:47:07.607 INFO:teuthology.orchestra.run.smithi040.stdout:Access: 2023-12-17 11:46:45.988321907 +0000 2023-12-17T11:47:07.607 INFO:teuthology.orchestra.run.smithi040.stdout:Modify: 2023-12-17 11:44:04.811368836 +0000 2023-12-17T11:47:07.607 INFO:teuthology.orchestra.run.smithi040.stdout:Change: 2023-12-17 11:44:04.811368836 +0000 2023-12-17T11:47:07.608 INFO:teuthology.orchestra.run.smithi040.stdout: Birth: 2023-12-17 11:44:04.811368836 +0000 2023-12-17T11:47:07.608 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-12-17T11:47:07.705 INFO:teuthology.orchestra.run.smithi040.stderr:1+0 records in 2023-12-17T11:47:07.705 INFO:teuthology.orchestra.run.smithi040.stderr:1+0 records out 2023-12-17T11:47:07.705 INFO:teuthology.orchestra.run.smithi040.stderr:512 bytes copied, 0.000586163 s, 873 kB/s 2023-12-17T11:47:07.710 DEBUG:teuthology.orchestra.run.smithi040:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-12-17T11:47:07.769 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-12-17T11:47:07.769 DEBUG:teuthology.orchestra.run.smithi159:> set -ex 2023-12-17T11:47:07.770 DEBUG:teuthology.orchestra.run.smithi159:> dd if=/scratch_devs of=/dev/stdout 2023-12-17T11:47:07.828 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-12-17T11:47:07.829 DEBUG:teuthology.orchestra.run.smithi159:> stat /dev/vg_nvme/lv_1 2023-12-17T11:47:07.881 INFO:teuthology.orchestra.run.smithi159.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-12-17T11:47:07.881 INFO:teuthology.orchestra.run.smithi159.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-17T11:47:07.882 INFO:teuthology.orchestra.run.smithi159.stdout:Device: 5h/5d Inode: 632 Links: 1 2023-12-17T11:47:07.882 INFO:teuthology.orchestra.run.smithi159.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-17T11:47:07.882 INFO:teuthology.orchestra.run.smithi159.stdout:Context: system_u:object_r:device_t:s0 2023-12-17T11:47:07.882 INFO:teuthology.orchestra.run.smithi159.stdout:Access: 2023-12-17 11:46:49.674121089 +0000 2023-12-17T11:47:07.882 INFO:teuthology.orchestra.run.smithi159.stdout:Modify: 2023-12-17 11:43:40.187451508 +0000 2023-12-17T11:47:07.882 INFO:teuthology.orchestra.run.smithi159.stdout:Change: 2023-12-17 11:43:40.187451508 +0000 2023-12-17T11:47:07.882 INFO:teuthology.orchestra.run.smithi159.stdout: Birth: 2023-12-17 11:43:40.187451508 +0000 2023-12-17T11:47:07.882 DEBUG:teuthology.orchestra.run.smithi159:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-12-17T11:47:07.977 INFO:teuthology.orchestra.run.smithi159.stderr:1+0 records in 2023-12-17T11:47:07.977 INFO:teuthology.orchestra.run.smithi159.stderr:1+0 records out 2023-12-17T11:47:07.977 INFO:teuthology.orchestra.run.smithi159.stderr:512 bytes copied, 0.000353482 s, 1.4 MB/s 2023-12-17T11:47:07.980 DEBUG:teuthology.orchestra.run.smithi159:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-12-17T11:47:08.037 DEBUG:teuthology.orchestra.run.smithi159:> stat /dev/vg_nvme/lv_2 2023-12-17T11:47:08.087 INFO:teuthology.orchestra.run.smithi159.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-12-17T11:47:08.087 INFO:teuthology.orchestra.run.smithi159.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-17T11:47:08.087 INFO:teuthology.orchestra.run.smithi159.stdout:Device: 5h/5d Inode: 653 Links: 1 2023-12-17T11:47:08.088 INFO:teuthology.orchestra.run.smithi159.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-17T11:47:08.088 INFO:teuthology.orchestra.run.smithi159.stdout:Context: system_u:object_r:device_t:s0 2023-12-17T11:47:08.088 INFO:teuthology.orchestra.run.smithi159.stdout:Access: 2023-12-17 11:46:49.675121070 +0000 2023-12-17T11:47:08.088 INFO:teuthology.orchestra.run.smithi159.stdout:Modify: 2023-12-17 11:43:41.250431465 +0000 2023-12-17T11:47:08.088 INFO:teuthology.orchestra.run.smithi159.stdout:Change: 2023-12-17 11:43:41.250431465 +0000 2023-12-17T11:47:08.088 INFO:teuthology.orchestra.run.smithi159.stdout: Birth: 2023-12-17 11:43:41.250431465 +0000 2023-12-17T11:47:08.088 DEBUG:teuthology.orchestra.run.smithi159:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-12-17T11:47:08.166 INFO:teuthology.orchestra.run.smithi159.stderr:1+0 records in 2023-12-17T11:47:08.166 INFO:teuthology.orchestra.run.smithi159.stderr:1+0 records out 2023-12-17T11:47:08.166 INFO:teuthology.orchestra.run.smithi159.stderr:512 bytes copied, 0.000307742 s, 1.7 MB/s 2023-12-17T11:47:08.169 DEBUG:teuthology.orchestra.run.smithi159:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-12-17T11:47:08.224 DEBUG:teuthology.orchestra.run.smithi159:> stat /dev/vg_nvme/lv_3 2023-12-17T11:47:08.272 INFO:teuthology.orchestra.run.smithi159.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-12-17T11:47:08.273 INFO:teuthology.orchestra.run.smithi159.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-17T11:47:08.273 INFO:teuthology.orchestra.run.smithi159.stdout:Device: 5h/5d Inode: 671 Links: 1 2023-12-17T11:47:08.273 INFO:teuthology.orchestra.run.smithi159.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-17T11:47:08.273 INFO:teuthology.orchestra.run.smithi159.stdout:Context: system_u:object_r:device_t:s0 2023-12-17T11:47:08.273 INFO:teuthology.orchestra.run.smithi159.stdout:Access: 2023-12-17 11:46:49.676121051 +0000 2023-12-17T11:47:08.273 INFO:teuthology.orchestra.run.smithi159.stdout:Modify: 2023-12-17 11:43:42.314411404 +0000 2023-12-17T11:47:08.273 INFO:teuthology.orchestra.run.smithi159.stdout:Change: 2023-12-17 11:43:42.314411404 +0000 2023-12-17T11:47:08.273 INFO:teuthology.orchestra.run.smithi159.stdout: Birth: 2023-12-17 11:43:42.314411404 +0000 2023-12-17T11:47:08.273 DEBUG:teuthology.orchestra.run.smithi159:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-12-17T11:47:08.355 INFO:teuthology.orchestra.run.smithi159.stderr:1+0 records in 2023-12-17T11:47:08.355 INFO:teuthology.orchestra.run.smithi159.stderr:1+0 records out 2023-12-17T11:47:08.355 INFO:teuthology.orchestra.run.smithi159.stderr:512 bytes copied, 0.000316807 s, 1.6 MB/s 2023-12-17T11:47:08.358 DEBUG:teuthology.orchestra.run.smithi159:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-12-17T11:47:08.413 DEBUG:teuthology.orchestra.run.smithi159:> stat /dev/vg_nvme/lv_4 2023-12-17T11:47:08.461 INFO:teuthology.orchestra.run.smithi159.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-12-17T11:47:08.462 INFO:teuthology.orchestra.run.smithi159.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-17T11:47:08.462 INFO:teuthology.orchestra.run.smithi159.stdout:Device: 5h/5d Inode: 689 Links: 1 2023-12-17T11:47:08.462 INFO:teuthology.orchestra.run.smithi159.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-17T11:47:08.462 INFO:teuthology.orchestra.run.smithi159.stdout:Context: system_u:object_r:device_t:s0 2023-12-17T11:47:08.462 INFO:teuthology.orchestra.run.smithi159.stdout:Access: 2023-12-17 11:46:49.677121032 +0000 2023-12-17T11:47:08.462 INFO:teuthology.orchestra.run.smithi159.stdout:Modify: 2023-12-17 11:43:43.358391719 +0000 2023-12-17T11:47:08.462 INFO:teuthology.orchestra.run.smithi159.stdout:Change: 2023-12-17 11:43:43.358391719 +0000 2023-12-17T11:47:08.462 INFO:teuthology.orchestra.run.smithi159.stdout: Birth: 2023-12-17 11:43:43.358391719 +0000 2023-12-17T11:47:08.462 DEBUG:teuthology.orchestra.run.smithi159:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-12-17T11:47:08.604 INFO:teuthology.orchestra.run.smithi159.stderr:1+0 records in 2023-12-17T11:47:08.605 INFO:teuthology.orchestra.run.smithi159.stderr:1+0 records out 2023-12-17T11:47:08.605 INFO:teuthology.orchestra.run.smithi159.stderr:512 bytes copied, 0.00035563 s, 1.4 MB/s 2023-12-17T11:47:08.608 DEBUG:teuthology.orchestra.run.smithi159:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-12-17T11:47:08.666 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-12-17T11:47:08.667 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi040.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi159.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-12-17T11:47:08.667 INFO:tasks.ceph:Generating config... 2023-12-17T11:47:08.668 INFO:tasks.ceph:[client] client mount timeout = 600 2023-12-17T11:47:08.668 INFO:tasks.ceph:[client] debug client = 20 2023-12-17T11:47:08.668 INFO:tasks.ceph:[client] debug ms = 1 2023-12-17T11:47:08.668 INFO:tasks.ceph:[client] pid file = 2023-12-17T11:47:08.668 INFO:tasks.ceph:[client] rados mon op timeout = 900 2023-12-17T11:47:08.668 INFO:tasks.ceph:[client] rados osd op timeout = 900 2023-12-17T11:47:08.668 INFO:tasks.ceph:[global] ms die on skipped message = False 2023-12-17T11:47:08.668 INFO:tasks.ceph:[mds] debug mds = 20 2023-12-17T11:47:08.669 INFO:tasks.ceph:[mds] debug mds balancer = 20 2023-12-17T11:47:08.669 INFO:tasks.ceph:[mds] debug ms = 1 2023-12-17T11:47:08.669 INFO:tasks.ceph:[mds] mds debug frag = True 2023-12-17T11:47:08.669 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2023-12-17T11:47:08.669 INFO:tasks.ceph:[mds] mds op complaint time = 180 2023-12-17T11:47:08.669 INFO:tasks.ceph:[mds] mds verify scatter = True 2023-12-17T11:47:08.669 INFO:tasks.ceph:[mds] osd op complaint time = 180 2023-12-17T11:47:08.669 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2023-12-17T11:47:08.669 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2023-12-17T11:47:08.669 INFO:tasks.ceph:[mgr] debug mgr = 20 2023-12-17T11:47:08.669 INFO:tasks.ceph:[mgr] debug ms = 1 2023-12-17T11:47:08.669 INFO:tasks.ceph:[mon] debug mon = 20 2023-12-17T11:47:08.669 INFO:tasks.ceph:[mon] debug ms = 1 2023-12-17T11:47:08.669 INFO:tasks.ceph:[mon] debug paxos = 20 2023-12-17T11:47:08.669 INFO:tasks.ceph:[mon] mon op complaint time = 120 2023-12-17T11:47:08.670 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2023-12-17T11:47:08.670 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2023-12-17T11:47:08.670 INFO:tasks.ceph:[osd] debug bluefs = 20 2023-12-17T11:47:08.670 INFO:tasks.ceph:[osd] debug bluestore = 20 2023-12-17T11:47:08.670 INFO:tasks.ceph:[osd] debug ms = 1 2023-12-17T11:47:08.670 INFO:tasks.ceph:[osd] debug osd = 20 2023-12-17T11:47:08.670 INFO:tasks.ceph:[osd] debug rocksdb = 10 2023-12-17T11:47:08.670 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2023-12-17T11:47:08.670 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2023-12-17T11:47:08.670 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2023-12-17T11:47:08.670 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2023-12-17T11:47:08.670 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2023-12-17T11:47:08.670 INFO:tasks.ceph:[osd] osd op complaint time = 180 2023-12-17T11:47:08.671 INFO:tasks.ceph:Setting up mon.a... 2023-12-17T11:47:08.671 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2023-12-17T11:47:08.822 INFO:teuthology.orchestra.run.smithi040.stdout:creating /etc/ceph/ceph.keyring 2023-12-17T11:47:08.831 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2023-12-17T11:47:08.980 DEBUG:teuthology.orchestra.run.smithi040:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-12-17T11:47:09.081 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.40'), ('mon.b', '172.21.15.159'), ('mon.c', '[v2:172.21.15.159:3301,v1:172.21.15.159:6790]')] 2023-12-17T11:47:09.082 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.40,172.21.15.159,[v2:172.21.15.159:3301,v1:172.21.15.159:6790]', 'ms die on skipped message': False}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2023-12-17T11:47:09.082 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2023-12-17T11:47:09.082 DEBUG:teuthology.orchestra.run.smithi040:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2023-12-17T11:47:09.140 DEBUG:teuthology.orchestra.run.smithi040:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.40 --add b 172.21.15.159 --addv c '[v2:172.21.15.159:3301,v1:172.21.15.159:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2023-12-17T11:47:09.301 INFO:teuthology.orchestra.run.smithi040.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2023-12-17T11:47:09.302 INFO:teuthology.orchestra.run.smithi040.stdout:monmaptool: generated fsid 099cd35d-80d9-4ca4-8424-de13b3b03ac7 2023-12-17T11:47:09.302 INFO:teuthology.orchestra.run.smithi040.stdout:setting min_mon_release = pacific 2023-12-17T11:47:09.302 INFO:teuthology.orchestra.run.smithi040.stdout:epoch 0 2023-12-17T11:47:09.302 INFO:teuthology.orchestra.run.smithi040.stdout:fsid 099cd35d-80d9-4ca4-8424-de13b3b03ac7 2023-12-17T11:47:09.302 INFO:teuthology.orchestra.run.smithi040.stdout:last_changed 2023-12-17T11:47:09.300751+0000 2023-12-17T11:47:09.302 INFO:teuthology.orchestra.run.smithi040.stdout:created 2023-12-17T11:47:09.300751+0000 2023-12-17T11:47:09.302 INFO:teuthology.orchestra.run.smithi040.stdout:min_mon_release 16 (pacific) 2023-12-17T11:47:09.302 INFO:teuthology.orchestra.run.smithi040.stdout:election_strategy: 1 2023-12-17T11:47:09.302 INFO:teuthology.orchestra.run.smithi040.stdout:0: [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] mon.a 2023-12-17T11:47:09.302 INFO:teuthology.orchestra.run.smithi040.stdout:1: [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] mon.b 2023-12-17T11:47:09.302 INFO:teuthology.orchestra.run.smithi040.stdout:2: [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] mon.c 2023-12-17T11:47:09.302 INFO:teuthology.orchestra.run.smithi040.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2023-12-17T11:47:09.305 DEBUG:teuthology.orchestra.run.smithi040:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2023-12-17T11:47:09.360 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 099cd35d-80d9-4ca4-8424-de13b3b03ac7... 2023-12-17T11:47:09.361 DEBUG:teuthology.orchestra.run.smithi040:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-12-17T11:47:09.369 DEBUG:teuthology.orchestra.run.smithi159:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-12-17T11:47:09.545 INFO:teuthology.orchestra.run.smithi040.stdout:[global] 2023-12-17T11:47:09.545 INFO:teuthology.orchestra.run.smithi040.stdout: chdir = "" 2023-12-17T11:47:09.545 INFO:teuthology.orchestra.run.smithi040.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-12-17T11:47:09.545 INFO:teuthology.orchestra.run.smithi040.stdout: auth supported = cephx 2023-12-17T11:47:09.545 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T11:47:09.545 INFO:teuthology.orchestra.run.smithi040.stdout: filestore xattr use omap = true 2023-12-17T11:47:09.545 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T11:47:09.545 INFO:teuthology.orchestra.run.smithi040.stdout: mon clock drift allowed = 1.000 2023-12-17T11:47:09.545 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T11:47:09.545 INFO:teuthology.orchestra.run.smithi040.stdout: osd crush chooseleaf type = 0 2023-12-17T11:47:09.545 INFO:teuthology.orchestra.run.smithi040.stdout: auth debug = true 2023-12-17T11:47:09.546 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T11:47:09.546 INFO:teuthology.orchestra.run.smithi040.stdout: ms die on old message = true 2023-12-17T11:47:09.546 INFO:teuthology.orchestra.run.smithi040.stdout: ms die on bug = true 2023-12-17T11:47:09.546 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T11:47:09.546 INFO:teuthology.orchestra.run.smithi040.stdout: mon max pg per osd = 10000 # >= luminous 2023-12-17T11:47:09.546 INFO:teuthology.orchestra.run.smithi040.stdout: mon pg warn max object skew = 0 2023-12-17T11:47:09.546 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T11:47:09.546 INFO:teuthology.orchestra.run.smithi040.stdout: # disable pg_autoscaler by default for new pools 2023-12-17T11:47:09.546 INFO:teuthology.orchestra.run.smithi040.stdout: osd_pool_default_pg_autoscale_mode = off 2023-12-17T11:47:09.546 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T11:47:09.546 INFO:teuthology.orchestra.run.smithi040.stdout: osd pool default size = 2 2023-12-17T11:47:09.546 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T11:47:09.546 INFO:teuthology.orchestra.run.smithi040.stdout: mon osd allow primary affinity = true 2023-12-17T11:47:09.546 INFO:teuthology.orchestra.run.smithi040.stdout: mon osd allow pg remap = true 2023-12-17T11:47:09.546 INFO:teuthology.orchestra.run.smithi040.stdout: mon warn on legacy crush tunables = false 2023-12-17T11:47:09.547 INFO:teuthology.orchestra.run.smithi040.stdout: mon warn on crush straw calc version zero = false 2023-12-17T11:47:09.547 INFO:teuthology.orchestra.run.smithi040.stdout: mon warn on no sortbitwise = false 2023-12-17T11:47:09.547 INFO:teuthology.orchestra.run.smithi040.stdout: mon warn on osd down out interval zero = false 2023-12-17T11:47:09.547 INFO:teuthology.orchestra.run.smithi040.stdout: mon warn on too few osds = false 2023-12-17T11:47:09.547 INFO:teuthology.orchestra.run.smithi040.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-12-17T11:47:09.547 INFO:teuthology.orchestra.run.smithi040.stdout: mon_warn_on_pool_no_redundancy = false 2023-12-17T11:47:09.547 INFO:teuthology.orchestra.run.smithi040.stdout: mon_allow_pool_size_one = true 2023-12-17T11:47:09.547 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T11:47:09.547 INFO:teuthology.orchestra.run.smithi040.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-12-17T11:47:09.547 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T11:47:09.547 INFO:teuthology.orchestra.run.smithi040.stdout: osd default data pool replay window = 5 2023-12-17T11:47:09.547 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T11:47:09.547 INFO:teuthology.orchestra.run.smithi040.stdout: mon allow pool delete = true 2023-12-17T11:47:09.547 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T11:47:09.548 INFO:teuthology.orchestra.run.smithi040.stdout: mon cluster log file level = debug 2023-12-17T11:47:09.548 INFO:teuthology.orchestra.run.smithi040.stdout: debug asserts on shutdown = true 2023-12-17T11:47:09.548 INFO:teuthology.orchestra.run.smithi040.stdout: mon health detail to clog = false 2023-12-17T11:47:09.548 INFO:teuthology.orchestra.run.smithi040.stdout: mon host = "172.21.15.40,172.21.15.159,[v2:172.21.15.159:3301,v1:172.21.15.159:6790]" 2023-12-17T11:47:09.548 INFO:teuthology.orchestra.run.smithi040.stdout: ms die on skipped message = False 2023-12-17T11:47:09.548 INFO:teuthology.orchestra.run.smithi040.stdout: fsid = 099cd35d-80d9-4ca4-8424-de13b3b03ac7 2023-12-17T11:47:09.548 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T11:47:09.548 INFO:teuthology.orchestra.run.smithi040.stdout:[osd] 2023-12-17T11:47:09.548 INFO:teuthology.orchestra.run.smithi040.stdout: osd journal size = 100 2023-12-17T11:47:09.548 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T11:47:09.548 INFO:teuthology.orchestra.run.smithi040.stdout: osd scrub load threshold = 5.0 2023-12-17T11:47:09.548 INFO:teuthology.orchestra.run.smithi040.stdout: osd scrub max interval = 600 2023-12-17T11:47:09.548 INFO:teuthology.orchestra.run.smithi040.stdout: osd mclock profile = high_recovery_ops 2023-12-17T11:47:09.549 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T11:47:09.549 INFO:teuthology.orchestra.run.smithi040.stdout: osd recover clone overlap = true 2023-12-17T11:47:09.549 INFO:teuthology.orchestra.run.smithi040.stdout: osd recovery max chunk = 1048576 2023-12-17T11:47:09.549 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T11:47:09.549 INFO:teuthology.orchestra.run.smithi040.stdout: osd debug shutdown = true 2023-12-17T11:47:09.549 INFO:teuthology.orchestra.run.smithi040.stdout: osd debug op order = true 2023-12-17T11:47:09.549 INFO:teuthology.orchestra.run.smithi040.stdout: osd debug verify stray on activate = true 2023-12-17T11:47:09.549 INFO:teuthology.orchestra.run.smithi040.stdout: osd debug trim objects = true 2023-12-17T11:47:09.549 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T11:47:09.549 INFO:teuthology.orchestra.run.smithi040.stdout: osd open classes on start = true 2023-12-17T11:47:09.549 INFO:teuthology.orchestra.run.smithi040.stdout: osd debug pg log writeout = true 2023-12-17T11:47:09.549 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T11:47:09.549 INFO:teuthology.orchestra.run.smithi040.stdout: osd deep scrub update digest min age = 30 2023-12-17T11:47:09.550 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T11:47:09.550 INFO:teuthology.orchestra.run.smithi040.stdout: osd map max advance = 10 2023-12-17T11:47:09.550 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T11:47:09.550 INFO:teuthology.orchestra.run.smithi040.stdout: journal zero on create = true 2023-12-17T11:47:09.550 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T11:47:09.550 INFO:teuthology.orchestra.run.smithi040.stdout: filestore ondisk finisher threads = 3 2023-12-17T11:47:09.550 INFO:teuthology.orchestra.run.smithi040.stdout: filestore apply finisher threads = 3 2023-12-17T11:47:09.550 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T11:47:09.550 INFO:teuthology.orchestra.run.smithi040.stdout: bdev debug aio = true 2023-12-17T11:47:09.550 INFO:teuthology.orchestra.run.smithi040.stdout: osd debug misdirected ops = true 2023-12-17T11:47:09.550 INFO:teuthology.orchestra.run.smithi040.stdout: bluestore block size = 96636764160 2023-12-17T11:47:09.550 INFO:teuthology.orchestra.run.smithi040.stdout: bluestore fsck on mount = True 2023-12-17T11:47:09.550 INFO:teuthology.orchestra.run.smithi040.stdout: debug bluefs = 20 2023-12-17T11:47:09.551 INFO:teuthology.orchestra.run.smithi040.stdout: debug bluestore = 20 2023-12-17T11:47:09.551 INFO:teuthology.orchestra.run.smithi040.stdout: debug ms = 1 2023-12-17T11:47:09.551 INFO:teuthology.orchestra.run.smithi040.stdout: debug osd = 20 2023-12-17T11:47:09.551 INFO:teuthology.orchestra.run.smithi040.stdout: debug rocksdb = 10 2023-12-17T11:47:09.551 INFO:teuthology.orchestra.run.smithi040.stdout: mon osd backfillfull_ratio = 0.85 2023-12-17T11:47:09.551 INFO:teuthology.orchestra.run.smithi040.stdout: mon osd full ratio = 0.9 2023-12-17T11:47:09.551 INFO:teuthology.orchestra.run.smithi040.stdout: mon osd nearfull ratio = 0.8 2023-12-17T11:47:09.551 INFO:teuthology.orchestra.run.smithi040.stdout: osd failsafe full ratio = 0.95 2023-12-17T11:47:09.551 INFO:teuthology.orchestra.run.smithi040.stdout: osd objectstore = bluestore 2023-12-17T11:47:09.551 INFO:teuthology.orchestra.run.smithi040.stdout: osd op complaint time = 180 2023-12-17T11:47:09.551 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T11:47:09.551 INFO:teuthology.orchestra.run.smithi040.stdout:[mgr] 2023-12-17T11:47:09.551 INFO:teuthology.orchestra.run.smithi040.stdout: debug ms = 1 2023-12-17T11:47:09.551 INFO:teuthology.orchestra.run.smithi040.stdout: debug mgr = 20 2023-12-17T11:47:09.552 INFO:teuthology.orchestra.run.smithi040.stdout: debug mon = 20 2023-12-17T11:47:09.552 INFO:teuthology.orchestra.run.smithi040.stdout: debug auth = 20 2023-12-17T11:47:09.552 INFO:teuthology.orchestra.run.smithi040.stdout: mon reweight min pgs per osd = 4 2023-12-17T11:47:09.552 INFO:teuthology.orchestra.run.smithi040.stdout: mon reweight min bytes per osd = 10 2023-12-17T11:47:09.552 INFO:teuthology.orchestra.run.smithi040.stdout: mgr/telemetry/nag = false 2023-12-17T11:47:09.552 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T11:47:09.552 INFO:teuthology.orchestra.run.smithi040.stdout:[mon] 2023-12-17T11:47:09.552 INFO:teuthology.orchestra.run.smithi040.stdout: debug ms = 1 2023-12-17T11:47:09.552 INFO:teuthology.orchestra.run.smithi040.stdout: debug mon = 20 2023-12-17T11:47:09.552 INFO:teuthology.orchestra.run.smithi040.stdout: debug paxos = 20 2023-12-17T11:47:09.552 INFO:teuthology.orchestra.run.smithi040.stdout: debug auth = 20 2023-12-17T11:47:09.552 INFO:teuthology.orchestra.run.smithi040.stdout: mon data avail warn = 5 2023-12-17T11:47:09.552 INFO:teuthology.orchestra.run.smithi040.stdout: mon mgr mkfs grace = 240 2023-12-17T11:47:09.552 INFO:teuthology.orchestra.run.smithi040.stdout: mon reweight min pgs per osd = 4 2023-12-17T11:47:09.552 INFO:teuthology.orchestra.run.smithi040.stdout: mon osd reporter subtree level = osd 2023-12-17T11:47:09.553 INFO:teuthology.orchestra.run.smithi040.stdout: mon osd prime pg temp = true 2023-12-17T11:47:09.553 INFO:teuthology.orchestra.run.smithi040.stdout: mon reweight min bytes per osd = 10 2023-12-17T11:47:09.553 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T11:47:09.553 INFO:teuthology.orchestra.run.smithi040.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-12-17T11:47:09.555 INFO:teuthology.orchestra.run.smithi040.stdout: auth mon ticket ttl = 660 # 11m 2023-12-17T11:47:09.555 INFO:teuthology.orchestra.run.smithi040.stdout: auth service ticket ttl = 240 # 4m 2023-12-17T11:47:09.555 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T11:47:09.555 INFO:teuthology.orchestra.run.smithi040.stdout: # don't complain about insecure global_id in the test suite 2023-12-17T11:47:09.556 INFO:teuthology.orchestra.run.smithi040.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-12-17T11:47:09.556 INFO:teuthology.orchestra.run.smithi040.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-12-17T11:47:09.556 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T11:47:09.556 INFO:teuthology.orchestra.run.smithi040.stdout: # 1m isn't quite enough 2023-12-17T11:47:09.556 INFO:teuthology.orchestra.run.smithi040.stdout: mon_down_mkfs_grace = 2m 2023-12-17T11:47:09.556 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T11:47:09.556 INFO:teuthology.orchestra.run.smithi040.stdout: mon_warn_on_filestore_osds = false 2023-12-17T11:47:09.556 INFO:teuthology.orchestra.run.smithi040.stdout: mon op complaint time = 120 2023-12-17T11:47:09.557 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T11:47:09.557 INFO:teuthology.orchestra.run.smithi040.stdout:[client] 2023-12-17T11:47:09.557 INFO:teuthology.orchestra.run.smithi040.stdout: rgw cache enabled = true 2023-12-17T11:47:09.557 INFO:teuthology.orchestra.run.smithi040.stdout: rgw enable ops log = true 2023-12-17T11:47:09.557 INFO:teuthology.orchestra.run.smithi040.stdout: rgw enable usage log = true 2023-12-17T11:47:09.557 INFO:teuthology.orchestra.run.smithi040.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-12-17T11:47:09.557 INFO:teuthology.orchestra.run.smithi040.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-12-17T11:47:09.557 INFO:teuthology.orchestra.run.smithi040.stdout: client mount timeout = 600 2023-12-17T11:47:09.558 INFO:teuthology.orchestra.run.smithi040.stdout: debug client = 20 2023-12-17T11:47:09.558 INFO:teuthology.orchestra.run.smithi040.stdout: debug ms = 1 2023-12-17T11:47:09.558 INFO:teuthology.orchestra.run.smithi040.stdout: pid file = "" 2023-12-17T11:47:09.558 INFO:teuthology.orchestra.run.smithi040.stdout: rados mon op timeout = 900 2023-12-17T11:47:09.558 INFO:teuthology.orchestra.run.smithi040.stdout: rados osd op timeout = 900 2023-12-17T11:47:09.558 INFO:teuthology.orchestra.run.smithi040.stdout:[mon.a] 2023-12-17T11:47:09.558 INFO:teuthology.orchestra.run.smithi040.stdout:[mon.b] 2023-12-17T11:47:09.559 INFO:teuthology.orchestra.run.smithi040.stdout:[mon.c] 2023-12-17T11:47:09.559 INFO:teuthology.orchestra.run.smithi040.stdout:[mds.a] 2023-12-17T11:47:09.559 INFO:teuthology.orchestra.run.smithi040.stdout:[mds.c] 2023-12-17T11:47:09.559 INFO:teuthology.orchestra.run.smithi040.stdout:[mds.b] 2023-12-17T11:47:09.559 INFO:teuthology.orchestra.run.smithi040.stdout:[mds.d] 2023-12-17T11:47:09.559 INFO:teuthology.orchestra.run.smithi040.stdout:[mds] 2023-12-17T11:47:09.559 INFO:teuthology.orchestra.run.smithi040.stdout: debug mds = 20 2023-12-17T11:47:09.559 INFO:teuthology.orchestra.run.smithi040.stdout: debug mds balancer = 20 2023-12-17T11:47:09.559 INFO:teuthology.orchestra.run.smithi040.stdout: debug ms = 1 2023-12-17T11:47:09.559 INFO:teuthology.orchestra.run.smithi040.stdout: mds debug frag = True 2023-12-17T11:47:09.559 INFO:teuthology.orchestra.run.smithi040.stdout: mds debug scatterstat = True 2023-12-17T11:47:09.559 INFO:teuthology.orchestra.run.smithi040.stdout: mds op complaint time = 180 2023-12-17T11:47:09.559 INFO:teuthology.orchestra.run.smithi040.stdout: mds verify scatter = True 2023-12-17T11:47:09.560 INFO:teuthology.orchestra.run.smithi040.stdout: osd op complaint time = 180 2023-12-17T11:47:09.560 INFO:teuthology.orchestra.run.smithi040.stdout: rados mon op timeout = 900 2023-12-17T11:47:09.560 INFO:teuthology.orchestra.run.smithi040.stdout: rados osd op timeout = 900 2023-12-17T11:47:09.560 INFO:teuthology.orchestra.run.smithi159.stdout:[global] 2023-12-17T11:47:09.560 INFO:teuthology.orchestra.run.smithi159.stdout: chdir = "" 2023-12-17T11:47:09.560 INFO:teuthology.orchestra.run.smithi159.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-12-17T11:47:09.561 INFO:teuthology.orchestra.run.smithi159.stdout: auth supported = cephx 2023-12-17T11:47:09.561 INFO:teuthology.orchestra.run.smithi159.stdout: 2023-12-17T11:47:09.561 INFO:teuthology.orchestra.run.smithi159.stdout: filestore xattr use omap = true 2023-12-17T11:47:09.561 INFO:teuthology.orchestra.run.smithi159.stdout: 2023-12-17T11:47:09.561 INFO:teuthology.orchestra.run.smithi159.stdout: mon clock drift allowed = 1.000 2023-12-17T11:47:09.561 INFO:teuthology.orchestra.run.smithi159.stdout: 2023-12-17T11:47:09.561 INFO:teuthology.orchestra.run.smithi159.stdout: osd crush chooseleaf type = 0 2023-12-17T11:47:09.561 INFO:teuthology.orchestra.run.smithi159.stdout: auth debug = true 2023-12-17T11:47:09.561 INFO:teuthology.orchestra.run.smithi159.stdout: 2023-12-17T11:47:09.561 INFO:teuthology.orchestra.run.smithi159.stdout: ms die on old message = true 2023-12-17T11:47:09.561 INFO:teuthology.orchestra.run.smithi159.stdout: ms die on bug = true 2023-12-17T11:47:09.561 INFO:teuthology.orchestra.run.smithi159.stdout: 2023-12-17T11:47:09.562 INFO:teuthology.orchestra.run.smithi159.stdout: mon max pg per osd = 10000 # >= luminous 2023-12-17T11:47:09.562 INFO:teuthology.orchestra.run.smithi159.stdout: mon pg warn max object skew = 0 2023-12-17T11:47:09.562 INFO:teuthology.orchestra.run.smithi159.stdout: 2023-12-17T11:47:09.562 INFO:teuthology.orchestra.run.smithi159.stdout: # disable pg_autoscaler by default for new pools 2023-12-17T11:47:09.562 INFO:teuthology.orchestra.run.smithi159.stdout: osd_pool_default_pg_autoscale_mode = off 2023-12-17T11:47:09.562 INFO:teuthology.orchestra.run.smithi159.stdout: 2023-12-17T11:47:09.562 INFO:teuthology.orchestra.run.smithi159.stdout: osd pool default size = 2 2023-12-17T11:47:09.562 INFO:teuthology.orchestra.run.smithi159.stdout: 2023-12-17T11:47:09.563 INFO:teuthology.orchestra.run.smithi159.stdout: mon osd allow primary affinity = true 2023-12-17T11:47:09.563 INFO:teuthology.orchestra.run.smithi159.stdout: mon osd allow pg remap = true 2023-12-17T11:47:09.563 INFO:teuthology.orchestra.run.smithi159.stdout: mon warn on legacy crush tunables = false 2023-12-17T11:47:09.563 INFO:teuthology.orchestra.run.smithi159.stdout: mon warn on crush straw calc version zero = false 2023-12-17T11:47:09.563 INFO:teuthology.orchestra.run.smithi159.stdout: mon warn on no sortbitwise = false 2023-12-17T11:47:09.563 INFO:teuthology.orchestra.run.smithi159.stdout: mon warn on osd down out interval zero = false 2023-12-17T11:47:09.563 INFO:teuthology.orchestra.run.smithi159.stdout: mon warn on too few osds = false 2023-12-17T11:47:09.563 INFO:teuthology.orchestra.run.smithi159.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-12-17T11:47:09.563 INFO:teuthology.orchestra.run.smithi159.stdout: mon_warn_on_pool_no_redundancy = false 2023-12-17T11:47:09.563 INFO:teuthology.orchestra.run.smithi159.stdout: mon_allow_pool_size_one = true 2023-12-17T11:47:09.564 INFO:teuthology.orchestra.run.smithi159.stdout: 2023-12-17T11:47:09.564 INFO:teuthology.orchestra.run.smithi159.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-12-17T11:47:09.564 INFO:teuthology.orchestra.run.smithi159.stdout: 2023-12-17T11:47:09.564 INFO:teuthology.orchestra.run.smithi159.stdout: osd default data pool replay window = 5 2023-12-17T11:47:09.564 INFO:teuthology.orchestra.run.smithi159.stdout: 2023-12-17T11:47:09.564 INFO:teuthology.orchestra.run.smithi159.stdout: mon allow pool delete = true 2023-12-17T11:47:09.564 INFO:teuthology.orchestra.run.smithi159.stdout: 2023-12-17T11:47:09.564 INFO:teuthology.orchestra.run.smithi159.stdout: mon cluster log file level = debug 2023-12-17T11:47:09.564 INFO:teuthology.orchestra.run.smithi159.stdout: debug asserts on shutdown = true 2023-12-17T11:47:09.564 INFO:teuthology.orchestra.run.smithi159.stdout: mon health detail to clog = false 2023-12-17T11:47:09.564 INFO:teuthology.orchestra.run.smithi159.stdout: mon host = "172.21.15.40,172.21.15.159,[v2:172.21.15.159:3301,v1:172.21.15.159:6790]" 2023-12-17T11:47:09.564 INFO:teuthology.orchestra.run.smithi159.stdout: ms die on skipped message = False 2023-12-17T11:47:09.564 INFO:teuthology.orchestra.run.smithi159.stdout: fsid = 099cd35d-80d9-4ca4-8424-de13b3b03ac7 2023-12-17T11:47:09.565 INFO:teuthology.orchestra.run.smithi159.stdout: 2023-12-17T11:47:09.565 INFO:teuthology.orchestra.run.smithi159.stdout:[osd] 2023-12-17T11:47:09.565 INFO:teuthology.orchestra.run.smithi159.stdout: osd journal size = 100 2023-12-17T11:47:09.565 INFO:teuthology.orchestra.run.smithi159.stdout: 2023-12-17T11:47:09.565 INFO:teuthology.orchestra.run.smithi159.stdout: osd scrub load threshold = 5.0 2023-12-17T11:47:09.565 INFO:teuthology.orchestra.run.smithi159.stdout: osd scrub max interval = 600 2023-12-17T11:47:09.566 INFO:teuthology.orchestra.run.smithi159.stdout: osd mclock profile = high_recovery_ops 2023-12-17T11:47:09.566 INFO:teuthology.orchestra.run.smithi159.stdout: 2023-12-17T11:47:09.566 INFO:teuthology.orchestra.run.smithi159.stdout: osd recover clone overlap = true 2023-12-17T11:47:09.566 INFO:teuthology.orchestra.run.smithi159.stdout: osd recovery max chunk = 1048576 2023-12-17T11:47:09.566 INFO:teuthology.orchestra.run.smithi159.stdout: 2023-12-17T11:47:09.566 INFO:teuthology.orchestra.run.smithi159.stdout: osd debug shutdown = true 2023-12-17T11:47:09.566 INFO:teuthology.orchestra.run.smithi159.stdout: osd debug op order = true 2023-12-17T11:47:09.566 INFO:teuthology.orchestra.run.smithi159.stdout: osd debug verify stray on activate = true 2023-12-17T11:47:09.567 INFO:teuthology.orchestra.run.smithi159.stdout: osd debug trim objects = true 2023-12-17T11:47:09.567 INFO:teuthology.orchestra.run.smithi159.stdout: 2023-12-17T11:47:09.567 INFO:teuthology.orchestra.run.smithi159.stdout: osd open classes on start = true 2023-12-17T11:47:09.567 INFO:teuthology.orchestra.run.smithi159.stdout: osd debug pg log writeout = true 2023-12-17T11:47:09.567 INFO:teuthology.orchestra.run.smithi159.stdout: 2023-12-17T11:47:09.567 INFO:teuthology.orchestra.run.smithi159.stdout: osd deep scrub update digest min age = 30 2023-12-17T11:47:09.567 INFO:teuthology.orchestra.run.smithi159.stdout: 2023-12-17T11:47:09.568 INFO:teuthology.orchestra.run.smithi159.stdout: osd map max advance = 10 2023-12-17T11:47:09.568 INFO:teuthology.orchestra.run.smithi159.stdout: 2023-12-17T11:47:09.568 INFO:teuthology.orchestra.run.smithi159.stdout: journal zero on create = true 2023-12-17T11:47:09.568 INFO:teuthology.orchestra.run.smithi159.stdout: 2023-12-17T11:47:09.568 INFO:teuthology.orchestra.run.smithi159.stdout: filestore ondisk finisher threads = 3 2023-12-17T11:47:09.568 INFO:teuthology.orchestra.run.smithi159.stdout: filestore apply finisher threads = 3 2023-12-17T11:47:09.569 INFO:teuthology.orchestra.run.smithi159.stdout: 2023-12-17T11:47:09.569 INFO:teuthology.orchestra.run.smithi159.stdout: bdev debug aio = true 2023-12-17T11:47:09.569 INFO:teuthology.orchestra.run.smithi159.stdout: osd debug misdirected ops = true 2023-12-17T11:47:09.569 INFO:teuthology.orchestra.run.smithi159.stdout: bluestore block size = 96636764160 2023-12-17T11:47:09.569 INFO:teuthology.orchestra.run.smithi159.stdout: bluestore fsck on mount = True 2023-12-17T11:47:09.569 INFO:teuthology.orchestra.run.smithi159.stdout: debug bluefs = 20 2023-12-17T11:47:09.570 INFO:teuthology.orchestra.run.smithi159.stdout: debug bluestore = 20 2023-12-17T11:47:09.570 INFO:teuthology.orchestra.run.smithi159.stdout: debug ms = 1 2023-12-17T11:47:09.570 INFO:teuthology.orchestra.run.smithi159.stdout: debug osd = 20 2023-12-17T11:47:09.570 INFO:teuthology.orchestra.run.smithi159.stdout: debug rocksdb = 10 2023-12-17T11:47:09.570 INFO:teuthology.orchestra.run.smithi159.stdout: mon osd backfillfull_ratio = 0.85 2023-12-17T11:47:09.570 INFO:teuthology.orchestra.run.smithi159.stdout: mon osd full ratio = 0.9 2023-12-17T11:47:09.570 INFO:teuthology.orchestra.run.smithi159.stdout: mon osd nearfull ratio = 0.8 2023-12-17T11:47:09.571 INFO:teuthology.orchestra.run.smithi159.stdout: osd failsafe full ratio = 0.95 2023-12-17T11:47:09.571 INFO:teuthology.orchestra.run.smithi159.stdout: osd objectstore = bluestore 2023-12-17T11:47:09.571 INFO:teuthology.orchestra.run.smithi159.stdout: osd op complaint time = 180 2023-12-17T11:47:09.571 INFO:teuthology.orchestra.run.smithi159.stdout: 2023-12-17T11:47:09.571 INFO:teuthology.orchestra.run.smithi159.stdout:[mgr] 2023-12-17T11:47:09.571 INFO:teuthology.orchestra.run.smithi159.stdout: debug ms = 1 2023-12-17T11:47:09.572 INFO:teuthology.orchestra.run.smithi159.stdout: debug mgr = 20 2023-12-17T11:47:09.572 INFO:teuthology.orchestra.run.smithi159.stdout: debug mon = 20 2023-12-17T11:47:09.572 INFO:teuthology.orchestra.run.smithi159.stdout: debug auth = 20 2023-12-17T11:47:09.572 INFO:teuthology.orchestra.run.smithi159.stdout: mon reweight min pgs per osd = 4 2023-12-17T11:47:09.572 INFO:teuthology.orchestra.run.smithi159.stdout: mon reweight min bytes per osd = 10 2023-12-17T11:47:09.572 INFO:teuthology.orchestra.run.smithi159.stdout: mgr/telemetry/nag = false 2023-12-17T11:47:09.572 INFO:teuthology.orchestra.run.smithi159.stdout: 2023-12-17T11:47:09.573 INFO:teuthology.orchestra.run.smithi159.stdout:[mon] 2023-12-17T11:47:09.573 INFO:teuthology.orchestra.run.smithi159.stdout: debug ms = 1 2023-12-17T11:47:09.573 INFO:teuthology.orchestra.run.smithi159.stdout: debug mon = 20 2023-12-17T11:47:09.573 INFO:teuthology.orchestra.run.smithi159.stdout: debug paxos = 20 2023-12-17T11:47:09.573 INFO:teuthology.orchestra.run.smithi159.stdout: debug auth = 20 2023-12-17T11:47:09.573 INFO:teuthology.orchestra.run.smithi159.stdout: mon data avail warn = 5 2023-12-17T11:47:09.574 INFO:teuthology.orchestra.run.smithi159.stdout: mon mgr mkfs grace = 240 2023-12-17T11:47:09.574 INFO:teuthology.orchestra.run.smithi159.stdout: mon reweight min pgs per osd = 4 2023-12-17T11:47:09.574 INFO:teuthology.orchestra.run.smithi159.stdout: mon osd reporter subtree level = osd 2023-12-17T11:47:09.574 INFO:teuthology.orchestra.run.smithi159.stdout: mon osd prime pg temp = true 2023-12-17T11:47:09.574 INFO:teuthology.orchestra.run.smithi159.stdout: mon reweight min bytes per osd = 10 2023-12-17T11:47:09.574 INFO:teuthology.orchestra.run.smithi159.stdout: 2023-12-17T11:47:09.574 INFO:teuthology.orchestra.run.smithi159.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-12-17T11:47:09.574 INFO:teuthology.orchestra.run.smithi159.stdout: auth mon ticket ttl = 660 # 11m 2023-12-17T11:47:09.574 INFO:teuthology.orchestra.run.smithi159.stdout: auth service ticket ttl = 240 # 4m 2023-12-17T11:47:09.574 INFO:teuthology.orchestra.run.smithi159.stdout: 2023-12-17T11:47:09.574 INFO:teuthology.orchestra.run.smithi159.stdout: # don't complain about insecure global_id in the test suite 2023-12-17T11:47:09.574 INFO:teuthology.orchestra.run.smithi159.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-12-17T11:47:09.574 INFO:teuthology.orchestra.run.smithi159.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-12-17T11:47:09.575 INFO:teuthology.orchestra.run.smithi159.stdout: 2023-12-17T11:47:09.575 INFO:teuthology.orchestra.run.smithi159.stdout: # 1m isn't quite enough 2023-12-17T11:47:09.575 INFO:teuthology.orchestra.run.smithi159.stdout: mon_down_mkfs_grace = 2m 2023-12-17T11:47:09.575 INFO:teuthology.orchestra.run.smithi159.stdout: 2023-12-17T11:47:09.575 INFO:teuthology.orchestra.run.smithi159.stdout: mon_warn_on_filestore_osds = false 2023-12-17T11:47:09.575 INFO:teuthology.orchestra.run.smithi159.stdout: mon op complaint time = 120 2023-12-17T11:47:09.575 INFO:teuthology.orchestra.run.smithi159.stdout: 2023-12-17T11:47:09.575 INFO:teuthology.orchestra.run.smithi159.stdout:[client] 2023-12-17T11:47:09.575 INFO:teuthology.orchestra.run.smithi159.stdout: rgw cache enabled = true 2023-12-17T11:47:09.575 INFO:teuthology.orchestra.run.smithi159.stdout: rgw enable ops log = true 2023-12-17T11:47:09.575 INFO:teuthology.orchestra.run.smithi159.stdout: rgw enable usage log = true 2023-12-17T11:47:09.575 INFO:teuthology.orchestra.run.smithi159.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-12-17T11:47:09.575 INFO:teuthology.orchestra.run.smithi159.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-12-17T11:47:09.575 INFO:teuthology.orchestra.run.smithi159.stdout: client mount timeout = 600 2023-12-17T11:47:09.575 INFO:teuthology.orchestra.run.smithi159.stdout: debug client = 20 2023-12-17T11:47:09.575 INFO:teuthology.orchestra.run.smithi159.stdout: debug ms = 1 2023-12-17T11:47:09.576 INFO:teuthology.orchestra.run.smithi159.stdout: pid file = "" 2023-12-17T11:47:09.576 INFO:teuthology.orchestra.run.smithi159.stdout: rados mon op timeout = 900 2023-12-17T11:47:09.576 INFO:teuthology.orchestra.run.smithi159.stdout: rados osd op timeout = 900 2023-12-17T11:47:09.576 INFO:teuthology.orchestra.run.smithi159.stdout:[mon.a] 2023-12-17T11:47:09.576 INFO:teuthology.orchestra.run.smithi159.stdout:[mon.b] 2023-12-17T11:47:09.576 INFO:teuthology.orchestra.run.smithi159.stdout:[mon.c] 2023-12-17T11:47:09.576 INFO:teuthology.orchestra.run.smithi159.stdout:[mds.a] 2023-12-17T11:47:09.576 INFO:teuthology.orchestra.run.smithi159.stdout:[mds.c] 2023-12-17T11:47:09.576 INFO:teuthology.orchestra.run.smithi159.stdout:[mds.b] 2023-12-17T11:47:09.576 INFO:teuthology.orchestra.run.smithi159.stdout:[mds.d] 2023-12-17T11:47:09.576 INFO:teuthology.orchestra.run.smithi159.stdout:[mds] 2023-12-17T11:47:09.576 INFO:teuthology.orchestra.run.smithi159.stdout: debug mds = 20 2023-12-17T11:47:09.576 INFO:teuthology.orchestra.run.smithi159.stdout: debug mds balancer = 20 2023-12-17T11:47:09.576 INFO:teuthology.orchestra.run.smithi159.stdout: debug ms = 1 2023-12-17T11:47:09.576 INFO:teuthology.orchestra.run.smithi159.stdout: mds debug frag = True 2023-12-17T11:47:09.576 INFO:teuthology.orchestra.run.smithi159.stdout: mds debug scatterstat = True 2023-12-17T11:47:09.577 INFO:teuthology.orchestra.run.smithi159.stdout: mds op complaint time = 180 2023-12-17T11:47:09.577 INFO:teuthology.orchestra.run.smithi159.stdout: mds verify scatter = True 2023-12-17T11:47:09.577 INFO:teuthology.orchestra.run.smithi159.stdout: osd op complaint time = 180 2023-12-17T11:47:09.577 INFO:teuthology.orchestra.run.smithi159.stdout: rados mon op timeout = 900 2023-12-17T11:47:09.577 INFO:teuthology.orchestra.run.smithi159.stdout: rados osd op timeout = 900 2023-12-17T11:47:09.596 INFO:tasks.ceph:Creating admin key on mon.a... 2023-12-17T11:47:09.596 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2023-12-17T11:47:09.752 INFO:tasks.ceph:Copying monmap to all nodes... 2023-12-17T11:47:09.752 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2023-12-17T11:47:09.753 DEBUG:teuthology.orchestra.run.smithi040:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2023-12-17T11:47:09.804 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2023-12-17T11:47:09.804 DEBUG:teuthology.orchestra.run.smithi040:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2023-12-17T11:47:09.906 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi040.front.sepia.ceph.com 2023-12-17T11:47:09.907 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2023-12-17T11:47:09.907 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd of=/etc/ceph/ceph.keyring 2023-12-17T11:47:09.907 DEBUG:teuthology.orchestra.run.smithi040:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-12-17T11:47:10.053 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2023-12-17T11:47:10.053 DEBUG:teuthology.orchestra.run.smithi040:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-12-17T11:47:10.155 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi159.front.sepia.ceph.com 2023-12-17T11:47:10.155 DEBUG:teuthology.orchestra.run.smithi159:> set -ex 2023-12-17T11:47:10.156 DEBUG:teuthology.orchestra.run.smithi159:> sudo dd of=/etc/ceph/ceph.keyring 2023-12-17T11:47:10.156 DEBUG:teuthology.orchestra.run.smithi159:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-12-17T11:47:10.312 DEBUG:teuthology.orchestra.run.smithi159:> set -ex 2023-12-17T11:47:10.312 DEBUG:teuthology.orchestra.run.smithi159:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-12-17T11:47:10.412 INFO:tasks.ceph:Setting up mon nodes... 2023-12-17T11:47:10.413 INFO:tasks.ceph:Setting up mgr nodes... 2023-12-17T11:47:10.413 DEBUG:teuthology.orchestra.run.smithi040:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2023-12-17T11:47:10.623 INFO:teuthology.orchestra.run.smithi040.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2023-12-17T11:47:10.634 DEBUG:teuthology.orchestra.run.smithi159:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2023-12-17T11:47:10.841 INFO:teuthology.orchestra.run.smithi159.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2023-12-17T11:47:10.852 INFO:tasks.ceph:Setting up mds nodes... 2023-12-17T11:47:10.852 DEBUG:teuthology.orchestra.run.smithi040:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2023-12-17T11:47:11.057 INFO:teuthology.orchestra.run.smithi040.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2023-12-17T11:47:11.067 DEBUG:teuthology.orchestra.run.smithi040:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2023-12-17T11:47:11.173 DEBUG:teuthology.orchestra.run.smithi040:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2023-12-17T11:47:11.360 INFO:teuthology.orchestra.run.smithi040.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2023-12-17T11:47:11.369 DEBUG:teuthology.orchestra.run.smithi040:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2023-12-17T11:47:11.466 DEBUG:teuthology.orchestra.run.smithi159:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2023-12-17T11:47:11.659 INFO:teuthology.orchestra.run.smithi159.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2023-12-17T11:47:11.668 DEBUG:teuthology.orchestra.run.smithi159:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2023-12-17T11:47:11.766 DEBUG:teuthology.orchestra.run.smithi159:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2023-12-17T11:47:11.947 INFO:teuthology.orchestra.run.smithi159.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2023-12-17T11:47:11.956 DEBUG:teuthology.orchestra.run.smithi159:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2023-12-17T11:47:12.055 INFO:tasks.ceph_client:Setting up client nodes... 2023-12-17T11:47:12.055 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2023-12-17T11:47:12.200 INFO:teuthology.orchestra.run.smithi040.stdout:creating /etc/ceph/ceph.client.0.keyring 2023-12-17T11:47:12.274 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2023-12-17T11:47:12.416 INFO:teuthology.orchestra.run.smithi040.stdout:creating /etc/ceph/ceph.client.2.keyring 2023-12-17T11:47:12.485 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2023-12-17T11:47:12.619 INFO:teuthology.orchestra.run.smithi159.stdout:creating /etc/ceph/ceph.client.1.keyring 2023-12-17T11:47:12.675 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2023-12-17T11:47:12.799 INFO:teuthology.orchestra.run.smithi159.stdout:creating /etc/ceph/ceph.client.3.keyring 2023-12-17T11:47:12.858 INFO:tasks.ceph:Running mkfs on osd nodes... 2023-12-17T11:47:12.858 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi040.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi159.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-12-17T11:47:12.858 DEBUG:teuthology.orchestra.run.smithi040:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2023-12-17T11:47:12.969 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-12-17T11:47:12.969 INFO:tasks.ceph:role: osd.0 2023-12-17T11:47:12.969 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi040.front.sepia.ceph.com 2023-12-17T11:47:12.970 DEBUG:teuthology.orchestra.run.smithi040:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-12-17T11:47:13.078 INFO:teuthology.orchestra.run.smithi040.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-12-17T11:47:13.078 INFO:teuthology.orchestra.run.smithi040.stdout: = sectsz=512 attr=2, projid32bit=1 2023-12-17T11:47:13.078 INFO:teuthology.orchestra.run.smithi040.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-12-17T11:47:13.078 INFO:teuthology.orchestra.run.smithi040.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-12-17T11:47:13.078 INFO:teuthology.orchestra.run.smithi040.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-12-17T11:47:13.078 INFO:teuthology.orchestra.run.smithi040.stdout: = sunit=0 swidth=0 blks 2023-12-17T11:47:13.078 INFO:teuthology.orchestra.run.smithi040.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-12-17T11:47:13.079 INFO:teuthology.orchestra.run.smithi040.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-12-17T11:47:13.079 INFO:teuthology.orchestra.run.smithi040.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-12-17T11:47:13.079 INFO:teuthology.orchestra.run.smithi040.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-12-17T11:47:13.580 INFO:teuthology.orchestra.run.smithi040.stdout:Discarding blocks...Done. 2023-12-17T11:47:13.587 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi040.front.sepia.ceph.com -o noatime 2023-12-17T11:47:13.588 DEBUG:teuthology.orchestra.run.smithi040:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2023-12-17T11:47:13.765 DEBUG:teuthology.orchestra.run.smithi040:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2023-12-17T11:47:13.883 DEBUG:teuthology.orchestra.run.smithi040:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2023-12-17T11:47:13.984 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-12-17T11:47:13.984 INFO:tasks.ceph:role: osd.1 2023-12-17T11:47:13.984 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi040.front.sepia.ceph.com 2023-12-17T11:47:13.984 DEBUG:teuthology.orchestra.run.smithi040:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-12-17T11:47:14.092 INFO:teuthology.orchestra.run.smithi040.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-12-17T11:47:14.092 INFO:teuthology.orchestra.run.smithi040.stdout: = sectsz=512 attr=2, projid32bit=1 2023-12-17T11:47:14.092 INFO:teuthology.orchestra.run.smithi040.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-12-17T11:47:14.092 INFO:teuthology.orchestra.run.smithi040.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-12-17T11:47:14.092 INFO:teuthology.orchestra.run.smithi040.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-12-17T11:47:14.092 INFO:teuthology.orchestra.run.smithi040.stdout: = sunit=0 swidth=0 blks 2023-12-17T11:47:14.092 INFO:teuthology.orchestra.run.smithi040.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-12-17T11:47:14.092 INFO:teuthology.orchestra.run.smithi040.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-12-17T11:47:14.092 INFO:teuthology.orchestra.run.smithi040.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-12-17T11:47:14.092 INFO:teuthology.orchestra.run.smithi040.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-12-17T11:47:14.588 INFO:teuthology.orchestra.run.smithi040.stdout:Discarding blocks...Done. 2023-12-17T11:47:14.596 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi040.front.sepia.ceph.com -o noatime 2023-12-17T11:47:14.596 DEBUG:teuthology.orchestra.run.smithi040:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2023-12-17T11:47:14.742 DEBUG:teuthology.orchestra.run.smithi040:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2023-12-17T11:47:14.840 DEBUG:teuthology.orchestra.run.smithi040:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2023-12-17T11:47:14.937 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-12-17T11:47:14.938 INFO:tasks.ceph:role: osd.2 2023-12-17T11:47:14.938 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi040.front.sepia.ceph.com 2023-12-17T11:47:14.938 DEBUG:teuthology.orchestra.run.smithi040:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-12-17T11:47:15.041 INFO:teuthology.orchestra.run.smithi040.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-12-17T11:47:15.041 INFO:teuthology.orchestra.run.smithi040.stdout: = sectsz=512 attr=2, projid32bit=1 2023-12-17T11:47:15.041 INFO:teuthology.orchestra.run.smithi040.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-12-17T11:47:15.041 INFO:teuthology.orchestra.run.smithi040.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-12-17T11:47:15.041 INFO:teuthology.orchestra.run.smithi040.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-12-17T11:47:15.041 INFO:teuthology.orchestra.run.smithi040.stdout: = sunit=0 swidth=0 blks 2023-12-17T11:47:15.041 INFO:teuthology.orchestra.run.smithi040.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-12-17T11:47:15.041 INFO:teuthology.orchestra.run.smithi040.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-12-17T11:47:15.041 INFO:teuthology.orchestra.run.smithi040.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-12-17T11:47:15.041 INFO:teuthology.orchestra.run.smithi040.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-12-17T11:47:15.563 INFO:teuthology.orchestra.run.smithi040.stdout:Discarding blocks...Done. 2023-12-17T11:47:15.569 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi040.front.sepia.ceph.com -o noatime 2023-12-17T11:47:15.569 DEBUG:teuthology.orchestra.run.smithi040:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2023-12-17T11:47:15.781 DEBUG:teuthology.orchestra.run.smithi040:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2023-12-17T11:47:15.891 DEBUG:teuthology.orchestra.run.smithi040:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2023-12-17T11:47:15.989 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-12-17T11:47:15.989 INFO:tasks.ceph:role: osd.3 2023-12-17T11:47:15.989 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi040.front.sepia.ceph.com 2023-12-17T11:47:15.989 DEBUG:teuthology.orchestra.run.smithi040:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-12-17T11:47:16.097 INFO:teuthology.orchestra.run.smithi040.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-12-17T11:47:16.098 INFO:teuthology.orchestra.run.smithi040.stdout: = sectsz=512 attr=2, projid32bit=1 2023-12-17T11:47:16.098 INFO:teuthology.orchestra.run.smithi040.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-12-17T11:47:16.098 INFO:teuthology.orchestra.run.smithi040.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-12-17T11:47:16.098 INFO:teuthology.orchestra.run.smithi040.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-12-17T11:47:16.098 INFO:teuthology.orchestra.run.smithi040.stdout: = sunit=0 swidth=0 blks 2023-12-17T11:47:16.098 INFO:teuthology.orchestra.run.smithi040.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-12-17T11:47:16.098 INFO:teuthology.orchestra.run.smithi040.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-12-17T11:47:16.098 INFO:teuthology.orchestra.run.smithi040.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-12-17T11:47:16.098 INFO:teuthology.orchestra.run.smithi040.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-12-17T11:47:16.563 INFO:teuthology.orchestra.run.smithi040.stdout:Discarding blocks...Done. 2023-12-17T11:47:16.572 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi040.front.sepia.ceph.com -o noatime 2023-12-17T11:47:16.572 DEBUG:teuthology.orchestra.run.smithi040:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2023-12-17T11:47:16.727 DEBUG:teuthology.orchestra.run.smithi040:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2023-12-17T11:47:16.831 DEBUG:teuthology.orchestra.run.smithi040:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-12-17T11:47:16.989 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:47:16.987+0000 7f1f2e212500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2023-12-17T11:47:16.993 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:47:16.991+0000 7f1f2e212500 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2023-12-17T11:47:16.994 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:47:16.992+0000 7f1f2e212500 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-12-17T11:47:16.994 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:47:16.992+0000 7f1f2e212500 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-12-17T11:47:16.994 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:47:16.992+0000 7f1f2e212500 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-12-17T11:47:17.001 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:47:16.999+0000 7f1f2e212500 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2023-12-17T11:47:20.194 DEBUG:teuthology.orchestra.run.smithi040:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2023-12-17T11:47:20.304 DEBUG:teuthology.orchestra.run.smithi040:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-12-17T11:47:20.452 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:47:20.450+0000 7fa151a0c500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2023-12-17T11:47:20.453 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:47:20.451+0000 7fa151a0c500 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2023-12-17T11:47:20.453 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:47:20.451+0000 7fa151a0c500 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-12-17T11:47:20.453 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:47:20.451+0000 7fa151a0c500 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-12-17T11:47:20.453 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:47:20.451+0000 7fa151a0c500 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-12-17T11:47:20.455 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:47:20.453+0000 7fa151a0c500 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2023-12-17T11:47:23.630 DEBUG:teuthology.orchestra.run.smithi040:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2023-12-17T11:47:23.733 DEBUG:teuthology.orchestra.run.smithi040:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-12-17T11:47:23.883 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:47:23.881+0000 7fa596815500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2023-12-17T11:47:23.884 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:47:23.882+0000 7fa596815500 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2023-12-17T11:47:23.884 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:47:23.882+0000 7fa596815500 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-12-17T11:47:23.884 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:47:23.882+0000 7fa596815500 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-12-17T11:47:23.884 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:47:23.882+0000 7fa596815500 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-12-17T11:47:23.886 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:47:23.884+0000 7fa596815500 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2023-12-17T11:47:27.068 DEBUG:teuthology.orchestra.run.smithi040:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2023-12-17T11:47:27.178 DEBUG:teuthology.orchestra.run.smithi040:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-12-17T11:47:27.329 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:47:27.327+0000 7f21cda11500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2023-12-17T11:47:27.329 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:47:27.327+0000 7f21cda11500 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2023-12-17T11:47:27.330 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:47:27.327+0000 7f21cda11500 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-12-17T11:47:27.330 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:47:27.327+0000 7f21cda11500 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-12-17T11:47:27.330 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:47:27.327+0000 7f21cda11500 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-12-17T11:47:27.331 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:47:27.330+0000 7f21cda11500 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2023-12-17T11:47:30.267 DEBUG:teuthology.orchestra.run.smithi040:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2023-12-17T11:47:30.369 DEBUG:teuthology.orchestra.run.smithi159:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2023-12-17T11:47:30.475 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-12-17T11:47:30.475 INFO:tasks.ceph:role: osd.4 2023-12-17T11:47:30.475 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi159.front.sepia.ceph.com 2023-12-17T11:47:30.476 DEBUG:teuthology.orchestra.run.smithi159:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-12-17T11:47:30.577 INFO:teuthology.orchestra.run.smithi159.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-12-17T11:47:30.577 INFO:teuthology.orchestra.run.smithi159.stdout: = sectsz=512 attr=2, projid32bit=1 2023-12-17T11:47:30.577 INFO:teuthology.orchestra.run.smithi159.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-12-17T11:47:30.577 INFO:teuthology.orchestra.run.smithi159.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-12-17T11:47:30.577 INFO:teuthology.orchestra.run.smithi159.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-12-17T11:47:30.577 INFO:teuthology.orchestra.run.smithi159.stdout: = sunit=0 swidth=0 blks 2023-12-17T11:47:30.577 INFO:teuthology.orchestra.run.smithi159.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-12-17T11:47:30.577 INFO:teuthology.orchestra.run.smithi159.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-12-17T11:47:30.577 INFO:teuthology.orchestra.run.smithi159.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-12-17T11:47:30.577 INFO:teuthology.orchestra.run.smithi159.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-12-17T11:47:31.091 INFO:teuthology.orchestra.run.smithi159.stdout:Discarding blocks...Done. 2023-12-17T11:47:31.098 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi159.front.sepia.ceph.com -o noatime 2023-12-17T11:47:31.098 DEBUG:teuthology.orchestra.run.smithi159:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2023-12-17T11:47:31.292 DEBUG:teuthology.orchestra.run.smithi159:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2023-12-17T11:47:31.406 DEBUG:teuthology.orchestra.run.smithi159:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2023-12-17T11:47:31.486 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-12-17T11:47:31.486 INFO:tasks.ceph:role: osd.5 2023-12-17T11:47:31.486 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi159.front.sepia.ceph.com 2023-12-17T11:47:31.487 DEBUG:teuthology.orchestra.run.smithi159:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-12-17T11:47:31.571 INFO:teuthology.orchestra.run.smithi159.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-12-17T11:47:31.572 INFO:teuthology.orchestra.run.smithi159.stdout: = sectsz=512 attr=2, projid32bit=1 2023-12-17T11:47:31.572 INFO:teuthology.orchestra.run.smithi159.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-12-17T11:47:31.572 INFO:teuthology.orchestra.run.smithi159.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-12-17T11:47:31.572 INFO:teuthology.orchestra.run.smithi159.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-12-17T11:47:31.572 INFO:teuthology.orchestra.run.smithi159.stdout: = sunit=0 swidth=0 blks 2023-12-17T11:47:31.572 INFO:teuthology.orchestra.run.smithi159.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-12-17T11:47:31.572 INFO:teuthology.orchestra.run.smithi159.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-12-17T11:47:31.572 INFO:teuthology.orchestra.run.smithi159.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-12-17T11:47:31.572 INFO:teuthology.orchestra.run.smithi159.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-12-17T11:47:32.051 INFO:teuthology.orchestra.run.smithi159.stdout:Discarding blocks...Done. 2023-12-17T11:47:32.058 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi159.front.sepia.ceph.com -o noatime 2023-12-17T11:47:32.058 DEBUG:teuthology.orchestra.run.smithi159:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2023-12-17T11:47:32.180 DEBUG:teuthology.orchestra.run.smithi159:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2023-12-17T11:47:32.268 DEBUG:teuthology.orchestra.run.smithi159:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2023-12-17T11:47:32.349 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-12-17T11:47:32.349 INFO:tasks.ceph:role: osd.6 2023-12-17T11:47:32.349 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi159.front.sepia.ceph.com 2023-12-17T11:47:32.349 DEBUG:teuthology.orchestra.run.smithi159:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-12-17T11:47:32.429 INFO:teuthology.orchestra.run.smithi159.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-12-17T11:47:32.429 INFO:teuthology.orchestra.run.smithi159.stdout: = sectsz=512 attr=2, projid32bit=1 2023-12-17T11:47:32.430 INFO:teuthology.orchestra.run.smithi159.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-12-17T11:47:32.430 INFO:teuthology.orchestra.run.smithi159.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-12-17T11:47:32.430 INFO:teuthology.orchestra.run.smithi159.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-12-17T11:47:32.430 INFO:teuthology.orchestra.run.smithi159.stdout: = sunit=0 swidth=0 blks 2023-12-17T11:47:32.430 INFO:teuthology.orchestra.run.smithi159.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-12-17T11:47:32.430 INFO:teuthology.orchestra.run.smithi159.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-12-17T11:47:32.430 INFO:teuthology.orchestra.run.smithi159.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-12-17T11:47:32.430 INFO:teuthology.orchestra.run.smithi159.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-12-17T11:47:32.955 INFO:teuthology.orchestra.run.smithi159.stdout:Discarding blocks...Done. 2023-12-17T11:47:32.961 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi159.front.sepia.ceph.com -o noatime 2023-12-17T11:47:32.961 DEBUG:teuthology.orchestra.run.smithi159:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2023-12-17T11:47:33.147 DEBUG:teuthology.orchestra.run.smithi159:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2023-12-17T11:47:33.249 DEBUG:teuthology.orchestra.run.smithi159:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2023-12-17T11:47:33.338 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-12-17T11:47:33.339 INFO:tasks.ceph:role: osd.7 2023-12-17T11:47:33.339 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi159.front.sepia.ceph.com 2023-12-17T11:47:33.339 DEBUG:teuthology.orchestra.run.smithi159:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-12-17T11:47:33.442 INFO:teuthology.orchestra.run.smithi159.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-12-17T11:47:33.442 INFO:teuthology.orchestra.run.smithi159.stdout: = sectsz=512 attr=2, projid32bit=1 2023-12-17T11:47:33.442 INFO:teuthology.orchestra.run.smithi159.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-12-17T11:47:33.442 INFO:teuthology.orchestra.run.smithi159.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-12-17T11:47:33.442 INFO:teuthology.orchestra.run.smithi159.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-12-17T11:47:33.442 INFO:teuthology.orchestra.run.smithi159.stdout: = sunit=0 swidth=0 blks 2023-12-17T11:47:33.442 INFO:teuthology.orchestra.run.smithi159.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-12-17T11:47:33.442 INFO:teuthology.orchestra.run.smithi159.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-12-17T11:47:33.442 INFO:teuthology.orchestra.run.smithi159.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-12-17T11:47:33.442 INFO:teuthology.orchestra.run.smithi159.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-12-17T11:47:33.888 INFO:teuthology.orchestra.run.smithi159.stdout:Discarding blocks...Done. 2023-12-17T11:47:33.893 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi159.front.sepia.ceph.com -o noatime 2023-12-17T11:47:33.894 DEBUG:teuthology.orchestra.run.smithi159:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2023-12-17T11:47:34.047 DEBUG:teuthology.orchestra.run.smithi159:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2023-12-17T11:47:34.149 DEBUG:teuthology.orchestra.run.smithi159:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-12-17T11:47:34.297 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:34.296+0000 7f1dc4410500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2023-12-17T11:47:34.301 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:34.299+0000 7f1dc4410500 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2023-12-17T11:47:34.301 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:34.299+0000 7f1dc4410500 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-12-17T11:47:34.301 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:34.299+0000 7f1dc4410500 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-12-17T11:47:34.301 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:34.299+0000 7f1dc4410500 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-12-17T11:47:34.304 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:34.303+0000 7f1dc4410500 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2023-12-17T11:47:36.659 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T11:47:36.668 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T11:47:37.475 DEBUG:teuthology.orchestra.run.smithi159:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2023-12-17T11:47:37.577 DEBUG:teuthology.orchestra.run.smithi159:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-12-17T11:47:37.719 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:37.718+0000 7f72dd89e500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2023-12-17T11:47:37.721 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:37.719+0000 7f72dd89e500 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2023-12-17T11:47:37.721 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:37.719+0000 7f72dd89e500 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-12-17T11:47:37.721 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:37.719+0000 7f72dd89e500 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-12-17T11:47:37.721 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:37.719+0000 7f72dd89e500 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-12-17T11:47:37.722 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:37.721+0000 7f72dd89e500 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2023-12-17T11:47:40.645 DEBUG:teuthology.orchestra.run.smithi159:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2023-12-17T11:47:40.741 DEBUG:teuthology.orchestra.run.smithi159:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-12-17T11:47:40.883 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:40.881+0000 7f012b212500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2023-12-17T11:47:40.883 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:40.882+0000 7f012b212500 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2023-12-17T11:47:40.883 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:40.882+0000 7f012b212500 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-12-17T11:47:40.884 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:40.882+0000 7f012b212500 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-12-17T11:47:40.884 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:40.882+0000 7f012b212500 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-12-17T11:47:40.885 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:40.884+0000 7f012b212500 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2023-12-17T11:47:44.076 DEBUG:teuthology.orchestra.run.smithi159:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2023-12-17T11:47:44.173 DEBUG:teuthology.orchestra.run.smithi159:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-12-17T11:47:44.316 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:44.314+0000 7fd6056af500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2023-12-17T11:47:44.317 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:44.315+0000 7fd6056af500 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2023-12-17T11:47:44.317 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:44.315+0000 7fd6056af500 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-12-17T11:47:44.317 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:44.315+0000 7fd6056af500 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-12-17T11:47:44.317 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:44.315+0000 7fd6056af500 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-12-17T11:47:44.318 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:44.317+0000 7fd6056af500 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2023-12-17T11:47:47.494 DEBUG:teuthology.orchestra.run.smithi159:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2023-12-17T11:47:47.592 INFO:tasks.ceph:Reading keys from all nodes... 2023-12-17T11:47:47.592 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2023-12-17T11:47:47.592 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2023-12-17T11:47:47.702 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2023-12-17T11:47:47.702 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2023-12-17T11:47:47.808 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2023-12-17T11:47:47.808 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2023-12-17T11:47:47.914 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2023-12-17T11:47:47.914 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2023-12-17T11:47:48.012 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2023-12-17T11:47:48.012 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2023-12-17T11:47:48.106 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2023-12-17T11:47:48.106 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2023-12-17T11:47:48.203 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2023-12-17T11:47:48.203 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2023-12-17T11:47:48.304 DEBUG:teuthology.orchestra.run.smithi159:> set -ex 2023-12-17T11:47:48.304 DEBUG:teuthology.orchestra.run.smithi159:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2023-12-17T11:47:48.406 DEBUG:teuthology.orchestra.run.smithi159:> set -ex 2023-12-17T11:47:48.407 DEBUG:teuthology.orchestra.run.smithi159:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2023-12-17T11:47:48.502 DEBUG:teuthology.orchestra.run.smithi159:> set -ex 2023-12-17T11:47:48.502 DEBUG:teuthology.orchestra.run.smithi159:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2023-12-17T11:47:48.602 DEBUG:teuthology.orchestra.run.smithi159:> set -ex 2023-12-17T11:47:48.602 DEBUG:teuthology.orchestra.run.smithi159:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2023-12-17T11:47:48.696 DEBUG:teuthology.orchestra.run.smithi159:> set -ex 2023-12-17T11:47:48.697 DEBUG:teuthology.orchestra.run.smithi159:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2023-12-17T11:47:48.796 DEBUG:teuthology.orchestra.run.smithi159:> set -ex 2023-12-17T11:47:48.796 DEBUG:teuthology.orchestra.run.smithi159:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2023-12-17T11:47:48.896 DEBUG:teuthology.orchestra.run.smithi159:> set -ex 2023-12-17T11:47:48.896 DEBUG:teuthology.orchestra.run.smithi159:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2023-12-17T11:47:48.991 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2023-12-17T11:47:48.991 DEBUG:teuthology.orchestra.run.smithi040:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2023-12-17T11:47:49.054 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2023-12-17T11:47:49.054 DEBUG:teuthology.orchestra.run.smithi040:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2023-12-17T11:47:49.112 DEBUG:teuthology.orchestra.run.smithi159:> set -ex 2023-12-17T11:47:49.112 DEBUG:teuthology.orchestra.run.smithi159:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2023-12-17T11:47:49.173 DEBUG:teuthology.orchestra.run.smithi159:> set -ex 2023-12-17T11:47:49.173 DEBUG:teuthology.orchestra.run.smithi159:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2023-12-17T11:47:49.227 INFO:tasks.ceph:Adding keys to all mons... 2023-12-17T11:47:49.227 DEBUG:teuthology.orchestra.run.smithi040:> sudo tee -a /etc/ceph/ceph.keyring 2023-12-17T11:47:49.236 DEBUG:teuthology.orchestra.run.smithi159:> sudo tee -a /etc/ceph/ceph.keyring 2023-12-17T11:47:49.327 INFO:teuthology.orchestra.run.smithi159.stdout:[mgr.y] 2023-12-17T11:47:49.327 INFO:teuthology.orchestra.run.smithi159.stdout: key = AQC+335lXTMfJRAAHSbPetES3R1cYacqXspUeA== 2023-12-17T11:47:49.327 INFO:teuthology.orchestra.run.smithi159.stdout:[mds.a] 2023-12-17T11:47:49.327 INFO:teuthology.orchestra.run.smithi159.stdout: key = AQC/335lcMJiAxAAEmAhqsD5Ez8lOxO/36u06Q== 2023-12-17T11:47:49.327 INFO:teuthology.orchestra.run.smithi159.stdout:[mds.c] 2023-12-17T11:47:49.327 INFO:teuthology.orchestra.run.smithi159.stdout: key = AQC/335l69xuFRAA9R2H20UsV4CYNgA6mMVNlw== 2023-12-17T11:47:49.327 INFO:teuthology.orchestra.run.smithi159.stdout:[osd.0] 2023-12-17T11:47:49.327 INFO:teuthology.orchestra.run.smithi159.stdout: key = AQDE335l5BjwOhAACWNnZr4ORrVRzTdqHwhulQ== 2023-12-17T11:47:49.327 INFO:teuthology.orchestra.run.smithi159.stdout:[osd.1] 2023-12-17T11:47:49.327 INFO:teuthology.orchestra.run.smithi159.stdout: key = AQDI335lb1LxGhAA3S6fG2ua5UPxWRyyJjwmwA== 2023-12-17T11:47:49.328 INFO:teuthology.orchestra.run.smithi159.stdout:[osd.2] 2023-12-17T11:47:49.328 INFO:teuthology.orchestra.run.smithi159.stdout: key = AQDL335lVA+fNBAA8EmJWJjqzq2Wqo7wqNzqfw== 2023-12-17T11:47:49.328 INFO:teuthology.orchestra.run.smithi159.stdout:[osd.3] 2023-12-17T11:47:49.328 INFO:teuthology.orchestra.run.smithi159.stdout: key = AQDP335l7M6SExAAaBvAl5kmaHX+Db8AfYim9A== 2023-12-17T11:47:49.328 INFO:teuthology.orchestra.run.smithi159.stdout:[mgr.x] 2023-12-17T11:47:49.328 INFO:teuthology.orchestra.run.smithi159.stdout: key = AQC+335loC8TMhAA82XLYfdL2X1wSvK1nlwEPQ== 2023-12-17T11:47:49.328 INFO:teuthology.orchestra.run.smithi159.stdout:[mds.b] 2023-12-17T11:47:49.328 INFO:teuthology.orchestra.run.smithi159.stdout: key = AQC/335lNTk8JxAAr4s47d9dZY5AF9DZJFJ/GQ== 2023-12-17T11:47:49.328 INFO:teuthology.orchestra.run.smithi159.stdout:[mds.d] 2023-12-17T11:47:49.328 INFO:teuthology.orchestra.run.smithi159.stdout: key = AQC/335lu3dpOBAA9oeMahnP/SF0e87WZuak9Q== 2023-12-17T11:47:49.328 INFO:teuthology.orchestra.run.smithi159.stdout:[osd.4] 2023-12-17T11:47:49.328 INFO:teuthology.orchestra.run.smithi159.stdout: key = AQDW335l+9O3ERAAdpR1Sud4LOjJP69Q9UGXfA== 2023-12-17T11:47:49.328 INFO:teuthology.orchestra.run.smithi159.stdout:[osd.5] 2023-12-17T11:47:49.328 INFO:teuthology.orchestra.run.smithi159.stdout: key = AQDZ335l7yzcKhAA01WjGwKvT2iD4kCzdND2lA== 2023-12-17T11:47:49.329 INFO:teuthology.orchestra.run.smithi159.stdout:[osd.6] 2023-12-17T11:47:49.329 INFO:teuthology.orchestra.run.smithi159.stdout: key = AQDc335ll8SWNBAAZjx/5PJ1XC3W7J5N9Ago0w== 2023-12-17T11:47:49.329 INFO:teuthology.orchestra.run.smithi159.stdout:[osd.7] 2023-12-17T11:47:49.329 INFO:teuthology.orchestra.run.smithi159.stdout: key = AQDg335l9CHMEhAAWssX8Rz4sxBbSRMyQONxKg== 2023-12-17T11:47:49.329 INFO:teuthology.orchestra.run.smithi159.stdout:[client.0] 2023-12-17T11:47:49.329 INFO:teuthology.orchestra.run.smithi159.stdout: key = AQDA335l6XHnCxAAxjHOSjT8N5JpduZyqQ+KYw== 2023-12-17T11:47:49.329 INFO:teuthology.orchestra.run.smithi159.stdout:[client.2] 2023-12-17T11:47:49.329 INFO:teuthology.orchestra.run.smithi159.stdout: key = AQDA335lI87NGBAAZe7NcEi86g4it2cYfeHTRw== 2023-12-17T11:47:49.329 INFO:teuthology.orchestra.run.smithi159.stdout:[client.1] 2023-12-17T11:47:49.329 INFO:teuthology.orchestra.run.smithi159.stdout: key = AQDA335l2dDaJBAAqotnT6fGcOq4En7mZ1fQWQ== 2023-12-17T11:47:49.329 INFO:teuthology.orchestra.run.smithi159.stdout:[client.3] 2023-12-17T11:47:49.329 INFO:teuthology.orchestra.run.smithi159.stdout: key = AQDA335l2n+iLxAAadKFkVp+ELQtwaUpu1fpYQ== 2023-12-17T11:47:49.334 INFO:teuthology.orchestra.run.smithi040.stdout:[mgr.y] 2023-12-17T11:47:49.335 INFO:teuthology.orchestra.run.smithi040.stdout: key = AQC+335lXTMfJRAAHSbPetES3R1cYacqXspUeA== 2023-12-17T11:47:49.335 INFO:teuthology.orchestra.run.smithi040.stdout:[mds.a] 2023-12-17T11:47:49.335 INFO:teuthology.orchestra.run.smithi040.stdout: key = AQC/335lcMJiAxAAEmAhqsD5Ez8lOxO/36u06Q== 2023-12-17T11:47:49.335 INFO:teuthology.orchestra.run.smithi040.stdout:[mds.c] 2023-12-17T11:47:49.335 INFO:teuthology.orchestra.run.smithi040.stdout: key = AQC/335l69xuFRAA9R2H20UsV4CYNgA6mMVNlw== 2023-12-17T11:47:49.335 INFO:teuthology.orchestra.run.smithi040.stdout:[osd.0] 2023-12-17T11:47:49.335 INFO:teuthology.orchestra.run.smithi040.stdout: key = AQDE335l5BjwOhAACWNnZr4ORrVRzTdqHwhulQ== 2023-12-17T11:47:49.335 INFO:teuthology.orchestra.run.smithi040.stdout:[osd.1] 2023-12-17T11:47:49.335 INFO:teuthology.orchestra.run.smithi040.stdout: key = AQDI335lb1LxGhAA3S6fG2ua5UPxWRyyJjwmwA== 2023-12-17T11:47:49.335 INFO:teuthology.orchestra.run.smithi040.stdout:[osd.2] 2023-12-17T11:47:49.335 INFO:teuthology.orchestra.run.smithi040.stdout: key = AQDL335lVA+fNBAA8EmJWJjqzq2Wqo7wqNzqfw== 2023-12-17T11:47:49.335 INFO:teuthology.orchestra.run.smithi040.stdout:[osd.3] 2023-12-17T11:47:49.336 INFO:teuthology.orchestra.run.smithi040.stdout: key = AQDP335l7M6SExAAaBvAl5kmaHX+Db8AfYim9A== 2023-12-17T11:47:49.336 INFO:teuthology.orchestra.run.smithi040.stdout:[mgr.x] 2023-12-17T11:47:49.336 INFO:teuthology.orchestra.run.smithi040.stdout: key = AQC+335loC8TMhAA82XLYfdL2X1wSvK1nlwEPQ== 2023-12-17T11:47:49.336 INFO:teuthology.orchestra.run.smithi040.stdout:[mds.b] 2023-12-17T11:47:49.336 INFO:teuthology.orchestra.run.smithi040.stdout: key = AQC/335lNTk8JxAAr4s47d9dZY5AF9DZJFJ/GQ== 2023-12-17T11:47:49.336 INFO:teuthology.orchestra.run.smithi040.stdout:[mds.d] 2023-12-17T11:47:49.336 INFO:teuthology.orchestra.run.smithi040.stdout: key = AQC/335lu3dpOBAA9oeMahnP/SF0e87WZuak9Q== 2023-12-17T11:47:49.336 INFO:teuthology.orchestra.run.smithi040.stdout:[osd.4] 2023-12-17T11:47:49.336 INFO:teuthology.orchestra.run.smithi040.stdout: key = AQDW335l+9O3ERAAdpR1Sud4LOjJP69Q9UGXfA== 2023-12-17T11:47:49.336 INFO:teuthology.orchestra.run.smithi040.stdout:[osd.5] 2023-12-17T11:47:49.336 INFO:teuthology.orchestra.run.smithi040.stdout: key = AQDZ335l7yzcKhAA01WjGwKvT2iD4kCzdND2lA== 2023-12-17T11:47:49.336 INFO:teuthology.orchestra.run.smithi040.stdout:[osd.6] 2023-12-17T11:47:49.336 INFO:teuthology.orchestra.run.smithi040.stdout: key = AQDc335ll8SWNBAAZjx/5PJ1XC3W7J5N9Ago0w== 2023-12-17T11:47:49.336 INFO:teuthology.orchestra.run.smithi040.stdout:[osd.7] 2023-12-17T11:47:49.337 INFO:teuthology.orchestra.run.smithi040.stdout: key = AQDg335l9CHMEhAAWssX8Rz4sxBbSRMyQONxKg== 2023-12-17T11:47:49.337 INFO:teuthology.orchestra.run.smithi040.stdout:[client.0] 2023-12-17T11:47:49.337 INFO:teuthology.orchestra.run.smithi040.stdout: key = AQDA335l6XHnCxAAxjHOSjT8N5JpduZyqQ+KYw== 2023-12-17T11:47:49.337 INFO:teuthology.orchestra.run.smithi040.stdout:[client.2] 2023-12-17T11:47:49.337 INFO:teuthology.orchestra.run.smithi040.stdout: key = AQDA335lI87NGBAAZe7NcEi86g4it2cYfeHTRw== 2023-12-17T11:47:49.337 INFO:teuthology.orchestra.run.smithi040.stdout:[client.1] 2023-12-17T11:47:49.337 INFO:teuthology.orchestra.run.smithi040.stdout: key = AQDA335l2dDaJBAAqotnT6fGcOq4En7mZ1fQWQ== 2023-12-17T11:47:49.337 INFO:teuthology.orchestra.run.smithi040.stdout:[client.3] 2023-12-17T11:47:49.337 INFO:teuthology.orchestra.run.smithi040.stdout: key = AQDA335l2n+iLxAAadKFkVp+ELQtwaUpu1fpYQ== 2023-12-17T11:47:49.339 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-12-17T11:47:49.345 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-12-17T11:47:49.496 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-12-17T11:47:49.504 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-12-17T11:47:49.651 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-12-17T11:47:49.657 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-12-17T11:47:49.801 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-17T11:47:49.806 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-17T11:47:49.950 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-17T11:47:49.958 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-17T11:47:50.107 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-17T11:47:50.112 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-17T11:47:50.259 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-17T11:47:50.268 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-17T11:47:50.421 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-12-17T11:47:50.429 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-12-17T11:47:50.581 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-12-17T11:47:50.590 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-12-17T11:47:50.735 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-12-17T11:47:50.744 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-12-17T11:47:50.888 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-17T11:47:50.896 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-17T11:47:51.042 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-17T11:47:51.047 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-17T11:47:51.194 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-17T11:47:51.199 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-17T11:47:51.347 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-17T11:47:51.352 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-17T11:47:51.506 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-12-17T11:47:51.512 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-12-17T11:47:51.659 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-12-17T11:47:51.668 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-12-17T11:47:51.822 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-12-17T11:47:51.829 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-12-17T11:47:51.980 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-12-17T11:47:51.986 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-12-17T11:47:52.126 INFO:tasks.ceph:Running mkfs on mon nodes... 2023-12-17T11:47:52.126 DEBUG:teuthology.orchestra.run.smithi040:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2023-12-17T11:47:52.231 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-12-17T11:47:52.400 DEBUG:teuthology.orchestra.run.smithi040:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2023-12-17T11:47:52.493 DEBUG:teuthology.orchestra.run.smithi159:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2023-12-17T11:47:52.595 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-12-17T11:47:52.753 DEBUG:teuthology.orchestra.run.smithi159:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2023-12-17T11:47:52.839 DEBUG:teuthology.orchestra.run.smithi159:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2023-12-17T11:47:52.937 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-12-17T11:47:53.094 DEBUG:teuthology.orchestra.run.smithi159:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2023-12-17T11:47:53.178 DEBUG:teuthology.orchestra.run.smithi040:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-12-17T11:47:53.187 DEBUG:teuthology.orchestra.run.smithi159:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-12-17T11:47:53.240 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2023-12-17T11:47:53.240 INFO:tasks.ceph.mon.a:Restarting daemon 2023-12-17T11:47:53.240 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2023-12-17T11:47:53.247 INFO:tasks.ceph.mon.a:Started 2023-12-17T11:47:53.247 INFO:tasks.ceph.mon.b:Restarting daemon 2023-12-17T11:47:53.247 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2023-12-17T11:47:53.252 INFO:tasks.ceph.mon.b:Started 2023-12-17T11:47:53.252 INFO:tasks.ceph.mon.c:Restarting daemon 2023-12-17T11:47:53.253 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2023-12-17T11:47:53.257 INFO:tasks.ceph.mon.c:Started 2023-12-17T11:47:53.258 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2023-12-17T11:47:53.258 INFO:tasks.ceph.mgr.y:Restarting daemon 2023-12-17T11:47:53.258 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2023-12-17T11:47:53.264 INFO:tasks.ceph.mgr.y:Started 2023-12-17T11:47:53.264 INFO:tasks.ceph.mgr.x:Restarting daemon 2023-12-17T11:47:53.264 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2023-12-17T11:47:53.270 INFO:tasks.ceph.mgr.x:Started 2023-12-17T11:47:53.270 INFO:tasks.ceph:Setting crush tunables to default 2023-12-17T11:47:53.270 DEBUG:teuthology.orchestra.run.smithi040:> sudo ceph --cluster ceph osd crush tunables default 2023-12-17T11:47:53.459 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:47:53.457+0000 7f5346199640 1 Processor -- start 2023-12-17T11:47:53.459 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:47:53.457+0000 7f5346199640 1 -- start start 2023-12-17T11:47:53.461 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:47:53.458+0000 7f5346199640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f534015d1f0 0x7f53400d0b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:47:53.461 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:47:53.458+0000 7f5346199640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f53400cec20 0x7f53400d1480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:47:53.461 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:47:53.458+0000 7f5346199640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53400b74d0 con 0x7f53400d1060 2023-12-17T11:47:53.461 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:47:53.458+0000 7f5346199640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53400d19c0 con 0x7f53400cec20 2023-12-17T11:47:53.462 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:47:53.458+0000 7f5346199640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53400b68e0 con 0x7f534015d1f0 2023-12-17T11:47:53.462 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:47:53.459+0000 7f5345197640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f534015d1f0 0x7f53400d0b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:47:53.462 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:47:53.459+0000 7f5345197640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f534015d1f0 0x7f53400d0b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3301/0 says I am v2:172.21.15.40:36758/0 (socket says 172.21.15.40:36758) 2023-12-17T11:47:53.462 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:47:53.459+0000 7f5345197640 1 -- 172.21.15.40:0/1836699321 learned_addr learned my addr 172.21.15.40:0/1836699321 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-17T11:47:53.462 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:47:53.459+0000 7f5345998640 1 --2- 172.21.15.40:0/1836699321 >> v2:172.21.15.159:3300/0 conn(0x7f53400cec20 0x7f53400d1480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:47:53.462 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:47:53.459+0000 7f5345197640 1 -- 172.21.15.40:0/1836699321 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f534015d1f0 msgr2=0x7f53400d0b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-12-17T11:47:53.462 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:47:53.459+0000 7f5345197640 1 -- 172.21.15.40:0/1836699321 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f534015d1f0 msgr2=0x7f53400d0b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-12-17T11:47:53.462 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:47:53.459+0000 7f5345197640 1 --2- 172.21.15.40:0/1836699321 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f534015d1f0 0x7f53400d0b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-12-17T11:47:53.462 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:47:53.459+0000 7f5345197640 1 --2- 172.21.15.40:0/1836699321 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f534015d1f0 0x7f53400d0b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-17T11:47:53.462 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:47:53.459+0000 7f5345998640 1 -- 172.21.15.40:0/1836699321 >> v2:172.21.15.159:3300/0 conn(0x7f53400cec20 msgr2=0x7f53400d1480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-12-17T11:47:53.462 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:47:53.459+0000 7f5345998640 1 -- 172.21.15.40:0/1836699321 >> v2:172.21.15.159:3300/0 conn(0x7f53400cec20 msgr2=0x7f53400d1480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-12-17T11:47:53.462 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:47:53.459+0000 7f5345998640 1 --2- 172.21.15.40:0/1836699321 >> v2:172.21.15.159:3300/0 conn(0x7f53400cec20 0x7f53400d1480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-12-17T11:47:53.463 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:47:53.459+0000 7f5345998640 1 --2- 172.21.15.40:0/1836699321 >> v2:172.21.15.159:3300/0 conn(0x7f53400cec20 0x7f53400d1480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-17T11:47:53.467 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:47:53.462+0000 7f5333fff640 1 -- 172.21.15.40:0/1836699321 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1019120502 0 0) 0x7f53400b74d0 con 0x7f53400d1060 2023-12-17T11:47:53.468 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:47:53.462+0000 7f5333fff640 1 -- 172.21.15.40:0/1836699321 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f532c003520 con 0x7f53400d1060 2023-12-17T11:47:53.468 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:47:53.463+0000 7f5333fff640 1 -- 172.21.15.40:0/1836699321 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1864654588 0 0) 0x7f532c003520 con 0x7f53400d1060 2023-12-17T11:47:53.468 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:47:53.463+0000 7f5333fff640 1 -- 172.21.15.40:0/1836699321 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f534015d1f0 msgr2=0x7f53400d0b20 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-12-17T11:47:53.468 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:47:53.463+0000 7f5333fff640 1 --2- 172.21.15.40:0/1836699321 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f534015d1f0 0x7f53400d0b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:47:53.468 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:47:53.463+0000 7f5333fff640 1 -- 172.21.15.40:0/1836699321 >> v2:172.21.15.159:3300/0 conn(0x7f53400cec20 msgr2=0x7f53400d1480 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-12-17T11:47:53.469 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:47:53.463+0000 7f5333fff640 1 --2- 172.21.15.40:0/1836699321 >> v2:172.21.15.159:3300/0 conn(0x7f53400cec20 0x7f53400d1480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:47:53.469 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:47:53.463+0000 7f5333fff640 1 -- 172.21.15.40:0/1836699321 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53400b6ba0 con 0x7f53400d1060 2023-12-17T11:47:53.469 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:47:53.463+0000 7f5333fff640 1 -- 172.21.15.40:0/1836699321 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2643242555 0 0) 0x7f5334001670 con 0x7f53400d1060 2023-12-17T11:47:53.469 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:47:53.463+0000 7f5333fff640 1 -- 172.21.15.40:0/1836699321 >> v1:172.21.15.40:6789/0 conn(0x7f53400d1060 legacy=0x7f53400b7960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:47:53.469 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:47:53.463+0000 7f5333fff640 1 --2- 172.21.15.40:0/1836699321 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f532c003970 0x7f532c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:47:53.469 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:47:53.463+0000 7f5333fff640 1 --2- 172.21.15.40:0/1836699321 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f532c0047c0 0x7f532c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:47:53.469 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:47:53.463+0000 7f5333fff640 1 --2- 172.21.15.40:0/1836699321 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f534015d1f0 0x7f532c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:47:53.469 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:47:53.463+0000 7f5333fff640 1 -- 172.21.15.40:0/1836699321 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53400d19c0 con 0x7f532c0047c0 2023-12-17T11:47:53.469 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:47:53.463+0000 7f5333fff640 1 -- 172.21.15.40:0/1836699321 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53400b68e0 con 0x7f532c003970 2023-12-17T11:47:53.469 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:47:53.463+0000 7f5333fff640 1 -- 172.21.15.40:0/1836699321 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f532c00ba30 con 0x7f534015d1f0 2023-12-17T11:47:53.469 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:47:53.463+0000 7f5345197640 1 --2- 172.21.15.40:0/1836699321 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f532c003970 0x7f532c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:47:53.469 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:47:53.463+0000 7f5345998640 1 --2- 172.21.15.40:0/1836699321 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f534015d1f0 0x7f532c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:47:53.470 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:47:53.463+0000 7f5344996640 1 --2- 172.21.15.40:0/1836699321 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f532c0047c0 0x7f532c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:47:53.470 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:47:53.464+0000 7f5345197640 1 -- 172.21.15.40:0/1836699321 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f534015d1f0 msgr2=0x7f532c005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:47:53.470 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:47:53.464+0000 7f5345197640 1 --2- 172.21.15.40:0/1836699321 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f534015d1f0 0x7f532c005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:47:53.470 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:47:53.464+0000 7f5345197640 1 -- 172.21.15.40:0/1836699321 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f532c0047c0 msgr2=0x7f532c004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:47:53.470 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:47:53.464+0000 7f5345197640 1 --2- 172.21.15.40:0/1836699321 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f532c0047c0 0x7f532c004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:47:53.470 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:47:53.464+0000 7f5345197640 1 -- 172.21.15.40:0/1836699321 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f532c003520 con 0x7f532c003970 2023-12-17T11:47:53.470 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:47:53.465+0000 7f5345197640 1 --2- 172.21.15.40:0/1836699321 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f532c003970 0x7f532c003d90 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f533c009100 tx=0x7f532c0057f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c911a07ba43af4ef server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:47:53.470 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:47:53.465+0000 7f5333fff640 1 -- 172.21.15.40:0/1836699321 <== mon.1 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f533c030400 con 0x7f532c003970 2023-12-17T11:47:53.470 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:47:53.465+0000 7f5333fff640 1 -- 172.21.15.40:0/1836699321 <== mon.1 v2:172.21.15.159:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f533c030560 con 0x7f532c003970 2023-12-17T11:47:53.470 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:47:53.465+0000 7f5333fff640 1 -- 172.21.15.40:0/1836699321 <== mon.1 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f533c030950 con 0x7f532c003970 2023-12-17T11:47:53.473 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:47:53.466+0000 7f5346199640 1 -- 172.21.15.40:0/1836699321 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f532c003970 msgr2=0x7f532c003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:47:53.473 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:47:53.466+0000 7f5346199640 1 --2- 172.21.15.40:0/1836699321 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f532c003970 0x7f532c003d90 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f533c009100 tx=0x7f532c0057f0 comp rx=0 tx=0).stop 2023-12-17T11:47:53.473 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:47:53.466+0000 7f5345998640 1 -- 172.21.15.40:0/1836699321 reap_dead start 2023-12-17T11:47:53.473 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:47:53.466+0000 7f5346199640 1 -- 172.21.15.40:0/1836699321 shutdown_connections 2023-12-17T11:47:53.473 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:47:53.466+0000 7f5346199640 1 -- 172.21.15.40:0/1836699321 >> 172.21.15.40:0/1836699321 conn(0x7f53400d2fe0 msgr2=0x7f53400d33f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:47:53.473 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:47:53.466+0000 7f5346199640 1 -- 172.21.15.40:0/1836699321 shutdown_connections 2023-12-17T11:47:53.473 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:47:53.466+0000 7f5346199640 1 -- 172.21.15.40:0/1836699321 wait complete. 2023-12-17T11:47:53.477 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:47:53.468+0000 7f5346199640 1 Processor -- start 2023-12-17T11:47:53.477 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:47:53.468+0000 7f5346199640 1 -- start start 2023-12-17T11:47:53.477 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:47:53.469+0000 7f5346199640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f532c003970 0x7f534009d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:47:53.477 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:47:53.469+0000 7f5346199640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5340148a60 0x7f53401f2a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:47:53.478 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:47:53.469+0000 7f5346199640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f534009e070 0x7f534009e4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:47:53.478 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:47:53.469+0000 7f5346199640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5340149ba0 con 0x7f534009e070 2023-12-17T11:47:53.478 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:47:53.469+0000 7f5346199640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53400aff80 con 0x7f532c003970 2023-12-17T11:47:53.478 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:47:53.469+0000 7f5346199640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5340148f20 con 0x7f5340148a60 2023-12-17T11:47:53.478 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:47:53.469+0000 7f5345998640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f534009e070 0x7f534009e4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:47:53.478 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:47:53.470+0000 7f5345197640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f532c003970 0x7f534009d6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:47:53.478 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:47:53.470+0000 7f5344996640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5340148a60 0x7f53401f2a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:47:53.478 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:47:53.470+0000 7f5345998640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f534009e070 0x7f534009e4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:56336/0 (socket says 172.21.15.40:56336) 2023-12-17T11:47:53.478 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:47:53.470+0000 7f5345998640 1 -- 172.21.15.40:0/4033628494 learned_addr learned my addr 172.21.15.40:0/4033628494 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-17T11:47:53.478 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:47:53.470+0000 7f5345998640 1 -- 172.21.15.40:0/4033628494 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5340148a60 msgr2=0x7f53401f2a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:47:53.478 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:47:53.470+0000 7f5345998640 1 --2- 172.21.15.40:0/4033628494 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5340148a60 0x7f53401f2a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:47:53.478 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:47:53.470+0000 7f5345998640 1 -- 172.21.15.40:0/4033628494 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f532c003970 msgr2=0x7f534009d6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:47:53.478 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:47:53.470+0000 7f5345998640 1 --2- 172.21.15.40:0/4033628494 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f532c003970 0x7f534009d6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:47:53.479 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:47:53.470+0000 7f5345998640 1 -- 172.21.15.40:0/4033628494 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5340149200 con 0x7f534009e070 2023-12-17T11:47:53.479 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:47:53.470+0000 7f5345998640 1 --2- 172.21.15.40:0/4033628494 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f534009e070 0x7f534009e4f0 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f534006acd0 tx=0x7f533800f520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:47:53.479 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:47:53.470+0000 7f5331ffb640 1 -- 172.21.15.40:0/4033628494 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5338003990 con 0x7f534009e070 2023-12-17T11:47:53.479 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:47:53.471+0000 7f5331ffb640 1 -- 172.21.15.40:0/4033628494 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5338003b30 con 0x7f534009e070 2023-12-17T11:47:53.479 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:47:53.471+0000 7f5331ffb640 1 -- 172.21.15.40:0/4033628494 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5338004030 con 0x7f534009e070 2023-12-17T11:47:53.479 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:47:53.471+0000 7f5346199640 1 -- 172.21.15.40:0/4033628494 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53401494e0 con 0x7f534009e070 2023-12-17T11:47:53.479 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:47:53.471+0000 7f5346199640 1 -- 172.21.15.40:0/4033628494 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f534009dc30 con 0x7f534009e070 2023-12-17T11:47:53.479 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:47:53.471+0000 7f5331ffb640 1 -- 172.21.15.40:0/4033628494 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f5338004190 con 0x7f534009e070 2023-12-17T11:47:53.479 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:47:53.471+0000 7f5331ffb640 1 -- 172.21.15.40:0/4033628494 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f5338020a80 con 0x7f534009e070 2023-12-17T11:47:53.480 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:47:53.472+0000 7f5346199640 1 -- 172.21.15.40:0/4033628494 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53400d1480 con 0x7f534009e070 2023-12-17T11:47:53.480 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:47:53.475+0000 7f5331ffb640 1 -- 172.21.15.40:0/4033628494 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7f533801b070 con 0x7f534009e070 2023-12-17T11:47:53.551 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:47:53.549+0000 7f5346199640 1 -- 172.21.15.40:0/4033628494 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f53400673f0 con 0x7f534009e070 2023-12-17T11:47:53.554 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:47:53.552+0000 7f5331ffb640 1 -- 172.21.15.40:0/4033628494 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7f53380045d0 con 0x7f534009e070 2023-12-17T11:47:53.554 INFO:teuthology.orchestra.run.smithi040.stderr:adjusted tunables profile to default 2023-12-17T11:47:53.555 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:47:53.553+0000 7f5346199640 1 -- 172.21.15.40:0/4033628494 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f534009e070 msgr2=0x7f534009e4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:47:53.555 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:47:53.553+0000 7f5346199640 1 --2- 172.21.15.40:0/4033628494 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f534009e070 0x7f534009e4f0 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f534006acd0 tx=0x7f533800f520 comp rx=0 tx=0).stop 2023-12-17T11:47:53.556 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:47:53.553+0000 7f5346199640 1 -- 172.21.15.40:0/4033628494 shutdown_connections 2023-12-17T11:47:53.556 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:47:53.553+0000 7f5346199640 1 --2- 172.21.15.40:0/4033628494 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f534009e070 0x7f534009e4f0 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:47:53.556 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:47:53.553+0000 7f5346199640 1 --2- 172.21.15.40:0/4033628494 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5340148a60 0x7f53401f2a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:47:53.556 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:47:53.553+0000 7f5346199640 1 --2- 172.21.15.40:0/4033628494 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f532c003970 0x7f534009d6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:47:53.556 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:47:53.553+0000 7f5346199640 1 -- 172.21.15.40:0/4033628494 >> 172.21.15.40:0/4033628494 conn(0x7f53400d2fe0 msgr2=0x7f53400b7860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:47:53.556 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:47:53.554+0000 7f5346199640 1 -- 172.21.15.40:0/4033628494 shutdown_connections 2023-12-17T11:47:53.556 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:47:53.554+0000 7f5346199640 1 -- 172.21.15.40:0/4033628494 wait complete. 2023-12-17T11:47:53.574 INFO:tasks.ceph:check_enable_crimson: False 2023-12-17T11:47:53.574 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2023-12-17T11:47:53.574 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2023-12-17T11:47:53.574 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2023-12-17T11:47:53.659 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2023-12-17T11:47:53.660 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2023-12-17T11:47:53.732 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2023-12-17T11:47:53.732 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2023-12-17T11:47:53.866 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2023-12-17T11:47:53.866 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2023-12-17T11:47:53.952 DEBUG:teuthology.orchestra.run.smithi159:> set -ex 2023-12-17T11:47:53.953 DEBUG:teuthology.orchestra.run.smithi159:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2023-12-17T11:47:54.041 DEBUG:teuthology.orchestra.run.smithi159:> set -ex 2023-12-17T11:47:54.041 DEBUG:teuthology.orchestra.run.smithi159:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2023-12-17T11:47:54.124 DEBUG:teuthology.orchestra.run.smithi159:> set -ex 2023-12-17T11:47:54.124 DEBUG:teuthology.orchestra.run.smithi159:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2023-12-17T11:47:54.173 INFO:tasks.ceph.mgr.x.smithi159.stderr:2023-12-17T11:47:54.168+0000 7fc300641040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-12-17T11:47:54.199 INFO:tasks.ceph.mgr.y.smithi040.stderr:2023-12-17T11:47:54.197+0000 7f1e05cb0040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-12-17T11:47:54.233 INFO:tasks.ceph.mgr.x.smithi159.stderr:2023-12-17T11:47:54.231+0000 7fc300641040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-12-17T11:47:54.258 DEBUG:teuthology.orchestra.run.smithi159:> set -ex 2023-12-17T11:47:54.258 DEBUG:teuthology.orchestra.run.smithi159:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2023-12-17T11:47:54.265 INFO:tasks.ceph.mgr.y.smithi040.stderr:2023-12-17T11:47:54.263+0000 7f1e05cb0040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-12-17T11:47:54.342 DEBUG:teuthology.orchestra.run.smithi159:> sudo ceph --cluster ceph osd new a88bfd46-63b8-48b1-9c0e-5c9cdc31bd38 0 2023-12-17T11:47:54.580 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:54.578+0000 7fd81551d640 1 Processor -- start 2023-12-17T11:47:54.581 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:54.578+0000 7fd81551d640 1 -- start start 2023-12-17T11:47:54.582 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:54.579+0000 7fd81551d640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fd8100d1970 0x7fd8100b0dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:47:54.582 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:54.579+0000 7fd81551d640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8100cf130 con 0x7fd8100d1510 2023-12-17T11:47:54.582 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:54.580+0000 7fd81551d640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8100b0220 con 0x7fd81015d620 2023-12-17T11:47:54.582 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:54.580+0000 7fd81551d640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd81015da00 con 0x7fd8100d1970 2023-12-17T11:47:54.582 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:54.580+0000 7fd80effd640 1 --1- >> v1:172.21.15.159:6789/0 conn(0x7fd81015d620 0x7fd8100d3a00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.159:6789/0 says I am v1:172.21.15.159:43182/0 (socket says 172.21.15.159:43182) 2023-12-17T11:47:54.583 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:54.580+0000 7fd80effd640 1 -- 172.21.15.159:0/3303441900 learned_addr learned my addr 172.21.15.159:0/3303441900 (peer_addr_for_me v1:172.21.15.159:0/0) 2023-12-17T11:47:54.585 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:54.580+0000 7fd80f7fe640 1 --2- 172.21.15.159:0/3303441900 >> v2:172.21.15.40:3300/0 conn(0x7fd8100d1970 0x7fd8100b0dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:47:54.585 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:54.580+0000 7fd80dffb640 1 -- 172.21.15.159:0/3303441900 <== mon.1 v1:172.21.15.159:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4216880030 0 0) 0x7fd8100b0220 con 0x7fd81015d620 2023-12-17T11:47:54.585 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:54.580+0000 7fd80dffb640 1 -- 172.21.15.159:0/3303441900 --> v1:172.21.15.159:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd7fc003520 con 0x7fd81015d620 2023-12-17T11:47:54.585 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:54.581+0000 7fd80dffb640 1 -- 172.21.15.159:0/3303441900 <== mon.1 v1:172.21.15.159:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3674372410 0 0) 0x7fd7fc003520 con 0x7fd81015d620 2023-12-17T11:47:54.585 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:54.581+0000 7fd80dffb640 1 -- 172.21.15.159:0/3303441900 >> v2:172.21.15.40:3300/0 conn(0x7fd8100d1970 msgr2=0x7fd8100b0dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:47:54.585 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:54.581+0000 7fd80dffb640 1 --2- 172.21.15.159:0/3303441900 >> v2:172.21.15.40:3300/0 conn(0x7fd8100d1970 0x7fd8100b0dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:47:54.585 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:54.581+0000 7fd80dffb640 1 -- 172.21.15.159:0/3303441900 >> v1:172.21.15.40:6789/0 conn(0x7fd8100d1510 legacy=0x7fd8100b06b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:47:54.585 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:54.581+0000 7fd80dffb640 1 -- 172.21.15.159:0/3303441900 --> v1:172.21.15.159:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8100ceb70 con 0x7fd81015d620 2023-12-17T11:47:54.586 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:54.581+0000 7fd80dffb640 1 -- 172.21.15.159:0/3303441900 <== mon.1 v1:172.21.15.159:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2643242555 0 0) 0x7fd8000019f0 con 0x7fd81015d620 2023-12-17T11:47:54.586 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:54.581+0000 7fd80dffb640 1 -- 172.21.15.159:0/3303441900 >> v1:172.21.15.159:6789/0 conn(0x7fd81015d620 legacy=0x7fd8100d3a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:47:54.586 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:54.581+0000 7fd80dffb640 1 --2- 172.21.15.159:0/3303441900 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd7fc0039c0 0x7fd7fc003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:47:54.586 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:54.581+0000 7fd80dffb640 1 --2- 172.21.15.159:0/3303441900 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd7fc0047c0 0x7fd7fc004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:47:54.586 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:54.581+0000 7fd80dffb640 1 --2- 172.21.15.159:0/3303441900 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd7fc005180 0x7fd7fc00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:47:54.586 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:54.581+0000 7fd80dffb640 1 -- 172.21.15.159:0/3303441900 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd81015da00 con 0x7fd7fc0047c0 2023-12-17T11:47:54.586 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:54.581+0000 7fd80dffb640 1 -- 172.21.15.159:0/3303441900 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7fc00c080 con 0x7fd7fc0039c0 2023-12-17T11:47:54.586 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:54.581+0000 7fd80dffb640 1 -- 172.21.15.159:0/3303441900 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7fc00c240 con 0x7fd7fc005180 2023-12-17T11:47:54.586 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:54.581+0000 7fd80effd640 1 --2- 172.21.15.159:0/3303441900 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd7fc0039c0 0x7fd7fc003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:47:54.586 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:54.581+0000 7fd80f7fe640 1 --2- 172.21.15.159:0/3303441900 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd7fc005180 0x7fd7fc00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:47:54.586 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:54.581+0000 7fd80e7fc640 1 --2- 172.21.15.159:0/3303441900 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd7fc0047c0 0x7fd7fc004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:47:54.586 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:54.582+0000 7fd80effd640 1 -- 172.21.15.159:0/3303441900 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd7fc005180 msgr2=0x7fd7fc00b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:47:54.586 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:54.582+0000 7fd80effd640 1 --2- 172.21.15.159:0/3303441900 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd7fc005180 0x7fd7fc00b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:47:54.587 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:54.582+0000 7fd80effd640 1 -- 172.21.15.159:0/3303441900 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd7fc0047c0 msgr2=0x7fd7fc004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:47:54.587 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:54.582+0000 7fd80effd640 1 --2- 172.21.15.159:0/3303441900 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd7fc0047c0 0x7fd7fc004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:47:54.587 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:54.582+0000 7fd80effd640 1 -- 172.21.15.159:0/3303441900 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7fc003520 con 0x7fd7fc0039c0 2023-12-17T11:47:54.587 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:54.582+0000 7fd80f7fe640 1 --2- 172.21.15.159:0/3303441900 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd7fc005180 0x7fd7fc00b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-17T11:47:54.587 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:54.582+0000 7fd80f7fe640 1 -- 172.21.15.159:0/3303441900 reap_dead start 2023-12-17T11:47:54.587 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:54.583+0000 7fd80effd640 1 --2- 172.21.15.159:0/3303441900 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd7fc0039c0 0x7fd7fc003de0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fd80000a760 tx=0x7fd7fc0057f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fab8eff39c430bd9 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:47:54.588 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:54.583+0000 7fd80dffb640 1 -- 172.21.15.159:0/3303441900 <== mon.1 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd800034630 con 0x7fd7fc0039c0 2023-12-17T11:47:54.588 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:54.583+0000 7fd80dffb640 1 -- 172.21.15.159:0/3303441900 <== mon.1 v2:172.21.15.159:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd80002f070 con 0x7fd7fc0039c0 2023-12-17T11:47:54.588 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:54.583+0000 7fd80dffb640 1 -- 172.21.15.159:0/3303441900 <== mon.1 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd800034a50 con 0x7fd7fc0039c0 2023-12-17T11:47:54.588 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:54.583+0000 7fd81551d640 1 -- 172.21.15.159:0/3303441900 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd7fc0039c0 msgr2=0x7fd7fc003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:47:54.588 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:54.583+0000 7fd81551d640 1 --2- 172.21.15.159:0/3303441900 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd7fc0039c0 0x7fd7fc003de0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fd80000a760 tx=0x7fd7fc0057f0 comp rx=0 tx=0).stop 2023-12-17T11:47:54.589 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:54.584+0000 7fd81551d640 1 -- 172.21.15.159:0/3303441900 shutdown_connections 2023-12-17T11:47:54.589 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:54.584+0000 7fd81551d640 1 --2- 172.21.15.159:0/3303441900 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd7fc0039c0 0x7fd7fc003de0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:47:54.589 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:54.584+0000 7fd81551d640 1 -- 172.21.15.159:0/3303441900 >> 172.21.15.159:0/3303441900 conn(0x7fd81009c420 msgr2=0x7fd8100d30e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:47:54.589 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:54.584+0000 7fd81551d640 1 -- 172.21.15.159:0/3303441900 shutdown_connections 2023-12-17T11:47:54.589 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:54.584+0000 7fd81551d640 1 -- 172.21.15.159:0/3303441900 wait complete. 2023-12-17T11:47:54.589 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:54.585+0000 7fd81551d640 1 Processor -- start 2023-12-17T11:47:54.589 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:54.585+0000 7fd81551d640 1 -- start start 2023-12-17T11:47:54.591 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:54.586+0000 7fd81551d640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd7fc0039c0 0x7fd810151ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:47:54.591 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:54.586+0000 7fd81551d640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd8100c88b0 0x7fd8100c8d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:47:54.591 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:54.586+0000 7fd81551d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd8100c6c10 0x7fd8100c7090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:47:54.591 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:54.586+0000 7fd81551d640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8100b2a90 con 0x7fd8100c6c10 2023-12-17T11:47:54.591 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:54.586+0000 7fd81551d640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8100c9270 con 0x7fd8100c88b0 2023-12-17T11:47:54.591 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:54.586+0000 7fd81551d640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8100c75d0 con 0x7fd7fc0039c0 2023-12-17T11:47:54.592 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:54.587+0000 7fd80e7fc640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd8100c88b0 0x7fd8100c8d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:47:54.592 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:54.587+0000 7fd80effd640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd7fc0039c0 0x7fd810151ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:47:54.592 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:54.587+0000 7fd80e7fc640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd8100c88b0 0x7fd8100c8d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:58138/0 (socket says 172.21.15.159:58138) 2023-12-17T11:47:54.592 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:54.587+0000 7fd80e7fc640 1 -- 172.21.15.159:0/2254685036 learned_addr learned my addr 172.21.15.159:0/2254685036 (peer_addr_for_me v2:172.21.15.159:0/0) 2023-12-17T11:47:54.592 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:54.587+0000 7fd80e7fc640 1 -- 172.21.15.159:0/2254685036 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd7fc0039c0 msgr2=0x7fd810151ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:47:54.592 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:54.587+0000 7fd80e7fc640 1 --2- 172.21.15.159:0/2254685036 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd7fc0039c0 0x7fd810151ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:47:54.592 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:54.587+0000 7fd80e7fc640 1 -- 172.21.15.159:0/2254685036 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd8100c6c10 msgr2=0x7fd8100c7090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:47:54.592 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:54.587+0000 7fd80e7fc640 1 --2- 172.21.15.159:0/2254685036 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd8100c6c10 0x7fd8100c7090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:47:54.592 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:54.587+0000 7fd80e7fc640 1 -- 172.21.15.159:0/2254685036 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd810152920 con 0x7fd8100c88b0 2023-12-17T11:47:54.592 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:54.587+0000 7fd80effd640 1 --2- 172.21.15.159:0/2254685036 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd7fc0039c0 0x7fd810151ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-17T11:47:54.592 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:54.587+0000 7fd80e7fc640 1 --2- 172.21.15.159:0/2254685036 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd8100c88b0 0x7fd8100c8d30 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fd7f800e4d0 tx=0x7fd7f800e990 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:47:54.592 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:54.587+0000 7fd8077fe640 1 -- 172.21.15.159:0/2254685036 <== mon.1 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7f80052e0 con 0x7fd8100c88b0 2023-12-17T11:47:54.592 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:54.588+0000 7fd8077fe640 1 -- 172.21.15.159:0/2254685036 <== mon.1 v2:172.21.15.159:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7f8005440 con 0x7fd8100c88b0 2023-12-17T11:47:54.592 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:54.588+0000 7fd8077fe640 1 -- 172.21.15.159:0/2254685036 <== mon.1 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7f8003810 con 0x7fd8100c88b0 2023-12-17T11:47:54.593 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:54.588+0000 7fd81551d640 1 -- 172.21.15.159:0/2254685036 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd810152430 con 0x7fd8100c88b0 2023-12-17T11:47:54.593 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:54.588+0000 7fd81551d640 1 -- 172.21.15.159:0/2254685036 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8100c77f0 con 0x7fd8100c88b0 2023-12-17T11:47:54.593 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:54.588+0000 7fd8077fe640 1 -- 172.21.15.159:0/2254685036 <== mon.1 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fd7f8003c70 con 0x7fd8100c88b0 2023-12-17T11:47:54.593 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:54.588+0000 7fd8077fe640 1 -- 172.21.15.159:0/2254685036 <== mon.1 v2:172.21.15.159:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 725+0+0 (secure 0 0 0) 0x7fd7f801ddf0 con 0x7fd8100c88b0 2023-12-17T11:47:54.593 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:54.589+0000 7fd81551d640 1 -- 172.21.15.159:0/2254685036 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd810074450 con 0x7fd8100c88b0 2023-12-17T11:47:54.594 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:54.592+0000 7fd8077fe640 1 -- 172.21.15.159:0/2254685036 <== mon.1 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7fd7f801d460 con 0x7fd8100c88b0 2023-12-17T11:47:54.672 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:54.670+0000 7fd81551d640 1 -- 172.21.15.159:0/2254685036 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "osd new", "uuid": "a88bfd46-63b8-48b1-9c0e-5c9cdc31bd38", "id": 0} v 0) v1 -- 0x7fd8100d2680 con 0x7fd8100c88b0 2023-12-17T11:47:54.679 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:54.677+0000 7fd8077fe640 1 -- 172.21.15.159:0/2254685036 <== mon.1 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "a88bfd46-63b8-48b1-9c0e-5c9cdc31bd38", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7fd7f801d600 con 0x7fd8100c88b0 2023-12-17T11:47:54.680 INFO:teuthology.orchestra.run.smithi159.stdout:0 2023-12-17T11:47:54.682 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:54.679+0000 7fd81551d640 1 -- 172.21.15.159:0/2254685036 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd8100c88b0 msgr2=0x7fd8100c8d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:47:54.682 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:54.679+0000 7fd81551d640 1 --2- 172.21.15.159:0/2254685036 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd8100c88b0 0x7fd8100c8d30 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fd7f800e4d0 tx=0x7fd7f800e990 comp rx=0 tx=0).stop 2023-12-17T11:47:54.682 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:54.679+0000 7fd81551d640 1 -- 172.21.15.159:0/2254685036 shutdown_connections 2023-12-17T11:47:54.682 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:54.679+0000 7fd81551d640 1 --2- 172.21.15.159:0/2254685036 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd8100c6c10 0x7fd8100c7090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:47:54.682 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:54.679+0000 7fd81551d640 1 --2- 172.21.15.159:0/2254685036 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd8100c88b0 0x7fd8100c8d30 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:47:54.682 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:54.679+0000 7fd81551d640 1 --2- 172.21.15.159:0/2254685036 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd7fc0039c0 0x7fd810151ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:47:54.682 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:54.679+0000 7fd81551d640 1 -- 172.21.15.159:0/2254685036 >> 172.21.15.159:0/2254685036 conn(0x7fd81009c420 msgr2=0x7fd8100cf4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:47:54.682 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:54.679+0000 7fd81551d640 1 -- 172.21.15.159:0/2254685036 shutdown_connections 2023-12-17T11:47:54.682 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:54.679+0000 7fd81551d640 1 -- 172.21.15.159:0/2254685036 wait complete. 2023-12-17T11:47:54.705 DEBUG:teuthology.orchestra.run.smithi159:> sudo ceph --cluster ceph osd new c5d628ae-36f4-4866-802c-b162f0e90add 1 2023-12-17T11:47:54.872 INFO:tasks.ceph.mgr.x.smithi159.stderr:2023-12-17T11:47:54.869+0000 7fc300641040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-12-17T11:47:54.896 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:54.893+0000 7f8ab2c1a640 1 Processor -- start 2023-12-17T11:47:54.896 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:54.894+0000 7f8ab2c1a640 1 -- start start 2023-12-17T11:47:54.898 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:54.895+0000 7f8ab2c1a640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8aac15d1f0 0x7f8aac0d0b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:47:54.898 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:54.895+0000 7f8ab2c1a640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f8aac0d1060 0x7f8aac0d1480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:47:54.898 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:54.895+0000 7f8ab2c1a640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8aac0b74d0 con 0x7f8aac0b7960 2023-12-17T11:47:54.898 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:54.895+0000 7f8ab2c1a640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8aac0d19c0 con 0x7f8aac0d1060 2023-12-17T11:47:54.898 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:54.895+0000 7f8ab2c1a640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8aac0b68e0 con 0x7f8aac15d1f0 2023-12-17T11:47:54.898 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:54.895+0000 7f8ab1417640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f8aac0d1060 0x7f8aac0d1480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:47:54.898 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:54.895+0000 7f8ab1c18640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8aac15d1f0 0x7f8aac0d0b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:47:54.898 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:54.895+0000 7f8ab1417640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f8aac0d1060 0x7f8aac0d1480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:50228/0 (socket says 172.21.15.159:50228) 2023-12-17T11:47:54.898 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:54.896+0000 7f8ab1417640 1 -- 172.21.15.159:0/3155998042 learned_addr learned my addr 172.21.15.159:0/3155998042 (peer_addr_for_me v2:172.21.15.159:0/0) 2023-12-17T11:47:54.899 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:54.896+0000 7f8ab1417640 1 -- 172.21.15.159:0/3155998042 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8aac15d1f0 msgr2=0x7f8aac0d0b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:47:54.899 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:54.896+0000 7f8ab1417640 1 --2- 172.21.15.159:0/3155998042 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8aac15d1f0 0x7f8aac0d0b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:47:54.899 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:54.896+0000 7f8ab1417640 1 -- 172.21.15.159:0/3155998042 >> v1:172.21.15.40:6789/0 conn(0x7f8aac0b7960 legacy=0x7f8aac0b7df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:47:54.899 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:54.896+0000 7f8ab1417640 1 -- 172.21.15.159:0/3155998042 --> v2:172.21.15.159:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8aac0b6ba0 con 0x7f8aac0d1060 2023-12-17T11:47:54.899 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:54.896+0000 7f8ab1c18640 1 --2- 172.21.15.159:0/3155998042 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8aac15d1f0 0x7f8aac0d0b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-17T11:47:54.900 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:54.897+0000 7f8ab1417640 1 --2- 172.21.15.159:0/3155998042 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8aac0d1060 0x7f8aac0d1480 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f8a9c009870 tx=0x7f8a9c02b8f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d8d989b2805b9405 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:47:54.900 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:54.898+0000 7f8ab0c16640 1 -- 172.21.15.159:0/3155998042 <== mon.1 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a9c031640 con 0x7f8aac0d1060 2023-12-17T11:47:54.900 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:54.898+0000 7f8ab0c16640 1 -- 172.21.15.159:0/3155998042 <== mon.1 v2:172.21.15.159:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a9c0317a0 con 0x7f8aac0d1060 2023-12-17T11:47:54.900 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:54.898+0000 7f8ab0c16640 1 -- 172.21.15.159:0/3155998042 <== mon.1 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a9c031b30 con 0x7f8aac0d1060 2023-12-17T11:47:54.901 INFO:tasks.ceph.mgr.y.smithi040.stderr:2023-12-17T11:47:54.898+0000 7f1e05cb0040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-12-17T11:47:54.902 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:54.898+0000 7f8ab2c1a640 1 -- 172.21.15.159:0/3155998042 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8aac0d1060 msgr2=0x7f8aac0d1480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:47:54.902 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:54.898+0000 7f8ab2c1a640 1 --2- 172.21.15.159:0/3155998042 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8aac0d1060 0x7f8aac0d1480 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f8a9c009870 tx=0x7f8a9c02b8f0 comp rx=0 tx=0).stop 2023-12-17T11:47:54.902 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:54.898+0000 7f8ab2c1a640 1 -- 172.21.15.159:0/3155998042 shutdown_connections 2023-12-17T11:47:54.902 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:54.898+0000 7f8ab2c1a640 1 --2- 172.21.15.159:0/3155998042 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8aac0d1060 0x7f8aac0d1480 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:47:54.902 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:54.898+0000 7f8ab2c1a640 1 --2- 172.21.15.159:0/3155998042 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8aac15d1f0 0x7f8aac0d0b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:47:54.902 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:54.898+0000 7f8ab2c1a640 1 -- 172.21.15.159:0/3155998042 >> 172.21.15.159:0/3155998042 conn(0x7f8aac0d2fe0 msgr2=0x7f8aac0d33f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:47:54.902 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:54.898+0000 7f8ab2c1a640 1 -- 172.21.15.159:0/3155998042 shutdown_connections 2023-12-17T11:47:54.902 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:54.899+0000 7f8ab2c1a640 1 -- 172.21.15.159:0/3155998042 wait complete. 2023-12-17T11:47:54.903 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:54.900+0000 7f8ab2c1a640 1 Processor -- start 2023-12-17T11:47:54.903 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:54.900+0000 7f8ab2c1a640 1 -- start start 2023-12-17T11:47:54.904 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:54.901+0000 7f8ab2c1a640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8aac0b7960 0x7f8aac1513f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:47:54.904 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:54.901+0000 7f8ab2c1a640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8aac0d1060 0x7f8aac09cce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:47:54.904 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:54.901+0000 7f8ab2c1a640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8aac15d1f0 0x7f8aac09e800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:47:54.904 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:54.901+0000 7f8ab2c1a640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8aac15ad90 con 0x7f8aac0d1060 2023-12-17T11:47:54.904 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:54.901+0000 7f8ab2c1a640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8aac0c88e0 con 0x7f8aac15d1f0 2023-12-17T11:47:54.904 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:54.901+0000 7f8ab2c1a640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8aac0c7840 con 0x7f8aac0b7960 2023-12-17T11:47:54.904 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:54.901+0000 7f8ab1c18640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8aac0b7960 0x7f8aac1513f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:47:54.904 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:54.901+0000 7f8ab1c18640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8aac0b7960 0x7f8aac1513f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3301/0 says I am v2:172.21.15.159:35398/0 (socket says 172.21.15.159:35398) 2023-12-17T11:47:54.905 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:54.901+0000 7f8ab2419640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8aac15d1f0 0x7f8aac09e800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:47:54.905 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:54.901+0000 7f8ab1c18640 1 -- 172.21.15.159:0/2229569450 learned_addr learned my addr 172.21.15.159:0/2229569450 (peer_addr_for_me v2:172.21.15.159:0/0) 2023-12-17T11:47:54.905 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:54.902+0000 7f8ab1417640 1 --2- 172.21.15.159:0/2229569450 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8aac0d1060 0x7f8aac09cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:47:54.906 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:54.902+0000 7f8ab2419640 1 -- 172.21.15.159:0/2229569450 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8aac0b7960 msgr2=0x7f8aac1513f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:47:54.906 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:54.902+0000 7f8ab2419640 1 --2- 172.21.15.159:0/2229569450 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8aac0b7960 0x7f8aac1513f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:47:54.906 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:54.902+0000 7f8ab2419640 1 -- 172.21.15.159:0/2229569450 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8aac0d1060 msgr2=0x7f8aac09cce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:47:54.906 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:54.902+0000 7f8ab2419640 1 --2- 172.21.15.159:0/2229569450 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8aac0d1060 0x7f8aac09cce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:47:54.906 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:54.902+0000 7f8ab2419640 1 -- 172.21.15.159:0/2229569450 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8aa8009400 con 0x7f8aac15d1f0 2023-12-17T11:47:54.907 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:54.902+0000 7f8ab1c18640 1 --2- 172.21.15.159:0/2229569450 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8aac0b7960 0x7f8aac1513f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-17T11:47:54.907 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:54.902+0000 7f8ab2419640 1 --2- 172.21.15.159:0/2229569450 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8aac15d1f0 0x7f8aac09e800 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f8aa400c780 tx=0x7f8aa400cc40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:47:54.907 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:54.902+0000 7f8aa27fc640 1 -- 172.21.15.159:0/2229569450 <== mon.1 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8aa400aa50 con 0x7f8aac15d1f0 2023-12-17T11:47:54.907 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:54.902+0000 7f8aa27fc640 1 -- 172.21.15.159:0/2229569450 <== mon.1 v2:172.21.15.159:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8aa400abb0 con 0x7f8aac15d1f0 2023-12-17T11:47:54.907 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:54.903+0000 7f8ab2c1a640 1 -- 172.21.15.159:0/2229569450 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a9c0094d0 con 0x7f8aac15d1f0 2023-12-17T11:47:54.907 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:54.903+0000 7f8aa27fc640 1 -- 172.21.15.159:0/2229569450 <== mon.1 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8aa400ce30 con 0x7f8aac15d1f0 2023-12-17T11:47:54.907 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:54.903+0000 7f8ab2c1a640 1 -- 172.21.15.159:0/2229569450 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8aac0c7e00 con 0x7f8aac15d1f0 2023-12-17T11:47:54.907 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:54.903+0000 7f8aa27fc640 1 -- 172.21.15.159:0/2229569450 <== mon.1 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f8aa4004bf0 con 0x7f8aac15d1f0 2023-12-17T11:47:54.907 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:54.903+0000 7f8aa27fc640 1 -- 172.21.15.159:0/2229569450 <== mon.1 v2:172.21.15.159:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 840+0+0 (secure 0 0 0) 0x7f8aa4012420 con 0x7f8aac15d1f0 2023-12-17T11:47:54.907 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:54.904+0000 7f8ab2c1a640 1 -- 172.21.15.159:0/2229569450 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8aac0673f0 con 0x7f8aac15d1f0 2023-12-17T11:47:54.908 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:54.906+0000 7f8aa27fc640 1 -- 172.21.15.159:0/2229569450 <== mon.1 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7f8aa4039ce0 con 0x7f8aac15d1f0 2023-12-17T11:47:54.938 INFO:tasks.ceph.mgr.x.smithi159.stderr:2023-12-17T11:47:54.936+0000 7fc300641040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-12-17T11:47:54.965 INFO:tasks.ceph.mgr.y.smithi040.stderr:2023-12-17T11:47:54.963+0000 7f1e05cb0040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-12-17T11:47:54.988 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:54.985+0000 7f8ab2c1a640 1 -- 172.21.15.159:0/2229569450 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "osd new", "uuid": "c5d628ae-36f4-4866-802c-b162f0e90add", "id": 1} v 0) v1 -- 0x7f8aac06b280 con 0x7f8aac15d1f0 2023-12-17T11:47:54.991 INFO:tasks.ceph.mgr.x.smithi159.stderr:2023-12-17T11:47:54.989+0000 7fc300641040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-12-17T11:47:54.995 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:54.992+0000 7f8aa27fc640 1 -- 172.21.15.159:0/2229569450 <== mon.1 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "c5d628ae-36f4-4866-802c-b162f0e90add", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7f8aa4028070 con 0x7f8aac15d1f0 2023-12-17T11:47:54.995 INFO:teuthology.orchestra.run.smithi159.stdout:1 2023-12-17T11:47:54.996 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:54.993+0000 7f8ab2c1a640 1 -- 172.21.15.159:0/2229569450 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8aac15d1f0 msgr2=0x7f8aac09e800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:47:54.996 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:54.993+0000 7f8ab2c1a640 1 --2- 172.21.15.159:0/2229569450 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8aac15d1f0 0x7f8aac09e800 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f8aa400c780 tx=0x7f8aa400cc40 comp rx=0 tx=0).stop 2023-12-17T11:47:54.996 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:54.994+0000 7f8ab2c1a640 1 -- 172.21.15.159:0/2229569450 shutdown_connections 2023-12-17T11:47:54.996 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:54.994+0000 7f8ab2c1a640 1 --2- 172.21.15.159:0/2229569450 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8aac15d1f0 0x7f8aac09e800 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:47:54.996 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:54.994+0000 7f8ab2c1a640 1 --2- 172.21.15.159:0/2229569450 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8aac0d1060 0x7f8aac09cce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:47:54.997 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:54.994+0000 7f8ab2c1a640 1 --2- 172.21.15.159:0/2229569450 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8aac0b7960 0x7f8aac1513f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:47:54.997 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:54.994+0000 7f8ab2c1a640 1 -- 172.21.15.159:0/2229569450 >> 172.21.15.159:0/2229569450 conn(0x7f8aac0d2fe0 msgr2=0x7f8aac06c0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:47:54.997 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:54.994+0000 7f8ab2c1a640 1 -- 172.21.15.159:0/2229569450 shutdown_connections 2023-12-17T11:47:54.997 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:54.994+0000 7f8ab2c1a640 1 -- 172.21.15.159:0/2229569450 wait complete. 2023-12-17T11:47:55.012 DEBUG:teuthology.orchestra.run.smithi159:> sudo ceph --cluster ceph osd new d986ad6a-af2f-47fc-9c3b-fbda27b82b73 2 2023-12-17T11:47:55.018 INFO:tasks.ceph.mgr.y.smithi040.stderr:2023-12-17T11:47:55.016+0000 7f1e05cb0040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-12-17T11:47:55.059 INFO:tasks.ceph.mgr.x.smithi159.stderr:2023-12-17T11:47:55.056+0000 7fc300641040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-12-17T11:47:55.084 INFO:tasks.ceph.mgr.y.smithi040.stderr:2023-12-17T11:47:55.082+0000 7f1e05cb0040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-12-17T11:47:55.111 INFO:tasks.ceph.mgr.x.smithi159.stderr:2023-12-17T11:47:55.109+0000 7fc300641040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-12-17T11:47:55.136 INFO:tasks.ceph.mgr.y.smithi040.stderr:2023-12-17T11:47:55.134+0000 7f1e05cb0040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-12-17T11:47:55.204 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:55.202+0000 7fba8a267640 1 Processor -- start 2023-12-17T11:47:55.204 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:55.202+0000 7fba8a267640 1 -- start start 2023-12-17T11:47:55.206 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:55.203+0000 7fba8a267640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fba840b8970 0x7fba840d1230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:47:55.206 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:55.203+0000 7fba8a267640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fba840cdc10 0x7fba840ce0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:47:55.206 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:55.203+0000 7fba8a267640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba840b74d0 con 0x7fba8415d1f0 2023-12-17T11:47:55.206 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:55.203+0000 7fba8a267640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba840b68e0 con 0x7fba840cdc10 2023-12-17T11:47:55.206 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:55.203+0000 7fba8a267640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba840b6ba0 con 0x7fba840b8970 2023-12-17T11:47:55.206 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:55.204+0000 7fba89265640 1 --1- >> v1:172.21.15.159:6789/0 conn(0x7fba8415d1f0 0x7fba840d0b20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.159:6789/0 says I am v1:172.21.15.159:53712/0 (socket says 172.21.15.159:53712) 2023-12-17T11:47:55.206 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:55.204+0000 7fba89265640 1 -- 172.21.15.159:0/1922140249 learned_addr learned my addr 172.21.15.159:0/1922140249 (peer_addr_for_me v1:172.21.15.159:0/0) 2023-12-17T11:47:55.207 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:55.204+0000 7fba88a64640 1 --2- 172.21.15.159:0/1922140249 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fba840b8970 0x7fba840d1230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:47:55.207 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:55.204+0000 7fba89a66640 1 --2- 172.21.15.159:0/1922140249 >> v2:172.21.15.40:3300/0 conn(0x7fba840cdc10 0x7fba840ce0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:47:55.208 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:55.204+0000 7fba7bfff640 1 -- 172.21.15.159:0/1922140249 <== mon.1 v1:172.21.15.159:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2275712167 0 0) 0x7fba840b74d0 con 0x7fba8415d1f0 2023-12-17T11:47:55.208 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:55.204+0000 7fba7bfff640 1 -- 172.21.15.159:0/1922140249 --> v1:172.21.15.159:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fba70003520 con 0x7fba8415d1f0 2023-12-17T11:47:55.208 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:55.204+0000 7fba88a64640 1 -- 172.21.15.159:0/1922140249 >> v2:172.21.15.40:3300/0 conn(0x7fba840cdc10 msgr2=0x7fba840ce0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:47:55.208 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:55.204+0000 7fba88a64640 1 --2- 172.21.15.159:0/1922140249 >> v2:172.21.15.40:3300/0 conn(0x7fba840cdc10 0x7fba840ce0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:47:55.208 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:55.204+0000 7fba88a64640 1 -- 172.21.15.159:0/1922140249 >> v1:172.21.15.159:6789/0 conn(0x7fba8415d1f0 legacy=0x7fba840d0b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:47:55.208 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:55.204+0000 7fba88a64640 1 -- 172.21.15.159:0/1922140249 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba840b6e80 con 0x7fba840b8970 2023-12-17T11:47:55.209 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:55.206+0000 7fba88a64640 1 --2- 172.21.15.159:0/1922140249 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fba840b8970 0x7fba840d1230 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fba740097a0 tx=0x7fba7402b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=58e3c3963eedeec8 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:47:55.209 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:55.206+0000 7fba7bfff640 1 -- 172.21.15.159:0/1922140249 <== mon.2 v2:172.21.15.159:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba74031830 con 0x7fba840b8970 2023-12-17T11:47:55.209 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:55.206+0000 7fba7bfff640 1 -- 172.21.15.159:0/1922140249 <== mon.2 v2:172.21.15.159:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba74031990 con 0x7fba840b8970 2023-12-17T11:47:55.209 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:55.206+0000 7fba7bfff640 1 -- 172.21.15.159:0/1922140249 <== mon.2 v2:172.21.15.159:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba74031d00 con 0x7fba840b8970 2023-12-17T11:47:55.210 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:55.207+0000 7fba8a267640 1 -- 172.21.15.159:0/1922140249 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fba840b8970 msgr2=0x7fba840d1230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:47:55.210 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:55.207+0000 7fba8a267640 1 --2- 172.21.15.159:0/1922140249 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fba840b8970 0x7fba840d1230 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fba740097a0 tx=0x7fba7402b8d0 comp rx=0 tx=0).stop 2023-12-17T11:47:55.210 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:55.207+0000 7fba8a267640 1 -- 172.21.15.159:0/1922140249 shutdown_connections 2023-12-17T11:47:55.210 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:55.207+0000 7fba8a267640 1 --2- 172.21.15.159:0/1922140249 >> v2:172.21.15.40:3300/0 conn(0x7fba840cdc10 0x7fba840ce0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:47:55.210 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:55.207+0000 7fba8a267640 1 --2- 172.21.15.159:0/1922140249 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fba840b8970 0x7fba840d1230 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:47:55.210 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:55.207+0000 7fba8a267640 1 -- 172.21.15.159:0/1922140249 >> 172.21.15.159:0/1922140249 conn(0x7fba840d2fe0 msgr2=0x7fba840d33f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:47:55.210 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:55.207+0000 7fba8a267640 1 -- 172.21.15.159:0/1922140249 shutdown_connections 2023-12-17T11:47:55.210 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:55.207+0000 7fba8a267640 1 -- 172.21.15.159:0/1922140249 wait complete. 2023-12-17T11:47:55.211 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:55.209+0000 7fba8a267640 1 Processor -- start 2023-12-17T11:47:55.211 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:55.209+0000 7fba8a267640 1 -- start start 2023-12-17T11:47:55.214 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:55.210+0000 7fba8a267640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fba840b8970 0x7fba841f2140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:47:55.214 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:55.210+0000 7fba8a267640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fba840cdc10 0x7fba840afbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:47:55.214 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:55.210+0000 7fba8a267640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fba8415d1f0 0x7fba840b0110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:47:55.214 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:55.210+0000 7fba8a267640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba8414b240 con 0x7fba8415d1f0 2023-12-17T11:47:55.214 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:55.210+0000 7fba8a267640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba84148600 con 0x7fba840b8970 2023-12-17T11:47:55.214 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:55.210+0000 7fba8a267640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba841488e0 con 0x7fba840cdc10 2023-12-17T11:47:55.214 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:55.210+0000 7fba89265640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fba840b8970 0x7fba841f2140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:47:55.214 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:55.210+0000 7fba88a64640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fba840cdc10 0x7fba840afbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:47:55.214 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:55.210+0000 7fba88a64640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fba840cdc10 0x7fba840afbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3301/0 says I am v2:172.21.15.159:35416/0 (socket says 172.21.15.159:35416) 2023-12-17T11:47:55.214 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:55.210+0000 7fba88a64640 1 -- 172.21.15.159:0/1226668180 learned_addr learned my addr 172.21.15.159:0/1226668180 (peer_addr_for_me v2:172.21.15.159:0/0) 2023-12-17T11:47:55.214 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:55.210+0000 7fba89265640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fba840b8970 0x7fba841f2140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:50234/0 (socket says 172.21.15.159:50234) 2023-12-17T11:47:55.215 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:55.210+0000 7fba89a66640 1 --2- 172.21.15.159:0/1226668180 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fba8415d1f0 0x7fba840b0110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:47:55.215 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:55.211+0000 7fba89265640 1 -- 172.21.15.159:0/1226668180 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fba840cdc10 msgr2=0x7fba840afbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:47:55.215 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:55.211+0000 7fba89265640 1 --2- 172.21.15.159:0/1226668180 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fba840cdc10 0x7fba840afbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:47:55.215 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:55.211+0000 7fba89265640 1 -- 172.21.15.159:0/1226668180 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fba8415d1f0 msgr2=0x7fba840b0110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:47:55.215 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:55.211+0000 7fba89265640 1 --2- 172.21.15.159:0/1226668180 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fba8415d1f0 0x7fba840b0110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:47:55.215 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:55.211+0000 7fba89265640 1 -- 172.21.15.159:0/1226668180 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba74009400 con 0x7fba840b8970 2023-12-17T11:47:55.215 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:55.211+0000 7fba88a64640 1 --2- 172.21.15.159:0/1226668180 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fba840cdc10 0x7fba840afbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-17T11:47:55.215 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:55.211+0000 7fba89265640 1 --2- 172.21.15.159:0/1226668180 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fba840b8970 0x7fba841f2140 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fba8000c9f0 tx=0x7fba8000ceb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:47:55.215 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:55.211+0000 7fba79ffb640 1 -- 172.21.15.159:0/1226668180 <== mon.1 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba8000ab70 con 0x7fba840b8970 2023-12-17T11:47:55.215 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:55.211+0000 7fba79ffb640 1 -- 172.21.15.159:0/1226668180 <== mon.1 v2:172.21.15.159:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba8000acd0 con 0x7fba840b8970 2023-12-17T11:47:55.215 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:55.211+0000 7fba79ffb640 1 -- 172.21.15.159:0/1226668180 <== mon.1 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba80012640 con 0x7fba840b8970 2023-12-17T11:47:55.215 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:55.211+0000 7fba8a267640 1 -- 172.21.15.159:0/1226668180 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba84148bc0 con 0x7fba840b8970 2023-12-17T11:47:55.215 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:55.211+0000 7fba8a267640 1 -- 172.21.15.159:0/1226668180 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba841f2860 con 0x7fba840b8970 2023-12-17T11:47:55.216 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:55.211+0000 7fba79ffb640 1 -- 172.21.15.159:0/1226668180 <== mon.1 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fba80012aa0 con 0x7fba840b8970 2023-12-17T11:47:55.216 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:55.211+0000 7fba79ffb640 1 -- 172.21.15.159:0/1226668180 <== mon.1 v2:172.21.15.159:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 955+0+0 (secure 0 0 0) 0x7fba8000ae40 con 0x7fba840b8970 2023-12-17T11:47:55.216 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:55.212+0000 7fba8a267640 1 -- 172.21.15.159:0/1226668180 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba840673f0 con 0x7fba840b8970 2023-12-17T11:47:55.217 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:55.215+0000 7fba79ffb640 1 -- 172.21.15.159:0/1226668180 <== mon.1 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7fba80017070 con 0x7fba840b8970 2023-12-17T11:47:55.233 INFO:tasks.ceph.mgr.x.smithi159.stderr:2023-12-17T11:47:55.230+0000 7fc300641040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-12-17T11:47:55.255 INFO:tasks.ceph.mgr.y.smithi040.stderr:2023-12-17T11:47:55.253+0000 7f1e05cb0040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-12-17T11:47:55.295 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:55.293+0000 7fba8a267640 1 -- 172.21.15.159:0/1226668180 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "osd new", "uuid": "d986ad6a-af2f-47fc-9c3b-fbda27b82b73", "id": 2} v 0) v1 -- 0x7fba8406ba30 con 0x7fba840b8970 2023-12-17T11:47:55.303 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:55.300+0000 7fba79ffb640 1 -- 172.21.15.159:0/1226668180 <== mon.1 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "d986ad6a-af2f-47fc-9c3b-fbda27b82b73", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7fba8001c440 con 0x7fba840b8970 2023-12-17T11:47:55.303 INFO:teuthology.orchestra.run.smithi159.stdout:2 2023-12-17T11:47:55.304 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:55.301+0000 7fba8a267640 1 -- 172.21.15.159:0/1226668180 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fba840b8970 msgr2=0x7fba841f2140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:47:55.304 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:55.301+0000 7fba8a267640 1 --2- 172.21.15.159:0/1226668180 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fba840b8970 0x7fba841f2140 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fba8000c9f0 tx=0x7fba8000ceb0 comp rx=0 tx=0).stop 2023-12-17T11:47:55.304 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:55.301+0000 7fba8a267640 1 -- 172.21.15.159:0/1226668180 shutdown_connections 2023-12-17T11:47:55.304 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:55.301+0000 7fba8a267640 1 --2- 172.21.15.159:0/1226668180 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fba8415d1f0 0x7fba840b0110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:47:55.304 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:55.301+0000 7fba8a267640 1 --2- 172.21.15.159:0/1226668180 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fba840cdc10 0x7fba840afbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:47:55.304 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:55.301+0000 7fba8a267640 1 --2- 172.21.15.159:0/1226668180 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fba840b8970 0x7fba841f2140 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:47:55.305 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:55.302+0000 7fba8a267640 1 -- 172.21.15.159:0/1226668180 >> 172.21.15.159:0/1226668180 conn(0x7fba840d2fe0 msgr2=0x7fba840cdff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:47:55.305 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:55.302+0000 7fba8a267640 1 -- 172.21.15.159:0/1226668180 shutdown_connections 2023-12-17T11:47:55.305 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:55.302+0000 7fba8a267640 1 -- 172.21.15.159:0/1226668180 wait complete. 2023-12-17T11:47:55.316 INFO:tasks.ceph.mgr.x.smithi159.stderr:2023-12-17T11:47:55.314+0000 7fc300641040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-12-17T11:47:55.321 DEBUG:teuthology.orchestra.run.smithi159:> sudo ceph --cluster ceph osd new d79d22b7-be05-41b2-b95d-697db677fd02 3 2023-12-17T11:47:55.339 INFO:tasks.ceph.mgr.y.smithi040.stderr:2023-12-17T11:47:55.337+0000 7f1e05cb0040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-12-17T11:47:55.372 INFO:tasks.ceph.mgr.x.smithi159.stderr:2023-12-17T11:47:55.370+0000 7fc300641040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-12-17T11:47:55.395 INFO:tasks.ceph.mgr.y.smithi040.stderr:2023-12-17T11:47:55.393+0000 7f1e05cb0040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-12-17T11:47:55.436 INFO:tasks.ceph.mgr.x.smithi159.stderr:2023-12-17T11:47:55.434+0000 7fc300641040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-12-17T11:47:55.458 INFO:tasks.ceph.mgr.y.smithi040.stderr:2023-12-17T11:47:55.456+0000 7f1e05cb0040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-12-17T11:47:55.496 INFO:tasks.ceph.mgr.x.smithi159.stderr:2023-12-17T11:47:55.493+0000 7fc300641040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-12-17T11:47:55.515 INFO:tasks.ceph.mgr.y.smithi040.stderr:2023-12-17T11:47:55.513+0000 7f1e05cb0040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-12-17T11:47:55.563 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:55.560+0000 7f48ea81e640 1 Processor -- start 2023-12-17T11:47:55.563 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:55.560+0000 7f48ea81e640 1 -- start start 2023-12-17T11:47:55.565 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:55.562+0000 7f48ea81e640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f48e406e030 0x7f48e406a460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:47:55.565 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:55.562+0000 7f48ea81e640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f48e406a9a0 0x7f48e40b3ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:47:55.565 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:55.562+0000 7f48ea81e640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48e406adf0 con 0x7f48e4145fa0 2023-12-17T11:47:55.565 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:55.562+0000 7f48ea81e640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48e4071a90 con 0x7f48e406a9a0 2023-12-17T11:47:55.565 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:55.562+0000 7f48ea81e640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48e4146380 con 0x7f48e406e030 2023-12-17T11:47:55.565 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:55.562+0000 7f48e37fe640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f48e406e030 0x7f48e406a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:47:55.565 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:55.562+0000 7f48e3fff640 1 --1- >> v1:172.21.15.159:6789/0 conn(0x7f48e4145fa0 0x7f48e4071380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.159:6789/0 says I am v1:172.21.15.159:53728/0 (socket says 172.21.15.159:53728) 2023-12-17T11:47:55.566 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:55.562+0000 7f48e37fe640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f48e406e030 0x7f48e406a460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:50240/0 (socket says 172.21.15.159:50240) 2023-12-17T11:47:55.566 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:55.562+0000 7f48e3fff640 1 -- 172.21.15.159:0/2787397136 learned_addr learned my addr 172.21.15.159:0/2787397136 (peer_addr_for_me v1:172.21.15.159:0/0) 2023-12-17T11:47:55.566 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:55.562+0000 7f48e8dbb640 1 --2- 172.21.15.159:0/2787397136 >> v2:172.21.15.40:3300/0 conn(0x7f48e406a9a0 0x7f48e40b3ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:47:55.566 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:55.562+0000 7f48e37fe640 1 -- 172.21.15.159:0/2787397136 >> v2:172.21.15.40:3300/0 conn(0x7f48e406a9a0 msgr2=0x7f48e40b3ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:47:55.566 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:55.563+0000 7f48e37fe640 1 --2- 172.21.15.159:0/2787397136 >> v2:172.21.15.40:3300/0 conn(0x7f48e406a9a0 0x7f48e40b3ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:47:55.566 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:55.563+0000 7f48e37fe640 1 -- 172.21.15.159:0/2787397136 >> v1:172.21.15.159:6789/0 conn(0x7f48e4145fa0 legacy=0x7f48e4071380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:47:55.566 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:55.563+0000 7f48e37fe640 1 -- 172.21.15.159:0/2787397136 --> v2:172.21.15.159:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48e4071c80 con 0x7f48e406e030 2023-12-17T11:47:55.566 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:55.563+0000 7f48e2ffd640 1 -- 172.21.15.159:0/2787397136 <== mon.1 v1:172.21.15.159:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2276444469 0 0) 0x7f48d4001110 con 0x7f48e4145fa0 2023-12-17T11:47:55.566 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:55.563+0000 7f48e8dbb640 1 --2- 172.21.15.159:0/2787397136 >> v2:172.21.15.40:3300/0 conn(0x7f48e406a9a0 0x7f48e40b3ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-17T11:47:55.566 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:55.564+0000 7f48e37fe640 1 --2- 172.21.15.159:0/2787397136 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f48e406e030 0x7f48e406a460 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f48e4066f20 tx=0x7f48d802b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2dbf6539aa206158 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:47:55.567 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:55.565+0000 7f48e2ffd640 1 -- 172.21.15.159:0/2787397136 <== mon.1 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48d8031830 con 0x7f48e406e030 2023-12-17T11:47:55.567 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:55.565+0000 7f48e2ffd640 1 -- 172.21.15.159:0/2787397136 <== mon.1 v2:172.21.15.159:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48d8031990 con 0x7f48e406e030 2023-12-17T11:47:55.567 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:55.565+0000 7f48e2ffd640 1 -- 172.21.15.159:0/2787397136 <== mon.1 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48d8031d20 con 0x7f48e406e030 2023-12-17T11:47:55.568 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:55.565+0000 7f48ea81e640 1 -- 172.21.15.159:0/2787397136 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f48e406e030 msgr2=0x7f48e406a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:47:55.568 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:55.565+0000 7f48ea81e640 1 --2- 172.21.15.159:0/2787397136 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f48e406e030 0x7f48e406a460 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f48e4066f20 tx=0x7f48d802b8d0 comp rx=0 tx=0).stop 2023-12-17T11:47:55.568 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:55.565+0000 7f48ea81e640 1 -- 172.21.15.159:0/2787397136 shutdown_connections 2023-12-17T11:47:55.568 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:55.565+0000 7f48ea81e640 1 --2- 172.21.15.159:0/2787397136 >> v2:172.21.15.40:3300/0 conn(0x7f48e406a9a0 0x7f48e40b3ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:47:55.568 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:55.565+0000 7f48ea81e640 1 --2- 172.21.15.159:0/2787397136 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f48e406e030 0x7f48e406a460 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:47:55.568 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:55.565+0000 7f48ea81e640 1 -- 172.21.15.159:0/2787397136 >> 172.21.15.159:0/2787397136 conn(0x7f48e40b1bf0 msgr2=0x7f48e40b1fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:47:55.568 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:55.565+0000 7f48ea81e640 1 -- 172.21.15.159:0/2787397136 shutdown_connections 2023-12-17T11:47:55.568 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:55.565+0000 7f48ea81e640 1 -- 172.21.15.159:0/2787397136 wait complete. 2023-12-17T11:47:55.569 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:55.567+0000 7f48ea81e640 1 Processor -- start 2023-12-17T11:47:55.569 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:55.567+0000 7f48ea81e640 1 -- start start 2023-12-17T11:47:55.572 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:55.568+0000 7f48ea81e640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f48e406a9a0 0x7f48e413d9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:47:55.572 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:55.568+0000 7f48ea81e640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f48e406e030 0x7f48e415f1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:47:55.572 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:55.568+0000 7f48ea81e640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f48e4145fa0 0x7f48e415f6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:47:55.572 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:55.568+0000 7f48ea81e640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48e415d870 con 0x7f48e406a9a0 2023-12-17T11:47:55.572 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:55.568+0000 7f48ea81e640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48e4160000 con 0x7f48e4145fa0 2023-12-17T11:47:55.572 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:55.568+0000 7f48ea81e640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48e415fd20 con 0x7f48e406e030 2023-12-17T11:47:55.572 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:55.568+0000 7f48e37fe640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f48e406e030 0x7f48e415f1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:47:55.572 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:55.568+0000 7f48e37fe640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f48e406e030 0x7f48e415f1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3301/0 says I am v2:172.21.15.159:35428/0 (socket says 172.21.15.159:35428) 2023-12-17T11:47:55.573 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:55.568+0000 7f48e37fe640 1 -- 172.21.15.159:0/2073457716 learned_addr learned my addr 172.21.15.159:0/2073457716 (peer_addr_for_me v2:172.21.15.159:0/0) 2023-12-17T11:47:55.573 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:55.568+0000 7f48e3fff640 1 --2- 172.21.15.159:0/2073457716 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f48e406a9a0 0x7f48e413d9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:47:55.573 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:55.569+0000 7f48e37fe640 1 -- 172.21.15.159:0/2073457716 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f48e4145fa0 msgr2=0x7f48e415f6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:47:55.573 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:55.569+0000 7f48e37fe640 1 --2- 172.21.15.159:0/2073457716 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f48e4145fa0 0x7f48e415f6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:47:55.573 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:55.569+0000 7f48e37fe640 1 -- 172.21.15.159:0/2073457716 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f48e406a9a0 msgr2=0x7f48e413d9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:47:55.573 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:55.569+0000 7f48e37fe640 1 --2- 172.21.15.159:0/2073457716 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f48e406a9a0 0x7f48e413d9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:47:55.573 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:55.569+0000 7f48e37fe640 1 -- 172.21.15.159:0/2073457716 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48d8009400 con 0x7f48e406e030 2023-12-17T11:47:55.573 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:55.569+0000 7f48e37fe640 1 --2- 172.21.15.159:0/2073457716 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f48e406e030 0x7f48e415f1b0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f48d802bee0 tx=0x7f48d80046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:47:55.573 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:55.569+0000 7f48e0ff9640 1 -- 172.21.15.159:0/2073457716 <== mon.2 v2:172.21.15.159:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48d803ba70 con 0x7f48e406e030 2023-12-17T11:47:55.573 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:55.569+0000 7f48e0ff9640 1 -- 172.21.15.159:0/2073457716 <== mon.2 v2:172.21.15.159:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48d803bbf0 con 0x7f48e406e030 2023-12-17T11:47:55.573 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:55.569+0000 7f48ea81e640 1 -- 172.21.15.159:0/2073457716 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48e415da50 con 0x7f48e406e030 2023-12-17T11:47:55.573 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:55.569+0000 7f48e0ff9640 1 -- 172.21.15.159:0/2073457716 <== mon.2 v2:172.21.15.159:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48d80433f0 con 0x7f48e406e030 2023-12-17T11:47:55.573 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:55.569+0000 7f48ea81e640 1 -- 172.21.15.159:0/2073457716 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48e415e010 con 0x7f48e406e030 2023-12-17T11:47:55.574 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:55.570+0000 7f48e0ff9640 1 -- 172.21.15.159:0/2073457716 <== mon.2 v2:172.21.15.159:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f48d8043850 con 0x7f48e406e030 2023-12-17T11:47:55.574 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:55.570+0000 7f48e0ff9640 1 -- 172.21.15.159:0/2073457716 <== mon.2 v2:172.21.15.159:3301/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1070+0+0 (secure 0 0 0) 0x7f48d804c7b0 con 0x7f48e406e030 2023-12-17T11:47:55.574 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:55.570+0000 7f48ea81e640 1 -- 172.21.15.159:0/2073457716 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48e40673f0 con 0x7f48e406e030 2023-12-17T11:47:55.575 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:55.573+0000 7f48e0ff9640 1 -- 172.21.15.159:0/2073457716 <== mon.2 v2:172.21.15.159:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7f48d8051060 con 0x7f48e406e030 2023-12-17T11:47:55.654 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:55.651+0000 7f48ea81e640 1 -- 172.21.15.159:0/2073457716 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_command({"prefix": "osd new", "uuid": "d79d22b7-be05-41b2-b95d-697db677fd02", "id": 3} v 0) v1 -- 0x7f48e415e200 con 0x7f48e406e030 2023-12-17T11:47:55.664 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:55.661+0000 7f48e0ff9640 1 -- 172.21.15.159:0/2073457716 <== mon.2 v2:172.21.15.159:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "d79d22b7-be05-41b2-b95d-697db677fd02", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7f48d8035020 con 0x7f48e406e030 2023-12-17T11:47:55.664 INFO:teuthology.orchestra.run.smithi159.stdout:3 2023-12-17T11:47:55.666 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:55.663+0000 7f48ea81e640 1 -- 172.21.15.159:0/2073457716 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f48e406e030 msgr2=0x7f48e415f1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:47:55.666 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:55.663+0000 7f48ea81e640 1 --2- 172.21.15.159:0/2073457716 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f48e406e030 0x7f48e415f1b0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f48d802bee0 tx=0x7f48d80046c0 comp rx=0 tx=0).stop 2023-12-17T11:47:55.666 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:55.663+0000 7f48ea81e640 1 -- 172.21.15.159:0/2073457716 shutdown_connections 2023-12-17T11:47:55.666 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:55.663+0000 7f48ea81e640 1 --2- 172.21.15.159:0/2073457716 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f48e4145fa0 0x7f48e415f6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:47:55.666 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:55.663+0000 7f48ea81e640 1 --2- 172.21.15.159:0/2073457716 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f48e406e030 0x7f48e415f1b0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:47:55.666 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:55.663+0000 7f48ea81e640 1 --2- 172.21.15.159:0/2073457716 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f48e406a9a0 0x7f48e413d9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:47:55.666 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:55.663+0000 7f48ea81e640 1 -- 172.21.15.159:0/2073457716 >> 172.21.15.159:0/2073457716 conn(0x7f48e40b1bf0 msgr2=0x7f48e40afb90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:47:55.666 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:55.663+0000 7f48ea81e640 1 -- 172.21.15.159:0/2073457716 shutdown_connections 2023-12-17T11:47:55.667 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:55.663+0000 7f48ea81e640 1 -- 172.21.15.159:0/2073457716 wait complete. 2023-12-17T11:47:55.682 DEBUG:teuthology.orchestra.run.smithi159:> sudo ceph --cluster ceph osd new 62a7a233-d3ea-40be-91de-180c0208d639 4 2023-12-17T11:47:55.924 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:55.922+0000 7f5d0a90f640 1 Processor -- start 2023-12-17T11:47:55.924 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:55.922+0000 7f5d0a90f640 1 -- start start 2023-12-17T11:47:55.927 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:55.923+0000 7f5d0a90f640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f5d0415d620 0x7f5d040d3a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:47:55.927 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:55.923+0000 7f5d0a90f640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5d040d1510 0x7f5d040d1970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:47:55.927 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:55.923+0000 7f5d0a90f640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d040cf130 con 0x7f5d040cf810 2023-12-17T11:47:55.927 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:55.923+0000 7f5d0a90f640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d040b0220 con 0x7f5d0415d620 2023-12-17T11:47:55.927 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:55.923+0000 7f5d0a90f640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d0415da00 con 0x7f5d040d1510 2023-12-17T11:47:55.927 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:55.924+0000 7f5cfbfff640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5d040d1510 0x7f5d040d1970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:47:55.928 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:55.924+0000 7f5d08eac640 1 --1- >> v1:172.21.15.159:6789/0 conn(0x7f5d040cf810 0x7f5d040cfc70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.159:6789/0 says I am v1:172.21.15.159:53730/0 (socket says 172.21.15.159:53730) 2023-12-17T11:47:55.928 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:55.924+0000 7f5d08eac640 1 -- 172.21.15.159:0/1165852848 learned_addr learned my addr 172.21.15.159:0/1165852848 (peer_addr_for_me v1:172.21.15.159:0/0) 2023-12-17T11:47:55.928 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:55.924+0000 7f5d03fff640 1 --2- 172.21.15.159:0/1165852848 >> v2:172.21.15.40:3300/0 conn(0x7f5d0415d620 0x7f5d040d3a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:47:55.928 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:55.924+0000 7f5cfbfff640 1 -- 172.21.15.159:0/1165852848 >> v2:172.21.15.40:3300/0 conn(0x7f5d0415d620 msgr2=0x7f5d040d3a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:47:55.928 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:55.924+0000 7f5cfbfff640 1 --2- 172.21.15.159:0/1165852848 >> v2:172.21.15.40:3300/0 conn(0x7f5d0415d620 0x7f5d040d3a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:47:55.928 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:55.924+0000 7f5cfbfff640 1 -- 172.21.15.159:0/1165852848 >> v1:172.21.15.159:6789/0 conn(0x7f5d040cf810 legacy=0x7f5d040cfc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:47:55.928 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:55.924+0000 7f5d037fe640 1 -- 172.21.15.159:0/1165852848 <== mon.1 v1:172.21.15.159:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1430416045 0 0) 0x7f5d040cf130 con 0x7f5d040cf810 2023-12-17T11:47:55.928 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:55.924+0000 7f5cfbfff640 1 -- 172.21.15.159:0/1165852848 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d040d1eb0 con 0x7f5d040d1510 2023-12-17T11:47:55.928 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:55.924+0000 7f5d03fff640 1 --2- 172.21.15.159:0/1165852848 >> v2:172.21.15.40:3300/0 conn(0x7f5d0415d620 0x7f5d040d3a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-17T11:47:55.930 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:55.925+0000 7f5cfbfff640 1 --2- 172.21.15.159:0/1165852848 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5d040d1510 0x7f5d040d1970 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f5cec0097a0 tx=0x7f5cec02b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=588c22544e148b5a server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:47:55.930 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:55.926+0000 7f5d037fe640 1 -- 172.21.15.159:0/1165852848 <== mon.2 v2:172.21.15.159:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cec031830 con 0x7f5d040d1510 2023-12-17T11:47:55.930 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:55.926+0000 7f5d037fe640 1 -- 172.21.15.159:0/1165852848 <== mon.2 v2:172.21.15.159:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5cec031990 con 0x7f5d040d1510 2023-12-17T11:47:55.930 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:55.926+0000 7f5d037fe640 1 -- 172.21.15.159:0/1165852848 <== mon.2 v2:172.21.15.159:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cec031d20 con 0x7f5d040d1510 2023-12-17T11:47:55.930 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:55.926+0000 7f5d0a90f640 1 -- 172.21.15.159:0/1165852848 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5d040d1510 msgr2=0x7f5d040d1970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:47:55.930 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:55.926+0000 7f5d0a90f640 1 --2- 172.21.15.159:0/1165852848 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5d040d1510 0x7f5d040d1970 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f5cec0097a0 tx=0x7f5cec02b8d0 comp rx=0 tx=0).stop 2023-12-17T11:47:55.930 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:55.926+0000 7f5d0a90f640 1 -- 172.21.15.159:0/1165852848 shutdown_connections 2023-12-17T11:47:55.930 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:55.926+0000 7f5d0a90f640 1 --2- 172.21.15.159:0/1165852848 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5d040d1510 0x7f5d040d1970 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:47:55.930 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:55.926+0000 7f5d0a90f640 1 --2- 172.21.15.159:0/1165852848 >> v2:172.21.15.40:3300/0 conn(0x7f5d0415d620 0x7f5d040d3a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:47:55.931 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:55.926+0000 7f5d0a90f640 1 -- 172.21.15.159:0/1165852848 >> 172.21.15.159:0/1165852848 conn(0x7f5d0409c420 msgr2=0x7f5d040d30e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:47:55.931 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:55.926+0000 7f5d0a90f640 1 -- 172.21.15.159:0/1165852848 shutdown_connections 2023-12-17T11:47:55.931 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:55.926+0000 7f5d0a90f640 1 -- 172.21.15.159:0/1165852848 wait complete. 2023-12-17T11:47:55.932 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:55.928+0000 7f5d0a90f640 1 Processor -- start 2023-12-17T11:47:55.932 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:55.928+0000 7f5d0a90f640 1 -- start start 2023-12-17T11:47:55.932 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:55.929+0000 7f5d0a90f640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5d040cf810 0x7f5d04156a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:47:55.932 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:55.929+0000 7f5d0a90f640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5d040d1510 0x7f5d041f6ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:47:55.932 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:55.929+0000 7f5d0a90f640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5d0415d620 0x7f5d040c8dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:47:55.932 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:55.929+0000 7f5d0a90f640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d041f64e0 con 0x7f5d040cf810 2023-12-17T11:47:55.932 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:55.929+0000 7f5d0a90f640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d041f7430 con 0x7f5d040d1510 2023-12-17T11:47:55.932 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:55.929+0000 7f5d0a90f640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d040c9710 con 0x7f5d0415d620 2023-12-17T11:47:55.932 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:55.929+0000 7f5cfbfff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5d040d1510 0x7f5d041f6ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:47:55.932 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:55.930+0000 7f5d08eac640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5d0415d620 0x7f5d040c8dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:47:55.932 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:55.930+0000 7f5cfbfff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5d040d1510 0x7f5d041f6ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:50264/0 (socket says 172.21.15.159:50264) 2023-12-17T11:47:55.933 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:55.930+0000 7f5cfbfff640 1 -- 172.21.15.159:0/192053292 learned_addr learned my addr 172.21.15.159:0/192053292 (peer_addr_for_me v2:172.21.15.159:0/0) 2023-12-17T11:47:55.934 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:55.930+0000 7f5d03fff640 1 --2- 172.21.15.159:0/192053292 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5d040cf810 0x7f5d04156a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:47:55.934 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:55.930+0000 7f5cfbfff640 1 -- 172.21.15.159:0/192053292 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5d0415d620 msgr2=0x7f5d040c8dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:47:55.934 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:55.930+0000 7f5cfbfff640 1 --2- 172.21.15.159:0/192053292 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5d0415d620 0x7f5d040c8dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:47:55.934 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:55.930+0000 7f5cfbfff640 1 -- 172.21.15.159:0/192053292 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5d040cf810 msgr2=0x7f5d04156a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:47:55.934 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:55.930+0000 7f5cfbfff640 1 --2- 172.21.15.159:0/192053292 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5d040cf810 0x7f5d04156a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:47:55.934 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:55.930+0000 7f5cfbfff640 1 -- 172.21.15.159:0/192053292 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cec009400 con 0x7f5d040d1510 2023-12-17T11:47:55.934 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:55.930+0000 7f5d08eac640 1 --2- 172.21.15.159:0/192053292 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5d0415d620 0x7f5d040c8dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-17T11:47:55.935 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:55.930+0000 7f5cfbfff640 1 --2- 172.21.15.159:0/192053292 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5d040d1510 0x7f5d041f6ef0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f5cec0098c0 tx=0x7f5cec0046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:47:55.935 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:55.931+0000 7f5d017fa640 1 -- 172.21.15.159:0/192053292 <== mon.1 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cec03b9f0 con 0x7f5d040d1510 2023-12-17T11:47:55.935 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:55.931+0000 7f5d017fa640 1 -- 172.21.15.159:0/192053292 <== mon.1 v2:172.21.15.159:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5cec03bb70 con 0x7f5d040d1510 2023-12-17T11:47:55.935 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:55.931+0000 7f5d0a90f640 1 -- 172.21.15.159:0/192053292 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d040c99f0 con 0x7f5d040d1510 2023-12-17T11:47:55.935 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:55.931+0000 7f5d017fa640 1 -- 172.21.15.159:0/192053292 <== mon.1 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cec0453f0 con 0x7f5d040d1510 2023-12-17T11:47:55.935 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:55.931+0000 7f5d0a90f640 1 -- 172.21.15.159:0/192053292 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d041f69d0 con 0x7f5d040d1510 2023-12-17T11:47:55.935 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:55.931+0000 7f5d017fa640 1 -- 172.21.15.159:0/192053292 <== mon.1 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f5cec045850 con 0x7f5d040d1510 2023-12-17T11:47:55.935 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:55.931+0000 7f5d017fa640 1 -- 172.21.15.159:0/192053292 <== mon.1 v2:172.21.15.159:3300/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1185+0+0 (secure 0 0 0) 0x7f5cec04ecd0 con 0x7f5d040d1510 2023-12-17T11:47:55.935 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:55.932+0000 7f5d0a90f640 1 -- 172.21.15.159:0/192053292 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d040c9bb0 con 0x7f5d040d1510 2023-12-17T11:47:55.937 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:55.935+0000 7f5d017fa640 1 -- 172.21.15.159:0/192053292 <== mon.1 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7f5cec035020 con 0x7f5d040d1510 2023-12-17T11:47:55.989 INFO:tasks.ceph.mgr.y.smithi040.stderr:2023-12-17T11:47:55.987+0000 7f1e05cb0040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-12-17T11:47:56.009 INFO:tasks.ceph.mgr.x.smithi159.stderr:2023-12-17T11:47:56.006+0000 7fc300641040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-12-17T11:47:56.034 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:56.032+0000 7f5d0a90f640 1 -- 172.21.15.159:0/192053292 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "osd new", "uuid": "62a7a233-d3ea-40be-91de-180c0208d639", "id": 4} v 0) v1 -- 0x7f5d040cd510 con 0x7f5d040d1510 2023-12-17T11:47:56.042 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:56.040+0000 7f5d017fa640 1 -- 172.21.15.159:0/192053292 <== mon.1 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "62a7a233-d3ea-40be-91de-180c0208d639", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7f5cec045b00 con 0x7f5d040d1510 2023-12-17T11:47:56.042 INFO:teuthology.orchestra.run.smithi159.stdout:4 2023-12-17T11:47:56.044 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:56.041+0000 7f5d0a90f640 1 -- 172.21.15.159:0/192053292 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5d040d1510 msgr2=0x7f5d041f6ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:47:56.044 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:56.041+0000 7f5d0a90f640 1 --2- 172.21.15.159:0/192053292 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5d040d1510 0x7f5d041f6ef0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f5cec0098c0 tx=0x7f5cec0046c0 comp rx=0 tx=0).stop 2023-12-17T11:47:56.044 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:56.041+0000 7f5d0a90f640 1 -- 172.21.15.159:0/192053292 shutdown_connections 2023-12-17T11:47:56.044 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:56.041+0000 7f5d0a90f640 1 --2- 172.21.15.159:0/192053292 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5d0415d620 0x7f5d040c8dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:47:56.044 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:56.041+0000 7f5d0a90f640 1 --2- 172.21.15.159:0/192053292 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5d040d1510 0x7f5d041f6ef0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:47:56.044 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:56.041+0000 7f5d0a90f640 1 --2- 172.21.15.159:0/192053292 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5d040cf810 0x7f5d04156a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:47:56.044 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:56.041+0000 7f5d0a90f640 1 -- 172.21.15.159:0/192053292 >> 172.21.15.159:0/192053292 conn(0x7f5d0409c420 msgr2=0x7f5d040cfc70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:47:56.044 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:56.041+0000 7f5d0a90f640 1 -- 172.21.15.159:0/192053292 shutdown_connections 2023-12-17T11:47:56.044 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:56.041+0000 7f5d0a90f640 1 -- 172.21.15.159:0/192053292 wait complete. 2023-12-17T11:47:56.061 DEBUG:teuthology.orchestra.run.smithi159:> sudo ceph --cluster ceph osd new 84629cea-dc0e-4b5e-b203-5ea963839281 5 2023-12-17T11:47:56.158 INFO:tasks.ceph.mgr.y.smithi040.stderr:2023-12-17T11:47:56.156+0000 7f1e05cb0040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-12-17T11:47:56.180 INFO:tasks.ceph.mgr.x.smithi159.stderr:2023-12-17T11:47:56.177+0000 7fc300641040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-12-17T11:47:56.256 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:56.253+0000 7fcc0137c640 1 Processor -- start 2023-12-17T11:47:56.256 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:56.253+0000 7fcc0137c640 1 -- start start 2023-12-17T11:47:56.258 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:56.255+0000 7fcc0137c640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fcbfc0aecf0 0x7fcbfc15db70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:47:56.258 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:56.255+0000 7fcc0137c640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7fcbfc15e0b0 0x7fcbfc15b690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:47:56.258 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:56.255+0000 7fcc0137c640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcbfc151470 con 0x7fcbfc151090 2023-12-17T11:47:56.258 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:56.255+0000 7fcc0137c640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcbfc15e540 con 0x7fcbfc0aecf0 2023-12-17T11:47:56.258 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:56.255+0000 7fcc0137c640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcbfc0b3b20 con 0x7fcbfc15e0b0 2023-12-17T11:47:56.259 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:56.255+0000 7fcbfb7fe640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7fcbfc15e0b0 0x7fcbfc15b690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:47:56.259 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:56.255+0000 7fcbfb7fe640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7fcbfc15e0b0 0x7fcbfc15b690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:50268/0 (socket says 172.21.15.159:50268) 2023-12-17T11:47:56.259 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:56.255+0000 7fcbfb7fe640 1 -- 172.21.15.159:0/4279560069 learned_addr learned my addr 172.21.15.159:0/4279560069 (peer_addr_for_me v2:172.21.15.159:0/0) 2023-12-17T11:47:56.259 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:56.256+0000 7fcbfb7fe640 1 -- 172.21.15.159:0/4279560069 >> v2:172.21.15.40:3300/0 conn(0x7fcbfc0aecf0 msgr2=0x7fcbfc15db70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:47:56.259 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:56.256+0000 7fcbf3fff640 1 --2- 172.21.15.159:0/4279560069 >> v2:172.21.15.40:3300/0 conn(0x7fcbfc0aecf0 0x7fcbfc15db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:47:56.259 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:56.256+0000 7fcbfb7fe640 1 --2- 172.21.15.159:0/4279560069 >> v2:172.21.15.40:3300/0 conn(0x7fcbfc0aecf0 0x7fcbfc15db70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:47:56.259 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:56.256+0000 7fcbfb7fe640 1 -- 172.21.15.159:0/4279560069 >> v1:172.21.15.40:6789/0 conn(0x7fcbfc151090 legacy=0x7fcbfc0b43e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:47:56.259 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:56.256+0000 7fcbfb7fe640 1 -- 172.21.15.159:0/4279560069 --> v2:172.21.15.159:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbfc0b2f70 con 0x7fcbfc15e0b0 2023-12-17T11:47:56.260 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:56.257+0000 7fcbfb7fe640 1 --2- 172.21.15.159:0/4279560069 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcbfc15e0b0 0x7fcbfc15b690 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fcbfc071cb0 tx=0x7fcbf402be50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=139e2ce49cb23d53 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:47:56.260 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:56.257+0000 7fcbfa7fc640 1 -- 172.21.15.159:0/4279560069 <== mon.1 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbf402c9f0 con 0x7fcbfc15e0b0 2023-12-17T11:47:56.260 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:56.257+0000 7fcbfa7fc640 1 -- 172.21.15.159:0/4279560069 <== mon.1 v2:172.21.15.159:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbf402cb50 con 0x7fcbfc15e0b0 2023-12-17T11:47:56.260 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:56.257+0000 7fcbfa7fc640 1 -- 172.21.15.159:0/4279560069 <== mon.1 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbf40343f0 con 0x7fcbfc15e0b0 2023-12-17T11:47:56.260 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:56.258+0000 7fcc0137c640 1 -- 172.21.15.159:0/4279560069 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcbfc15e0b0 msgr2=0x7fcbfc15b690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:47:56.260 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:56.258+0000 7fcc0137c640 1 --2- 172.21.15.159:0/4279560069 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcbfc15e0b0 0x7fcbfc15b690 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fcbfc071cb0 tx=0x7fcbf402be50 comp rx=0 tx=0).stop 2023-12-17T11:47:56.261 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:56.258+0000 7fcc0137c640 1 -- 172.21.15.159:0/4279560069 shutdown_connections 2023-12-17T11:47:56.261 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:56.258+0000 7fcc0137c640 1 --2- 172.21.15.159:0/4279560069 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcbfc15e0b0 0x7fcbfc15b690 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:47:56.261 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:56.258+0000 7fcc0137c640 1 --2- 172.21.15.159:0/4279560069 >> v2:172.21.15.40:3300/0 conn(0x7fcbfc0aecf0 0x7fcbfc15db70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:47:56.261 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:56.258+0000 7fcc0137c640 1 -- 172.21.15.159:0/4279560069 >> 172.21.15.159:0/4279560069 conn(0x7fcbfc0cf7a0 msgr2=0x7fcbfc0cfbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:47:56.261 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:56.258+0000 7fcc0137c640 1 -- 172.21.15.159:0/4279560069 shutdown_connections 2023-12-17T11:47:56.261 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:56.258+0000 7fcc0137c640 1 -- 172.21.15.159:0/4279560069 wait complete. 2023-12-17T11:47:56.262 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:56.259+0000 7fcc0137c640 1 Processor -- start 2023-12-17T11:47:56.262 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:56.260+0000 7fcc0137c640 1 -- start start 2023-12-17T11:47:56.264 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:56.260+0000 7fcc0137c640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcbfc0aecf0 0x7fcbfc152270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:47:56.264 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:56.261+0000 7fcc0137c640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcbfc151090 0x7fcbfc1f3080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:47:56.264 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:56.261+0000 7fcc0137c640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fcbfc15e0b0 0x7fcbfc153ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:47:56.264 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:56.261+0000 7fcc0137c640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbfc0cd8e0 con 0x7fcbfc151090 2023-12-17T11:47:56.264 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:56.261+0000 7fcc0137c640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbfc0cdbc0 con 0x7fcbfc0aecf0 2023-12-17T11:47:56.264 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:56.261+0000 7fcc0137c640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcbfc0cdea0 con 0x7fcbfc15e0b0 2023-12-17T11:47:56.264 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:56.261+0000 7fcbfaffd640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcbfc0aecf0 0x7fcbfc152270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:47:56.264 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:56.261+0000 7fcbfaffd640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcbfc0aecf0 0x7fcbfc152270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:50284/0 (socket says 172.21.15.159:50284) 2023-12-17T11:47:56.264 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:56.261+0000 7fcbfaffd640 1 -- 172.21.15.159:0/3174163560 learned_addr learned my addr 172.21.15.159:0/3174163560 (peer_addr_for_me v2:172.21.15.159:0/0) 2023-12-17T11:47:56.264 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:56.261+0000 7fcbfb7fe640 1 --2- 172.21.15.159:0/3174163560 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fcbfc15e0b0 0x7fcbfc153ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:47:56.265 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:56.261+0000 7fcbf3fff640 1 --2- 172.21.15.159:0/3174163560 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcbfc151090 0x7fcbfc1f3080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:47:56.265 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:56.261+0000 7fcbfaffd640 1 -- 172.21.15.159:0/3174163560 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fcbfc15e0b0 msgr2=0x7fcbfc153ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:47:56.265 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:56.261+0000 7fcbfaffd640 1 --2- 172.21.15.159:0/3174163560 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fcbfc15e0b0 0x7fcbfc153ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:47:56.265 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:56.261+0000 7fcbfaffd640 1 -- 172.21.15.159:0/3174163560 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcbfc151090 msgr2=0x7fcbfc1f3080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:47:56.265 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:56.261+0000 7fcbfaffd640 1 --2- 172.21.15.159:0/3174163560 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcbfc151090 0x7fcbfc1f3080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:47:56.265 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:56.261+0000 7fcbfaffd640 1 -- 172.21.15.159:0/3174163560 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbf4009b30 con 0x7fcbfc0aecf0 2023-12-17T11:47:56.265 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:56.261+0000 7fcbfaffd640 1 --2- 172.21.15.159:0/3174163560 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcbfc0aecf0 0x7fcbfc152270 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fcbec00c410 tx=0x7fcbec00c8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:47:56.266 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:56.262+0000 7fcbf37fe640 1 -- 172.21.15.159:0/3174163560 <== mon.1 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbec0035f0 con 0x7fcbfc0aecf0 2023-12-17T11:47:56.266 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:56.262+0000 7fcbf37fe640 1 -- 172.21.15.159:0/3174163560 <== mon.1 v2:172.21.15.159:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbec003750 con 0x7fcbfc0aecf0 2023-12-17T11:47:56.266 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:56.262+0000 7fcc0137c640 1 -- 172.21.15.159:0/3174163560 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcbfc0ce180 con 0x7fcbfc0aecf0 2023-12-17T11:47:56.266 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:56.262+0000 7fcbf37fe640 1 -- 172.21.15.159:0/3174163560 <== mon.1 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbec003b40 con 0x7fcbfc0aecf0 2023-12-17T11:47:56.266 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:56.262+0000 7fcc0137c640 1 -- 172.21.15.159:0/3174163560 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcbfc0cd500 con 0x7fcbfc0aecf0 2023-12-17T11:47:56.266 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:56.262+0000 7fcbf37fe640 1 -- 172.21.15.159:0/3174163560 <== mon.1 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fcbec007020 con 0x7fcbfc0aecf0 2023-12-17T11:47:56.266 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:56.262+0000 7fcbf37fe640 1 -- 172.21.15.159:0/3174163560 <== mon.1 v2:172.21.15.159:3300/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1300+0+0 (secure 0 0 0) 0x7fcbec006790 con 0x7fcbfc0aecf0 2023-12-17T11:47:56.266 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:56.263+0000 7fcc0137c640 1 -- 172.21.15.159:0/3174163560 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcbfc0673f0 con 0x7fcbfc0aecf0 2023-12-17T11:47:56.267 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:56.265+0000 7fcbf37fe640 1 -- 172.21.15.159:0/3174163560 <== mon.1 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7fcbec017070 con 0x7fcbfc0aecf0 2023-12-17T11:47:56.297 INFO:tasks.ceph.mgr.y.smithi040.stderr:2023-12-17T11:47:56.295+0000 7f1e05cb0040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-12-17T11:47:56.316 INFO:tasks.ceph.mgr.x.smithi159.stderr:2023-12-17T11:47:56.313+0000 7fc300641040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-12-17T11:47:56.346 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:56.343+0000 7fcc0137c640 1 -- 172.21.15.159:0/3174163560 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "osd new", "uuid": "84629cea-dc0e-4b5e-b203-5ea963839281", "id": 5} v 0) v1 -- 0x7fcbfc06bb10 con 0x7fcbfc0aecf0 2023-12-17T11:47:56.352 INFO:tasks.ceph.mgr.y.smithi040.stderr:2023-12-17T11:47:56.350+0000 7f1e05cb0040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-12-17T11:47:56.353 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:56.350+0000 7fcbf37fe640 1 -- 172.21.15.159:0/3174163560 <== mon.1 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "84629cea-dc0e-4b5e-b203-5ea963839281", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7fcbec006ba0 con 0x7fcbfc0aecf0 2023-12-17T11:47:56.353 INFO:teuthology.orchestra.run.smithi159.stdout:5 2023-12-17T11:47:56.354 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:56.352+0000 7fcc0137c640 1 -- 172.21.15.159:0/3174163560 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcbfc0aecf0 msgr2=0x7fcbfc152270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:47:56.354 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:56.352+0000 7fcc0137c640 1 --2- 172.21.15.159:0/3174163560 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcbfc0aecf0 0x7fcbfc152270 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fcbec00c410 tx=0x7fcbec00c8d0 comp rx=0 tx=0).stop 2023-12-17T11:47:56.354 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:56.352+0000 7fcc0137c640 1 -- 172.21.15.159:0/3174163560 shutdown_connections 2023-12-17T11:47:56.355 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:56.352+0000 7fcc0137c640 1 --2- 172.21.15.159:0/3174163560 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fcbfc15e0b0 0x7fcbfc153ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:47:56.355 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:56.352+0000 7fcc0137c640 1 --2- 172.21.15.159:0/3174163560 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcbfc151090 0x7fcbfc1f3080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:47:56.355 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:56.352+0000 7fcc0137c640 1 --2- 172.21.15.159:0/3174163560 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcbfc0aecf0 0x7fcbfc152270 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:47:56.355 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:56.352+0000 7fcc0137c640 1 -- 172.21.15.159:0/3174163560 >> 172.21.15.159:0/3174163560 conn(0x7fcbfc0cf7a0 msgr2=0x7fcbfc0cfb80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:47:56.355 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:56.352+0000 7fcc0137c640 1 -- 172.21.15.159:0/3174163560 shutdown_connections 2023-12-17T11:47:56.355 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:56.352+0000 7fcc0137c640 1 -- 172.21.15.159:0/3174163560 wait complete. 2023-12-17T11:47:56.370 DEBUG:teuthology.orchestra.run.smithi159:> sudo ceph --cluster ceph osd new 4ae3af3a-1743-4070-a91d-8be5c31cdb04 6 2023-12-17T11:47:56.379 INFO:tasks.ceph.mgr.x.smithi159.stderr:2023-12-17T11:47:56.371+0000 7fc300641040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-12-17T11:47:56.468 INFO:tasks.ceph.mgr.y.smithi040.stderr:2023-12-17T11:47:56.465+0000 7f1e05cb0040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-12-17T11:47:56.491 INFO:tasks.ceph.mgr.x.smithi159.stderr:2023-12-17T11:47:56.488+0000 7fc300641040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-12-17T11:47:56.565 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:56.562+0000 7f90cf59e640 1 Processor -- start 2023-12-17T11:47:56.565 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:56.562+0000 7f90cf59e640 1 -- start start 2023-12-17T11:47:56.566 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:56.564+0000 7f90cf59e640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f90d00b3350 0x7f90d00b3ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:47:56.566 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:56.564+0000 7f90cf59e640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90d00c6b80 con 0x7f90d00cfe70 2023-12-17T11:47:56.566 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:56.564+0000 7f90cf59e640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90d00d3bf0 con 0x7f90d00b3730 2023-12-17T11:47:56.567 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:56.564+0000 7f90cf59e640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90d00d3ed0 con 0x7f90d00b3350 2023-12-17T11:47:56.567 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:56.564+0000 7f90ce59c640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f90d00b3350 0x7f90d00b3ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:47:56.567 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:56.564+0000 7f90cdd9b640 1 --1- >> v1:172.21.15.159:6789/0 conn(0x7f90d00b3730 0x7f90d00cf760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.159:6789/0 says I am v1:172.21.15.159:53734/0 (socket says 172.21.15.159:53734) 2023-12-17T11:47:56.567 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:56.564+0000 7f90cdd9b640 1 -- 172.21.15.159:0/316725024 learned_addr learned my addr 172.21.15.159:0/316725024 (peer_addr_for_me v1:172.21.15.159:0/0) 2023-12-17T11:47:56.568 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:56.564+0000 7f90cd59a640 1 -- 172.21.15.159:0/316725024 <== mon.1 v1:172.21.15.159:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1641656449 0 0) 0x7f90d00d3bf0 con 0x7f90d00b3730 2023-12-17T11:47:56.568 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:56.565+0000 7f90cd59a640 1 -- 172.21.15.159:0/316725024 --> v1:172.21.15.159:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f90b8003520 con 0x7f90d00b3730 2023-12-17T11:47:56.568 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:56.565+0000 7f90ce59c640 1 -- 172.21.15.159:0/316725024 >> v1:172.21.15.159:6789/0 conn(0x7f90d00b3730 legacy=0x7f90d00cf760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:47:56.568 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:56.565+0000 7f90ce59c640 1 -- 172.21.15.159:0/316725024 >> v1:172.21.15.40:6789/0 conn(0x7f90d00cfe70 legacy=0x7f90d00cdef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:47:56.568 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:56.565+0000 7f90ce59c640 1 -- 172.21.15.159:0/316725024 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90d00d18c0 con 0x7f90d00b3350 2023-12-17T11:47:56.569 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:56.566+0000 7f90ce59c640 1 --2- 172.21.15.159:0/316725024 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f90d00b3350 0x7f90d00b3ba0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f90c00097d0 tx=0x7f90c002b930 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8734d1dc9caad578 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:47:56.569 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:56.567+0000 7f90cd59a640 1 -- 172.21.15.159:0/316725024 <== mon.2 v2:172.21.15.159:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90c0031890 con 0x7f90d00b3350 2023-12-17T11:47:56.569 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:56.567+0000 7f90cd59a640 1 -- 172.21.15.159:0/316725024 <== mon.2 v2:172.21.15.159:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90c00319f0 con 0x7f90d00b3350 2023-12-17T11:47:56.569 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:56.567+0000 7f90cd59a640 1 -- 172.21.15.159:0/316725024 <== mon.2 v2:172.21.15.159:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90c0031d80 con 0x7f90d00b3350 2023-12-17T11:47:56.570 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:56.567+0000 7f90cf59e640 1 -- 172.21.15.159:0/316725024 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f90d00b3350 msgr2=0x7f90d00b3ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:47:56.570 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:56.567+0000 7f90cf59e640 1 --2- 172.21.15.159:0/316725024 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f90d00b3350 0x7f90d00b3ba0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f90c00097d0 tx=0x7f90c002b930 comp rx=0 tx=0).stop 2023-12-17T11:47:56.570 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:56.568+0000 7f90cf59e640 1 -- 172.21.15.159:0/316725024 shutdown_connections 2023-12-17T11:47:56.570 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:56.568+0000 7f90cf59e640 1 --2- 172.21.15.159:0/316725024 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f90d00b3350 0x7f90d00b3ba0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:47:56.571 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:56.568+0000 7f90cf59e640 1 -- 172.21.15.159:0/316725024 >> 172.21.15.159:0/316725024 conn(0x7f90d00d3030 msgr2=0x7f90d00d3440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:47:56.571 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:56.568+0000 7f90cf59e640 1 -- 172.21.15.159:0/316725024 shutdown_connections 2023-12-17T11:47:56.571 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:56.568+0000 7f90cf59e640 1 -- 172.21.15.159:0/316725024 wait complete. 2023-12-17T11:47:56.572 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:56.569+0000 7f90cf59e640 1 Processor -- start 2023-12-17T11:47:56.572 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:56.569+0000 7f90cf59e640 1 -- start start 2023-12-17T11:47:56.574 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:56.570+0000 7f90cf59e640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f90d00b3350 0x7f90d006b740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:47:56.575 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:56.570+0000 7f90cf59e640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f90d00b3730 0x7f90d00b1550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:47:56.575 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:56.570+0000 7f90cf59e640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f90d00cfe70 0x7f90d00cc500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:47:56.575 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:56.570+0000 7f90cf59e640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90d00b2bb0 con 0x7f90d00b3730 2023-12-17T11:47:56.575 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:56.570+0000 7f90cf59e640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90d00b2030 con 0x7f90d00cfe70 2023-12-17T11:47:56.575 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:56.570+0000 7f90cf59e640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90d00b2310 con 0x7f90d00b3350 2023-12-17T11:47:56.575 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:56.571+0000 7f90ce59c640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f90d00b3350 0x7f90d006b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:47:56.575 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:56.571+0000 7f90ce59c640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f90d00b3350 0x7f90d006b740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3301/0 says I am v2:172.21.15.159:35476/0 (socket says 172.21.15.159:35476) 2023-12-17T11:47:56.575 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:56.571+0000 7f90ce59c640 1 -- 172.21.15.159:0/2733999449 learned_addr learned my addr 172.21.15.159:0/2733999449 (peer_addr_for_me v2:172.21.15.159:0/0) 2023-12-17T11:47:56.575 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:56.571+0000 7f90ced9d640 1 --2- 172.21.15.159:0/2733999449 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f90d00cfe70 0x7f90d00cc500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:47:56.575 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:56.571+0000 7f90cdd9b640 1 --2- 172.21.15.159:0/2733999449 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f90d00b3730 0x7f90d00b1550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:47:56.575 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:56.571+0000 7f90ce59c640 1 -- 172.21.15.159:0/2733999449 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f90d00cfe70 msgr2=0x7f90d00cc500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:47:56.575 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:56.571+0000 7f90ce59c640 1 --2- 172.21.15.159:0/2733999449 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f90d00cfe70 0x7f90d00cc500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:47:56.576 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:56.571+0000 7f90ce59c640 1 -- 172.21.15.159:0/2733999449 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f90d00b3730 msgr2=0x7f90d00b1550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:47:56.576 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:56.571+0000 7f90ce59c640 1 --2- 172.21.15.159:0/2733999449 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f90d00b3730 0x7f90d00b1550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:47:56.576 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:56.571+0000 7f90ce59c640 1 -- 172.21.15.159:0/2733999449 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90c0009400 con 0x7f90d00b3350 2023-12-17T11:47:56.576 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:56.571+0000 7f90cdd9b640 1 --2- 172.21.15.159:0/2733999449 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f90d00b3730 0x7f90d00b1550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-17T11:47:56.576 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:56.571+0000 7f90ce59c640 1 --2- 172.21.15.159:0/2733999449 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f90d00b3350 0x7f90d006b740 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f90c00098f0 tx=0x7f90c00046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:47:56.576 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:56.572+0000 7f90beffd640 1 -- 172.21.15.159:0/2733999449 <== mon.2 v2:172.21.15.159:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90c003bd30 con 0x7f90d00b3350 2023-12-17T11:47:56.576 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:56.572+0000 7f90beffd640 1 -- 172.21.15.159:0/2733999449 <== mon.2 v2:172.21.15.159:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90c003be90 con 0x7f90d00b3350 2023-12-17T11:47:56.576 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:56.572+0000 7f90beffd640 1 -- 172.21.15.159:0/2733999449 <== mon.2 v2:172.21.15.159:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90c0045630 con 0x7f90d00b3350 2023-12-17T11:47:56.576 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:56.572+0000 7f90cf59e640 1 -- 172.21.15.159:0/2733999449 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90d00b48a0 con 0x7f90d00b3350 2023-12-17T11:47:56.576 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:56.572+0000 7f90cf59e640 1 -- 172.21.15.159:0/2733999449 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90d00b28d0 con 0x7f90d00b3350 2023-12-17T11:47:56.576 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:56.572+0000 7f90beffd640 1 -- 172.21.15.159:0/2733999449 <== mon.2 v2:172.21.15.159:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f90c0045a90 con 0x7f90d00b3350 2023-12-17T11:47:56.576 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:56.572+0000 7f90beffd640 1 -- 172.21.15.159:0/2733999449 <== mon.2 v2:172.21.15.159:3301/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1415+0+0 (secure 0 0 0) 0x7f90c00309d0 con 0x7f90d00b3350 2023-12-17T11:47:56.577 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:56.573+0000 7f90cf59e640 1 -- 172.21.15.159:0/2733999449 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90d0074450 con 0x7f90d00b3350 2023-12-17T11:47:56.578 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:56.575+0000 7f90beffd640 1 -- 172.21.15.159:0/2733999449 <== mon.2 v2:172.21.15.159:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7f90c0035020 con 0x7f90d00b3350 2023-12-17T11:47:56.583 INFO:tasks.ceph.mgr.y.smithi040.stderr:2023-12-17T11:47:56.582+0000 7f1e05cb0040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-12-17T11:47:56.610 INFO:tasks.ceph.mgr.x.smithi159.stderr:2023-12-17T11:47:56.607+0000 7fc300641040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-12-17T11:47:56.656 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:56.654+0000 7f90cf59e640 1 -- 172.21.15.159:0/2733999449 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_command({"prefix": "osd new", "uuid": "4ae3af3a-1743-4070-a91d-8be5c31cdb04", "id": 6} v 0) v1 -- 0x7f90d0072830 con 0x7f90d00b3350 2023-12-17T11:47:56.664 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:56.662+0000 7f90beffd640 1 -- 172.21.15.159:0/2733999449 <== mon.2 v2:172.21.15.159:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "4ae3af3a-1743-4070-a91d-8be5c31cdb04", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7f90c0030c30 con 0x7f90d00b3350 2023-12-17T11:47:56.665 INFO:teuthology.orchestra.run.smithi159.stdout:6 2023-12-17T11:47:56.666 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:56.663+0000 7f90cf59e640 1 -- 172.21.15.159:0/2733999449 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f90d00b3350 msgr2=0x7f90d006b740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:47:56.666 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:56.663+0000 7f90cf59e640 1 --2- 172.21.15.159:0/2733999449 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f90d00b3350 0x7f90d006b740 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f90c00098f0 tx=0x7f90c00046c0 comp rx=0 tx=0).stop 2023-12-17T11:47:56.666 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:56.663+0000 7f90cf59e640 1 -- 172.21.15.159:0/2733999449 shutdown_connections 2023-12-17T11:47:56.666 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:56.663+0000 7f90cf59e640 1 --2- 172.21.15.159:0/2733999449 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f90d00cfe70 0x7f90d00cc500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:47:56.666 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:56.663+0000 7f90cf59e640 1 --2- 172.21.15.159:0/2733999449 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f90d00b3730 0x7f90d00b1550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:47:56.666 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:56.663+0000 7f90cf59e640 1 --2- 172.21.15.159:0/2733999449 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f90d00b3350 0x7f90d006b740 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:47:56.666 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:56.663+0000 7f90cf59e640 1 -- 172.21.15.159:0/2733999449 >> 172.21.15.159:0/2733999449 conn(0x7f90d00d3030 msgr2=0x7f90d00d3410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:47:56.667 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:56.664+0000 7f90cf59e640 1 -- 172.21.15.159:0/2733999449 shutdown_connections 2023-12-17T11:47:56.667 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:56.664+0000 7f90cf59e640 1 -- 172.21.15.159:0/2733999449 wait complete. 2023-12-17T11:47:56.681 DEBUG:teuthology.orchestra.run.smithi159:> sudo ceph --cluster ceph osd new c1f4c7f2-8f75-4f95-bc63-a332773e3b8e 7 2023-12-17T11:47:56.751 INFO:tasks.ceph.mgr.y.smithi040.stderr:2023-12-17T11:47:56.749+0000 7f1e05cb0040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-12-17T11:47:56.781 INFO:tasks.ceph.mgr.x.smithi159.stderr:2023-12-17T11:47:56.778+0000 7fc300641040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-12-17T11:47:56.802 INFO:tasks.ceph.mgr.y.smithi040.stderr:2023-12-17T11:47:56.800+0000 7f1e05cb0040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-12-17T11:47:56.833 INFO:tasks.ceph.mgr.x.smithi159.stderr:2023-12-17T11:47:56.830+0000 7fc300641040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-12-17T11:47:56.864 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:56.861+0000 7f4b5f59e640 1 Processor -- start 2023-12-17T11:47:56.864 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:56.861+0000 7f4b5f59e640 1 -- start start 2023-12-17T11:47:56.865 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:56.863+0000 7f4b5f59e640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f4b600b8970 0x7f4b600d1230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:47:56.866 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:56.863+0000 7f4b5f59e640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f4b600cdc10 0x7f4b600ce0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:47:56.866 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:56.863+0000 7f4b5f59e640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b600b74d0 con 0x7f4b6015d1f0 2023-12-17T11:47:56.866 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:56.863+0000 7f4b5f59e640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b600b68e0 con 0x7f4b600b8970 2023-12-17T11:47:56.866 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:56.863+0000 7f4b5f59e640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b600b6ba0 con 0x7f4b600cdc10 2023-12-17T11:47:56.866 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:56.863+0000 7f4b5e59c640 1 --1- >> v1:172.21.15.159:6789/0 conn(0x7f4b6015d1f0 0x7f4b600d0b20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.159:6789/0 says I am v1:172.21.15.159:53736/0 (socket says 172.21.15.159:53736) 2023-12-17T11:47:56.866 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:56.863+0000 7f4b5e59c640 1 -- 172.21.15.159:0/3335354785 learned_addr learned my addr 172.21.15.159:0/3335354785 (peer_addr_for_me v1:172.21.15.159:0/0) 2023-12-17T11:47:56.866 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:56.863+0000 7f4b5ed9d640 1 --2- 172.21.15.159:0/3335354785 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f4b600cdc10 0x7f4b600ce0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:47:56.866 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:56.863+0000 7f4b57fff640 1 --2- 172.21.15.159:0/3335354785 >> v2:172.21.15.159:3300/0 conn(0x7f4b600b8970 0x7f4b600d1230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:47:56.867 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:56.864+0000 7f4b5ed9d640 1 -- 172.21.15.159:0/3335354785 >> v2:172.21.15.159:3300/0 conn(0x7f4b600b8970 msgr2=0x7f4b600d1230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:47:56.867 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:56.864+0000 7f4b5ed9d640 1 --2- 172.21.15.159:0/3335354785 >> v2:172.21.15.159:3300/0 conn(0x7f4b600b8970 0x7f4b600d1230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:47:56.867 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:56.864+0000 7f4b5dd9b640 1 -- 172.21.15.159:0/3335354785 <== mon.1 v1:172.21.15.159:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2373488524 0 0) 0x7f4b600b74d0 con 0x7f4b6015d1f0 2023-12-17T11:47:56.867 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:56.864+0000 7f4b5ed9d640 1 -- 172.21.15.159:0/3335354785 >> v1:172.21.15.159:6789/0 conn(0x7f4b6015d1f0 legacy=0x7f4b600d0b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:47:56.867 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:56.864+0000 7f4b5ed9d640 1 -- 172.21.15.159:0/3335354785 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b600b6e80 con 0x7f4b600cdc10 2023-12-17T11:47:56.867 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:56.865+0000 7f4b5ed9d640 1 --2- 172.21.15.159:0/3335354785 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f4b600cdc10 0x7f4b600ce0a0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f4b58009d90 tx=0x7f4b5802bea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=475dfd5a39d199d1 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:47:56.868 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:56.866+0000 7f4b5dd9b640 1 -- 172.21.15.159:0/3335354785 <== mon.2 v2:172.21.15.159:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b5802cc50 con 0x7f4b600cdc10 2023-12-17T11:47:56.868 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:56.866+0000 7f4b5dd9b640 1 -- 172.21.15.159:0/3335354785 <== mon.2 v2:172.21.15.159:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b5802cdb0 con 0x7f4b600cdc10 2023-12-17T11:47:56.868 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:56.866+0000 7f4b5dd9b640 1 -- 172.21.15.159:0/3335354785 <== mon.2 v2:172.21.15.159:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b58034660 con 0x7f4b600cdc10 2023-12-17T11:47:56.869 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:56.866+0000 7f4b5f59e640 1 -- 172.21.15.159:0/3335354785 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f4b600cdc10 msgr2=0x7f4b600ce0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:47:56.869 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:56.866+0000 7f4b5f59e640 1 --2- 172.21.15.159:0/3335354785 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f4b600cdc10 0x7f4b600ce0a0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f4b58009d90 tx=0x7f4b5802bea0 comp rx=0 tx=0).stop 2023-12-17T11:47:56.869 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:56.866+0000 7f4b5f59e640 1 -- 172.21.15.159:0/3335354785 shutdown_connections 2023-12-17T11:47:56.869 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:56.866+0000 7f4b5f59e640 1 --2- 172.21.15.159:0/3335354785 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f4b600cdc10 0x7f4b600ce0a0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:47:56.869 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:56.866+0000 7f4b5f59e640 1 --2- 172.21.15.159:0/3335354785 >> v2:172.21.15.159:3300/0 conn(0x7f4b600b8970 0x7f4b600d1230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:47:56.870 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:56.866+0000 7f4b5f59e640 1 -- 172.21.15.159:0/3335354785 >> 172.21.15.159:0/3335354785 conn(0x7f4b600d2fe0 msgr2=0x7f4b600d33f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:47:56.870 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:56.866+0000 7f4b5f59e640 1 -- 172.21.15.159:0/3335354785 shutdown_connections 2023-12-17T11:47:56.870 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:56.866+0000 7f4b5f59e640 1 -- 172.21.15.159:0/3335354785 wait complete. 2023-12-17T11:47:56.870 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:56.868+0000 7f4b5f59e640 1 Processor -- start 2023-12-17T11:47:56.871 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:56.868+0000 7f4b5f59e640 1 -- start start 2023-12-17T11:47:56.873 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:56.869+0000 7f4b5f59e640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4b600b8970 0x7f4b600a0650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:47:56.873 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:56.869+0000 7f4b5f59e640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4b600cdc10 0x7f4b6009cce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:47:56.873 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:56.869+0000 7f4b5f59e640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f4b6015d1f0 0x7f4b601f5fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:47:56.873 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:56.869+0000 7f4b5f59e640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b600cca40 con 0x7f4b600b8970 2023-12-17T11:47:56.874 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:56.869+0000 7f4b5f59e640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b600ccfc0 con 0x7f4b600cdc10 2023-12-17T11:47:56.874 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:56.869+0000 7f4b5f59e640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b600a0b90 con 0x7f4b6015d1f0 2023-12-17T11:47:56.874 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:56.869+0000 7f4b57fff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4b600cdc10 0x7f4b6009cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:47:56.874 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:56.870+0000 7f4b57fff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4b600cdc10 0x7f4b6009cce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:50316/0 (socket says 172.21.15.159:50316) 2023-12-17T11:47:56.874 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:56.870+0000 7f4b57fff640 1 -- 172.21.15.159:0/1380858269 learned_addr learned my addr 172.21.15.159:0/1380858269 (peer_addr_for_me v2:172.21.15.159:0/0) 2023-12-17T11:47:56.874 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:56.870+0000 7f4b5ed9d640 1 --2- 172.21.15.159:0/1380858269 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f4b6015d1f0 0x7f4b601f5fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:47:56.874 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:56.870+0000 7f4b5e59c640 1 --2- 172.21.15.159:0/1380858269 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4b600b8970 0x7f4b600a0650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:47:56.874 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:56.870+0000 7f4b57fff640 1 -- 172.21.15.159:0/1380858269 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f4b6015d1f0 msgr2=0x7f4b601f5fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:47:56.874 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:56.870+0000 7f4b57fff640 1 --2- 172.21.15.159:0/1380858269 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f4b6015d1f0 0x7f4b601f5fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:47:56.874 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:56.870+0000 7f4b57fff640 1 -- 172.21.15.159:0/1380858269 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4b600b8970 msgr2=0x7f4b600a0650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:47:56.874 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:56.870+0000 7f4b57fff640 1 --2- 172.21.15.159:0/1380858269 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4b600b8970 0x7f4b600a0650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:47:56.874 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:56.870+0000 7f4b57fff640 1 -- 172.21.15.159:0/1380858269 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b58009a70 con 0x7f4b600cdc10 2023-12-17T11:47:56.874 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:56.870+0000 7f4b5e59c640 1 --2- 172.21.15.159:0/1380858269 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4b600b8970 0x7f4b600a0650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-17T11:47:56.875 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:56.870+0000 7f4b57fff640 1 --2- 172.21.15.159:0/1380858269 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4b600cdc10 0x7f4b6009cce0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f4b4800e9b0 tx=0x7f4b4800ee70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:47:56.875 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:56.870+0000 7f4b56ffd640 1 -- 172.21.15.159:0/1380858269 <== mon.1 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b48009670 con 0x7f4b600cdc10 2023-12-17T11:47:56.875 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:56.870+0000 7f4b56ffd640 1 -- 172.21.15.159:0/1380858269 <== mon.1 v2:172.21.15.159:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b4800c9a0 con 0x7f4b600cdc10 2023-12-17T11:47:56.875 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:56.870+0000 7f4b56ffd640 1 -- 172.21.15.159:0/1380858269 <== mon.1 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b4800cd50 con 0x7f4b600cdc10 2023-12-17T11:47:56.875 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:56.871+0000 7f4b5f59e640 1 -- 172.21.15.159:0/1380858269 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b600ccce0 con 0x7f4b600cdc10 2023-12-17T11:47:56.875 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:56.871+0000 7f4b5f59e640 1 -- 172.21.15.159:0/1380858269 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b600cb990 con 0x7f4b600cdc10 2023-12-17T11:47:56.875 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:56.871+0000 7f4b56ffd640 1 -- 172.21.15.159:0/1380858269 <== mon.1 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f4b48005c90 con 0x7f4b600cdc10 2023-12-17T11:47:56.875 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:56.871+0000 7f4b56ffd640 1 -- 172.21.15.159:0/1380858269 <== mon.1 v2:172.21.15.159:3300/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1530+0+0 (secure 0 0 0) 0x7f4b48013ad0 con 0x7f4b600cdc10 2023-12-17T11:47:56.875 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:56.872+0000 7f4b5f59e640 1 -- 172.21.15.159:0/1380858269 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b600673f0 con 0x7f4b600cdc10 2023-12-17T11:47:56.876 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:56.874+0000 7f4b56ffd640 1 -- 172.21.15.159:0/1380858269 <== mon.1 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7f4b48021060 con 0x7f4b600cdc10 2023-12-17T11:47:56.955 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:56.953+0000 7f4b5f59e640 1 -- 172.21.15.159:0/1380858269 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "osd new", "uuid": "c1f4c7f2-8f75-4f95-bc63-a332773e3b8e", "id": 7} v 0) v1 -- 0x7f4b60073be0 con 0x7f4b600cdc10 2023-12-17T11:47:56.963 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:56.960+0000 7f4b56ffd640 1 -- 172.21.15.159:0/1380858269 <== mon.1 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "c1f4c7f2-8f75-4f95-bc63-a332773e3b8e", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7f4b48017070 con 0x7f4b600cdc10 2023-12-17T11:47:56.963 INFO:teuthology.orchestra.run.smithi159.stdout:7 2023-12-17T11:47:56.964 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:56.961+0000 7f4b5f59e640 1 -- 172.21.15.159:0/1380858269 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4b600cdc10 msgr2=0x7f4b6009cce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:47:56.964 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:56.961+0000 7f4b5f59e640 1 --2- 172.21.15.159:0/1380858269 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4b600cdc10 0x7f4b6009cce0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f4b4800e9b0 tx=0x7f4b4800ee70 comp rx=0 tx=0).stop 2023-12-17T11:47:56.964 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:56.961+0000 7f4b5f59e640 1 -- 172.21.15.159:0/1380858269 shutdown_connections 2023-12-17T11:47:56.965 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:56.961+0000 7f4b5f59e640 1 --2- 172.21.15.159:0/1380858269 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f4b6015d1f0 0x7f4b601f5fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:47:56.965 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:56.961+0000 7f4b5f59e640 1 --2- 172.21.15.159:0/1380858269 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4b600cdc10 0x7f4b6009cce0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:47:56.965 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:56.961+0000 7f4b5f59e640 1 --2- 172.21.15.159:0/1380858269 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4b600b8970 0x7f4b600a0650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:47:56.965 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:56.961+0000 7f4b5f59e640 1 -- 172.21.15.159:0/1380858269 >> 172.21.15.159:0/1380858269 conn(0x7f4b600d2fe0 msgr2=0x7f4b6015c5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:47:56.965 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:56.962+0000 7f4b5f59e640 1 -- 172.21.15.159:0/1380858269 shutdown_connections 2023-12-17T11:47:56.965 INFO:teuthology.orchestra.run.smithi159.stderr:2023-12-17T11:47:56.962+0000 7f4b5f59e640 1 -- 172.21.15.159:0/1380858269 wait complete. 2023-12-17T11:47:56.968 INFO:tasks.ceph.mgr.y.smithi040.stderr:2023-12-17T11:47:56.966+0000 7f1e05cb0040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-12-17T11:47:56.980 INFO:tasks.ceph.osd.0:Restarting daemon 2023-12-17T11:47:56.981 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2023-12-17T11:47:56.989 INFO:tasks.ceph.osd.0:Started 2023-12-17T11:47:56.990 INFO:tasks.ceph.osd.1:Restarting daemon 2023-12-17T11:47:56.990 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2023-12-17T11:47:56.998 INFO:tasks.ceph.osd.1:Started 2023-12-17T11:47:56.998 INFO:tasks.ceph.osd.2:Restarting daemon 2023-12-17T11:47:56.998 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2023-12-17T11:47:57.002 INFO:tasks.ceph.mgr.x.smithi159.stderr:2023-12-17T11:47:56.999+0000 7fc300641040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-12-17T11:47:57.004 INFO:tasks.ceph.osd.2:Started 2023-12-17T11:47:57.005 INFO:tasks.ceph.osd.3:Restarting daemon 2023-12-17T11:47:57.005 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2023-12-17T11:47:57.011 INFO:tasks.ceph.osd.3:Started 2023-12-17T11:47:57.011 INFO:tasks.ceph.osd.4:Restarting daemon 2023-12-17T11:47:57.012 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2023-12-17T11:47:57.020 INFO:tasks.ceph.osd.4:Started 2023-12-17T11:47:57.020 INFO:tasks.ceph.osd.5:Restarting daemon 2023-12-17T11:47:57.020 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2023-12-17T11:47:57.028 INFO:tasks.ceph.osd.5:Started 2023-12-17T11:47:57.029 INFO:tasks.ceph.osd.6:Restarting daemon 2023-12-17T11:47:57.029 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2023-12-17T11:47:57.035 INFO:tasks.ceph.osd.6:Started 2023-12-17T11:47:57.035 INFO:tasks.ceph.osd.7:Restarting daemon 2023-12-17T11:47:57.036 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2023-12-17T11:47:57.042 INFO:tasks.ceph.osd.7:Started 2023-12-17T11:47:57.042 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-17T11:47:57.263 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:47:57.261+0000 7fb3e0397640 1 Processor -- start 2023-12-17T11:47:57.264 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:47:57.261+0000 7fb3e0397640 1 -- start start 2023-12-17T11:47:57.266 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:47:57.263+0000 7fb3e0397640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7fb3d8070170 0x7fb3d8072080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:47:57.266 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:47:57.263+0000 7fb3e0397640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fb3d80b3660 0x7fb3d8070550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:47:57.266 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:47:57.263+0000 7fb3e0397640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3d806c4b0 con 0x7fb3d806c940 2023-12-17T11:47:57.266 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:47:57.263+0000 7fb3e0397640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3d80b2fe0 con 0x7fb3d80b3660 2023-12-17T11:47:57.266 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:47:57.263+0000 7fb3e0397640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3d8070a90 con 0x7fb3d8070170 2023-12-17T11:47:57.267 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:47:57.263+0000 7fb3dd932640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fb3d80b3660 0x7fb3d8070550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:47:57.267 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:47:57.263+0000 7fb3de133640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7fb3d8070170 0x7fb3d8072080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:47:57.267 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:47:57.263+0000 7fb3dd932640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fb3d80b3660 0x7fb3d8070550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:33148/0 (socket says 172.21.15.40:33148) 2023-12-17T11:47:57.267 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:47:57.263+0000 7fb3dd932640 1 -- 172.21.15.40:0/349112621 learned_addr learned my addr 172.21.15.40:0/349112621 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-17T11:47:57.267 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:47:57.263+0000 7fb3dd932640 1 -- 172.21.15.40:0/349112621 >> v2:172.21.15.159:3300/0 conn(0x7fb3d8070170 msgr2=0x7fb3d8072080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:47:57.268 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:47:57.263+0000 7fb3dd932640 1 --2- 172.21.15.40:0/349112621 >> v2:172.21.15.159:3300/0 conn(0x7fb3d8070170 0x7fb3d8072080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:47:57.268 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:47:57.263+0000 7fb3dd932640 1 -- 172.21.15.40:0/349112621 >> v1:172.21.15.40:6789/0 conn(0x7fb3d806c940 legacy=0x7fb3d806cd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:47:57.268 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:47:57.264+0000 7fb3dd932640 1 -- 172.21.15.40:0/349112621 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3d80b2a20 con 0x7fb3d80b3660 2023-12-17T11:47:57.268 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:47:57.263+0000 7fb3dd131640 1 -- 172.21.15.40:0/349112621 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 723350439 0 0) 0x7fb3d806c4b0 con 0x7fb3d806c940 2023-12-17T11:47:57.270 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:47:57.265+0000 7fb3dd932640 1 --2- 172.21.15.40:0/349112621 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb3d80b3660 0x7fb3d8070550 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fb3d80729d0 tx=0x7fb3c802b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c430e449baf6f37a server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:47:57.270 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:47:57.265+0000 7fb3dd131640 1 -- 172.21.15.40:0/349112621 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3c80317e0 con 0x7fb3d80b3660 2023-12-17T11:47:57.270 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:47:57.266+0000 7fb3dd131640 1 -- 172.21.15.40:0/349112621 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3c8031940 con 0x7fb3d80b3660 2023-12-17T11:47:57.270 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:47:57.266+0000 7fb3dd131640 1 -- 172.21.15.40:0/349112621 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3c8031cd0 con 0x7fb3d80b3660 2023-12-17T11:47:57.270 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:47:57.266+0000 7fb3e0397640 1 -- 172.21.15.40:0/349112621 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb3d80b3660 msgr2=0x7fb3d8070550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:47:57.271 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:47:57.266+0000 7fb3e0397640 1 --2- 172.21.15.40:0/349112621 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb3d80b3660 0x7fb3d8070550 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fb3d80729d0 tx=0x7fb3c802b880 comp rx=0 tx=0).stop 2023-12-17T11:47:57.271 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:47:57.266+0000 7fb3e0397640 1 -- 172.21.15.40:0/349112621 shutdown_connections 2023-12-17T11:47:57.271 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:47:57.266+0000 7fb3e0397640 1 --2- 172.21.15.40:0/349112621 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb3d80b3660 0x7fb3d8070550 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:47:57.271 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:47:57.266+0000 7fb3e0397640 1 --2- 172.21.15.40:0/349112621 >> v2:172.21.15.159:3300/0 conn(0x7fb3d8070170 0x7fb3d8072080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:47:57.271 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:47:57.266+0000 7fb3e0397640 1 -- 172.21.15.40:0/349112621 >> 172.21.15.40:0/349112621 conn(0x7fb3d80b08d0 msgr2=0x7fb3d80b0cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:47:57.271 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:47:57.266+0000 7fb3e0397640 1 -- 172.21.15.40:0/349112621 shutdown_connections 2023-12-17T11:47:57.271 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:47:57.266+0000 7fb3e0397640 1 -- 172.21.15.40:0/349112621 wait complete. 2023-12-17T11:47:57.271 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:47:57.268+0000 7fb3e0397640 1 Processor -- start 2023-12-17T11:47:57.271 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:47:57.268+0000 7fb3e0397640 1 -- start start 2023-12-17T11:47:57.274 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:47:57.269+0000 7fb3e0397640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb3d806c940 0x7fb3d8156080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:47:57.274 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:47:57.269+0000 7fb3e0397640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb3d8070170 0x7fb3d813f8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:47:57.274 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:47:57.269+0000 7fb3e0397640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb3d80b3660 0x7fb3d813f000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:47:57.274 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:47:57.269+0000 7fb3e0397640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3d809b480 con 0x7fb3d80b3660 2023-12-17T11:47:57.274 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:47:57.269+0000 7fb3e0397640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3d81565c0 con 0x7fb3d8070170 2023-12-17T11:47:57.274 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:47:57.269+0000 7fb3e0397640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3d813fe20 con 0x7fb3d806c940 2023-12-17T11:47:57.274 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:47:57.269+0000 7fb3de934640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb3d80b3660 0x7fb3d813f000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:47:57.274 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:47:57.269+0000 7fb3de934640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb3d80b3660 0x7fb3d813f000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:33164/0 (socket says 172.21.15.40:33164) 2023-12-17T11:47:57.274 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:47:57.269+0000 7fb3de934640 1 -- 172.21.15.40:0/1540716872 learned_addr learned my addr 172.21.15.40:0/1540716872 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-17T11:47:57.274 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:47:57.269+0000 7fb3de133640 1 --2- 172.21.15.40:0/1540716872 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb3d806c940 0x7fb3d8156080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:47:57.275 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:47:57.269+0000 7fb3dd932640 1 --2- 172.21.15.40:0/1540716872 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb3d8070170 0x7fb3d813f8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:47:57.275 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:47:57.270+0000 7fb3de934640 1 -- 172.21.15.40:0/1540716872 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb3d806c940 msgr2=0x7fb3d8156080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:47:57.275 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:47:57.270+0000 7fb3de934640 1 --2- 172.21.15.40:0/1540716872 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb3d806c940 0x7fb3d8156080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:47:57.275 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:47:57.270+0000 7fb3de934640 1 -- 172.21.15.40:0/1540716872 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb3d8070170 msgr2=0x7fb3d813f8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:47:57.275 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:47:57.270+0000 7fb3de934640 1 --2- 172.21.15.40:0/1540716872 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb3d8070170 0x7fb3d813f8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:47:57.275 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:47:57.270+0000 7fb3de934640 1 -- 172.21.15.40:0/1540716872 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3c80094d0 con 0x7fb3d80b3660 2023-12-17T11:47:57.275 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:47:57.270+0000 7fb3de133640 1 --2- 172.21.15.40:0/1540716872 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb3d806c940 0x7fb3d8156080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-17T11:47:57.275 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:47:57.270+0000 7fb3de934640 1 --2- 172.21.15.40:0/1540716872 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb3d80b3660 0x7fb3d813f000 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fb3d000c390 tx=0x7fb3d000c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:47:57.275 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:47:57.270+0000 7fb3ceffd640 1 -- 172.21.15.40:0/1540716872 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3d00035f0 con 0x7fb3d80b3660 2023-12-17T11:47:57.275 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:47:57.270+0000 7fb3ceffd640 1 -- 172.21.15.40:0/1540716872 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3d0003750 con 0x7fb3d80b3660 2023-12-17T11:47:57.275 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:47:57.270+0000 7fb3ceffd640 1 -- 172.21.15.40:0/1540716872 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3d0003b00 con 0x7fb3d80b3660 2023-12-17T11:47:57.275 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:47:57.270+0000 7fb3e0397640 1 -- 172.21.15.40:0/1540716872 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3d809aae0 con 0x7fb3d80b3660 2023-12-17T11:47:57.275 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:47:57.270+0000 7fb3e0397640 1 -- 172.21.15.40:0/1540716872 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3d809b0a0 con 0x7fb3d80b3660 2023-12-17T11:47:57.276 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:47:57.270+0000 7fb3ceffd640 1 -- 172.21.15.40:0/1540716872 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fb3d001c440 con 0x7fb3d80b3660 2023-12-17T11:47:57.276 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:47:57.271+0000 7fb3ceffd640 1 -- 172.21.15.40:0/1540716872 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7fb3d001cdc0 con 0x7fb3d80b3660 2023-12-17T11:47:57.276 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:47:57.271+0000 7fb3e0397640 1 -- 172.21.15.40:0/1540716872 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb3d809b5c0 con 0x7fb3d80b3660 2023-12-17T11:47:57.276 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:47:57.274+0000 7fb3ceffd640 1 -- 172.21.15.40:0/1540716872 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7fb3d809b5c0 con 0x7fb3d80b3660 2023-12-17T11:47:57.340 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:47:57.338+0000 7fb3e0397640 1 -- 172.21.15.40:0/1540716872 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb3d8074450 con 0x7fb3d80b3660 2023-12-17T11:47:57.341 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:47:57.339+0000 7fb3ceffd640 1 -- 172.21.15.40:0/1540716872 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7fb3d0017070 con 0x7fb3d80b3660 2023-12-17T11:47:57.341 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T11:47:57.341 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":10,"fsid":"099cd35d-80d9-4ca4-8424-de13b3b03ac7","created":"2023-12-17T11:47:53.450097+0000","modified":"2023-12-17T11:47:56.956499+0000","last_up_change":"0.000000","last_in_change":"2023-12-17T11:47:56.956499+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"a88bfd46-63b8-48b1-9c0e-5c9cdc31bd38","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"c5d628ae-36f4-4866-802c-b162f0e90add","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"d986ad6a-af2f-47fc-9c3b-fbda27b82b73","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"d79d22b7-be05-41b2-b95d-697db677fd02","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"62a7a233-d3ea-40be-91de-180c0208d639","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"84629cea-dc0e-4b5e-b203-5ea963839281","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"4ae3af3a-1743-4070-a91d-8be5c31cdb04","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"c1f4c7f2-8f75-4f95-bc63-a332773e3b8e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-17T11:47:57.342 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:47:57.340+0000 7fb3e0397640 1 -- 172.21.15.40:0/1540716872 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb3d80b3660 msgr2=0x7fb3d813f000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:47:57.342 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:47:57.340+0000 7fb3e0397640 1 --2- 172.21.15.40:0/1540716872 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb3d80b3660 0x7fb3d813f000 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fb3d000c390 tx=0x7fb3d000c850 comp rx=0 tx=0).stop 2023-12-17T11:47:57.342 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:47:57.340+0000 7fb3e0397640 1 -- 172.21.15.40:0/1540716872 shutdown_connections 2023-12-17T11:47:57.342 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:47:57.340+0000 7fb3e0397640 1 --2- 172.21.15.40:0/1540716872 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb3d80b3660 0x7fb3d813f000 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:47:57.343 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:47:57.340+0000 7fb3e0397640 1 --2- 172.21.15.40:0/1540716872 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb3d8070170 0x7fb3d813f8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:47:57.343 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:47:57.340+0000 7fb3e0397640 1 --2- 172.21.15.40:0/1540716872 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb3d806c940 0x7fb3d8156080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:47:57.343 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:47:57.340+0000 7fb3e0397640 1 -- 172.21.15.40:0/1540716872 >> 172.21.15.40:0/1540716872 conn(0x7fb3d80b08d0 msgr2=0x7fb3d80b20e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:47:57.343 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:47:57.340+0000 7fb3e0397640 1 -- 172.21.15.40:0/1540716872 shutdown_connections 2023-12-17T11:47:57.343 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:47:57.341+0000 7fb3e0397640 1 -- 172.21.15.40:0/1540716872 wait complete. 2023-12-17T11:47:57.358 INFO:tasks.ceph.ceph_manager.ceph:[] 2023-12-17T11:47:57.358 INFO:tasks.ceph:Waiting for OSDs to come up 2023-12-17T11:47:57.720 INFO:tasks.ceph.osd.6.smithi159.stderr:2023-12-17T11:47:57.717+0000 7efd9b810500 -1 Falling back to public interface 2023-12-17T11:47:57.724 INFO:tasks.ceph.osd.0.smithi040.stderr:2023-12-17T11:47:57.722+0000 7fddcb410500 -1 Falling back to public interface 2023-12-17T11:47:57.724 INFO:tasks.ceph.osd.1.smithi040.stderr:2023-12-17T11:47:57.722+0000 7f1059212500 -1 Falling back to public interface 2023-12-17T11:47:57.726 INFO:tasks.ceph.osd.4.smithi159.stderr:2023-12-17T11:47:57.724+0000 7f2f7fa16500 -1 Falling back to public interface 2023-12-17T11:47:57.731 INFO:tasks.ceph.osd.2.smithi040.stderr:2023-12-17T11:47:57.729+0000 7f342e4d4500 -1 Falling back to public interface 2023-12-17T11:47:57.739 INFO:tasks.ceph.osd.3.smithi040.stderr:2023-12-17T11:47:57.737+0000 7f518a614500 -1 Falling back to public interface 2023-12-17T11:47:57.754 INFO:tasks.ceph.osd.5.smithi159.stderr:2023-12-17T11:47:57.752+0000 7fca9c794500 -1 Falling back to public interface 2023-12-17T11:47:57.766 INFO:tasks.ceph.osd.7.smithi159.stderr:2023-12-17T11:47:57.764+0000 7f2a69010500 -1 Falling back to public interface 2023-12-17T11:47:58.066 INFO:tasks.ceph.mgr.y.smithi040.stderr:2023-12-17T11:47:58.064+0000 7f1e05cb0040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-12-17T11:47:58.081 INFO:tasks.ceph.mgr.x.smithi159.stderr:2023-12-17T11:47:58.078+0000 7fc300641040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-12-17T11:47:58.164 DEBUG:teuthology.orchestra.run.smithi040:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-12-17T11:47:58.342 INFO:teuthology.misc.health.smithi040.stderr:2023-12-17T11:47:58.340+0000 7fb64a90c640 1 Processor -- start 2023-12-17T11:47:58.342 INFO:teuthology.misc.health.smithi040.stderr:2023-12-17T11:47:58.340+0000 7fb64a90c640 1 -- start start 2023-12-17T11:47:58.343 INFO:teuthology.misc.health.smithi040.stderr:2023-12-17T11:47:58.341+0000 7fb64a90c640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fb6440d1540 0x7fb6440d1920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:47:58.343 INFO:teuthology.misc.health.smithi040.stderr:2023-12-17T11:47:58.341+0000 7fb64a90c640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7fb6440cdc20 0x7fb6440ce080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:47:58.343 INFO:teuthology.misc.health.smithi040.stderr:2023-12-17T11:47:58.341+0000 7fb64a90c640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb6440cf870 0x7fb6440cfce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:47:58.343 INFO:teuthology.misc.health.smithi040.stderr:2023-12-17T11:47:58.341+0000 7fb64a90c640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6440d1e60 con 0x7fb6440d1540 2023-12-17T11:47:58.343 INFO:teuthology.misc.health.smithi040.stderr:2023-12-17T11:47:58.341+0000 7fb64a90c640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6440b23f0 con 0x7fb6440cdc20 2023-12-17T11:47:58.343 INFO:teuthology.misc.health.smithi040.stderr:2023-12-17T11:47:58.341+0000 7fb64a90c640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6440ce5c0 con 0x7fb6440cf870 2023-12-17T11:47:58.343 INFO:teuthology.misc.health.smithi040.stderr:2023-12-17T11:47:58.341+0000 7fb643fff640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fb6440d1540 0x7fb6440d1920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:47:58.344 INFO:teuthology.misc.health.smithi040.stderr:2023-12-17T11:47:58.341+0000 7fb643fff640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fb6440d1540 0x7fb6440d1920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:33170/0 (socket says 172.21.15.40:33170) 2023-12-17T11:47:58.344 INFO:teuthology.misc.health.smithi040.stderr:2023-12-17T11:47:58.341+0000 7fb643fff640 1 -- 172.21.15.40:0/966913719 learned_addr learned my addr 172.21.15.40:0/966913719 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-17T11:47:58.344 INFO:teuthology.misc.health.smithi040.stderr:2023-12-17T11:47:58.341+0000 7fb648ea9640 1 --2- 172.21.15.40:0/966913719 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb6440cf870 0x7fb6440cfce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:47:58.344 INFO:teuthology.misc.health.smithi040.stderr:2023-12-17T11:47:58.341+0000 7fb6437fe640 1 --2- 172.21.15.40:0/966913719 >> v2:172.21.15.159:3300/0 conn(0x7fb6440cdc20 0x7fb6440ce080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:47:58.344 INFO:teuthology.misc.health.smithi040.stderr:2023-12-17T11:47:58.342+0000 7fb643fff640 1 -- 172.21.15.40:0/966913719 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb6440cf870 msgr2=0x7fb6440cfce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:47:58.344 INFO:teuthology.misc.health.smithi040.stderr:2023-12-17T11:47:58.342+0000 7fb643fff640 1 --2- 172.21.15.40:0/966913719 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb6440cf870 0x7fb6440cfce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:47:58.344 INFO:teuthology.misc.health.smithi040.stderr:2023-12-17T11:47:58.342+0000 7fb643fff640 1 -- 172.21.15.40:0/966913719 >> v2:172.21.15.159:3300/0 conn(0x7fb6440cdc20 msgr2=0x7fb6440ce080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:47:58.344 INFO:teuthology.misc.health.smithi040.stderr:2023-12-17T11:47:58.342+0000 7fb643fff640 1 --2- 172.21.15.40:0/966913719 >> v2:172.21.15.159:3300/0 conn(0x7fb6440cdc20 0x7fb6440ce080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:47:58.345 INFO:teuthology.misc.health.smithi040.stderr:2023-12-17T11:47:58.342+0000 7fb643fff640 1 -- 172.21.15.40:0/966913719 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6440ce890 con 0x7fb6440d1540 2023-12-17T11:47:58.345 INFO:teuthology.misc.health.smithi040.stderr:2023-12-17T11:47:58.343+0000 7fb643fff640 1 --2- 172.21.15.40:0/966913719 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb6440d1540 0x7fb6440d1920 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fb6440cd940 tx=0x7fb63402b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e8fd67670550ff1 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:47:58.345 INFO:teuthology.misc.health.smithi040.stderr:2023-12-17T11:47:58.343+0000 7fb642ffd640 1 -- 172.21.15.40:0/966913719 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb634031860 con 0x7fb6440d1540 2023-12-17T11:47:58.345 INFO:teuthology.misc.health.smithi040.stderr:2023-12-17T11:47:58.343+0000 7fb642ffd640 1 -- 172.21.15.40:0/966913719 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6340319c0 con 0x7fb6440d1540 2023-12-17T11:47:58.345 INFO:teuthology.misc.health.smithi040.stderr:2023-12-17T11:47:58.343+0000 7fb642ffd640 1 -- 172.21.15.40:0/966913719 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb634031d50 con 0x7fb6440d1540 2023-12-17T11:47:58.346 INFO:teuthology.misc.health.smithi040.stderr:2023-12-17T11:47:58.344+0000 7fb64a90c640 1 -- 172.21.15.40:0/966913719 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb6440d1540 msgr2=0x7fb6440d1920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:47:58.346 INFO:teuthology.misc.health.smithi040.stderr:2023-12-17T11:47:58.344+0000 7fb64a90c640 1 --2- 172.21.15.40:0/966913719 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb6440d1540 0x7fb6440d1920 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fb6440cd940 tx=0x7fb63402b900 comp rx=0 tx=0).stop 2023-12-17T11:47:58.346 INFO:teuthology.misc.health.smithi040.stderr:2023-12-17T11:47:58.344+0000 7fb64a90c640 1 -- 172.21.15.40:0/966913719 shutdown_connections 2023-12-17T11:47:58.346 INFO:teuthology.misc.health.smithi040.stderr:2023-12-17T11:47:58.344+0000 7fb64a90c640 1 --2- 172.21.15.40:0/966913719 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb6440cf870 0x7fb6440cfce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:47:58.347 INFO:teuthology.misc.health.smithi040.stderr:2023-12-17T11:47:58.344+0000 7fb64a90c640 1 --2- 172.21.15.40:0/966913719 >> v2:172.21.15.159:3300/0 conn(0x7fb6440cdc20 0x7fb6440ce080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:47:58.347 INFO:teuthology.misc.health.smithi040.stderr:2023-12-17T11:47:58.344+0000 7fb64a90c640 1 --2- 172.21.15.40:0/966913719 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb6440d1540 0x7fb6440d1920 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:47:58.347 INFO:teuthology.misc.health.smithi040.stderr:2023-12-17T11:47:58.344+0000 7fb64a90c640 1 -- 172.21.15.40:0/966913719 >> 172.21.15.40:0/966913719 conn(0x7fb64409c450 msgr2=0x7fb6440d3110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:47:58.347 INFO:teuthology.misc.health.smithi040.stderr:2023-12-17T11:47:58.344+0000 7fb64a90c640 1 -- 172.21.15.40:0/966913719 shutdown_connections 2023-12-17T11:47:58.347 INFO:teuthology.misc.health.smithi040.stderr:2023-12-17T11:47:58.344+0000 7fb64a90c640 1 -- 172.21.15.40:0/966913719 wait complete. 2023-12-17T11:47:58.348 INFO:teuthology.misc.health.smithi040.stderr:2023-12-17T11:47:58.346+0000 7fb64a90c640 1 Processor -- start 2023-12-17T11:47:58.348 INFO:teuthology.misc.health.smithi040.stderr:2023-12-17T11:47:58.346+0000 7fb64a90c640 1 -- start start 2023-12-17T11:47:58.350 INFO:teuthology.misc.health.smithi040.stderr:2023-12-17T11:47:58.347+0000 7fb64a90c640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb6440cdc20 0x7fb6440b5e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:47:58.351 INFO:teuthology.misc.health.smithi040.stderr:2023-12-17T11:47:58.347+0000 7fb64a90c640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb6440cf870 0x7fb644151690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:47:58.351 INFO:teuthology.misc.health.smithi040.stderr:2023-12-17T11:47:58.347+0000 7fb64a90c640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb6440d1540 0x7fb6440c7c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:47:58.351 INFO:teuthology.misc.health.smithi040.stderr:2023-12-17T11:47:58.347+0000 7fb64a90c640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6440c81d0 con 0x7fb6440cdc20 2023-12-17T11:47:58.351 INFO:teuthology.misc.health.smithi040.stderr:2023-12-17T11:47:58.347+0000 7fb64a90c640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6440c8ff0 con 0x7fb6440d1540 2023-12-17T11:47:58.351 INFO:teuthology.misc.health.smithi040.stderr:2023-12-17T11:47:58.347+0000 7fb64a90c640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6440c83e0 con 0x7fb6440cf870 2023-12-17T11:47:58.351 INFO:teuthology.misc.health.smithi040.stderr:2023-12-17T11:47:58.347+0000 7fb643fff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb6440cdc20 0x7fb6440b5e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:47:58.351 INFO:teuthology.misc.health.smithi040.stderr:2023-12-17T11:47:58.347+0000 7fb643fff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb6440cdc20 0x7fb6440b5e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:33176/0 (socket says 172.21.15.40:33176) 2023-12-17T11:47:58.351 INFO:teuthology.misc.health.smithi040.stderr:2023-12-17T11:47:58.347+0000 7fb643fff640 1 -- 172.21.15.40:0/1339470592 learned_addr learned my addr 172.21.15.40:0/1339470592 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-17T11:47:58.351 INFO:teuthology.misc.health.smithi040.stderr:2023-12-17T11:47:58.347+0000 7fb6437fe640 1 --2- 172.21.15.40:0/1339470592 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb6440cf870 0x7fb644151690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:47:58.351 INFO:teuthology.misc.health.smithi040.stderr:2023-12-17T11:47:58.347+0000 7fb648ea9640 1 --2- 172.21.15.40:0/1339470592 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb6440d1540 0x7fb6440c7c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:47:58.351 INFO:teuthology.misc.health.smithi040.stderr:2023-12-17T11:47:58.348+0000 7fb6437fe640 1 -- 172.21.15.40:0/1339470592 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb6440d1540 msgr2=0x7fb6440c7c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:47:58.351 INFO:teuthology.misc.health.smithi040.stderr:2023-12-17T11:47:58.348+0000 7fb6437fe640 1 --2- 172.21.15.40:0/1339470592 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb6440d1540 0x7fb6440c7c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:47:58.351 INFO:teuthology.misc.health.smithi040.stderr:2023-12-17T11:47:58.348+0000 7fb6437fe640 1 -- 172.21.15.40:0/1339470592 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb6440cdc20 msgr2=0x7fb6440b5e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:47:58.352 INFO:teuthology.misc.health.smithi040.stderr:2023-12-17T11:47:58.348+0000 7fb6437fe640 1 --2- 172.21.15.40:0/1339470592 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb6440cdc20 0x7fb6440b5e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:47:58.352 INFO:teuthology.misc.health.smithi040.stderr:2023-12-17T11:47:58.348+0000 7fb6437fe640 1 -- 172.21.15.40:0/1339470592 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6340094d0 con 0x7fb6440cf870 2023-12-17T11:47:58.352 INFO:teuthology.misc.health.smithi040.stderr:2023-12-17T11:47:58.348+0000 7fb643fff640 1 --2- 172.21.15.40:0/1339470592 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb6440cdc20 0x7fb6440b5e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-17T11:47:58.352 INFO:teuthology.misc.health.smithi040.stderr:2023-12-17T11:47:58.348+0000 7fb6437fe640 1 --2- 172.21.15.40:0/1339470592 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb6440cf870 0x7fb644151690 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fb63800e870 tx=0x7fb63800ed30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:47:58.352 INFO:teuthology.misc.health.smithi040.stderr:2023-12-17T11:47:58.348+0000 7fb640ff9640 1 -- 172.21.15.40:0/1339470592 <== mon.2 v2:172.21.15.159:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb63800c940 con 0x7fb6440cf870 2023-12-17T11:47:58.352 INFO:teuthology.misc.health.smithi040.stderr:2023-12-17T11:47:58.348+0000 7fb640ff9640 1 -- 172.21.15.40:0/1339470592 <== mon.2 v2:172.21.15.159:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb63800caa0 con 0x7fb6440cf870 2023-12-17T11:47:58.352 INFO:teuthology.misc.health.smithi040.stderr:2023-12-17T11:47:58.348+0000 7fb64a90c640 1 -- 172.21.15.40:0/1339470592 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6440c86c0 con 0x7fb6440cf870 2023-12-17T11:47:58.352 INFO:teuthology.misc.health.smithi040.stderr:2023-12-17T11:47:58.348+0000 7fb640ff9640 1 -- 172.21.15.40:0/1339470592 <== mon.2 v2:172.21.15.159:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb63800ce10 con 0x7fb6440cf870 2023-12-17T11:47:58.352 INFO:teuthology.misc.health.smithi040.stderr:2023-12-17T11:47:58.348+0000 7fb64a90c640 1 -- 172.21.15.40:0/1339470592 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6440c8c80 con 0x7fb6440cf870 2023-12-17T11:47:58.352 INFO:teuthology.misc.health.smithi040.stderr:2023-12-17T11:47:58.348+0000 7fb640ff9640 1 -- 172.21.15.40:0/1339470592 <== mon.2 v2:172.21.15.159:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fb638005c90 con 0x7fb6440cf870 2023-12-17T11:47:58.352 INFO:teuthology.misc.health.smithi040.stderr:2023-12-17T11:47:58.349+0000 7fb640ff9640 1 -- 172.21.15.40:0/1339470592 <== mon.2 v2:172.21.15.159:3301/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7fb6380068e0 con 0x7fb6440cf870 2023-12-17T11:47:58.353 INFO:teuthology.misc.health.smithi040.stderr:2023-12-17T11:47:58.349+0000 7fb64a90c640 1 -- 172.21.15.40:0/1339470592 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb6440c9160 con 0x7fb6440cf870 2023-12-17T11:47:58.354 INFO:teuthology.misc.health.smithi040.stderr:2023-12-17T11:47:58.352+0000 7fb640ff9640 1 -- 172.21.15.40:0/1339470592 <== mon.2 v2:172.21.15.159:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7fb638021060 con 0x7fb6440cf870 2023-12-17T11:47:58.389 INFO:tasks.ceph.mgr.x.smithi159.stderr:2023-12-17T11:47:58.387+0000 7fc300641040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-12-17T11:47:58.391 INFO:tasks.ceph.mgr.y.smithi040.stderr:2023-12-17T11:47:58.389+0000 7f1e05cb0040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-12-17T11:47:58.422 INFO:teuthology.misc.health.smithi040.stderr:2023-12-17T11:47:58.420+0000 7fb64a90c640 1 -- 172.21.15.40:0/1339470592 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb6440745d0 con 0x7fb6440cf870 2023-12-17T11:47:58.423 INFO:teuthology.misc.health.smithi040.stderr:2023-12-17T11:47:58.421+0000 7fb640ff9640 1 -- 172.21.15.40:0/1339470592 <== mon.2 v2:172.21.15.159:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7fb638029020 con 0x7fb6440cf870 2023-12-17T11:47:58.423 INFO:teuthology.misc.health.smithi040.stdout: 2023-12-17T11:47:58.424 INFO:teuthology.misc.health.smithi040.stdout:{"epoch":10,"fsid":"099cd35d-80d9-4ca4-8424-de13b3b03ac7","created":"2023-12-17T11:47:53.450097+0000","modified":"2023-12-17T11:47:56.956499+0000","last_up_change":"0.000000","last_in_change":"2023-12-17T11:47:56.956499+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"a88bfd46-63b8-48b1-9c0e-5c9cdc31bd38","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"c5d628ae-36f4-4866-802c-b162f0e90add","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"d986ad6a-af2f-47fc-9c3b-fbda27b82b73","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"d79d22b7-be05-41b2-b95d-697db677fd02","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"62a7a233-d3ea-40be-91de-180c0208d639","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"84629cea-dc0e-4b5e-b203-5ea963839281","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"4ae3af3a-1743-4070-a91d-8be5c31cdb04","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"c1f4c7f2-8f75-4f95-bc63-a332773e3b8e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-17T11:47:58.425 INFO:teuthology.misc.health.smithi040.stderr:2023-12-17T11:47:58.422+0000 7fb64a90c640 1 -- 172.21.15.40:0/1339470592 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb6440cf870 msgr2=0x7fb644151690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:47:58.425 INFO:teuthology.misc.health.smithi040.stderr:2023-12-17T11:47:58.422+0000 7fb64a90c640 1 --2- 172.21.15.40:0/1339470592 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb6440cf870 0x7fb644151690 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fb63800e870 tx=0x7fb63800ed30 comp rx=0 tx=0).stop 2023-12-17T11:47:58.425 INFO:teuthology.misc.health.smithi040.stderr:2023-12-17T11:47:58.422+0000 7fb64a90c640 1 -- 172.21.15.40:0/1339470592 shutdown_connections 2023-12-17T11:47:58.425 INFO:teuthology.misc.health.smithi040.stderr:2023-12-17T11:47:58.422+0000 7fb64a90c640 1 --2- 172.21.15.40:0/1339470592 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb6440d1540 0x7fb6440c7c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:47:58.425 INFO:teuthology.misc.health.smithi040.stderr:2023-12-17T11:47:58.422+0000 7fb64a90c640 1 --2- 172.21.15.40:0/1339470592 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb6440cf870 0x7fb644151690 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:47:58.425 INFO:teuthology.misc.health.smithi040.stderr:2023-12-17T11:47:58.422+0000 7fb64a90c640 1 --2- 172.21.15.40:0/1339470592 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb6440cdc20 0x7fb6440b5e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:47:58.425 INFO:teuthology.misc.health.smithi040.stderr:2023-12-17T11:47:58.422+0000 7fb64a90c640 1 -- 172.21.15.40:0/1339470592 >> 172.21.15.40:0/1339470592 conn(0x7fb64409c450 msgr2=0x7fb64415c910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:47:58.425 INFO:teuthology.misc.health.smithi040.stderr:2023-12-17T11:47:58.423+0000 7fb64a90c640 1 -- 172.21.15.40:0/1339470592 shutdown_connections 2023-12-17T11:47:58.425 INFO:teuthology.misc.health.smithi040.stderr:2023-12-17T11:47:58.423+0000 7fb64a90c640 1 -- 172.21.15.40:0/1339470592 wait complete. 2023-12-17T11:47:58.439 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-12-17T11:47:58.451 INFO:tasks.ceph.mgr.x.smithi159.stderr:2023-12-17T11:47:58.448+0000 7fc300641040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-12-17T11:47:58.454 INFO:tasks.ceph.mgr.y.smithi040.stderr:2023-12-17T11:47:58.452+0000 7f1e05cb0040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-12-17T11:47:58.567 INFO:tasks.ceph.mgr.x.smithi159.stderr:2023-12-17T11:47:58.564+0000 7fc300641040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-12-17T11:47:58.573 INFO:tasks.ceph.mgr.y.smithi040.stderr:2023-12-17T11:47:58.571+0000 7f1e05cb0040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-12-17T11:47:59.620 INFO:tasks.ceph.mgr.x.smithi159.stderr:2023-12-17T11:47:59.617+0000 7fc2a1a62640 -1 mgr.server handle_report got status from non-daemon mon.c 2023-12-17T11:47:59.620 INFO:tasks.ceph.mgr.x.smithi159.stderr:2023-12-17T11:47:59.618+0000 7fc2a1a62640 -1 mgr.server handle_report got status from non-daemon mon.b 2023-12-17T11:48:00.817 INFO:tasks.ceph.osd.3.smithi040.stderr:2023-12-17T11:48:00.815+0000 7f518a614500 -1 osd.3 0 log_to_monitors true 2023-12-17T11:48:01.047 INFO:tasks.ceph.osd.0.smithi040.stderr:2023-12-17T11:48:01.045+0000 7fddcb410500 -1 osd.0 0 log_to_monitors true 2023-12-17T11:48:01.268 INFO:tasks.ceph.osd.6.smithi159.stderr:2023-12-17T11:48:01.266+0000 7efd9b810500 -1 osd.6 0 log_to_monitors true 2023-12-17T11:48:01.317 INFO:tasks.ceph.osd.5.smithi159.stderr:2023-12-17T11:48:01.315+0000 7fca9c794500 -1 osd.5 0 log_to_monitors true 2023-12-17T11:48:01.322 INFO:tasks.ceph.osd.1.smithi040.stderr:2023-12-17T11:48:01.320+0000 7f1059212500 -1 osd.1 0 log_to_monitors true 2023-12-17T11:48:01.347 INFO:tasks.ceph.osd.2.smithi040.stderr:2023-12-17T11:48:01.345+0000 7f342e4d4500 -1 osd.2 0 log_to_monitors true 2023-12-17T11:48:01.572 INFO:tasks.ceph.osd.4.smithi159.stderr:2023-12-17T11:48:01.569+0000 7f2f7fa16500 -1 osd.4 0 log_to_monitors true 2023-12-17T11:48:01.607 INFO:tasks.ceph.osd.7.smithi159.stderr:2023-12-17T11:48:01.604+0000 7f2a69010500 -1 osd.7 0 log_to_monitors true 2023-12-17T11:48:04.726 INFO:tasks.ceph.osd.4.smithi159.stderr:2023-12-17T11:48:04.723+0000 7f2f7b3c1640 -1 osd.4 0 waiting for initial osdmap 2023-12-17T11:48:04.735 INFO:tasks.ceph.osd.4.smithi159.stderr:2023-12-17T11:48:04.733+0000 7f2f731e8640 -1 osd.4 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-17T11:48:04.736 INFO:tasks.ceph.osd.5.smithi159.stderr:2023-12-17T11:48:04.733+0000 7fca98f36640 -1 osd.5 0 waiting for initial osdmap 2023-12-17T11:48:04.753 INFO:tasks.ceph.osd.5.smithi159.stderr:2023-12-17T11:48:04.750+0000 7fca90549640 -1 osd.5 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-17T11:48:04.776 INFO:tasks.ceph.osd.6.smithi159.stderr:2023-12-17T11:48:04.774+0000 7efd97221640 -1 osd.6 0 waiting for initial osdmap 2023-12-17T11:48:04.784 INFO:tasks.ceph.osd.6.smithi159.stderr:2023-12-17T11:48:04.782+0000 7efd8f048640 -1 osd.6 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-17T11:48:04.999 INFO:tasks.ceph.osd.3.smithi040.stderr:2023-12-17T11:48:04.996+0000 7f51866f3640 -1 osd.3 0 waiting for initial osdmap 2023-12-17T11:48:05.004 INFO:tasks.ceph.osd.3.smithi040.stderr:2023-12-17T11:48:05.002+0000 7f517dd06640 -1 osd.3 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-17T11:48:05.063 INFO:tasks.ceph.osd.1.smithi040.stderr:2023-12-17T11:48:05.061+0000 7f1055483640 -1 osd.1 0 waiting for initial osdmap 2023-12-17T11:48:05.065 INFO:tasks.ceph.osd.2.smithi040.stderr:2023-12-17T11:48:05.064+0000 7f342a462640 -1 osd.2 0 waiting for initial osdmap 2023-12-17T11:48:05.075 INFO:tasks.ceph.osd.2.smithi040.stderr:2023-12-17T11:48:05.074+0000 7f3422289640 -1 osd.2 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-17T11:48:05.081 INFO:tasks.ceph.osd.1.smithi040.stderr:2023-12-17T11:48:05.079+0000 7f104ca96640 -1 osd.1 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-17T11:48:05.084 INFO:tasks.ceph.osd.0.smithi040.stderr:2023-12-17T11:48:05.082+0000 7fddc6cdf640 -1 osd.0 0 waiting for initial osdmap 2023-12-17T11:48:05.091 INFO:tasks.ceph.osd.0.smithi040.stderr:2023-12-17T11:48:05.089+0000 7fddbeb06640 -1 osd.0 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-17T11:48:05.154 INFO:tasks.ceph.osd.7.smithi159.stderr:2023-12-17T11:48:05.152+0000 7f2a64a8f640 -1 osd.7 0 waiting for initial osdmap 2023-12-17T11:48:05.164 INFO:tasks.ceph.osd.7.smithi159.stderr:2023-12-17T11:48:05.161+0000 7f2a5c8b6640 -1 osd.7 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-17T11:48:05.244 DEBUG:teuthology.orchestra.run.smithi040:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-12-17T11:48:05.431 INFO:teuthology.misc.health.smithi040.stderr:2023-12-17T11:48:05.429+0000 7fe645e6d640 1 Processor -- start 2023-12-17T11:48:05.431 INFO:teuthology.misc.health.smithi040.stderr:2023-12-17T11:48:05.429+0000 7fe645e6d640 1 -- start start 2023-12-17T11:48:05.433 INFO:teuthology.misc.health.smithi040.stderr:2023-12-17T11:48:05.430+0000 7fe645e6d640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fe64015d380 0x7fe6400afb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:05.434 INFO:teuthology.misc.health.smithi040.stderr:2023-12-17T11:48:05.431+0000 7fe645e6d640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe6400d1c60 0x7fe6400ceaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:05.434 INFO:teuthology.misc.health.smithi040.stderr:2023-12-17T11:48:05.431+0000 7fe645e6d640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6400b2c40 con 0x7fe6400ce630 2023-12-17T11:48:05.434 INFO:teuthology.misc.health.smithi040.stderr:2023-12-17T11:48:05.431+0000 7fe645e6d640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6400b38c0 con 0x7fe64015d380 2023-12-17T11:48:05.434 INFO:teuthology.misc.health.smithi040.stderr:2023-12-17T11:48:05.431+0000 7fe645e6d640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6400b2f20 con 0x7fe6400d1c60 2023-12-17T11:48:05.434 INFO:teuthology.misc.health.smithi040.stderr:2023-12-17T11:48:05.431+0000 7fe637fff640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fe6400ce630 0x7fe6400d1550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:43404/0 (socket says 172.21.15.40:43404) 2023-12-17T11:48:05.434 INFO:teuthology.misc.health.smithi040.stderr:2023-12-17T11:48:05.431+0000 7fe644e6b640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fe64015d380 0x7fe6400afb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:05.434 INFO:teuthology.misc.health.smithi040.stderr:2023-12-17T11:48:05.431+0000 7fe637fff640 1 -- 172.21.15.40:0/1746110698 learned_addr learned my addr 172.21.15.40:0/1746110698 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-12-17T11:48:05.434 INFO:teuthology.misc.health.smithi040.stderr:2023-12-17T11:48:05.431+0000 7fe64566c640 1 --2- 172.21.15.40:0/1746110698 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe6400d1c60 0x7fe6400ceaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:05.434 INFO:teuthology.misc.health.smithi040.stderr:2023-12-17T11:48:05.431+0000 7fe6377fe640 1 -- 172.21.15.40:0/1746110698 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 243564850 0 0) 0x7fe6400b2c40 con 0x7fe6400ce630 2023-12-17T11:48:05.434 INFO:teuthology.misc.health.smithi040.stderr:2023-12-17T11:48:05.431+0000 7fe6377fe640 1 -- 172.21.15.40:0/1746110698 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe628003520 con 0x7fe6400ce630 2023-12-17T11:48:05.434 INFO:teuthology.misc.health.smithi040.stderr:2023-12-17T11:48:05.432+0000 7fe644e6b640 1 -- 172.21.15.40:0/1746110698 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe6400d1c60 msgr2=0x7fe6400ceaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:48:05.434 INFO:teuthology.misc.health.smithi040.stderr:2023-12-17T11:48:05.432+0000 7fe644e6b640 1 --2- 172.21.15.40:0/1746110698 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe6400d1c60 0x7fe6400ceaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:05.434 INFO:teuthology.misc.health.smithi040.stderr:2023-12-17T11:48:05.432+0000 7fe644e6b640 1 -- 172.21.15.40:0/1746110698 >> v1:172.21.15.40:6789/0 conn(0x7fe6400ce630 legacy=0x7fe6400d1550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:05.434 INFO:teuthology.misc.health.smithi040.stderr:2023-12-17T11:48:05.432+0000 7fe644e6b640 1 -- 172.21.15.40:0/1746110698 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6400b3200 con 0x7fe64015d380 2023-12-17T11:48:05.436 INFO:teuthology.misc.health.smithi040.stderr:2023-12-17T11:48:05.433+0000 7fe644e6b640 1 --2- 172.21.15.40:0/1746110698 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe64015d380 0x7fe6400afb30 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fe63c009d90 tx=0x7fe63c02be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f54d87ed951f047 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:48:05.436 INFO:teuthology.misc.health.smithi040.stderr:2023-12-17T11:48:05.433+0000 7fe6377fe640 1 -- 172.21.15.40:0/1746110698 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe63c02cbd0 con 0x7fe64015d380 2023-12-17T11:48:05.436 INFO:teuthology.misc.health.smithi040.stderr:2023-12-17T11:48:05.433+0000 7fe6377fe640 1 -- 172.21.15.40:0/1746110698 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe63c02cd30 con 0x7fe64015d380 2023-12-17T11:48:05.436 INFO:teuthology.misc.health.smithi040.stderr:2023-12-17T11:48:05.433+0000 7fe6377fe640 1 -- 172.21.15.40:0/1746110698 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe63c02cea0 con 0x7fe64015d380 2023-12-17T11:48:05.436 INFO:teuthology.misc.health.smithi040.stderr:2023-12-17T11:48:05.433+0000 7fe645e6d640 1 -- 172.21.15.40:0/1746110698 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe64015d380 msgr2=0x7fe6400afb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:05.436 INFO:teuthology.misc.health.smithi040.stderr:2023-12-17T11:48:05.433+0000 7fe645e6d640 1 --2- 172.21.15.40:0/1746110698 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe64015d380 0x7fe6400afb30 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fe63c009d90 tx=0x7fe63c02be20 comp rx=0 tx=0).stop 2023-12-17T11:48:05.436 INFO:teuthology.misc.health.smithi040.stderr:2023-12-17T11:48:05.434+0000 7fe645e6d640 1 -- 172.21.15.40:0/1746110698 shutdown_connections 2023-12-17T11:48:05.436 INFO:teuthology.misc.health.smithi040.stderr:2023-12-17T11:48:05.434+0000 7fe645e6d640 1 --2- 172.21.15.40:0/1746110698 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe6400d1c60 0x7fe6400ceaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:05.436 INFO:teuthology.misc.health.smithi040.stderr:2023-12-17T11:48:05.434+0000 7fe645e6d640 1 --2- 172.21.15.40:0/1746110698 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe64015d380 0x7fe6400afb30 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:05.436 INFO:teuthology.misc.health.smithi040.stderr:2023-12-17T11:48:05.434+0000 7fe645e6d640 1 -- 172.21.15.40:0/1746110698 >> 172.21.15.40:0/1746110698 conn(0x7fe64009c240 msgr2=0x7fe6400d2f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:48:05.436 INFO:teuthology.misc.health.smithi040.stderr:2023-12-17T11:48:05.434+0000 7fe645e6d640 1 -- 172.21.15.40:0/1746110698 shutdown_connections 2023-12-17T11:48:05.436 INFO:teuthology.misc.health.smithi040.stderr:2023-12-17T11:48:05.434+0000 7fe645e6d640 1 -- 172.21.15.40:0/1746110698 wait complete. 2023-12-17T11:48:05.437 INFO:teuthology.misc.health.smithi040.stderr:2023-12-17T11:48:05.435+0000 7fe645e6d640 1 Processor -- start 2023-12-17T11:48:05.437 INFO:teuthology.misc.health.smithi040.stderr:2023-12-17T11:48:05.436+0000 7fe645e6d640 1 -- start start 2023-12-17T11:48:05.439 INFO:teuthology.misc.health.smithi040.stderr:2023-12-17T11:48:05.436+0000 7fe645e6d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe6400ce630 0x7fe64015e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:05.439 INFO:teuthology.misc.health.smithi040.stderr:2023-12-17T11:48:05.436+0000 7fe645e6d640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe6400d1c60 0x7fe64014acd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:05.439 INFO:teuthology.misc.health.smithi040.stderr:2023-12-17T11:48:05.437+0000 7fe645e6d640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe64015d380 0x7fe64014b210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:05.439 INFO:teuthology.misc.health.smithi040.stderr:2023-12-17T11:48:05.437+0000 7fe645e6d640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe64015e830 con 0x7fe6400ce630 2023-12-17T11:48:05.439 INFO:teuthology.misc.health.smithi040.stderr:2023-12-17T11:48:05.437+0000 7fe645e6d640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe640151bf0 con 0x7fe64015d380 2023-12-17T11:48:05.440 INFO:teuthology.misc.health.smithi040.stderr:2023-12-17T11:48:05.437+0000 7fe645e6d640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe64014ddd0 con 0x7fe6400d1c60 2023-12-17T11:48:05.440 INFO:teuthology.misc.health.smithi040.stderr:2023-12-17T11:48:05.437+0000 7fe644e6b640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe6400ce630 0x7fe64015e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:05.440 INFO:teuthology.misc.health.smithi040.stderr:2023-12-17T11:48:05.437+0000 7fe644e6b640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe6400ce630 0x7fe64015e2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:47726/0 (socket says 172.21.15.40:47726) 2023-12-17T11:48:05.440 INFO:teuthology.misc.health.smithi040.stderr:2023-12-17T11:48:05.437+0000 7fe644e6b640 1 -- 172.21.15.40:0/1272794424 learned_addr learned my addr 172.21.15.40:0/1272794424 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-17T11:48:05.440 INFO:teuthology.misc.health.smithi040.stderr:2023-12-17T11:48:05.437+0000 7fe637fff640 1 --2- 172.21.15.40:0/1272794424 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe6400d1c60 0x7fe64014acd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:05.440 INFO:teuthology.misc.health.smithi040.stderr:2023-12-17T11:48:05.437+0000 7fe644e6b640 1 -- 172.21.15.40:0/1272794424 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe6400d1c60 msgr2=0x7fe64014acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:05.440 INFO:teuthology.misc.health.smithi040.stderr:2023-12-17T11:48:05.437+0000 7fe644e6b640 1 --2- 172.21.15.40:0/1272794424 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe6400d1c60 0x7fe64014acd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:05.440 INFO:teuthology.misc.health.smithi040.stderr:2023-12-17T11:48:05.437+0000 7fe644e6b640 1 -- 172.21.15.40:0/1272794424 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe64015d380 msgr2=0x7fe64014b210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:05.440 INFO:teuthology.misc.health.smithi040.stderr:2023-12-17T11:48:05.437+0000 7fe644e6b640 1 --2- 172.21.15.40:0/1272794424 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe64015d380 0x7fe64014b210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:05.440 INFO:teuthology.misc.health.smithi040.stderr:2023-12-17T11:48:05.437+0000 7fe644e6b640 1 -- 172.21.15.40:0/1272794424 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe63c009a70 con 0x7fe6400ce630 2023-12-17T11:48:05.440 INFO:teuthology.misc.health.smithi040.stderr:2023-12-17T11:48:05.438+0000 7fe644e6b640 1 --2- 172.21.15.40:0/1272794424 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe6400ce630 0x7fe64015e2f0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fe63c009eb0 tx=0x7fe63c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:48:05.441 INFO:teuthology.misc.health.smithi040.stderr:2023-12-17T11:48:05.438+0000 7fe6357fa640 1 -- 172.21.15.40:0/1272794424 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe63c02cea0 con 0x7fe6400ce630 2023-12-17T11:48:05.441 INFO:teuthology.misc.health.smithi040.stderr:2023-12-17T11:48:05.438+0000 7fe6357fa640 1 -- 172.21.15.40:0/1272794424 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe63c03e610 con 0x7fe6400ce630 2023-12-17T11:48:05.441 INFO:teuthology.misc.health.smithi040.stderr:2023-12-17T11:48:05.438+0000 7fe6357fa640 1 -- 172.21.15.40:0/1272794424 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe63c03e9c0 con 0x7fe6400ce630 2023-12-17T11:48:05.441 INFO:teuthology.misc.health.smithi040.stderr:2023-12-17T11:48:05.438+0000 7fe645e6d640 1 -- 172.21.15.40:0/1272794424 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe64014e0b0 con 0x7fe6400ce630 2023-12-17T11:48:05.441 INFO:teuthology.misc.health.smithi040.stderr:2023-12-17T11:48:05.438+0000 7fe645e6d640 1 -- 172.21.15.40:0/1272794424 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe64014e670 con 0x7fe6400ce630 2023-12-17T11:48:05.442 INFO:teuthology.misc.health.smithi040.stderr:2023-12-17T11:48:05.439+0000 7fe645e6d640 1 -- 172.21.15.40:0/1272794424 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe640074450 con 0x7fe6400ce630 2023-12-17T11:48:05.442 INFO:teuthology.misc.health.smithi040.stderr:2023-12-17T11:48:05.440+0000 7fe6357fa640 1 -- 172.21.15.40:0/1272794424 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 4) v1 ==== 89175+0+0 (secure 0 0 0) 0x7fe63c03b050 con 0x7fe6400ce630 2023-12-17T11:48:05.443 INFO:teuthology.misc.health.smithi040.stderr:2023-12-17T11:48:05.441+0000 7fe6357fa640 1 --2- 172.21.15.40:0/1272794424 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7fe62c06adb0 0x7fe62c06d270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:05.443 INFO:teuthology.misc.health.smithi040.stderr:2023-12-17T11:48:05.442+0000 7fe6357fa640 1 -- 172.21.15.40:0/1272794424 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(13..13 src has 1..13) v4 ==== 2231+0+0 (secure 0 0 0) 0x7fe63c0aafc0 con 0x7fe6400ce630 2023-12-17T11:48:05.444 INFO:teuthology.misc.health.smithi040.stderr:2023-12-17T11:48:05.442+0000 7fe637fff640 1 --2- 172.21.15.40:0/1272794424 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7fe62c06adb0 0x7fe62c06d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:05.445 INFO:teuthology.misc.health.smithi040.stderr:2023-12-17T11:48:05.443+0000 7fe637fff640 1 --2- 172.21.15.40:0/1272794424 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7fe62c06adb0 0x7fe62c06d270 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fe640066630 tx=0x7fe630009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:48:05.448 INFO:teuthology.misc.health.smithi040.stderr:2023-12-17T11:48:05.447+0000 7fe6357fa640 1 -- 172.21.15.40:0/1272794424 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fe63c0dde90 con 0x7fe6400ce630 2023-12-17T11:48:05.636 INFO:teuthology.misc.health.smithi040.stderr:2023-12-17T11:48:05.634+0000 7fe645e6d640 1 -- 172.21.15.40:0/1272794424 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe6400d1330 con 0x7fe6400ce630 2023-12-17T11:48:05.638 INFO:teuthology.misc.health.smithi040.stderr:2023-12-17T11:48:05.636+0000 7fe6357fa640 1 -- 172.21.15.40:0/1272794424 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v13) v1 ==== 74+0+7057 (secure 0 0 0) 0x7fe63c039090 con 0x7fe6400ce630 2023-12-17T11:48:05.638 INFO:teuthology.misc.health.smithi040.stdout: 2023-12-17T11:48:05.639 INFO:teuthology.misc.health.smithi040.stdout:{"epoch":13,"fsid":"099cd35d-80d9-4ca4-8424-de13b3b03ac7","created":"2023-12-17T11:47:53.450097+0000","modified":"2023-12-17T11:48:03.636469+0000","last_up_change":"0.000000","last_in_change":"2023-12-17T11:47:56.956499+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"a88bfd46-63b8-48b1-9c0e-5c9cdc31bd38","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"c5d628ae-36f4-4866-802c-b162f0e90add","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"d986ad6a-af2f-47fc-9c3b-fbda27b82b73","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"d79d22b7-be05-41b2-b95d-697db677fd02","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"62a7a233-d3ea-40be-91de-180c0208d639","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"84629cea-dc0e-4b5e-b203-5ea963839281","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"4ae3af3a-1743-4070-a91d-8be5c31cdb04","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"c1f4c7f2-8f75-4f95-bc63-a332773e3b8e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-17T11:48:05.641 INFO:teuthology.misc.health.smithi040.stderr:2023-12-17T11:48:05.639+0000 7fe645e6d640 1 -- 172.21.15.40:0/1272794424 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7fe62c06adb0 msgr2=0x7fe62c06d270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:05.641 INFO:teuthology.misc.health.smithi040.stderr:2023-12-17T11:48:05.639+0000 7fe645e6d640 1 --2- 172.21.15.40:0/1272794424 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7fe62c06adb0 0x7fe62c06d270 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fe640066630 tx=0x7fe630009040 comp rx=0 tx=0).stop 2023-12-17T11:48:05.642 INFO:teuthology.misc.health.smithi040.stderr:2023-12-17T11:48:05.639+0000 7fe645e6d640 1 -- 172.21.15.40:0/1272794424 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe6400ce630 msgr2=0x7fe64015e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:05.642 INFO:teuthology.misc.health.smithi040.stderr:2023-12-17T11:48:05.639+0000 7fe645e6d640 1 --2- 172.21.15.40:0/1272794424 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe6400ce630 0x7fe64015e2f0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fe63c009eb0 tx=0x7fe63c004a40 comp rx=0 tx=0).stop 2023-12-17T11:48:05.642 INFO:teuthology.misc.health.smithi040.stderr:2023-12-17T11:48:05.639+0000 7fe645e6d640 1 -- 172.21.15.40:0/1272794424 shutdown_connections 2023-12-17T11:48:05.642 INFO:teuthology.misc.health.smithi040.stderr:2023-12-17T11:48:05.639+0000 7fe645e6d640 1 --2- 172.21.15.40:0/1272794424 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7fe62c06adb0 0x7fe62c06d270 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:05.642 INFO:teuthology.misc.health.smithi040.stderr:2023-12-17T11:48:05.639+0000 7fe645e6d640 1 --2- 172.21.15.40:0/1272794424 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe64015d380 0x7fe64014b210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:05.642 INFO:teuthology.misc.health.smithi040.stderr:2023-12-17T11:48:05.639+0000 7fe645e6d640 1 --2- 172.21.15.40:0/1272794424 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe6400d1c60 0x7fe64014acd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:05.642 INFO:teuthology.misc.health.smithi040.stderr:2023-12-17T11:48:05.639+0000 7fe645e6d640 1 --2- 172.21.15.40:0/1272794424 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe6400ce630 0x7fe64015e2f0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:05.642 INFO:teuthology.misc.health.smithi040.stderr:2023-12-17T11:48:05.639+0000 7fe645e6d640 1 -- 172.21.15.40:0/1272794424 >> 172.21.15.40:0/1272794424 conn(0x7fe64009c240 msgr2=0x7fe64006c270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:48:05.642 INFO:teuthology.misc.health.smithi040.stderr:2023-12-17T11:48:05.639+0000 7fe645e6d640 1 -- 172.21.15.40:0/1272794424 shutdown_connections 2023-12-17T11:48:05.642 INFO:teuthology.misc.health.smithi040.stderr:2023-12-17T11:48:05.639+0000 7fe645e6d640 1 -- 172.21.15.40:0/1272794424 wait complete. 2023-12-17T11:48:05.655 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-12-17T11:48:06.852 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T11:48:06.862 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T11:48:12.462 DEBUG:teuthology.orchestra.run.smithi040:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-12-17T11:48:12.659 INFO:teuthology.misc.health.smithi040.stderr:2023-12-17T11:48:12.657+0000 7f9b16901640 1 Processor -- start 2023-12-17T11:48:12.660 INFO:teuthology.misc.health.smithi040.stderr:2023-12-17T11:48:12.658+0000 7f9b16901640 1 -- start start 2023-12-17T11:48:12.662 INFO:teuthology.misc.health.smithi040.stderr:2023-12-17T11:48:12.659+0000 7f9b16901640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f9b10143da0 0x7f9b1006d440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:12.662 INFO:teuthology.misc.health.smithi040.stderr:2023-12-17T11:48:12.659+0000 7f9b16901640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9b1006d980 0x7f9b100cb800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:12.662 INFO:teuthology.misc.health.smithi040.stderr:2023-12-17T11:48:12.659+0000 7f9b16901640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f9b100cbd40 0x7f9b1015ecf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:12.662 INFO:teuthology.misc.health.smithi040.stderr:2023-12-17T11:48:12.659+0000 7f9b16901640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b1006dde0 con 0x7f9b100cbd40 2023-12-17T11:48:12.662 INFO:teuthology.misc.health.smithi040.stderr:2023-12-17T11:48:12.659+0000 7f9b16901640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b100cc1d0 con 0x7f9b10143da0 2023-12-17T11:48:12.662 INFO:teuthology.misc.health.smithi040.stderr:2023-12-17T11:48:12.659+0000 7f9b16901640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b100ce5b0 con 0x7f9b1006d980 2023-12-17T11:48:12.662 INFO:teuthology.misc.health.smithi040.stderr:2023-12-17T11:48:12.660+0000 7f9b14e9e640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f9b100cbd40 0x7f9b1015ecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:12.662 INFO:teuthology.misc.health.smithi040.stderr:2023-12-17T11:48:12.660+0000 7f9b14e9e640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f9b100cbd40 0x7f9b1015ecf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:47738/0 (socket says 172.21.15.40:47738) 2023-12-17T11:48:12.662 INFO:teuthology.misc.health.smithi040.stderr:2023-12-17T11:48:12.660+0000 7f9b14e9e640 1 -- 172.21.15.40:0/1738332089 learned_addr learned my addr 172.21.15.40:0/1738332089 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-17T11:48:12.663 INFO:teuthology.misc.health.smithi040.stderr:2023-12-17T11:48:12.660+0000 7f9b0f7fe640 1 --2- 172.21.15.40:0/1738332089 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9b1006d980 0x7f9b100cb800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:12.663 INFO:teuthology.misc.health.smithi040.stderr:2023-12-17T11:48:12.660+0000 7f9b0ffff640 1 --2- 172.21.15.40:0/1738332089 >> v2:172.21.15.159:3300/0 conn(0x7f9b10143da0 0x7f9b1006d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:12.663 INFO:teuthology.misc.health.smithi040.stderr:2023-12-17T11:48:12.661+0000 7f9b14e9e640 1 -- 172.21.15.40:0/1738332089 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9b1006d980 msgr2=0x7f9b100cb800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:48:12.663 INFO:teuthology.misc.health.smithi040.stderr:2023-12-17T11:48:12.661+0000 7f9b14e9e640 1 --2- 172.21.15.40:0/1738332089 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9b1006d980 0x7f9b100cb800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:12.664 INFO:teuthology.misc.health.smithi040.stderr:2023-12-17T11:48:12.661+0000 7f9b14e9e640 1 -- 172.21.15.40:0/1738332089 >> v2:172.21.15.159:3300/0 conn(0x7f9b10143da0 msgr2=0x7f9b1006d440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:48:12.664 INFO:teuthology.misc.health.smithi040.stderr:2023-12-17T11:48:12.661+0000 7f9b14e9e640 1 --2- 172.21.15.40:0/1738332089 >> v2:172.21.15.159:3300/0 conn(0x7f9b10143da0 0x7f9b1006d440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:12.664 INFO:teuthology.misc.health.smithi040.stderr:2023-12-17T11:48:12.661+0000 7f9b14e9e640 1 -- 172.21.15.40:0/1738332089 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b10144180 con 0x7f9b100cbd40 2023-12-17T11:48:12.664 INFO:teuthology.misc.health.smithi040.stderr:2023-12-17T11:48:12.662+0000 7f9b14e9e640 1 --2- 172.21.15.40:0/1738332089 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9b100cbd40 0x7f9b1015ecf0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f9b10144f80 tx=0x7f9b0802bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=501d9f2551018a1e server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:48:12.665 INFO:teuthology.misc.health.smithi040.stderr:2023-12-17T11:48:12.662+0000 7f9b0effd640 1 -- 172.21.15.40:0/1738332089 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b0802ca70 con 0x7f9b100cbd40 2023-12-17T11:48:12.665 INFO:teuthology.misc.health.smithi040.stderr:2023-12-17T11:48:12.662+0000 7f9b0effd640 1 -- 172.21.15.40:0/1738332089 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b0802cbd0 con 0x7f9b100cbd40 2023-12-17T11:48:12.665 INFO:teuthology.misc.health.smithi040.stderr:2023-12-17T11:48:12.662+0000 7f9b0effd640 1 -- 172.21.15.40:0/1738332089 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b080343f0 con 0x7f9b100cbd40 2023-12-17T11:48:12.665 INFO:teuthology.misc.health.smithi040.stderr:2023-12-17T11:48:12.662+0000 7f9b16901640 1 -- 172.21.15.40:0/1738332089 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9b100cbd40 msgr2=0x7f9b1015ecf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:12.665 INFO:teuthology.misc.health.smithi040.stderr:2023-12-17T11:48:12.662+0000 7f9b16901640 1 --2- 172.21.15.40:0/1738332089 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9b100cbd40 0x7f9b1015ecf0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f9b10144f80 tx=0x7f9b0802bed0 comp rx=0 tx=0).stop 2023-12-17T11:48:12.665 INFO:teuthology.misc.health.smithi040.stderr:2023-12-17T11:48:12.663+0000 7f9b16901640 1 -- 172.21.15.40:0/1738332089 shutdown_connections 2023-12-17T11:48:12.665 INFO:teuthology.misc.health.smithi040.stderr:2023-12-17T11:48:12.663+0000 7f9b16901640 1 --2- 172.21.15.40:0/1738332089 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9b100cbd40 0x7f9b1015ecf0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:12.665 INFO:teuthology.misc.health.smithi040.stderr:2023-12-17T11:48:12.663+0000 7f9b16901640 1 --2- 172.21.15.40:0/1738332089 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9b1006d980 0x7f9b100cb800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:12.665 INFO:teuthology.misc.health.smithi040.stderr:2023-12-17T11:48:12.663+0000 7f9b16901640 1 --2- 172.21.15.40:0/1738332089 >> v2:172.21.15.159:3300/0 conn(0x7f9b10143da0 0x7f9b1006d440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:12.665 INFO:teuthology.misc.health.smithi040.stderr:2023-12-17T11:48:12.663+0000 7f9b16901640 1 -- 172.21.15.40:0/1738332089 >> 172.21.15.40:0/1738332089 conn(0x7f9b100b0a90 msgr2=0x7f9b100b0ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:48:12.665 INFO:teuthology.misc.health.smithi040.stderr:2023-12-17T11:48:12.663+0000 7f9b16901640 1 -- 172.21.15.40:0/1738332089 shutdown_connections 2023-12-17T11:48:12.665 INFO:teuthology.misc.health.smithi040.stderr:2023-12-17T11:48:12.663+0000 7f9b16901640 1 -- 172.21.15.40:0/1738332089 wait complete. 2023-12-17T11:48:12.666 INFO:teuthology.misc.health.smithi040.stderr:2023-12-17T11:48:12.665+0000 7f9b16901640 1 Processor -- start 2023-12-17T11:48:12.666 INFO:teuthology.misc.health.smithi040.stderr:2023-12-17T11:48:12.665+0000 7f9b16901640 1 -- start start 2023-12-17T11:48:12.668 INFO:teuthology.misc.health.smithi040.stderr:2023-12-17T11:48:12.666+0000 7f9b16901640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9b1006d980 0x7f9b10159d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:12.668 INFO:teuthology.misc.health.smithi040.stderr:2023-12-17T11:48:12.666+0000 7f9b16901640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9b100cbd40 0x7f9b10142960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:12.668 INFO:teuthology.misc.health.smithi040.stderr:2023-12-17T11:48:12.666+0000 7f9b16901640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9b10143da0 0x7f9b1013dac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:12.668 INFO:teuthology.misc.health.smithi040.stderr:2023-12-17T11:48:12.666+0000 7f9b16901640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b1013e000 con 0x7f9b1006d980 2023-12-17T11:48:12.668 INFO:teuthology.misc.health.smithi040.stderr:2023-12-17T11:48:12.666+0000 7f9b16901640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b1013e230 con 0x7f9b10143da0 2023-12-17T11:48:12.668 INFO:teuthology.misc.health.smithi040.stderr:2023-12-17T11:48:12.666+0000 7f9b16901640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b1013e510 con 0x7f9b100cbd40 2023-12-17T11:48:12.669 INFO:teuthology.misc.health.smithi040.stderr:2023-12-17T11:48:12.666+0000 7f9b0ffff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9b1006d980 0x7f9b10159d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:12.669 INFO:teuthology.misc.health.smithi040.stderr:2023-12-17T11:48:12.666+0000 7f9b0ffff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9b1006d980 0x7f9b10159d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:47752/0 (socket says 172.21.15.40:47752) 2023-12-17T11:48:12.669 INFO:teuthology.misc.health.smithi040.stderr:2023-12-17T11:48:12.666+0000 7f9b0ffff640 1 -- 172.21.15.40:0/3558763190 learned_addr learned my addr 172.21.15.40:0/3558763190 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-17T11:48:12.669 INFO:teuthology.misc.health.smithi040.stderr:2023-12-17T11:48:12.666+0000 7f9b0f7fe640 1 --2- 172.21.15.40:0/3558763190 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9b100cbd40 0x7f9b10142960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:12.669 INFO:teuthology.misc.health.smithi040.stderr:2023-12-17T11:48:12.666+0000 7f9b14e9e640 1 --2- 172.21.15.40:0/3558763190 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9b10143da0 0x7f9b1013dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:12.670 INFO:teuthology.misc.health.smithi040.stderr:2023-12-17T11:48:12.667+0000 7f9b0ffff640 1 -- 172.21.15.40:0/3558763190 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9b100cbd40 msgr2=0x7f9b10142960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:12.670 INFO:teuthology.misc.health.smithi040.stderr:2023-12-17T11:48:12.667+0000 7f9b0ffff640 1 --2- 172.21.15.40:0/3558763190 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9b100cbd40 0x7f9b10142960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:12.670 INFO:teuthology.misc.health.smithi040.stderr:2023-12-17T11:48:12.667+0000 7f9b0ffff640 1 -- 172.21.15.40:0/3558763190 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9b10143da0 msgr2=0x7f9b1013dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:12.670 INFO:teuthology.misc.health.smithi040.stderr:2023-12-17T11:48:12.667+0000 7f9b0ffff640 1 --2- 172.21.15.40:0/3558763190 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9b10143da0 0x7f9b1013dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:12.670 INFO:teuthology.misc.health.smithi040.stderr:2023-12-17T11:48:12.667+0000 7f9b0ffff640 1 -- 172.21.15.40:0/3558763190 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b08009b30 con 0x7f9b1006d980 2023-12-17T11:48:12.670 INFO:teuthology.misc.health.smithi040.stderr:2023-12-17T11:48:12.667+0000 7f9b0f7fe640 1 --2- 172.21.15.40:0/3558763190 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9b100cbd40 0x7f9b10142960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-17T11:48:12.671 INFO:teuthology.misc.health.smithi040.stderr:2023-12-17T11:48:12.667+0000 7f9b0ffff640 1 --2- 172.21.15.40:0/3558763190 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9b1006d980 0x7f9b10159d70 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f9b0000d800 tx=0x7f9b0000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:48:12.671 INFO:teuthology.misc.health.smithi040.stderr:2023-12-17T11:48:12.667+0000 7f9b0cff9640 1 -- 172.21.15.40:0/3558763190 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b0000b6c0 con 0x7f9b1006d980 2023-12-17T11:48:12.671 INFO:teuthology.misc.health.smithi040.stderr:2023-12-17T11:48:12.667+0000 7f9b0cff9640 1 -- 172.21.15.40:0/3558763190 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b0000b820 con 0x7f9b1006d980 2023-12-17T11:48:12.671 INFO:teuthology.misc.health.smithi040.stderr:2023-12-17T11:48:12.667+0000 7f9b16901640 1 -- 172.21.15.40:0/3558763190 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b1013e7f0 con 0x7f9b1006d980 2023-12-17T11:48:12.671 INFO:teuthology.misc.health.smithi040.stderr:2023-12-17T11:48:12.667+0000 7f9b0cff9640 1 -- 172.21.15.40:0/3558763190 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b0000bbb0 con 0x7f9b1006d980 2023-12-17T11:48:12.671 INFO:teuthology.misc.health.smithi040.stderr:2023-12-17T11:48:12.667+0000 7f9b16901640 1 -- 172.21.15.40:0/3558763190 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b1013edb0 con 0x7f9b1006d980 2023-12-17T11:48:12.671 INFO:teuthology.misc.health.smithi040.stderr:2023-12-17T11:48:12.668+0000 7f9b16901640 1 -- 172.21.15.40:0/3558763190 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b1013ef70 con 0x7f9b1006d980 2023-12-17T11:48:12.671 INFO:teuthology.misc.health.smithi040.stderr:2023-12-17T11:48:12.669+0000 7f9b0cff9640 1 -- 172.21.15.40:0/3558763190 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f9b0000bd10 con 0x7f9b1006d980 2023-12-17T11:48:12.672 INFO:teuthology.misc.health.smithi040.stderr:2023-12-17T11:48:12.670+0000 7f9b0cff9640 1 --2- 172.21.15.40:0/3558763190 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f9afc06ae40 0x7f9afc06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:12.672 INFO:teuthology.misc.health.smithi040.stderr:2023-12-17T11:48:12.670+0000 7f9b0cff9640 1 -- 172.21.15.40:0/3558763190 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f9b00089900 con 0x7f9b1006d980 2023-12-17T11:48:12.673 INFO:teuthology.misc.health.smithi040.stderr:2023-12-17T11:48:12.671+0000 7f9b0f7fe640 1 --2- 172.21.15.40:0/3558763190 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f9afc06ae40 0x7f9afc06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:12.674 INFO:teuthology.misc.health.smithi040.stderr:2023-12-17T11:48:12.672+0000 7f9b0f7fe640 1 --2- 172.21.15.40:0/3558763190 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f9afc06ae40 0x7f9afc06d300 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f9b101431e0 tx=0x7f9b04008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:48:12.678 INFO:teuthology.misc.health.smithi040.stderr:2023-12-17T11:48:12.676+0000 7f9b0cff9640 1 -- 172.21.15.40:0/3558763190 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f9b00054c60 con 0x7f9b1006d980 2023-12-17T11:48:12.884 INFO:teuthology.misc.health.smithi040.stderr:2023-12-17T11:48:12.882+0000 7f9b16901640 1 -- 172.21.15.40:0/3558763190 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9b100745d0 con 0x7f9b1006d980 2023-12-17T11:48:12.886 INFO:teuthology.misc.health.smithi040.stderr:2023-12-17T11:48:12.884+0000 7f9b0cff9640 1 -- 172.21.15.40:0/3558763190 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) v1 ==== 74+0+12826 (secure 0 0 0) 0x7f9b00058280 con 0x7f9b1006d980 2023-12-17T11:48:12.886 INFO:teuthology.misc.health.smithi040.stdout: 2023-12-17T11:48:12.887 INFO:teuthology.misc.health.smithi040.stdout:{"epoch":17,"fsid":"099cd35d-80d9-4ca4-8424-de13b3b03ac7","created":"2023-12-17T11:47:53.450097+0000","modified":"2023-12-17T11:48:08.736207+0000","last_up_change":"2023-12-17T11:48:05.724195+0000","last_in_change":"2023-12-17T11:47:56.956499+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-17T11:48:06.668943+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a88bfd46-63b8-48b1-9c0e-5c9cdc31bd38","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":555204741},{"type":"v1","addr":"172.21.15.40:6802","nonce":555204741}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":555204741},{"type":"v1","addr":"172.21.15.40:6807","nonce":555204741}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":555204741},{"type":"v1","addr":"172.21.15.40:6815","nonce":555204741}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6809","nonce":555204741},{"type":"v1","addr":"172.21.15.40:6812","nonce":555204741}]},"public_addr":"172.21.15.40:6802/555204741","cluster_addr":"172.21.15.40:6807/555204741","heartbeat_back_addr":"172.21.15.40:6815/555204741","heartbeat_front_addr":"172.21.15.40:6812/555204741","state":["exists","up"]},{"osd":1,"uuid":"c5d628ae-36f4-4866-802c-b162f0e90add","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6801","nonce":1221318112},{"type":"v1","addr":"172.21.15.40:6803","nonce":1221318112}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6805","nonce":1221318112},{"type":"v1","addr":"172.21.15.40:6806","nonce":1221318112}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6811","nonce":1221318112},{"type":"v1","addr":"172.21.15.40:6813","nonce":1221318112}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":1221318112},{"type":"v1","addr":"172.21.15.40:6810","nonce":1221318112}]},"public_addr":"172.21.15.40:6803/1221318112","cluster_addr":"172.21.15.40:6806/1221318112","heartbeat_back_addr":"172.21.15.40:6813/1221318112","heartbeat_front_addr":"172.21.15.40:6810/1221318112","state":["exists","up"]},{"osd":2,"uuid":"d986ad6a-af2f-47fc-9c3b-fbda27b82b73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":1959000265},{"type":"v1","addr":"172.21.15.40:6817","nonce":1959000265}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6818","nonce":1959000265},{"type":"v1","addr":"172.21.15.40:6819","nonce":1959000265}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":1959000265},{"type":"v1","addr":"172.21.15.40:6827","nonce":1959000265}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":1959000265},{"type":"v1","addr":"172.21.15.40:6822","nonce":1959000265}]},"public_addr":"172.21.15.40:6817/1959000265","cluster_addr":"172.21.15.40:6819/1959000265","heartbeat_back_addr":"172.21.15.40:6827/1959000265","heartbeat_front_addr":"172.21.15.40:6822/1959000265","state":["exists","up"]},{"osd":3,"uuid":"d79d22b7-be05-41b2-b95d-697db677fd02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6821","nonce":974040287},{"type":"v1","addr":"172.21.15.40:6823","nonce":974040287}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6825","nonce":974040287},{"type":"v1","addr":"172.21.15.40:6826","nonce":974040287}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":974040287},{"type":"v1","addr":"172.21.15.40:6831","nonce":974040287}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":974040287},{"type":"v1","addr":"172.21.15.40:6829","nonce":974040287}]},"public_addr":"172.21.15.40:6823/974040287","cluster_addr":"172.21.15.40:6826/974040287","heartbeat_back_addr":"172.21.15.40:6831/974040287","heartbeat_front_addr":"172.21.15.40:6829/974040287","state":["exists","up"]},{"osd":4,"uuid":"62a7a233-d3ea-40be-91de-180c0208d639","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6808","nonce":3937787733},{"type":"v1","addr":"172.21.15.159:6809","nonce":3937787733}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6810","nonce":3937787733},{"type":"v1","addr":"172.21.15.159:6811","nonce":3937787733}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6814","nonce":3937787733},{"type":"v1","addr":"172.21.15.159:6815","nonce":3937787733}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6812","nonce":3937787733},{"type":"v1","addr":"172.21.15.159:6813","nonce":3937787733}]},"public_addr":"172.21.15.159:6809/3937787733","cluster_addr":"172.21.15.159:6811/3937787733","heartbeat_back_addr":"172.21.15.159:6815/3937787733","heartbeat_front_addr":"172.21.15.159:6813/3937787733","state":["exists","up"]},{"osd":5,"uuid":"84629cea-dc0e-4b5e-b203-5ea963839281","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6816","nonce":3032505240},{"type":"v1","addr":"172.21.15.159:6817","nonce":3032505240}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6818","nonce":3032505240},{"type":"v1","addr":"172.21.15.159:6819","nonce":3032505240}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6822","nonce":3032505240},{"type":"v1","addr":"172.21.15.159:6823","nonce":3032505240}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6820","nonce":3032505240},{"type":"v1","addr":"172.21.15.159:6821","nonce":3032505240}]},"public_addr":"172.21.15.159:6817/3032505240","cluster_addr":"172.21.15.159:6819/3032505240","heartbeat_back_addr":"172.21.15.159:6823/3032505240","heartbeat_front_addr":"172.21.15.159:6821/3032505240","state":["exists","up"]},{"osd":6,"uuid":"4ae3af3a-1743-4070-a91d-8be5c31cdb04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6800","nonce":2411788597},{"type":"v1","addr":"172.21.15.159:6801","nonce":2411788597}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6802","nonce":2411788597},{"type":"v1","addr":"172.21.15.159:6803","nonce":2411788597}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6806","nonce":2411788597},{"type":"v1","addr":"172.21.15.159:6807","nonce":2411788597}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6804","nonce":2411788597},{"type":"v1","addr":"172.21.15.159:6805","nonce":2411788597}]},"public_addr":"172.21.15.159:6801/2411788597","cluster_addr":"172.21.15.159:6803/2411788597","heartbeat_back_addr":"172.21.15.159:6807/2411788597","heartbeat_front_addr":"172.21.15.159:6805/2411788597","state":["exists","up"]},{"osd":7,"uuid":"c1f4c7f2-8f75-4f95-bc63-a332773e3b8e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6824","nonce":478953349},{"type":"v1","addr":"172.21.15.159:6825","nonce":478953349}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6826","nonce":478953349},{"type":"v1","addr":"172.21.15.159:6827","nonce":478953349}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6830","nonce":478953349},{"type":"v1","addr":"172.21.15.159:6831","nonce":478953349}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6828","nonce":478953349},{"type":"v1","addr":"172.21.15.159:6829","nonce":478953349}]},"public_addr":"172.21.15.159:6825/478953349","cluster_addr":"172.21.15.159:6827/478953349","heartbeat_back_addr":"172.21.15.159:6831/478953349","heartbeat_front_addr":"172.21.15.159:6829/478953349","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T11:48:02.023567+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T11:48:02.278216+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T11:48:02.311843+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T11:48:01.773372+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T11:48:02.618910+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T11:48:02.361559+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T11:48:02.223997+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T11:48:02.604403+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-17T11:48:12.890 INFO:teuthology.misc.health.smithi040.stderr:2023-12-17T11:48:12.887+0000 7f9b16901640 1 -- 172.21.15.40:0/3558763190 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f9afc06ae40 msgr2=0x7f9afc06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:12.890 INFO:teuthology.misc.health.smithi040.stderr:2023-12-17T11:48:12.887+0000 7f9b16901640 1 --2- 172.21.15.40:0/3558763190 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f9afc06ae40 0x7f9afc06d300 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f9b101431e0 tx=0x7f9b04008040 comp rx=0 tx=0).stop 2023-12-17T11:48:12.890 INFO:teuthology.misc.health.smithi040.stderr:2023-12-17T11:48:12.887+0000 7f9b16901640 1 -- 172.21.15.40:0/3558763190 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9b1006d980 msgr2=0x7f9b10159d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:12.890 INFO:teuthology.misc.health.smithi040.stderr:2023-12-17T11:48:12.887+0000 7f9b16901640 1 --2- 172.21.15.40:0/3558763190 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9b1006d980 0x7f9b10159d70 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f9b0000d800 tx=0x7f9b0000dcc0 comp rx=0 tx=0).stop 2023-12-17T11:48:12.890 INFO:teuthology.misc.health.smithi040.stderr:2023-12-17T11:48:12.887+0000 7f9b16901640 1 -- 172.21.15.40:0/3558763190 shutdown_connections 2023-12-17T11:48:12.890 INFO:teuthology.misc.health.smithi040.stderr:2023-12-17T11:48:12.887+0000 7f9b16901640 1 --2- 172.21.15.40:0/3558763190 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f9afc06ae40 0x7f9afc06d300 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:12.890 INFO:teuthology.misc.health.smithi040.stderr:2023-12-17T11:48:12.887+0000 7f9b16901640 1 --2- 172.21.15.40:0/3558763190 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9b10143da0 0x7f9b1013dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:12.890 INFO:teuthology.misc.health.smithi040.stderr:2023-12-17T11:48:12.887+0000 7f9b16901640 1 --2- 172.21.15.40:0/3558763190 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9b100cbd40 0x7f9b10142960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:12.890 INFO:teuthology.misc.health.smithi040.stderr:2023-12-17T11:48:12.887+0000 7f9b16901640 1 --2- 172.21.15.40:0/3558763190 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9b1006d980 0x7f9b10159d70 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:12.890 INFO:teuthology.misc.health.smithi040.stderr:2023-12-17T11:48:12.887+0000 7f9b16901640 1 -- 172.21.15.40:0/3558763190 >> 172.21.15.40:0/3558763190 conn(0x7f9b100b0a90 msgr2=0x7f9b100ac860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:48:12.891 INFO:teuthology.misc.health.smithi040.stderr:2023-12-17T11:48:12.888+0000 7f9b16901640 1 -- 172.21.15.40:0/3558763190 shutdown_connections 2023-12-17T11:48:12.891 INFO:teuthology.misc.health.smithi040.stderr:2023-12-17T11:48:12.888+0000 7f9b16901640 1 -- 172.21.15.40:0/3558763190 wait complete. 2023-12-17T11:48:12.904 DEBUG:teuthology.misc:8 of 8 OSDs are up 2023-12-17T11:48:12.904 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2023-12-17T11:48:12.905 INFO:tasks.ceph.mds.a:Restarting daemon 2023-12-17T11:48:12.905 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-12-17T11:48:12.913 INFO:tasks.ceph.mds.a:Started 2023-12-17T11:48:12.913 INFO:tasks.ceph.mds.c:Restarting daemon 2023-12-17T11:48:12.913 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-12-17T11:48:12.922 INFO:tasks.ceph.mds.c:Started 2023-12-17T11:48:12.922 INFO:tasks.ceph.mds.b:Restarting daemon 2023-12-17T11:48:12.922 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-12-17T11:48:12.931 INFO:tasks.ceph.mds.b:Started 2023-12-17T11:48:12.931 INFO:tasks.ceph.mds.d:Restarting daemon 2023-12-17T11:48:12.932 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-12-17T11:48:12.940 INFO:tasks.ceph.mds.d:Started 2023-12-17T11:48:12.940 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2023-12-17T11:48:12.941 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-17T11:48:13.077 INFO:tasks.ceph.mds.a.smithi040.stdout:starting mds.a at 2023-12-17T11:48:13.098 INFO:tasks.ceph.mds.b.smithi159.stdout:starting mds.b at 2023-12-17T11:48:13.098 INFO:tasks.ceph.mds.c.smithi040.stdout:starting mds.c at 2023-12-17T11:48:13.098 INFO:tasks.ceph.mds.d.smithi159.stdout:starting mds.d at 2023-12-17T11:48:13.149 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:13.147+0000 7f2fb9891640 1 Processor -- start 2023-12-17T11:48:13.149 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:13.147+0000 7f2fb9891640 1 -- start start 2023-12-17T11:48:13.151 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:13.148+0000 7f2fb9891640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2fb40d0d70 0x7f2fb40b0e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:13.151 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:13.148+0000 7f2fb9891640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2fb40b2280 con 0x7f2fb40d13c0 2023-12-17T11:48:13.151 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:13.149+0000 7f2fb9891640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2fb40cee70 con 0x7f2fb40ce5b0 2023-12-17T11:48:13.151 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:13.149+0000 7f2fb9891640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2fb40d1200 con 0x7f2fb40d0d70 2023-12-17T11:48:13.151 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:13.149+0000 7f2fb888f640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f2fb40d13c0 0x7f2fb40d17a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:43424/0 (socket says 172.21.15.40:43424) 2023-12-17T11:48:13.151 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:13.149+0000 7f2fb888f640 1 -- 172.21.15.40:0/3481420853 learned_addr learned my addr 172.21.15.40:0/3481420853 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-12-17T11:48:13.151 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:13.149+0000 7f2fb9090640 1 --2- 172.21.15.40:0/3481420853 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2fb40d0d70 0x7f2fb40b0e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:13.152 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:13.149+0000 7f2fb37fe640 1 -- 172.21.15.40:0/3481420853 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1888499761 0 0) 0x7f2fb40b2280 con 0x7f2fb40d13c0 2023-12-17T11:48:13.152 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:13.149+0000 7f2fb9090640 1 -- 172.21.15.40:0/3481420853 >> v1:172.21.15.159:6789/0 conn(0x7f2fb40ce5b0 legacy=0x7f2fb40b0760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:13.152 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:13.149+0000 7f2fb9090640 1 -- 172.21.15.40:0/3481420853 >> v1:172.21.15.40:6789/0 conn(0x7f2fb40d13c0 legacy=0x7f2fb40d17a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:13.152 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:13.149+0000 7f2fb9090640 1 -- 172.21.15.40:0/3481420853 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fb40ceb90 con 0x7f2fb40d0d70 2023-12-17T11:48:13.152 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:13.151+0000 7f2fb9090640 1 --2- 172.21.15.40:0/3481420853 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2fb40d0d70 0x7f2fb40b0e70 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f2fac009dc0 tx=0x7f2fac02bce0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ac27c2761c0355e3 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:48:13.153 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:13.151+0000 7f2fb37fe640 1 -- 172.21.15.40:0/3481420853 <== mon.2 v2:172.21.15.159:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fac02ca10 con 0x7f2fb40d0d70 2023-12-17T11:48:13.153 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:13.151+0000 7f2fb37fe640 1 -- 172.21.15.40:0/3481420853 <== mon.2 v2:172.21.15.159:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fac02cb70 con 0x7f2fb40d0d70 2023-12-17T11:48:13.153 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:13.151+0000 7f2fb37fe640 1 -- 172.21.15.40:0/3481420853 <== mon.2 v2:172.21.15.159:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fac034440 con 0x7f2fb40d0d70 2023-12-17T11:48:13.154 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:13.151+0000 7f2fb9891640 1 -- 172.21.15.40:0/3481420853 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2fb40d0d70 msgr2=0x7f2fb40b0e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:13.154 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:13.151+0000 7f2fb9891640 1 --2- 172.21.15.40:0/3481420853 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2fb40d0d70 0x7f2fb40b0e70 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f2fac009dc0 tx=0x7f2fac02bce0 comp rx=0 tx=0).stop 2023-12-17T11:48:13.154 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:13.151+0000 7f2fb9891640 1 -- 172.21.15.40:0/3481420853 shutdown_connections 2023-12-17T11:48:13.154 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:13.152+0000 7f2fb9891640 1 --2- 172.21.15.40:0/3481420853 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2fb40d0d70 0x7f2fb40b0e70 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:13.154 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:13.152+0000 7f2fb9891640 1 -- 172.21.15.40:0/3481420853 >> 172.21.15.40:0/3481420853 conn(0x7f2fb409c260 msgr2=0x7f2fb40d2f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:48:13.154 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:13.152+0000 7f2fb9891640 1 -- 172.21.15.40:0/3481420853 shutdown_connections 2023-12-17T11:48:13.154 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:13.152+0000 7f2fb9891640 1 -- 172.21.15.40:0/3481420853 wait complete. 2023-12-17T11:48:13.155 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:13.153+0000 7f2fb9891640 1 Processor -- start 2023-12-17T11:48:13.155 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:13.153+0000 7f2fb9891640 1 -- start start 2023-12-17T11:48:13.157 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:13.154+0000 7f2fb9891640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2fb40ce5b0 0x7f2fb415c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:13.157 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:13.154+0000 7f2fb9891640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2fb40d0d70 0x7f2fb40ccbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:13.157 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:13.154+0000 7f2fb9891640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2fb40d13c0 0x7f2fb4154060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:13.157 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:13.154+0000 7f2fb9891640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fb40cc730 con 0x7f2fb40d13c0 2023-12-17T11:48:13.157 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:13.154+0000 7f2fb9891640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fb41545a0 con 0x7f2fb40d0d70 2023-12-17T11:48:13.157 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:13.154+0000 7f2fb9891640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2fb40cbb20 con 0x7f2fb40ce5b0 2023-12-17T11:48:13.157 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:13.155+0000 7f2fb9090640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2fb40d13c0 0x7f2fb4154060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:13.158 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:13.155+0000 7f2fb9090640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2fb40d13c0 0x7f2fb4154060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:47790/0 (socket says 172.21.15.40:47790) 2023-12-17T11:48:13.158 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:13.155+0000 7f2fb9090640 1 -- 172.21.15.40:0/130473475 learned_addr learned my addr 172.21.15.40:0/130473475 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-17T11:48:13.158 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:13.155+0000 7f2fb3fff640 1 --2- 172.21.15.40:0/130473475 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2fb40d0d70 0x7f2fb40ccbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:13.158 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:13.155+0000 7f2fb888f640 1 --2- 172.21.15.40:0/130473475 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2fb40ce5b0 0x7f2fb415c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:13.158 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:13.155+0000 7f2fb9090640 1 -- 172.21.15.40:0/130473475 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2fb40ce5b0 msgr2=0x7f2fb415c2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:13.158 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:13.155+0000 7f2fb9090640 1 --2- 172.21.15.40:0/130473475 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2fb40ce5b0 0x7f2fb415c2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:13.158 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:13.155+0000 7f2fb9090640 1 -- 172.21.15.40:0/130473475 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2fb40d0d70 msgr2=0x7f2fb40ccbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:13.158 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:13.155+0000 7f2fb9090640 1 --2- 172.21.15.40:0/130473475 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2fb40d0d70 0x7f2fb40ccbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:13.158 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:13.155+0000 7f2fb9090640 1 -- 172.21.15.40:0/130473475 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fac009a70 con 0x7f2fb40d13c0 2023-12-17T11:48:13.159 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:13.156+0000 7f2fb9090640 1 --2- 172.21.15.40:0/130473475 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2fb40d13c0 0x7f2fb4154060 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f2fac037040 tx=0x7f2fac004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:48:13.159 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:13.156+0000 7f2fb17fa640 1 -- 172.21.15.40:0/130473475 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fac03e610 con 0x7f2fb40d13c0 2023-12-17T11:48:13.159 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:13.156+0000 7f2fb17fa640 1 -- 172.21.15.40:0/130473475 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fac03e770 con 0x7f2fb40d13c0 2023-12-17T11:48:13.159 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:13.156+0000 7f2fb17fa640 1 -- 172.21.15.40:0/130473475 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fac03eb00 con 0x7f2fb40d13c0 2023-12-17T11:48:13.159 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:13.156+0000 7f2fb9891640 1 -- 172.21.15.40:0/130473475 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2fb40cbe00 con 0x7f2fb40d13c0 2023-12-17T11:48:13.159 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:13.156+0000 7f2fb9891640 1 -- 172.21.15.40:0/130473475 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2fb40cc3c0 con 0x7f2fb40d13c0 2023-12-17T11:48:13.160 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:13.157+0000 7f2fb9891640 1 -- 172.21.15.40:0/130473475 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2fb40b0220 con 0x7f2fb40d13c0 2023-12-17T11:48:13.160 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:13.158+0000 7f2fb17fa640 1 -- 172.21.15.40:0/130473475 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f2fac03b050 con 0x7f2fb40d13c0 2023-12-17T11:48:13.161 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:13.159+0000 7f2fb17fa640 1 --2- 172.21.15.40:0/130473475 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f2f9806ae40 0x7f2f9806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:13.161 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:13.159+0000 7f2fb17fa640 1 -- 172.21.15.40:0/130473475 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f2fac0abc00 con 0x7f2fb40d13c0 2023-12-17T11:48:13.161 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:13.160+0000 7f2fb888f640 1 --2- 172.21.15.40:0/130473475 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f2f9806ae40 0x7f2f9806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:13.162 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:13.160+0000 7f2fb888f640 1 --2- 172.21.15.40:0/130473475 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f2f9806ae40 0x7f2f9806d300 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f2fa8000f60 tx=0x7f2fa8007e40 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:48:13.168 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:13.164+0000 7f2fb17fa640 1 -- 172.21.15.40:0/130473475 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f2fb40b0220 con 0x7f2fb40d13c0 2023-12-17T11:48:13.357 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:13.354+0000 7f2fb9891640 1 -- 172.21.15.40:0/130473475 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2fb40b0220 con 0x7f2fb40d13c0 2023-12-17T11:48:13.358 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:13.356+0000 7f2fb17fa640 1 -- 172.21.15.40:0/130473475 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) v1 ==== 74+0+12826 (secure 0 0 0) 0x7f2fb40b0220 con 0x7f2fb40d13c0 2023-12-17T11:48:13.358 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T11:48:13.358 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":17,"fsid":"099cd35d-80d9-4ca4-8424-de13b3b03ac7","created":"2023-12-17T11:47:53.450097+0000","modified":"2023-12-17T11:48:08.736207+0000","last_up_change":"2023-12-17T11:48:05.724195+0000","last_in_change":"2023-12-17T11:47:56.956499+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-17T11:48:06.668943+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a88bfd46-63b8-48b1-9c0e-5c9cdc31bd38","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":555204741},{"type":"v1","addr":"172.21.15.40:6802","nonce":555204741}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":555204741},{"type":"v1","addr":"172.21.15.40:6807","nonce":555204741}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":555204741},{"type":"v1","addr":"172.21.15.40:6815","nonce":555204741}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6809","nonce":555204741},{"type":"v1","addr":"172.21.15.40:6812","nonce":555204741}]},"public_addr":"172.21.15.40:6802/555204741","cluster_addr":"172.21.15.40:6807/555204741","heartbeat_back_addr":"172.21.15.40:6815/555204741","heartbeat_front_addr":"172.21.15.40:6812/555204741","state":["exists","up"]},{"osd":1,"uuid":"c5d628ae-36f4-4866-802c-b162f0e90add","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6801","nonce":1221318112},{"type":"v1","addr":"172.21.15.40:6803","nonce":1221318112}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6805","nonce":1221318112},{"type":"v1","addr":"172.21.15.40:6806","nonce":1221318112}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6811","nonce":1221318112},{"type":"v1","addr":"172.21.15.40:6813","nonce":1221318112}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":1221318112},{"type":"v1","addr":"172.21.15.40:6810","nonce":1221318112}]},"public_addr":"172.21.15.40:6803/1221318112","cluster_addr":"172.21.15.40:6806/1221318112","heartbeat_back_addr":"172.21.15.40:6813/1221318112","heartbeat_front_addr":"172.21.15.40:6810/1221318112","state":["exists","up"]},{"osd":2,"uuid":"d986ad6a-af2f-47fc-9c3b-fbda27b82b73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":1959000265},{"type":"v1","addr":"172.21.15.40:6817","nonce":1959000265}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6818","nonce":1959000265},{"type":"v1","addr":"172.21.15.40:6819","nonce":1959000265}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":1959000265},{"type":"v1","addr":"172.21.15.40:6827","nonce":1959000265}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":1959000265},{"type":"v1","addr":"172.21.15.40:6822","nonce":1959000265}]},"public_addr":"172.21.15.40:6817/1959000265","cluster_addr":"172.21.15.40:6819/1959000265","heartbeat_back_addr":"172.21.15.40:6827/1959000265","heartbeat_front_addr":"172.21.15.40:6822/1959000265","state":["exists","up"]},{"osd":3,"uuid":"d79d22b7-be05-41b2-b95d-697db677fd02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6821","nonce":974040287},{"type":"v1","addr":"172.21.15.40:6823","nonce":974040287}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6825","nonce":974040287},{"type":"v1","addr":"172.21.15.40:6826","nonce":974040287}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":974040287},{"type":"v1","addr":"172.21.15.40:6831","nonce":974040287}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":974040287},{"type":"v1","addr":"172.21.15.40:6829","nonce":974040287}]},"public_addr":"172.21.15.40:6823/974040287","cluster_addr":"172.21.15.40:6826/974040287","heartbeat_back_addr":"172.21.15.40:6831/974040287","heartbeat_front_addr":"172.21.15.40:6829/974040287","state":["exists","up"]},{"osd":4,"uuid":"62a7a233-d3ea-40be-91de-180c0208d639","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6808","nonce":3937787733},{"type":"v1","addr":"172.21.15.159:6809","nonce":3937787733}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6810","nonce":3937787733},{"type":"v1","addr":"172.21.15.159:6811","nonce":3937787733}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6814","nonce":3937787733},{"type":"v1","addr":"172.21.15.159:6815","nonce":3937787733}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6812","nonce":3937787733},{"type":"v1","addr":"172.21.15.159:6813","nonce":3937787733}]},"public_addr":"172.21.15.159:6809/3937787733","cluster_addr":"172.21.15.159:6811/3937787733","heartbeat_back_addr":"172.21.15.159:6815/3937787733","heartbeat_front_addr":"172.21.15.159:6813/3937787733","state":["exists","up"]},{"osd":5,"uuid":"84629cea-dc0e-4b5e-b203-5ea963839281","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6816","nonce":3032505240},{"type":"v1","addr":"172.21.15.159:6817","nonce":3032505240}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6818","nonce":3032505240},{"type":"v1","addr":"172.21.15.159:6819","nonce":3032505240}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6822","nonce":3032505240},{"type":"v1","addr":"172.21.15.159:6823","nonce":3032505240}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6820","nonce":3032505240},{"type":"v1","addr":"172.21.15.159:6821","nonce":3032505240}]},"public_addr":"172.21.15.159:6817/3032505240","cluster_addr":"172.21.15.159:6819/3032505240","heartbeat_back_addr":"172.21.15.159:6823/3032505240","heartbeat_front_addr":"172.21.15.159:6821/3032505240","state":["exists","up"]},{"osd":6,"uuid":"4ae3af3a-1743-4070-a91d-8be5c31cdb04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6800","nonce":2411788597},{"type":"v1","addr":"172.21.15.159:6801","nonce":2411788597}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6802","nonce":2411788597},{"type":"v1","addr":"172.21.15.159:6803","nonce":2411788597}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6806","nonce":2411788597},{"type":"v1","addr":"172.21.15.159:6807","nonce":2411788597}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6804","nonce":2411788597},{"type":"v1","addr":"172.21.15.159:6805","nonce":2411788597}]},"public_addr":"172.21.15.159:6801/2411788597","cluster_addr":"172.21.15.159:6803/2411788597","heartbeat_back_addr":"172.21.15.159:6807/2411788597","heartbeat_front_addr":"172.21.15.159:6805/2411788597","state":["exists","up"]},{"osd":7,"uuid":"c1f4c7f2-8f75-4f95-bc63-a332773e3b8e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6824","nonce":478953349},{"type":"v1","addr":"172.21.15.159:6825","nonce":478953349}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6826","nonce":478953349},{"type":"v1","addr":"172.21.15.159:6827","nonce":478953349}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6830","nonce":478953349},{"type":"v1","addr":"172.21.15.159:6831","nonce":478953349}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6828","nonce":478953349},{"type":"v1","addr":"172.21.15.159:6829","nonce":478953349}]},"public_addr":"172.21.15.159:6825/478953349","cluster_addr":"172.21.15.159:6827/478953349","heartbeat_back_addr":"172.21.15.159:6831/478953349","heartbeat_front_addr":"172.21.15.159:6829/478953349","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T11:48:02.023567+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T11:48:02.278216+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T11:48:02.311843+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T11:48:01.773372+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T11:48:02.618910+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T11:48:02.361559+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T11:48:02.223997+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T11:48:02.604403+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-17T11:48:13.361 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:13.358+0000 7f2fb9891640 1 -- 172.21.15.40:0/130473475 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f2f9806ae40 msgr2=0x7f2f9806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:13.361 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:13.358+0000 7f2fb9891640 1 --2- 172.21.15.40:0/130473475 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f2f9806ae40 0x7f2f9806d300 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f2fa8000f60 tx=0x7f2fa8007e40 comp rx=0 tx=0).stop 2023-12-17T11:48:13.361 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:13.358+0000 7f2fb9891640 1 -- 172.21.15.40:0/130473475 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2fb40d13c0 msgr2=0x7f2fb4154060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:13.361 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:13.358+0000 7f2fb9891640 1 --2- 172.21.15.40:0/130473475 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2fb40d13c0 0x7f2fb4154060 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f2fac037040 tx=0x7f2fac004a40 comp rx=0 tx=0).stop 2023-12-17T11:48:13.361 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:13.358+0000 7f2fb9891640 1 -- 172.21.15.40:0/130473475 shutdown_connections 2023-12-17T11:48:13.361 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:13.358+0000 7f2fb9891640 1 --2- 172.21.15.40:0/130473475 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f2f9806ae40 0x7f2f9806d300 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:13.361 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:13.358+0000 7f2fb9891640 1 --2- 172.21.15.40:0/130473475 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2fb40d13c0 0x7f2fb4154060 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:13.361 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:13.358+0000 7f2fb9891640 1 --2- 172.21.15.40:0/130473475 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2fb40d0d70 0x7f2fb40ccbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:13.361 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:13.358+0000 7f2fb9891640 1 --2- 172.21.15.40:0/130473475 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2fb40ce5b0 0x7f2fb415c2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:13.362 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:13.358+0000 7f2fb9891640 1 -- 172.21.15.40:0/130473475 >> 172.21.15.40:0/130473475 conn(0x7f2fb409c260 msgr2=0x7f2fb40cf370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:48:13.362 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:13.359+0000 7f2fb9891640 1 -- 172.21.15.40:0/130473475 shutdown_connections 2023-12-17T11:48:13.362 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:13.359+0000 7f2fb9891640 1 -- 172.21.15.40:0/130473475 wait complete. 2023-12-17T11:48:13.380 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-17T11:48:06.668943+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-17T11:48:13.380 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-17T11:48:13.582 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:13.580+0000 7f03ae3f4640 1 Processor -- start 2023-12-17T11:48:13.582 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:13.580+0000 7f03ae3f4640 1 -- start start 2023-12-17T11:48:13.584 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:13.582+0000 7f03ae3f4640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f03a80b3350 0x7f03a80b3ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:13.584 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:13.582+0000 7f03ae3f4640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f03a80cfe70 0x7f03a80cdef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:13.584 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:13.582+0000 7f03ae3f4640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03a80c6b80 con 0x7f03a80b3730 2023-12-17T11:48:13.584 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:13.582+0000 7f03ae3f4640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03a80d3bf0 con 0x7f03a80cfe70 2023-12-17T11:48:13.584 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:13.582+0000 7f03ae3f4640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03a80d3ed0 con 0x7f03a80b3350 2023-12-17T11:48:13.584 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:13.582+0000 7f03acbf1640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f03a80b3730 0x7f03a80cf760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:43434/0 (socket says 172.21.15.40:43434) 2023-12-17T11:48:13.584 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:13.582+0000 7f03acbf1640 1 -- 172.21.15.40:0/288005441 learned_addr learned my addr 172.21.15.40:0/288005441 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-12-17T11:48:13.587 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:13.582+0000 7f03ad3f2640 1 --2- 172.21.15.40:0/288005441 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f03a80b3350 0x7f03a80b3ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:13.587 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:13.583+0000 7f03adbf3640 1 --2- 172.21.15.40:0/288005441 >> v2:172.21.15.159:3300/0 conn(0x7f03a80cfe70 0x7f03a80cdef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:13.587 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:13.583+0000 7f039ffff640 1 -- 172.21.15.40:0/288005441 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 311700350 0 0) 0x7f03a80c6b80 con 0x7f03a80b3730 2023-12-17T11:48:13.587 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:13.583+0000 7f039ffff640 1 -- 172.21.15.40:0/288005441 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0394003520 con 0x7f03a80b3730 2023-12-17T11:48:13.587 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:13.583+0000 7f039ffff640 1 -- 172.21.15.40:0/288005441 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2417071123 0 0) 0x7f0394003520 con 0x7f03a80b3730 2023-12-17T11:48:13.587 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:13.583+0000 7f039ffff640 1 -- 172.21.15.40:0/288005441 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f03a80b3350 msgr2=0x7f03a80b3ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:48:13.587 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:13.583+0000 7f039ffff640 1 --2- 172.21.15.40:0/288005441 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f03a80b3350 0x7f03a80b3ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:13.587 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:13.583+0000 7f039ffff640 1 -- 172.21.15.40:0/288005441 >> v2:172.21.15.159:3300/0 conn(0x7f03a80cfe70 msgr2=0x7f03a80cdef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:48:13.588 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:13.583+0000 7f039ffff640 1 --2- 172.21.15.40:0/288005441 >> v2:172.21.15.159:3300/0 conn(0x7f03a80cfe70 0x7f03a80cdef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:13.588 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:13.583+0000 7f039ffff640 1 -- 172.21.15.40:0/288005441 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03a80d18c0 con 0x7f03a80b3730 2023-12-17T11:48:13.588 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:13.583+0000 7f039ffff640 1 -- 172.21.15.40:0/288005441 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2643242555 0 0) 0x7f0398001670 con 0x7f03a80b3730 2023-12-17T11:48:13.588 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:13.583+0000 7f039ffff640 1 -- 172.21.15.40:0/288005441 >> v1:172.21.15.40:6789/0 conn(0x7f03a80b3730 legacy=0x7f03a80cf760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:13.588 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:13.583+0000 7f039ffff640 1 --2- 172.21.15.40:0/288005441 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0394003970 0x7f0394003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:13.588 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:13.583+0000 7f039ffff640 1 --2- 172.21.15.40:0/288005441 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f03a80b3350 0x7f03940047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:13.588 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:13.583+0000 7f039ffff640 1 --2- 172.21.15.40:0/288005441 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0394004d00 0x7f0394005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:13.588 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:13.583+0000 7f039ffff640 1 -- 172.21.15.40:0/288005441 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03a80d3bf0 con 0x7f0394003970 2023-12-17T11:48:13.588 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:13.583+0000 7f039ffff640 1 -- 172.21.15.40:0/288005441 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03a80d3ed0 con 0x7f0394004d00 2023-12-17T11:48:13.588 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:13.583+0000 7f039ffff640 1 -- 172.21.15.40:0/288005441 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f039400b980 con 0x7f03a80b3350 2023-12-17T11:48:13.588 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:13.583+0000 7f03ad3f2640 1 --2- 172.21.15.40:0/288005441 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0394003970 0x7f0394003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:13.589 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:13.584+0000 7f03ad3f2640 1 -- 172.21.15.40:0/288005441 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f03a80b3350 msgr2=0x7f03940047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:48:13.589 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:13.584+0000 7f03ad3f2640 1 --2- 172.21.15.40:0/288005441 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f03a80b3350 0x7f03940047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:13.589 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:13.584+0000 7f03ad3f2640 1 -- 172.21.15.40:0/288005441 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0394004d00 msgr2=0x7f0394005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:48:13.589 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:13.584+0000 7f03ad3f2640 1 --2- 172.21.15.40:0/288005441 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0394004d00 0x7f0394005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:13.589 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:13.584+0000 7f03ad3f2640 1 -- 172.21.15.40:0/288005441 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0394003520 con 0x7f0394003970 2023-12-17T11:48:13.589 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:13.585+0000 7f03ad3f2640 1 --2- 172.21.15.40:0/288005441 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0394003970 0x7f0394003d90 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f03a4009ac0 tx=0x7f03940057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b5790b3765d7526 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:48:13.589 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:13.585+0000 7f039ffff640 1 -- 172.21.15.40:0/288005441 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03a402c710 con 0x7f0394003970 2023-12-17T11:48:13.589 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:13.585+0000 7f039ffff640 1 -- 172.21.15.40:0/288005441 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03a402c870 con 0x7f0394003970 2023-12-17T11:48:13.589 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:13.585+0000 7f039ffff640 1 -- 172.21.15.40:0/288005441 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03a402cc00 con 0x7f0394003970 2023-12-17T11:48:13.592 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:13.585+0000 7f03ae3f4640 1 -- 172.21.15.40:0/288005441 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0394003970 msgr2=0x7f0394003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:13.592 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:13.585+0000 7f03ae3f4640 1 --2- 172.21.15.40:0/288005441 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0394003970 0x7f0394003d90 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f03a4009ac0 tx=0x7f03940057f0 comp rx=0 tx=0).stop 2023-12-17T11:48:13.592 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:13.585+0000 7f03adbf3640 1 -- 172.21.15.40:0/288005441 reap_dead start 2023-12-17T11:48:13.592 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:13.586+0000 7f03ae3f4640 1 -- 172.21.15.40:0/288005441 shutdown_connections 2023-12-17T11:48:13.592 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:13.586+0000 7f03ae3f4640 1 -- 172.21.15.40:0/288005441 >> 172.21.15.40:0/288005441 conn(0x7f03a80d3030 msgr2=0x7f03a80d3440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:48:13.592 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:13.586+0000 7f03ae3f4640 1 -- 172.21.15.40:0/288005441 shutdown_connections 2023-12-17T11:48:13.592 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:13.586+0000 7f03ae3f4640 1 -- 172.21.15.40:0/288005441 wait complete. 2023-12-17T11:48:13.592 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:13.587+0000 7f03ae3f4640 1 Processor -- start 2023-12-17T11:48:13.592 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:13.587+0000 7f03ae3f4640 1 -- start start 2023-12-17T11:48:13.592 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:13.588+0000 7f03ae3f4640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0394003970 0x7f03a80afbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:13.592 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:13.588+0000 7f03ae3f4640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f03a8154db0 0x7f03a80cac70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:13.593 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:13.588+0000 7f03ae3f4640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f03a8155230 0x7f03a80cb1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:13.593 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:13.588+0000 7f03ae3f4640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03a80b6920 con 0x7f0394003970 2023-12-17T11:48:13.593 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:13.588+0000 7f03ae3f4640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03a80b70e0 con 0x7f03a8155230 2023-12-17T11:48:13.593 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:13.588+0000 7f03ae3f4640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03a80b73c0 con 0x7f03a8154db0 2023-12-17T11:48:13.593 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:13.589+0000 7f03ad3f2640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0394003970 0x7f03a80afbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:13.593 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:13.589+0000 7f03ad3f2640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0394003970 0x7f03a80afbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:47812/0 (socket says 172.21.15.40:47812) 2023-12-17T11:48:13.593 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:13.589+0000 7f03ad3f2640 1 -- 172.21.15.40:0/3236463376 learned_addr learned my addr 172.21.15.40:0/3236463376 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-17T11:48:13.593 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:13.589+0000 7f03ad3f2640 1 -- 172.21.15.40:0/3236463376 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f03a8154db0 msgr2=0x7f03a80cac70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:13.593 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:13.589+0000 7f03ad3f2640 1 --2- 172.21.15.40:0/3236463376 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f03a8154db0 0x7f03a80cac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:13.593 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:13.589+0000 7f03ad3f2640 1 -- 172.21.15.40:0/3236463376 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f03a8155230 msgr2=0x7f03a80cb1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:13.593 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:13.589+0000 7f03ad3f2640 1 --2- 172.21.15.40:0/3236463376 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f03a8155230 0x7f03a80cb1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:13.593 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:13.589+0000 7f03ad3f2640 1 -- 172.21.15.40:0/3236463376 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03a80b48a0 con 0x7f0394003970 2023-12-17T11:48:13.593 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:13.589+0000 7f03ad3f2640 1 --2- 172.21.15.40:0/3236463376 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0394003970 0x7f03a80afbf0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f03a402c2b0 tx=0x7f03a4004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:48:13.594 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:13.589+0000 7f039dffb640 1 -- 172.21.15.40:0/3236463376 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03a4003810 con 0x7f0394003970 2023-12-17T11:48:13.594 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:13.589+0000 7f039dffb640 1 -- 172.21.15.40:0/3236463376 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03a402de90 con 0x7f0394003970 2023-12-17T11:48:13.594 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:13.589+0000 7f039dffb640 1 -- 172.21.15.40:0/3236463376 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03a4003b90 con 0x7f0394003970 2023-12-17T11:48:13.594 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:13.589+0000 7f03ae3f4640 1 -- 172.21.15.40:0/3236463376 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03a80b76a0 con 0x7f0394003970 2023-12-17T11:48:13.594 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:13.590+0000 7f03ae3f4640 1 -- 172.21.15.40:0/3236463376 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03a80b0130 con 0x7f0394003970 2023-12-17T11:48:13.594 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:13.591+0000 7f03ae3f4640 1 -- 172.21.15.40:0/3236463376 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03a8074450 con 0x7f0394003970 2023-12-17T11:48:13.595 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:13.592+0000 7f039dffb640 1 -- 172.21.15.40:0/3236463376 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f03a4003cf0 con 0x7f0394003970 2023-12-17T11:48:13.595 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:13.592+0000 7f039dffb640 1 --2- 172.21.15.40:0/3236463376 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f038c06ae40 0x7f038c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:13.595 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:13.593+0000 7f039dffb640 1 -- 172.21.15.40:0/3236463376 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f03a40ab270 con 0x7f0394003970 2023-12-17T11:48:13.595 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:13.593+0000 7f03acbf1640 1 --2- 172.21.15.40:0/3236463376 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f038c06ae40 0x7f038c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:13.596 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:13.594+0000 7f03acbf1640 1 --2- 172.21.15.40:0/3236463376 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f038c06ae40 0x7f038c06d300 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f03a80b6fd0 tx=0x7f0398001550 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:48:13.599 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:13.597+0000 7f039dffb640 1 -- 172.21.15.40:0/3236463376 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f03a40767a0 con 0x7f0394003970 2023-12-17T11:48:13.784 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:13.782+0000 7f03ae3f4640 1 -- 172.21.15.40:0/3236463376 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f03a80b46d0 con 0x7f0394003970 2023-12-17T11:48:13.785 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:13.782+0000 7f039dffb640 1 -- 172.21.15.40:0/3236463376 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v17) v1 ==== 93+0+10 (secure 0 0 0) 0x7f03a4079dc0 con 0x7f0394003970 2023-12-17T11:48:13.785 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 1 2023-12-17T11:48:13.787 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:13.785+0000 7f03ae3f4640 1 -- 172.21.15.40:0/3236463376 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f038c06ae40 msgr2=0x7f038c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:13.787 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:13.785+0000 7f03ae3f4640 1 --2- 172.21.15.40:0/3236463376 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f038c06ae40 0x7f038c06d300 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f03a80b6fd0 tx=0x7f0398001550 comp rx=0 tx=0).stop 2023-12-17T11:48:13.787 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:13.785+0000 7f03ae3f4640 1 -- 172.21.15.40:0/3236463376 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0394003970 msgr2=0x7f03a80afbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:13.787 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:13.785+0000 7f03ae3f4640 1 --2- 172.21.15.40:0/3236463376 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0394003970 0x7f03a80afbf0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f03a402c2b0 tx=0x7f03a4004730 comp rx=0 tx=0).stop 2023-12-17T11:48:13.787 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:13.785+0000 7f03ae3f4640 1 -- 172.21.15.40:0/3236463376 shutdown_connections 2023-12-17T11:48:13.787 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:13.785+0000 7f03ae3f4640 1 --2- 172.21.15.40:0/3236463376 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f038c06ae40 0x7f038c06d300 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:13.787 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:13.785+0000 7f03ae3f4640 1 --2- 172.21.15.40:0/3236463376 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f03a8155230 0x7f03a80cb1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:13.788 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:13.785+0000 7f03ae3f4640 1 --2- 172.21.15.40:0/3236463376 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f03a8154db0 0x7f03a80cac70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:13.788 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:13.785+0000 7f03ae3f4640 1 --2- 172.21.15.40:0/3236463376 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0394003970 0x7f03a80afbf0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:13.788 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:13.785+0000 7f03ae3f4640 1 -- 172.21.15.40:0/3236463376 >> 172.21.15.40:0/3236463376 conn(0x7f03a80d3030 msgr2=0x7f03a80b3b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:48:13.788 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:13.785+0000 7f03ae3f4640 1 -- 172.21.15.40:0/3236463376 shutdown_connections 2023-12-17T11:48:13.788 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:13.785+0000 7f03ae3f4640 1 -- 172.21.15.40:0/3236463376 wait complete. 2023-12-17T11:48:13.804 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-17T11:48:14.018 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:14.016+0000 7fd9c9b6c640 1 Processor -- start 2023-12-17T11:48:14.018 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:14.016+0000 7fd9c9b6c640 1 -- start start 2023-12-17T11:48:14.020 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:14.018+0000 7fd9c9b6c640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fd9c40b35c0 0x7fd9c406a460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:14.020 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:14.018+0000 7fd9c9b6c640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd9c4146320 0x7fd9c406a9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:14.020 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:14.018+0000 7fd9c9b6c640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9c4146150 con 0x7fd9c4146870 2023-12-17T11:48:14.020 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:14.018+0000 7fd9c9b6c640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9c40b5060 con 0x7fd9c40b35c0 2023-12-17T11:48:14.020 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:14.018+0000 7fd9c9b6c640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9c40cfa50 con 0x7fd9c4146320 2023-12-17T11:48:14.021 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:14.018+0000 7fd9c8b6a640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fd9c40b35c0 0x7fd9c406a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:14.021 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:14.018+0000 7fd9c936b640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fd9c4146870 0x7fd9c4160c70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:43446/0 (socket says 172.21.15.40:43446) 2023-12-17T11:48:14.021 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:14.018+0000 7fd9c936b640 1 -- 172.21.15.40:0/1132635391 learned_addr learned my addr 172.21.15.40:0/1132635391 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-12-17T11:48:14.021 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:14.018+0000 7fd9c3fff640 1 --2- 172.21.15.40:0/1132635391 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd9c4146320 0x7fd9c406a9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:14.021 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:14.019+0000 7fd9c8b6a640 1 -- 172.21.15.40:0/1132635391 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd9c4146320 msgr2=0x7fd9c406a9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:48:14.021 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:14.019+0000 7fd9c37fe640 1 -- 172.21.15.40:0/1132635391 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4252127990 0 0) 0x7fd9c4146150 con 0x7fd9c4146870 2023-12-17T11:48:14.022 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:14.019+0000 7fd9c8b6a640 1 --2- 172.21.15.40:0/1132635391 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd9c4146320 0x7fd9c406a9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:14.022 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:14.019+0000 7fd9c8b6a640 1 -- 172.21.15.40:0/1132635391 >> v1:172.21.15.40:6789/0 conn(0x7fd9c4146870 legacy=0x7fd9c4160c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:14.022 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:14.019+0000 7fd9c8b6a640 1 -- 172.21.15.40:0/1132635391 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9c40cfd30 con 0x7fd9c40b35c0 2023-12-17T11:48:14.022 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:14.019+0000 7fd9c3fff640 1 --2- 172.21.15.40:0/1132635391 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd9c4146320 0x7fd9c406a9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-17T11:48:14.022 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:14.020+0000 7fd9c8b6a640 1 --2- 172.21.15.40:0/1132635391 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd9c40b35c0 0x7fd9c406a460 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fd9b80097a0 tx=0x7fd9b802b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52252fa74623d7c7 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:48:14.022 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:14.021+0000 7fd9c37fe640 1 -- 172.21.15.40:0/1132635391 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9b802d040 con 0x7fd9c40b35c0 2023-12-17T11:48:14.023 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:14.021+0000 7fd9c37fe640 1 -- 172.21.15.40:0/1132635391 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9b8031810 con 0x7fd9c40b35c0 2023-12-17T11:48:14.023 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:14.021+0000 7fd9c37fe640 1 -- 172.21.15.40:0/1132635391 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9b8031ba0 con 0x7fd9c40b35c0 2023-12-17T11:48:14.023 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:14.021+0000 7fd9c9b6c640 1 -- 172.21.15.40:0/1132635391 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd9c40b35c0 msgr2=0x7fd9c406a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:14.023 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:14.021+0000 7fd9c9b6c640 1 --2- 172.21.15.40:0/1132635391 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd9c40b35c0 0x7fd9c406a460 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fd9b80097a0 tx=0x7fd9b802b8b0 comp rx=0 tx=0).stop 2023-12-17T11:48:14.024 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:14.021+0000 7fd9c9b6c640 1 -- 172.21.15.40:0/1132635391 shutdown_connections 2023-12-17T11:48:14.024 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:14.021+0000 7fd9c9b6c640 1 --2- 172.21.15.40:0/1132635391 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd9c4146320 0x7fd9c406a9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:14.024 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:14.021+0000 7fd9c9b6c640 1 --2- 172.21.15.40:0/1132635391 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd9c40b35c0 0x7fd9c406a460 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:14.024 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:14.021+0000 7fd9c9b6c640 1 -- 172.21.15.40:0/1132635391 >> 172.21.15.40:0/1132635391 conn(0x7fd9c40b1840 msgr2=0x7fd9c40b1c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:48:14.024 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:14.021+0000 7fd9c9b6c640 1 -- 172.21.15.40:0/1132635391 shutdown_connections 2023-12-17T11:48:14.024 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:14.021+0000 7fd9c9b6c640 1 -- 172.21.15.40:0/1132635391 wait complete. 2023-12-17T11:48:14.025 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:14.023+0000 7fd9c9b6c640 1 Processor -- start 2023-12-17T11:48:14.025 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:14.023+0000 7fd9c9b6c640 1 -- start start 2023-12-17T11:48:14.027 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:14.024+0000 7fd9c9b6c640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd9c4146320 0x7fd9c415c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:14.027 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:14.024+0000 7fd9c9b6c640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd9c4146870 0x7fd9c4135b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:14.027 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:14.024+0000 7fd9c9b6c640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd9c40c4f10 0x7fd9c4160c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:14.027 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:14.024+0000 7fd9c9b6c640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9c4138fc0 con 0x7fd9c4146320 2023-12-17T11:48:14.027 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:14.024+0000 7fd9c9b6c640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9c40c5480 con 0x7fd9c4146870 2023-12-17T11:48:14.027 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:14.024+0000 7fd9c9b6c640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9c41f6c40 con 0x7fd9c40c4f10 2023-12-17T11:48:14.027 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:14.024+0000 7fd9c8b6a640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd9c4146320 0x7fd9c415c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:14.027 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:14.024+0000 7fd9c8b6a640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd9c4146320 0x7fd9c415c9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:47844/0 (socket says 172.21.15.40:47844) 2023-12-17T11:48:14.027 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:14.024+0000 7fd9c8b6a640 1 -- 172.21.15.40:0/1601173566 learned_addr learned my addr 172.21.15.40:0/1601173566 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-17T11:48:14.028 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:14.025+0000 7fd9c3fff640 1 --2- 172.21.15.40:0/1601173566 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd9c4146870 0x7fd9c4135b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:14.028 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:14.025+0000 7fd9c936b640 1 --2- 172.21.15.40:0/1601173566 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd9c40c4f10 0x7fd9c4160c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:14.028 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:14.025+0000 7fd9c8b6a640 1 -- 172.21.15.40:0/1601173566 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd9c40c4f10 msgr2=0x7fd9c4160c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:14.028 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:14.025+0000 7fd9c8b6a640 1 --2- 172.21.15.40:0/1601173566 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd9c40c4f10 0x7fd9c4160c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:14.028 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:14.025+0000 7fd9c8b6a640 1 -- 172.21.15.40:0/1601173566 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd9c4146870 msgr2=0x7fd9c4135b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:14.028 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:14.025+0000 7fd9c8b6a640 1 --2- 172.21.15.40:0/1601173566 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd9c4146870 0x7fd9c4135b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:14.028 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:14.025+0000 7fd9c8b6a640 1 -- 172.21.15.40:0/1601173566 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9b8009400 con 0x7fd9c4146320 2023-12-17T11:48:14.028 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:14.025+0000 7fd9c3fff640 1 --2- 172.21.15.40:0/1601173566 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd9c4146870 0x7fd9c4135b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-17T11:48:14.028 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:14.025+0000 7fd9c936b640 1 --2- 172.21.15.40:0/1601173566 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd9c40c4f10 0x7fd9c4160c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-17T11:48:14.028 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:14.025+0000 7fd9c8b6a640 1 --2- 172.21.15.40:0/1601173566 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd9c4146320 0x7fd9c415c9b0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fd9b8000c00 tx=0x7fd9b80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:48:14.029 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:14.025+0000 7fd9c17fa640 1 -- 172.21.15.40:0/1601173566 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9b803ad60 con 0x7fd9c4146320 2023-12-17T11:48:14.029 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:14.026+0000 7fd9c17fa640 1 -- 172.21.15.40:0/1601173566 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9b80443f0 con 0x7fd9c4146320 2023-12-17T11:48:14.029 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:14.026+0000 7fd9c17fa640 1 -- 172.21.15.40:0/1601173566 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9b80447a0 con 0x7fd9c4146320 2023-12-17T11:48:14.029 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:14.026+0000 7fd9c9b6c640 1 -- 172.21.15.40:0/1601173566 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9c4136090 con 0x7fd9c4146320 2023-12-17T11:48:14.029 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:14.026+0000 7fd9c9b6c640 1 -- 172.21.15.40:0/1601173566 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9c41f6310 con 0x7fd9c4146320 2023-12-17T11:48:14.030 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:14.027+0000 7fd9c9b6c640 1 -- 172.21.15.40:0/1601173566 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9c40673f0 con 0x7fd9c4146320 2023-12-17T11:48:14.030 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:14.028+0000 7fd9c17fa640 1 -- 172.21.15.40:0/1601173566 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fd9b804d450 con 0x7fd9c4146320 2023-12-17T11:48:14.030 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:14.029+0000 7fd9c17fa640 1 --2- 172.21.15.40:0/1601173566 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7fd9a806ae70 0x7fd9a806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:14.031 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:14.029+0000 7fd9c17fa640 1 -- 172.21.15.40:0/1601173566 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fd9b80ab5d0 con 0x7fd9c4146320 2023-12-17T11:48:14.031 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:14.029+0000 7fd9c3fff640 1 --2- 172.21.15.40:0/1601173566 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7fd9a806ae70 0x7fd9a806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:14.032 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:14.030+0000 7fd9c3fff640 1 --2- 172.21.15.40:0/1601173566 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7fd9a806ae70 0x7fd9a806d330 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fd9c4132f80 tx=0x7fd9b0008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:48:14.035 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:14.034+0000 7fd9c17fa640 1 -- 172.21.15.40:0/1601173566 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fd9b8076ae0 con 0x7fd9c4146320 2023-12-17T11:48:14.275 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:14.273+0000 7fd9c9b6c640 1 -- 172.21.15.40:0/1601173566 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd9c40c5680 con 0x7fd9c4146320 2023-12-17T11:48:14.276 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:14.274+0000 7fd9c17fa640 1 -- 172.21.15.40:0/1601173566 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+3700 (secure 0 0 0) 0x7fd9b8035090 con 0x7fd9c4146320 2023-12-17T11:48:14.276 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T11:48:14.276 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/3337931457","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":3337931457},{"type":"v1","addr":"172.21.15.40:6835","nonce":3337931457}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4257,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6833/1874601964","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6832","nonce":1874601964},{"type":"v1","addr":"172.21.15.40:6833","nonce":1874601964}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4267,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6836/3645037845","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6834","nonce":3645037845},{"type":"v1","addr":"172.21.15.159:6836","nonce":3645037845}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4270,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6837/1288849778","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6835","nonce":1288849778},{"type":"v1","addr":"172.21.15.159:6837","nonce":1288849778}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[]} 2023-12-17T11:48:14.276 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 3 2023-12-17T11:48:14.279 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:14.276+0000 7fd9c9b6c640 1 -- 172.21.15.40:0/1601173566 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7fd9a806ae70 msgr2=0x7fd9a806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:14.279 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:14.276+0000 7fd9c9b6c640 1 --2- 172.21.15.40:0/1601173566 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7fd9a806ae70 0x7fd9a806d330 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fd9c4132f80 tx=0x7fd9b0008040 comp rx=0 tx=0).stop 2023-12-17T11:48:14.279 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:14.276+0000 7fd9c9b6c640 1 -- 172.21.15.40:0/1601173566 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd9c4146320 msgr2=0x7fd9c415c9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:14.279 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:14.276+0000 7fd9c9b6c640 1 --2- 172.21.15.40:0/1601173566 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd9c4146320 0x7fd9c415c9b0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fd9b8000c00 tx=0x7fd9b80046c0 comp rx=0 tx=0).stop 2023-12-17T11:48:14.279 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:14.276+0000 7fd9c9b6c640 1 -- 172.21.15.40:0/1601173566 shutdown_connections 2023-12-17T11:48:14.279 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:14.276+0000 7fd9c9b6c640 1 --2- 172.21.15.40:0/1601173566 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7fd9a806ae70 0x7fd9a806d330 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:14.279 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:14.276+0000 7fd9c9b6c640 1 --2- 172.21.15.40:0/1601173566 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd9c40c4f10 0x7fd9c4160c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:14.279 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:14.276+0000 7fd9c9b6c640 1 --2- 172.21.15.40:0/1601173566 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd9c4146870 0x7fd9c4135b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:14.279 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:14.276+0000 7fd9c9b6c640 1 --2- 172.21.15.40:0/1601173566 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd9c4146320 0x7fd9c415c9b0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:14.279 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:14.277+0000 7fd9c9b6c640 1 -- 172.21.15.40:0/1601173566 >> 172.21.15.40:0/1601173566 conn(0x7fd9c40b1840 msgr2=0x7fd9c406a460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:48:14.279 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:14.277+0000 7fd9c9b6c640 1 -- 172.21.15.40:0/1601173566 shutdown_connections 2023-12-17T11:48:14.279 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:14.277+0000 7fd9c9b6c640 1 -- 172.21.15.40:0/1601173566 wait complete. 2023-12-17T11:48:14.298 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-17T11:48:14.505 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:14.503+0000 7fab0e864640 1 Processor -- start 2023-12-17T11:48:14.505 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:14.503+0000 7fab0e864640 1 -- start start 2023-12-17T11:48:14.507 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:14.505+0000 7fab0e864640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fab08159fd0 0x7fab080ae1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:14.507 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:14.505+0000 7fab0e864640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7fab08070750 0x7fab08070ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:14.507 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:14.505+0000 7fab0e864640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab08070070 con 0x7fab080711e0 2023-12-17T11:48:14.507 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:14.505+0000 7fab0e864640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab080705f0 con 0x7fab08070750 2023-12-17T11:48:14.507 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:14.505+0000 7fab0e864640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab08071650 con 0x7fab08159fd0 2023-12-17T11:48:14.507 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:14.505+0000 7fab0e063640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fab080711e0 0x7fab080ac700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:43454/0 (socket says 172.21.15.40:43454) 2023-12-17T11:48:14.507 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:14.505+0000 7fab0e063640 1 -- 172.21.15.40:0/3281773700 learned_addr learned my addr 172.21.15.40:0/3281773700 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-12-17T11:48:14.508 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:14.506+0000 7fab0d061640 1 --2- 172.21.15.40:0/3281773700 >> v2:172.21.15.159:3300/0 conn(0x7fab08070750 0x7fab08070ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:14.508 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:14.506+0000 7fab0d862640 1 --2- 172.21.15.40:0/3281773700 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fab08159fd0 0x7fab080ae1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:14.509 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:14.506+0000 7fab0c860640 1 -- 172.21.15.40:0/3281773700 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3962890153 0 0) 0x7fab08070070 con 0x7fab080711e0 2023-12-17T11:48:14.509 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:14.506+0000 7fab0c860640 1 -- 172.21.15.40:0/3281773700 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faaf4003520 con 0x7fab080711e0 2023-12-17T11:48:14.509 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:14.506+0000 7fab0d061640 1 -- 172.21.15.40:0/3281773700 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fab08159fd0 msgr2=0x7fab080ae1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:48:14.509 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:14.506+0000 7fab0d061640 1 --2- 172.21.15.40:0/3281773700 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fab08159fd0 0x7fab080ae1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:14.509 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:14.506+0000 7fab0d061640 1 -- 172.21.15.40:0/3281773700 >> v1:172.21.15.40:6789/0 conn(0x7fab080711e0 legacy=0x7fab080ac700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:14.509 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:14.506+0000 7fab0c860640 1 -- 172.21.15.40:0/3281773700 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2221885859 0 0) 0x7faaf4003520 con 0x7fab080711e0 2023-12-17T11:48:14.509 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:14.506+0000 7fab0d061640 1 -- 172.21.15.40:0/3281773700 --> v2:172.21.15.159:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab08070310 con 0x7fab08070750 2023-12-17T11:48:14.510 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:14.508+0000 7fab0d061640 1 --2- 172.21.15.40:0/3281773700 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fab08070750 0x7fab08070ca0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7faaf80097a0 tx=0x7faaf802b820 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b0d031ea25bbee32 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:48:14.510 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:14.509+0000 7fab0c860640 1 -- 172.21.15.40:0/3281773700 <== mon.1 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faaf802f050 con 0x7fab08070750 2023-12-17T11:48:14.510 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:14.509+0000 7fab0c860640 1 -- 172.21.15.40:0/3281773700 <== mon.1 v2:172.21.15.159:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faaf8031500 con 0x7fab08070750 2023-12-17T11:48:14.511 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:14.509+0000 7fab0c860640 1 -- 172.21.15.40:0/3281773700 <== mon.1 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab00001670 con 0x7fab08070750 2023-12-17T11:48:14.511 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:14.509+0000 7fab0e864640 1 -- 172.21.15.40:0/3281773700 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fab08070750 msgr2=0x7fab08070ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:14.511 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:14.509+0000 7fab0e864640 1 --2- 172.21.15.40:0/3281773700 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fab08070750 0x7fab08070ca0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7faaf80097a0 tx=0x7faaf802b820 comp rx=0 tx=0).stop 2023-12-17T11:48:14.511 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:14.509+0000 7fab0e864640 1 -- 172.21.15.40:0/3281773700 shutdown_connections 2023-12-17T11:48:14.512 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:14.509+0000 7fab0e864640 1 --2- 172.21.15.40:0/3281773700 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fab08070750 0x7fab08070ca0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:14.512 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:14.509+0000 7fab0e864640 1 --2- 172.21.15.40:0/3281773700 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fab08159fd0 0x7fab080ae1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:14.512 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:14.509+0000 7fab0e864640 1 -- 172.21.15.40:0/3281773700 >> 172.21.15.40:0/3281773700 conn(0x7fab080b0860 msgr2=0x7fab080b0c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:48:14.512 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:14.509+0000 7fab0e864640 1 -- 172.21.15.40:0/3281773700 shutdown_connections 2023-12-17T11:48:14.512 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:14.510+0000 7fab0e864640 1 -- 172.21.15.40:0/3281773700 wait complete. 2023-12-17T11:48:14.513 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:14.511+0000 7fab0e864640 1 Processor -- start 2023-12-17T11:48:14.513 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:14.511+0000 7fab0e864640 1 -- start start 2023-12-17T11:48:14.514 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:14.512+0000 7fab0e864640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fab08070750 0x7fab0815be20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:14.514 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:14.512+0000 7fab0e864640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fab080711e0 0x7fab0809bc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:14.515 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:14.512+0000 7fab0e864640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fab08159fd0 0x7fab0809c140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:14.515 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:14.512+0000 7fab0e864640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab0815ab30 con 0x7fab08159fd0 2023-12-17T11:48:14.515 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:14.512+0000 7fab0e864640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab0815b990 con 0x7fab080711e0 2023-12-17T11:48:14.515 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:14.512+0000 7fab0e864640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab0815ad80 con 0x7fab08070750 2023-12-17T11:48:14.515 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:14.513+0000 7fab0e063640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fab08159fd0 0x7fab0809c140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:14.515 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:14.513+0000 7fab0e063640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fab08159fd0 0x7fab0809c140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:47850/0 (socket says 172.21.15.40:47850) 2023-12-17T11:48:14.515 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:14.513+0000 7fab0e063640 1 -- 172.21.15.40:0/1343479702 learned_addr learned my addr 172.21.15.40:0/1343479702 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-17T11:48:14.517 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:14.513+0000 7fab0d862640 1 --2- 172.21.15.40:0/1343479702 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fab08070750 0x7fab0815be20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:14.517 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:14.513+0000 7fab0d061640 1 --2- 172.21.15.40:0/1343479702 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fab080711e0 0x7fab0809bc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:14.518 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:14.513+0000 7fab0e063640 1 -- 172.21.15.40:0/1343479702 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fab08070750 msgr2=0x7fab0815be20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:14.518 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:14.513+0000 7fab0e063640 1 --2- 172.21.15.40:0/1343479702 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fab08070750 0x7fab0815be20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:14.518 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:14.513+0000 7fab0e063640 1 -- 172.21.15.40:0/1343479702 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fab080711e0 msgr2=0x7fab0809bc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:14.518 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:14.513+0000 7fab0e063640 1 --2- 172.21.15.40:0/1343479702 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fab080711e0 0x7fab0809bc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:14.518 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:14.513+0000 7fab0e063640 1 -- 172.21.15.40:0/1343479702 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faaf8009400 con 0x7fab08159fd0 2023-12-17T11:48:14.518 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:14.513+0000 7fab0e063640 1 --2- 172.21.15.40:0/1343479702 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fab08159fd0 0x7fab0809c140 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fab0000c750 tx=0x7fab0000cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:48:14.518 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:14.513+0000 7faafe7fc640 1 -- 172.21.15.40:0/1343479702 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab00005ad0 con 0x7fab08159fd0 2023-12-17T11:48:14.518 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:14.514+0000 7faafe7fc640 1 -- 172.21.15.40:0/1343479702 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab00005c50 con 0x7fab08159fd0 2023-12-17T11:48:14.518 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:14.514+0000 7faafe7fc640 1 -- 172.21.15.40:0/1343479702 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab00007070 con 0x7fab08159fd0 2023-12-17T11:48:14.518 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:14.514+0000 7fab0e864640 1 -- 172.21.15.40:0/1343479702 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab0815b060 con 0x7fab08159fd0 2023-12-17T11:48:14.518 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:14.514+0000 7fab0e864640 1 -- 172.21.15.40:0/1343479702 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab0815b620 con 0x7fab08159fd0 2023-12-17T11:48:14.518 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:14.515+0000 7fab0e864640 1 -- 172.21.15.40:0/1343479702 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab0815bb00 con 0x7fab08159fd0 2023-12-17T11:48:14.518 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:14.516+0000 7faafe7fc640 1 -- 172.21.15.40:0/1343479702 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fab000071d0 con 0x7fab08159fd0 2023-12-17T11:48:14.519 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:14.516+0000 7faafe7fc640 1 --2- 172.21.15.40:0/1343479702 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7faaec06ae40 0x7faaec06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:14.519 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:14.517+0000 7faafe7fc640 1 -- 172.21.15.40:0/1343479702 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fab00089150 con 0x7fab08159fd0 2023-12-17T11:48:14.519 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:14.517+0000 7fab0d862640 1 --2- 172.21.15.40:0/1343479702 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7faaec06ae40 0x7faaec06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:14.520 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:14.518+0000 7fab0d862640 1 --2- 172.21.15.40:0/1343479702 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7faaec06ae40 0x7faaec06d300 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fab04009fd0 tx=0x7fab0400b040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:48:14.523 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:14.521+0000 7faafe7fc640 1 -- 172.21.15.40:0/1343479702 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fab00054420 con 0x7fab08159fd0 2023-12-17T11:48:14.711 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:14.709+0000 7fab0e864640 1 -- 172.21.15.40:0/1343479702 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fab08074450 con 0x7fab08159fd0 2023-12-17T11:48:14.713 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:14.711+0000 7faafe7fc640 1 -- 172.21.15.40:0/1343479702 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) v1 ==== 74+0+12826 (secure 0 0 0) 0x7fab00057a40 con 0x7fab08159fd0 2023-12-17T11:48:14.713 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T11:48:14.713 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":17,"fsid":"099cd35d-80d9-4ca4-8424-de13b3b03ac7","created":"2023-12-17T11:47:53.450097+0000","modified":"2023-12-17T11:48:08.736207+0000","last_up_change":"2023-12-17T11:48:05.724195+0000","last_in_change":"2023-12-17T11:47:56.956499+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-17T11:48:06.668943+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a88bfd46-63b8-48b1-9c0e-5c9cdc31bd38","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":555204741},{"type":"v1","addr":"172.21.15.40:6802","nonce":555204741}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":555204741},{"type":"v1","addr":"172.21.15.40:6807","nonce":555204741}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":555204741},{"type":"v1","addr":"172.21.15.40:6815","nonce":555204741}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6809","nonce":555204741},{"type":"v1","addr":"172.21.15.40:6812","nonce":555204741}]},"public_addr":"172.21.15.40:6802/555204741","cluster_addr":"172.21.15.40:6807/555204741","heartbeat_back_addr":"172.21.15.40:6815/555204741","heartbeat_front_addr":"172.21.15.40:6812/555204741","state":["exists","up"]},{"osd":1,"uuid":"c5d628ae-36f4-4866-802c-b162f0e90add","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6801","nonce":1221318112},{"type":"v1","addr":"172.21.15.40:6803","nonce":1221318112}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6805","nonce":1221318112},{"type":"v1","addr":"172.21.15.40:6806","nonce":1221318112}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6811","nonce":1221318112},{"type":"v1","addr":"172.21.15.40:6813","nonce":1221318112}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":1221318112},{"type":"v1","addr":"172.21.15.40:6810","nonce":1221318112}]},"public_addr":"172.21.15.40:6803/1221318112","cluster_addr":"172.21.15.40:6806/1221318112","heartbeat_back_addr":"172.21.15.40:6813/1221318112","heartbeat_front_addr":"172.21.15.40:6810/1221318112","state":["exists","up"]},{"osd":2,"uuid":"d986ad6a-af2f-47fc-9c3b-fbda27b82b73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":1959000265},{"type":"v1","addr":"172.21.15.40:6817","nonce":1959000265}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6818","nonce":1959000265},{"type":"v1","addr":"172.21.15.40:6819","nonce":1959000265}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":1959000265},{"type":"v1","addr":"172.21.15.40:6827","nonce":1959000265}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":1959000265},{"type":"v1","addr":"172.21.15.40:6822","nonce":1959000265}]},"public_addr":"172.21.15.40:6817/1959000265","cluster_addr":"172.21.15.40:6819/1959000265","heartbeat_back_addr":"172.21.15.40:6827/1959000265","heartbeat_front_addr":"172.21.15.40:6822/1959000265","state":["exists","up"]},{"osd":3,"uuid":"d79d22b7-be05-41b2-b95d-697db677fd02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6821","nonce":974040287},{"type":"v1","addr":"172.21.15.40:6823","nonce":974040287}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6825","nonce":974040287},{"type":"v1","addr":"172.21.15.40:6826","nonce":974040287}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":974040287},{"type":"v1","addr":"172.21.15.40:6831","nonce":974040287}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":974040287},{"type":"v1","addr":"172.21.15.40:6829","nonce":974040287}]},"public_addr":"172.21.15.40:6823/974040287","cluster_addr":"172.21.15.40:6826/974040287","heartbeat_back_addr":"172.21.15.40:6831/974040287","heartbeat_front_addr":"172.21.15.40:6829/974040287","state":["exists","up"]},{"osd":4,"uuid":"62a7a233-d3ea-40be-91de-180c0208d639","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6808","nonce":3937787733},{"type":"v1","addr":"172.21.15.159:6809","nonce":3937787733}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6810","nonce":3937787733},{"type":"v1","addr":"172.21.15.159:6811","nonce":3937787733}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6814","nonce":3937787733},{"type":"v1","addr":"172.21.15.159:6815","nonce":3937787733}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6812","nonce":3937787733},{"type":"v1","addr":"172.21.15.159:6813","nonce":3937787733}]},"public_addr":"172.21.15.159:6809/3937787733","cluster_addr":"172.21.15.159:6811/3937787733","heartbeat_back_addr":"172.21.15.159:6815/3937787733","heartbeat_front_addr":"172.21.15.159:6813/3937787733","state":["exists","up"]},{"osd":5,"uuid":"84629cea-dc0e-4b5e-b203-5ea963839281","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6816","nonce":3032505240},{"type":"v1","addr":"172.21.15.159:6817","nonce":3032505240}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6818","nonce":3032505240},{"type":"v1","addr":"172.21.15.159:6819","nonce":3032505240}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6822","nonce":3032505240},{"type":"v1","addr":"172.21.15.159:6823","nonce":3032505240}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6820","nonce":3032505240},{"type":"v1","addr":"172.21.15.159:6821","nonce":3032505240}]},"public_addr":"172.21.15.159:6817/3032505240","cluster_addr":"172.21.15.159:6819/3032505240","heartbeat_back_addr":"172.21.15.159:6823/3032505240","heartbeat_front_addr":"172.21.15.159:6821/3032505240","state":["exists","up"]},{"osd":6,"uuid":"4ae3af3a-1743-4070-a91d-8be5c31cdb04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6800","nonce":2411788597},{"type":"v1","addr":"172.21.15.159:6801","nonce":2411788597}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6802","nonce":2411788597},{"type":"v1","addr":"172.21.15.159:6803","nonce":2411788597}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6806","nonce":2411788597},{"type":"v1","addr":"172.21.15.159:6807","nonce":2411788597}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6804","nonce":2411788597},{"type":"v1","addr":"172.21.15.159:6805","nonce":2411788597}]},"public_addr":"172.21.15.159:6801/2411788597","cluster_addr":"172.21.15.159:6803/2411788597","heartbeat_back_addr":"172.21.15.159:6807/2411788597","heartbeat_front_addr":"172.21.15.159:6805/2411788597","state":["exists","up"]},{"osd":7,"uuid":"c1f4c7f2-8f75-4f95-bc63-a332773e3b8e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6824","nonce":478953349},{"type":"v1","addr":"172.21.15.159:6825","nonce":478953349}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6826","nonce":478953349},{"type":"v1","addr":"172.21.15.159:6827","nonce":478953349}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6830","nonce":478953349},{"type":"v1","addr":"172.21.15.159:6831","nonce":478953349}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6828","nonce":478953349},{"type":"v1","addr":"172.21.15.159:6829","nonce":478953349}]},"public_addr":"172.21.15.159:6825/478953349","cluster_addr":"172.21.15.159:6827/478953349","heartbeat_back_addr":"172.21.15.159:6831/478953349","heartbeat_front_addr":"172.21.15.159:6829/478953349","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T11:48:02.023567+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T11:48:02.278216+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T11:48:02.311843+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T11:48:01.773372+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T11:48:02.618910+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T11:48:02.361559+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T11:48:02.223997+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T11:48:02.604403+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-17T11:48:14.715 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:14.713+0000 7fab0e864640 1 -- 172.21.15.40:0/1343479702 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7faaec06ae40 msgr2=0x7faaec06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:14.715 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:14.713+0000 7fab0e864640 1 --2- 172.21.15.40:0/1343479702 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7faaec06ae40 0x7faaec06d300 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fab04009fd0 tx=0x7fab0400b040 comp rx=0 tx=0).stop 2023-12-17T11:48:14.715 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:14.713+0000 7fab0e864640 1 -- 172.21.15.40:0/1343479702 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fab08159fd0 msgr2=0x7fab0809c140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:14.715 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:14.713+0000 7fab0e864640 1 --2- 172.21.15.40:0/1343479702 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fab08159fd0 0x7fab0809c140 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fab0000c750 tx=0x7fab0000cc10 comp rx=0 tx=0).stop 2023-12-17T11:48:14.716 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:14.713+0000 7fab0e864640 1 -- 172.21.15.40:0/1343479702 shutdown_connections 2023-12-17T11:48:14.716 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:14.713+0000 7fab0e864640 1 --2- 172.21.15.40:0/1343479702 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7faaec06ae40 0x7faaec06d300 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:14.716 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:14.713+0000 7fab0e864640 1 --2- 172.21.15.40:0/1343479702 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fab08159fd0 0x7fab0809c140 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:14.716 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:14.713+0000 7fab0e864640 1 --2- 172.21.15.40:0/1343479702 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fab080711e0 0x7fab0809bc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:14.716 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:14.713+0000 7fab0e864640 1 --2- 172.21.15.40:0/1343479702 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fab08070750 0x7fab0815be20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:14.716 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:14.713+0000 7fab0e864640 1 -- 172.21.15.40:0/1343479702 >> 172.21.15.40:0/1343479702 conn(0x7fab080b0860 msgr2=0x7fab080b27e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:48:14.716 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:14.714+0000 7fab0e864640 1 -- 172.21.15.40:0/1343479702 shutdown_connections 2023-12-17T11:48:14.717 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:14.714+0000 7fab0e864640 1 -- 172.21.15.40:0/1343479702 wait complete. 2023-12-17T11:48:14.733 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-17T11:48:06.668943+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-17T11:48:14.734 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-17T11:48:14.957 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:14.955+0000 7f6cd1d62640 1 Processor -- start 2023-12-17T11:48:14.957 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:14.955+0000 7f6cd1d62640 1 -- start start 2023-12-17T11:48:14.959 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:14.957+0000 7f6cd1d62640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f6ccc0cfe70 0x7f6ccc168530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:14.959 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:14.957+0000 7f6cd1d62640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ccc0c6b80 con 0x7f6ccc0b3350 2023-12-17T11:48:14.959 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:14.957+0000 7f6cd1d62640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ccc0d3bf0 con 0x7f6ccc0b3730 2023-12-17T11:48:14.959 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:14.957+0000 7f6cd1d62640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ccc0d3ed0 con 0x7f6ccc0cfe70 2023-12-17T11:48:14.960 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:14.957+0000 7f6cd0d60640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f6ccc0b3350 0x7f6ccc0b3ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:49248/0 (socket says 172.21.15.40:49248) 2023-12-17T11:48:14.960 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:14.957+0000 7f6cd0d60640 1 -- 172.21.15.40:0/4198565944 learned_addr learned my addr 172.21.15.40:0/4198565944 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-12-17T11:48:14.962 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:14.958+0000 7f6cd1561640 1 --2- 172.21.15.40:0/4198565944 >> v2:172.21.15.159:3300/0 conn(0x7f6ccc0cfe70 0x7f6ccc168530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:14.962 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:14.958+0000 7f6cc37fe640 1 -- 172.21.15.40:0/4198565944 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3993356934 0 0) 0x7f6ccc0c6b80 con 0x7f6ccc0b3350 2023-12-17T11:48:14.962 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:14.958+0000 7f6cc37fe640 1 -- 172.21.15.40:0/4198565944 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6cb4003520 con 0x7f6ccc0b3350 2023-12-17T11:48:14.962 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:14.958+0000 7f6cc37fe640 1 -- 172.21.15.40:0/4198565944 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3393244992 0 0) 0x7f6cb4003520 con 0x7f6ccc0b3350 2023-12-17T11:48:14.962 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:14.958+0000 7f6cc37fe640 1 -- 172.21.15.40:0/4198565944 >> v2:172.21.15.159:3300/0 conn(0x7f6ccc0cfe70 msgr2=0x7f6ccc168530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:48:14.962 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:14.958+0000 7f6cc37fe640 1 --2- 172.21.15.40:0/4198565944 >> v2:172.21.15.159:3300/0 conn(0x7f6ccc0cfe70 0x7f6ccc168530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:14.962 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:14.958+0000 7f6cc37fe640 1 -- 172.21.15.40:0/4198565944 >> v1:172.21.15.159:6789/0 conn(0x7f6ccc0b3730 legacy=0x7f6ccc0cf760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:14.962 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:14.958+0000 7f6cc37fe640 1 -- 172.21.15.40:0/4198565944 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ccc0d18c0 con 0x7f6ccc0b3350 2023-12-17T11:48:14.962 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:14.958+0000 7f6cc37fe640 1 -- 172.21.15.40:0/4198565944 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2643242555 0 0) 0x7f6cc80019f0 con 0x7f6ccc0b3350 2023-12-17T11:48:14.962 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:14.958+0000 7f6cc37fe640 1 -- 172.21.15.40:0/4198565944 >> v1:172.21.15.40:6789/0 conn(0x7f6ccc0b3350 legacy=0x7f6ccc0b3ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:14.962 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:14.958+0000 7f6cc37fe640 1 --2- 172.21.15.40:0/4198565944 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6cb40039c0 0x7f6cb4003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:14.963 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:14.958+0000 7f6cc37fe640 1 --2- 172.21.15.40:0/4198565944 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6cb40047c0 0x7f6cb4004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:14.963 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:14.959+0000 7f6cc37fe640 1 --2- 172.21.15.40:0/4198565944 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6cb4005180 0x7f6cb400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:14.963 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:14.959+0000 7f6cc37fe640 1 -- 172.21.15.40:0/4198565944 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ccc0d3ed0 con 0x7f6cb4005180 2023-12-17T11:48:14.963 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:14.959+0000 7f6cc37fe640 1 -- 172.21.15.40:0/4198565944 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cb400c080 con 0x7f6cb40047c0 2023-12-17T11:48:14.963 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:14.959+0000 7f6cc37fe640 1 -- 172.21.15.40:0/4198565944 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6cb400c240 con 0x7f6cb40039c0 2023-12-17T11:48:14.963 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:14.959+0000 7f6cd1561640 1 --2- 172.21.15.40:0/4198565944 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6cb4005180 0x7f6cb400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:14.963 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:14.959+0000 7f6cd0d60640 1 --2- 172.21.15.40:0/4198565944 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6cb40039c0 0x7f6cb4003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:14.963 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:14.959+0000 7f6cc3fff640 1 --2- 172.21.15.40:0/4198565944 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6cb40047c0 0x7f6cb4004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:14.963 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:14.959+0000 7f6cd1561640 1 -- 172.21.15.40:0/4198565944 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6cb40039c0 msgr2=0x7f6cb4003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:48:14.963 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:14.959+0000 7f6cd1561640 1 --2- 172.21.15.40:0/4198565944 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6cb40039c0 0x7f6cb4003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:14.963 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:14.959+0000 7f6cd1561640 1 -- 172.21.15.40:0/4198565944 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6cb40047c0 msgr2=0x7f6cb4004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:48:14.963 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:14.959+0000 7f6cd1561640 1 --2- 172.21.15.40:0/4198565944 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6cb40047c0 0x7f6cb4004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:14.963 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:14.959+0000 7f6cd1561640 1 -- 172.21.15.40:0/4198565944 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cb4003520 con 0x7f6cb4005180 2023-12-17T11:48:14.965 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:14.960+0000 7f6cd1561640 1 -- 172.21.15.40:0/4198565944 reap_dead start 2023-12-17T11:48:14.965 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:14.960+0000 7f6cd1561640 1 --2- 172.21.15.40:0/4198565944 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6cb4005180 0x7f6cb400b980 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f6cc4009a90 tx=0x7f6cb40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a888ae93a8daab33 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:48:14.965 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:14.961+0000 7f6cc37fe640 1 -- 172.21.15.40:0/4198565944 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cc402c6b0 con 0x7f6cb4005180 2023-12-17T11:48:14.965 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:14.961+0000 7f6cc37fe640 1 -- 172.21.15.40:0/4198565944 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6cc402c810 con 0x7f6cb4005180 2023-12-17T11:48:14.965 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:14.961+0000 7f6cc37fe640 1 -- 172.21.15.40:0/4198565944 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cc402cbc0 con 0x7f6cb4005180 2023-12-17T11:48:14.965 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:14.961+0000 7f6cd1d62640 1 -- 172.21.15.40:0/4198565944 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6cb4005180 msgr2=0x7f6cb400b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:14.965 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:14.961+0000 7f6cd1d62640 1 --2- 172.21.15.40:0/4198565944 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6cb4005180 0x7f6cb400b980 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f6cc4009a90 tx=0x7f6cb40057f0 comp rx=0 tx=0).stop 2023-12-17T11:48:14.965 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:14.961+0000 7f6cd1d62640 1 -- 172.21.15.40:0/4198565944 shutdown_connections 2023-12-17T11:48:14.965 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:14.961+0000 7f6cd1d62640 1 --2- 172.21.15.40:0/4198565944 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6cb4005180 0x7f6cb400b980 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:14.965 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:14.961+0000 7f6cd1d62640 1 -- 172.21.15.40:0/4198565944 >> 172.21.15.40:0/4198565944 conn(0x7f6ccc0d3030 msgr2=0x7f6ccc0d3440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:48:14.965 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:14.962+0000 7f6cd1d62640 1 -- 172.21.15.40:0/4198565944 shutdown_connections 2023-12-17T11:48:14.966 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:14.962+0000 7f6cd1d62640 1 -- 172.21.15.40:0/4198565944 wait complete. 2023-12-17T11:48:14.966 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:14.963+0000 7f6cd1d62640 1 Processor -- start 2023-12-17T11:48:14.966 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:14.964+0000 7f6cd1d62640 1 -- start start 2023-12-17T11:48:14.967 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:14.965+0000 7f6cd1d62640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6cb4005180 0x7f6ccc15e1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:14.968 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:14.965+0000 7f6cd1d62640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6ccc0ccbd0 0x7f6ccc1f28d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:14.968 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:14.965+0000 7f6cd1d62640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6ccc1f2e10 0x7f6ccc1f3290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:14.968 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:14.965+0000 7f6cd1d62640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ccc0b7a00 con 0x7f6cb4005180 2023-12-17T11:48:14.968 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:14.965+0000 7f6cd1d62640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ccc0cbb30 con 0x7f6ccc0ccbd0 2023-12-17T11:48:14.968 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:14.965+0000 7f6cd1d62640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ccc0cbe10 con 0x7f6ccc1f2e10 2023-12-17T11:48:14.968 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:14.965+0000 7f6cd0d60640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6cb4005180 0x7f6ccc15e1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:14.968 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:14.965+0000 7f6cd0d60640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6cb4005180 0x7f6ccc15e1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:50848/0 (socket says 172.21.15.40:50848) 2023-12-17T11:48:14.968 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:14.965+0000 7f6cd0d60640 1 -- 172.21.15.40:0/3401563811 learned_addr learned my addr 172.21.15.40:0/3401563811 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-17T11:48:14.968 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:14.965+0000 7f6cd1561640 1 --2- 172.21.15.40:0/3401563811 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6ccc1f2e10 0x7f6ccc1f3290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:14.968 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:14.965+0000 7f6cc3fff640 1 --2- 172.21.15.40:0/3401563811 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6ccc0ccbd0 0x7f6ccc1f28d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:14.968 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:14.965+0000 7f6cd0d60640 1 -- 172.21.15.40:0/3401563811 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6ccc1f2e10 msgr2=0x7f6ccc1f3290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:14.968 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:14.965+0000 7f6cd0d60640 1 --2- 172.21.15.40:0/3401563811 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6ccc1f2e10 0x7f6ccc1f3290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:14.968 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:14.965+0000 7f6cd0d60640 1 -- 172.21.15.40:0/3401563811 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6ccc0ccbd0 msgr2=0x7f6ccc1f28d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:14.969 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:14.965+0000 7f6cd0d60640 1 --2- 172.21.15.40:0/3401563811 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6ccc0ccbd0 0x7f6ccc1f28d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:14.969 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:14.965+0000 7f6cd0d60640 1 -- 172.21.15.40:0/3401563811 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ccc0b48a0 con 0x7f6cb4005180 2023-12-17T11:48:14.969 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:14.965+0000 7f6cc3fff640 1 --2- 172.21.15.40:0/3401563811 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6ccc0ccbd0 0x7f6ccc1f28d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-17T11:48:14.969 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:14.966+0000 7f6cd0d60640 1 --2- 172.21.15.40:0/3401563811 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6cb4005180 0x7f6ccc15e1a0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f6cc80079e0 tx=0x7f6cc800e530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:48:14.969 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:14.966+0000 7f6cc17fa640 1 -- 172.21.15.40:0/3401563811 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cc800ee50 con 0x7f6cb4005180 2023-12-17T11:48:14.970 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:14.966+0000 7f6cc17fa640 1 -- 172.21.15.40:0/3401563811 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6cc8013420 con 0x7f6cb4005180 2023-12-17T11:48:14.970 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:14.966+0000 7f6cc17fa640 1 -- 172.21.15.40:0/3401563811 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cc80137d0 con 0x7f6cb4005180 2023-12-17T11:48:14.970 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:14.966+0000 7f6cd1d62640 1 -- 172.21.15.40:0/3401563811 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ccc0cc0f0 con 0x7f6cb4005180 2023-12-17T11:48:14.970 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:14.966+0000 7f6cd1d62640 1 -- 172.21.15.40:0/3401563811 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ccc0cc6b0 con 0x7f6cb4005180 2023-12-17T11:48:14.970 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:14.968+0000 7f6cd1d62640 1 -- 172.21.15.40:0/3401563811 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ccc0d0b60 con 0x7f6cb4005180 2023-12-17T11:48:14.970 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:14.968+0000 7f6cc17fa640 1 -- 172.21.15.40:0/3401563811 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f6cc8013930 con 0x7f6cb4005180 2023-12-17T11:48:14.971 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:14.969+0000 7f6cc17fa640 1 --2- 172.21.15.40:0/3401563811 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f6cb806ae40 0x7f6cb806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:14.971 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:14.969+0000 7f6cc17fa640 1 -- 172.21.15.40:0/3401563811 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f6cc80899e0 con 0x7f6cb4005180 2023-12-17T11:48:14.971 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:14.970+0000 7f6cc3fff640 1 --2- 172.21.15.40:0/3401563811 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f6cb806ae40 0x7f6cb806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:14.973 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:14.971+0000 7f6cc3fff640 1 --2- 172.21.15.40:0/3401563811 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f6cb806ae40 0x7f6cb806d300 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f6ccc0c9e30 tx=0x7f6cbc009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:48:14.975 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:14.974+0000 7f6cc17fa640 1 -- 172.21.15.40:0/3401563811 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f6cc8054e70 con 0x7f6cb4005180 2023-12-17T11:48:15.178 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:15.176+0000 7f6cd1d62640 1 -- 172.21.15.40:0/3401563811 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f6ccc074450 con 0x7f6cb4005180 2023-12-17T11:48:15.179 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:15.177+0000 7f6cc17fa640 1 -- 172.21.15.40:0/3401563811 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v17) v1 ==== 93+0+10 (secure 0 0 0) 0x7f6cc8058490 con 0x7f6cb4005180 2023-12-17T11:48:15.179 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 1 2023-12-17T11:48:15.182 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:15.180+0000 7f6cd1d62640 1 -- 172.21.15.40:0/3401563811 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f6cb806ae40 msgr2=0x7f6cb806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:15.182 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:15.180+0000 7f6cd1d62640 1 --2- 172.21.15.40:0/3401563811 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f6cb806ae40 0x7f6cb806d300 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f6ccc0c9e30 tx=0x7f6cbc009040 comp rx=0 tx=0).stop 2023-12-17T11:48:15.182 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:15.180+0000 7f6cd1d62640 1 -- 172.21.15.40:0/3401563811 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6cb4005180 msgr2=0x7f6ccc15e1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:15.182 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:15.180+0000 7f6cd1d62640 1 --2- 172.21.15.40:0/3401563811 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6cb4005180 0x7f6ccc15e1a0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f6cc80079e0 tx=0x7f6cc800e530 comp rx=0 tx=0).stop 2023-12-17T11:48:15.182 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:15.180+0000 7f6cd1d62640 1 -- 172.21.15.40:0/3401563811 shutdown_connections 2023-12-17T11:48:15.182 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:15.180+0000 7f6cd1d62640 1 --2- 172.21.15.40:0/3401563811 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f6cb806ae40 0x7f6cb806d300 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:15.182 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:15.180+0000 7f6cd1d62640 1 --2- 172.21.15.40:0/3401563811 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6ccc1f2e10 0x7f6ccc1f3290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:15.182 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:15.180+0000 7f6cd1d62640 1 --2- 172.21.15.40:0/3401563811 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6ccc0ccbd0 0x7f6ccc1f28d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:15.183 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:15.180+0000 7f6cd1d62640 1 --2- 172.21.15.40:0/3401563811 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6cb4005180 0x7f6ccc15e1a0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:15.183 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:15.180+0000 7f6cd1d62640 1 -- 172.21.15.40:0/3401563811 >> 172.21.15.40:0/3401563811 conn(0x7f6ccc0d3030 msgr2=0x7f6ccc0cddf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:48:15.183 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:15.180+0000 7f6cd1d62640 1 -- 172.21.15.40:0/3401563811 shutdown_connections 2023-12-17T11:48:15.183 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:15.180+0000 7f6cd1d62640 1 -- 172.21.15.40:0/3401563811 wait complete. 2023-12-17T11:48:15.203 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-12-17T11:48:15.426 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:15.423+0000 7f0b10932640 1 Processor -- start 2023-12-17T11:48:15.426 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:15.424+0000 7f0b10932640 1 -- start start 2023-12-17T11:48:15.427 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:15.425+0000 7f0b10932640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0b0c0d13c0 0x7f0b0c0ce5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:15.427 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:15.425+0000 7f0b10932640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f0b0c0b0760 0x7f0b0c0b0bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:15.427 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:15.425+0000 7f0b10932640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b0c0b2280 con 0x7f0b0c0d0d70 2023-12-17T11:48:15.427 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:15.425+0000 7f0b10932640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b0c0cee70 con 0x7f0b0c0b0760 2023-12-17T11:48:15.427 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:15.425+0000 7f0b10932640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b0c0d1190 con 0x7f0b0c0d13c0 2023-12-17T11:48:15.427 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:15.425+0000 7f0b0b59e640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f0b0c0b0760 0x7f0b0c0b0bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:15.428 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:15.425+0000 7f0b0b59e640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f0b0c0b0760 0x7f0b0c0b0bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:50852/0 (socket says 172.21.15.40:50852) 2023-12-17T11:48:15.428 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:15.425+0000 7f0b0b59e640 1 -- 172.21.15.40:0/1520238172 learned_addr learned my addr 172.21.15.40:0/1520238172 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-17T11:48:15.428 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:15.425+0000 7f0b0a59c640 1 --1- 172.21.15.40:0/1520238172 >> v1:172.21.15.40:6789/0 conn(0x7f0b0c0d0d70 0x7f0b0c0d17a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:49258/0 (socket says 172.21.15.40:49258) 2023-12-17T11:48:15.428 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:15.426+0000 7f0b0ad9d640 1 --2- 172.21.15.40:0/1520238172 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0b0c0d13c0 0x7f0b0c0ce5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:15.428 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:15.426+0000 7f0b0b59e640 1 -- 172.21.15.40:0/1520238172 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0b0c0d13c0 msgr2=0x7f0b0c0ce5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:48:15.428 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:15.426+0000 7f0b0b59e640 1 --2- 172.21.15.40:0/1520238172 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0b0c0d13c0 0x7f0b0c0ce5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:15.429 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:15.426+0000 7f0b0b59e640 1 -- 172.21.15.40:0/1520238172 >> v1:172.21.15.40:6789/0 conn(0x7f0b0c0d0d70 legacy=0x7f0b0c0d17a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:15.429 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:15.426+0000 7f0b0b59e640 1 -- 172.21.15.40:0/1520238172 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b0c0ceb90 con 0x7f0b0c0b0760 2023-12-17T11:48:15.429 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:15.427+0000 7f0b0b59e640 1 --2- 172.21.15.40:0/1520238172 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0b0c0b0760 0x7f0b0c0b0bf0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f0b04009870 tx=0x7f0b0402b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68c965ca594f7e1e server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:48:15.429 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:15.427+0000 7f0b09d9b640 1 -- 172.21.15.40:0/1520238172 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b04031640 con 0x7f0b0c0b0760 2023-12-17T11:48:15.429 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:15.427+0000 7f0b09d9b640 1 -- 172.21.15.40:0/1520238172 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b040317a0 con 0x7f0b0c0b0760 2023-12-17T11:48:15.429 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:15.427+0000 7f0b09d9b640 1 -- 172.21.15.40:0/1520238172 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b04031b30 con 0x7f0b0c0b0760 2023-12-17T11:48:15.430 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:15.428+0000 7f0b10932640 1 -- 172.21.15.40:0/1520238172 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0b0c0b0760 msgr2=0x7f0b0c0b0bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:15.430 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:15.428+0000 7f0b10932640 1 --2- 172.21.15.40:0/1520238172 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0b0c0b0760 0x7f0b0c0b0bf0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f0b04009870 tx=0x7f0b0402b8f0 comp rx=0 tx=0).stop 2023-12-17T11:48:15.430 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:15.428+0000 7f0b10932640 1 -- 172.21.15.40:0/1520238172 shutdown_connections 2023-12-17T11:48:15.430 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:15.428+0000 7f0b10932640 1 --2- 172.21.15.40:0/1520238172 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0b0c0b0760 0x7f0b0c0b0bf0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:15.430 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:15.428+0000 7f0b10932640 1 --2- 172.21.15.40:0/1520238172 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0b0c0d13c0 0x7f0b0c0ce5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:15.430 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:15.428+0000 7f0b10932640 1 -- 172.21.15.40:0/1520238172 >> 172.21.15.40:0/1520238172 conn(0x7f0b0c09c260 msgr2=0x7f0b0c0d2f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:48:15.431 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:15.428+0000 7f0b10932640 1 -- 172.21.15.40:0/1520238172 shutdown_connections 2023-12-17T11:48:15.431 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:15.428+0000 7f0b10932640 1 -- 172.21.15.40:0/1520238172 wait complete. 2023-12-17T11:48:15.432 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:15.430+0000 7f0b10932640 1 Processor -- start 2023-12-17T11:48:15.432 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:15.430+0000 7f0b10932640 1 -- start start 2023-12-17T11:48:15.434 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:15.431+0000 7f0b10932640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0b0c0b0760 0x7f0b0c0ccc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:15.434 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:15.431+0000 7f0b10932640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0b0c0d0d70 0x7f0b0c153270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:15.434 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:15.431+0000 7f0b10932640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0b0c0d13c0 0x7f0b0c0b3a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:15.434 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:15.431+0000 7f0b10932640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b0c0c9e10 con 0x7f0b0c0d13c0 2023-12-17T11:48:15.434 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:15.431+0000 7f0b10932640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b0c0c9370 con 0x7f0b0c0b0760 2023-12-17T11:48:15.434 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:15.431+0000 7f0b10932640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b0c0c6940 con 0x7f0b0c0d0d70 2023-12-17T11:48:15.434 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:15.431+0000 7f0b0b59e640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0b0c0d13c0 0x7f0b0c0b3a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:15.434 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:15.431+0000 7f0b0b59e640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0b0c0d13c0 0x7f0b0c0b3a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:50854/0 (socket says 172.21.15.40:50854) 2023-12-17T11:48:15.434 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:15.431+0000 7f0b0b59e640 1 -- 172.21.15.40:0/930222290 learned_addr learned my addr 172.21.15.40:0/930222290 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-17T11:48:15.434 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:15.432+0000 7f0b0ad9d640 1 --2- 172.21.15.40:0/930222290 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0b0c0b0760 0x7f0b0c0ccc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:15.434 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:15.432+0000 7f0b0a59c640 1 --2- 172.21.15.40:0/930222290 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0b0c0d0d70 0x7f0b0c153270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:15.434 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:15.432+0000 7f0b0b59e640 1 -- 172.21.15.40:0/930222290 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0b0c0d0d70 msgr2=0x7f0b0c153270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:15.435 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:15.432+0000 7f0b0b59e640 1 --2- 172.21.15.40:0/930222290 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0b0c0d0d70 0x7f0b0c153270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:15.435 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:15.432+0000 7f0b0b59e640 1 -- 172.21.15.40:0/930222290 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0b0c0b0760 msgr2=0x7f0b0c0ccc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:15.435 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:15.432+0000 7f0b0b59e640 1 --2- 172.21.15.40:0/930222290 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0b0c0b0760 0x7f0b0c0ccc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:15.435 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:15.432+0000 7f0b0b59e640 1 -- 172.21.15.40:0/930222290 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b040094d0 con 0x7f0b0c0d13c0 2023-12-17T11:48:15.435 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:15.432+0000 7f0b0a59c640 1 --2- 172.21.15.40:0/930222290 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0b0c0d0d70 0x7f0b0c153270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-17T11:48:15.435 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:15.432+0000 7f0b0ad9d640 1 --2- 172.21.15.40:0/930222290 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0b0c0b0760 0x7f0b0c0ccc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-17T11:48:15.435 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:15.432+0000 7f0b0b59e640 1 --2- 172.21.15.40:0/930222290 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0b0c0d13c0 0x7f0b0c0b3a00 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f0b04009870 tx=0x7f0b040046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:48:15.436 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:15.432+0000 7f0af37fe640 1 -- 172.21.15.40:0/930222290 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b0403ac60 con 0x7f0b0c0d13c0 2023-12-17T11:48:15.436 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:15.432+0000 7f0af37fe640 1 -- 172.21.15.40:0/930222290 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b0403ade0 con 0x7f0b0c0d13c0 2023-12-17T11:48:15.436 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:15.432+0000 7f0af37fe640 1 -- 172.21.15.40:0/930222290 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b04044630 con 0x7f0b0c0d13c0 2023-12-17T11:48:15.436 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:15.432+0000 7f0b10932640 1 -- 172.21.15.40:0/930222290 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b0c0c9610 con 0x7f0b0c0d13c0 2023-12-17T11:48:15.436 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:15.432+0000 7f0b10932640 1 -- 172.21.15.40:0/930222290 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b0c1537b0 con 0x7f0b0c0d13c0 2023-12-17T11:48:15.436 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:15.434+0000 7f0b10932640 1 -- 172.21.15.40:0/930222290 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b0c0c9ad0 con 0x7f0b0c0d13c0 2023-12-17T11:48:15.436 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:15.434+0000 7f0af37fe640 1 -- 172.21.15.40:0/930222290 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f0b0402f050 con 0x7f0b0c0d13c0 2023-12-17T11:48:15.437 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:15.435+0000 7f0af37fe640 1 --2- 172.21.15.40:0/930222290 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f0af806ae40 0x7f0af806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:15.437 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:15.435+0000 7f0af37fe640 1 -- 172.21.15.40:0/930222290 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f0b040ab260 con 0x7f0b0c0d13c0 2023-12-17T11:48:15.438 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:15.436+0000 7f0b0ad9d640 1 --2- 172.21.15.40:0/930222290 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f0af806ae40 0x7f0af806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:15.439 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:15.437+0000 7f0b0ad9d640 1 --2- 172.21.15.40:0/930222290 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f0af806ae40 0x7f0af806d300 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f0afc007eb0 tx=0x7f0afc007400 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:48:15.441 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:15.440+0000 7f0af37fe640 1 -- 172.21.15.40:0/930222290 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f0b04076650 con 0x7f0b0c0d13c0 2023-12-17T11:48:15.640 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:15.637+0000 7f0b10932640 1 -- 172.21.15.40:0/930222290 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f0b0c074450 con 0x7f0b0c0d13c0 2023-12-17T11:48:15.640 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:15.638+0000 7f0af37fe640 1 -- 172.21.15.40:0/930222290 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v17) v1 ==== 84+0+65 (secure 0 0 0) 0x7f0b040a9e60 con 0x7f0b0c0d13c0 2023-12-17T11:48:15.641 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T11:48:15.641 INFO:teuthology.orchestra.run.smithi040.stdout:[ 2023-12-17T11:48:15.641 INFO:teuthology.orchestra.run.smithi040.stdout: { 2023-12-17T11:48:15.641 INFO:teuthology.orchestra.run.smithi040.stdout: "poolnum": 1, 2023-12-17T11:48:15.641 INFO:teuthology.orchestra.run.smithi040.stdout: "poolname": ".mgr" 2023-12-17T11:48:15.641 INFO:teuthology.orchestra.run.smithi040.stdout: } 2023-12-17T11:48:15.641 INFO:teuthology.orchestra.run.smithi040.stdout:] 2023-12-17T11:48:15.643 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:15.641+0000 7f0b10932640 1 -- 172.21.15.40:0/930222290 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f0af806ae40 msgr2=0x7f0af806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:15.643 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:15.641+0000 7f0b10932640 1 --2- 172.21.15.40:0/930222290 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f0af806ae40 0x7f0af806d300 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f0afc007eb0 tx=0x7f0afc007400 comp rx=0 tx=0).stop 2023-12-17T11:48:15.643 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:15.641+0000 7f0b10932640 1 -- 172.21.15.40:0/930222290 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0b0c0d13c0 msgr2=0x7f0b0c0b3a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:15.643 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:15.641+0000 7f0b10932640 1 --2- 172.21.15.40:0/930222290 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0b0c0d13c0 0x7f0b0c0b3a00 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f0b04009870 tx=0x7f0b040046c0 comp rx=0 tx=0).stop 2023-12-17T11:48:15.643 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:15.641+0000 7f0b10932640 1 -- 172.21.15.40:0/930222290 shutdown_connections 2023-12-17T11:48:15.644 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:15.641+0000 7f0b10932640 1 --2- 172.21.15.40:0/930222290 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f0af806ae40 0x7f0af806d300 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:15.644 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:15.641+0000 7f0b10932640 1 --2- 172.21.15.40:0/930222290 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0b0c0d13c0 0x7f0b0c0b3a00 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:15.644 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:15.641+0000 7f0b10932640 1 --2- 172.21.15.40:0/930222290 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0b0c0d0d70 0x7f0b0c153270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:15.644 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:15.641+0000 7f0b10932640 1 --2- 172.21.15.40:0/930222290 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0b0c0b0760 0x7f0b0c0ccc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:15.644 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:15.641+0000 7f0b10932640 1 -- 172.21.15.40:0/930222290 >> 172.21.15.40:0/930222290 conn(0x7f0b0c09c260 msgr2=0x7f0b0c0b6340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:48:15.644 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:15.641+0000 7f0b10932640 1 -- 172.21.15.40:0/930222290 shutdown_connections 2023-12-17T11:48:15.644 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:15.641+0000 7f0b10932640 1 -- 172.21.15.40:0/930222290 wait complete. 2023-12-17T11:48:15.663 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-12-17T11:48:15.664 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-12-17T11:48:15.887 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:15.885+0000 7fe43bfff640 1 Processor -- start 2023-12-17T11:48:15.888 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:15.885+0000 7fe43bfff640 1 -- start start 2023-12-17T11:48:15.889 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:15.887+0000 7fe43bfff640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe43c161510 0x7fe43c0cdd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:15.889 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:15.887+0000 7fe43bfff640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7fe43c0cf6c0 0x7fe43c1651b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:15.889 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:15.887+0000 7fe43bfff640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe43c0cbef0 con 0x7fe43c0cd6a0 2023-12-17T11:48:15.889 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:15.887+0000 7fe43bfff640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe43c0b2e50 con 0x7fe43c0cf6c0 2023-12-17T11:48:15.889 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:15.887+0000 7fe43bfff640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe43c0ce350 con 0x7fe43c161510 2023-12-17T11:48:15.890 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:15.888+0000 7fe43b7fe640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7fe43c0cf6c0 0x7fe43c1651b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:15.890 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:15.888+0000 7fe43affd640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe43c161510 0x7fe43c0cdd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:15.890 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:15.888+0000 7fe43a7fc640 1 --1- >> v1:172.21.15.159:6789/0 conn(0x7fe43c0cd6a0 0x7fe43c0cefb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.159:6789/0 says I am v1:172.21.15.40:37144/0 (socket says 172.21.15.40:37144) 2023-12-17T11:48:15.890 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:15.888+0000 7fe43a7fc640 1 -- 172.21.15.40:0/1373677462 learned_addr learned my addr 172.21.15.40:0/1373677462 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-12-17T11:48:15.891 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:15.889+0000 7fe439ffb640 1 -- 172.21.15.40:0/1373677462 <== mon.1 v1:172.21.15.159:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1644781805 0 0) 0x7fe43c0cbef0 con 0x7fe43c0cd6a0 2023-12-17T11:48:15.891 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:15.889+0000 7fe439ffb640 1 -- 172.21.15.40:0/1373677462 --> v1:172.21.15.159:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe424003520 con 0x7fe43c0cd6a0 2023-12-17T11:48:15.891 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:15.889+0000 7fe43affd640 1 -- 172.21.15.40:0/1373677462 >> v2:172.21.15.159:3300/0 conn(0x7fe43c0cf6c0 msgr2=0x7fe43c1651b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:48:15.892 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:15.889+0000 7fe43affd640 1 --2- 172.21.15.40:0/1373677462 >> v2:172.21.15.159:3300/0 conn(0x7fe43c0cf6c0 0x7fe43c1651b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:15.892 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:15.889+0000 7fe43affd640 1 -- 172.21.15.40:0/1373677462 >> v1:172.21.15.159:6789/0 conn(0x7fe43c0cd6a0 legacy=0x7fe43c0cefb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:15.892 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:15.889+0000 7fe43affd640 1 -- 172.21.15.40:0/1373677462 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe43c0cb5c0 con 0x7fe43c161510 2023-12-17T11:48:15.892 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:15.889+0000 7fe43b7fe640 1 --2- 172.21.15.40:0/1373677462 >> v2:172.21.15.159:3300/0 conn(0x7fe43c0cf6c0 0x7fe43c1651b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-17T11:48:15.892 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:15.890+0000 7fe43affd640 1 --2- 172.21.15.40:0/1373677462 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe43c161510 0x7fe43c0cdd50 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fe42c0097a0 tx=0x7fe42c02b8b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=70094a79a3cd6ec9 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:48:15.893 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:15.891+0000 7fe439ffb640 1 -- 172.21.15.40:0/1373677462 <== mon.2 v2:172.21.15.159:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe42c02d040 con 0x7fe43c161510 2023-12-17T11:48:15.893 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:15.891+0000 7fe439ffb640 1 -- 172.21.15.40:0/1373677462 <== mon.2 v2:172.21.15.159:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe42c031810 con 0x7fe43c161510 2023-12-17T11:48:15.893 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:15.891+0000 7fe439ffb640 1 -- 172.21.15.40:0/1373677462 <== mon.2 v2:172.21.15.159:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe42c031b80 con 0x7fe43c161510 2023-12-17T11:48:15.894 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:15.891+0000 7fe43bfff640 1 -- 172.21.15.40:0/1373677462 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe43c161510 msgr2=0x7fe43c0cdd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:15.894 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:15.891+0000 7fe43bfff640 1 --2- 172.21.15.40:0/1373677462 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe43c161510 0x7fe43c0cdd50 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fe42c0097a0 tx=0x7fe42c02b8b0 comp rx=0 tx=0).stop 2023-12-17T11:48:15.894 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:15.892+0000 7fe43bfff640 1 -- 172.21.15.40:0/1373677462 shutdown_connections 2023-12-17T11:48:15.894 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:15.892+0000 7fe43bfff640 1 --2- 172.21.15.40:0/1373677462 >> v2:172.21.15.159:3300/0 conn(0x7fe43c0cf6c0 0x7fe43c1651b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:15.894 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:15.892+0000 7fe43bfff640 1 --2- 172.21.15.40:0/1373677462 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe43c161510 0x7fe43c0cdd50 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:15.894 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:15.892+0000 7fe43bfff640 1 -- 172.21.15.40:0/1373677462 >> 172.21.15.40:0/1373677462 conn(0x7fe43c06a880 msgr2=0x7fe43c06ac90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:48:15.894 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:15.892+0000 7fe43bfff640 1 -- 172.21.15.40:0/1373677462 shutdown_connections 2023-12-17T11:48:15.894 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:15.892+0000 7fe43bfff640 1 -- 172.21.15.40:0/1373677462 wait complete. 2023-12-17T11:48:15.896 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:15.894+0000 7fe43bfff640 1 Processor -- start 2023-12-17T11:48:15.896 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:15.894+0000 7fe43bfff640 1 -- start start 2023-12-17T11:48:15.898 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:15.896+0000 7fe43bfff640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe43c0cd6a0 0x7fe43c164140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:15.898 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:15.896+0000 7fe43bfff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe43c0cf6c0 0x7fe43c150d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:15.898 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:15.896+0000 7fe43bfff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe43c161510 0x7fe43c15b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:15.899 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:15.896+0000 7fe43bfff640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe43c1630a0 con 0x7fe43c161510 2023-12-17T11:48:15.899 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:15.896+0000 7fe43bfff640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe43c163380 con 0x7fe43c0cf6c0 2023-12-17T11:48:15.899 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:15.896+0000 7fe43bfff640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe43c163660 con 0x7fe43c0cd6a0 2023-12-17T11:48:15.899 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:15.896+0000 7fe43b7fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe43c161510 0x7fe43c15b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:15.899 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:15.896+0000 7fe43b7fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe43c161510 0x7fe43c15b8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:50870/0 (socket says 172.21.15.40:50870) 2023-12-17T11:48:15.899 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:15.896+0000 7fe43b7fe640 1 -- 172.21.15.40:0/1525813531 learned_addr learned my addr 172.21.15.40:0/1525813531 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-17T11:48:15.899 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:15.896+0000 7fe43affd640 1 --2- 172.21.15.40:0/1525813531 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe43c0cd6a0 0x7fe43c164140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:15.899 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:15.896+0000 7fe43a7fc640 1 --2- 172.21.15.40:0/1525813531 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe43c0cf6c0 0x7fe43c150d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:15.899 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:15.896+0000 7fe43b7fe640 1 -- 172.21.15.40:0/1525813531 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe43c0cd6a0 msgr2=0x7fe43c164140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:15.899 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:15.896+0000 7fe43b7fe640 1 --2- 172.21.15.40:0/1525813531 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe43c0cd6a0 0x7fe43c164140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:15.899 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:15.896+0000 7fe43b7fe640 1 -- 172.21.15.40:0/1525813531 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe43c0cf6c0 msgr2=0x7fe43c150d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:15.899 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:15.896+0000 7fe43b7fe640 1 --2- 172.21.15.40:0/1525813531 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe43c0cf6c0 0x7fe43c150d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:15.899 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:15.896+0000 7fe43b7fe640 1 -- 172.21.15.40:0/1525813531 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe434009a70 con 0x7fe43c161510 2023-12-17T11:48:15.899 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:15.897+0000 7fe43a7fc640 1 --2- 172.21.15.40:0/1525813531 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe43c0cf6c0 0x7fe43c150d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-17T11:48:15.900 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:15.897+0000 7fe43b7fe640 1 --2- 172.21.15.40:0/1525813531 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe43c161510 0x7fe43c15b8e0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fe43400efc0 tx=0x7fe434009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:48:15.900 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:15.897+0000 7fe423fff640 1 -- 172.21.15.40:0/1525813531 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe434009d70 con 0x7fe43c161510 2023-12-17T11:48:15.900 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:15.897+0000 7fe423fff640 1 -- 172.21.15.40:0/1525813531 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe43400f040 con 0x7fe43c161510 2023-12-17T11:48:15.900 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:15.897+0000 7fe423fff640 1 -- 172.21.15.40:0/1525813531 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe434003990 con 0x7fe43c161510 2023-12-17T11:48:15.901 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:15.897+0000 7fe43bfff640 1 -- 172.21.15.40:0/1525813531 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe42c009400 con 0x7fe43c161510 2023-12-17T11:48:15.901 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:15.897+0000 7fe43bfff640 1 -- 172.21.15.40:0/1525813531 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe43c163c20 con 0x7fe43c161510 2023-12-17T11:48:15.901 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:15.898+0000 7fe43bfff640 1 -- 172.21.15.40:0/1525813531 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe43c163e40 con 0x7fe43c161510 2023-12-17T11:48:15.901 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:15.899+0000 7fe423fff640 1 -- 172.21.15.40:0/1525813531 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fe4340144a0 con 0x7fe43c161510 2023-12-17T11:48:15.902 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:15.900+0000 7fe423fff640 1 --2- 172.21.15.40:0/1525813531 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7fe42806ae40 0x7fe42806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:15.902 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:15.901+0000 7fe423fff640 1 -- 172.21.15.40:0/1525813531 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fe434089fc0 con 0x7fe43c161510 2023-12-17T11:48:15.903 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:15.901+0000 7fe43affd640 1 --2- 172.21.15.40:0/1525813531 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7fe42806ae40 0x7fe42806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:15.904 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:15.903+0000 7fe43affd640 1 --2- 172.21.15.40:0/1525813531 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7fe42806ae40 0x7fe42806d300 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fe42c036000 tx=0x7fe42c03c040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:48:15.907 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:15.905+0000 7fe423fff640 1 -- 172.21.15.40:0/1525813531 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fe4340bce90 con 0x7fe43c161510 2023-12-17T11:48:16.101 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:16.099+0000 7fe43bfff640 1 -- 172.21.15.40:0/1525813531 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fe43c074450 con 0x7fe43c161510 2023-12-17T11:48:16.201 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:16.199+0000 7fe423fff640 1 -- 172.21.15.40:0/1525813531 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v18) v1 ==== 138+0+0 (secure 0 0 0) 0x7fe434018020 con 0x7fe43c161510 2023-12-17T11:48:16.201 INFO:teuthology.orchestra.run.smithi040.stderr:pool 'cephfs_metadata' created 2023-12-17T11:48:16.204 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:16.202+0000 7fe43bfff640 1 -- 172.21.15.40:0/1525813531 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7fe42806ae40 msgr2=0x7fe42806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:16.204 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:16.202+0000 7fe43bfff640 1 --2- 172.21.15.40:0/1525813531 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7fe42806ae40 0x7fe42806d300 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fe42c036000 tx=0x7fe42c03c040 comp rx=0 tx=0).stop 2023-12-17T11:48:16.204 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:16.202+0000 7fe43bfff640 1 -- 172.21.15.40:0/1525813531 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe43c161510 msgr2=0x7fe43c15b8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:16.204 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:16.202+0000 7fe43bfff640 1 --2- 172.21.15.40:0/1525813531 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe43c161510 0x7fe43c15b8e0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fe43400efc0 tx=0x7fe434009f90 comp rx=0 tx=0).stop 2023-12-17T11:48:16.204 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:16.202+0000 7fe43bfff640 1 -- 172.21.15.40:0/1525813531 shutdown_connections 2023-12-17T11:48:16.205 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:16.202+0000 7fe43bfff640 1 --2- 172.21.15.40:0/1525813531 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7fe42806ae40 0x7fe42806d300 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:16.205 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:16.202+0000 7fe43bfff640 1 --2- 172.21.15.40:0/1525813531 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe43c161510 0x7fe43c15b8e0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:16.205 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:16.202+0000 7fe43bfff640 1 --2- 172.21.15.40:0/1525813531 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe43c0cf6c0 0x7fe43c150d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:16.205 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:16.202+0000 7fe43bfff640 1 --2- 172.21.15.40:0/1525813531 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe43c0cd6a0 0x7fe43c164140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:16.205 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:16.202+0000 7fe43bfff640 1 -- 172.21.15.40:0/1525813531 >> 172.21.15.40:0/1525813531 conn(0x7fe43c06a880 msgr2=0x7fe43c0abe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:48:16.205 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:16.203+0000 7fe43bfff640 1 -- 172.21.15.40:0/1525813531 shutdown_connections 2023-12-17T11:48:16.205 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:16.203+0000 7fe43bfff640 1 -- 172.21.15.40:0/1525813531 wait complete. 2023-12-17T11:48:16.232 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.05 2023-12-17T11:48:16.450 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:16.448+0000 7f5e9eebb640 1 Processor -- start 2023-12-17T11:48:16.451 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:16.449+0000 7f5e9eebb640 1 -- start start 2023-12-17T11:48:16.453 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:16.450+0000 7f5e9eebb640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f5e98155890 0x7f5e9815f470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:16.453 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:16.451+0000 7f5e9eebb640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e981416c0 con 0x7f5e9815f9b0 2023-12-17T11:48:16.453 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:16.451+0000 7f5e9eebb640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e9815ece0 con 0x7f5e981554b0 2023-12-17T11:48:16.453 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:16.451+0000 7f5e9eebb640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e9815bd60 con 0x7f5e98155890 2023-12-17T11:48:16.453 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:16.451+0000 7f5e97fff640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f5e98155890 0x7f5e9815f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:16.453 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:16.451+0000 7f5e97fff640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f5e98155890 0x7f5e9815f470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:50878/0 (socket says 172.21.15.40:50878) 2023-12-17T11:48:16.453 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:16.451+0000 7f5e97fff640 1 -- 172.21.15.40:0/1263777375 learned_addr learned my addr 172.21.15.40:0/1263777375 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-17T11:48:16.454 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:16.451+0000 7f5e97fff640 1 -- 172.21.15.40:0/1263777375 >> v1:172.21.15.159:6789/0 conn(0x7f5e981554b0 legacy=0x7f5e9815b650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:48:16.454 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:16.451+0000 7f5e97fff640 1 -- 172.21.15.40:0/1263777375 >> v1:172.21.15.40:6789/0 conn(0x7f5e9815f9b0 legacy=0x7f5e980cf1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:16.454 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:16.451+0000 7f5e97fff640 1 -- 172.21.15.40:0/1263777375 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e9815bf80 con 0x7f5e98155890 2023-12-17T11:48:16.454 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:16.453+0000 7f5e97fff640 1 --2- 172.21.15.40:0/1263777375 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5e98155890 0x7f5e9815f470 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f5e84009870 tx=0x7f5e8402b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46883324158c8a0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:48:16.455 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:16.453+0000 7f5e977fe640 1 -- 172.21.15.40:0/1263777375 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e84031870 con 0x7f5e98155890 2023-12-17T11:48:16.455 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:16.453+0000 7f5e977fe640 1 -- 172.21.15.40:0/1263777375 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e840319d0 con 0x7f5e98155890 2023-12-17T11:48:16.455 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:16.453+0000 7f5e977fe640 1 -- 172.21.15.40:0/1263777375 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e84031d60 con 0x7f5e98155890 2023-12-17T11:48:16.456 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:16.454+0000 7f5e9eebb640 1 -- 172.21.15.40:0/1263777375 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5e98155890 msgr2=0x7f5e9815f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:16.456 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:16.454+0000 7f5e9eebb640 1 --2- 172.21.15.40:0/1263777375 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5e98155890 0x7f5e9815f470 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f5e84009870 tx=0x7f5e8402b910 comp rx=0 tx=0).stop 2023-12-17T11:48:16.456 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:16.454+0000 7f5e9eebb640 1 -- 172.21.15.40:0/1263777375 shutdown_connections 2023-12-17T11:48:16.456 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:16.454+0000 7f5e9eebb640 1 --2- 172.21.15.40:0/1263777375 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5e98155890 0x7f5e9815f470 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:16.456 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:16.454+0000 7f5e9eebb640 1 -- 172.21.15.40:0/1263777375 >> 172.21.15.40:0/1263777375 conn(0x7f5e9806a880 msgr2=0x7f5e9806ac90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:48:16.456 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:16.454+0000 7f5e9eebb640 1 -- 172.21.15.40:0/1263777375 shutdown_connections 2023-12-17T11:48:16.456 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:16.454+0000 7f5e9eebb640 1 -- 172.21.15.40:0/1263777375 wait complete. 2023-12-17T11:48:16.457 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:16.456+0000 7f5e9eebb640 1 Processor -- start 2023-12-17T11:48:16.458 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:16.456+0000 7f5e9eebb640 1 -- start start 2023-12-17T11:48:16.460 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:16.457+0000 7f5e9eebb640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5e981554b0 0x7f5e981f71f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:16.461 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:16.457+0000 7f5e9eebb640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5e98155890 0x7f5e98139ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:16.461 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:16.457+0000 7f5e9eebb640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5e9815f9b0 0x7f5e9813a0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:16.461 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:16.457+0000 7f5e9eebb640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e981f7730 con 0x7f5e98155890 2023-12-17T11:48:16.461 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:16.457+0000 7f5e9eebb640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e980b3480 con 0x7f5e981554b0 2023-12-17T11:48:16.461 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:16.457+0000 7f5e9eebb640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e9813a770 con 0x7f5e9815f9b0 2023-12-17T11:48:16.461 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:16.457+0000 7f5e97fff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5e98155890 0x7f5e98139ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:16.461 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:16.457+0000 7f5e97fff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5e98155890 0x7f5e98139ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:50892/0 (socket says 172.21.15.40:50892) 2023-12-17T11:48:16.461 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:16.457+0000 7f5e97fff640 1 -- 172.21.15.40:0/184761757 learned_addr learned my addr 172.21.15.40:0/184761757 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-17T11:48:16.461 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:16.457+0000 7f5e9cc57640 1 --2- 172.21.15.40:0/184761757 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5e981554b0 0x7f5e981f71f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:16.461 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:16.458+0000 7f5e97fff640 1 -- 172.21.15.40:0/184761757 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5e9815f9b0 msgr2=0x7f5e9813a0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:16.461 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:16.458+0000 7f5e9d458640 1 --2- 172.21.15.40:0/184761757 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5e9815f9b0 0x7f5e9813a0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:16.461 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:16.458+0000 7f5e97fff640 1 --2- 172.21.15.40:0/184761757 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5e9815f9b0 0x7f5e9813a0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:16.462 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:16.458+0000 7f5e97fff640 1 -- 172.21.15.40:0/184761757 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5e981554b0 msgr2=0x7f5e981f71f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:16.462 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:16.458+0000 7f5e97fff640 1 --2- 172.21.15.40:0/184761757 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5e981554b0 0x7f5e981f71f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:16.462 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:16.458+0000 7f5e97fff640 1 -- 172.21.15.40:0/184761757 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e840094d0 con 0x7f5e98155890 2023-12-17T11:48:16.462 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:16.458+0000 7f5e97fff640 1 --2- 172.21.15.40:0/184761757 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5e98155890 0x7f5e98139ba0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f5e84009870 tx=0x7f5e840046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:48:16.462 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:16.458+0000 7f5e957fa640 1 -- 172.21.15.40:0/184761757 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e84031820 con 0x7f5e98155890 2023-12-17T11:48:16.462 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:16.458+0000 7f5e957fa640 1 -- 172.21.15.40:0/184761757 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e840443f0 con 0x7f5e98155890 2023-12-17T11:48:16.462 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:16.458+0000 7f5e957fa640 1 -- 172.21.15.40:0/184761757 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e840447a0 con 0x7f5e98155890 2023-12-17T11:48:16.462 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:16.458+0000 7f5e9eebb640 1 -- 172.21.15.40:0/184761757 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e9813aa50 con 0x7f5e98155890 2023-12-17T11:48:16.462 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:16.459+0000 7f5e9eebb640 1 -- 172.21.15.40:0/184761757 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e9813b950 con 0x7f5e98155890 2023-12-17T11:48:16.462 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:16.459+0000 7f5e9eebb640 1 -- 172.21.15.40:0/184761757 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e9813af70 con 0x7f5e98155890 2023-12-17T11:48:16.463 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:16.462+0000 7f5e957fa640 1 -- 172.21.15.40:0/184761757 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f5e8404d450 con 0x7f5e98155890 2023-12-17T11:48:16.464 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:16.462+0000 7f5e957fa640 1 --2- 172.21.15.40:0/184761757 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f5e7c06ae90 0x7f5e7c06d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:16.464 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:16.463+0000 7f5e957fa640 1 -- 172.21.15.40:0/184761757 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5227+0+0 (secure 0 0 0) 0x7f5e8402d040 con 0x7f5e98155890 2023-12-17T11:48:16.465 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:16.463+0000 7f5e9cc57640 1 --2- 172.21.15.40:0/184761757 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f5e7c06ae90 0x7f5e7c06d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:16.466 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:16.464+0000 7f5e9cc57640 1 --2- 172.21.15.40:0/184761757 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f5e7c06ae90 0x7f5e7c06d350 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f5e8c006fd0 tx=0x7f5e8c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:48:16.468 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:16.466+0000 7f5e957fa640 1 -- 172.21.15.40:0/184761757 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f5e84077190 con 0x7f5e98155890 2023-12-17T11:48:16.666 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:16.664+0000 7f5e9eebb640 1 -- 172.21.15.40:0/184761757 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} v 0) v1 -- 0x7f5e9813af70 con 0x7f5e98155890 2023-12-17T11:48:17.208 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:17.206+0000 7f5e957fa640 1 -- 172.21.15.40:0/184761757 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]=0 pool 'cephfs_data' created v19) v1 ==== 171+0+0 (secure 0 0 0) 0x7f5e9813af70 con 0x7f5e98155890 2023-12-17T11:48:17.209 INFO:teuthology.orchestra.run.smithi040.stderr:pool 'cephfs_data' created 2023-12-17T11:48:17.212 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:17.210+0000 7f5e9eebb640 1 -- 172.21.15.40:0/184761757 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f5e7c06ae90 msgr2=0x7f5e7c06d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:17.212 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:17.210+0000 7f5e9eebb640 1 --2- 172.21.15.40:0/184761757 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f5e7c06ae90 0x7f5e7c06d350 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f5e8c006fd0 tx=0x7f5e8c008040 comp rx=0 tx=0).stop 2023-12-17T11:48:17.213 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:17.210+0000 7f5e9eebb640 1 -- 172.21.15.40:0/184761757 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5e98155890 msgr2=0x7f5e98139ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:17.213 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:17.210+0000 7f5e9eebb640 1 --2- 172.21.15.40:0/184761757 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5e98155890 0x7f5e98139ba0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f5e84009870 tx=0x7f5e840046c0 comp rx=0 tx=0).stop 2023-12-17T11:48:17.213 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:17.210+0000 7f5e9eebb640 1 -- 172.21.15.40:0/184761757 shutdown_connections 2023-12-17T11:48:17.213 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:17.210+0000 7f5e9eebb640 1 --2- 172.21.15.40:0/184761757 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f5e7c06ae90 0x7f5e7c06d350 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:17.213 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:17.210+0000 7f5e9eebb640 1 --2- 172.21.15.40:0/184761757 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5e9815f9b0 0x7f5e9813a0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:17.213 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:17.210+0000 7f5e9eebb640 1 --2- 172.21.15.40:0/184761757 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5e98155890 0x7f5e98139ba0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:17.213 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:17.210+0000 7f5e9eebb640 1 --2- 172.21.15.40:0/184761757 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5e981554b0 0x7f5e981f71f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:17.213 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:17.210+0000 7f5e9eebb640 1 -- 172.21.15.40:0/184761757 >> 172.21.15.40:0/184761757 conn(0x7f5e9806a880 msgr2=0x7f5e980cf170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:48:17.213 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:17.211+0000 7f5e9eebb640 1 -- 172.21.15.40:0/184761757 shutdown_connections 2023-12-17T11:48:17.214 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:17.211+0000 7f5e9eebb640 1 -- 172.21.15.40:0/184761757 wait complete. 2023-12-17T11:48:17.248 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-12-17T11:48:17.441 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:17.439+0000 7fd285733640 1 Processor -- start 2023-12-17T11:48:17.441 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:17.439+0000 7fd285733640 1 -- start start 2023-12-17T11:48:17.443 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:17.441+0000 7fd285733640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd28006c6a0 0x7fd28006fa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:17.443 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:17.441+0000 7fd285733640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fd28009a100 0x7fd2800cb530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:17.443 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:17.441+0000 7fd285733640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd28006b780 con 0x7fd28015d6d0 2023-12-17T11:48:17.443 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:17.441+0000 7fd285733640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd28006b9d0 con 0x7fd28009a100 2023-12-17T11:48:17.443 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:17.441+0000 7fd285733640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd28006ecc0 con 0x7fd28006c6a0 2023-12-17T11:48:17.443 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:17.441+0000 7fd27f7fe640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fd28009a100 0x7fd2800cb530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:17.443 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:17.441+0000 7fd27f7fe640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fd28009a100 0x7fd2800cb530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:50908/0 (socket says 172.21.15.40:50908) 2023-12-17T11:48:17.443 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:17.441+0000 7fd27f7fe640 1 -- 172.21.15.40:0/2310982063 learned_addr learned my addr 172.21.15.40:0/2310982063 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-17T11:48:17.444 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:17.442+0000 7fd27e7fc640 1 --2- 172.21.15.40:0/2310982063 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd28006c6a0 0x7fd28006fa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:17.444 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:17.442+0000 7fd27f7fe640 1 -- 172.21.15.40:0/2310982063 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd28006c6a0 msgr2=0x7fd28006fa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:48:17.444 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:17.442+0000 7fd27f7fe640 1 --2- 172.21.15.40:0/2310982063 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd28006c6a0 0x7fd28006fa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:17.444 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:17.442+0000 7fd27f7fe640 1 -- 172.21.15.40:0/2310982063 >> v1:172.21.15.40:6789/0 conn(0x7fd28015d6d0 legacy=0x7fd2800999f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:17.445 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:17.442+0000 7fd27f7fe640 1 -- 172.21.15.40:0/2310982063 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd28006efa0 con 0x7fd28009a100 2023-12-17T11:48:17.445 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:17.442+0000 7fd27dffb640 1 -- 172.21.15.40:0/2310982063 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 216244300 0 0) 0x7fd28006b780 con 0x7fd28015d6d0 2023-12-17T11:48:17.445 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:17.442+0000 7fd27e7fc640 1 --2- 172.21.15.40:0/2310982063 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd28006c6a0 0x7fd28006fa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-17T11:48:17.445 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:17.443+0000 7fd27f7fe640 1 --2- 172.21.15.40:0/2310982063 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd28009a100 0x7fd2800cb530 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fd278009870 tx=0x7fd27802b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30bf71d48e975a3a server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:48:17.445 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:17.443+0000 7fd27dffb640 1 -- 172.21.15.40:0/2310982063 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd278031640 con 0x7fd28009a100 2023-12-17T11:48:17.445 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:17.443+0000 7fd27dffb640 1 -- 172.21.15.40:0/2310982063 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2780317a0 con 0x7fd28009a100 2023-12-17T11:48:17.446 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:17.443+0000 7fd27dffb640 1 -- 172.21.15.40:0/2310982063 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd278031b30 con 0x7fd28009a100 2023-12-17T11:48:17.446 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:17.444+0000 7fd285733640 1 -- 172.21.15.40:0/2310982063 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd28009a100 msgr2=0x7fd2800cb530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:17.446 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:17.444+0000 7fd285733640 1 --2- 172.21.15.40:0/2310982063 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd28009a100 0x7fd2800cb530 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fd278009870 tx=0x7fd27802b8f0 comp rx=0 tx=0).stop 2023-12-17T11:48:17.446 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:17.444+0000 7fd285733640 1 -- 172.21.15.40:0/2310982063 shutdown_connections 2023-12-17T11:48:17.446 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:17.444+0000 7fd285733640 1 --2- 172.21.15.40:0/2310982063 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd28009a100 0x7fd2800cb530 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:17.447 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:17.444+0000 7fd285733640 1 --2- 172.21.15.40:0/2310982063 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd28006c6a0 0x7fd28006fa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:17.447 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:17.444+0000 7fd285733640 1 -- 172.21.15.40:0/2310982063 >> 172.21.15.40:0/2310982063 conn(0x7fd2800d0ee0 msgr2=0x7fd2800d12f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:48:17.447 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:17.444+0000 7fd285733640 1 -- 172.21.15.40:0/2310982063 shutdown_connections 2023-12-17T11:48:17.447 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:17.444+0000 7fd285733640 1 -- 172.21.15.40:0/2310982063 wait complete. 2023-12-17T11:48:17.448 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:17.446+0000 7fd285733640 1 Processor -- start 2023-12-17T11:48:17.448 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:17.446+0000 7fd285733640 1 -- start start 2023-12-17T11:48:17.450 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:17.447+0000 7fd285733640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd28006c6a0 0x7fd2800c9170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:17.450 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:17.447+0000 7fd285733640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd28009a100 0x7fd2800c96b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:17.450 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:17.447+0000 7fd285733640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd28015d6d0 0x7fd2801f2ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:17.450 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:17.447+0000 7fd285733640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2801f4930 con 0x7fd28015d6d0 2023-12-17T11:48:17.450 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:17.447+0000 7fd285733640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2800c9ea0 con 0x7fd28009a100 2023-12-17T11:48:17.450 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:17.447+0000 7fd285733640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2800c9bf0 con 0x7fd28006c6a0 2023-12-17T11:48:17.450 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:17.447+0000 7fd27f7fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd28015d6d0 0x7fd2801f2ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:17.450 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:17.447+0000 7fd27f7fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd28015d6d0 0x7fd2801f2ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:50910/0 (socket says 172.21.15.40:50910) 2023-12-17T11:48:17.450 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:17.447+0000 7fd27f7fe640 1 -- 172.21.15.40:0/2743703049 learned_addr learned my addr 172.21.15.40:0/2743703049 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-17T11:48:17.450 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:17.448+0000 7fd27e7fc640 1 --2- 172.21.15.40:0/2743703049 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd28009a100 0x7fd2800c96b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:17.450 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:17.448+0000 7fd27effd640 1 --2- 172.21.15.40:0/2743703049 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd28006c6a0 0x7fd2800c9170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:17.450 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:17.448+0000 7fd27f7fe640 1 -- 172.21.15.40:0/2743703049 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd28006c6a0 msgr2=0x7fd2800c9170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:17.451 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:17.448+0000 7fd27f7fe640 1 --2- 172.21.15.40:0/2743703049 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd28006c6a0 0x7fd2800c9170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:17.451 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:17.448+0000 7fd27f7fe640 1 -- 172.21.15.40:0/2743703049 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd28009a100 msgr2=0x7fd2800c96b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:17.451 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:17.448+0000 7fd27f7fe640 1 --2- 172.21.15.40:0/2743703049 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd28009a100 0x7fd2800c96b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:17.451 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:17.448+0000 7fd27f7fe640 1 -- 172.21.15.40:0/2743703049 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2780094d0 con 0x7fd28015d6d0 2023-12-17T11:48:17.451 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:17.448+0000 7fd27f7fe640 1 --2- 172.21.15.40:0/2743703049 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd28015d6d0 0x7fd2801f2ca0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fd27802b930 tx=0x7fd2780046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:48:17.452 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:17.448+0000 7fd2777fe640 1 -- 172.21.15.40:0/2743703049 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd27803ac60 con 0x7fd28015d6d0 2023-12-17T11:48:17.452 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:17.449+0000 7fd2777fe640 1 -- 172.21.15.40:0/2743703049 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd27803ade0 con 0x7fd28015d6d0 2023-12-17T11:48:17.452 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:17.449+0000 7fd2777fe640 1 -- 172.21.15.40:0/2743703049 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd278044630 con 0x7fd28015d6d0 2023-12-17T11:48:17.452 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:17.449+0000 7fd285733640 1 -- 172.21.15.40:0/2743703049 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2801f3f90 con 0x7fd28015d6d0 2023-12-17T11:48:17.452 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:17.449+0000 7fd285733640 1 -- 172.21.15.40:0/2743703049 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2801f4550 con 0x7fd28015d6d0 2023-12-17T11:48:17.452 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:17.450+0000 7fd285733640 1 -- 172.21.15.40:0/2743703049 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd280067f30 con 0x7fd28015d6d0 2023-12-17T11:48:17.453 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:17.451+0000 7fd2777fe640 1 -- 172.21.15.40:0/2743703049 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fd27802f050 con 0x7fd28015d6d0 2023-12-17T11:48:17.454 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:17.452+0000 7fd2777fe640 1 --2- 172.21.15.40:0/2743703049 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7fd26006ae40 0x7fd26006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:17.454 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:17.452+0000 7fd2777fe640 1 -- 172.21.15.40:0/2743703049 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5609+0+0 (secure 0 0 0) 0x7fd2780ab6c0 con 0x7fd28015d6d0 2023-12-17T11:48:17.454 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:17.453+0000 7fd27effd640 1 --2- 172.21.15.40:0/2743703049 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7fd26006ae40 0x7fd26006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:17.455 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:17.454+0000 7fd27effd640 1 --2- 172.21.15.40:0/2743703049 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7fd26006ae40 0x7fd26006d300 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fd270007fd0 tx=0x7fd270009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:48:17.459 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:17.457+0000 7fd2777fe640 1 -- 172.21.15.40:0/2743703049 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fd2780767c0 con 0x7fd28015d6d0 2023-12-17T11:48:17.696 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:17.693+0000 7fd285733640 1 -- 172.21.15.40:0/2743703049 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fd28006cf00 con 0x7fd28015d6d0 2023-12-17T11:48:18.254 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:18.251+0000 7fd2777fe640 1 -- 172.21.15.40:0/2743703049 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7fd27804d450 con 0x7fd28015d6d0 2023-12-17T11:48:18.260 INFO:teuthology.orchestra.run.smithi040.stderr:new fs with metadata pool 2 and data pool 3 2023-12-17T11:48:18.264 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:18.262+0000 7fd285733640 1 -- 172.21.15.40:0/2743703049 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7fd26006ae40 msgr2=0x7fd26006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:18.264 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:18.262+0000 7fd285733640 1 --2- 172.21.15.40:0/2743703049 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7fd26006ae40 0x7fd26006d300 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fd270007fd0 tx=0x7fd270009040 comp rx=0 tx=0).stop 2023-12-17T11:48:18.264 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:18.262+0000 7fd285733640 1 -- 172.21.15.40:0/2743703049 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd28015d6d0 msgr2=0x7fd2801f2ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:18.265 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:18.262+0000 7fd285733640 1 --2- 172.21.15.40:0/2743703049 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd28015d6d0 0x7fd2801f2ca0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fd27802b930 tx=0x7fd2780046c0 comp rx=0 tx=0).stop 2023-12-17T11:48:18.265 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:18.262+0000 7fd285733640 1 -- 172.21.15.40:0/2743703049 shutdown_connections 2023-12-17T11:48:18.265 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:18.262+0000 7fd285733640 1 --2- 172.21.15.40:0/2743703049 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7fd26006ae40 0x7fd26006d300 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:18.265 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:18.262+0000 7fd285733640 1 --2- 172.21.15.40:0/2743703049 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd28015d6d0 0x7fd2801f2ca0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:18.265 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:18.262+0000 7fd285733640 1 --2- 172.21.15.40:0/2743703049 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd28009a100 0x7fd2800c96b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:18.265 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:18.262+0000 7fd285733640 1 --2- 172.21.15.40:0/2743703049 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd28006c6a0 0x7fd2800c9170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:18.265 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:18.262+0000 7fd285733640 1 -- 172.21.15.40:0/2743703049 >> 172.21.15.40:0/2743703049 conn(0x7fd2800d0ee0 msgr2=0x7fd2800cede0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:48:18.266 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:18.264+0000 7fd285733640 1 -- 172.21.15.40:0/2743703049 shutdown_connections 2023-12-17T11:48:18.267 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:18.265+0000 7fd285733640 1 -- 172.21.15.40:0/2743703049 wait complete. 2023-12-17T11:48:18.300 DEBUG:tasks.cephfs.filesystem:EC profile is ['m=2', 'k=2', 'crush-failure-domain=osd'] 2023-12-17T11:48:18.301 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd erasure-code-profile set cephfs_data_ec m=2 k=2 crush-failure-domain=osd 2023-12-17T11:48:18.498 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:18.495+0000 7fdaa8652640 1 Processor -- start 2023-12-17T11:48:18.498 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:18.496+0000 7fdaa8652640 1 -- start start 2023-12-17T11:48:18.500 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:18.497+0000 7fdaa8652640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7fdaa014b090 0x7fdaa00b1d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:18.500 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:18.497+0000 7fdaa8652640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fdaa00cdab0 0x7fdaa0070200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:18.500 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:18.497+0000 7fdaa8652640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fdaa00cdf10 0x7fdaa0070740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:18.500 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:18.497+0000 7fdaa8652640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdaa00ccf40 con 0x7fdaa00cdab0 2023-12-17T11:48:18.500 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:18.497+0000 7fdaa8652640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdaa006c430 con 0x7fdaa014b090 2023-12-17T11:48:18.500 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:18.497+0000 7fdaa8652640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdaa006c710 con 0x7fdaa00cdf10 2023-12-17T11:48:18.500 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:18.498+0000 7fdaa5bed640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fdaa00cdab0 0x7fdaa0070200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:18.501 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:18.498+0000 7fdaa5bed640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fdaa00cdab0 0x7fdaa0070200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:50922/0 (socket says 172.21.15.40:50922) 2023-12-17T11:48:18.501 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:18.498+0000 7fdaa5bed640 1 -- 172.21.15.40:0/705106126 learned_addr learned my addr 172.21.15.40:0/705106126 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-17T11:48:18.501 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:18.498+0000 7fdaa6bef640 1 --2- 172.21.15.40:0/705106126 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fdaa00cdf10 0x7fdaa0070740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:18.501 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:18.498+0000 7fdaa63ee640 1 --2- 172.21.15.40:0/705106126 >> v2:172.21.15.159:3300/0 conn(0x7fdaa014b090 0x7fdaa00b1d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:18.501 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:18.498+0000 7fdaa5bed640 1 -- 172.21.15.40:0/705106126 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fdaa00cdf10 msgr2=0x7fdaa0070740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:48:18.501 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:18.498+0000 7fdaa5bed640 1 --2- 172.21.15.40:0/705106126 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fdaa00cdf10 0x7fdaa0070740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:18.501 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:18.498+0000 7fdaa5bed640 1 -- 172.21.15.40:0/705106126 >> v2:172.21.15.159:3300/0 conn(0x7fdaa014b090 msgr2=0x7fdaa00b1d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:48:18.501 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:18.498+0000 7fdaa5bed640 1 --2- 172.21.15.40:0/705106126 >> v2:172.21.15.159:3300/0 conn(0x7fdaa014b090 0x7fdaa00b1d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:18.501 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:18.498+0000 7fdaa5bed640 1 -- 172.21.15.40:0/705106126 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdaa006c9f0 con 0x7fdaa00cdab0 2023-12-17T11:48:18.501 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:18.498+0000 7fdaa63ee640 1 --2- 172.21.15.40:0/705106126 >> v2:172.21.15.159:3300/0 conn(0x7fdaa014b090 0x7fdaa00b1d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-17T11:48:18.502 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:18.499+0000 7fdaa5bed640 1 --2- 172.21.15.40:0/705106126 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdaa00cdab0 0x7fdaa0070200 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fdaa00cfd90 tx=0x7fda9402b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d568365503f09ef6 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:48:18.503 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:18.500+0000 7fdaa53ec640 1 -- 172.21.15.40:0/705106126 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda94031870 con 0x7fdaa00cdab0 2023-12-17T11:48:18.503 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:18.500+0000 7fdaa53ec640 1 -- 172.21.15.40:0/705106126 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda940319d0 con 0x7fdaa00cdab0 2023-12-17T11:48:18.503 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:18.500+0000 7fdaa53ec640 1 -- 172.21.15.40:0/705106126 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda94031d60 con 0x7fdaa00cdab0 2023-12-17T11:48:18.503 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:18.500+0000 7fdaa8652640 1 -- 172.21.15.40:0/705106126 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdaa00cdab0 msgr2=0x7fdaa0070200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:18.503 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:18.500+0000 7fdaa8652640 1 --2- 172.21.15.40:0/705106126 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdaa00cdab0 0x7fdaa0070200 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fdaa00cfd90 tx=0x7fda9402b910 comp rx=0 tx=0).stop 2023-12-17T11:48:18.503 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:18.500+0000 7fdaa8652640 1 -- 172.21.15.40:0/705106126 shutdown_connections 2023-12-17T11:48:18.503 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:18.500+0000 7fdaa8652640 1 --2- 172.21.15.40:0/705106126 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fdaa00cdf10 0x7fdaa0070740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:18.503 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:18.500+0000 7fdaa8652640 1 --2- 172.21.15.40:0/705106126 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdaa00cdab0 0x7fdaa0070200 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:18.503 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:18.500+0000 7fdaa8652640 1 --2- 172.21.15.40:0/705106126 >> v2:172.21.15.159:3300/0 conn(0x7fdaa014b090 0x7fdaa00b1d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:18.503 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:18.500+0000 7fdaa8652640 1 -- 172.21.15.40:0/705106126 >> 172.21.15.40:0/705106126 conn(0x7fdaa00b0a90 msgr2=0x7fdaa00b0ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:48:18.503 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:18.501+0000 7fdaa8652640 1 -- 172.21.15.40:0/705106126 shutdown_connections 2023-12-17T11:48:18.503 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:18.501+0000 7fdaa8652640 1 -- 172.21.15.40:0/705106126 wait complete. 2023-12-17T11:48:18.505 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:18.503+0000 7fdaa8652640 1 Processor -- start 2023-12-17T11:48:18.505 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:18.503+0000 7fdaa8652640 1 -- start start 2023-12-17T11:48:18.508 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:18.504+0000 7fdaa8652640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fdaa00cdab0 0x7fdaa0145920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:18.508 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:18.504+0000 7fdaa8652640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdaa00cdf10 0x7fdaa0144470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:18.508 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:18.504+0000 7fdaa8652640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdaa014b090 0x7fdaa01449b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:18.508 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:18.504+0000 7fdaa8652640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdaa0143750 con 0x7fdaa014b090 2023-12-17T11:48:18.508 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:18.504+0000 7fdaa8652640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdaa0145e60 con 0x7fdaa00cdf10 2023-12-17T11:48:18.508 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:18.504+0000 7fdaa8652640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdaa0151c50 con 0x7fdaa00cdab0 2023-12-17T11:48:18.508 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:18.504+0000 7fdaa6bef640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdaa014b090 0x7fdaa01449b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:18.508 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:18.505+0000 7fdaa6bef640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdaa014b090 0x7fdaa01449b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:50936/0 (socket says 172.21.15.40:50936) 2023-12-17T11:48:18.508 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:18.505+0000 7fdaa6bef640 1 -- 172.21.15.40:0/2065596831 learned_addr learned my addr 172.21.15.40:0/2065596831 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-17T11:48:18.508 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:18.505+0000 7fdaa63ee640 1 --2- 172.21.15.40:0/2065596831 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fdaa00cdab0 0x7fdaa0145920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:18.509 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:18.505+0000 7fdaa5bed640 1 --2- 172.21.15.40:0/2065596831 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdaa00cdf10 0x7fdaa0144470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:18.509 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:18.505+0000 7fdaa6bef640 1 -- 172.21.15.40:0/2065596831 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fdaa00cdab0 msgr2=0x7fdaa0145920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:18.509 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:18.505+0000 7fdaa6bef640 1 --2- 172.21.15.40:0/2065596831 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fdaa00cdab0 0x7fdaa0145920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:18.509 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:18.505+0000 7fdaa6bef640 1 -- 172.21.15.40:0/2065596831 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdaa00cdf10 msgr2=0x7fdaa0144470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:18.509 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:18.505+0000 7fdaa6bef640 1 --2- 172.21.15.40:0/2065596831 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdaa00cdf10 0x7fdaa0144470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:18.509 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:18.505+0000 7fdaa6bef640 1 -- 172.21.15.40:0/2065596831 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda940094d0 con 0x7fdaa014b090 2023-12-17T11:48:18.509 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:18.505+0000 7fdaa6bef640 1 --2- 172.21.15.40:0/2065596831 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdaa014b090 0x7fdaa01449b0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fda9800efc0 tx=0x7fda9800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:48:18.509 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:18.506+0000 7fda92ffd640 1 -- 172.21.15.40:0/2065596831 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda98009ba0 con 0x7fdaa014b090 2023-12-17T11:48:18.509 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:18.506+0000 7fda92ffd640 1 -- 172.21.15.40:0/2065596831 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda9800f040 con 0x7fdaa014b090 2023-12-17T11:48:18.509 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:18.506+0000 7fdaa8652640 1 -- 172.21.15.40:0/2065596831 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdaa0151f30 con 0x7fdaa014b090 2023-12-17T11:48:18.509 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:18.506+0000 7fda92ffd640 1 -- 172.21.15.40:0/2065596831 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda980146c0 con 0x7fdaa014b090 2023-12-17T11:48:18.509 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:18.506+0000 7fdaa8652640 1 -- 172.21.15.40:0/2065596831 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdaa01524f0 con 0x7fdaa014b090 2023-12-17T11:48:18.510 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:18.507+0000 7fdaa8652640 1 -- 172.21.15.40:0/2065596831 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdaa01526e0 con 0x7fdaa014b090 2023-12-17T11:48:18.510 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:18.508+0000 7fda92ffd640 1 -- 172.21.15.40:0/2065596831 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fda98014820 con 0x7fdaa014b090 2023-12-17T11:48:18.512 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:18.510+0000 7fda92ffd640 1 --2- 172.21.15.40:0/2065596831 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7fda8406ae70 0x7fda8406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:18.512 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:18.510+0000 7fda92ffd640 1 -- 172.21.15.40:0/2065596831 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fda9808a140 con 0x7fdaa014b090 2023-12-17T11:48:18.512 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:18.511+0000 7fdaa63ee640 1 --2- 172.21.15.40:0/2065596831 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7fda8406ae70 0x7fda8406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:18.513 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:18.512+0000 7fdaa63ee640 1 --2- 172.21.15.40:0/2065596831 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7fda8406ae70 0x7fda8406d330 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fda9c00aae0 tx=0x7fda9c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:48:18.516 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:18.515+0000 7fda92ffd640 1 -- 172.21.15.40:0/2065596831 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fda980550c0 con 0x7fdaa014b090 2023-12-17T11:48:18.724 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:18.721+0000 7fdaa8652640 1 -- 172.21.15.40:0/2065596831 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} v 0) v1 -- 0x7fdaa0074670 con 0x7fdaa014b090 2023-12-17T11:48:19.105 INFO:tasks.ceph.mds.d.smithi159.stderr:2023-12-17T11:48:19.103+0000 7f61c96bf640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-12-17T11:48:19.256 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:19.254+0000 7fda92ffd640 1 -- 172.21.15.40:0/2065596831 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]=0 v21) v1 ==== 157+0+0 (secure 0 0 0) 0x7fda980586e0 con 0x7fdaa014b090 2023-12-17T11:48:19.260 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:19.258+0000 7fdaa8652640 1 -- 172.21.15.40:0/2065596831 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7fda8406ae70 msgr2=0x7fda8406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:19.260 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:19.258+0000 7fdaa8652640 1 --2- 172.21.15.40:0/2065596831 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7fda8406ae70 0x7fda8406d330 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fda9c00aae0 tx=0x7fda9c008040 comp rx=0 tx=0).stop 2023-12-17T11:48:19.260 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:19.258+0000 7fdaa8652640 1 -- 172.21.15.40:0/2065596831 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdaa014b090 msgr2=0x7fdaa01449b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:19.260 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:19.258+0000 7fdaa8652640 1 --2- 172.21.15.40:0/2065596831 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdaa014b090 0x7fdaa01449b0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fda9800efc0 tx=0x7fda9800c490 comp rx=0 tx=0).stop 2023-12-17T11:48:19.260 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:19.258+0000 7fdaa8652640 1 -- 172.21.15.40:0/2065596831 shutdown_connections 2023-12-17T11:48:19.261 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:19.258+0000 7fdaa8652640 1 --2- 172.21.15.40:0/2065596831 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7fda8406ae70 0x7fda8406d330 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:19.261 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:19.258+0000 7fdaa8652640 1 --2- 172.21.15.40:0/2065596831 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdaa014b090 0x7fdaa01449b0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:19.261 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:19.258+0000 7fdaa8652640 1 --2- 172.21.15.40:0/2065596831 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdaa00cdf10 0x7fdaa0144470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:19.261 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:19.258+0000 7fdaa8652640 1 --2- 172.21.15.40:0/2065596831 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fdaa00cdab0 0x7fdaa0145920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:19.261 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:19.258+0000 7fdaa8652640 1 -- 172.21.15.40:0/2065596831 >> 172.21.15.40:0/2065596831 conn(0x7fdaa00b0a90 msgr2=0x7fdaa00cf590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:48:19.261 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:19.258+0000 7fdaa8652640 1 -- 172.21.15.40:0/2065596831 shutdown_connections 2023-12-17T11:48:19.261 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:19.259+0000 7fdaa8652640 1 -- 172.21.15.40:0/2065596831 wait complete. 2023-12-17T11:48:19.282 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data_ec erasure cephfs_data_ec --pg_num_min 64 --target_size_ratio 0.9 2023-12-17T11:48:19.505 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:19.503+0000 7f3b5921e640 1 Processor -- start 2023-12-17T11:48:19.505 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:19.503+0000 7f3b5921e640 1 -- start start 2023-12-17T11:48:19.507 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:19.505+0000 7f3b5921e640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f3b5406d770 0x7f3b540b1e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:19.507 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:19.505+0000 7f3b5921e640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b5415b780 con 0x7f3b54141960 2023-12-17T11:48:19.507 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:19.505+0000 7f3b5921e640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b5415b9d0 con 0x7f3b5406db50 2023-12-17T11:48:19.507 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:19.505+0000 7f3b5921e640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b5415bcb0 con 0x7f3b5406d770 2023-12-17T11:48:19.509 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:19.505+0000 7f3b5359e640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f3b54141960 0x7f3b540cce00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:49290/0 (socket says 172.21.15.40:49290) 2023-12-17T11:48:19.509 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:19.505+0000 7f3b5359e640 1 -- 172.21.15.40:0/404852779 learned_addr learned my addr 172.21.15.40:0/404852779 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-12-17T11:48:19.509 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:19.506+0000 7f3b52d9d640 1 --2- 172.21.15.40:0/404852779 >> v2:172.21.15.159:3300/0 conn(0x7f3b5406d770 0x7f3b540b1e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:19.509 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:19.506+0000 7f3b5259c640 1 -- 172.21.15.40:0/404852779 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3298367165 0 0) 0x7f3b5415b780 con 0x7f3b54141960 2023-12-17T11:48:19.509 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:19.506+0000 7f3b5259c640 1 -- 172.21.15.40:0/404852779 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3b40003520 con 0x7f3b54141960 2023-12-17T11:48:19.510 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:19.506+0000 7f3b5259c640 1 -- 172.21.15.40:0/404852779 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2196917387 0 0) 0x7f3b40003520 con 0x7f3b54141960 2023-12-17T11:48:19.510 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:19.506+0000 7f3b5259c640 1 -- 172.21.15.40:0/404852779 >> v2:172.21.15.159:3300/0 conn(0x7f3b5406d770 msgr2=0x7f3b540b1e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:48:19.510 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:19.506+0000 7f3b5259c640 1 --2- 172.21.15.40:0/404852779 >> v2:172.21.15.159:3300/0 conn(0x7f3b5406d770 0x7f3b540b1e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:19.510 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:19.506+0000 7f3b5259c640 1 -- 172.21.15.40:0/404852779 >> v1:172.21.15.159:6789/0 conn(0x7f3b5406db50 legacy=0x7f3b54141250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:19.510 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:19.506+0000 7f3b5259c640 1 -- 172.21.15.40:0/404852779 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b5415bf90 con 0x7f3b54141960 2023-12-17T11:48:19.510 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:19.506+0000 7f3b5259c640 1 -- 172.21.15.40:0/404852779 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2643242555 0 0) 0x7f3b4c001670 con 0x7f3b54141960 2023-12-17T11:48:19.510 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:19.506+0000 7f3b5259c640 1 -- 172.21.15.40:0/404852779 >> v1:172.21.15.40:6789/0 conn(0x7f3b54141960 legacy=0x7f3b540cce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:19.510 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:19.506+0000 7f3b5259c640 1 --2- 172.21.15.40:0/404852779 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3b400039c0 0x7f3b40003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:19.510 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:19.506+0000 7f3b5259c640 1 --2- 172.21.15.40:0/404852779 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f3b400047c0 0x7f3b40004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:19.510 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:19.506+0000 7f3b5259c640 1 --2- 172.21.15.40:0/404852779 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3b40005180 0x7f3b4000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:19.510 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:19.507+0000 7f3b5259c640 1 -- 172.21.15.40:0/404852779 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b5415bcb0 con 0x7f3b40005180 2023-12-17T11:48:19.510 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:19.507+0000 7f3b5259c640 1 -- 172.21.15.40:0/404852779 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b4000c080 con 0x7f3b400039c0 2023-12-17T11:48:19.510 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:19.507+0000 7f3b5259c640 1 -- 172.21.15.40:0/404852779 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b4000c240 con 0x7f3b400047c0 2023-12-17T11:48:19.511 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:19.507+0000 7f3b5359e640 1 --2- 172.21.15.40:0/404852779 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3b40005180 0x7f3b4000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:19.511 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:19.507+0000 7f3b52d9d640 1 --2- 172.21.15.40:0/404852779 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3b400039c0 0x7f3b40003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:19.511 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:19.507+0000 7f3b5359e640 1 -- 172.21.15.40:0/404852779 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f3b400047c0 msgr2=0x7f3b40004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:48:19.511 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:19.507+0000 7f3b4a59c640 1 --2- 172.21.15.40:0/404852779 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f3b400047c0 0x7f3b40004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:19.511 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:19.507+0000 7f3b5359e640 1 --2- 172.21.15.40:0/404852779 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f3b400047c0 0x7f3b40004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:19.511 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:19.507+0000 7f3b5359e640 1 -- 172.21.15.40:0/404852779 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3b400039c0 msgr2=0x7f3b40003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:48:19.511 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:19.507+0000 7f3b5359e640 1 --2- 172.21.15.40:0/404852779 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3b400039c0 0x7f3b40003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:19.511 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:19.507+0000 7f3b5359e640 1 -- 172.21.15.40:0/404852779 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b40003520 con 0x7f3b40005180 2023-12-17T11:48:19.511 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:19.507+0000 7f3b4a59c640 1 --2- 172.21.15.40:0/404852779 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f3b400047c0 0x7f3b40004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-17T11:48:19.511 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:19.507+0000 7f3b52d9d640 1 --2- 172.21.15.40:0/404852779 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3b400039c0 0x7f3b40003de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-17T11:48:19.512 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:19.508+0000 7f3b5359e640 1 -- 172.21.15.40:0/404852779 reap_dead start 2023-12-17T11:48:19.512 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:19.508+0000 7f3b5359e640 1 --2- 172.21.15.40:0/404852779 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3b40005180 0x7f3b4000b980 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f3b4c00c0e0 tx=0x7f3b400057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88ab07c5866ca752 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:48:19.512 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:19.509+0000 7f3b5259c640 1 -- 172.21.15.40:0/404852779 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b4c005ad0 con 0x7f3b40005180 2023-12-17T11:48:19.512 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:19.509+0000 7f3b5259c640 1 -- 172.21.15.40:0/404852779 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b4c005c70 con 0x7f3b40005180 2023-12-17T11:48:19.513 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:19.509+0000 7f3b5259c640 1 -- 172.21.15.40:0/404852779 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b4c02c810 con 0x7f3b40005180 2023-12-17T11:48:19.513 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:19.509+0000 7f3b5921e640 1 -- 172.21.15.40:0/404852779 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3b40005180 msgr2=0x7f3b4000b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:19.513 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:19.509+0000 7f3b5921e640 1 --2- 172.21.15.40:0/404852779 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3b40005180 0x7f3b4000b980 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f3b4c00c0e0 tx=0x7f3b400057f0 comp rx=0 tx=0).stop 2023-12-17T11:48:19.513 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:19.509+0000 7f3b5921e640 1 -- 172.21.15.40:0/404852779 shutdown_connections 2023-12-17T11:48:19.513 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:19.509+0000 7f3b5921e640 1 --2- 172.21.15.40:0/404852779 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3b40005180 0x7f3b4000b980 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:19.513 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:19.509+0000 7f3b5921e640 1 -- 172.21.15.40:0/404852779 >> 172.21.15.40:0/404852779 conn(0x7f3b540cb850 msgr2=0x7f3b540cbc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:48:19.513 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:19.510+0000 7f3b5921e640 1 -- 172.21.15.40:0/404852779 shutdown_connections 2023-12-17T11:48:19.513 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:19.510+0000 7f3b5921e640 1 -- 172.21.15.40:0/404852779 wait complete. 2023-12-17T11:48:19.514 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:19.511+0000 7f3b5921e640 1 Processor -- start 2023-12-17T11:48:19.514 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:19.512+0000 7f3b5921e640 1 -- start start 2023-12-17T11:48:19.515 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:19.512+0000 7f3b5921e640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3b40005180 0x7f3b540ad1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:19.515 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:19.512+0000 7f3b5921e640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3b54070290 0x7f3b5413c710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:19.515 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:19.513+0000 7f3b5921e640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f3b54071aa0 0x7f3b5413efe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:19.515 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:19.513+0000 7f3b5921e640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b54071610 con 0x7f3b40005180 2023-12-17T11:48:19.515 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:19.513+0000 7f3b5921e640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b5413cc50 con 0x7f3b54070290 2023-12-17T11:48:19.515 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:19.513+0000 7f3b5921e640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b54070a00 con 0x7f3b54071aa0 2023-12-17T11:48:19.515 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:19.513+0000 7f3b52d9d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3b40005180 0x7f3b540ad1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:19.516 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:19.513+0000 7f3b52d9d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3b40005180 0x7f3b540ad1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:50952/0 (socket says 172.21.15.40:50952) 2023-12-17T11:48:19.516 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:19.513+0000 7f3b52d9d640 1 -- 172.21.15.40:0/1588757734 learned_addr learned my addr 172.21.15.40:0/1588757734 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-17T11:48:19.516 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:19.513+0000 7f3b52d9d640 1 -- 172.21.15.40:0/1588757734 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f3b54071aa0 msgr2=0x7f3b5413efe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:19.516 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:19.513+0000 7f3b5359e640 1 --2- 172.21.15.40:0/1588757734 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f3b54071aa0 0x7f3b5413efe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:19.516 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:19.513+0000 7f3b52d9d640 1 --2- 172.21.15.40:0/1588757734 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f3b54071aa0 0x7f3b5413efe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:19.516 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:19.513+0000 7f3b52d9d640 1 -- 172.21.15.40:0/1588757734 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3b54070290 msgr2=0x7f3b5413c710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:19.516 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:19.513+0000 7f3b52d9d640 1 --2- 172.21.15.40:0/1588757734 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3b54070290 0x7f3b5413c710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:19.516 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:19.513+0000 7f3b52d9d640 1 -- 172.21.15.40:0/1588757734 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b540b3940 con 0x7f3b40005180 2023-12-17T11:48:19.517 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:19.514+0000 7f3b52d9d640 1 --2- 172.21.15.40:0/1588757734 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3b40005180 0x7f3b540ad1c0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f3b44007f20 tx=0x7f3b44010650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:48:19.517 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:19.514+0000 7f3b4bfff640 1 -- 172.21.15.40:0/1588757734 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b4400e050 con 0x7f3b40005180 2023-12-17T11:48:19.517 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:19.514+0000 7f3b4bfff640 1 -- 172.21.15.40:0/1588757734 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b4400f040 con 0x7f3b40005180 2023-12-17T11:48:19.517 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:19.514+0000 7f3b4bfff640 1 -- 172.21.15.40:0/1588757734 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b44003bb0 con 0x7f3b40005180 2023-12-17T11:48:19.517 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:19.514+0000 7f3b5921e640 1 -- 172.21.15.40:0/1588757734 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b54070ce0 con 0x7f3b40005180 2023-12-17T11:48:19.517 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:19.514+0000 7f3b5921e640 1 -- 172.21.15.40:0/1588757734 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b540712a0 con 0x7f3b40005180 2023-12-17T11:48:19.518 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:19.515+0000 7f3b5921e640 1 -- 172.21.15.40:0/1588757734 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b54067910 con 0x7f3b40005180 2023-12-17T11:48:19.518 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:19.516+0000 7f3b4bfff640 1 -- 172.21.15.40:0/1588757734 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f3b44004020 con 0x7f3b40005180 2023-12-17T11:48:19.519 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:19.517+0000 7f3b4bfff640 1 --2- 172.21.15.40:0/1588757734 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f3b3406ae70 0x7f3b3406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:19.519 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:19.517+0000 7f3b4bfff640 1 -- 172.21.15.40:0/1588757734 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5935+0+0 (secure 0 0 0) 0x7f3b4408a6e0 con 0x7f3b40005180 2023-12-17T11:48:19.520 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:19.518+0000 7f3b4a59c640 1 --2- 172.21.15.40:0/1588757734 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f3b3406ae70 0x7f3b3406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:19.521 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:19.519+0000 7f3b4a59c640 1 --2- 172.21.15.40:0/1588757734 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f3b3406ae70 0x7f3b3406d330 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f3b5406e360 tx=0x7f3b3c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:48:19.523 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:19.521+0000 7f3b4bfff640 1 -- 172.21.15.40:0/1588757734 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f3b44055610 con 0x7f3b40005180 2023-12-17T11:48:19.718 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:19.716+0000 7f3b5921e640 1 -- 172.21.15.40:0/1588757734 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f3b540745d0 con 0x7f3b40005180 2023-12-17T11:48:21.489 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:21.486+0000 7f3b4bfff640 1 -- 172.21.15.40:0/1588757734 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data_ec' created v23) v1 ==== 228+0+0 (secure 0 0 0) 0x7f3b44058c30 con 0x7f3b40005180 2023-12-17T11:48:21.489 INFO:teuthology.orchestra.run.smithi040.stderr:pool 'cephfs_data_ec' created 2023-12-17T11:48:21.494 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:21.491+0000 7f3b5921e640 1 -- 172.21.15.40:0/1588757734 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f3b3406ae70 msgr2=0x7f3b3406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:21.494 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:21.491+0000 7f3b5921e640 1 --2- 172.21.15.40:0/1588757734 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f3b3406ae70 0x7f3b3406d330 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f3b5406e360 tx=0x7f3b3c009040 comp rx=0 tx=0).stop 2023-12-17T11:48:21.494 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:21.491+0000 7f3b5921e640 1 -- 172.21.15.40:0/1588757734 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3b40005180 msgr2=0x7f3b540ad1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:21.494 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:21.491+0000 7f3b5921e640 1 --2- 172.21.15.40:0/1588757734 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3b40005180 0x7f3b540ad1c0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f3b44007f20 tx=0x7f3b44010650 comp rx=0 tx=0).stop 2023-12-17T11:48:21.494 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:21.492+0000 7f3b5921e640 1 -- 172.21.15.40:0/1588757734 shutdown_connections 2023-12-17T11:48:21.494 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:21.492+0000 7f3b5921e640 1 --2- 172.21.15.40:0/1588757734 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f3b3406ae70 0x7f3b3406d330 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:21.494 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:21.492+0000 7f3b5921e640 1 --2- 172.21.15.40:0/1588757734 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f3b54071aa0 0x7f3b5413efe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:21.494 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:21.492+0000 7f3b5921e640 1 --2- 172.21.15.40:0/1588757734 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3b54070290 0x7f3b5413c710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:21.494 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:21.492+0000 7f3b5921e640 1 --2- 172.21.15.40:0/1588757734 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3b40005180 0x7f3b540ad1c0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:21.494 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:21.492+0000 7f3b5921e640 1 -- 172.21.15.40:0/1588757734 >> 172.21.15.40:0/1588757734 conn(0x7f3b540cb850 msgr2=0x7f3b540cbc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:48:21.495 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:21.492+0000 7f3b5921e640 1 -- 172.21.15.40:0/1588757734 shutdown_connections 2023-12-17T11:48:21.495 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:21.492+0000 7f3b5921e640 1 -- 172.21.15.40:0/1588757734 wait complete. 2023-12-17T11:48:21.522 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set cephfs_data_ec allow_ec_overwrites true 2023-12-17T11:48:21.716 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:21.713+0000 7ff5417e2640 1 Processor -- start 2023-12-17T11:48:21.716 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:21.714+0000 7ff5417e2640 1 -- start start 2023-12-17T11:48:21.718 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:21.715+0000 7ff5417e2640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff53c0cf6c0 0x7ff53c0b1f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:21.718 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:21.715+0000 7ff5417e2640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff53c15c4b0 con 0x7ff53c0ce1b0 2023-12-17T11:48:21.718 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:21.715+0000 7ff5417e2640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff53c0b3b50 con 0x7ff53c0b3770 2023-12-17T11:48:21.718 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:21.715+0000 7ff5417e2640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff53c0cd750 con 0x7ff53c0cf6c0 2023-12-17T11:48:21.718 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:21.716+0000 7ff540fe1640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff53c0cf6c0 0x7ff53c0b1f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:21.719 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:21.716+0000 7ff540fe1640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff53c0cf6c0 0x7ff53c0b1f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:50958/0 (socket says 172.21.15.40:50958) 2023-12-17T11:48:21.719 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:21.716+0000 7ff540fe1640 1 -- 172.21.15.40:0/2930525295 learned_addr learned my addr 172.21.15.40:0/2930525295 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-17T11:48:21.719 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:21.716+0000 7ff533fff640 1 --1- 172.21.15.40:0/2930525295 >> v1:172.21.15.40:6789/0 conn(0x7ff53c0ce1b0 0x7ff53c0cefb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:49302/0 (socket says 172.21.15.40:49302) 2023-12-17T11:48:21.719 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:21.716+0000 7ff540fe1640 1 -- 172.21.15.40:0/2930525295 >> v1:172.21.15.159:6789/0 conn(0x7ff53c0b3770 legacy=0x7ff53c0cb1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:48:21.719 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:21.716+0000 7ff540fe1640 1 -- 172.21.15.40:0/2930525295 >> v1:172.21.15.40:6789/0 conn(0x7ff53c0ce1b0 legacy=0x7ff53c0cefb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:21.719 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:21.716+0000 7ff540fe1640 1 -- 172.21.15.40:0/2930525295 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff53c15b930 con 0x7ff53c0cf6c0 2023-12-17T11:48:21.719 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:21.716+0000 7ff53b7fe640 1 -- 172.21.15.40:0/2930525295 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 907630137 0 0) 0x7ff524001110 con 0x7ff53c0ce1b0 2023-12-17T11:48:21.719 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:21.718+0000 7ff540fe1640 1 --2- 172.21.15.40:0/2930525295 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff53c0cf6c0 0x7ff53c0b1f00 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7ff53c0cd890 tx=0x7ff53402bf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2d497353ad77eb7 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:48:21.720 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:21.718+0000 7ff53b7fe640 1 -- 172.21.15.40:0/2930525295 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff53402caf0 con 0x7ff53c0cf6c0 2023-12-17T11:48:21.720 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:21.718+0000 7ff53b7fe640 1 -- 172.21.15.40:0/2930525295 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff53402cc50 con 0x7ff53c0cf6c0 2023-12-17T11:48:21.720 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:21.718+0000 7ff53b7fe640 1 -- 172.21.15.40:0/2930525295 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5340343f0 con 0x7ff53c0cf6c0 2023-12-17T11:48:21.721 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:21.718+0000 7ff5417e2640 1 -- 172.21.15.40:0/2930525295 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff53c0cf6c0 msgr2=0x7ff53c0b1f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:21.721 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:21.718+0000 7ff5417e2640 1 --2- 172.21.15.40:0/2930525295 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff53c0cf6c0 0x7ff53c0b1f00 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7ff53c0cd890 tx=0x7ff53402bf50 comp rx=0 tx=0).stop 2023-12-17T11:48:21.721 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:21.719+0000 7ff5417e2640 1 -- 172.21.15.40:0/2930525295 shutdown_connections 2023-12-17T11:48:21.721 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:21.719+0000 7ff5417e2640 1 --2- 172.21.15.40:0/2930525295 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff53c0cf6c0 0x7ff53c0b1f00 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:21.721 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:21.719+0000 7ff5417e2640 1 -- 172.21.15.40:0/2930525295 >> 172.21.15.40:0/2930525295 conn(0x7ff53c06a880 msgr2=0x7ff53c06ac90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:48:21.721 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:21.719+0000 7ff5417e2640 1 -- 172.21.15.40:0/2930525295 shutdown_connections 2023-12-17T11:48:21.721 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:21.719+0000 7ff5417e2640 1 -- 172.21.15.40:0/2930525295 wait complete. 2023-12-17T11:48:21.722 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:21.721+0000 7ff5417e2640 1 Processor -- start 2023-12-17T11:48:21.723 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:21.721+0000 7ff5417e2640 1 -- start start 2023-12-17T11:48:21.724 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:21.722+0000 7ff5417e2640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff53c0b3770 0x7ff53c0999f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:21.725 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:21.722+0000 7ff5417e2640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff53c0ce1b0 0x7ff53c14eac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:21.725 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:21.722+0000 7ff5417e2640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff53c0cf6c0 0x7ff53c1f6500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:21.725 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:21.722+0000 7ff5417e2640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff53c14f000 con 0x7ff53c0cf6c0 2023-12-17T11:48:21.725 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:21.722+0000 7ff5417e2640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff53c099fd0 con 0x7ff53c0ce1b0 2023-12-17T11:48:21.725 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:21.722+0000 7ff5417e2640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff53c09a2b0 con 0x7ff53c0b3770 2023-12-17T11:48:21.725 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:21.722+0000 7ff540fe1640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff53c0cf6c0 0x7ff53c1f6500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:21.725 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:21.722+0000 7ff540fe1640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff53c0cf6c0 0x7ff53c1f6500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:50966/0 (socket says 172.21.15.40:50966) 2023-12-17T11:48:21.725 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:21.722+0000 7ff540fe1640 1 -- 172.21.15.40:0/323615662 learned_addr learned my addr 172.21.15.40:0/323615662 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-17T11:48:21.725 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:21.722+0000 7ff53bfff640 1 --2- 172.21.15.40:0/323615662 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff53c0b3770 0x7ff53c0999f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:21.725 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:21.723+0000 7ff533fff640 1 --2- 172.21.15.40:0/323615662 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff53c0ce1b0 0x7ff53c14eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:21.725 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:21.723+0000 7ff540fe1640 1 -- 172.21.15.40:0/323615662 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff53c0b3770 msgr2=0x7ff53c0999f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:21.725 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:21.723+0000 7ff540fe1640 1 --2- 172.21.15.40:0/323615662 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff53c0b3770 0x7ff53c0999f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:21.725 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:21.723+0000 7ff540fe1640 1 -- 172.21.15.40:0/323615662 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff53c0ce1b0 msgr2=0x7ff53c14eac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:21.726 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:21.723+0000 7ff540fe1640 1 --2- 172.21.15.40:0/323615662 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff53c0ce1b0 0x7ff53c14eac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:21.726 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:21.723+0000 7ff540fe1640 1 -- 172.21.15.40:0/323615662 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff534009b30 con 0x7ff53c0cf6c0 2023-12-17T11:48:21.726 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:21.723+0000 7ff540fe1640 1 --2- 172.21.15.40:0/323615662 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff53c0cf6c0 0x7ff53c1f6500 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7ff534036040 tx=0x7ff534004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:48:21.726 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:21.723+0000 7ff5397fa640 1 -- 172.21.15.40:0/323615662 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff53403e450 con 0x7ff53c0cf6c0 2023-12-17T11:48:21.726 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:21.723+0000 7ff5397fa640 1 -- 172.21.15.40:0/323615662 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff53403e5d0 con 0x7ff53c0cf6c0 2023-12-17T11:48:21.726 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:21.723+0000 7ff5397fa640 1 -- 172.21.15.40:0/323615662 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff53403e980 con 0x7ff53c0cf6c0 2023-12-17T11:48:21.727 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:21.723+0000 7ff5417e2640 1 -- 172.21.15.40:0/323615662 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff53c09a590 con 0x7ff53c0cf6c0 2023-12-17T11:48:21.727 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:21.724+0000 7ff5417e2640 1 -- 172.21.15.40:0/323615662 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff53c1f5fe0 con 0x7ff53c0cf6c0 2023-12-17T11:48:21.727 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:21.725+0000 7ff5417e2640 1 -- 172.21.15.40:0/323615662 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff53c074450 con 0x7ff53c0cf6c0 2023-12-17T11:48:21.727 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:21.726+0000 7ff5397fa640 1 -- 172.21.15.40:0/323615662 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ff53403eae0 con 0x7ff53c0cf6c0 2023-12-17T11:48:21.729 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:21.727+0000 7ff5397fa640 1 --2- 172.21.15.40:0/323615662 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7ff51c06ae40 0x7ff51c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:21.729 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:21.727+0000 7ff5397fa640 1 -- 172.21.15.40:0/323615662 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6428+0+0 (secure 0 0 0) 0x7ff5340ac8b0 con 0x7ff53c0cf6c0 2023-12-17T11:48:21.729 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:21.727+0000 7ff53bfff640 1 --2- 172.21.15.40:0/323615662 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7ff51c06ae40 0x7ff51c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:21.730 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:21.728+0000 7ff53bfff640 1 --2- 172.21.15.40:0/323615662 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7ff51c06ae40 0x7ff51c06d300 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7ff52c006fd0 tx=0x7ff52c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:48:21.734 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:21.732+0000 7ff5397fa640 1 -- 172.21.15.40:0/323615662 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7ff534077710 con 0x7ff53c0cf6c0 2023-12-17T11:48:21.931 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:21.929+0000 7ff5417e2640 1 -- 172.21.15.40:0/323615662 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} v 0) v1 -- 0x7ff53c1f6170 con 0x7ff53c0cf6c0 2023-12-17T11:48:22.493 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:22.491+0000 7ff5397fa640 1 -- 172.21.15.40:0/323615662 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]=0 set pool 4 allow_ec_overwrites to true v24) v1 ==== 169+0+0 (secure 0 0 0) 0x7ff53407ad30 con 0x7ff53c0cf6c0 2023-12-17T11:48:22.493 INFO:teuthology.orchestra.run.smithi040.stderr:set pool 4 allow_ec_overwrites to true 2023-12-17T11:48:22.497 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:22.495+0000 7ff5417e2640 1 -- 172.21.15.40:0/323615662 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7ff51c06ae40 msgr2=0x7ff51c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:22.497 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:22.495+0000 7ff5417e2640 1 --2- 172.21.15.40:0/323615662 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7ff51c06ae40 0x7ff51c06d300 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7ff52c006fd0 tx=0x7ff52c008040 comp rx=0 tx=0).stop 2023-12-17T11:48:22.497 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:22.495+0000 7ff5417e2640 1 -- 172.21.15.40:0/323615662 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff53c0cf6c0 msgr2=0x7ff53c1f6500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:22.497 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:22.495+0000 7ff5417e2640 1 --2- 172.21.15.40:0/323615662 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff53c0cf6c0 0x7ff53c1f6500 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7ff534036040 tx=0x7ff534004a40 comp rx=0 tx=0).stop 2023-12-17T11:48:22.497 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:22.495+0000 7ff5417e2640 1 -- 172.21.15.40:0/323615662 shutdown_connections 2023-12-17T11:48:22.497 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:22.495+0000 7ff5417e2640 1 --2- 172.21.15.40:0/323615662 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7ff51c06ae40 0x7ff51c06d300 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:22.497 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:22.495+0000 7ff5417e2640 1 --2- 172.21.15.40:0/323615662 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff53c0cf6c0 0x7ff53c1f6500 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:22.497 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:22.495+0000 7ff5417e2640 1 --2- 172.21.15.40:0/323615662 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff53c0ce1b0 0x7ff53c14eac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:22.498 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:22.495+0000 7ff5417e2640 1 --2- 172.21.15.40:0/323615662 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff53c0b3770 0x7ff53c0999f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:22.498 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:22.495+0000 7ff5417e2640 1 -- 172.21.15.40:0/323615662 >> 172.21.15.40:0/323615662 conn(0x7ff53c06a880 msgr2=0x7ff53c06cb30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:48:22.498 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:22.495+0000 7ff5417e2640 1 -- 172.21.15.40:0/323615662 shutdown_connections 2023-12-17T11:48:22.498 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:22.495+0000 7ff5417e2640 1 -- 172.21.15.40:0/323615662 wait complete. 2023-12-17T11:48:22.533 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs add_data_pool cephfs cephfs_data_ec 2023-12-17T11:48:22.726 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:22.724+0000 7f15d5eda640 1 Processor -- start 2023-12-17T11:48:22.727 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:22.724+0000 7f15d5eda640 1 -- start start 2023-12-17T11:48:22.728 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:22.726+0000 7f15d5eda640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f15d015d5f0 0x7f15d00d1d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:22.728 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:22.726+0000 7f15d5eda640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15d00d3ee0 con 0x7f15d00d3a50 2023-12-17T11:48:22.728 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:22.726+0000 7f15d5eda640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15d00b2300 con 0x7f15d00d0200 2023-12-17T11:48:22.728 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:22.726+0000 7f15d5eda640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15d015e620 con 0x7f15d015d5f0 2023-12-17T11:48:22.728 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:22.726+0000 7f15ceffd640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f15d00d3a50 0x7f15d00cfaf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:49306/0 (socket says 172.21.15.40:49306) 2023-12-17T11:48:22.728 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:22.726+0000 7f15ceffd640 1 -- 172.21.15.40:0/553079026 learned_addr learned my addr 172.21.15.40:0/553079026 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-12-17T11:48:22.731 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:22.727+0000 7f15cf7fe640 1 --2- 172.21.15.40:0/553079026 >> v2:172.21.15.159:3300/0 conn(0x7f15d015d5f0 0x7f15d00d1d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:22.731 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:22.727+0000 7f15ce7fc640 1 -- 172.21.15.40:0/553079026 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4192424701 0 0) 0x7f15d00d3ee0 con 0x7f15d00d3a50 2023-12-17T11:48:22.731 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:22.727+0000 7f15ce7fc640 1 -- 172.21.15.40:0/553079026 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f15bc003520 con 0x7f15d00d3a50 2023-12-17T11:48:22.731 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:22.727+0000 7f15ce7fc640 1 -- 172.21.15.40:0/553079026 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 767114234 0 0) 0x7f15bc003520 con 0x7f15d00d3a50 2023-12-17T11:48:22.731 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:22.727+0000 7f15ce7fc640 1 -- 172.21.15.40:0/553079026 >> v2:172.21.15.159:3300/0 conn(0x7f15d015d5f0 msgr2=0x7f15d00d1d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:48:22.731 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:22.727+0000 7f15ce7fc640 1 --2- 172.21.15.40:0/553079026 >> v2:172.21.15.159:3300/0 conn(0x7f15d015d5f0 0x7f15d00d1d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:22.731 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:22.727+0000 7f15ce7fc640 1 -- 172.21.15.40:0/553079026 >> v1:172.21.15.159:6789/0 conn(0x7f15d00d0200 legacy=0x7f15d00cdca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:22.731 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:22.727+0000 7f15ce7fc640 1 -- 172.21.15.40:0/553079026 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15d015d9d0 con 0x7f15d00d3a50 2023-12-17T11:48:22.731 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:22.727+0000 7f15ce7fc640 1 -- 172.21.15.40:0/553079026 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2643242555 0 0) 0x7f15b8001670 con 0x7f15d00d3a50 2023-12-17T11:48:22.731 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:22.727+0000 7f15ce7fc640 1 -- 172.21.15.40:0/553079026 >> v1:172.21.15.40:6789/0 conn(0x7f15d00d3a50 legacy=0x7f15d00cfaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:22.731 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:22.727+0000 7f15ce7fc640 1 --2- 172.21.15.40:0/553079026 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f15bc003970 0x7f15bc003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:22.731 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:22.728+0000 7f15ce7fc640 1 --2- 172.21.15.40:0/553079026 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f15bc0047c0 0x7f15bc004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:22.732 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:22.728+0000 7f15ce7fc640 1 --2- 172.21.15.40:0/553079026 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f15bc005180 0x7f15bc00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:22.732 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:22.728+0000 7f15ce7fc640 1 -- 172.21.15.40:0/553079026 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15d015e620 con 0x7f15bc005180 2023-12-17T11:48:22.732 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:22.728+0000 7f15ce7fc640 1 -- 172.21.15.40:0/553079026 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15bc00c120 con 0x7f15bc0047c0 2023-12-17T11:48:22.732 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:22.728+0000 7f15ce7fc640 1 -- 172.21.15.40:0/553079026 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15bc00c2e0 con 0x7f15bc003970 2023-12-17T11:48:22.732 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:22.728+0000 7f15cffff640 1 --2- 172.21.15.40:0/553079026 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f15bc005180 0x7f15bc00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:22.732 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:22.728+0000 7f15cf7fe640 1 --2- 172.21.15.40:0/553079026 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f15bc003970 0x7f15bc003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:22.732 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:22.728+0000 7f15ceffd640 1 --2- 172.21.15.40:0/553079026 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f15bc0047c0 0x7f15bc004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:22.732 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:22.728+0000 7f15cffff640 1 -- 172.21.15.40:0/553079026 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f15bc003970 msgr2=0x7f15bc003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:48:22.732 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:22.728+0000 7f15cffff640 1 --2- 172.21.15.40:0/553079026 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f15bc003970 0x7f15bc003d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:22.732 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:22.728+0000 7f15cffff640 1 -- 172.21.15.40:0/553079026 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f15bc0047c0 msgr2=0x7f15bc004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:48:22.732 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:22.728+0000 7f15cffff640 1 --2- 172.21.15.40:0/553079026 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f15bc0047c0 0x7f15bc004c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:22.732 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:22.728+0000 7f15cffff640 1 -- 172.21.15.40:0/553079026 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15bc003520 con 0x7f15bc005180 2023-12-17T11:48:22.732 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:22.729+0000 7f15cffff640 1 -- 172.21.15.40:0/553079026 reap_dead start 2023-12-17T11:48:22.734 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:22.729+0000 7f15cffff640 1 --2- 172.21.15.40:0/553079026 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f15bc005180 0x7f15bc00b980 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f15c8001750 tx=0x7f15bc0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c63445b70acc27b2 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:48:22.734 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:22.729+0000 7f15ce7fc640 1 -- 172.21.15.40:0/553079026 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15c80052d0 con 0x7f15bc005180 2023-12-17T11:48:22.734 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:22.730+0000 7f15ce7fc640 1 -- 172.21.15.40:0/553079026 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15c802e050 con 0x7f15bc005180 2023-12-17T11:48:22.734 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:22.730+0000 7f15ce7fc640 1 -- 172.21.15.40:0/553079026 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15c8003830 con 0x7f15bc005180 2023-12-17T11:48:22.734 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:22.730+0000 7f15d5eda640 1 -- 172.21.15.40:0/553079026 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f15bc005180 msgr2=0x7f15bc00b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:22.734 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:22.730+0000 7f15d5eda640 1 --2- 172.21.15.40:0/553079026 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f15bc005180 0x7f15bc00b980 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f15c8001750 tx=0x7f15bc0057f0 comp rx=0 tx=0).stop 2023-12-17T11:48:22.734 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:22.730+0000 7f15d5eda640 1 -- 172.21.15.40:0/553079026 shutdown_connections 2023-12-17T11:48:22.734 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:22.730+0000 7f15d5eda640 1 --2- 172.21.15.40:0/553079026 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f15bc005180 0x7f15bc00b980 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:22.734 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:22.730+0000 7f15d5eda640 1 -- 172.21.15.40:0/553079026 >> 172.21.15.40:0/553079026 conn(0x7f15d009c450 msgr2=0x7f15d00d3120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:48:22.735 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:22.730+0000 7f15d5eda640 1 -- 172.21.15.40:0/553079026 shutdown_connections 2023-12-17T11:48:22.735 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:22.730+0000 7f15d5eda640 1 -- 172.21.15.40:0/553079026 wait complete. 2023-12-17T11:48:22.735 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:22.732+0000 7f15d5eda640 1 Processor -- start 2023-12-17T11:48:22.735 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:22.732+0000 7f15d5eda640 1 -- start start 2023-12-17T11:48:22.736 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:22.733+0000 7f15d5eda640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f15bc005180 0x7f15d00a0020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:22.737 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:22.733+0000 7f15d5eda640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f15d00b4eb0 0x7f15d015b5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:22.737 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:22.733+0000 7f15d5eda640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f15d009d620 0x7f15d009daa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:22.737 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:22.733+0000 7f15d5eda640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15d009dfe0 con 0x7f15bc005180 2023-12-17T11:48:22.737 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:22.733+0000 7f15d5eda640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15d00b92c0 con 0x7f15d009d620 2023-12-17T11:48:22.737 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:22.733+0000 7f15d5eda640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15d00cbb30 con 0x7f15d00b4eb0 2023-12-17T11:48:22.737 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:22.733+0000 7f15cf7fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f15bc005180 0x7f15d00a0020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:22.737 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:22.733+0000 7f15cf7fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f15bc005180 0x7f15d00a0020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:50986/0 (socket says 172.21.15.40:50986) 2023-12-17T11:48:22.737 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:22.733+0000 7f15cf7fe640 1 -- 172.21.15.40:0/705204900 learned_addr learned my addr 172.21.15.40:0/705204900 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-17T11:48:22.737 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:22.734+0000 7f15cffff640 1 --2- 172.21.15.40:0/705204900 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f15d009d620 0x7f15d009daa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:22.737 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:22.734+0000 7f15ceffd640 1 --2- 172.21.15.40:0/705204900 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f15d00b4eb0 0x7f15d015b5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:22.737 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:22.734+0000 7f15cf7fe640 1 -- 172.21.15.40:0/705204900 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f15d00b4eb0 msgr2=0x7f15d015b5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:22.737 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:22.734+0000 7f15cf7fe640 1 --2- 172.21.15.40:0/705204900 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f15d00b4eb0 0x7f15d015b5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:22.738 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:22.734+0000 7f15cf7fe640 1 -- 172.21.15.40:0/705204900 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f15d009d620 msgr2=0x7f15d009daa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:22.738 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:22.734+0000 7f15cf7fe640 1 --2- 172.21.15.40:0/705204900 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f15d009d620 0x7f15d009daa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:22.738 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:22.734+0000 7f15cf7fe640 1 -- 172.21.15.40:0/705204900 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15d015baf0 con 0x7f15bc005180 2023-12-17T11:48:22.738 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:22.734+0000 7f15cffff640 1 --2- 172.21.15.40:0/705204900 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f15d009d620 0x7f15d009daa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-17T11:48:22.738 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:22.734+0000 7f15cf7fe640 1 --2- 172.21.15.40:0/705204900 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f15bc005180 0x7f15d00a0020 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f15c000f380 tx=0x7f15c000f840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:48:22.738 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:22.734+0000 7f15c7fff640 1 -- 172.21.15.40:0/705204900 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15c0017600 con 0x7f15bc005180 2023-12-17T11:48:22.738 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:22.735+0000 7f15c7fff640 1 -- 172.21.15.40:0/705204900 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15c0011040 con 0x7f15bc005180 2023-12-17T11:48:22.738 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:22.735+0000 7f15c7fff640 1 -- 172.21.15.40:0/705204900 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15c00179c0 con 0x7f15bc005180 2023-12-17T11:48:22.738 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:22.735+0000 7f15d5eda640 1 -- 172.21.15.40:0/705204900 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15d00cb7e0 con 0x7f15bc005180 2023-12-17T11:48:22.738 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:22.735+0000 7f15d5eda640 1 -- 172.21.15.40:0/705204900 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15d00a0a10 con 0x7f15bc005180 2023-12-17T11:48:22.739 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:22.736+0000 7f15d5eda640 1 -- 172.21.15.40:0/705204900 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15d00745d0 con 0x7f15bc005180 2023-12-17T11:48:22.739 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:22.737+0000 7f15c7fff640 1 -- 172.21.15.40:0/705204900 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f15c0017b20 con 0x7f15bc005180 2023-12-17T11:48:22.740 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:22.738+0000 7f15c7fff640 1 --2- 172.21.15.40:0/705204900 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f15b006ae70 0x7f15b006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:22.740 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:22.738+0000 7f15c7fff640 1 -- 172.21.15.40:0/705204900 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6428+0+0 (secure 0 0 0) 0x7f15c0089fe0 con 0x7f15bc005180 2023-12-17T11:48:22.740 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:22.738+0000 7f15ceffd640 1 --2- 172.21.15.40:0/705204900 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f15b006ae70 0x7f15b006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:22.741 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:22.739+0000 7f15ceffd640 1 --2- 172.21.15.40:0/705204900 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f15b006ae70 0x7f15b006d330 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f15d009d2a0 tx=0x7f15b8009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:48:22.744 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:22.742+0000 7f15c7fff640 1 -- 172.21.15.40:0/705204900 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f15c0054eb0 con 0x7f15bc005180 2023-12-17T11:48:22.971 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:22.969+0000 7f15d5eda640 1 -- 172.21.15.40:0/705204900 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} v 0) v1 -- 0x7f15d00cb970 con 0x7f15bc005180 2023-12-17T11:48:23.522 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:23.519+0000 7f15c7fff640 1 -- 172.21.15.40:0/705204900 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]=0 added data pool 4 to fsmap v6) v1 ==== 137+0+0 (secure 0 0 0) 0x7f15d00cb970 con 0x7f15bc005180 2023-12-17T11:48:23.522 INFO:teuthology.orchestra.run.smithi040.stderr:added data pool 4 to fsmap 2023-12-17T11:48:23.525 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:23.523+0000 7f15d5eda640 1 -- 172.21.15.40:0/705204900 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f15b006ae70 msgr2=0x7f15b006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:23.525 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:23.523+0000 7f15d5eda640 1 --2- 172.21.15.40:0/705204900 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f15b006ae70 0x7f15b006d330 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f15d009d2a0 tx=0x7f15b8009040 comp rx=0 tx=0).stop 2023-12-17T11:48:23.526 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:23.523+0000 7f15d5eda640 1 -- 172.21.15.40:0/705204900 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f15bc005180 msgr2=0x7f15d00a0020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:23.526 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:23.523+0000 7f15d5eda640 1 --2- 172.21.15.40:0/705204900 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f15bc005180 0x7f15d00a0020 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f15c000f380 tx=0x7f15c000f840 comp rx=0 tx=0).stop 2023-12-17T11:48:23.526 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:23.523+0000 7f15d5eda640 1 -- 172.21.15.40:0/705204900 shutdown_connections 2023-12-17T11:48:23.526 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:23.523+0000 7f15d5eda640 1 --2- 172.21.15.40:0/705204900 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f15b006ae70 0x7f15b006d330 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:23.526 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:23.523+0000 7f15d5eda640 1 --2- 172.21.15.40:0/705204900 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f15d009d620 0x7f15d009daa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:23.526 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:23.523+0000 7f15d5eda640 1 --2- 172.21.15.40:0/705204900 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f15d00b4eb0 0x7f15d015b5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:23.526 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:23.523+0000 7f15d5eda640 1 --2- 172.21.15.40:0/705204900 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f15bc005180 0x7f15d00a0020 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:23.526 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:23.523+0000 7f15d5eda640 1 -- 172.21.15.40:0/705204900 >> 172.21.15.40:0/705204900 conn(0x7f15d009c450 msgr2=0x7f15d00b8450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:48:23.526 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:23.523+0000 7f15d5eda640 1 -- 172.21.15.40:0/705204900 shutdown_connections 2023-12-17T11:48:23.526 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:23.523+0000 7f15d5eda640 1 -- 172.21.15.40:0/705204900 wait complete. 2023-12-17T11:48:23.544 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-17T11:48:23.767 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:23.764+0000 7fb186c72640 1 Processor -- start 2023-12-17T11:48:23.767 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:23.765+0000 7fb186c72640 1 -- start start 2023-12-17T11:48:23.769 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:23.766+0000 7fb186c72640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7fb18006a460 0x7fb18006a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:23.769 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:23.767+0000 7fb186c72640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb18006ae00 con 0x7fb1800cf780 2023-12-17T11:48:23.769 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:23.767+0000 7fb186c72640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1800cf2f0 con 0x7fb1801448f0 2023-12-17T11:48:23.769 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:23.767+0000 7fb186c72640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb18006ec00 con 0x7fb18006a460 2023-12-17T11:48:23.769 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:23.767+0000 7fb186471640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fb1800cf780 0x7fb1800cfbd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:49316/0 (socket says 172.21.15.40:49316) 2023-12-17T11:48:23.769 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:23.767+0000 7fb186471640 1 -- 172.21.15.40:0/4022969543 learned_addr learned my addr 172.21.15.40:0/4022969543 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-12-17T11:48:23.771 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:23.767+0000 7fb18546f640 1 --2- 172.21.15.40:0/4022969543 >> v2:172.21.15.159:3300/0 conn(0x7fb18006a460 0x7fb18006a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:23.771 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:23.768+0000 7fb184c6e640 1 -- 172.21.15.40:0/4022969543 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 783725712 0 0) 0x7fb18006ae00 con 0x7fb1800cf780 2023-12-17T11:48:23.771 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:23.768+0000 7fb184c6e640 1 -- 172.21.15.40:0/4022969543 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb16c003520 con 0x7fb1800cf780 2023-12-17T11:48:23.771 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:23.768+0000 7fb184c6e640 1 -- 172.21.15.40:0/4022969543 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 89791464 0 0) 0x7fb16c003520 con 0x7fb1800cf780 2023-12-17T11:48:23.771 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:23.768+0000 7fb184c6e640 1 -- 172.21.15.40:0/4022969543 >> v2:172.21.15.159:3300/0 conn(0x7fb18006a460 msgr2=0x7fb18006a8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:48:23.771 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:23.768+0000 7fb184c6e640 1 --2- 172.21.15.40:0/4022969543 >> v2:172.21.15.159:3300/0 conn(0x7fb18006a460 0x7fb18006a8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:23.771 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:23.768+0000 7fb184c6e640 1 -- 172.21.15.40:0/4022969543 >> v1:172.21.15.159:6789/0 conn(0x7fb1801448f0 legacy=0x7fb18006db60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:23.772 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:23.768+0000 7fb184c6e640 1 -- 172.21.15.40:0/4022969543 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1800ce6e0 con 0x7fb1800cf780 2023-12-17T11:48:23.772 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:23.768+0000 7fb184c6e640 1 -- 172.21.15.40:0/4022969543 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2643242555 0 0) 0x7fb1780019f0 con 0x7fb1800cf780 2023-12-17T11:48:23.772 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:23.768+0000 7fb184c6e640 1 -- 172.21.15.40:0/4022969543 >> v1:172.21.15.40:6789/0 conn(0x7fb1800cf780 legacy=0x7fb1800cfbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:23.772 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:23.768+0000 7fb184c6e640 1 --2- 172.21.15.40:0/4022969543 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb16c0039c0 0x7fb16c003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:23.772 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:23.768+0000 7fb184c6e640 1 --2- 172.21.15.40:0/4022969543 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb16c0047c0 0x7fb16c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:23.772 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:23.768+0000 7fb184c6e640 1 --2- 172.21.15.40:0/4022969543 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb16c005180 0x7fb16c00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:23.772 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:23.768+0000 7fb184c6e640 1 -- 172.21.15.40:0/4022969543 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb18006ec00 con 0x7fb16c005180 2023-12-17T11:48:23.772 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:23.768+0000 7fb184c6e640 1 -- 172.21.15.40:0/4022969543 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb16c00c080 con 0x7fb16c0039c0 2023-12-17T11:48:23.772 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:23.768+0000 7fb184c6e640 1 -- 172.21.15.40:0/4022969543 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb16c00c240 con 0x7fb16c0047c0 2023-12-17T11:48:23.772 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:23.768+0000 7fb186471640 1 --2- 172.21.15.40:0/4022969543 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb16c005180 0x7fb16c00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:23.772 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:23.769+0000 7fb185c70640 1 --2- 172.21.15.40:0/4022969543 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb16c0039c0 0x7fb16c003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:23.772 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:23.769+0000 7fb18546f640 1 --2- 172.21.15.40:0/4022969543 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb16c0047c0 0x7fb16c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:23.772 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:23.769+0000 7fb186471640 1 -- 172.21.15.40:0/4022969543 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb16c0047c0 msgr2=0x7fb16c004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:48:23.772 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:23.769+0000 7fb186471640 1 --2- 172.21.15.40:0/4022969543 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb16c0047c0 0x7fb16c004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:23.773 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:23.769+0000 7fb186471640 1 -- 172.21.15.40:0/4022969543 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb16c0039c0 msgr2=0x7fb16c003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:48:23.773 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:23.769+0000 7fb186471640 1 --2- 172.21.15.40:0/4022969543 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb16c0039c0 0x7fb16c003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:23.773 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:23.769+0000 7fb186471640 1 -- 172.21.15.40:0/4022969543 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb16c003520 con 0x7fb16c005180 2023-12-17T11:48:23.774 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:23.770+0000 7fb186471640 1 -- 172.21.15.40:0/4022969543 reap_dead start 2023-12-17T11:48:23.774 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:23.770+0000 7fb186471640 1 --2- 172.21.15.40:0/4022969543 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb16c005180 0x7fb16c00b980 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fb17800a760 tx=0x7fb16c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dec841f0dfa4d7ac server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:48:23.774 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:23.770+0000 7fb184c6e640 1 -- 172.21.15.40:0/4022969543 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb178034630 con 0x7fb16c005180 2023-12-17T11:48:23.774 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:23.770+0000 7fb184c6e640 1 -- 172.21.15.40:0/4022969543 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb17802f070 con 0x7fb16c005180 2023-12-17T11:48:23.774 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:23.770+0000 7fb184c6e640 1 -- 172.21.15.40:0/4022969543 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb178034a10 con 0x7fb16c005180 2023-12-17T11:48:23.774 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:23.771+0000 7fb186c72640 1 -- 172.21.15.40:0/4022969543 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb16c005180 msgr2=0x7fb16c00b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:23.774 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:23.771+0000 7fb186c72640 1 --2- 172.21.15.40:0/4022969543 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb16c005180 0x7fb16c00b980 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fb17800a760 tx=0x7fb16c0057f0 comp rx=0 tx=0).stop 2023-12-17T11:48:23.774 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:23.771+0000 7fb186c72640 1 -- 172.21.15.40:0/4022969543 shutdown_connections 2023-12-17T11:48:23.774 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:23.771+0000 7fb186c72640 1 --2- 172.21.15.40:0/4022969543 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb16c005180 0x7fb16c00b980 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:23.774 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:23.771+0000 7fb186c72640 1 -- 172.21.15.40:0/4022969543 >> 172.21.15.40:0/4022969543 conn(0x7fb1800b1840 msgr2=0x7fb1800b1c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:48:23.775 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:23.771+0000 7fb186c72640 1 -- 172.21.15.40:0/4022969543 shutdown_connections 2023-12-17T11:48:23.775 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:23.771+0000 7fb186c72640 1 -- 172.21.15.40:0/4022969543 wait complete. 2023-12-17T11:48:23.775 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:23.773+0000 7fb186c72640 1 Processor -- start 2023-12-17T11:48:23.775 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:23.773+0000 7fb186c72640 1 -- start start 2023-12-17T11:48:23.777 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:23.774+0000 7fb186c72640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb16c005180 0x7fb18015c210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:23.777 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:23.774+0000 7fb186c72640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb18015a2c0 0x7fb180140e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:23.777 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:23.774+0000 7fb186c72640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb1801eed20 0x7fb180142b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:23.777 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:23.774+0000 7fb186c72640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb18013ef10 con 0x7fb18015a2c0 2023-12-17T11:48:23.777 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:23.774+0000 7fb186c72640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1801416c0 con 0x7fb16c005180 2023-12-17T11:48:23.777 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:23.774+0000 7fb186c72640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb18013e570 con 0x7fb1801eed20 2023-12-17T11:48:23.777 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:23.774+0000 7fb18546f640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb18015a2c0 0x7fb180140e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:23.777 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:23.774+0000 7fb18546f640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb18015a2c0 0x7fb180140e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:51006/0 (socket says 172.21.15.40:51006) 2023-12-17T11:48:23.777 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:23.774+0000 7fb18546f640 1 -- 172.21.15.40:0/2347481201 learned_addr learned my addr 172.21.15.40:0/2347481201 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-17T11:48:23.777 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:23.774+0000 7fb185c70640 1 --2- 172.21.15.40:0/2347481201 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb16c005180 0x7fb18015c210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:23.777 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:23.775+0000 7fb186471640 1 --2- 172.21.15.40:0/2347481201 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb1801eed20 0x7fb180142b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:23.777 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:23.775+0000 7fb18546f640 1 -- 172.21.15.40:0/2347481201 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb1801eed20 msgr2=0x7fb180142b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:23.778 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:23.775+0000 7fb18546f640 1 --2- 172.21.15.40:0/2347481201 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb1801eed20 0x7fb180142b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:23.778 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:23.775+0000 7fb18546f640 1 -- 172.21.15.40:0/2347481201 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb16c005180 msgr2=0x7fb18015c210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:23.778 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:23.775+0000 7fb18546f640 1 --2- 172.21.15.40:0/2347481201 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb16c005180 0x7fb18015c210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:23.778 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:23.775+0000 7fb18546f640 1 -- 172.21.15.40:0/2347481201 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb18013e850 con 0x7fb18015a2c0 2023-12-17T11:48:23.779 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:23.775+0000 7fb18546f640 1 --2- 172.21.15.40:0/2347481201 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb18015a2c0 0x7fb180140e70 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fb17c011540 tx=0x7fb17c011a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:48:23.779 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:23.775+0000 7fb1727fc640 1 -- 172.21.15.40:0/2347481201 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb17c015930 con 0x7fb18015a2c0 2023-12-17T11:48:23.779 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:23.775+0000 7fb1727fc640 1 -- 172.21.15.40:0/2347481201 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb17c015a90 con 0x7fb18015a2c0 2023-12-17T11:48:23.779 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:23.775+0000 7fb1727fc640 1 -- 172.21.15.40:0/2347481201 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb17c015e60 con 0x7fb18015a2c0 2023-12-17T11:48:23.779 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:23.775+0000 7fb186c72640 1 -- 172.21.15.40:0/2347481201 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb18013eb30 con 0x7fb18015a2c0 2023-12-17T11:48:23.779 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:23.776+0000 7fb186c72640 1 -- 172.21.15.40:0/2347481201 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1801ef1a0 con 0x7fb18015a2c0 2023-12-17T11:48:23.779 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:23.777+0000 7fb186c72640 1 -- 172.21.15.40:0/2347481201 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1800673f0 con 0x7fb18015a2c0 2023-12-17T11:48:23.780 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:23.778+0000 7fb1727fc640 1 -- 172.21.15.40:0/2347481201 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fb17c00f460 con 0x7fb18015a2c0 2023-12-17T11:48:23.780 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:23.779+0000 7fb1727fc640 1 --2- 172.21.15.40:0/2347481201 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7fb16406ae70 0x7fb16406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:23.781 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:23.779+0000 7fb1727fc640 1 -- 172.21.15.40:0/2347481201 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fb17c08a070 con 0x7fb18015a2c0 2023-12-17T11:48:23.781 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:23.779+0000 7fb185c70640 1 --2- 172.21.15.40:0/2347481201 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7fb16406ae70 0x7fb16406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:23.782 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:23.780+0000 7fb185c70640 1 --2- 172.21.15.40:0/2347481201 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7fb16406ae70 0x7fb16406d330 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fb18015b880 tx=0x7fb174009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:48:23.785 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:23.783+0000 7fb1727fc640 1 -- 172.21.15.40:0/2347481201 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fb17c054ec0 con 0x7fb18015a2c0 2023-12-17T11:48:24.008 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:24.006+0000 7fb186c72640 1 -- 172.21.15.40:0/2347481201 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb18015e2d0 con 0x7fb18015a2c0 2023-12-17T11:48:24.009 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:24.007+0000 7fb1727fc640 1 -- 172.21.15.40:0/2347481201 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+4915 (secure 0 0 0) 0x7fb17c0584e0 con 0x7fb18015a2c0 2023-12-17T11:48:24.009 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T11:48:24.009 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/3337931457","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":3337931457},{"type":"v1","addr":"172.21.15.40:6835","nonce":3337931457}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4257,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6833/1874601964","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6832","nonce":1874601964},{"type":"v1","addr":"172.21.15.40:6833","nonce":1874601964}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4267,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6836/3645037845","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6834","nonce":3645037845},{"type":"v1","addr":"172.21.15.159:6836","nonce":3645037845}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-17T11:48:17.696113+0000","modified":"2023-12-17T11:48:22.971352+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4270},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4270":{"gid":4270,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.159:6837/1288849778","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6835","nonce":1288849778},{"type":"v1","addr":"172.21.15.159:6837","nonce":1288849778}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2023-12-17T11:48:24.010 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 6 2023-12-17T11:48:24.012 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:24.010+0000 7fb186c72640 1 -- 172.21.15.40:0/2347481201 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7fb16406ae70 msgr2=0x7fb16406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:24.012 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:24.010+0000 7fb186c72640 1 --2- 172.21.15.40:0/2347481201 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7fb16406ae70 0x7fb16406d330 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fb18015b880 tx=0x7fb174009040 comp rx=0 tx=0).stop 2023-12-17T11:48:24.012 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:24.010+0000 7fb186c72640 1 -- 172.21.15.40:0/2347481201 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb18015a2c0 msgr2=0x7fb180140e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:24.012 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:24.010+0000 7fb186c72640 1 --2- 172.21.15.40:0/2347481201 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb18015a2c0 0x7fb180140e70 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fb17c011540 tx=0x7fb17c011a00 comp rx=0 tx=0).stop 2023-12-17T11:48:24.012 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:24.010+0000 7fb186c72640 1 -- 172.21.15.40:0/2347481201 shutdown_connections 2023-12-17T11:48:24.013 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:24.010+0000 7fb186c72640 1 --2- 172.21.15.40:0/2347481201 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7fb16406ae70 0x7fb16406d330 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:24.013 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:24.010+0000 7fb186c72640 1 --2- 172.21.15.40:0/2347481201 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb1801eed20 0x7fb180142b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:24.013 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:24.010+0000 7fb186c72640 1 --2- 172.21.15.40:0/2347481201 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb18015a2c0 0x7fb180140e70 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:24.013 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:24.010+0000 7fb186c72640 1 --2- 172.21.15.40:0/2347481201 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb16c005180 0x7fb18015c210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:24.013 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:24.010+0000 7fb186c72640 1 -- 172.21.15.40:0/2347481201 >> 172.21.15.40:0/2347481201 conn(0x7fb1800b1840 msgr2=0x7fb1800b0040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:48:24.013 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:24.010+0000 7fb186c72640 1 -- 172.21.15.40:0/2347481201 shutdown_connections 2023-12-17T11:48:24.013 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:24.010+0000 7fb186c72640 1 -- 172.21.15.40:0/2347481201 wait complete. 2023-12-17T11:48:24.031 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-17T11:48:24.252 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:24.250+0000 7f96a4c06640 1 Processor -- start 2023-12-17T11:48:24.252 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:24.250+0000 7f96a4c06640 1 -- start start 2023-12-17T11:48:24.254 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:24.252+0000 7f96a4c06640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f96a00ae200 0x7f96a0070b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:24.254 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:24.252+0000 7f96a4c06640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96a0071f90 con 0x7f96a00abd20 2023-12-17T11:48:24.254 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:24.252+0000 7f96a4c06640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96a0072270 con 0x7f96a015e5d0 2023-12-17T11:48:24.254 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:24.252+0000 7f96a4c06640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96a0070070 con 0x7f96a00ae200 2023-12-17T11:48:24.254 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:24.252+0000 7f969ffff640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f96a00abd20 0x7f96a00cded0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:49330/0 (socket says 172.21.15.40:49330) 2023-12-17T11:48:24.254 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:24.252+0000 7f969ffff640 1 -- 172.21.15.40:0/2975976859 learned_addr learned my addr 172.21.15.40:0/2975976859 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-12-17T11:48:24.256 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:24.252+0000 7f9697fff640 1 --2- 172.21.15.40:0/2975976859 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f96a00ae200 0x7f96a0070b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:24.256 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:24.253+0000 7f969effd640 1 -- 172.21.15.40:0/2975976859 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3121533578 0 0) 0x7f96a0071f90 con 0x7f96a00abd20 2023-12-17T11:48:24.256 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:24.253+0000 7f969effd640 1 -- 172.21.15.40:0/2975976859 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f968c003520 con 0x7f96a00abd20 2023-12-17T11:48:24.256 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:24.253+0000 7f969effd640 1 -- 172.21.15.40:0/2975976859 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1474936238 0 0) 0x7f968c003520 con 0x7f96a00abd20 2023-12-17T11:48:24.257 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:24.253+0000 7f969effd640 1 -- 172.21.15.40:0/2975976859 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f96a00ae200 msgr2=0x7f96a0070b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:48:24.257 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:24.253+0000 7f969effd640 1 --2- 172.21.15.40:0/2975976859 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f96a00ae200 0x7f96a0070b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:24.257 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:24.253+0000 7f969effd640 1 -- 172.21.15.40:0/2975976859 >> v1:172.21.15.159:6789/0 conn(0x7f96a015e5d0 legacy=0x7f96a006bdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:24.257 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:24.253+0000 7f969effd640 1 -- 172.21.15.40:0/2975976859 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96a0070350 con 0x7f96a00abd20 2023-12-17T11:48:24.257 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:24.253+0000 7f969effd640 1 -- 172.21.15.40:0/2975976859 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2643242555 0 0) 0x7f96980019f0 con 0x7f96a00abd20 2023-12-17T11:48:24.257 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:24.253+0000 7f969effd640 1 -- 172.21.15.40:0/2975976859 >> v1:172.21.15.40:6789/0 conn(0x7f96a00abd20 legacy=0x7f96a00cded0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:24.257 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:24.253+0000 7f969effd640 1 --2- 172.21.15.40:0/2975976859 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f968c0039a0 0x7f968c003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:24.257 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:24.253+0000 7f969effd640 1 --2- 172.21.15.40:0/2975976859 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f96a00ae200 0x7f968c0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:24.257 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:24.253+0000 7f969effd640 1 --2- 172.21.15.40:0/2975976859 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f968c004d00 0x7f968c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:24.257 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:24.253+0000 7f969effd640 1 -- 172.21.15.40:0/2975976859 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96a0070070 con 0x7f968c0039a0 2023-12-17T11:48:24.257 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:24.253+0000 7f969effd640 1 -- 172.21.15.40:0/2975976859 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f968c00bb40 con 0x7f968c004d00 2023-12-17T11:48:24.257 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:24.253+0000 7f969effd640 1 -- 172.21.15.40:0/2975976859 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f968c00bd00 con 0x7f96a00ae200 2023-12-17T11:48:24.258 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:24.253+0000 7f969f7fe640 1 --2- 172.21.15.40:0/2975976859 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f968c0039a0 0x7f968c003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:24.258 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:24.254+0000 7f9697fff640 1 --2- 172.21.15.40:0/2975976859 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f96a00ae200 0x7f968c0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:24.258 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:24.254+0000 7f969ffff640 1 --2- 172.21.15.40:0/2975976859 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f968c004d00 0x7f968c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:24.258 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:24.254+0000 7f969f7fe640 1 -- 172.21.15.40:0/2975976859 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f96a00ae200 msgr2=0x7f968c0047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:48:24.258 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:24.254+0000 7f969f7fe640 1 --2- 172.21.15.40:0/2975976859 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f96a00ae200 0x7f968c0047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:24.258 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:24.254+0000 7f969f7fe640 1 -- 172.21.15.40:0/2975976859 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f968c004d00 msgr2=0x7f968c005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:48:24.258 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:24.254+0000 7f969f7fe640 1 --2- 172.21.15.40:0/2975976859 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f968c004d00 0x7f968c005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:24.258 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:24.254+0000 7f969f7fe640 1 -- 172.21.15.40:0/2975976859 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f968c003520 con 0x7f968c0039a0 2023-12-17T11:48:24.258 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:24.254+0000 7f969ffff640 1 --2- 172.21.15.40:0/2975976859 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f968c004d00 0x7f968c005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-17T11:48:24.260 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:24.255+0000 7f969f7fe640 1 --2- 172.21.15.40:0/2975976859 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f968c0039a0 0x7f968c003dc0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f9690001750 tx=0x7f968c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e70b00a56ab653 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:48:24.260 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:24.255+0000 7f969effd640 1 -- 172.21.15.40:0/2975976859 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96900052d0 con 0x7f968c0039a0 2023-12-17T11:48:24.260 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:24.255+0000 7f969effd640 1 -- 172.21.15.40:0/2975976859 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f969002e050 con 0x7f968c0039a0 2023-12-17T11:48:24.260 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:24.255+0000 7f969effd640 1 -- 172.21.15.40:0/2975976859 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96900035f0 con 0x7f968c0039a0 2023-12-17T11:48:24.260 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:24.255+0000 7f96a4c06640 1 -- 172.21.15.40:0/2975976859 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f968c0039a0 msgr2=0x7f968c003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:24.260 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:24.255+0000 7f96a4c06640 1 --2- 172.21.15.40:0/2975976859 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f968c0039a0 0x7f968c003dc0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f9690001750 tx=0x7f968c0057f0 comp rx=0 tx=0).stop 2023-12-17T11:48:24.260 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:24.256+0000 7f969ffff640 1 -- 172.21.15.40:0/2975976859 reap_dead start 2023-12-17T11:48:24.260 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:24.256+0000 7f96a4c06640 1 -- 172.21.15.40:0/2975976859 shutdown_connections 2023-12-17T11:48:24.260 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:24.256+0000 7f96a4c06640 1 -- 172.21.15.40:0/2975976859 >> 172.21.15.40:0/2975976859 conn(0x7f96a00b0860 msgr2=0x7f96a00b0c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:48:24.260 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:24.256+0000 7f96a4c06640 1 -- 172.21.15.40:0/2975976859 shutdown_connections 2023-12-17T11:48:24.260 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:24.256+0000 7f96a4c06640 1 -- 172.21.15.40:0/2975976859 wait complete. 2023-12-17T11:48:24.260 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:24.257+0000 7f96a4c06640 1 Processor -- start 2023-12-17T11:48:24.260 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:24.258+0000 7f96a4c06640 1 -- start start 2023-12-17T11:48:24.263 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:24.258+0000 7f96a4c06640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f968c0039a0 0x7f96a015b030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:24.263 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:24.258+0000 7f96a4c06640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f96a00afb30 0x7f96a015cd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:24.263 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:24.258+0000 7f96a4c06640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f96a009a3d0 0x7f96a00ae610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:24.263 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:24.258+0000 7f96a4c06640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96a015ac10 con 0x7f96a00afb30 2023-12-17T11:48:24.263 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:24.258+0000 7f96a4c06640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96a015a590 con 0x7f968c0039a0 2023-12-17T11:48:24.263 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:24.258+0000 7f96a4c06640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96a0099d20 con 0x7f96a009a3d0 2023-12-17T11:48:24.263 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:24.259+0000 7f9697fff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f96a00afb30 0x7f96a015cd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:24.263 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:24.259+0000 7f9697fff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f96a00afb30 0x7f96a015cd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:51036/0 (socket says 172.21.15.40:51036) 2023-12-17T11:48:24.263 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:24.259+0000 7f9697fff640 1 -- 172.21.15.40:0/2936118427 learned_addr learned my addr 172.21.15.40:0/2936118427 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-17T11:48:24.263 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:24.259+0000 7f969f7fe640 1 --2- 172.21.15.40:0/2936118427 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f968c0039a0 0x7f96a015b030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:24.263 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:24.259+0000 7f9697fff640 1 -- 172.21.15.40:0/2936118427 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f96a009a3d0 msgr2=0x7f96a00ae610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:24.264 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:24.259+0000 7f9697fff640 1 --2- 172.21.15.40:0/2936118427 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f96a009a3d0 0x7f96a00ae610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:24.264 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:24.259+0000 7f9697fff640 1 -- 172.21.15.40:0/2936118427 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f968c0039a0 msgr2=0x7f96a015b030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:24.264 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:24.259+0000 7f9697fff640 1 --2- 172.21.15.40:0/2936118427 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f968c0039a0 0x7f96a015b030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:24.264 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:24.259+0000 7f9697fff640 1 -- 172.21.15.40:0/2936118427 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96a006c680 con 0x7f96a00afb30 2023-12-17T11:48:24.264 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:24.259+0000 7f969f7fe640 1 --2- 172.21.15.40:0/2936118427 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f968c0039a0 0x7f96a015b030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-17T11:48:24.264 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:24.259+0000 7f9697fff640 1 --2- 172.21.15.40:0/2936118427 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f96a00afb30 0x7f96a015cd90 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f9688011600 tx=0x7f9688011ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:48:24.264 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:24.260+0000 7f969cff9640 1 -- 172.21.15.40:0/2936118427 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f968800f920 con 0x7f96a00afb30 2023-12-17T11:48:24.264 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:24.260+0000 7f969cff9640 1 -- 172.21.15.40:0/2936118427 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f968800fa80 con 0x7f96a00afb30 2023-12-17T11:48:24.264 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:24.260+0000 7f969cff9640 1 -- 172.21.15.40:0/2936118427 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f968800fdf0 con 0x7f96a00afb30 2023-12-17T11:48:24.264 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:24.260+0000 7f96a4c06640 1 -- 172.21.15.40:0/2936118427 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96a015a830 con 0x7f96a00afb30 2023-12-17T11:48:24.264 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:24.260+0000 7f96a4c06640 1 -- 172.21.15.40:0/2936118427 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96a00999f0 con 0x7f96a00afb30 2023-12-17T11:48:24.264 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:24.261+0000 7f96a4c06640 1 -- 172.21.15.40:0/2936118427 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96a015ad50 con 0x7f96a00afb30 2023-12-17T11:48:24.265 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:24.262+0000 7f969cff9640 1 -- 172.21.15.40:0/2936118427 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f9688015460 con 0x7f96a00afb30 2023-12-17T11:48:24.265 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:24.262+0000 7f969cff9640 1 --2- 172.21.15.40:0/2936118427 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f968006ae40 0x7f968006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:24.265 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:24.263+0000 7f969cff9640 1 -- 172.21.15.40:0/2936118427 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f9688089da0 con 0x7f96a00afb30 2023-12-17T11:48:24.265 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:24.263+0000 7f969f7fe640 1 --2- 172.21.15.40:0/2936118427 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f968006ae40 0x7f968006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:24.266 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:24.264+0000 7f969f7fe640 1 --2- 172.21.15.40:0/2936118427 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f968006ae40 0x7f968006d300 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f9690033000 tx=0x7f9690009030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:48:24.268 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:24.267+0000 7f969cff9640 1 -- 172.21.15.40:0/2936118427 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f96a015ad50 con 0x7f96a00afb30 2023-12-17T11:48:24.462 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:24.460+0000 7f96a4c06640 1 -- 172.21.15.40:0/2936118427 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f96a015ad50 con 0x7f96a00afb30 2023-12-17T11:48:24.465 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:24.463+0000 7f969cff9640 1 -- 172.21.15.40:0/2936118427 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18322 (secure 0 0 0) 0x7f9688081e60 con 0x7f96a00afb30 2023-12-17T11:48:24.466 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T11:48:24.466 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":25,"fsid":"099cd35d-80d9-4ca4-8424-de13b3b03ac7","created":"2023-12-17T11:47:53.450097+0000","modified":"2023-12-17T11:48:22.971195+0000","last_up_change":"2023-12-17T11:48:05.724195+0000","last_in_change":"2023-12-17T11:47:56.956499+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-17T11:48:06.668943+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-17T11:48:16.151444+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-17T11:48:16.717726+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-17T11:48:20.534819+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a88bfd46-63b8-48b1-9c0e-5c9cdc31bd38","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":555204741},{"type":"v1","addr":"172.21.15.40:6802","nonce":555204741}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":555204741},{"type":"v1","addr":"172.21.15.40:6807","nonce":555204741}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":555204741},{"type":"v1","addr":"172.21.15.40:6815","nonce":555204741}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6809","nonce":555204741},{"type":"v1","addr":"172.21.15.40:6812","nonce":555204741}]},"public_addr":"172.21.15.40:6802/555204741","cluster_addr":"172.21.15.40:6807/555204741","heartbeat_back_addr":"172.21.15.40:6815/555204741","heartbeat_front_addr":"172.21.15.40:6812/555204741","state":["exists","up"]},{"osd":1,"uuid":"c5d628ae-36f4-4866-802c-b162f0e90add","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6801","nonce":1221318112},{"type":"v1","addr":"172.21.15.40:6803","nonce":1221318112}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6805","nonce":1221318112},{"type":"v1","addr":"172.21.15.40:6806","nonce":1221318112}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6811","nonce":1221318112},{"type":"v1","addr":"172.21.15.40:6813","nonce":1221318112}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":1221318112},{"type":"v1","addr":"172.21.15.40:6810","nonce":1221318112}]},"public_addr":"172.21.15.40:6803/1221318112","cluster_addr":"172.21.15.40:6806/1221318112","heartbeat_back_addr":"172.21.15.40:6813/1221318112","heartbeat_front_addr":"172.21.15.40:6810/1221318112","state":["exists","up"]},{"osd":2,"uuid":"d986ad6a-af2f-47fc-9c3b-fbda27b82b73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":1959000265},{"type":"v1","addr":"172.21.15.40:6817","nonce":1959000265}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6818","nonce":1959000265},{"type":"v1","addr":"172.21.15.40:6819","nonce":1959000265}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":1959000265},{"type":"v1","addr":"172.21.15.40:6827","nonce":1959000265}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":1959000265},{"type":"v1","addr":"172.21.15.40:6822","nonce":1959000265}]},"public_addr":"172.21.15.40:6817/1959000265","cluster_addr":"172.21.15.40:6819/1959000265","heartbeat_back_addr":"172.21.15.40:6827/1959000265","heartbeat_front_addr":"172.21.15.40:6822/1959000265","state":["exists","up"]},{"osd":3,"uuid":"d79d22b7-be05-41b2-b95d-697db677fd02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6821","nonce":974040287},{"type":"v1","addr":"172.21.15.40:6823","nonce":974040287}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6825","nonce":974040287},{"type":"v1","addr":"172.21.15.40:6826","nonce":974040287}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":974040287},{"type":"v1","addr":"172.21.15.40:6831","nonce":974040287}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":974040287},{"type":"v1","addr":"172.21.15.40:6829","nonce":974040287}]},"public_addr":"172.21.15.40:6823/974040287","cluster_addr":"172.21.15.40:6826/974040287","heartbeat_back_addr":"172.21.15.40:6831/974040287","heartbeat_front_addr":"172.21.15.40:6829/974040287","state":["exists","up"]},{"osd":4,"uuid":"62a7a233-d3ea-40be-91de-180c0208d639","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6808","nonce":3937787733},{"type":"v1","addr":"172.21.15.159:6809","nonce":3937787733}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6810","nonce":3937787733},{"type":"v1","addr":"172.21.15.159:6811","nonce":3937787733}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6814","nonce":3937787733},{"type":"v1","addr":"172.21.15.159:6815","nonce":3937787733}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6812","nonce":3937787733},{"type":"v1","addr":"172.21.15.159:6813","nonce":3937787733}]},"public_addr":"172.21.15.159:6809/3937787733","cluster_addr":"172.21.15.159:6811/3937787733","heartbeat_back_addr":"172.21.15.159:6815/3937787733","heartbeat_front_addr":"172.21.15.159:6813/3937787733","state":["exists","up"]},{"osd":5,"uuid":"84629cea-dc0e-4b5e-b203-5ea963839281","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6816","nonce":3032505240},{"type":"v1","addr":"172.21.15.159:6817","nonce":3032505240}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6818","nonce":3032505240},{"type":"v1","addr":"172.21.15.159:6819","nonce":3032505240}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6822","nonce":3032505240},{"type":"v1","addr":"172.21.15.159:6823","nonce":3032505240}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6820","nonce":3032505240},{"type":"v1","addr":"172.21.15.159:6821","nonce":3032505240}]},"public_addr":"172.21.15.159:6817/3032505240","cluster_addr":"172.21.15.159:6819/3032505240","heartbeat_back_addr":"172.21.15.159:6823/3032505240","heartbeat_front_addr":"172.21.15.159:6821/3032505240","state":["exists","up"]},{"osd":6,"uuid":"4ae3af3a-1743-4070-a91d-8be5c31cdb04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6800","nonce":2411788597},{"type":"v1","addr":"172.21.15.159:6801","nonce":2411788597}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6802","nonce":2411788597},{"type":"v1","addr":"172.21.15.159:6803","nonce":2411788597}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6806","nonce":2411788597},{"type":"v1","addr":"172.21.15.159:6807","nonce":2411788597}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6804","nonce":2411788597},{"type":"v1","addr":"172.21.15.159:6805","nonce":2411788597}]},"public_addr":"172.21.15.159:6801/2411788597","cluster_addr":"172.21.15.159:6803/2411788597","heartbeat_back_addr":"172.21.15.159:6807/2411788597","heartbeat_front_addr":"172.21.15.159:6805/2411788597","state":["exists","up"]},{"osd":7,"uuid":"c1f4c7f2-8f75-4f95-bc63-a332773e3b8e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6824","nonce":478953349},{"type":"v1","addr":"172.21.15.159:6825","nonce":478953349}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6826","nonce":478953349},{"type":"v1","addr":"172.21.15.159:6827","nonce":478953349}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6830","nonce":478953349},{"type":"v1","addr":"172.21.15.159:6831","nonce":478953349}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6828","nonce":478953349},{"type":"v1","addr":"172.21.15.159:6829","nonce":478953349}]},"public_addr":"172.21.15.159:6825/478953349","cluster_addr":"172.21.15.159:6827/478953349","heartbeat_back_addr":"172.21.15.159:6831/478953349","heartbeat_front_addr":"172.21.15.159:6829/478953349","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T11:48:02.023567+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T11:48:02.278216+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T11:48:02.311843+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T11:48:01.773372+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T11:48:02.618910+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T11:48:02.361559+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T11:48:02.223997+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T11:48:02.604403+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-17T11:48:24.469 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:24.466+0000 7f96a4c06640 1 -- 172.21.15.40:0/2936118427 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f968006ae40 msgr2=0x7f968006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:24.469 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:24.466+0000 7f96a4c06640 1 --2- 172.21.15.40:0/2936118427 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f968006ae40 0x7f968006d300 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f9690033000 tx=0x7f9690009030 comp rx=0 tx=0).stop 2023-12-17T11:48:24.469 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:24.466+0000 7f96a4c06640 1 -- 172.21.15.40:0/2936118427 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f96a00afb30 msgr2=0x7f96a015cd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:24.469 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:24.466+0000 7f96a4c06640 1 --2- 172.21.15.40:0/2936118427 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f96a00afb30 0x7f96a015cd90 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f9688011600 tx=0x7f9688011ac0 comp rx=0 tx=0).stop 2023-12-17T11:48:24.469 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:24.467+0000 7f96a4c06640 1 -- 172.21.15.40:0/2936118427 shutdown_connections 2023-12-17T11:48:24.469 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:24.467+0000 7f96a4c06640 1 --2- 172.21.15.40:0/2936118427 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f968006ae40 0x7f968006d300 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:24.470 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:24.467+0000 7f96a4c06640 1 --2- 172.21.15.40:0/2936118427 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f96a009a3d0 0x7f96a00ae610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:24.470 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:24.467+0000 7f96a4c06640 1 --2- 172.21.15.40:0/2936118427 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f96a00afb30 0x7f96a015cd90 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:24.470 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:24.467+0000 7f96a4c06640 1 --2- 172.21.15.40:0/2936118427 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f968c0039a0 0x7f96a015b030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:24.470 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:24.467+0000 7f96a4c06640 1 -- 172.21.15.40:0/2936118427 >> 172.21.15.40:0/2936118427 conn(0x7f96a00b0860 msgr2=0x7f96a015f170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:48:24.470 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:24.467+0000 7f96a4c06640 1 -- 172.21.15.40:0/2936118427 shutdown_connections 2023-12-17T11:48:24.470 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:24.467+0000 7f96a4c06640 1 -- 172.21.15.40:0/2936118427 wait complete. 2023-12-17T11:48:24.488 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-17T11:48:24.714 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:24.712+0000 7f3fa8b14640 1 Processor -- start 2023-12-17T11:48:24.715 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:24.713+0000 7f3fa8b14640 1 -- start start 2023-12-17T11:48:24.717 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:24.714+0000 7f3fa8b14640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f3fa41596f0 0x7f3fa4070eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:24.717 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:24.714+0000 7f3fa8b14640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f3fa40b3c80 0x7f3fa40abf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:24.717 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:24.714+0000 7f3fa8b14640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f3fa406d9b0 0x7f3fa406c680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:24.717 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:24.714+0000 7f3fa8b14640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3fa40b2770 con 0x7f3fa41596f0 2023-12-17T11:48:24.717 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:24.714+0000 7f3fa8b14640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3fa40b1b60 con 0x7f3fa40b3c80 2023-12-17T11:48:24.717 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:24.714+0000 7f3fa8b14640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3fa40b1e40 con 0x7f3fa406d9b0 2023-12-17T11:48:24.717 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:24.714+0000 7f3fa37fe640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f3fa41596f0 0x7f3fa4070eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:24.717 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:24.714+0000 7f3fa37fe640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f3fa41596f0 0x7f3fa4070eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:51038/0 (socket says 172.21.15.40:51038) 2023-12-17T11:48:24.717 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:24.714+0000 7f3fa37fe640 1 -- 172.21.15.40:0/3142040897 learned_addr learned my addr 172.21.15.40:0/3142040897 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-17T11:48:24.717 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:24.715+0000 7f3f9bfff640 1 --2- 172.21.15.40:0/3142040897 >> v2:172.21.15.159:3300/0 conn(0x7f3fa40b3c80 0x7f3fa40abf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:24.717 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:24.715+0000 7f3fa37fe640 1 -- 172.21.15.40:0/3142040897 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f3fa406d9b0 msgr2=0x7f3fa406c680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:48:24.718 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:24.715+0000 7f3fa37fe640 1 --2- 172.21.15.40:0/3142040897 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f3fa406d9b0 0x7f3fa406c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:24.718 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:24.715+0000 7f3fa37fe640 1 -- 172.21.15.40:0/3142040897 >> v2:172.21.15.159:3300/0 conn(0x7f3fa40b3c80 msgr2=0x7f3fa40abf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:48:24.718 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:24.715+0000 7f3fa37fe640 1 --2- 172.21.15.40:0/3142040897 >> v2:172.21.15.159:3300/0 conn(0x7f3fa40b3c80 0x7f3fa40abf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:24.718 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:24.715+0000 7f3fa37fe640 1 -- 172.21.15.40:0/3142040897 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fa40b2120 con 0x7f3fa41596f0 2023-12-17T11:48:24.718 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:24.715+0000 7f3f9bfff640 1 --2- 172.21.15.40:0/3142040897 >> v2:172.21.15.159:3300/0 conn(0x7f3fa40b3c80 0x7f3fa40abf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-17T11:48:24.719 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:24.716+0000 7f3fa37fe640 1 --2- 172.21.15.40:0/3142040897 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3fa41596f0 0x7f3fa4070eb0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f3fa415e330 tx=0x7f3f9402b930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1bc85de20ff6277a server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:48:24.719 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:24.716+0000 7f3fa2ffd640 1 -- 172.21.15.40:0/3142040897 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f94031890 con 0x7f3fa41596f0 2023-12-17T11:48:24.719 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:24.716+0000 7f3fa2ffd640 1 -- 172.21.15.40:0/3142040897 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f940319f0 con 0x7f3fa41596f0 2023-12-17T11:48:24.719 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:24.716+0000 7f3fa2ffd640 1 -- 172.21.15.40:0/3142040897 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f94031d80 con 0x7f3fa41596f0 2023-12-17T11:48:24.719 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:24.716+0000 7f3fa8b14640 1 -- 172.21.15.40:0/3142040897 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3fa41596f0 msgr2=0x7f3fa4070eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:24.719 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:24.716+0000 7f3fa8b14640 1 --2- 172.21.15.40:0/3142040897 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3fa41596f0 0x7f3fa4070eb0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f3fa415e330 tx=0x7f3f9402b930 comp rx=0 tx=0).stop 2023-12-17T11:48:24.719 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:24.717+0000 7f3fa8b14640 1 -- 172.21.15.40:0/3142040897 shutdown_connections 2023-12-17T11:48:24.719 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:24.717+0000 7f3fa8b14640 1 --2- 172.21.15.40:0/3142040897 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f3fa406d9b0 0x7f3fa406c680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:24.720 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:24.717+0000 7f3fa8b14640 1 --2- 172.21.15.40:0/3142040897 >> v2:172.21.15.159:3300/0 conn(0x7f3fa40b3c80 0x7f3fa40abf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:24.720 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:24.717+0000 7f3fa8b14640 1 --2- 172.21.15.40:0/3142040897 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3fa41596f0 0x7f3fa4070eb0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:24.720 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:24.717+0000 7f3fa8b14640 1 -- 172.21.15.40:0/3142040897 >> 172.21.15.40:0/3142040897 conn(0x7f3fa40b0860 msgr2=0x7f3fa40b0c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:48:24.720 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:24.717+0000 7f3fa8b14640 1 -- 172.21.15.40:0/3142040897 shutdown_connections 2023-12-17T11:48:24.720 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:24.717+0000 7f3fa8b14640 1 -- 172.21.15.40:0/3142040897 wait complete. 2023-12-17T11:48:24.720 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:24.719+0000 7f3fa8b14640 1 Processor -- start 2023-12-17T11:48:24.720 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:24.719+0000 7f3fa8b14640 1 -- start start 2023-12-17T11:48:24.723 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:24.720+0000 7f3fa8b14640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3fa406d9b0 0x7f3fa4144030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:24.723 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:24.720+0000 7f3fa8b14640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3fa40b3c80 0x7f3fa4159c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:24.723 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:24.720+0000 7f3fa8b14640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f3fa41596f0 0x7f3fa414ac70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:24.723 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:24.720+0000 7f3fa8b14640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fa414b670 con 0x7f3fa406d9b0 2023-12-17T11:48:24.723 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:24.720+0000 7f3fa8b14640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fa414b950 con 0x7f3fa40b3c80 2023-12-17T11:48:24.723 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:24.720+0000 7f3fa8b14640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3fa414bc30 con 0x7f3fa41596f0 2023-12-17T11:48:24.723 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:24.720+0000 7f3fa37fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3fa406d9b0 0x7f3fa4144030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:24.724 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:24.720+0000 7f3fa37fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3fa406d9b0 0x7f3fa4144030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:51042/0 (socket says 172.21.15.40:51042) 2023-12-17T11:48:24.724 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:24.720+0000 7f3fa37fe640 1 -- 172.21.15.40:0/3756339102 learned_addr learned my addr 172.21.15.40:0/3756339102 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-17T11:48:24.724 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:24.720+0000 7f3f9bfff640 1 --2- 172.21.15.40:0/3756339102 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3fa40b3c80 0x7f3fa4159c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:24.724 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:24.720+0000 7f3fa37fe640 1 -- 172.21.15.40:0/3756339102 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f3fa41596f0 msgr2=0x7f3fa414ac70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:24.724 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:24.720+0000 7f3fa37fe640 1 --2- 172.21.15.40:0/3756339102 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f3fa41596f0 0x7f3fa414ac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:24.724 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:24.720+0000 7f3fa37fe640 1 -- 172.21.15.40:0/3756339102 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3fa40b3c80 msgr2=0x7f3fa4159c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:24.724 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:24.720+0000 7f3fa37fe640 1 --2- 172.21.15.40:0/3756339102 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3fa40b3c80 0x7f3fa4159c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:24.724 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:24.720+0000 7f3fa37fe640 1 -- 172.21.15.40:0/3756339102 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f940094d0 con 0x7f3fa406d9b0 2023-12-17T11:48:24.724 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:24.720+0000 7f3f9bfff640 1 --2- 172.21.15.40:0/3756339102 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3fa40b3c80 0x7f3fa4159c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-17T11:48:24.724 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:24.721+0000 7f3fa37fe640 1 --2- 172.21.15.40:0/3756339102 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3fa406d9b0 0x7f3fa4144030 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f3f940090b0 tx=0x7f3f940046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:48:24.724 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:24.721+0000 7f3fa0ff9640 1 -- 172.21.15.40:0/3756339102 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f94031800 con 0x7f3fa406d9b0 2023-12-17T11:48:24.724 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:24.721+0000 7f3fa0ff9640 1 -- 172.21.15.40:0/3756339102 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f940443f0 con 0x7f3fa406d9b0 2023-12-17T11:48:24.724 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:24.721+0000 7f3fa8b14640 1 -- 172.21.15.40:0/3756339102 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3fa414bf10 con 0x7f3fa406d9b0 2023-12-17T11:48:24.725 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:24.721+0000 7f3fa0ff9640 1 -- 172.21.15.40:0/3756339102 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f94044780 con 0x7f3fa406d9b0 2023-12-17T11:48:24.725 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:24.721+0000 7f3fa8b14640 1 -- 172.21.15.40:0/3756339102 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3fa4144570 con 0x7f3fa406d9b0 2023-12-17T11:48:24.725 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:24.722+0000 7f3fa8b14640 1 -- 172.21.15.40:0/3756339102 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3fa40ae540 con 0x7f3fa406d9b0 2023-12-17T11:48:24.725 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:24.723+0000 7f3fa0ff9640 1 -- 172.21.15.40:0/3756339102 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f3f9404d450 con 0x7f3fa406d9b0 2023-12-17T11:48:24.726 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:24.725+0000 7f3fa0ff9640 1 --2- 172.21.15.40:0/3756339102 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f3f8406ae40 0x7f3f8406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:24.726 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:24.725+0000 7f3fa0ff9640 1 -- 172.21.15.40:0/3756339102 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f3f940ac1a0 con 0x7f3fa406d9b0 2023-12-17T11:48:24.727 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:24.725+0000 7f3f9bfff640 1 --2- 172.21.15.40:0/3756339102 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f3f8406ae40 0x7f3f8406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:24.728 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:24.726+0000 7f3f9bfff640 1 --2- 172.21.15.40:0/3756339102 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f3f8406ae40 0x7f3f8406d300 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f3f8c006fd0 tx=0x7f3f8c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:48:24.731 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:24.729+0000 7f3fa0ff9640 1 -- 172.21.15.40:0/3756339102 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f3f94076fe0 con 0x7f3fa406d9b0 2023-12-17T11:48:24.921 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:24.918+0000 7f3fa8b14640 1 -- 172.21.15.40:0/3756339102 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3fa40b3490 con 0x7f3fa406d9b0 2023-12-17T11:48:24.922 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:24.921+0000 7f3fa0ff9640 1 -- 172.21.15.40:0/3756339102 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18322 (secure 0 0 0) 0x7f3f9407a600 con 0x7f3fa406d9b0 2023-12-17T11:48:24.923 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T11:48:24.923 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":25,"fsid":"099cd35d-80d9-4ca4-8424-de13b3b03ac7","created":"2023-12-17T11:47:53.450097+0000","modified":"2023-12-17T11:48:22.971195+0000","last_up_change":"2023-12-17T11:48:05.724195+0000","last_in_change":"2023-12-17T11:47:56.956499+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-17T11:48:06.668943+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-17T11:48:16.151444+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-17T11:48:16.717726+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-17T11:48:20.534819+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a88bfd46-63b8-48b1-9c0e-5c9cdc31bd38","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":555204741},{"type":"v1","addr":"172.21.15.40:6802","nonce":555204741}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":555204741},{"type":"v1","addr":"172.21.15.40:6807","nonce":555204741}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":555204741},{"type":"v1","addr":"172.21.15.40:6815","nonce":555204741}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6809","nonce":555204741},{"type":"v1","addr":"172.21.15.40:6812","nonce":555204741}]},"public_addr":"172.21.15.40:6802/555204741","cluster_addr":"172.21.15.40:6807/555204741","heartbeat_back_addr":"172.21.15.40:6815/555204741","heartbeat_front_addr":"172.21.15.40:6812/555204741","state":["exists","up"]},{"osd":1,"uuid":"c5d628ae-36f4-4866-802c-b162f0e90add","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6801","nonce":1221318112},{"type":"v1","addr":"172.21.15.40:6803","nonce":1221318112}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6805","nonce":1221318112},{"type":"v1","addr":"172.21.15.40:6806","nonce":1221318112}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6811","nonce":1221318112},{"type":"v1","addr":"172.21.15.40:6813","nonce":1221318112}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":1221318112},{"type":"v1","addr":"172.21.15.40:6810","nonce":1221318112}]},"public_addr":"172.21.15.40:6803/1221318112","cluster_addr":"172.21.15.40:6806/1221318112","heartbeat_back_addr":"172.21.15.40:6813/1221318112","heartbeat_front_addr":"172.21.15.40:6810/1221318112","state":["exists","up"]},{"osd":2,"uuid":"d986ad6a-af2f-47fc-9c3b-fbda27b82b73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":1959000265},{"type":"v1","addr":"172.21.15.40:6817","nonce":1959000265}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6818","nonce":1959000265},{"type":"v1","addr":"172.21.15.40:6819","nonce":1959000265}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":1959000265},{"type":"v1","addr":"172.21.15.40:6827","nonce":1959000265}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":1959000265},{"type":"v1","addr":"172.21.15.40:6822","nonce":1959000265}]},"public_addr":"172.21.15.40:6817/1959000265","cluster_addr":"172.21.15.40:6819/1959000265","heartbeat_back_addr":"172.21.15.40:6827/1959000265","heartbeat_front_addr":"172.21.15.40:6822/1959000265","state":["exists","up"]},{"osd":3,"uuid":"d79d22b7-be05-41b2-b95d-697db677fd02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6821","nonce":974040287},{"type":"v1","addr":"172.21.15.40:6823","nonce":974040287}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6825","nonce":974040287},{"type":"v1","addr":"172.21.15.40:6826","nonce":974040287}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":974040287},{"type":"v1","addr":"172.21.15.40:6831","nonce":974040287}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":974040287},{"type":"v1","addr":"172.21.15.40:6829","nonce":974040287}]},"public_addr":"172.21.15.40:6823/974040287","cluster_addr":"172.21.15.40:6826/974040287","heartbeat_back_addr":"172.21.15.40:6831/974040287","heartbeat_front_addr":"172.21.15.40:6829/974040287","state":["exists","up"]},{"osd":4,"uuid":"62a7a233-d3ea-40be-91de-180c0208d639","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6808","nonce":3937787733},{"type":"v1","addr":"172.21.15.159:6809","nonce":3937787733}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6810","nonce":3937787733},{"type":"v1","addr":"172.21.15.159:6811","nonce":3937787733}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6814","nonce":3937787733},{"type":"v1","addr":"172.21.15.159:6815","nonce":3937787733}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6812","nonce":3937787733},{"type":"v1","addr":"172.21.15.159:6813","nonce":3937787733}]},"public_addr":"172.21.15.159:6809/3937787733","cluster_addr":"172.21.15.159:6811/3937787733","heartbeat_back_addr":"172.21.15.159:6815/3937787733","heartbeat_front_addr":"172.21.15.159:6813/3937787733","state":["exists","up"]},{"osd":5,"uuid":"84629cea-dc0e-4b5e-b203-5ea963839281","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6816","nonce":3032505240},{"type":"v1","addr":"172.21.15.159:6817","nonce":3032505240}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6818","nonce":3032505240},{"type":"v1","addr":"172.21.15.159:6819","nonce":3032505240}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6822","nonce":3032505240},{"type":"v1","addr":"172.21.15.159:6823","nonce":3032505240}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6820","nonce":3032505240},{"type":"v1","addr":"172.21.15.159:6821","nonce":3032505240}]},"public_addr":"172.21.15.159:6817/3032505240","cluster_addr":"172.21.15.159:6819/3032505240","heartbeat_back_addr":"172.21.15.159:6823/3032505240","heartbeat_front_addr":"172.21.15.159:6821/3032505240","state":["exists","up"]},{"osd":6,"uuid":"4ae3af3a-1743-4070-a91d-8be5c31cdb04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6800","nonce":2411788597},{"type":"v1","addr":"172.21.15.159:6801","nonce":2411788597}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6802","nonce":2411788597},{"type":"v1","addr":"172.21.15.159:6803","nonce":2411788597}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6806","nonce":2411788597},{"type":"v1","addr":"172.21.15.159:6807","nonce":2411788597}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6804","nonce":2411788597},{"type":"v1","addr":"172.21.15.159:6805","nonce":2411788597}]},"public_addr":"172.21.15.159:6801/2411788597","cluster_addr":"172.21.15.159:6803/2411788597","heartbeat_back_addr":"172.21.15.159:6807/2411788597","heartbeat_front_addr":"172.21.15.159:6805/2411788597","state":["exists","up"]},{"osd":7,"uuid":"c1f4c7f2-8f75-4f95-bc63-a332773e3b8e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6824","nonce":478953349},{"type":"v1","addr":"172.21.15.159:6825","nonce":478953349}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6826","nonce":478953349},{"type":"v1","addr":"172.21.15.159:6827","nonce":478953349}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6830","nonce":478953349},{"type":"v1","addr":"172.21.15.159:6831","nonce":478953349}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6828","nonce":478953349},{"type":"v1","addr":"172.21.15.159:6829","nonce":478953349}]},"public_addr":"172.21.15.159:6825/478953349","cluster_addr":"172.21.15.159:6827/478953349","heartbeat_back_addr":"172.21.15.159:6831/478953349","heartbeat_front_addr":"172.21.15.159:6829/478953349","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T11:48:02.023567+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T11:48:02.278216+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T11:48:02.311843+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T11:48:01.773372+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T11:48:02.618910+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T11:48:02.361559+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T11:48:02.223997+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T11:48:02.604403+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-17T11:48:24.925 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:24.923+0000 7f3fa8b14640 1 -- 172.21.15.40:0/3756339102 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f3f8406ae40 msgr2=0x7f3f8406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:24.925 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:24.923+0000 7f3fa8b14640 1 --2- 172.21.15.40:0/3756339102 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f3f8406ae40 0x7f3f8406d300 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f3f8c006fd0 tx=0x7f3f8c008040 comp rx=0 tx=0).stop 2023-12-17T11:48:24.925 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:24.923+0000 7f3fa8b14640 1 -- 172.21.15.40:0/3756339102 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3fa406d9b0 msgr2=0x7f3fa4144030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:24.925 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:24.923+0000 7f3fa8b14640 1 --2- 172.21.15.40:0/3756339102 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3fa406d9b0 0x7f3fa4144030 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f3f940090b0 tx=0x7f3f940046c0 comp rx=0 tx=0).stop 2023-12-17T11:48:24.926 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:24.923+0000 7f3fa8b14640 1 -- 172.21.15.40:0/3756339102 shutdown_connections 2023-12-17T11:48:24.926 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:24.923+0000 7f3fa8b14640 1 --2- 172.21.15.40:0/3756339102 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f3f8406ae40 0x7f3f8406d300 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:24.926 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:24.923+0000 7f3fa8b14640 1 --2- 172.21.15.40:0/3756339102 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f3fa41596f0 0x7f3fa414ac70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:24.926 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:24.923+0000 7f3fa8b14640 1 --2- 172.21.15.40:0/3756339102 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3fa40b3c80 0x7f3fa4159c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:24.926 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:24.923+0000 7f3fa8b14640 1 --2- 172.21.15.40:0/3756339102 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3fa406d9b0 0x7f3fa4144030 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:24.926 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:24.923+0000 7f3fa8b14640 1 -- 172.21.15.40:0/3756339102 >> 172.21.15.40:0/3756339102 conn(0x7f3fa40b0860 msgr2=0x7f3fa40aeae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:48:24.926 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:24.924+0000 7f3fa8b14640 1 -- 172.21.15.40:0/3756339102 shutdown_connections 2023-12-17T11:48:24.926 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:24.924+0000 7f3fa8b14640 1 -- 172.21.15.40:0/3756339102 wait complete. 2023-12-17T11:48:24.957 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-17T11:48:25.188 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:25.186+0000 7fe415333640 1 Processor -- start 2023-12-17T11:48:25.188 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:25.186+0000 7fe415333640 1 -- start start 2023-12-17T11:48:25.190 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:25.188+0000 7fe415333640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fe410072180 0x7fe4100b4750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:25.191 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:25.188+0000 7fe415333640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4100b3bb0 con 0x7fe41006c410 2023-12-17T11:48:25.191 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:25.188+0000 7fe415333640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4101441e0 con 0x7fe410143e00 2023-12-17T11:48:25.191 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:25.188+0000 7fe415333640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe410072680 con 0x7fe410072180 2023-12-17T11:48:25.191 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:25.189+0000 7fe4067fc640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fe410072180 0x7fe4100b4750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:25.191 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:25.189+0000 7fe40f7fe640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fe41006c410 0x7fe41015ecb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:49394/0 (socket says 172.21.15.40:49394) 2023-12-17T11:48:25.191 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:25.189+0000 7fe40f7fe640 1 -- 172.21.15.40:0/2653606808 learned_addr learned my addr 172.21.15.40:0/2653606808 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-12-17T11:48:25.191 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:25.189+0000 7fe4067fc640 1 -- 172.21.15.40:0/2653606808 >> v1:172.21.15.159:6789/0 conn(0x7fe410143e00 legacy=0x7fe4100b4040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:48:25.192 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:25.189+0000 7fe4067fc640 1 -- 172.21.15.40:0/2653606808 >> v1:172.21.15.40:6789/0 conn(0x7fe41006c410 legacy=0x7fe41015ecb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:25.192 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:25.189+0000 7fe4067fc640 1 -- 172.21.15.40:0/2653606808 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4100b1e30 con 0x7fe410072180 2023-12-17T11:48:25.192 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:25.190+0000 7fe4067fc640 1 --2- 172.21.15.40:0/2653606808 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe410072180 0x7fe4100b4750 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fe3f80097a0 tx=0x7fe3f802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95e14a181c0c1838 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:48:25.192 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:25.191+0000 7fe40e7fc640 1 -- 172.21.15.40:0/2653606808 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3f8031830 con 0x7fe410072180 2023-12-17T11:48:25.193 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:25.191+0000 7fe40e7fc640 1 -- 172.21.15.40:0/2653606808 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3f8031990 con 0x7fe410072180 2023-12-17T11:48:25.193 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:25.191+0000 7fe40e7fc640 1 -- 172.21.15.40:0/2653606808 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3f8031d20 con 0x7fe410072180 2023-12-17T11:48:25.193 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:25.191+0000 7fe415333640 1 -- 172.21.15.40:0/2653606808 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe410072180 msgr2=0x7fe4100b4750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:25.194 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:25.191+0000 7fe415333640 1 --2- 172.21.15.40:0/2653606808 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe410072180 0x7fe4100b4750 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fe3f80097a0 tx=0x7fe3f802b8d0 comp rx=0 tx=0).stop 2023-12-17T11:48:25.194 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:25.191+0000 7fe415333640 1 -- 172.21.15.40:0/2653606808 shutdown_connections 2023-12-17T11:48:25.194 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:25.191+0000 7fe415333640 1 --2- 172.21.15.40:0/2653606808 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe410072180 0x7fe4100b4750 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:25.194 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:25.192+0000 7fe415333640 1 -- 172.21.15.40:0/2653606808 >> 172.21.15.40:0/2653606808 conn(0x7fe4100b0a90 msgr2=0x7fe4100b0e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:48:25.194 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:25.192+0000 7fe415333640 1 -- 172.21.15.40:0/2653606808 shutdown_connections 2023-12-17T11:48:25.194 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:25.192+0000 7fe415333640 1 -- 172.21.15.40:0/2653606808 wait complete. 2023-12-17T11:48:25.196 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:25.194+0000 7fe415333640 1 Processor -- start 2023-12-17T11:48:25.196 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:25.194+0000 7fe415333640 1 -- start start 2023-12-17T11:48:25.198 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:25.196+0000 7fe415333640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe41006c410 0x7fe41013efb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:25.198 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:25.196+0000 7fe415333640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe410072180 0x7fe4101429a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:25.198 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:25.196+0000 7fe415333640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe410143e00 0x7fe4100ad810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:25.198 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:25.196+0000 7fe415333640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe410140170 con 0x7fe410143e00 2023-12-17T11:48:25.198 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:25.196+0000 7fe415333640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe41014e110 con 0x7fe410072180 2023-12-17T11:48:25.198 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:25.196+0000 7fe415333640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe41013f4f0 con 0x7fe41006c410 2023-12-17T11:48:25.198 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:25.196+0000 7fe40f7fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe410143e00 0x7fe4100ad810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:25.198 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:25.196+0000 7fe40f7fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe410143e00 0x7fe4100ad810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:40720/0 (socket says 172.21.15.40:40720) 2023-12-17T11:48:25.198 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:25.196+0000 7fe40f7fe640 1 -- 172.21.15.40:0/3873403034 learned_addr learned my addr 172.21.15.40:0/3873403034 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-17T11:48:25.200 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:25.196+0000 7fe4067fc640 1 --2- 172.21.15.40:0/3873403034 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe410072180 0x7fe4101429a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:25.200 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:25.196+0000 7fe40effd640 1 --2- 172.21.15.40:0/3873403034 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe41006c410 0x7fe41013efb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:25.200 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:25.196+0000 7fe40f7fe640 1 -- 172.21.15.40:0/3873403034 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe41006c410 msgr2=0x7fe41013efb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:25.200 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:25.196+0000 7fe40f7fe640 1 --2- 172.21.15.40:0/3873403034 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe41006c410 0x7fe41013efb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:25.200 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:25.196+0000 7fe40f7fe640 1 -- 172.21.15.40:0/3873403034 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe410072180 msgr2=0x7fe4101429a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:25.200 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:25.196+0000 7fe40f7fe640 1 --2- 172.21.15.40:0/3873403034 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe410072180 0x7fe4101429a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:25.200 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:25.196+0000 7fe40f7fe640 1 -- 172.21.15.40:0/3873403034 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3f8009400 con 0x7fe410143e00 2023-12-17T11:48:25.200 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:25.196+0000 7fe4067fc640 1 --2- 172.21.15.40:0/3873403034 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe410072180 0x7fe4101429a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-17T11:48:25.200 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:25.197+0000 7fe40f7fe640 1 --2- 172.21.15.40:0/3873403034 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe410143e00 0x7fe4100ad810 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fe40800cbc0 tx=0x7fe40800a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:48:25.200 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:25.197+0000 7fe407fff640 1 -- 172.21.15.40:0/3873403034 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe40800ad40 con 0x7fe410143e00 2023-12-17T11:48:25.200 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:25.197+0000 7fe407fff640 1 -- 172.21.15.40:0/3873403034 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe408012400 con 0x7fe410143e00 2023-12-17T11:48:25.201 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:25.197+0000 7fe407fff640 1 -- 172.21.15.40:0/3873403034 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe40800aea0 con 0x7fe410143e00 2023-12-17T11:48:25.201 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:25.197+0000 7fe415333640 1 -- 172.21.15.40:0/3873403034 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4101f6b80 con 0x7fe410143e00 2023-12-17T11:48:25.201 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:25.197+0000 7fe415333640 1 -- 172.21.15.40:0/3873403034 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4101f7140 con 0x7fe410143e00 2023-12-17T11:48:25.201 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:25.198+0000 7fe415333640 1 -- 172.21.15.40:0/3873403034 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4100745d0 con 0x7fe410143e00 2023-12-17T11:48:25.201 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:25.199+0000 7fe407fff640 1 -- 172.21.15.40:0/3873403034 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fe408007070 con 0x7fe410143e00 2023-12-17T11:48:25.202 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:25.200+0000 7fe407fff640 1 --2- 172.21.15.40:0/3873403034 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7fe3f406ae40 0x7fe3f406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:25.202 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:25.200+0000 7fe407fff640 1 -- 172.21.15.40:0/3873403034 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fe408089800 con 0x7fe410143e00 2023-12-17T11:48:25.203 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:25.201+0000 7fe40effd640 1 --2- 172.21.15.40:0/3873403034 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7fe3f406ae40 0x7fe3f406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:25.204 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:25.202+0000 7fe40effd640 1 --2- 172.21.15.40:0/3873403034 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7fe3f406ae40 0x7fe3f406d300 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fe40000a750 tx=0x7fe400008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:48:25.206 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:25.205+0000 7fe407fff640 1 -- 172.21.15.40:0/3873403034 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fe4080545d0 con 0x7fe410143e00 2023-12-17T11:48:25.444 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:25.442+0000 7fe415333640 1 -- 172.21.15.40:0/3873403034 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe410070d50 con 0x7fe410143e00 2023-12-17T11:48:25.445 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:25.443+0000 7fe407fff640 1 -- 172.21.15.40:0/3873403034 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+4915 (secure 0 0 0) 0x7fe408057bf0 con 0x7fe410143e00 2023-12-17T11:48:25.445 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T11:48:25.445 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/3337931457","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":3337931457},{"type":"v1","addr":"172.21.15.40:6835","nonce":3337931457}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4257,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6833/1874601964","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6832","nonce":1874601964},{"type":"v1","addr":"172.21.15.40:6833","nonce":1874601964}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4267,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6836/3645037845","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6834","nonce":3645037845},{"type":"v1","addr":"172.21.15.159:6836","nonce":3645037845}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-17T11:48:17.696113+0000","modified":"2023-12-17T11:48:22.971352+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4270},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4270":{"gid":4270,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.159:6837/1288849778","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6835","nonce":1288849778},{"type":"v1","addr":"172.21.15.159:6837","nonce":1288849778}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2023-12-17T11:48:25.446 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 6 2023-12-17T11:48:25.448 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:25.445+0000 7fe415333640 1 -- 172.21.15.40:0/3873403034 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7fe3f406ae40 msgr2=0x7fe3f406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:25.448 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:25.445+0000 7fe415333640 1 --2- 172.21.15.40:0/3873403034 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7fe3f406ae40 0x7fe3f406d300 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fe40000a750 tx=0x7fe400008040 comp rx=0 tx=0).stop 2023-12-17T11:48:25.448 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:25.445+0000 7fe415333640 1 -- 172.21.15.40:0/3873403034 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe410143e00 msgr2=0x7fe4100ad810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:25.448 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:25.445+0000 7fe415333640 1 --2- 172.21.15.40:0/3873403034 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe410143e00 0x7fe4100ad810 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fe40800cbc0 tx=0x7fe40800a430 comp rx=0 tx=0).stop 2023-12-17T11:48:25.448 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:25.446+0000 7fe415333640 1 -- 172.21.15.40:0/3873403034 shutdown_connections 2023-12-17T11:48:25.448 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:25.446+0000 7fe415333640 1 --2- 172.21.15.40:0/3873403034 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7fe3f406ae40 0x7fe3f406d300 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:25.448 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:25.446+0000 7fe415333640 1 --2- 172.21.15.40:0/3873403034 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe410143e00 0x7fe4100ad810 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:25.448 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:25.446+0000 7fe415333640 1 --2- 172.21.15.40:0/3873403034 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe410072180 0x7fe4101429a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:25.448 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:25.446+0000 7fe415333640 1 --2- 172.21.15.40:0/3873403034 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe41006c410 0x7fe41013efb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:25.448 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:25.446+0000 7fe415333640 1 -- 172.21.15.40:0/3873403034 >> 172.21.15.40:0/3873403034 conn(0x7fe4100b0a90 msgr2=0x7fe410144400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:48:25.448 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:25.446+0000 7fe415333640 1 -- 172.21.15.40:0/3873403034 shutdown_connections 2023-12-17T11:48:25.448 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:25.446+0000 7fe415333640 1 -- 172.21.15.40:0/3873403034 wait complete. 2023-12-17T11:48:25.468 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-17T11:48:25.695 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:25.693+0000 7fd6c7f25640 1 Processor -- start 2023-12-17T11:48:25.695 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:25.693+0000 7fd6c7f25640 1 -- start start 2023-12-17T11:48:25.696 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:25.694+0000 7fd6c7f25640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd6c015d480 0x7fd6c00cec30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:25.696 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:25.694+0000 7fd6c7f25640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7fd6c00d3dd0 0x7fd6c00d1750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:25.697 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:25.694+0000 7fd6c7f25640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6c00cdc40 con 0x7fd6c00cfb80 2023-12-17T11:48:25.697 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:25.694+0000 7fd6c7f25640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6c00cde70 con 0x7fd6c00d3dd0 2023-12-17T11:48:25.697 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:25.694+0000 7fd6c7f25640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6c00ce150 con 0x7fd6c015d480 2023-12-17T11:48:25.697 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:25.695+0000 7fd6c64c2640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fd6c00cfb80 0x7fd6c00c6cc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:49404/0 (socket says 172.21.15.40:49404) 2023-12-17T11:48:25.697 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:25.695+0000 7fd6c64c2640 1 -- 172.21.15.40:0/3083623026 learned_addr learned my addr 172.21.15.40:0/3083623026 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-12-17T11:48:25.699 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:25.695+0000 7fd6c54c0640 1 --2- 172.21.15.40:0/3083623026 >> v2:172.21.15.159:3300/0 conn(0x7fd6c00d3dd0 0x7fd6c00d1750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:25.699 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:25.695+0000 7fd6c5cc1640 1 --2- 172.21.15.40:0/3083623026 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd6c015d480 0x7fd6c00cec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:25.699 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:25.695+0000 7fd6c4cbf640 1 -- 172.21.15.40:0/3083623026 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3534686845 0 0) 0x7fd6c00cdc40 con 0x7fd6c00cfb80 2023-12-17T11:48:25.699 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:25.695+0000 7fd6c4cbf640 1 -- 172.21.15.40:0/3083623026 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd6ac003520 con 0x7fd6c00cfb80 2023-12-17T11:48:25.699 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:25.695+0000 7fd6c4cbf640 1 -- 172.21.15.40:0/3083623026 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1502718805 0 0) 0x7fd6ac003520 con 0x7fd6c00cfb80 2023-12-17T11:48:25.699 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:25.695+0000 7fd6c4cbf640 1 -- 172.21.15.40:0/3083623026 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd6c015d480 msgr2=0x7fd6c00cec30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:48:25.700 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:25.695+0000 7fd6c4cbf640 1 --2- 172.21.15.40:0/3083623026 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd6c015d480 0x7fd6c00cec30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:25.700 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:25.695+0000 7fd6c4cbf640 1 -- 172.21.15.40:0/3083623026 >> v2:172.21.15.159:3300/0 conn(0x7fd6c00d3dd0 msgr2=0x7fd6c00d1750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:48:25.700 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:25.695+0000 7fd6c4cbf640 1 --2- 172.21.15.40:0/3083623026 >> v2:172.21.15.159:3300/0 conn(0x7fd6c00d3dd0 0x7fd6c00d1750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:25.700 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:25.695+0000 7fd6c4cbf640 1 -- 172.21.15.40:0/3083623026 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6c00ce430 con 0x7fd6c00cfb80 2023-12-17T11:48:25.700 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:25.695+0000 7fd6c4cbf640 1 -- 172.21.15.40:0/3083623026 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2643242555 0 0) 0x7fd6b8001670 con 0x7fd6c00cfb80 2023-12-17T11:48:25.700 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:25.696+0000 7fd6c4cbf640 1 -- 172.21.15.40:0/3083623026 >> v1:172.21.15.40:6789/0 conn(0x7fd6c00cfb80 legacy=0x7fd6c00c6cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:25.700 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:25.696+0000 7fd6c4cbf640 1 --2- 172.21.15.40:0/3083623026 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd6ac003970 0x7fd6ac003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:25.700 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:25.696+0000 7fd6c4cbf640 1 --2- 172.21.15.40:0/3083623026 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd6c015d480 0x7fd6ac0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:25.700 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:25.696+0000 7fd6c4cbf640 1 --2- 172.21.15.40:0/3083623026 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd6ac004d00 0x7fd6ac005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:25.700 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:25.696+0000 7fd6c4cbf640 1 -- 172.21.15.40:0/3083623026 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6c00cde70 con 0x7fd6ac003970 2023-12-17T11:48:25.700 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:25.696+0000 7fd6c4cbf640 1 -- 172.21.15.40:0/3083623026 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6c00ce150 con 0x7fd6ac004d00 2023-12-17T11:48:25.700 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:25.696+0000 7fd6c4cbf640 1 -- 172.21.15.40:0/3083623026 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6ac00b980 con 0x7fd6c015d480 2023-12-17T11:48:25.700 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:25.696+0000 7fd6c5cc1640 1 --2- 172.21.15.40:0/3083623026 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd6ac003970 0x7fd6ac003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:25.700 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:25.696+0000 7fd6c5cc1640 1 -- 172.21.15.40:0/3083623026 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd6c015d480 msgr2=0x7fd6ac0047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:48:25.701 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:25.696+0000 7fd6c5cc1640 1 --2- 172.21.15.40:0/3083623026 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd6c015d480 0x7fd6ac0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:25.701 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:25.696+0000 7fd6c64c2640 1 --2- 172.21.15.40:0/3083623026 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd6ac004d00 0x7fd6ac005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:25.701 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:25.696+0000 7fd6c5cc1640 1 -- 172.21.15.40:0/3083623026 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd6ac004d00 msgr2=0x7fd6ac005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:48:25.701 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:25.696+0000 7fd6c5cc1640 1 --2- 172.21.15.40:0/3083623026 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd6ac004d00 0x7fd6ac005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:25.701 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:25.696+0000 7fd6c5cc1640 1 -- 172.21.15.40:0/3083623026 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6ac003520 con 0x7fd6ac003970 2023-12-17T11:48:25.701 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:25.696+0000 7fd6c64c2640 1 --2- 172.21.15.40:0/3083623026 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd6ac004d00 0x7fd6ac005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-17T11:48:25.701 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:25.697+0000 7fd6c5cc1640 1 --2- 172.21.15.40:0/3083623026 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd6ac003970 0x7fd6ac003d90 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fd6bc007390 tx=0x7fd6ac0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33ce52cc0e030b68 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:48:25.702 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:25.698+0000 7fd6c4cbf640 1 -- 172.21.15.40:0/3083623026 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6bc02ccf0 con 0x7fd6ac003970 2023-12-17T11:48:25.703 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:25.698+0000 7fd6c4cbf640 1 -- 172.21.15.40:0/3083623026 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6bc02ce50 con 0x7fd6ac003970 2023-12-17T11:48:25.703 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:25.698+0000 7fd6c4cbf640 1 -- 172.21.15.40:0/3083623026 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6bc034660 con 0x7fd6ac003970 2023-12-17T11:48:25.703 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:25.698+0000 7fd6c7f25640 1 -- 172.21.15.40:0/3083623026 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd6ac003970 msgr2=0x7fd6ac003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:25.703 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:25.698+0000 7fd6c7f25640 1 --2- 172.21.15.40:0/3083623026 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd6ac003970 0x7fd6ac003d90 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fd6bc007390 tx=0x7fd6ac0057f0 comp rx=0 tx=0).stop 2023-12-17T11:48:25.703 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:25.698+0000 7fd6c64c2640 1 -- 172.21.15.40:0/3083623026 reap_dead start 2023-12-17T11:48:25.703 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:25.698+0000 7fd6c7f25640 1 -- 172.21.15.40:0/3083623026 shutdown_connections 2023-12-17T11:48:25.703 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:25.698+0000 7fd6c7f25640 1 -- 172.21.15.40:0/3083623026 >> 172.21.15.40:0/3083623026 conn(0x7fd6c009c4b0 msgr2=0x7fd6c00d3170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:48:25.703 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:25.698+0000 7fd6c7f25640 1 -- 172.21.15.40:0/3083623026 shutdown_connections 2023-12-17T11:48:25.703 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:25.698+0000 7fd6c7f25640 1 -- 172.21.15.40:0/3083623026 wait complete. 2023-12-17T11:48:25.703 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:25.700+0000 7fd6c7f25640 1 Processor -- start 2023-12-17T11:48:25.703 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:25.700+0000 7fd6c7f25640 1 -- start start 2023-12-17T11:48:25.705 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:25.701+0000 7fd6c7f25640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd6ac003970 0x7fd6c00ca240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:25.705 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:25.701+0000 7fd6c7f25640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd6c0159810 0x7fd6c01505e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:25.705 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:25.701+0000 7fd6c7f25640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd6c00b84f0 0x7fd6c00c7bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:25.705 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:25.701+0000 7fd6c7f25640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6c00b79d0 con 0x7fd6c00b84f0 2023-12-17T11:48:25.706 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:25.701+0000 7fd6c7f25640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6c00ca780 con 0x7fd6c0159810 2023-12-17T11:48:25.706 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:25.701+0000 7fd6c7f25640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6c00b71c0 con 0x7fd6ac003970 2023-12-17T11:48:25.706 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:25.702+0000 7fd6c64c2640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd6c00b84f0 0x7fd6c00c7bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:25.706 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:25.702+0000 7fd6c64c2640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd6c00b84f0 0x7fd6c00c7bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:40746/0 (socket says 172.21.15.40:40746) 2023-12-17T11:48:25.706 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:25.702+0000 7fd6c64c2640 1 -- 172.21.15.40:0/2241781263 learned_addr learned my addr 172.21.15.40:0/2241781263 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-17T11:48:25.706 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:25.702+0000 7fd6c54c0640 1 --2- 172.21.15.40:0/2241781263 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd6c0159810 0x7fd6c01505e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:25.706 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:25.702+0000 7fd6c5cc1640 1 --2- 172.21.15.40:0/2241781263 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd6ac003970 0x7fd6c00ca240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:25.706 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:25.702+0000 7fd6c64c2640 1 -- 172.21.15.40:0/2241781263 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd6ac003970 msgr2=0x7fd6c00ca240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:25.706 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:25.702+0000 7fd6c64c2640 1 --2- 172.21.15.40:0/2241781263 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd6ac003970 0x7fd6c00ca240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:25.706 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:25.702+0000 7fd6c64c2640 1 -- 172.21.15.40:0/2241781263 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd6c0159810 msgr2=0x7fd6c01505e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:25.706 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:25.702+0000 7fd6c64c2640 1 --2- 172.21.15.40:0/2241781263 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd6c0159810 0x7fd6c01505e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:25.706 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:25.702+0000 7fd6c64c2640 1 -- 172.21.15.40:0/2241781263 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6c00b7410 con 0x7fd6c00b84f0 2023-12-17T11:48:25.706 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:25.702+0000 7fd6c54c0640 1 --2- 172.21.15.40:0/2241781263 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd6c0159810 0x7fd6c01505e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-17T11:48:25.707 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:25.702+0000 7fd6c64c2640 1 --2- 172.21.15.40:0/2241781263 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd6c00b84f0 0x7fd6c00c7bb0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fd6c008d8a0 tx=0x7fd6b800dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:48:25.707 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:25.702+0000 7fd6b67fc640 1 -- 172.21.15.40:0/2241781263 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6b8007230 con 0x7fd6c00b84f0 2023-12-17T11:48:25.707 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:25.702+0000 7fd6b67fc640 1 -- 172.21.15.40:0/2241781263 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6b80073b0 con 0x7fd6c00b84f0 2023-12-17T11:48:25.707 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:25.703+0000 7fd6b67fc640 1 -- 172.21.15.40:0/2241781263 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6b80047e0 con 0x7fd6c00b84f0 2023-12-17T11:48:25.707 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:25.703+0000 7fd6c7f25640 1 -- 172.21.15.40:0/2241781263 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6c00b76f0 con 0x7fd6c00b84f0 2023-12-17T11:48:25.707 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:25.703+0000 7fd6c7f25640 1 -- 172.21.15.40:0/2241781263 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6c00b7fd0 con 0x7fd6c00b84f0 2023-12-17T11:48:25.707 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:25.704+0000 7fd6c7f25640 1 -- 172.21.15.40:0/2241781263 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6c00b7b50 con 0x7fd6c00b84f0 2023-12-17T11:48:25.707 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:25.705+0000 7fd6b67fc640 1 -- 172.21.15.40:0/2241781263 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fd6b8004940 con 0x7fd6c00b84f0 2023-12-17T11:48:25.708 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:25.706+0000 7fd6b67fc640 1 --2- 172.21.15.40:0/2241781263 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7fd6a406ae40 0x7fd6a406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:25.708 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:25.706+0000 7fd6b67fc640 1 -- 172.21.15.40:0/2241781263 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fd6b80896b0 con 0x7fd6c00b84f0 2023-12-17T11:48:25.709 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:25.707+0000 7fd6c5cc1640 1 --2- 172.21.15.40:0/2241781263 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7fd6a406ae40 0x7fd6a406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:25.710 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:25.708+0000 7fd6c5cc1640 1 --2- 172.21.15.40:0/2241781263 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7fd6a406ae40 0x7fd6a406d300 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fd6bc036000 tx=0x7fd6bc030000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:48:25.713 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:25.711+0000 7fd6b67fc640 1 -- 172.21.15.40:0/2241781263 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fd6c00b7b50 con 0x7fd6c00b84f0 2023-12-17T11:48:25.913 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:25.911+0000 7fd6c7f25640 1 -- 172.21.15.40:0/2241781263 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd6c00b7b50 con 0x7fd6c00b84f0 2023-12-17T11:48:25.914 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:25.912+0000 7fd6b67fc640 1 -- 172.21.15.40:0/2241781263 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18322 (secure 0 0 0) 0x7fd6c00b7b50 con 0x7fd6c00b84f0 2023-12-17T11:48:25.915 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T11:48:25.915 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":25,"fsid":"099cd35d-80d9-4ca4-8424-de13b3b03ac7","created":"2023-12-17T11:47:53.450097+0000","modified":"2023-12-17T11:48:22.971195+0000","last_up_change":"2023-12-17T11:48:05.724195+0000","last_in_change":"2023-12-17T11:47:56.956499+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-17T11:48:06.668943+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-17T11:48:16.151444+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-17T11:48:16.717726+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-17T11:48:20.534819+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a88bfd46-63b8-48b1-9c0e-5c9cdc31bd38","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":555204741},{"type":"v1","addr":"172.21.15.40:6802","nonce":555204741}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":555204741},{"type":"v1","addr":"172.21.15.40:6807","nonce":555204741}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":555204741},{"type":"v1","addr":"172.21.15.40:6815","nonce":555204741}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6809","nonce":555204741},{"type":"v1","addr":"172.21.15.40:6812","nonce":555204741}]},"public_addr":"172.21.15.40:6802/555204741","cluster_addr":"172.21.15.40:6807/555204741","heartbeat_back_addr":"172.21.15.40:6815/555204741","heartbeat_front_addr":"172.21.15.40:6812/555204741","state":["exists","up"]},{"osd":1,"uuid":"c5d628ae-36f4-4866-802c-b162f0e90add","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6801","nonce":1221318112},{"type":"v1","addr":"172.21.15.40:6803","nonce":1221318112}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6805","nonce":1221318112},{"type":"v1","addr":"172.21.15.40:6806","nonce":1221318112}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6811","nonce":1221318112},{"type":"v1","addr":"172.21.15.40:6813","nonce":1221318112}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":1221318112},{"type":"v1","addr":"172.21.15.40:6810","nonce":1221318112}]},"public_addr":"172.21.15.40:6803/1221318112","cluster_addr":"172.21.15.40:6806/1221318112","heartbeat_back_addr":"172.21.15.40:6813/1221318112","heartbeat_front_addr":"172.21.15.40:6810/1221318112","state":["exists","up"]},{"osd":2,"uuid":"d986ad6a-af2f-47fc-9c3b-fbda27b82b73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":1959000265},{"type":"v1","addr":"172.21.15.40:6817","nonce":1959000265}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6818","nonce":1959000265},{"type":"v1","addr":"172.21.15.40:6819","nonce":1959000265}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":1959000265},{"type":"v1","addr":"172.21.15.40:6827","nonce":1959000265}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":1959000265},{"type":"v1","addr":"172.21.15.40:6822","nonce":1959000265}]},"public_addr":"172.21.15.40:6817/1959000265","cluster_addr":"172.21.15.40:6819/1959000265","heartbeat_back_addr":"172.21.15.40:6827/1959000265","heartbeat_front_addr":"172.21.15.40:6822/1959000265","state":["exists","up"]},{"osd":3,"uuid":"d79d22b7-be05-41b2-b95d-697db677fd02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6821","nonce":974040287},{"type":"v1","addr":"172.21.15.40:6823","nonce":974040287}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6825","nonce":974040287},{"type":"v1","addr":"172.21.15.40:6826","nonce":974040287}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":974040287},{"type":"v1","addr":"172.21.15.40:6831","nonce":974040287}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":974040287},{"type":"v1","addr":"172.21.15.40:6829","nonce":974040287}]},"public_addr":"172.21.15.40:6823/974040287","cluster_addr":"172.21.15.40:6826/974040287","heartbeat_back_addr":"172.21.15.40:6831/974040287","heartbeat_front_addr":"172.21.15.40:6829/974040287","state":["exists","up"]},{"osd":4,"uuid":"62a7a233-d3ea-40be-91de-180c0208d639","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6808","nonce":3937787733},{"type":"v1","addr":"172.21.15.159:6809","nonce":3937787733}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6810","nonce":3937787733},{"type":"v1","addr":"172.21.15.159:6811","nonce":3937787733}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6814","nonce":3937787733},{"type":"v1","addr":"172.21.15.159:6815","nonce":3937787733}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6812","nonce":3937787733},{"type":"v1","addr":"172.21.15.159:6813","nonce":3937787733}]},"public_addr":"172.21.15.159:6809/3937787733","cluster_addr":"172.21.15.159:6811/3937787733","heartbeat_back_addr":"172.21.15.159:6815/3937787733","heartbeat_front_addr":"172.21.15.159:6813/3937787733","state":["exists","up"]},{"osd":5,"uuid":"84629cea-dc0e-4b5e-b203-5ea963839281","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6816","nonce":3032505240},{"type":"v1","addr":"172.21.15.159:6817","nonce":3032505240}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6818","nonce":3032505240},{"type":"v1","addr":"172.21.15.159:6819","nonce":3032505240}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6822","nonce":3032505240},{"type":"v1","addr":"172.21.15.159:6823","nonce":3032505240}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6820","nonce":3032505240},{"type":"v1","addr":"172.21.15.159:6821","nonce":3032505240}]},"public_addr":"172.21.15.159:6817/3032505240","cluster_addr":"172.21.15.159:6819/3032505240","heartbeat_back_addr":"172.21.15.159:6823/3032505240","heartbeat_front_addr":"172.21.15.159:6821/3032505240","state":["exists","up"]},{"osd":6,"uuid":"4ae3af3a-1743-4070-a91d-8be5c31cdb04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6800","nonce":2411788597},{"type":"v1","addr":"172.21.15.159:6801","nonce":2411788597}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6802","nonce":2411788597},{"type":"v1","addr":"172.21.15.159:6803","nonce":2411788597}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6806","nonce":2411788597},{"type":"v1","addr":"172.21.15.159:6807","nonce":2411788597}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6804","nonce":2411788597},{"type":"v1","addr":"172.21.15.159:6805","nonce":2411788597}]},"public_addr":"172.21.15.159:6801/2411788597","cluster_addr":"172.21.15.159:6803/2411788597","heartbeat_back_addr":"172.21.15.159:6807/2411788597","heartbeat_front_addr":"172.21.15.159:6805/2411788597","state":["exists","up"]},{"osd":7,"uuid":"c1f4c7f2-8f75-4f95-bc63-a332773e3b8e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6824","nonce":478953349},{"type":"v1","addr":"172.21.15.159:6825","nonce":478953349}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6826","nonce":478953349},{"type":"v1","addr":"172.21.15.159:6827","nonce":478953349}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6830","nonce":478953349},{"type":"v1","addr":"172.21.15.159:6831","nonce":478953349}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6828","nonce":478953349},{"type":"v1","addr":"172.21.15.159:6829","nonce":478953349}]},"public_addr":"172.21.15.159:6825/478953349","cluster_addr":"172.21.15.159:6827/478953349","heartbeat_back_addr":"172.21.15.159:6831/478953349","heartbeat_front_addr":"172.21.15.159:6829/478953349","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T11:48:02.023567+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T11:48:02.278216+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T11:48:02.311843+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T11:48:01.773372+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T11:48:02.618910+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T11:48:02.361559+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T11:48:02.223997+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T11:48:02.604403+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-17T11:48:25.917 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:25.915+0000 7fd6c7f25640 1 -- 172.21.15.40:0/2241781263 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7fd6a406ae40 msgr2=0x7fd6a406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:25.917 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:25.915+0000 7fd6c7f25640 1 --2- 172.21.15.40:0/2241781263 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7fd6a406ae40 0x7fd6a406d300 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fd6bc036000 tx=0x7fd6bc030000 comp rx=0 tx=0).stop 2023-12-17T11:48:25.917 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:25.915+0000 7fd6c7f25640 1 -- 172.21.15.40:0/2241781263 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd6c00b84f0 msgr2=0x7fd6c00c7bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:25.918 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:25.915+0000 7fd6c7f25640 1 --2- 172.21.15.40:0/2241781263 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd6c00b84f0 0x7fd6c00c7bb0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fd6c008d8a0 tx=0x7fd6b800dc00 comp rx=0 tx=0).stop 2023-12-17T11:48:25.918 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:25.915+0000 7fd6c7f25640 1 -- 172.21.15.40:0/2241781263 shutdown_connections 2023-12-17T11:48:25.918 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:25.915+0000 7fd6c7f25640 1 --2- 172.21.15.40:0/2241781263 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7fd6a406ae40 0x7fd6a406d300 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:25.918 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:25.915+0000 7fd6c7f25640 1 --2- 172.21.15.40:0/2241781263 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd6c00b84f0 0x7fd6c00c7bb0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:25.918 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:25.915+0000 7fd6c7f25640 1 --2- 172.21.15.40:0/2241781263 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd6c0159810 0x7fd6c01505e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:25.918 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:25.915+0000 7fd6c7f25640 1 --2- 172.21.15.40:0/2241781263 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd6ac003970 0x7fd6c00ca240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:25.918 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:25.915+0000 7fd6c7f25640 1 -- 172.21.15.40:0/2241781263 >> 172.21.15.40:0/2241781263 conn(0x7fd6c009c4b0 msgr2=0x7fd6c015eaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:48:25.918 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:25.915+0000 7fd6c7f25640 1 -- 172.21.15.40:0/2241781263 shutdown_connections 2023-12-17T11:48:25.918 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:25.915+0000 7fd6c7f25640 1 -- 172.21.15.40:0/2241781263 wait complete. 2023-12-17T11:48:26.340 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 6, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-12-17T11:48:17.696113+0000', 'modified': '2023-12-17T11:48:22.971352+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4270}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4270': {'gid': 4270, 'name': 'd', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.159:6837/1288849778', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.159:6835', 'nonce': 1288849778}, {'type': 'v1', 'addr': '172.21.15.159:6837', 'nonce': 1288849778}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 1} 2023-12-17T11:48:26.340 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-12-17T11:48:26.340 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2023-12-17T11:48:26.577 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:26.576+0000 7fb456b3c640 1 Processor -- start 2023-12-17T11:48:26.578 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:26.576+0000 7fb456b3c640 1 -- start start 2023-12-17T11:48:26.579 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:26.577+0000 7fb456b3c640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7fb45015d150 0x7fb450071ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:26.580 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:26.577+0000 7fb456b3c640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4500abd20 con 0x7fb45006dd00 2023-12-17T11:48:26.580 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:26.577+0000 7fb456b3c640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb45015d530 con 0x7fb450070780 2023-12-17T11:48:26.580 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:26.577+0000 7fb456b3c640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4500b2950 con 0x7fb45015d150 2023-12-17T11:48:26.580 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:26.577+0000 7fb455339640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fb45006dd00 0x7fb450070070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:49418/0 (socket says 172.21.15.40:49418) 2023-12-17T11:48:26.580 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:26.577+0000 7fb455339640 1 -- 172.21.15.40:0/3195187251 learned_addr learned my addr 172.21.15.40:0/3195187251 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-12-17T11:48:26.580 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:26.578+0000 7fb455b3a640 1 --2- 172.21.15.40:0/3195187251 >> v2:172.21.15.159:3300/0 conn(0x7fb45015d150 0x7fb450071ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:26.581 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:26.578+0000 7fb454b38640 1 -- 172.21.15.40:0/3195187251 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1826346819 0 0) 0x7fb4500abd20 con 0x7fb45006dd00 2023-12-17T11:48:26.581 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:26.578+0000 7fb454b38640 1 -- 172.21.15.40:0/3195187251 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb43c003520 con 0x7fb45006dd00 2023-12-17T11:48:26.581 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:26.578+0000 7fb454b38640 1 -- 172.21.15.40:0/3195187251 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2635104025 0 0) 0x7fb43c003520 con 0x7fb45006dd00 2023-12-17T11:48:26.581 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:26.578+0000 7fb455b3a640 1 -- 172.21.15.40:0/3195187251 >> v1:172.21.15.159:6789/0 conn(0x7fb450070780 legacy=0x7fb45006c690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:26.581 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:26.578+0000 7fb455b3a640 1 -- 172.21.15.40:0/3195187251 >> v1:172.21.15.40:6789/0 conn(0x7fb45006dd00 legacy=0x7fb450070070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:26.581 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:26.578+0000 7fb455b3a640 1 -- 172.21.15.40:0/3195187251 --> v2:172.21.15.159:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4500b2c30 con 0x7fb45015d150 2023-12-17T11:48:26.581 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:26.580+0000 7fb455b3a640 1 --2- 172.21.15.40:0/3195187251 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb45015d150 0x7fb450071ee0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fb44c0097a0 tx=0x7fb44c02b820 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1c30d3fda2989ffe server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:48:26.582 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:26.580+0000 7fb454b38640 1 -- 172.21.15.40:0/3195187251 <== mon.1 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb44c02f050 con 0x7fb45015d150 2023-12-17T11:48:26.582 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:26.580+0000 7fb454b38640 1 -- 172.21.15.40:0/3195187251 <== mon.1 v2:172.21.15.159:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb44c031500 con 0x7fb45015d150 2023-12-17T11:48:26.582 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:26.580+0000 7fb454b38640 1 -- 172.21.15.40:0/3195187251 <== mon.1 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb440001670 con 0x7fb45015d150 2023-12-17T11:48:26.583 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:26.581+0000 7fb456b3c640 1 -- 172.21.15.40:0/3195187251 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb45015d150 msgr2=0x7fb450071ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:26.583 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:26.581+0000 7fb456b3c640 1 --2- 172.21.15.40:0/3195187251 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb45015d150 0x7fb450071ee0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fb44c0097a0 tx=0x7fb44c02b820 comp rx=0 tx=0).stop 2023-12-17T11:48:26.583 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:26.581+0000 7fb456b3c640 1 -- 172.21.15.40:0/3195187251 shutdown_connections 2023-12-17T11:48:26.583 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:26.581+0000 7fb456b3c640 1 --2- 172.21.15.40:0/3195187251 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb45015d150 0x7fb450071ee0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:26.583 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:26.581+0000 7fb456b3c640 1 -- 172.21.15.40:0/3195187251 >> 172.21.15.40:0/3195187251 conn(0x7fb4500b0860 msgr2=0x7fb4500b0c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:48:26.583 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:26.581+0000 7fb456b3c640 1 -- 172.21.15.40:0/3195187251 shutdown_connections 2023-12-17T11:48:26.584 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:26.581+0000 7fb456b3c640 1 -- 172.21.15.40:0/3195187251 wait complete. 2023-12-17T11:48:26.585 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:26.583+0000 7fb456b3c640 1 Processor -- start 2023-12-17T11:48:26.585 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:26.583+0000 7fb456b3c640 1 -- start start 2023-12-17T11:48:26.586 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:26.584+0000 7fb456b3c640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb45006dd00 0x7fb45014d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:26.586 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:26.584+0000 7fb456b3c640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb450070780 0x7fb45015afa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:26.586 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:26.584+0000 7fb456b3c640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb45015d150 0x7fb45015b4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:26.586 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:26.584+0000 7fb456b3c640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb45014de20 con 0x7fb45006dd00 2023-12-17T11:48:26.587 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:26.584+0000 7fb456b3c640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4501f2be0 con 0x7fb45015d150 2023-12-17T11:48:26.587 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:26.584+0000 7fb456b3c640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb45015f780 con 0x7fb450070780 2023-12-17T11:48:26.587 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:26.584+0000 7fb455b3a640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb45006dd00 0x7fb45014d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:26.587 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:26.585+0000 7fb455b3a640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb45006dd00 0x7fb45014d8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:40762/0 (socket says 172.21.15.40:40762) 2023-12-17T11:48:26.587 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:26.585+0000 7fb455b3a640 1 -- 172.21.15.40:0/3766915802 learned_addr learned my addr 172.21.15.40:0/3766915802 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-17T11:48:26.588 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:26.585+0000 7fb45633b640 1 --2- 172.21.15.40:0/3766915802 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb45015d150 0x7fb45015b4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:26.588 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:26.585+0000 7fb455339640 1 --2- 172.21.15.40:0/3766915802 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb450070780 0x7fb45015afa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:26.588 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:26.585+0000 7fb455b3a640 1 -- 172.21.15.40:0/3766915802 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb450070780 msgr2=0x7fb45015afa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:26.588 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:26.585+0000 7fb455b3a640 1 --2- 172.21.15.40:0/3766915802 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb450070780 0x7fb45015afa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:26.589 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:26.585+0000 7fb455b3a640 1 -- 172.21.15.40:0/3766915802 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb45015d150 msgr2=0x7fb45015b4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:26.589 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:26.585+0000 7fb455b3a640 1 --2- 172.21.15.40:0/3766915802 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb45015d150 0x7fb45015b4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:26.589 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:26.585+0000 7fb455b3a640 1 -- 172.21.15.40:0/3766915802 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb44c009400 con 0x7fb45006dd00 2023-12-17T11:48:26.589 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:26.585+0000 7fb455339640 1 --2- 172.21.15.40:0/3766915802 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb450070780 0x7fb45015afa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-17T11:48:26.589 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:26.585+0000 7fb455b3a640 1 --2- 172.21.15.40:0/3766915802 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb45006dd00 0x7fb45014d8e0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fb44c036040 tx=0x7fb44c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:48:26.589 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:26.586+0000 7fb4467fc640 1 -- 172.21.15.40:0/3766915802 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb44c03d940 con 0x7fb45006dd00 2023-12-17T11:48:26.589 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:26.586+0000 7fb4467fc640 1 -- 172.21.15.40:0/3766915802 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb44c03daa0 con 0x7fb45006dd00 2023-12-17T11:48:26.589 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:26.586+0000 7fb456b3c640 1 -- 172.21.15.40:0/3766915802 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb45015fa60 con 0x7fb45006dd00 2023-12-17T11:48:26.589 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:26.586+0000 7fb4467fc640 1 -- 172.21.15.40:0/3766915802 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb44c03de10 con 0x7fb45006dd00 2023-12-17T11:48:26.589 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:26.586+0000 7fb456b3c640 1 -- 172.21.15.40:0/3766915802 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb450160020 con 0x7fb45006dd00 2023-12-17T11:48:26.590 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:26.588+0000 7fb4467fc640 1 -- 172.21.15.40:0/3766915802 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fb44c03a040 con 0x7fb45006dd00 2023-12-17T11:48:26.591 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:26.590+0000 7fb4467fc640 1 --2- 172.21.15.40:0/3766915802 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7fb43406ae40 0x7fb43406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:26.591 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:26.590+0000 7fb4467fc640 1 -- 172.21.15.40:0/3766915802 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fb44c0ab570 con 0x7fb45006dd00 2023-12-17T11:48:26.591 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:26.590+0000 7fb455339640 1 --2- 172.21.15.40:0/3766915802 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7fb43406ae40 0x7fb43406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:26.592 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:26.590+0000 7fb45aa0b740 1 Processor -- start 2023-12-17T11:48:26.592 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:26.590+0000 7fb45aa0b740 1 -- start start 2023-12-17T11:48:26.597 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:26.591+0000 7fb455339640 1 --2- 172.21.15.40:0/3766915802 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7fb43406ae40 0x7fb43406d300 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fb4400011e0 tx=0x7fb440009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:48:26.597 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:26.591+0000 7fb45aa0b740 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x55be7399e1e0 0x55be7399e5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:26.597 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:26.591+0000 7fb45aa0b740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55be7396e490 0x55be7399b450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:26.597 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:26.591+0000 7fb45aa0b740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55be73971d60 0x55be7399b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:26.597 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:26.591+0000 7fb45aa0b740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x55be738e0f40 con 0x55be7396e490 2023-12-17T11:48:26.598 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:26.591+0000 7fb45aa0b740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x55be738de630 con 0x55be73971d60 2023-12-17T11:48:26.598 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:26.591+0000 7fb45aa0b740 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x55be738d9f20 con 0x55be7399e1e0 2023-12-17T11:48:26.598 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:26.592+0000 7fb455339640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55be7396e490 0x55be7399b450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:26.598 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:26.592+0000 7fb455339640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55be7396e490 0x55be7399b450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:40778/0 (socket says 172.21.15.40:40778) 2023-12-17T11:48:26.598 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:26.592+0000 7fb455339640 1 -- 172.21.15.40:0/2157552627 learned_addr learned my addr 172.21.15.40:0/2157552627 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-17T11:48:26.598 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:26.592+0000 7fb45633b640 1 --2- 172.21.15.40:0/2157552627 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55be73971d60 0x55be7399b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:26.598 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:26.592+0000 7fb455b3a640 1 --2- 172.21.15.40:0/2157552627 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x55be7399e1e0 0x55be7399e5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:26.598 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:26.592+0000 7fb455339640 1 -- 172.21.15.40:0/2157552627 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x55be7399e1e0 msgr2=0x55be7399e5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:48:26.598 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:26.592+0000 7fb455339640 1 --2- 172.21.15.40:0/2157552627 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x55be7399e1e0 0x55be7399e5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:26.598 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:26.592+0000 7fb455339640 1 -- 172.21.15.40:0/2157552627 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55be73971d60 msgr2=0x55be7399b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:48:26.598 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:26.592+0000 7fb455339640 1 --2- 172.21.15.40:0/2157552627 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55be73971d60 0x55be7399b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:26.598 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:26.592+0000 7fb455339640 1 -- 172.21.15.40:0/2157552627 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55be7389c910 con 0x55be7396e490 2023-12-17T11:48:26.599 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:26.592+0000 7fb45633b640 1 --2- 172.21.15.40:0/2157552627 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55be73971d60 0x55be7399b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-17T11:48:26.599 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:26.592+0000 7fb455339640 1 --2- 172.21.15.40:0/2157552627 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55be7396e490 0x55be7399b450 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fb45006e100 tx=0x7fb440010000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34cf9f18826e400d server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:48:26.599 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:26.593+0000 7fb4337fe640 1 -- 172.21.15.40:0/2157552627 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb44000dbb0 con 0x55be7396e490 2023-12-17T11:48:26.599 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:26.593+0000 7fb4337fe640 1 -- 172.21.15.40:0/2157552627 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb44000dd10 con 0x55be7396e490 2023-12-17T11:48:26.599 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:26.593+0000 7fb4337fe640 1 -- 172.21.15.40:0/2157552627 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb440020690 con 0x55be7396e490 2023-12-17T11:48:26.599 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:26.593+0000 7fb45aa0b740 1 -- 172.21.15.40:0/2157552627 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55be7396e490 msgr2=0x55be7399b450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:26.599 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:26.593+0000 7fb45aa0b740 1 --2- 172.21.15.40:0/2157552627 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55be7396e490 0x55be7399b450 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fb45006e100 tx=0x7fb440010000 comp rx=0 tx=0).stop 2023-12-17T11:48:26.599 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:26.593+0000 7fb45aa0b740 1 -- 172.21.15.40:0/2157552627 shutdown_connections 2023-12-17T11:48:26.600 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:26.594+0000 7fb45aa0b740 1 --2- 172.21.15.40:0/2157552627 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55be73971d60 0x55be7399b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:26.600 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:26.594+0000 7fb45aa0b740 1 --2- 172.21.15.40:0/2157552627 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55be7396e490 0x55be7399b450 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:26.600 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:26.594+0000 7fb45aa0b740 1 --2- 172.21.15.40:0/2157552627 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x55be7399e1e0 0x55be7399e5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:26.600 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:26.594+0000 7fb45aa0b740 1 -- 172.21.15.40:0/2157552627 >> 172.21.15.40:0/2157552627 conn(0x55be73970700 msgr2=0x55be739b8ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:48:26.600 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:26.594+0000 7fb45aa0b740 1 -- 172.21.15.40:0/2157552627 shutdown_connections 2023-12-17T11:48:26.600 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:26.594+0000 7fb45aa0b740 1 -- 172.21.15.40:0/2157552627 wait complete. 2023-12-17T11:48:26.600 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:26.594+0000 7fb45aa0b740 1 -- start start 2023-12-17T11:48:26.600 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:26.595+0000 7fb45aa0b740 1 Processor -- start 2023-12-17T11:48:26.603 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:26.597+0000 7fb45aa0b740 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x55be73971d60 0x55be73997230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:26.603 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:26.597+0000 7fb45aa0b740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55be7399e1e0 0x55be739a2920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:26.604 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:26.597+0000 7fb45aa0b740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55be739ca4b0 0x55be739a2e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:26.604 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:26.597+0000 7fb45aa0b740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x55be738762f0 con 0x55be739ca4b0 2023-12-17T11:48:26.604 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:26.597+0000 7fb45aa0b740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x55be73893c70 con 0x55be7399e1e0 2023-12-17T11:48:26.604 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:26.597+0000 7fb45aa0b740 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x55be7363cf20 con 0x55be73971d60 2023-12-17T11:48:26.604 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:26.597+0000 7fb45aa0b740 10 client.0 _ll_register_callbacks cb 0x55be738983b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-17T11:48:26.604 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:26.597+0000 7fb45633b640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55be739ca4b0 0x55be739a2e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:26.604 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:26.597+0000 7fb45633b640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55be739ca4b0 0x55be739a2e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:40786/0 (socket says 172.21.15.40:40786) 2023-12-17T11:48:26.604 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:26.597+0000 7fb45633b640 1 -- 172.21.15.40:0/1310522043 learned_addr learned my addr 172.21.15.40:0/1310522043 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-17T11:48:26.604 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:26.597+0000 7fb455339640 1 --2- 172.21.15.40:0/1310522043 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55be7399e1e0 0x55be739a2920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:26.604 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:26.597+0000 7fb455b3a640 1 --2- 172.21.15.40:0/1310522043 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x55be73971d60 0x55be73997230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:26.604 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:26.597+0000 7fb45633b640 1 -- 172.21.15.40:0/1310522043 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x55be73971d60 msgr2=0x55be73997230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:48:26.604 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:26.597+0000 7fb45633b640 1 --2- 172.21.15.40:0/1310522043 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x55be73971d60 0x55be73997230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:26.604 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:26.597+0000 7fb45633b640 1 -- 172.21.15.40:0/1310522043 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55be7399e1e0 msgr2=0x55be739a2920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:48:26.605 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:26.597+0000 7fb45633b640 1 --2- 172.21.15.40:0/1310522043 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55be7399e1e0 0x55be739a2920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:26.605 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:26.597+0000 7fb45633b640 1 -- 172.21.15.40:0/1310522043 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb440005950 con 0x55be739ca4b0 2023-12-17T11:48:26.605 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:26.597+0000 7fb455339640 1 --2- 172.21.15.40:0/1310522043 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55be7399e1e0 0x55be739a2920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-17T11:48:26.605 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:26.597+0000 7fb45633b640 1 --2- 172.21.15.40:0/1310522043 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55be739ca4b0 0x55be739a2e60 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fb44800f4b0 tx=0x7fb44800f970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4469e268f5787a20 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:48:26.605 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:26.597+0000 7fb430ff9640 10 client.0 ms_handle_connect on v2:172.21.15.40:3300/0 2023-12-17T11:48:26.605 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:26.597+0000 7fb430ff9640 1 -- 172.21.15.40:0/1310522043 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb448003b80 con 0x55be739ca4b0 2023-12-17T11:48:26.605 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:26.597+0000 7fb430ff9640 1 -- 172.21.15.40:0/1310522043 <== mon.0 v2:172.21.15.40:3300/0 2 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fb448003ce0 con 0x55be739ca4b0 2023-12-17T11:48:26.605 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:26.597+0000 7fb45aa0b740 1 -- 172.21.15.40:0/1310522043 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55be738d2db0 con 0x55be739ca4b0 2023-12-17T11:48:26.605 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:26.597+0000 7fb430ff9640 1 -- 172.21.15.40:0/1310522043 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_get_version_reply(handle=1 version=6) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb448003ea0 con 0x55be739ca4b0 2023-12-17T11:48:26.605 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:26.597+0000 7fb45aa0b740 10 client.4413 fetch_fsmap learned FSMap version 6 2023-12-17T11:48:26.605 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:26.597+0000 7fb45aa0b740 1 -- 172.21.15.40:0/1310522043 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,fsmap=6,monmap=2+}) v3 -- 0x55be738d85a0 con 0x55be739ca4b0 2023-12-17T11:48:26.605 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:26.598+0000 7fb430ff9640 1 -- 172.21.15.40:0/1310522043 <== mon.0 v2:172.21.15.40:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55be738d2db0 con 0x55be739ca4b0 2023-12-17T11:48:26.605 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:26.598+0000 7fb430ff9640 1 -- 172.21.15.40:0/1310522043 <== mon.0 v2:172.21.15.40:3300/0 5 ==== fsmap(e 6) v1 ==== 3302+0+0 (secure 0 0 0) 0x7fb448012070 con 0x55be739ca4b0 2023-12-17T11:48:26.606 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:26.598+0000 7fb45aa0b740 10 client.4413 fetch_fsmap finished waiting for FSMap version 6 2023-12-17T11:48:26.606 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:26.598+0000 7fb45aa0b740 10 client.4413 resolve_mds: resolved name 'd' to daemon mds.d 2023-12-17T11:48:26.606 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:26.598+0000 7fb45aa0b740 20 client.4413 populate_metadata read hostname 'smithi040' 2023-12-17T11:48:26.606 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:26.598+0000 7fb45aa0b740 1 --2- 172.21.15.40:0/1310522043 >> [v2:172.21.15.159:6835/1288849778,v1:172.21.15.159:6837/1288849778] conn(0x55be7399fed0 0x55be739ccd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:26.606 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:26.598+0000 7fb45aa0b740 4 client.4413 mds_command: new command op to 4270 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-12-17T11:48:26.606 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:26.598+0000 7fb45aa0b740 1 -- 172.21.15.40:0/1310522043 --> [v2:172.21.15.159:6835/1288849778,v1:172.21.15.159:6837/1288849778] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55be738d2ad0 con 0x55be7399fed0 2023-12-17T11:48:26.606 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:26.600+0000 7fb455b3a640 1 --2- 172.21.15.40:0/1310522043 >> [v2:172.21.15.159:6835/1288849778,v1:172.21.15.159:6837/1288849778] conn(0x55be7399fed0 0x55be739ccd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:26.606 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:26.600+0000 7fb455b3a640 1 --2- 172.21.15.40:0/1310522043 >> [v2:172.21.15.159:6835/1288849778,v1:172.21.15.159:6837/1288849778] conn(0x55be7399fed0 0x55be739ccd00 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b4e34220148a43fc server_cookie=9addc7b1414df835 in_seq=0 out_seq=0 2023-12-17T11:48:26.606 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:26.600+0000 7fb430ff9640 10 client.4413 ms_handle_connect on v2:172.21.15.159:6835/1288849778 2023-12-17T11:48:26.606 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:26.601+0000 7fb430ff9640 1 -- 172.21.15.40:0/1310522043 <== mds.0 v2:172.21.15.159:6835/1288849778 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55be738d2ad0 con 0x55be7399fed0 2023-12-17T11:48:26.606 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:26.602+0000 7fb430ff9640 10 client.4413 handle_command_reply: tid=0 2023-12-17T11:48:26.606 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:26.602+0000 7fb45aa0b740 1 client.4413 shutdown 2023-12-17T11:48:26.607 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:26.602+0000 7fb45aa0b740 1 -- 172.21.15.40:0/1310522043 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55be739ca4b0 msgr2=0x55be739a2e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:26.607 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:26.602+0000 7fb45aa0b740 1 --2- 172.21.15.40:0/1310522043 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55be739ca4b0 0x55be739a2e60 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fb44800f4b0 tx=0x7fb44800f970 comp rx=0 tx=0).stop 2023-12-17T11:48:26.607 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:26.602+0000 7fb45aa0b740 1 -- 172.21.15.40:0/1310522043 shutdown_connections 2023-12-17T11:48:26.607 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:26.602+0000 7fb45aa0b740 1 --2- 172.21.15.40:0/1310522043 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55be739ca4b0 0x55be739a2e60 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:26.608 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:26.602+0000 7fb45aa0b740 1 --2- 172.21.15.40:0/1310522043 >> [v2:172.21.15.159:6835/1288849778,v1:172.21.15.159:6837/1288849778] conn(0x55be7399fed0 0x55be739ccd00 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:26.608 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:26.602+0000 7fb45aa0b740 1 --2- 172.21.15.40:0/1310522043 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55be7399e1e0 0x55be739a2920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:26.608 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:26.602+0000 7fb45aa0b740 1 --2- 172.21.15.40:0/1310522043 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x55be73971d60 0x55be73997230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:26.608 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:26.602+0000 7fb430ff9640 0 client.4413 ms_handle_reset on v2:172.21.15.159:6835/1288849778 2023-12-17T11:48:26.608 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:26.602+0000 7fb45aa0b740 1 -- 172.21.15.40:0/1310522043 >> 172.21.15.40:0/1310522043 conn(0x55be7396e490 msgr2=0x55be739a1d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:48:26.608 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:26.602+0000 7fb45aa0b740 1 -- 172.21.15.40:0/1310522043 shutdown_connections 2023-12-17T11:48:26.608 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:26.602+0000 7fb45aa0b740 1 -- 172.21.15.40:0/1310522043 wait complete. 2023-12-17T11:48:26.608 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:26.603+0000 7fb45aa0b740 20 client.4413 trim_cache size 0 max 16384 2023-12-17T11:48:26.622 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:26.620+0000 7fb45aa0b740 1 Processor -- start 2023-12-17T11:48:26.622 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:26.620+0000 7fb45aa0b740 1 -- start start 2023-12-17T11:48:26.622 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:26.620+0000 7fb45aa0b740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55be73971d60 0x55be739c9070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:26.623 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:26.621+0000 7fb45aa0b740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55be7399e1e0 0x55be73972450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:26.623 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:26.621+0000 7fb45aa0b740 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x55be739ca4b0 0x55be739c56b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:26.623 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:26.621+0000 7fb45aa0b740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x55be7396f880 con 0x55be73971d60 2023-12-17T11:48:26.623 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:26.621+0000 7fb45aa0b740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x55be73996bd0 con 0x55be7399e1e0 2023-12-17T11:48:26.623 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:26.621+0000 7fb45aa0b740 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x55be739ca2c0 con 0x55be739ca4b0 2023-12-17T11:48:26.625 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:26.621+0000 7fb455b3a640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55be73971d60 0x55be739c9070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:26.625 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:26.621+0000 7fb455b3a640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55be73971d60 0x55be739c9070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:40800/0 (socket says 172.21.15.40:40800) 2023-12-17T11:48:26.625 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:26.621+0000 7fb455b3a640 1 -- 172.21.15.40:0/2171269737 learned_addr learned my addr 172.21.15.40:0/2171269737 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-17T11:48:26.625 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:26.621+0000 7fb455339640 1 --2- 172.21.15.40:0/2171269737 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55be7399e1e0 0x55be73972450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:26.625 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:26.621+0000 7fb45633b640 1 --2- 172.21.15.40:0/2171269737 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x55be739ca4b0 0x55be739c56b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:26.625 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:26.621+0000 7fb455b3a640 1 -- 172.21.15.40:0/2171269737 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x55be739ca4b0 msgr2=0x55be739c56b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:48:26.625 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:26.621+0000 7fb455b3a640 1 --2- 172.21.15.40:0/2171269737 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x55be739ca4b0 0x55be739c56b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:26.625 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:26.621+0000 7fb455b3a640 1 -- 172.21.15.40:0/2171269737 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55be7399e1e0 msgr2=0x55be73972450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:48:26.626 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:26.621+0000 7fb455b3a640 1 --2- 172.21.15.40:0/2171269737 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55be7399e1e0 0x55be73972450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:26.626 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:26.622+0000 7fb455b3a640 1 -- 172.21.15.40:0/2171269737 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55be73875b80 con 0x55be73971d60 2023-12-17T11:48:26.626 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:26.622+0000 7fb455b3a640 1 --2- 172.21.15.40:0/2171269737 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55be73971d60 0x55be739c9070 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fb44c079d90 tx=0x7fb44c000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc51ba654205a6cb server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:48:26.626 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:26.622+0000 7fb433fff640 1 -- 172.21.15.40:0/2171269737 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb44c02f020 con 0x55be73971d60 2023-12-17T11:48:26.626 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:26.622+0000 7fb433fff640 1 -- 172.21.15.40:0/2171269737 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb44c078290 con 0x55be73971d60 2023-12-17T11:48:26.626 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:26.622+0000 7fb433fff640 1 -- 172.21.15.40:0/2171269737 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb44c0800b0 con 0x55be73971d60 2023-12-17T11:48:26.626 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:26.623+0000 7fb45aa0b740 1 -- 172.21.15.40:0/2171269737 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55be73971d60 msgr2=0x55be739c9070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:26.626 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:26.623+0000 7fb45aa0b740 1 --2- 172.21.15.40:0/2171269737 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55be73971d60 0x55be739c9070 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fb44c079d90 tx=0x7fb44c000bc0 comp rx=0 tx=0).stop 2023-12-17T11:48:26.626 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:26.623+0000 7fb45aa0b740 1 -- 172.21.15.40:0/2171269737 shutdown_connections 2023-12-17T11:48:26.626 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:26.623+0000 7fb45aa0b740 1 --2- 172.21.15.40:0/2171269737 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x55be739ca4b0 0x55be739c56b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:26.626 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:26.623+0000 7fb45aa0b740 1 --2- 172.21.15.40:0/2171269737 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55be7399e1e0 0x55be73972450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:26.626 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:26.623+0000 7fb45aa0b740 1 --2- 172.21.15.40:0/2171269737 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55be73971d60 0x55be739c9070 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:26.626 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:26.623+0000 7fb45aa0b740 1 -- 172.21.15.40:0/2171269737 >> 172.21.15.40:0/2171269737 conn(0x55be7396e490 msgr2=0x55be739a36d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:48:26.626 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:26.623+0000 7fb45aa0b740 1 -- 172.21.15.40:0/2171269737 shutdown_connections 2023-12-17T11:48:26.627 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:26.623+0000 7fb45aa0b740 1 -- 172.21.15.40:0/2171269737 wait complete. 2023-12-17T11:48:26.629 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:26.624+0000 7fb45aa0b740 1 -- start start 2023-12-17T11:48:26.629 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:26.624+0000 7fb45aa0b740 1 Processor -- start 2023-12-17T11:48:26.630 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:26.625+0000 7fb45aa0b740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55be7399e1e0 0x55be739995f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:26.630 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:26.625+0000 7fb45aa0b740 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x55be739ca4b0 0x55be73a244d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:26.630 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:26.625+0000 7fb45aa0b740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55be73a237e0 0x55be7399e5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:26.630 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:26.625+0000 7fb45aa0b740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x55be739d8500 con 0x55be73a237e0 2023-12-17T11:48:26.630 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:26.625+0000 7fb45aa0b740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x55be7399a0e0 con 0x55be7399e1e0 2023-12-17T11:48:26.630 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:26.625+0000 7fb45aa0b740 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x55be739d82b0 con 0x55be739ca4b0 2023-12-17T11:48:26.630 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:26.625+0000 7fb45aa0b740 10 client.0 _ll_register_callbacks cb 0x7fb4480015c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-17T11:48:26.630 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:26.625+0000 7fb45633b640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55be73a237e0 0x55be7399e5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:26.630 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:26.625+0000 7fb45633b640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55be73a237e0 0x55be7399e5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:40804/0 (socket says 172.21.15.40:40804) 2023-12-17T11:48:26.630 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:26.625+0000 7fb45633b640 1 -- 172.21.15.40:0/4051338528 learned_addr learned my addr 172.21.15.40:0/4051338528 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-17T11:48:26.630 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:26.625+0000 7fb455b3a640 1 --2- 172.21.15.40:0/4051338528 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55be7399e1e0 0x55be739995f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:26.630 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:26.626+0000 7fb455339640 1 --2- 172.21.15.40:0/4051338528 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x55be739ca4b0 0x55be73a244d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:26.631 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:26.626+0000 7fb45633b640 1 -- 172.21.15.40:0/4051338528 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x55be739ca4b0 msgr2=0x55be73a244d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:48:26.631 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:26.626+0000 7fb45633b640 1 --2- 172.21.15.40:0/4051338528 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x55be739ca4b0 0x55be73a244d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:26.631 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:26.626+0000 7fb45633b640 1 -- 172.21.15.40:0/4051338528 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55be7399e1e0 msgr2=0x55be739995f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:48:26.631 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:26.626+0000 7fb45633b640 1 --2- 172.21.15.40:0/4051338528 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55be7399e1e0 0x55be739995f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:26.631 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:26.626+0000 7fb45633b640 1 -- 172.21.15.40:0/4051338528 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb44c07ee70 con 0x55be73a237e0 2023-12-17T11:48:26.631 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:26.626+0000 7fb45633b640 1 --2- 172.21.15.40:0/4051338528 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55be73a237e0 0x55be7399e5c0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fb44800f4b0 tx=0x7fb4480014a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f04d502106752b3 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:48:26.631 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:26.626+0000 7fb430ff9640 10 client.0 ms_handle_connect on v2:172.21.15.40:3300/0 2023-12-17T11:48:26.631 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:26.626+0000 7fb430ff9640 1 -- 172.21.15.40:0/4051338528 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb44800b070 con 0x55be73a237e0 2023-12-17T11:48:26.631 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:26.626+0000 7fb430ff9640 1 -- 172.21.15.40:0/4051338528 <== mon.0 v2:172.21.15.40:3300/0 2 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fb44801c3f0 con 0x55be73a237e0 2023-12-17T11:48:26.631 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:26.626+0000 7fb45aa0b740 1 -- 172.21.15.40:0/4051338528 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55be735da6c0 con 0x55be73a237e0 2023-12-17T11:48:26.631 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:26.627+0000 7fb430ff9640 1 -- 172.21.15.40:0/4051338528 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_get_version_reply(handle=1 version=6) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb4480020c0 con 0x55be73a237e0 2023-12-17T11:48:26.631 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:26.627+0000 7fb45aa0b740 10 client.4419 fetch_fsmap learned FSMap version 6 2023-12-17T11:48:26.631 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:26.627+0000 7fb45aa0b740 1 -- 172.21.15.40:0/4051338528 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,fsmap=6,monmap=2+}) v3 -- 0x55be7389b170 con 0x55be73a237e0 2023-12-17T11:48:26.632 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:26.627+0000 7fb430ff9640 1 -- 172.21.15.40:0/4051338528 <== mon.0 v2:172.21.15.40:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55be735da6c0 con 0x55be73a237e0 2023-12-17T11:48:26.632 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:26.627+0000 7fb430ff9640 1 -- 172.21.15.40:0/4051338528 <== mon.0 v2:172.21.15.40:3300/0 5 ==== fsmap(e 6) v1 ==== 3302+0+0 (secure 0 0 0) 0x7fb44801c5b0 con 0x55be73a237e0 2023-12-17T11:48:26.632 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:26.627+0000 7fb45aa0b740 10 client.4419 fetch_fsmap finished waiting for FSMap version 6 2023-12-17T11:48:26.632 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:26.627+0000 7fb45aa0b740 10 client.4419 resolve_mds: resolved name 'd' to daemon mds.d 2023-12-17T11:48:26.632 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:26.627+0000 7fb45aa0b740 20 client.4419 populate_metadata read hostname 'smithi040' 2023-12-17T11:48:26.632 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:26.627+0000 7fb45aa0b740 1 --2- 172.21.15.40:0/4051338528 >> [v2:172.21.15.159:6835/1288849778,v1:172.21.15.159:6837/1288849778] conn(0x55be73972fa0 0x55be73973380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:26.632 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:26.627+0000 7fb45aa0b740 4 client.4419 mds_command: new command op to 4270 tid=0 multi_id=0 [{"prefix": "status"}] 2023-12-17T11:48:26.632 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:26.627+0000 7fb45aa0b740 1 -- 172.21.15.40:0/4051338528 --> [v2:172.21.15.159:6835/1288849778,v1:172.21.15.159:6837/1288849778] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55be7362dd10 con 0x55be73972fa0 2023-12-17T11:48:26.632 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:26.628+0000 7fb455b3a640 1 --2- 172.21.15.40:0/4051338528 >> [v2:172.21.15.159:6835/1288849778,v1:172.21.15.159:6837/1288849778] conn(0x55be73972fa0 0x55be73973380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:26.633 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:26.628+0000 7fb455b3a640 1 --2- 172.21.15.40:0/4051338528 >> [v2:172.21.15.159:6835/1288849778,v1:172.21.15.159:6837/1288849778] conn(0x55be73972fa0 0x55be73973380 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2c526dc97e028982 server_cookie=9f9374649531c36d in_seq=0 out_seq=0 2023-12-17T11:48:26.634 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:26.628+0000 7fb430ff9640 10 client.4419 ms_handle_connect on v2:172.21.15.159:6835/1288849778 2023-12-17T11:48:26.634 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:26.629+0000 7fb430ff9640 1 -- 172.21.15.40:0/4051338528 <== mds.0 v2:172.21.15.159:6835/1288849778 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+324 (crc 0 0 0) 0x55be7362dd10 con 0x55be73972fa0 2023-12-17T11:48:26.634 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:26.629+0000 7fb430ff9640 10 client.4419 handle_command_reply: tid=0 2023-12-17T11:48:26.634 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:26.629+0000 7fb45aa0b740 1 client.4419 shutdown 2023-12-17T11:48:26.634 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:26.629+0000 7fb45aa0b740 1 -- 172.21.15.40:0/4051338528 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55be73a237e0 msgr2=0x55be7399e5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:26.634 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:26.629+0000 7fb45aa0b740 1 --2- 172.21.15.40:0/4051338528 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55be73a237e0 0x55be7399e5c0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fb44800f4b0 tx=0x7fb4480014a0 comp rx=0 tx=0).stop 2023-12-17T11:48:26.634 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:26.629+0000 7fb45aa0b740 1 -- 172.21.15.40:0/4051338528 shutdown_connections 2023-12-17T11:48:26.634 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:26.629+0000 7fb45aa0b740 1 --2- 172.21.15.40:0/4051338528 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55be73a237e0 0x55be7399e5c0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:26.634 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:26.629+0000 7fb45aa0b740 1 --2- 172.21.15.40:0/4051338528 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x55be739ca4b0 0x55be73a244d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:26.634 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:26.629+0000 7fb45aa0b740 1 --2- 172.21.15.40:0/4051338528 >> [v2:172.21.15.159:6835/1288849778,v1:172.21.15.159:6837/1288849778] conn(0x55be73972fa0 0x55be73973380 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:26.635 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:26.629+0000 7fb45aa0b740 1 --2- 172.21.15.40:0/4051338528 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55be7399e1e0 0x55be739995f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:26.635 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:26.629+0000 7fb45aa0b740 1 -- 172.21.15.40:0/4051338528 >> 172.21.15.40:0/4051338528 conn(0x55be7396e490 msgr2=0x55be739bc500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:48:26.635 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:26.629+0000 7fb430ff9640 0 client.4419 ms_handle_reset on v2:172.21.15.159:6835/1288849778 2023-12-17T11:48:26.635 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:26.629+0000 7fb45aa0b740 1 -- 172.21.15.40:0/4051338528 shutdown_connections 2023-12-17T11:48:26.635 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:26.629+0000 7fb45aa0b740 1 -- 172.21.15.40:0/4051338528 wait complete. 2023-12-17T11:48:26.635 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:26.630+0000 7fb45aa0b740 20 client.4419 trim_cache size 0 max 16384 2023-12-17T11:48:26.635 INFO:teuthology.orchestra.run.smithi040.stdout:{ 2023-12-17T11:48:26.635 INFO:teuthology.orchestra.run.smithi040.stdout: "cluster_fsid": "099cd35d-80d9-4ca4-8424-de13b3b03ac7", 2023-12-17T11:48:26.635 INFO:teuthology.orchestra.run.smithi040.stdout: "whoami": 0, 2023-12-17T11:48:26.636 INFO:teuthology.orchestra.run.smithi040.stdout: "id": 4270, 2023-12-17T11:48:26.636 INFO:teuthology.orchestra.run.smithi040.stdout: "want_state": "up:active", 2023-12-17T11:48:26.636 INFO:teuthology.orchestra.run.smithi040.stdout: "state": "up:active", 2023-12-17T11:48:26.636 INFO:teuthology.orchestra.run.smithi040.stdout: "fs_name": "cephfs", 2023-12-17T11:48:26.636 INFO:teuthology.orchestra.run.smithi040.stdout: "rank_uptime": 8.3629595999999999, 2023-12-17T11:48:26.636 INFO:teuthology.orchestra.run.smithi040.stdout: "mdsmap_epoch": 6, 2023-12-17T11:48:26.636 INFO:teuthology.orchestra.run.smithi040.stdout: "osdmap_epoch": 25, 2023-12-17T11:48:26.636 INFO:teuthology.orchestra.run.smithi040.stdout: "osdmap_epoch_barrier": 25, 2023-12-17T11:48:26.636 INFO:teuthology.orchestra.run.smithi040.stdout: "uptime": 13.528198323 2023-12-17T11:48:26.636 INFO:teuthology.orchestra.run.smithi040.stdout:} 2023-12-17T11:48:26.637 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:26.630+0000 7fb456b3c640 1 -- 172.21.15.40:0/3766915802 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7fb43406ae40 msgr2=0x7fb43406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:26.637 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:26.630+0000 7fb456b3c640 1 --2- 172.21.15.40:0/3766915802 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7fb43406ae40 0x7fb43406d300 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fb4400011e0 tx=0x7fb440009040 comp rx=0 tx=0).stop 2023-12-17T11:48:26.637 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:26.630+0000 7fb456b3c640 1 -- 172.21.15.40:0/3766915802 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb45006dd00 msgr2=0x7fb45014d8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:26.637 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:26.630+0000 7fb456b3c640 1 --2- 172.21.15.40:0/3766915802 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb45006dd00 0x7fb45014d8e0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fb44c036040 tx=0x7fb44c0046c0 comp rx=0 tx=0).stop 2023-12-17T11:48:26.637 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:26.630+0000 7fb456b3c640 1 -- 172.21.15.40:0/3766915802 shutdown_connections 2023-12-17T11:48:26.638 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:26.630+0000 7fb456b3c640 1 --2- 172.21.15.40:0/3766915802 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7fb43406ae40 0x7fb43406d300 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:26.638 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:26.630+0000 7fb456b3c640 1 --2- 172.21.15.40:0/3766915802 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb45015d150 0x7fb45015b4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:26.638 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:26.630+0000 7fb456b3c640 1 --2- 172.21.15.40:0/3766915802 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb450070780 0x7fb45015afa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:26.638 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:26.630+0000 7fb456b3c640 1 --2- 172.21.15.40:0/3766915802 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb45006dd00 0x7fb45014d8e0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:26.638 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:26.630+0000 7fb456b3c640 1 -- 172.21.15.40:0/3766915802 >> 172.21.15.40:0/3766915802 conn(0x7fb4500b0860 msgr2=0x7fb4500ae990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:48:26.638 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:26.630+0000 7fb456b3c640 1 -- 172.21.15.40:0/3766915802 shutdown_connections 2023-12-17T11:48:26.638 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:26.630+0000 7fb456b3c640 1 -- 172.21.15.40:0/3766915802 wait complete. 2023-12-17T11:48:26.649 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-12-17T11:48:26.650 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2023-12-17T11:48:26.650 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-12-17T11:48:26.859 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:26.858+0000 7fb0066ea640 1 Processor -- start 2023-12-17T11:48:26.860 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:26.858+0000 7fb0066ea640 1 -- start start 2023-12-17T11:48:26.861 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:26.859+0000 7fb0066ea640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7fb0001614b0 0x7fb000071ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:26.861 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:26.859+0000 7fb0066ea640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb0000b3840 0x7fb000070070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:26.861 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:26.859+0000 7fb0066ea640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0000b2fb0 con 0x7fb0000705b0 2023-12-17T11:48:26.861 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:26.859+0000 7fb0066ea640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0000b2520 con 0x7fb0001614b0 2023-12-17T11:48:26.862 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:26.859+0000 7fb0066ea640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb000070a40 con 0x7fb0000b3840 2023-12-17T11:48:26.862 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:26.860+0000 7fb004ee7640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb0000b3840 0x7fb000070070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:26.862 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:26.860+0000 7fb0056e8640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7fb0001614b0 0x7fb000071ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:26.862 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:26.860+0000 7fb004ee7640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb0000b3840 0x7fb000070070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3301/0 says I am v2:172.21.15.40:52630/0 (socket says 172.21.15.40:52630) 2023-12-17T11:48:26.862 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:26.860+0000 7fb004ee7640 1 -- 172.21.15.40:0/1022345639 learned_addr learned my addr 172.21.15.40:0/1022345639 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-17T11:48:26.863 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:26.861+0000 7fb004ee7640 1 -- 172.21.15.40:0/1022345639 >> v2:172.21.15.159:3300/0 conn(0x7fb0001614b0 msgr2=0x7fb000071ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:48:26.863 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:26.861+0000 7fb004ee7640 1 --2- 172.21.15.40:0/1022345639 >> v2:172.21.15.159:3300/0 conn(0x7fb0001614b0 0x7fb000071ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:26.863 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:26.861+0000 7fb004ee7640 1 -- 172.21.15.40:0/1022345639 >> v1:172.21.15.159:6789/0 conn(0x7fb0000705b0 legacy=0x7fb0001650b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:48:26.863 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:26.861+0000 7fb004ee7640 1 -- 172.21.15.40:0/1022345639 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb00006ded0 con 0x7fb0000b3840 2023-12-17T11:48:26.864 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:26.863+0000 7fb004ee7640 1 --2- 172.21.15.40:0/1022345639 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb0000b3840 0x7fb000070070 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7faff00098a0 tx=0x7faff002b8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9faed5761fc7c718 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:48:26.864 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:26.863+0000 7faff7fff640 1 -- 172.21.15.40:0/1022345639 <== mon.2 v2:172.21.15.159:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faff0031640 con 0x7fb0000b3840 2023-12-17T11:48:26.865 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:26.863+0000 7faff7fff640 1 -- 172.21.15.40:0/1022345639 <== mon.2 v2:172.21.15.159:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faff00317a0 con 0x7fb0000b3840 2023-12-17T11:48:26.865 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:26.863+0000 7faff7fff640 1 -- 172.21.15.40:0/1022345639 <== mon.2 v2:172.21.15.159:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faff0031b30 con 0x7fb0000b3840 2023-12-17T11:48:26.866 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:26.863+0000 7fb0066ea640 1 -- 172.21.15.40:0/1022345639 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb0000b3840 msgr2=0x7fb000070070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:26.866 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:26.863+0000 7fb0066ea640 1 --2- 172.21.15.40:0/1022345639 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb0000b3840 0x7fb000070070 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7faff00098a0 tx=0x7faff002b8f0 comp rx=0 tx=0).stop 2023-12-17T11:48:26.866 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:26.863+0000 7fb0066ea640 1 -- 172.21.15.40:0/1022345639 shutdown_connections 2023-12-17T11:48:26.866 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:26.863+0000 7fb0066ea640 1 --2- 172.21.15.40:0/1022345639 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb0000b3840 0x7fb000070070 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:26.866 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:26.863+0000 7fb0066ea640 1 --2- 172.21.15.40:0/1022345639 >> v2:172.21.15.159:3300/0 conn(0x7fb0001614b0 0x7fb000071ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:26.866 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:26.863+0000 7fb0066ea640 1 -- 172.21.15.40:0/1022345639 >> 172.21.15.40:0/1022345639 conn(0x7fb0000b0860 msgr2=0x7fb0000b0c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:48:26.866 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:26.864+0000 7fb0066ea640 1 -- 172.21.15.40:0/1022345639 shutdown_connections 2023-12-17T11:48:26.866 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:26.864+0000 7fb0066ea640 1 -- 172.21.15.40:0/1022345639 wait complete. 2023-12-17T11:48:26.867 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:26.865+0000 7fb0066ea640 1 Processor -- start 2023-12-17T11:48:26.868 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:26.866+0000 7fb0066ea640 1 -- start start 2023-12-17T11:48:26.869 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:26.866+0000 7fb0066ea640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb0000705b0 0x7fb00014b560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:26.870 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:26.867+0000 7fb0066ea640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb0000b3840 0x7fb00014bde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:26.870 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:26.867+0000 7fb0066ea640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb0001614b0 0x7fb000149ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:26.870 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:26.867+0000 7fb0066ea640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb00014b140 con 0x7fb0000b3840 2023-12-17T11:48:26.870 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:26.867+0000 7fb0066ea640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb00014a4c0 con 0x7fb0000705b0 2023-12-17T11:48:26.870 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:26.867+0000 7fb0066ea640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb00014a7a0 con 0x7fb0001614b0 2023-12-17T11:48:26.870 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:26.867+0000 7fb004ee7640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb0000b3840 0x7fb00014bde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:26.870 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:26.867+0000 7fb004ee7640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb0000b3840 0x7fb00014bde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:40806/0 (socket says 172.21.15.40:40806) 2023-12-17T11:48:26.870 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:26.867+0000 7fb004ee7640 1 -- 172.21.15.40:0/896896964 learned_addr learned my addr 172.21.15.40:0/896896964 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-17T11:48:26.870 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:26.867+0000 7fb005ee9640 1 --2- 172.21.15.40:0/896896964 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb0001614b0 0x7fb000149ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:26.870 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:26.867+0000 7fb0056e8640 1 --2- 172.21.15.40:0/896896964 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb0000705b0 0x7fb00014b560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:26.870 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:26.867+0000 7fb004ee7640 1 -- 172.21.15.40:0/896896964 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb0001614b0 msgr2=0x7fb000149ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:26.871 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:26.867+0000 7fb004ee7640 1 --2- 172.21.15.40:0/896896964 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb0001614b0 0x7fb000149ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:26.871 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:26.867+0000 7fb004ee7640 1 -- 172.21.15.40:0/896896964 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb0000705b0 msgr2=0x7fb00014b560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:26.871 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:26.867+0000 7fb004ee7640 1 --2- 172.21.15.40:0/896896964 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb0000705b0 0x7fb00014b560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:26.871 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:26.867+0000 7fb004ee7640 1 -- 172.21.15.40:0/896896964 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faff00094d0 con 0x7fb0000b3840 2023-12-17T11:48:26.871 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:26.867+0000 7fb0056e8640 1 --2- 172.21.15.40:0/896896964 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb0000705b0 0x7fb00014b560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-17T11:48:26.871 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:26.867+0000 7fb005ee9640 1 --2- 172.21.15.40:0/896896964 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb0001614b0 0x7fb000149ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-17T11:48:26.871 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:26.868+0000 7fb004ee7640 1 --2- 172.21.15.40:0/896896964 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb0000b3840 0x7fb00014bde0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7faff00098a0 tx=0x7faff00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:48:26.872 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:26.868+0000 7faff5ffb640 1 -- 172.21.15.40:0/896896964 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faff003a930 con 0x7fb0000b3840 2023-12-17T11:48:26.872 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:26.868+0000 7faff5ffb640 1 -- 172.21.15.40:0/896896964 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faff003aa90 con 0x7fb0000b3840 2023-12-17T11:48:26.872 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:26.868+0000 7faff5ffb640 1 -- 172.21.15.40:0/896896964 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faff003ae40 con 0x7fb0000b3840 2023-12-17T11:48:26.872 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:26.868+0000 7fb0066ea640 1 -- 172.21.15.40:0/896896964 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb00014aa80 con 0x7fb0000b3840 2023-12-17T11:48:26.872 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:26.868+0000 7fb0066ea640 1 -- 172.21.15.40:0/896896964 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb00014c320 con 0x7fb0000b3840 2023-12-17T11:48:26.873 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:26.869+0000 7fb0066ea640 1 -- 172.21.15.40:0/896896964 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb00014c510 con 0x7fb0000b3840 2023-12-17T11:48:26.873 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:26.870+0000 7faff5ffb640 1 -- 172.21.15.40:0/896896964 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7faff002f050 con 0x7fb0000b3840 2023-12-17T11:48:26.873 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:26.871+0000 7faff5ffb640 1 --2- 172.21.15.40:0/896896964 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7fafe406ae40 0x7fafe406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:26.873 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:26.871+0000 7faff5ffb640 1 -- 172.21.15.40:0/896896964 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7faff00ab740 con 0x7fb0000b3840 2023-12-17T11:48:26.874 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:26.872+0000 7fb0056e8640 1 --2- 172.21.15.40:0/896896964 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7fafe406ae40 0x7fafe406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:26.875 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:26.873+0000 7fb0056e8640 1 --2- 172.21.15.40:0/896896964 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7fafe406ae40 0x7fafe406d300 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7faffc009a20 tx=0x7faffc008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:48:26.877 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:26.876+0000 7faff5ffb640 1 -- 172.21.15.40:0/896896964 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7faff00764f0 con 0x7fb0000b3840 2023-12-17T11:48:27.109 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:27.107+0000 7fb0066ea640 1 -- 172.21.15.40:0/896896964 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fb00014b280 con 0x7fb0000b3840 2023-12-17T11:48:27.110 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:27.108+0000 7faff5ffb640 1 -- 172.21.15.40:0/896896964 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v6) v1 ==== 53+0+88 (secure 0 0 0) 0x7fb00014b280 con 0x7fb0000b3840 2023-12-17T11:48:27.110 INFO:teuthology.orchestra.run.smithi040.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-12-17T11:48:27.113 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:27.111+0000 7fb0066ea640 1 -- 172.21.15.40:0/896896964 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7fafe406ae40 msgr2=0x7fafe406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:27.113 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:27.111+0000 7fb0066ea640 1 --2- 172.21.15.40:0/896896964 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7fafe406ae40 0x7fafe406d300 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7faffc009a20 tx=0x7faffc008040 comp rx=0 tx=0).stop 2023-12-17T11:48:27.113 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:27.111+0000 7fb0066ea640 1 -- 172.21.15.40:0/896896964 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb0000b3840 msgr2=0x7fb00014bde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:27.113 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:27.111+0000 7fb0066ea640 1 --2- 172.21.15.40:0/896896964 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb0000b3840 0x7fb00014bde0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7faff00098a0 tx=0x7faff00046c0 comp rx=0 tx=0).stop 2023-12-17T11:48:27.114 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:27.111+0000 7fb0066ea640 1 -- 172.21.15.40:0/896896964 shutdown_connections 2023-12-17T11:48:27.114 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:27.111+0000 7fb0066ea640 1 --2- 172.21.15.40:0/896896964 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7fafe406ae40 0x7fafe406d300 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:27.114 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:27.111+0000 7fb0066ea640 1 --2- 172.21.15.40:0/896896964 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb0001614b0 0x7fb000149ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:27.114 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:27.111+0000 7fb0066ea640 1 --2- 172.21.15.40:0/896896964 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb0000b3840 0x7fb00014bde0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:27.114 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:27.111+0000 7fb0066ea640 1 --2- 172.21.15.40:0/896896964 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb0000705b0 0x7fb00014b560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:27.114 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:27.111+0000 7fb0066ea640 1 -- 172.21.15.40:0/896896964 >> 172.21.15.40:0/896896964 conn(0x7fb0000b0860 msgr2=0x7fb0000af740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:48:27.114 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:27.111+0000 7fb0066ea640 1 -- 172.21.15.40:0/896896964 shutdown_connections 2023-12-17T11:48:27.114 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:27.111+0000 7fb0066ea640 1 -- 172.21.15.40:0/896896964 wait complete. 2023-12-17T11:48:27.132 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-12-17T11:48:27.132 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-17T11:48:27.132 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi040.front.sepia.ceph.com 2023-12-17T11:48:27.132 INFO:tasks.cephfs.mount:self.client.name = client.admin 2023-12-17T11:48:27.132 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2023-12-17T11:48:27.132 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-12-17T11:48:27.132 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-12-17T11:48:27.132 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-12-17T11:48:27.132 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.admin' 2023-12-17T11:48:27.133 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-17T11:48:27.133 DEBUG:teuthology.orchestra.run.smithi040:> ip addr 2023-12-17T11:48:27.187 INFO:teuthology.orchestra.run.smithi040.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-17T11:48:27.187 INFO:teuthology.orchestra.run.smithi040.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-17T11:48:27.187 INFO:teuthology.orchestra.run.smithi040.stdout: inet 127.0.0.1/8 scope host lo 2023-12-17T11:48:27.188 INFO:teuthology.orchestra.run.smithi040.stdout: valid_lft forever preferred_lft forever 2023-12-17T11:48:27.188 INFO:teuthology.orchestra.run.smithi040.stdout: inet6 ::1/128 scope host 2023-12-17T11:48:27.188 INFO:teuthology.orchestra.run.smithi040.stdout: valid_lft forever preferred_lft forever 2023-12-17T11:48:27.188 INFO:teuthology.orchestra.run.smithi040.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-17T11:48:27.188 INFO:teuthology.orchestra.run.smithi040.stdout: link/ether 0c:c4:7a:6b:fd:16 brd ff:ff:ff:ff:ff:ff 2023-12-17T11:48:27.188 INFO:teuthology.orchestra.run.smithi040.stdout: altname enp7s0f0 2023-12-17T11:48:27.188 INFO:teuthology.orchestra.run.smithi040.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-17T11:48:27.188 INFO:teuthology.orchestra.run.smithi040.stdout: link/ether 0c:c4:7a:6b:fd:17 brd ff:ff:ff:ff:ff:ff 2023-12-17T11:48:27.188 INFO:teuthology.orchestra.run.smithi040.stdout: altname enp7s0f1 2023-12-17T11:48:27.188 INFO:teuthology.orchestra.run.smithi040.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-17T11:48:27.188 INFO:teuthology.orchestra.run.smithi040.stdout: link/ether 0c:c4:7a:bd:12:cc brd ff:ff:ff:ff:ff:ff 2023-12-17T11:48:27.188 INFO:teuthology.orchestra.run.smithi040.stdout: altname enp1s0f0 2023-12-17T11:48:27.188 INFO:teuthology.orchestra.run.smithi040.stdout: inet 172.21.15.40/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-12-17T11:48:27.188 INFO:teuthology.orchestra.run.smithi040.stdout: valid_lft 42304sec preferred_lft 42304sec 2023-12-17T11:48:27.188 INFO:teuthology.orchestra.run.smithi040.stdout: inet6 fe80::ec4:7aff:febd:12cc/64 scope link noprefixroute 2023-12-17T11:48:27.189 INFO:teuthology.orchestra.run.smithi040.stdout: valid_lft forever preferred_lft forever 2023-12-17T11:48:27.189 INFO:teuthology.orchestra.run.smithi040.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-17T11:48:27.189 INFO:teuthology.orchestra.run.smithi040.stdout: link/ether 0c:c4:7a:bd:12:cd brd ff:ff:ff:ff:ff:ff 2023-12-17T11:48:27.189 INFO:teuthology.orchestra.run.smithi040.stdout: altname enp1s0f1 2023-12-17T11:48:27.190 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-12-17T11:48:27.190 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-17T11:48:27.190 DEBUG:teuthology.orchestra.run.smithi040:> (cd / && exec bash -c ' 2023-12-17T11:48:27.191 DEBUG:teuthology.orchestra.run.smithi040:> set -e 2023-12-17T11:48:27.191 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip link add name ceph-brx type bridge 2023-12-17T11:48:27.191 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip addr flush dev ceph-brx 2023-12-17T11:48:27.191 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip link set ceph-brx up 2023-12-17T11:48:27.191 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-12-17T11:48:27.191 DEBUG:teuthology.orchestra.run.smithi040:> ') 2023-12-17T11:48:27.662 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-17T11:48:27.662 DEBUG:teuthology.orchestra.run.smithi040:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-17T11:48:27.746 INFO:teuthology.orchestra.run.smithi040.stdout:1 2023-12-17T11:48:27.749 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-17T11:48:27.750 DEBUG:teuthology.orchestra.run.smithi040:> route 2023-12-17T11:48:27.800 INFO:teuthology.orchestra.run.smithi040.stdout:Kernel IP routing table 2023-12-17T11:48:27.800 INFO:teuthology.orchestra.run.smithi040.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-17T11:48:27.800 INFO:teuthology.orchestra.run.smithi040.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-12-17T11:48:27.800 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-12-17T11:48:27.801 INFO:teuthology.orchestra.run.smithi040.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-17T11:48:27.801 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-17T11:48:27.801 DEBUG:teuthology.orchestra.run.smithi040:> (cd / && exec bash -c ' 2023-12-17T11:48:27.801 DEBUG:teuthology.orchestra.run.smithi040:> set -e 2023-12-17T11:48:27.801 DEBUG:teuthology.orchestra.run.smithi040:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-12-17T11:48:27.801 DEBUG:teuthology.orchestra.run.smithi040:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-12-17T11:48:27.801 DEBUG:teuthology.orchestra.run.smithi040:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-12-17T11:48:27.801 DEBUG:teuthology.orchestra.run.smithi040:> ') 2023-12-17T11:48:28.577 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-17T11:48:28.577 DEBUG:teuthology.orchestra.run.smithi040:> ip netns list 2023-12-17T11:48:28.638 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-17T11:48:28.638 DEBUG:teuthology.orchestra.run.smithi040:> ip netns list-id 2023-12-17T11:48:28.694 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-17T11:48:28.694 DEBUG:teuthology.orchestra.run.smithi040:> (cd / && exec bash -c ' 2023-12-17T11:48:28.694 DEBUG:teuthology.orchestra.run.smithi040:> set -e 2023-12-17T11:48:28.694 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-12-17T11:48:28.694 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.admin 0 2023-12-17T11:48:28.694 DEBUG:teuthology.orchestra.run.smithi040:> ') 2023-12-17T11:48:28.847 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.admin' with 192.168.0.1/16 2023-12-17T11:48:28.848 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-17T11:48:28.848 DEBUG:teuthology.orchestra.run.smithi040:> (cd / && exec bash -c ' 2023-12-17T11:48:28.848 DEBUG:teuthology.orchestra.run.smithi040:> set -e 2023-12-17T11:48:28.848 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.admin type veth peer name brx.0 2023-12-17T11:48:28.848 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-12-17T11:48:28.848 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set veth0 up 2023-12-17T11:48:28.848 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set lo up 2023-12-17T11:48:28.848 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip route add default via 192.168.255.254 2023-12-17T11:48:28.848 DEBUG:teuthology.orchestra.run.smithi040:> ') 2023-12-17T11:48:29.152 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-17T11:48:29.152 DEBUG:teuthology.orchestra.run.smithi040:> (cd / && exec bash -c ' 2023-12-17T11:48:29.152 DEBUG:teuthology.orchestra.run.smithi040:> set -e 2023-12-17T11:48:29.152 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip link set brx.0 up 2023-12-17T11:48:29.152 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip link set dev brx.0 master ceph-brx 2023-12-17T11:48:29.152 DEBUG:teuthology.orchestra.run.smithi040:> ') 2023-12-17T11:48:29.326 INFO:tasks.cephfs.fuse_mount:Client client.admin config is {} 2023-12-17T11:48:29.326 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-17T11:48:29.326 DEBUG:teuthology.orchestra.run.smithi040:> mkdir -p -v /home/ubuntu/cephtest/mnt.admin 2023-12-17T11:48:29.381 INFO:teuthology.orchestra.run.smithi040.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.admin' 2023-12-17T11:48:29.381 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-17T11:48:29.382 DEBUG:teuthology.orchestra.run.smithi040:> chmod 0000 /home/ubuntu/cephtest/mnt.admin 2023-12-17T11:48:29.429 DEBUG:teuthology.orchestra.run.smithi040:> sudo modprobe fuse 2023-12-17T11:48:29.520 DEBUG:teuthology.orchestra.run.smithi040:> cat /proc/self/mounts | awk '{print $2}' 2023-12-17T11:48:29.576 INFO:teuthology.orchestra.run.smithi040.stdout:/proc 2023-12-17T11:48:29.576 INFO:teuthology.orchestra.run.smithi040.stdout:/sys 2023-12-17T11:48:29.576 INFO:teuthology.orchestra.run.smithi040.stdout:/dev 2023-12-17T11:48:29.576 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/kernel/security 2023-12-17T11:48:29.576 INFO:teuthology.orchestra.run.smithi040.stdout:/dev/shm 2023-12-17T11:48:29.577 INFO:teuthology.orchestra.run.smithi040.stdout:/dev/pts 2023-12-17T11:48:29.577 INFO:teuthology.orchestra.run.smithi040.stdout:/run 2023-12-17T11:48:29.577 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/cgroup 2023-12-17T11:48:29.577 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/pstore 2023-12-17T11:48:29.577 INFO:teuthology.orchestra.run.smithi040.stdout:/ 2023-12-17T11:48:29.577 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/selinux 2023-12-17T11:48:29.577 INFO:teuthology.orchestra.run.smithi040.stdout:/proc/sys/fs/binfmt_misc 2023-12-17T11:48:29.577 INFO:teuthology.orchestra.run.smithi040.stdout:/dev/mqueue 2023-12-17T11:48:29.577 INFO:teuthology.orchestra.run.smithi040.stdout:/dev/hugepages 2023-12-17T11:48:29.577 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/kernel/debug 2023-12-17T11:48:29.577 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/kernel/tracing 2023-12-17T11:48:29.577 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/fuse/connections 2023-12-17T11:48:29.578 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/kernel/config 2023-12-17T11:48:29.578 INFO:teuthology.orchestra.run.smithi040.stdout:/run/credentials/systemd-sysctl.service 2023-12-17T11:48:29.578 INFO:teuthology.orchestra.run.smithi040.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-12-17T11:48:29.578 INFO:teuthology.orchestra.run.smithi040.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-12-17T11:48:29.578 INFO:teuthology.orchestra.run.smithi040.stdout:/var/lib/nfs/rpc_pipefs 2023-12-17T11:48:29.578 INFO:teuthology.orchestra.run.smithi040.stdout:/run/user/1000 2023-12-17T11:48:29.578 INFO:teuthology.orchestra.run.smithi040.stdout:/var/lib/ceph 2023-12-17T11:48:29.578 INFO:teuthology.orchestra.run.smithi040.stdout:/var/lib/ceph/osd/ceph-0 2023-12-17T11:48:29.578 INFO:teuthology.orchestra.run.smithi040.stdout:/var/lib/ceph/osd/ceph-1 2023-12-17T11:48:29.578 INFO:teuthology.orchestra.run.smithi040.stdout:/var/lib/ceph/osd/ceph-2 2023-12-17T11:48:29.578 INFO:teuthology.orchestra.run.smithi040.stdout:/var/lib/ceph/osd/ceph-3 2023-12-17T11:48:29.578 INFO:teuthology.orchestra.run.smithi040.stdout:/run/netns 2023-12-17T11:48:29.578 INFO:teuthology.orchestra.run.smithi040.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-12-17T11:48:29.578 INFO:teuthology.orchestra.run.smithi040.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-12-17T11:48:29.579 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-17T11:48:29.580 DEBUG:teuthology.orchestra.run.smithi040:> ls /sys/fs/fuse/connections 2023-12-17T11:48:29.628 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-12-17T11:48:29.629 DEBUG:teuthology.orchestra.run.smithi040:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.admin --id admin --client_fs=cephfs) 2023-12-17T11:48:29.634 DEBUG:teuthology.orchestra.run.smithi040:> sudo modprobe fuse 2023-12-17T11:48:29.715 DEBUG:teuthology.orchestra.run.smithi040:> cat /proc/self/mounts | awk '{print $2}' 2023-12-17T11:48:29.762 INFO:teuthology.orchestra.run.smithi040.stdout:/proc 2023-12-17T11:48:29.763 INFO:teuthology.orchestra.run.smithi040.stdout:/sys 2023-12-17T11:48:29.763 INFO:teuthology.orchestra.run.smithi040.stdout:/dev 2023-12-17T11:48:29.763 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/kernel/security 2023-12-17T11:48:29.763 INFO:teuthology.orchestra.run.smithi040.stdout:/dev/shm 2023-12-17T11:48:29.763 INFO:teuthology.orchestra.run.smithi040.stdout:/dev/pts 2023-12-17T11:48:29.763 INFO:teuthology.orchestra.run.smithi040.stdout:/run 2023-12-17T11:48:29.763 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/cgroup 2023-12-17T11:48:29.763 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/pstore 2023-12-17T11:48:29.763 INFO:teuthology.orchestra.run.smithi040.stdout:/ 2023-12-17T11:48:29.763 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/selinux 2023-12-17T11:48:29.763 INFO:teuthology.orchestra.run.smithi040.stdout:/proc/sys/fs/binfmt_misc 2023-12-17T11:48:29.763 INFO:teuthology.orchestra.run.smithi040.stdout:/dev/mqueue 2023-12-17T11:48:29.763 INFO:teuthology.orchestra.run.smithi040.stdout:/dev/hugepages 2023-12-17T11:48:29.763 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/kernel/debug 2023-12-17T11:48:29.764 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/kernel/tracing 2023-12-17T11:48:29.764 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/fuse/connections 2023-12-17T11:48:29.764 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/kernel/config 2023-12-17T11:48:29.764 INFO:teuthology.orchestra.run.smithi040.stdout:/run/credentials/systemd-sysctl.service 2023-12-17T11:48:29.764 INFO:teuthology.orchestra.run.smithi040.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-12-17T11:48:29.764 INFO:teuthology.orchestra.run.smithi040.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-12-17T11:48:29.764 INFO:teuthology.orchestra.run.smithi040.stdout:/var/lib/nfs/rpc_pipefs 2023-12-17T11:48:29.764 INFO:teuthology.orchestra.run.smithi040.stdout:/run/user/1000 2023-12-17T11:48:29.764 INFO:teuthology.orchestra.run.smithi040.stdout:/var/lib/ceph 2023-12-17T11:48:29.764 INFO:teuthology.orchestra.run.smithi040.stdout:/var/lib/ceph/osd/ceph-0 2023-12-17T11:48:29.764 INFO:teuthology.orchestra.run.smithi040.stdout:/var/lib/ceph/osd/ceph-1 2023-12-17T11:48:29.765 INFO:teuthology.orchestra.run.smithi040.stdout:/var/lib/ceph/osd/ceph-2 2023-12-17T11:48:29.765 INFO:teuthology.orchestra.run.smithi040.stdout:/var/lib/ceph/osd/ceph-3 2023-12-17T11:48:29.765 INFO:teuthology.orchestra.run.smithi040.stdout:/run/netns 2023-12-17T11:48:29.765 INFO:teuthology.orchestra.run.smithi040.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-12-17T11:48:29.765 INFO:teuthology.orchestra.run.smithi040.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-12-17T11:48:29.766 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-17T11:48:29.766 DEBUG:teuthology.orchestra.run.smithi040:> ls /sys/fs/fuse/connections 2023-12-17T11:48:29.845 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi040.stderr:2023-12-17T11:48:29.844+0000 7fd3e0a3a480 -1 init, newargv = 0x55917cc3b1f0 newargc=15 2023-12-17T11:48:29.845 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi040.stderr:ceph-fuse[95122]: starting ceph client 2023-12-17T11:48:29.859 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi040.stderr:ceph-fuse[95122]: starting fuse 2023-12-17T11:48:30.958 DEBUG:teuthology.orchestra.run.smithi040:> sudo modprobe fuse 2023-12-17T11:48:31.071 DEBUG:teuthology.orchestra.run.smithi040:> cat /proc/self/mounts | awk '{print $2}' 2023-12-17T11:48:31.134 INFO:teuthology.orchestra.run.smithi040.stdout:/proc 2023-12-17T11:48:31.134 INFO:teuthology.orchestra.run.smithi040.stdout:/sys 2023-12-17T11:48:31.134 INFO:teuthology.orchestra.run.smithi040.stdout:/dev 2023-12-17T11:48:31.135 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/kernel/security 2023-12-17T11:48:31.135 INFO:teuthology.orchestra.run.smithi040.stdout:/dev/shm 2023-12-17T11:48:31.135 INFO:teuthology.orchestra.run.smithi040.stdout:/dev/pts 2023-12-17T11:48:31.135 INFO:teuthology.orchestra.run.smithi040.stdout:/run 2023-12-17T11:48:31.135 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/cgroup 2023-12-17T11:48:31.135 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/pstore 2023-12-17T11:48:31.135 INFO:teuthology.orchestra.run.smithi040.stdout:/ 2023-12-17T11:48:31.135 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/selinux 2023-12-17T11:48:31.135 INFO:teuthology.orchestra.run.smithi040.stdout:/proc/sys/fs/binfmt_misc 2023-12-17T11:48:31.135 INFO:teuthology.orchestra.run.smithi040.stdout:/dev/mqueue 2023-12-17T11:48:31.135 INFO:teuthology.orchestra.run.smithi040.stdout:/dev/hugepages 2023-12-17T11:48:31.135 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/kernel/debug 2023-12-17T11:48:31.135 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/kernel/tracing 2023-12-17T11:48:31.135 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/fuse/connections 2023-12-17T11:48:31.135 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/kernel/config 2023-12-17T11:48:31.136 INFO:teuthology.orchestra.run.smithi040.stdout:/run/credentials/systemd-sysctl.service 2023-12-17T11:48:31.136 INFO:teuthology.orchestra.run.smithi040.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-12-17T11:48:31.136 INFO:teuthology.orchestra.run.smithi040.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-12-17T11:48:31.136 INFO:teuthology.orchestra.run.smithi040.stdout:/var/lib/nfs/rpc_pipefs 2023-12-17T11:48:31.136 INFO:teuthology.orchestra.run.smithi040.stdout:/run/user/1000 2023-12-17T11:48:31.136 INFO:teuthology.orchestra.run.smithi040.stdout:/var/lib/ceph 2023-12-17T11:48:31.136 INFO:teuthology.orchestra.run.smithi040.stdout:/var/lib/ceph/osd/ceph-0 2023-12-17T11:48:31.136 INFO:teuthology.orchestra.run.smithi040.stdout:/var/lib/ceph/osd/ceph-1 2023-12-17T11:48:31.136 INFO:teuthology.orchestra.run.smithi040.stdout:/var/lib/ceph/osd/ceph-2 2023-12-17T11:48:31.136 INFO:teuthology.orchestra.run.smithi040.stdout:/var/lib/ceph/osd/ceph-3 2023-12-17T11:48:31.136 INFO:teuthology.orchestra.run.smithi040.stdout:/run/netns 2023-12-17T11:48:31.136 INFO:teuthology.orchestra.run.smithi040.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-12-17T11:48:31.136 INFO:teuthology.orchestra.run.smithi040.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-12-17T11:48:31.136 INFO:teuthology.orchestra.run.smithi040.stdout:/home/ubuntu/cephtest/mnt.admin 2023-12-17T11:48:31.137 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-17T11:48:31.138 DEBUG:teuthology.orchestra.run.smithi040:> ls /sys/fs/fuse/connections 2023-12-17T11:48:31.192 INFO:teuthology.orchestra.run.smithi040.stdout:41 2023-12-17T11:48:31.193 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [41] 2023-12-17T11:48:31.193 DEBUG:teuthology.orchestra.run.smithi040:> sudo stdin-killer -- python3 -c ' 2023-12-17T11:48:31.193 DEBUG:teuthology.orchestra.run.smithi040:> import glob 2023-12-17T11:48:31.193 DEBUG:teuthology.orchestra.run.smithi040:> import re 2023-12-17T11:48:31.193 DEBUG:teuthology.orchestra.run.smithi040:> import os 2023-12-17T11:48:31.193 DEBUG:teuthology.orchestra.run.smithi040:> import subprocess 2023-12-17T11:48:31.193 DEBUG:teuthology.orchestra.run.smithi040:> 2023-12-17T11:48:31.193 DEBUG:teuthology.orchestra.run.smithi040:> def _find_admin_socket(client_name): 2023-12-17T11:48:31.193 DEBUG:teuthology.orchestra.run.smithi040:> asok_path = "/var/run/ceph/ceph-client.admin.*.asok" 2023-12-17T11:48:31.194 DEBUG:teuthology.orchestra.run.smithi040:> files = glob.glob(asok_path) 2023-12-17T11:48:31.194 DEBUG:teuthology.orchestra.run.smithi040:> mountpoint = "/home/ubuntu/cephtest/mnt.admin" 2023-12-17T11:48:31.194 DEBUG:teuthology.orchestra.run.smithi040:> 2023-12-17T11:48:31.194 DEBUG:teuthology.orchestra.run.smithi040:> # Given a non-glob path, it better be there 2023-12-17T11:48:31.194 DEBUG:teuthology.orchestra.run.smithi040:> if "*" not in asok_path: 2023-12-17T11:48:31.194 DEBUG:teuthology.orchestra.run.smithi040:> assert(len(files) == 1) 2023-12-17T11:48:31.194 DEBUG:teuthology.orchestra.run.smithi040:> return files[0] 2023-12-17T11:48:31.194 DEBUG:teuthology.orchestra.run.smithi040:> 2023-12-17T11:48:31.194 DEBUG:teuthology.orchestra.run.smithi040:> for f in files: 2023-12-17T11:48:31.194 DEBUG:teuthology.orchestra.run.smithi040:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-12-17T11:48:31.194 DEBUG:teuthology.orchestra.run.smithi040:> if os.path.exists("/proc/{0}".format(pid)): 2023-12-17T11:48:31.194 DEBUG:teuthology.orchestra.run.smithi040:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-12-17T11:48:31.194 DEBUG:teuthology.orchestra.run.smithi040:> contents = proc_f.read() 2023-12-17T11:48:31.194 DEBUG:teuthology.orchestra.run.smithi040:> if mountpoint in contents: 2023-12-17T11:48:31.194 DEBUG:teuthology.orchestra.run.smithi040:> return f 2023-12-17T11:48:31.194 DEBUG:teuthology.orchestra.run.smithi040:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-12-17T11:48:31.195 DEBUG:teuthology.orchestra.run.smithi040:> 2023-12-17T11:48:31.195 DEBUG:teuthology.orchestra.run.smithi040:> print(_find_admin_socket("client.admin")) 2023-12-17T11:48:31.195 DEBUG:teuthology.orchestra.run.smithi040:> ' 2023-12-17T11:48:31.375 INFO:teuthology.orchestra.run.smithi040.stdout:/var/run/ceph/ceph-client.admin.95122.asok 2023-12-17T11:48:31.379 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:31 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-12-17T11:48:31.428 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.admin.95122.asok 2023-12-17T11:48:31.428 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-17T11:48:31.428 DEBUG:teuthology.orchestra.run.smithi040:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.admin.95122.asok status 2023-12-17T11:48:31.679 INFO:teuthology.orchestra.run.smithi040.stdout:{ 2023-12-17T11:48:31.679 INFO:teuthology.orchestra.run.smithi040.stdout: "metadata": { 2023-12-17T11:48:31.680 INFO:teuthology.orchestra.run.smithi040.stdout: "ceph_sha1": "a62fda73efba5520d409bb5a21bd8373289dda5d", 2023-12-17T11:48:31.680 INFO:teuthology.orchestra.run.smithi040.stdout: "ceph_version": "ceph version 19.0.0-119-ga62fda73 (a62fda73efba5520d409bb5a21bd8373289dda5d) reef (dev)", 2023-12-17T11:48:31.680 INFO:teuthology.orchestra.run.smithi040.stdout: "entity_id": "admin", 2023-12-17T11:48:31.680 INFO:teuthology.orchestra.run.smithi040.stdout: "hostname": "smithi040", 2023-12-17T11:48:31.680 INFO:teuthology.orchestra.run.smithi040.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.admin", 2023-12-17T11:48:31.680 INFO:teuthology.orchestra.run.smithi040.stdout: "pid": "95122", 2023-12-17T11:48:31.680 INFO:teuthology.orchestra.run.smithi040.stdout: "root": "/" 2023-12-17T11:48:31.680 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2023-12-17T11:48:31.680 INFO:teuthology.orchestra.run.smithi040.stdout: "dentry_count": 0, 2023-12-17T11:48:31.680 INFO:teuthology.orchestra.run.smithi040.stdout: "dentry_pinned_count": 0, 2023-12-17T11:48:31.680 INFO:teuthology.orchestra.run.smithi040.stdout: "id": 4428, 2023-12-17T11:48:31.680 INFO:teuthology.orchestra.run.smithi040.stdout: "inst": { 2023-12-17T11:48:31.680 INFO:teuthology.orchestra.run.smithi040.stdout: "name": { 2023-12-17T11:48:31.681 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "client", 2023-12-17T11:48:31.681 INFO:teuthology.orchestra.run.smithi040.stdout: "num": 4428 2023-12-17T11:48:31.681 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2023-12-17T11:48:31.681 INFO:teuthology.orchestra.run.smithi040.stdout: "addr": { 2023-12-17T11:48:31.681 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "v1", 2023-12-17T11:48:31.681 INFO:teuthology.orchestra.run.smithi040.stdout: "addr": "192.168.0.1:0", 2023-12-17T11:48:31.681 INFO:teuthology.orchestra.run.smithi040.stdout: "nonce": 2052818769 2023-12-17T11:48:31.681 INFO:teuthology.orchestra.run.smithi040.stdout: } 2023-12-17T11:48:31.681 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2023-12-17T11:48:31.681 INFO:teuthology.orchestra.run.smithi040.stdout: "addr": { 2023-12-17T11:48:31.681 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "v1", 2023-12-17T11:48:31.681 INFO:teuthology.orchestra.run.smithi040.stdout: "addr": "192.168.0.1:0", 2023-12-17T11:48:31.681 INFO:teuthology.orchestra.run.smithi040.stdout: "nonce": 2052818769 2023-12-17T11:48:31.681 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2023-12-17T11:48:31.682 INFO:teuthology.orchestra.run.smithi040.stdout: "inst_str": "client.4428 192.168.0.1:0/2052818769", 2023-12-17T11:48:31.682 INFO:teuthology.orchestra.run.smithi040.stdout: "addr_str": "192.168.0.1:0/2052818769", 2023-12-17T11:48:31.682 INFO:teuthology.orchestra.run.smithi040.stdout: "inode_count": 1, 2023-12-17T11:48:31.682 INFO:teuthology.orchestra.run.smithi040.stdout: "mds_epoch": 6, 2023-12-17T11:48:31.682 INFO:teuthology.orchestra.run.smithi040.stdout: "osd_epoch": 25, 2023-12-17T11:48:31.682 INFO:teuthology.orchestra.run.smithi040.stdout: "osd_epoch_barrier": 0, 2023-12-17T11:48:31.682 INFO:teuthology.orchestra.run.smithi040.stdout: "blocklisted": false, 2023-12-17T11:48:31.682 INFO:teuthology.orchestra.run.smithi040.stdout: "fs_name": "cephfs" 2023-12-17T11:48:31.682 INFO:teuthology.orchestra.run.smithi040.stdout:} 2023-12-17T11:48:31.695 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-17T11:48:31.696 DEBUG:teuthology.orchestra.run.smithi040:> stat --file-system '--printf=%T 2023-12-17T11:48:31.696 DEBUG:teuthology.orchestra.run.smithi040:> ' -- /home/ubuntu/cephtest/mnt.admin 2023-12-17T11:48:31.758 INFO:teuthology.orchestra.run.smithi040.stdout:fuseblk 2023-12-17T11:48:31.758 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.admin 2023-12-17T11:48:31.758 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-17T11:48:31.758 DEBUG:teuthology.orchestra.run.smithi040:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.admin 2023-12-17T11:48:31.861 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-17T11:48:31.861 DEBUG:teuthology.orchestra.run.smithi040:> (cd /home/ubuntu/cephtest/mnt.admin && exec bash -c 'setfattr -n ceph.dir.layout.pool -v cephfs_data_ec . && getfattr -n ceph.dir.layout .') 2023-12-17T11:48:31.956 INFO:teuthology.orchestra.run.smithi040.stdout:# file: . 2023-12-17T11:48:31.956 INFO:teuthology.orchestra.run.smithi040.stdout:ceph.dir.layout="stripe_unit=4194304 stripe_count=1 object_size=4194304 pool=cephfs_data_ec" 2023-12-17T11:48:31.956 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T11:48:31.958 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2023-12-17T11:48:31.958 DEBUG:teuthology.orchestra.run.smithi040:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-17T11:48:32.017 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-17T11:48:32.237 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:32.234+0000 7f3175f16640 1 Processor -- start 2023-12-17T11:48:32.237 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:32.235+0000 7f3175f16640 1 -- start start 2023-12-17T11:48:32.238 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:32.236+0000 7f3175f16640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f31700d13c0 0x7f31700ce5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:32.238 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:32.236+0000 7f3175f16640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f31700b0760 0x7f31700b0bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:32.239 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:32.236+0000 7f3175f16640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31700b2280 con 0x7f31700d0d70 2023-12-17T11:48:32.239 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:32.236+0000 7f3175f16640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31700cee70 con 0x7f31700d13c0 2023-12-17T11:48:32.239 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:32.236+0000 7f3175f16640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31700d11c0 con 0x7f31700b0760 2023-12-17T11:48:32.239 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:32.237+0000 7f316ffff640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f31700d0d70 0x7f31700d17a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:49422/0 (socket says 172.21.15.40:49422) 2023-12-17T11:48:32.239 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:32.237+0000 7f316ffff640 1 -- 172.21.15.40:0/1932937305 learned_addr learned my addr 172.21.15.40:0/1932937305 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-12-17T11:48:32.241 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:32.237+0000 7f3174f14640 1 --2- 172.21.15.40:0/1932937305 >> v2:172.21.15.159:3300/0 conn(0x7f31700d13c0 0x7f31700ce5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:32.241 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:32.237+0000 7f3175715640 1 --2- 172.21.15.40:0/1932937305 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f31700b0760 0x7f31700b0bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:32.241 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:32.237+0000 7f316f7fe640 1 -- 172.21.15.40:0/1932937305 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3114303023 0 0) 0x7f31700b2280 con 0x7f31700d0d70 2023-12-17T11:48:32.241 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:32.237+0000 7f316f7fe640 1 -- 172.21.15.40:0/1932937305 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3160003520 con 0x7f31700d0d70 2023-12-17T11:48:32.241 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:32.238+0000 7f316f7fe640 1 -- 172.21.15.40:0/1932937305 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3577096220 0 0) 0x7f3160003520 con 0x7f31700d0d70 2023-12-17T11:48:32.241 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:32.238+0000 7f316f7fe640 1 -- 172.21.15.40:0/1932937305 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f31700b0760 msgr2=0x7f31700b0bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:48:32.241 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:32.238+0000 7f316f7fe640 1 --2- 172.21.15.40:0/1932937305 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f31700b0760 0x7f31700b0bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:32.241 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:32.238+0000 7f316f7fe640 1 -- 172.21.15.40:0/1932937305 >> v2:172.21.15.159:3300/0 conn(0x7f31700d13c0 msgr2=0x7f31700ce5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:48:32.242 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:32.238+0000 7f316f7fe640 1 --2- 172.21.15.40:0/1932937305 >> v2:172.21.15.159:3300/0 conn(0x7f31700d13c0 0x7f31700ce5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:32.242 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:32.238+0000 7f316f7fe640 1 -- 172.21.15.40:0/1932937305 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31700ceb90 con 0x7f31700d0d70 2023-12-17T11:48:32.242 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:32.238+0000 7f316f7fe640 1 -- 172.21.15.40:0/1932937305 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2643242555 0 0) 0x7f315c001670 con 0x7f31700d0d70 2023-12-17T11:48:32.242 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:32.238+0000 7f316f7fe640 1 -- 172.21.15.40:0/1932937305 >> v1:172.21.15.40:6789/0 conn(0x7f31700d0d70 legacy=0x7f31700d17a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:32.242 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:32.238+0000 7f316f7fe640 1 --2- 172.21.15.40:0/1932937305 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3160003970 0x7f3160003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:32.242 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:32.238+0000 7f316f7fe640 1 --2- 172.21.15.40:0/1932937305 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f31600047c0 0x7f3160004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:32.242 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:32.238+0000 7f316f7fe640 1 --2- 172.21.15.40:0/1932937305 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f31700b0760 0x7f3160005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:32.242 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:32.238+0000 7f316f7fe640 1 -- 172.21.15.40:0/1932937305 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31700cee70 con 0x7f31600047c0 2023-12-17T11:48:32.242 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:32.238+0000 7f316f7fe640 1 -- 172.21.15.40:0/1932937305 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31700d11c0 con 0x7f3160003970 2023-12-17T11:48:32.242 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:32.238+0000 7f316f7fe640 1 -- 172.21.15.40:0/1932937305 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f316000b9d0 con 0x7f31700b0760 2023-12-17T11:48:32.242 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:32.238+0000 7f316ffff640 1 --2- 172.21.15.40:0/1932937305 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f31600047c0 0x7f3160004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:32.243 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:32.238+0000 7f3175715640 1 --2- 172.21.15.40:0/1932937305 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f31700b0760 0x7f3160005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:32.243 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:32.238+0000 7f3174f14640 1 --2- 172.21.15.40:0/1932937305 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3160003970 0x7f3160003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:32.243 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:32.239+0000 7f316ffff640 1 -- 172.21.15.40:0/1932937305 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f31700b0760 msgr2=0x7f3160005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:48:32.243 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:32.239+0000 7f316ffff640 1 --2- 172.21.15.40:0/1932937305 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f31700b0760 0x7f3160005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:32.243 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:32.239+0000 7f316ffff640 1 -- 172.21.15.40:0/1932937305 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3160003970 msgr2=0x7f3160003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:48:32.243 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:32.239+0000 7f316ffff640 1 --2- 172.21.15.40:0/1932937305 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3160003970 0x7f3160003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:32.243 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:32.239+0000 7f316ffff640 1 -- 172.21.15.40:0/1932937305 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3160003520 con 0x7f31600047c0 2023-12-17T11:48:32.245 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:32.240+0000 7f316ffff640 1 --2- 172.21.15.40:0/1932937305 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f31600047c0 0x7f3160004c40 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f315c00c1c0 tx=0x7f31600057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81e49c7e082c0734 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:48:32.245 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:32.240+0000 7f316f7fe640 1 -- 172.21.15.40:0/1932937305 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f315c005ad0 con 0x7f31600047c0 2023-12-17T11:48:32.245 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:32.240+0000 7f316f7fe640 1 -- 172.21.15.40:0/1932937305 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f315c005c50 con 0x7f31600047c0 2023-12-17T11:48:32.245 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:32.240+0000 7f316f7fe640 1 -- 172.21.15.40:0/1932937305 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f315c02c810 con 0x7f31600047c0 2023-12-17T11:48:32.245 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:32.241+0000 7f3175f16640 1 -- 172.21.15.40:0/1932937305 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f31600047c0 msgr2=0x7f3160004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:32.245 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:32.241+0000 7f3175f16640 1 --2- 172.21.15.40:0/1932937305 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f31600047c0 0x7f3160004c40 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f315c00c1c0 tx=0x7f31600057f0 comp rx=0 tx=0).stop 2023-12-17T11:48:32.245 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:32.241+0000 7f3175715640 1 -- 172.21.15.40:0/1932937305 reap_dead start 2023-12-17T11:48:32.246 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:32.241+0000 7f3175f16640 1 -- 172.21.15.40:0/1932937305 shutdown_connections 2023-12-17T11:48:32.246 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:32.241+0000 7f3175f16640 1 -- 172.21.15.40:0/1932937305 >> 172.21.15.40:0/1932937305 conn(0x7f317009c260 msgr2=0x7f31700d2f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:48:32.246 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:32.241+0000 7f3175f16640 1 -- 172.21.15.40:0/1932937305 shutdown_connections 2023-12-17T11:48:32.246 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:32.241+0000 7f3175f16640 1 -- 172.21.15.40:0/1932937305 wait complete. 2023-12-17T11:48:32.246 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:32.243+0000 7f3175f16640 1 Processor -- start 2023-12-17T11:48:32.246 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:32.243+0000 7f3175f16640 1 -- start start 2023-12-17T11:48:32.248 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:32.244+0000 7f3175f16640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f31600047c0 0x7f31700d2f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:32.248 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:32.244+0000 7f3175f16640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f31700d34d0 0x7f317014f640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:32.248 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:32.244+0000 7f3175f16640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f317014fb80 0x7f317014ffe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:32.248 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:32.244+0000 7f3175f16640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f317009d330 con 0x7f31700d34d0 2023-12-17T11:48:32.248 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:32.244+0000 7f3175f16640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31700d3910 con 0x7f317014fb80 2023-12-17T11:48:32.248 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:32.244+0000 7f3175f16640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f317014d110 con 0x7f31600047c0 2023-12-17T11:48:32.248 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:32.244+0000 7f316ffff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f31700d34d0 0x7f317014f640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:32.248 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:32.244+0000 7f316ffff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f31700d34d0 0x7f317014f640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:40820/0 (socket says 172.21.15.40:40820) 2023-12-17T11:48:32.248 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:32.244+0000 7f316ffff640 1 -- 172.21.15.40:0/1178645766 learned_addr learned my addr 172.21.15.40:0/1178645766 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-17T11:48:32.248 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:32.245+0000 7f3174f14640 1 --2- 172.21.15.40:0/1178645766 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f31600047c0 0x7f31700d2f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:32.248 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:32.245+0000 7f3175715640 1 --2- 172.21.15.40:0/1178645766 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f317014fb80 0x7f317014ffe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:32.249 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:32.245+0000 7f316ffff640 1 -- 172.21.15.40:0/1178645766 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f31600047c0 msgr2=0x7f31700d2f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:32.249 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:32.245+0000 7f316ffff640 1 --2- 172.21.15.40:0/1178645766 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f31600047c0 0x7f31700d2f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:32.249 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:32.245+0000 7f316ffff640 1 -- 172.21.15.40:0/1178645766 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f317014fb80 msgr2=0x7f317014ffe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:32.249 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:32.245+0000 7f316ffff640 1 --2- 172.21.15.40:0/1178645766 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f317014fb80 0x7f317014ffe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:32.249 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:32.245+0000 7f316ffff640 1 -- 172.21.15.40:0/1178645766 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f317009e750 con 0x7f31700d34d0 2023-12-17T11:48:32.249 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:32.245+0000 7f316ffff640 1 --2- 172.21.15.40:0/1178645766 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f31700d34d0 0x7f317014f640 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f315c00c1c0 tx=0x7f317009c670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:48:32.249 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:32.245+0000 7f316d7fa640 1 -- 172.21.15.40:0/1178645766 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f315c039070 con 0x7f31700d34d0 2023-12-17T11:48:32.249 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:32.245+0000 7f316d7fa640 1 -- 172.21.15.40:0/1178645766 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f315c02cc20 con 0x7f31700d34d0 2023-12-17T11:48:32.249 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:32.245+0000 7f316d7fa640 1 -- 172.21.15.40:0/1178645766 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f315c03c040 con 0x7f31700d34d0 2023-12-17T11:48:32.249 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:32.246+0000 7f3175f16640 1 -- 172.21.15.40:0/1178645766 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f317009d050 con 0x7f31700d34d0 2023-12-17T11:48:32.249 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:32.246+0000 7f3175f16640 1 -- 172.21.15.40:0/1178645766 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f317014d850 con 0x7f31700d34d0 2023-12-17T11:48:32.250 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:32.247+0000 7f3175f16640 1 -- 172.21.15.40:0/1178645766 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3170074450 con 0x7f31700d34d0 2023-12-17T11:48:32.250 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:32.248+0000 7f316d7fa640 1 -- 172.21.15.40:0/1178645766 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f315c032070 con 0x7f31700d34d0 2023-12-17T11:48:32.251 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:32.249+0000 7f316d7fa640 1 --2- 172.21.15.40:0/1178645766 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f315406ae70 0x7f315406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:32.251 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:32.249+0000 7f316d7fa640 1 -- 172.21.15.40:0/1178645766 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f315c0aace0 con 0x7f31700d34d0 2023-12-17T11:48:32.251 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:32.250+0000 7f3174f14640 1 --2- 172.21.15.40:0/1178645766 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f315406ae70 0x7f315406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:32.252 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:32.251+0000 7f3174f14640 1 --2- 172.21.15.40:0/1178645766 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f315406ae70 0x7f315406d330 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f3164009a10 tx=0x7f3164008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:48:32.255 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:32.254+0000 7f316d7fa640 1 -- 172.21.15.40:0/1178645766 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f315c075970 con 0x7f31700d34d0 2023-12-17T11:48:32.450 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:32.448+0000 7f3175f16640 1 -- 172.21.15.40:0/1178645766 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f31700d2d70 con 0x7f31700d34d0 2023-12-17T11:48:32.452 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:32.450+0000 7f316d7fa640 1 -- 172.21.15.40:0/1178645766 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18322 (secure 0 0 0) 0x7f315c078f90 con 0x7f31700d34d0 2023-12-17T11:48:32.453 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T11:48:32.453 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":25,"fsid":"099cd35d-80d9-4ca4-8424-de13b3b03ac7","created":"2023-12-17T11:47:53.450097+0000","modified":"2023-12-17T11:48:22.971195+0000","last_up_change":"2023-12-17T11:48:05.724195+0000","last_in_change":"2023-12-17T11:47:56.956499+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-17T11:48:06.668943+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-17T11:48:16.151444+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-17T11:48:16.717726+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-17T11:48:20.534819+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a88bfd46-63b8-48b1-9c0e-5c9cdc31bd38","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":555204741},{"type":"v1","addr":"172.21.15.40:6802","nonce":555204741}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":555204741},{"type":"v1","addr":"172.21.15.40:6807","nonce":555204741}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":555204741},{"type":"v1","addr":"172.21.15.40:6815","nonce":555204741}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6809","nonce":555204741},{"type":"v1","addr":"172.21.15.40:6812","nonce":555204741}]},"public_addr":"172.21.15.40:6802/555204741","cluster_addr":"172.21.15.40:6807/555204741","heartbeat_back_addr":"172.21.15.40:6815/555204741","heartbeat_front_addr":"172.21.15.40:6812/555204741","state":["exists","up"]},{"osd":1,"uuid":"c5d628ae-36f4-4866-802c-b162f0e90add","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6801","nonce":1221318112},{"type":"v1","addr":"172.21.15.40:6803","nonce":1221318112}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6805","nonce":1221318112},{"type":"v1","addr":"172.21.15.40:6806","nonce":1221318112}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6811","nonce":1221318112},{"type":"v1","addr":"172.21.15.40:6813","nonce":1221318112}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":1221318112},{"type":"v1","addr":"172.21.15.40:6810","nonce":1221318112}]},"public_addr":"172.21.15.40:6803/1221318112","cluster_addr":"172.21.15.40:6806/1221318112","heartbeat_back_addr":"172.21.15.40:6813/1221318112","heartbeat_front_addr":"172.21.15.40:6810/1221318112","state":["exists","up"]},{"osd":2,"uuid":"d986ad6a-af2f-47fc-9c3b-fbda27b82b73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":1959000265},{"type":"v1","addr":"172.21.15.40:6817","nonce":1959000265}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6818","nonce":1959000265},{"type":"v1","addr":"172.21.15.40:6819","nonce":1959000265}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":1959000265},{"type":"v1","addr":"172.21.15.40:6827","nonce":1959000265}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":1959000265},{"type":"v1","addr":"172.21.15.40:6822","nonce":1959000265}]},"public_addr":"172.21.15.40:6817/1959000265","cluster_addr":"172.21.15.40:6819/1959000265","heartbeat_back_addr":"172.21.15.40:6827/1959000265","heartbeat_front_addr":"172.21.15.40:6822/1959000265","state":["exists","up"]},{"osd":3,"uuid":"d79d22b7-be05-41b2-b95d-697db677fd02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6821","nonce":974040287},{"type":"v1","addr":"172.21.15.40:6823","nonce":974040287}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6825","nonce":974040287},{"type":"v1","addr":"172.21.15.40:6826","nonce":974040287}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":974040287},{"type":"v1","addr":"172.21.15.40:6831","nonce":974040287}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":974040287},{"type":"v1","addr":"172.21.15.40:6829","nonce":974040287}]},"public_addr":"172.21.15.40:6823/974040287","cluster_addr":"172.21.15.40:6826/974040287","heartbeat_back_addr":"172.21.15.40:6831/974040287","heartbeat_front_addr":"172.21.15.40:6829/974040287","state":["exists","up"]},{"osd":4,"uuid":"62a7a233-d3ea-40be-91de-180c0208d639","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6808","nonce":3937787733},{"type":"v1","addr":"172.21.15.159:6809","nonce":3937787733}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6810","nonce":3937787733},{"type":"v1","addr":"172.21.15.159:6811","nonce":3937787733}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6814","nonce":3937787733},{"type":"v1","addr":"172.21.15.159:6815","nonce":3937787733}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6812","nonce":3937787733},{"type":"v1","addr":"172.21.15.159:6813","nonce":3937787733}]},"public_addr":"172.21.15.159:6809/3937787733","cluster_addr":"172.21.15.159:6811/3937787733","heartbeat_back_addr":"172.21.15.159:6815/3937787733","heartbeat_front_addr":"172.21.15.159:6813/3937787733","state":["exists","up"]},{"osd":5,"uuid":"84629cea-dc0e-4b5e-b203-5ea963839281","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6816","nonce":3032505240},{"type":"v1","addr":"172.21.15.159:6817","nonce":3032505240}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6818","nonce":3032505240},{"type":"v1","addr":"172.21.15.159:6819","nonce":3032505240}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6822","nonce":3032505240},{"type":"v1","addr":"172.21.15.159:6823","nonce":3032505240}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6820","nonce":3032505240},{"type":"v1","addr":"172.21.15.159:6821","nonce":3032505240}]},"public_addr":"172.21.15.159:6817/3032505240","cluster_addr":"172.21.15.159:6819/3032505240","heartbeat_back_addr":"172.21.15.159:6823/3032505240","heartbeat_front_addr":"172.21.15.159:6821/3032505240","state":["exists","up"]},{"osd":6,"uuid":"4ae3af3a-1743-4070-a91d-8be5c31cdb04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6800","nonce":2411788597},{"type":"v1","addr":"172.21.15.159:6801","nonce":2411788597}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6802","nonce":2411788597},{"type":"v1","addr":"172.21.15.159:6803","nonce":2411788597}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6806","nonce":2411788597},{"type":"v1","addr":"172.21.15.159:6807","nonce":2411788597}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6804","nonce":2411788597},{"type":"v1","addr":"172.21.15.159:6805","nonce":2411788597}]},"public_addr":"172.21.15.159:6801/2411788597","cluster_addr":"172.21.15.159:6803/2411788597","heartbeat_back_addr":"172.21.15.159:6807/2411788597","heartbeat_front_addr":"172.21.15.159:6805/2411788597","state":["exists","up"]},{"osd":7,"uuid":"c1f4c7f2-8f75-4f95-bc63-a332773e3b8e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6824","nonce":478953349},{"type":"v1","addr":"172.21.15.159:6825","nonce":478953349}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6826","nonce":478953349},{"type":"v1","addr":"172.21.15.159:6827","nonce":478953349}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6830","nonce":478953349},{"type":"v1","addr":"172.21.15.159:6831","nonce":478953349}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6828","nonce":478953349},{"type":"v1","addr":"172.21.15.159:6829","nonce":478953349}]},"public_addr":"172.21.15.159:6825/478953349","cluster_addr":"172.21.15.159:6827/478953349","heartbeat_back_addr":"172.21.15.159:6831/478953349","heartbeat_front_addr":"172.21.15.159:6829/478953349","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T11:48:02.023567+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T11:48:02.278216+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T11:48:02.311843+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T11:48:01.773372+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T11:48:02.618910+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T11:48:02.361559+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T11:48:02.223997+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T11:48:02.604403+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-17T11:48:32.456 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:32.453+0000 7f3175f16640 1 -- 172.21.15.40:0/1178645766 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f315406ae70 msgr2=0x7f315406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:32.456 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:32.453+0000 7f3175f16640 1 --2- 172.21.15.40:0/1178645766 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f315406ae70 0x7f315406d330 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f3164009a10 tx=0x7f3164008040 comp rx=0 tx=0).stop 2023-12-17T11:48:32.456 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:32.453+0000 7f3175f16640 1 -- 172.21.15.40:0/1178645766 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f31700d34d0 msgr2=0x7f317014f640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:32.456 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:32.453+0000 7f3175f16640 1 --2- 172.21.15.40:0/1178645766 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f31700d34d0 0x7f317014f640 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f315c00c1c0 tx=0x7f317009c670 comp rx=0 tx=0).stop 2023-12-17T11:48:32.456 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:32.454+0000 7f3175f16640 1 -- 172.21.15.40:0/1178645766 shutdown_connections 2023-12-17T11:48:32.456 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:32.454+0000 7f3175f16640 1 --2- 172.21.15.40:0/1178645766 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f315406ae70 0x7f315406d330 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:32.456 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:32.454+0000 7f3175f16640 1 --2- 172.21.15.40:0/1178645766 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f317014fb80 0x7f317014ffe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:32.456 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:32.454+0000 7f3175f16640 1 --2- 172.21.15.40:0/1178645766 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f31700d34d0 0x7f317014f640 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:32.456 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:32.454+0000 7f3175f16640 1 --2- 172.21.15.40:0/1178645766 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f31600047c0 0x7f31700d2f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:32.456 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:32.454+0000 7f3175f16640 1 -- 172.21.15.40:0/1178645766 >> 172.21.15.40:0/1178645766 conn(0x7f317009c260 msgr2=0x7f31700b7510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:48:32.456 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:32.454+0000 7f3175f16640 1 -- 172.21.15.40:0/1178645766 shutdown_connections 2023-12-17T11:48:32.457 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:32.454+0000 7f3175f16640 1 -- 172.21.15.40:0/1178645766 wait complete. 2023-12-17T11:48:32.476 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-17T11:48:06.668943+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-17T11:48:16.151444+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-17T11:48:16.717726+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-12-17T11:48:20.534819+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-12-17T11:48:32.476 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-17T11:48:32.704 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:32.702+0000 7f9fab59e640 1 Processor -- start 2023-12-17T11:48:32.705 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:32.703+0000 7f9fab59e640 1 -- start start 2023-12-17T11:48:32.706 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:32.704+0000 7f9fab59e640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9fa40b3730 0x7f9fa40cf760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:32.706 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:32.704+0000 7f9fab59e640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f9fa40cfca0 0x7f9fa40cdef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:32.706 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:32.704+0000 7f9fab59e640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9fa40c6b80 con 0x7f9fa40b3350 2023-12-17T11:48:32.706 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:32.704+0000 7f9fab59e640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9fa40d0110 con 0x7f9fa40cfca0 2023-12-17T11:48:32.706 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:32.704+0000 7f9fab59e640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9fa40d3bf0 con 0x7f9fa40b3730 2023-12-17T11:48:32.706 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:32.704+0000 7f9faad9d640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f9fa40cfca0 0x7f9fa40cdef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:32.707 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:32.704+0000 7f9faad9d640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f9fa40cfca0 0x7f9fa40cdef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:40830/0 (socket says 172.21.15.40:40830) 2023-12-17T11:48:32.707 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:32.704+0000 7f9faad9d640 1 -- 172.21.15.40:0/2425281370 learned_addr learned my addr 172.21.15.40:0/2425281370 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-17T11:48:32.707 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:32.704+0000 7f9fa9d9b640 1 --2- 172.21.15.40:0/2425281370 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9fa40b3730 0x7f9fa40cf760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:32.707 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:32.705+0000 7f9faad9d640 1 -- 172.21.15.40:0/2425281370 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9fa40b3730 msgr2=0x7f9fa40cf760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:48:32.707 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:32.705+0000 7f9faad9d640 1 --2- 172.21.15.40:0/2425281370 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9fa40b3730 0x7f9fa40cf760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:32.708 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:32.705+0000 7f9faad9d640 1 -- 172.21.15.40:0/2425281370 >> v1:172.21.15.159:6789/0 conn(0x7f9fa40b3350 legacy=0x7f9fa40b3ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:48:32.708 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:32.705+0000 7f9faad9d640 1 -- 172.21.15.40:0/2425281370 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fa40d3ed0 con 0x7f9fa40cfca0 2023-12-17T11:48:32.708 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:32.706+0000 7f9faad9d640 1 --2- 172.21.15.40:0/2425281370 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9fa40cfca0 0x7f9fa40cdef0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f9fa0009870 tx=0x7f9fa002b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ecb7a86e686de0a server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:48:32.708 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:32.706+0000 7f9fa959a640 1 -- 172.21.15.40:0/2425281370 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fa0031640 con 0x7f9fa40cfca0 2023-12-17T11:48:32.708 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:32.706+0000 7f9fa959a640 1 -- 172.21.15.40:0/2425281370 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fa00317a0 con 0x7f9fa40cfca0 2023-12-17T11:48:32.709 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:32.706+0000 7f9fa959a640 1 -- 172.21.15.40:0/2425281370 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fa0031b30 con 0x7f9fa40cfca0 2023-12-17T11:48:32.709 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:32.707+0000 7f9fab59e640 1 -- 172.21.15.40:0/2425281370 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9fa40cfca0 msgr2=0x7f9fa40cdef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:32.709 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:32.707+0000 7f9fab59e640 1 --2- 172.21.15.40:0/2425281370 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9fa40cfca0 0x7f9fa40cdef0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f9fa0009870 tx=0x7f9fa002b8f0 comp rx=0 tx=0).stop 2023-12-17T11:48:32.709 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:32.707+0000 7f9fab59e640 1 -- 172.21.15.40:0/2425281370 shutdown_connections 2023-12-17T11:48:32.709 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:32.707+0000 7f9fab59e640 1 --2- 172.21.15.40:0/2425281370 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9fa40cfca0 0x7f9fa40cdef0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:32.710 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:32.707+0000 7f9fab59e640 1 --2- 172.21.15.40:0/2425281370 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9fa40b3730 0x7f9fa40cf760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:32.710 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:32.707+0000 7f9fab59e640 1 -- 172.21.15.40:0/2425281370 >> 172.21.15.40:0/2425281370 conn(0x7f9fa40d3030 msgr2=0x7f9fa40d3440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:48:32.710 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:32.707+0000 7f9fab59e640 1 -- 172.21.15.40:0/2425281370 shutdown_connections 2023-12-17T11:48:32.710 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:32.707+0000 7f9fab59e640 1 -- 172.21.15.40:0/2425281370 wait complete. 2023-12-17T11:48:32.711 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:32.709+0000 7f9fab59e640 1 Processor -- start 2023-12-17T11:48:32.711 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:32.709+0000 7f9fab59e640 1 -- start start 2023-12-17T11:48:32.713 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:32.710+0000 7f9fab59e640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9fa40b3350 0x7f9fa4159950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:32.713 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:32.710+0000 7f9fab59e640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9fa40b3730 0x7f9fa40b07e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:32.713 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:32.710+0000 7f9fab59e640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9fa40cfca0 0x7f9fa40cc3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:32.713 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:32.710+0000 7f9fab59e640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fa40ca100 con 0x7f9fa40b3350 2023-12-17T11:48:32.713 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:32.710+0000 7f9fab59e640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fa40cac80 con 0x7f9fa40b3730 2023-12-17T11:48:32.713 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:32.710+0000 7f9fab59e640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9fa40ca350 con 0x7f9fa40cfca0 2023-12-17T11:48:32.713 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:32.710+0000 7f9faa59c640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9fa40b3350 0x7f9fa4159950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:32.713 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:32.710+0000 7f9faa59c640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9fa40b3350 0x7f9fa4159950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:40846/0 (socket says 172.21.15.40:40846) 2023-12-17T11:48:32.713 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:32.710+0000 7f9faa59c640 1 -- 172.21.15.40:0/3959528876 learned_addr learned my addr 172.21.15.40:0/3959528876 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-17T11:48:32.713 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:32.711+0000 7f9fa9d9b640 1 --2- 172.21.15.40:0/3959528876 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9fa40b3730 0x7f9fa40b07e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:32.713 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:32.711+0000 7f9faad9d640 1 --2- 172.21.15.40:0/3959528876 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9fa40cfca0 0x7f9fa40cc3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:32.713 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:32.711+0000 7f9faa59c640 1 -- 172.21.15.40:0/3959528876 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9fa40cfca0 msgr2=0x7f9fa40cc3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:32.714 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:32.711+0000 7f9faa59c640 1 --2- 172.21.15.40:0/3959528876 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9fa40cfca0 0x7f9fa40cc3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:32.714 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:32.711+0000 7f9faa59c640 1 -- 172.21.15.40:0/3959528876 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9fa40b3730 msgr2=0x7f9fa40b07e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:32.714 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:32.711+0000 7f9faa59c640 1 --2- 172.21.15.40:0/3959528876 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9fa40b3730 0x7f9fa40b07e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:32.714 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:32.711+0000 7f9faa59c640 1 -- 172.21.15.40:0/3959528876 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fa00094d0 con 0x7f9fa40b3350 2023-12-17T11:48:32.715 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:32.711+0000 7f9faa59c640 1 --2- 172.21.15.40:0/3959528876 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9fa40b3350 0x7f9fa4159950 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f9f9c00ba80 tx=0x7f9f9c00bf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:48:32.715 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:32.711+0000 7f9f9affd640 1 -- 172.21.15.40:0/3959528876 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f9c00cc00 con 0x7f9fa40b3350 2023-12-17T11:48:32.715 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:32.711+0000 7f9f9affd640 1 -- 172.21.15.40:0/3959528876 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f9c00cd60 con 0x7f9fa40b3350 2023-12-17T11:48:32.715 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:32.712+0000 7f9f9affd640 1 -- 172.21.15.40:0/3959528876 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f9c003bb0 con 0x7f9fa40b3350 2023-12-17T11:48:32.715 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:32.712+0000 7f9fab59e640 1 -- 172.21.15.40:0/3959528876 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9fa40ca630 con 0x7f9fa40b3350 2023-12-17T11:48:32.715 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:32.712+0000 7f9fab59e640 1 -- 172.21.15.40:0/3959528876 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9fa4159e90 con 0x7f9fa40b3350 2023-12-17T11:48:32.715 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:32.713+0000 7f9fab59e640 1 -- 172.21.15.40:0/3959528876 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9fa4074450 con 0x7f9fa40b3350 2023-12-17T11:48:32.716 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:32.714+0000 7f9f9affd640 1 -- 172.21.15.40:0/3959528876 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f9f9c014440 con 0x7f9fa40b3350 2023-12-17T11:48:32.717 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:32.715+0000 7f9f9affd640 1 --2- 172.21.15.40:0/3959528876 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f9f8806ae40 0x7f9f8806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:32.717 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:32.715+0000 7f9f9affd640 1 -- 172.21.15.40:0/3959528876 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f9f9c0897c0 con 0x7f9fa40b3350 2023-12-17T11:48:32.718 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:32.716+0000 7f9fa9d9b640 1 --2- 172.21.15.40:0/3959528876 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f9f8806ae40 0x7f9f8806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:32.719 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:32.717+0000 7f9fa9d9b640 1 --2- 172.21.15.40:0/3959528876 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f9f8806ae40 0x7f9f8806d300 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f9fa4161830 tx=0x7f9f94008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:48:32.722 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:32.720+0000 7f9f9affd640 1 -- 172.21.15.40:0/3959528876 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f9f9c0544e0 con 0x7f9fa40b3350 2023-12-17T11:48:32.915 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:32.913+0000 7f9fab59e640 1 -- 172.21.15.40:0/3959528876 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f9fa40cd4f0 con 0x7f9fa40b3350 2023-12-17T11:48:32.915 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:32.914+0000 7f9f9affd640 1 -- 172.21.15.40:0/3959528876 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) v1 ==== 93+0+10 (secure 0 0 0) 0x7f9f9c057b00 con 0x7f9fa40b3350 2023-12-17T11:48:32.916 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 1 2023-12-17T11:48:32.918 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:32.916+0000 7f9fab59e640 1 -- 172.21.15.40:0/3959528876 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f9f8806ae40 msgr2=0x7f9f8806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:32.918 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:32.916+0000 7f9fab59e640 1 --2- 172.21.15.40:0/3959528876 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f9f8806ae40 0x7f9f8806d300 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f9fa4161830 tx=0x7f9f94008040 comp rx=0 tx=0).stop 2023-12-17T11:48:32.919 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:32.916+0000 7f9fab59e640 1 -- 172.21.15.40:0/3959528876 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9fa40b3350 msgr2=0x7f9fa4159950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:32.919 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:32.916+0000 7f9fab59e640 1 --2- 172.21.15.40:0/3959528876 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9fa40b3350 0x7f9fa4159950 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f9f9c00ba80 tx=0x7f9f9c00bf40 comp rx=0 tx=0).stop 2023-12-17T11:48:32.919 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:32.916+0000 7f9fab59e640 1 -- 172.21.15.40:0/3959528876 shutdown_connections 2023-12-17T11:48:32.919 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:32.916+0000 7f9fab59e640 1 --2- 172.21.15.40:0/3959528876 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f9f8806ae40 0x7f9f8806d300 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:32.919 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:32.916+0000 7f9fab59e640 1 --2- 172.21.15.40:0/3959528876 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9fa40cfca0 0x7f9fa40cc3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:32.919 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:32.916+0000 7f9fab59e640 1 --2- 172.21.15.40:0/3959528876 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9fa40b3730 0x7f9fa40b07e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:32.919 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:32.916+0000 7f9fab59e640 1 --2- 172.21.15.40:0/3959528876 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9fa40b3350 0x7f9fa4159950 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:32.919 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:32.916+0000 7f9fab59e640 1 -- 172.21.15.40:0/3959528876 >> 172.21.15.40:0/3959528876 conn(0x7f9fa40d3030 msgr2=0x7f9fa40d3410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:48:32.919 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:32.916+0000 7f9fab59e640 1 -- 172.21.15.40:0/3959528876 shutdown_connections 2023-12-17T11:48:32.919 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:32.917+0000 7f9fab59e640 1 -- 172.21.15.40:0/3959528876 wait complete. 2023-12-17T11:48:32.937 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-17T11:48:33.166 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:33.164+0000 7f5e58361640 1 Processor -- start 2023-12-17T11:48:33.166 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:33.164+0000 7f5e58361640 1 -- start start 2023-12-17T11:48:33.168 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:33.166+0000 7f5e58361640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f5e5015e5d0 0x7f5e5006c510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:33.168 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:33.166+0000 7f5e58361640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f5e500cf7e0 0x7f5e500cfc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:33.169 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:33.166+0000 7f5e58361640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e5006d5e0 con 0x7f5e500b2b90 2023-12-17T11:48:33.169 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:33.166+0000 7f5e58361640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e500cf350 con 0x7f5e500cf7e0 2023-12-17T11:48:33.169 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:33.166+0000 7f5e58361640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e5015ea80 con 0x7f5e5015e5d0 2023-12-17T11:48:33.169 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:33.166+0000 7f5e568fe640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f5e500cf7e0 0x7f5e500cfc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:33.169 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:33.166+0000 7f5e568fe640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f5e500cf7e0 0x7f5e500cfc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:40850/0 (socket says 172.21.15.40:40850) 2023-12-17T11:48:33.169 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:33.166+0000 7f5e568fe640 1 -- 172.21.15.40:0/3216723863 learned_addr learned my addr 172.21.15.40:0/3216723863 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-17T11:48:33.169 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:33.166+0000 7f5e560fd640 1 --1- 172.21.15.40:0/3216723863 >> v1:172.21.15.40:6789/0 conn(0x7f5e500b2b90 0x7f5e500b2f70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:49428/0 (socket says 172.21.15.40:49428) 2023-12-17T11:48:33.169 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:33.167+0000 7f5e558fc640 1 --2- 172.21.15.40:0/3216723863 >> v2:172.21.15.159:3300/0 conn(0x7f5e5015e5d0 0x7f5e5006c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:33.169 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:33.167+0000 7f5e568fe640 1 -- 172.21.15.40:0/3216723863 >> v2:172.21.15.159:3300/0 conn(0x7f5e5015e5d0 msgr2=0x7f5e5006c510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:48:33.170 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:33.167+0000 7f5e568fe640 1 --2- 172.21.15.40:0/3216723863 >> v2:172.21.15.159:3300/0 conn(0x7f5e5015e5d0 0x7f5e5006c510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:33.170 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:33.167+0000 7f5e568fe640 1 -- 172.21.15.40:0/3216723863 >> v1:172.21.15.40:6789/0 conn(0x7f5e500b2b90 legacy=0x7f5e500b2f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:33.170 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:33.167+0000 7f5e568fe640 1 -- 172.21.15.40:0/3216723863 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e50157f30 con 0x7f5e500cf7e0 2023-12-17T11:48:33.170 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:33.167+0000 7f5e550fb640 1 -- 172.21.15.40:0/3216723863 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1854617873 0 0) 0x7f5e4c001110 con 0x7f5e500b2b90 2023-12-17T11:48:33.170 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:33.168+0000 7f5e568fe640 1 --2- 172.21.15.40:0/3216723863 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5e500cf7e0 0x7f5e500cfc70 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f5e500b3cc0 tx=0x7f5e4802bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dea647cf72d3655a server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:48:33.170 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:33.168+0000 7f5e550fb640 1 -- 172.21.15.40:0/3216723863 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e4802cb20 con 0x7f5e500cf7e0 2023-12-17T11:48:33.171 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:33.168+0000 7f5e550fb640 1 -- 172.21.15.40:0/3216723863 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e4802cc80 con 0x7f5e500cf7e0 2023-12-17T11:48:33.171 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:33.168+0000 7f5e550fb640 1 -- 172.21.15.40:0/3216723863 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e480343f0 con 0x7f5e500cf7e0 2023-12-17T11:48:33.171 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:33.169+0000 7f5e58361640 1 -- 172.21.15.40:0/3216723863 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5e500cf7e0 msgr2=0x7f5e500cfc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:33.171 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:33.169+0000 7f5e58361640 1 --2- 172.21.15.40:0/3216723863 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5e500cf7e0 0x7f5e500cfc70 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f5e500b3cc0 tx=0x7f5e4802bf80 comp rx=0 tx=0).stop 2023-12-17T11:48:33.171 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:33.169+0000 7f5e58361640 1 -- 172.21.15.40:0/3216723863 shutdown_connections 2023-12-17T11:48:33.172 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:33.169+0000 7f5e58361640 1 --2- 172.21.15.40:0/3216723863 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5e500cf7e0 0x7f5e500cfc70 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:33.172 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:33.169+0000 7f5e58361640 1 --2- 172.21.15.40:0/3216723863 >> v2:172.21.15.159:3300/0 conn(0x7f5e5015e5d0 0x7f5e5006c510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:33.172 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:33.169+0000 7f5e58361640 1 -- 172.21.15.40:0/3216723863 >> 172.21.15.40:0/3216723863 conn(0x7f5e500b6420 msgr2=0x7f5e500b6800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:48:33.172 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:33.169+0000 7f5e58361640 1 -- 172.21.15.40:0/3216723863 shutdown_connections 2023-12-17T11:48:33.172 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:33.169+0000 7f5e58361640 1 -- 172.21.15.40:0/3216723863 wait complete. 2023-12-17T11:48:33.173 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:33.171+0000 7f5e58361640 1 Processor -- start 2023-12-17T11:48:33.173 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:33.171+0000 7f5e58361640 1 -- start start 2023-12-17T11:48:33.175 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:33.172+0000 7f5e58361640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5e500b2b90 0x7f5e500caec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:33.175 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:33.172+0000 7f5e58361640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5e500cf7e0 0x7f5e50147950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:33.175 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:33.172+0000 7f5e58361640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5e5015e5d0 0x7f5e50156c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:33.175 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:33.172+0000 7f5e58361640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e500caa30 con 0x7f5e500b2b90 2023-12-17T11:48:33.175 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:33.172+0000 7f5e58361640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e50154d90 con 0x7f5e500cf7e0 2023-12-17T11:48:33.175 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:33.172+0000 7f5e58361640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e500ca400 con 0x7f5e5015e5d0 2023-12-17T11:48:33.175 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:33.173+0000 7f5e560fd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5e500b2b90 0x7f5e500caec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:33.175 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:33.173+0000 7f5e560fd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5e500b2b90 0x7f5e500caec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:40864/0 (socket says 172.21.15.40:40864) 2023-12-17T11:48:33.176 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:33.173+0000 7f5e560fd640 1 -- 172.21.15.40:0/1342885243 learned_addr learned my addr 172.21.15.40:0/1342885243 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-17T11:48:33.176 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:33.173+0000 7f5e568fe640 1 --2- 172.21.15.40:0/1342885243 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5e5015e5d0 0x7f5e50156c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:33.176 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:33.173+0000 7f5e558fc640 1 --2- 172.21.15.40:0/1342885243 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5e500cf7e0 0x7f5e50147950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:33.176 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:33.173+0000 7f5e560fd640 1 -- 172.21.15.40:0/1342885243 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5e5015e5d0 msgr2=0x7f5e50156c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:33.176 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:33.173+0000 7f5e560fd640 1 --2- 172.21.15.40:0/1342885243 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5e5015e5d0 0x7f5e50156c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:33.176 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:33.173+0000 7f5e560fd640 1 -- 172.21.15.40:0/1342885243 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5e500cf7e0 msgr2=0x7f5e50147950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:33.176 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:33.173+0000 7f5e560fd640 1 --2- 172.21.15.40:0/1342885243 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5e500cf7e0 0x7f5e50147950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:33.176 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:33.173+0000 7f5e560fd640 1 -- 172.21.15.40:0/1342885243 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e48009b30 con 0x7f5e500b2b90 2023-12-17T11:48:33.176 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:33.173+0000 7f5e560fd640 1 --2- 172.21.15.40:0/1342885243 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5e500b2b90 0x7f5e500caec0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f5e4c00c7b0 tx=0x7f5e4c00cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:48:33.177 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:33.174+0000 7f5e46ffd640 1 -- 172.21.15.40:0/1342885243 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e4c0072d0 con 0x7f5e500b2b90 2023-12-17T11:48:33.177 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:33.174+0000 7f5e46ffd640 1 -- 172.21.15.40:0/1342885243 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e4c007450 con 0x7f5e500b2b90 2023-12-17T11:48:33.177 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:33.174+0000 7f5e46ffd640 1 -- 172.21.15.40:0/1342885243 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e4c0047e0 con 0x7f5e500b2b90 2023-12-17T11:48:33.177 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:33.174+0000 7f5e58361640 1 -- 172.21.15.40:0/1342885243 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e5015adc0 con 0x7f5e500b2b90 2023-12-17T11:48:33.177 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:33.174+0000 7f5e58361640 1 -- 172.21.15.40:0/1342885243 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e50147e90 con 0x7f5e500b2b90 2023-12-17T11:48:33.177 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:33.175+0000 7f5e58361640 1 -- 172.21.15.40:0/1342885243 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e500745d0 con 0x7f5e500b2b90 2023-12-17T11:48:33.178 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:33.176+0000 7f5e46ffd640 1 -- 172.21.15.40:0/1342885243 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f5e4c004960 con 0x7f5e500b2b90 2023-12-17T11:48:33.179 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:33.177+0000 7f5e46ffd640 1 --2- 172.21.15.40:0/1342885243 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f5e3406ae70 0x7f5e3406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:33.179 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:33.177+0000 7f5e46ffd640 1 -- 172.21.15.40:0/1342885243 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f5e4c088a10 con 0x7f5e500b2b90 2023-12-17T11:48:33.179 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:33.178+0000 7f5e558fc640 1 --2- 172.21.15.40:0/1342885243 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f5e3406ae70 0x7f5e3406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:33.180 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:33.179+0000 7f5e558fc640 1 --2- 172.21.15.40:0/1342885243 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f5e3406ae70 0x7f5e3406d330 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f5e500cd7d0 tx=0x7f5e40008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:48:33.183 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:33.181+0000 7f5e46ffd640 1 -- 172.21.15.40:0/1342885243 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f5e4c0536a0 con 0x7f5e500b2b90 2023-12-17T11:48:33.379 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:33.377+0000 7f5e58361640 1 -- 172.21.15.40:0/1342885243 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f5e500cd800 con 0x7f5e500b2b90 2023-12-17T11:48:33.380 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:33.378+0000 7f5e46ffd640 1 -- 172.21.15.40:0/1342885243 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) v1 ==== 104+0+11 (secure 0 0 0) 0x7f5e4c0180a0 con 0x7f5e500b2b90 2023-12-17T11:48:33.380 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 32 2023-12-17T11:48:33.383 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:33.380+0000 7f5e58361640 1 -- 172.21.15.40:0/1342885243 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f5e3406ae70 msgr2=0x7f5e3406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:33.383 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:33.380+0000 7f5e58361640 1 --2- 172.21.15.40:0/1342885243 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f5e3406ae70 0x7f5e3406d330 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f5e500cd7d0 tx=0x7f5e40008040 comp rx=0 tx=0).stop 2023-12-17T11:48:33.383 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:33.380+0000 7f5e58361640 1 -- 172.21.15.40:0/1342885243 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5e500b2b90 msgr2=0x7f5e500caec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:33.383 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:33.380+0000 7f5e58361640 1 --2- 172.21.15.40:0/1342885243 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5e500b2b90 0x7f5e500caec0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f5e4c00c7b0 tx=0x7f5e4c00cc70 comp rx=0 tx=0).stop 2023-12-17T11:48:33.383 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:33.380+0000 7f5e58361640 1 -- 172.21.15.40:0/1342885243 shutdown_connections 2023-12-17T11:48:33.383 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:33.380+0000 7f5e58361640 1 --2- 172.21.15.40:0/1342885243 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f5e3406ae70 0x7f5e3406d330 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:33.383 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:33.380+0000 7f5e58361640 1 --2- 172.21.15.40:0/1342885243 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5e5015e5d0 0x7f5e50156c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:33.383 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:33.380+0000 7f5e58361640 1 --2- 172.21.15.40:0/1342885243 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5e500cf7e0 0x7f5e50147950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:33.383 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:33.380+0000 7f5e58361640 1 --2- 172.21.15.40:0/1342885243 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5e500b2b90 0x7f5e500caec0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:33.383 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:33.381+0000 7f5e58361640 1 -- 172.21.15.40:0/1342885243 >> 172.21.15.40:0/1342885243 conn(0x7f5e500b6420 msgr2=0x7f5e500b5270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:48:33.383 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:33.381+0000 7f5e58361640 1 -- 172.21.15.40:0/1342885243 shutdown_connections 2023-12-17T11:48:33.383 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:33.381+0000 7f5e58361640 1 -- 172.21.15.40:0/1342885243 wait complete. 2023-12-17T11:48:33.401 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-17T11:48:33.629 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:33.627+0000 7fbfcffff640 1 Processor -- start 2023-12-17T11:48:33.629 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:33.627+0000 7fbfcffff640 1 -- start start 2023-12-17T11:48:33.632 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:33.629+0000 7fbfcffff640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7fbfd01543f0 0x7fbfd015a590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:33.632 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:33.629+0000 7fbfcffff640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fbfd00b3810 0x7fbfd00cedf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:33.632 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:33.629+0000 7fbfcffff640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbfd015ae30 con 0x7fbfd01547d0 2023-12-17T11:48:33.632 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:33.629+0000 7fbfcffff640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbfd0070780 con 0x7fbfd00b3810 2023-12-17T11:48:33.633 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:33.629+0000 7fbfcffff640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbfd015b110 con 0x7fbfd01543f0 2023-12-17T11:48:33.633 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:33.629+0000 7fbfcf7fe640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fbfd00b3810 0x7fbfd00cedf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:33.633 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:33.629+0000 7fbfcf7fe640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fbfd00b3810 0x7fbfd00cedf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:40880/0 (socket says 172.21.15.40:40880) 2023-12-17T11:48:33.633 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:33.629+0000 7fbfcf7fe640 1 -- 172.21.15.40:0/4053830999 learned_addr learned my addr 172.21.15.40:0/4053830999 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-17T11:48:33.633 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:33.629+0000 7fbfce7fc640 1 --1- 172.21.15.40:0/4053830999 >> v1:172.21.15.40:6789/0 conn(0x7fbfd01547d0 0x7fbfd0070070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:49434/0 (socket says 172.21.15.40:49434) 2023-12-17T11:48:33.633 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:33.629+0000 7fbfceffd640 1 --2- 172.21.15.40:0/4053830999 >> v2:172.21.15.159:3300/0 conn(0x7fbfd01543f0 0x7fbfd015a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:33.634 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:33.630+0000 7fbfcf7fe640 1 -- 172.21.15.40:0/4053830999 >> v2:172.21.15.159:3300/0 conn(0x7fbfd01543f0 msgr2=0x7fbfd015a590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:48:33.634 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:33.630+0000 7fbfcf7fe640 1 --2- 172.21.15.40:0/4053830999 >> v2:172.21.15.159:3300/0 conn(0x7fbfd01543f0 0x7fbfd015a590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:33.634 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:33.630+0000 7fbfcf7fe640 1 -- 172.21.15.40:0/4053830999 >> v1:172.21.15.40:6789/0 conn(0x7fbfd01547d0 legacy=0x7fbfd0070070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:33.634 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:33.630+0000 7fbfcdffb640 1 -- 172.21.15.40:0/4053830999 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3349490524 0 0) 0x7fbfd015ae30 con 0x7fbfd01547d0 2023-12-17T11:48:33.634 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:33.630+0000 7fbfcf7fe640 1 -- 172.21.15.40:0/4053830999 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfd015b3f0 con 0x7fbfd00b3810 2023-12-17T11:48:33.636 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:33.631+0000 7fbfcf7fe640 1 --2- 172.21.15.40:0/4053830999 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbfd00b3810 0x7fbfd00cedf0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fbfd00cfcb0 tx=0x7fbfc802b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba6a7f5d61f875ef server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:48:33.636 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:33.631+0000 7fbfcdffb640 1 -- 172.21.15.40:0/4053830999 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfc8030860 con 0x7fbfd00b3810 2023-12-17T11:48:33.636 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:33.631+0000 7fbfcdffb640 1 -- 172.21.15.40:0/4053830999 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfc80309c0 con 0x7fbfd00b3810 2023-12-17T11:48:33.636 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:33.631+0000 7fbfcdffb640 1 -- 172.21.15.40:0/4053830999 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfc8030d50 con 0x7fbfd00b3810 2023-12-17T11:48:33.636 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:33.632+0000 7fbfcffff640 1 -- 172.21.15.40:0/4053830999 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbfd00b3810 msgr2=0x7fbfd00cedf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:33.636 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:33.632+0000 7fbfcffff640 1 --2- 172.21.15.40:0/4053830999 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbfd00b3810 0x7fbfd00cedf0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fbfd00cfcb0 tx=0x7fbfc802b9a0 comp rx=0 tx=0).stop 2023-12-17T11:48:33.637 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:33.632+0000 7fbfcffff640 1 -- 172.21.15.40:0/4053830999 shutdown_connections 2023-12-17T11:48:33.637 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:33.632+0000 7fbfcffff640 1 --2- 172.21.15.40:0/4053830999 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbfd00b3810 0x7fbfd00cedf0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:33.637 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:33.632+0000 7fbfcffff640 1 --2- 172.21.15.40:0/4053830999 >> v2:172.21.15.159:3300/0 conn(0x7fbfd01543f0 0x7fbfd015a590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:33.637 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:33.632+0000 7fbfcffff640 1 -- 172.21.15.40:0/4053830999 >> 172.21.15.40:0/4053830999 conn(0x7fbfd006a640 msgr2=0x7fbfd006aa50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:48:33.637 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:33.632+0000 7fbfcffff640 1 -- 172.21.15.40:0/4053830999 shutdown_connections 2023-12-17T11:48:33.637 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:33.632+0000 7fbfcffff640 1 -- 172.21.15.40:0/4053830999 wait complete. 2023-12-17T11:48:33.637 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:33.634+0000 7fbfcffff640 1 Processor -- start 2023-12-17T11:48:33.638 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:33.634+0000 7fbfcffff640 1 -- start start 2023-12-17T11:48:33.641 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:33.635+0000 7fbfcffff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbfd00b3810 0x7fbfd0145fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:33.641 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:33.635+0000 7fbfcffff640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fbfd01543f0 0x7fbfd0148740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:33.641 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:33.635+0000 7fbfcffff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbfd01547d0 0x7fbfd0070f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:33.642 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:33.635+0000 7fbfcffff640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfd009b7e0 con 0x7fbfd00b3810 2023-12-17T11:48:33.642 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:33.635+0000 7fbfcffff640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfd009b1d0 con 0x7fbfd01547d0 2023-12-17T11:48:33.642 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:33.635+0000 7fbfcffff640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbfd0149700 con 0x7fbfd01543f0 2023-12-17T11:48:33.642 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:33.635+0000 7fbfceffd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbfd00b3810 0x7fbfd0145fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:33.642 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:33.635+0000 7fbfceffd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbfd00b3810 0x7fbfd0145fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:40886/0 (socket says 172.21.15.40:40886) 2023-12-17T11:48:33.642 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:33.635+0000 7fbfceffd640 1 -- 172.21.15.40:0/1695499744 learned_addr learned my addr 172.21.15.40:0/1695499744 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-17T11:48:33.642 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:33.635+0000 7fbfcf7fe640 1 --2- 172.21.15.40:0/1695499744 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbfd01547d0 0x7fbfd0070f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:33.642 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:33.635+0000 7fbfceffd640 1 -- 172.21.15.40:0/1695499744 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fbfd01543f0 msgr2=0x7fbfd0148740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:33.642 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:33.635+0000 7fbfceffd640 1 --2- 172.21.15.40:0/1695499744 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fbfd01543f0 0x7fbfd0148740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:33.642 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:33.635+0000 7fbfceffd640 1 -- 172.21.15.40:0/1695499744 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbfd01547d0 msgr2=0x7fbfd0070f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:33.643 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:33.635+0000 7fbfceffd640 1 --2- 172.21.15.40:0/1695499744 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbfd01547d0 0x7fbfd0070f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:33.643 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:33.636+0000 7fbfceffd640 1 -- 172.21.15.40:0/1695499744 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfc80094d0 con 0x7fbfd00b3810 2023-12-17T11:48:33.643 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:33.636+0000 7fbfcf7fe640 1 --2- 172.21.15.40:0/1695499744 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbfd01547d0 0x7fbfd0070f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-17T11:48:33.643 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:33.636+0000 7fbfceffd640 1 --2- 172.21.15.40:0/1695499744 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbfd00b3810 0x7fbfd0145fc0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fbfc0007ef0 tx=0x7fbfc000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:48:33.643 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:33.636+0000 7fbfc77fe640 1 -- 172.21.15.40:0/1695499744 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfc0014620 con 0x7fbfd00b3810 2023-12-17T11:48:33.643 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:33.636+0000 7fbfc77fe640 1 -- 172.21.15.40:0/1695499744 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfc0014780 con 0x7fbfd00b3810 2023-12-17T11:48:33.643 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:33.636+0000 7fbfcffff640 1 -- 172.21.15.40:0/1695499744 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbfd0149140 con 0x7fbfd00b3810 2023-12-17T11:48:33.643 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:33.636+0000 7fbfc77fe640 1 -- 172.21.15.40:0/1695499744 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfc0014b30 con 0x7fbfd00b3810 2023-12-17T11:48:33.643 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:33.636+0000 7fbfcffff640 1 -- 172.21.15.40:0/1695499744 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbfd009b400 con 0x7fbfd00b3810 2023-12-17T11:48:33.643 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:33.637+0000 7fbfcffff640 1 -- 172.21.15.40:0/1695499744 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbfd0074450 con 0x7fbfd00b3810 2023-12-17T11:48:33.643 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:33.638+0000 7fbfc77fe640 1 -- 172.21.15.40:0/1695499744 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fbfc0014c90 con 0x7fbfd00b3810 2023-12-17T11:48:33.643 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:33.639+0000 7fbfc77fe640 1 --2- 172.21.15.40:0/1695499744 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7fbfb006ae40 0x7fbfb006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:33.643 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:33.640+0000 7fbfc77fe640 1 -- 172.21.15.40:0/1695499744 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fbfc008a360 con 0x7fbfd00b3810 2023-12-17T11:48:33.644 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:33.640+0000 7fbfce7fc640 1 --2- 172.21.15.40:0/1695499744 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7fbfb006ae40 0x7fbfb006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:33.644 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:33.641+0000 7fbfce7fc640 1 --2- 172.21.15.40:0/1695499744 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7fbfb006ae40 0x7fbfb006d300 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fbfb8007fd0 tx=0x7fbfb8007960 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:48:33.646 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:33.644+0000 7fbfc77fe640 1 -- 172.21.15.40:0/1695499744 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fbfc0055120 con 0x7fbfd00b3810 2023-12-17T11:48:33.839 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:33.837+0000 7fbfcffff640 1 -- 172.21.15.40:0/1695499744 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fbfd0159de0 con 0x7fbfd00b3810 2023-12-17T11:48:33.840 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:33.838+0000 7fbfc77fe640 1 -- 172.21.15.40:0/1695499744 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) v1 ==== 100+0+11 (secure 0 0 0) 0x7fbfc0058740 con 0x7fbfd00b3810 2023-12-17T11:48:33.840 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 64 2023-12-17T11:48:33.843 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:33.840+0000 7fbfcffff640 1 -- 172.21.15.40:0/1695499744 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7fbfb006ae40 msgr2=0x7fbfb006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:33.843 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:33.840+0000 7fbfcffff640 1 --2- 172.21.15.40:0/1695499744 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7fbfb006ae40 0x7fbfb006d300 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fbfb8007fd0 tx=0x7fbfb8007960 comp rx=0 tx=0).stop 2023-12-17T11:48:33.843 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:33.840+0000 7fbfcffff640 1 -- 172.21.15.40:0/1695499744 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbfd00b3810 msgr2=0x7fbfd0145fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:33.843 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:33.840+0000 7fbfcffff640 1 --2- 172.21.15.40:0/1695499744 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbfd00b3810 0x7fbfd0145fc0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fbfc0007ef0 tx=0x7fbfc000e4b0 comp rx=0 tx=0).stop 2023-12-17T11:48:33.843 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:33.840+0000 7fbfcffff640 1 -- 172.21.15.40:0/1695499744 shutdown_connections 2023-12-17T11:48:33.843 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:33.840+0000 7fbfcffff640 1 --2- 172.21.15.40:0/1695499744 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7fbfb006ae40 0x7fbfb006d300 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:33.843 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:33.840+0000 7fbfcffff640 1 --2- 172.21.15.40:0/1695499744 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbfd01547d0 0x7fbfd0070f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:33.843 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:33.840+0000 7fbfcffff640 1 --2- 172.21.15.40:0/1695499744 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fbfd01543f0 0x7fbfd0148740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:33.843 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:33.840+0000 7fbfcffff640 1 --2- 172.21.15.40:0/1695499744 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbfd00b3810 0x7fbfd0145fc0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:33.843 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:33.840+0000 7fbfcffff640 1 -- 172.21.15.40:0/1695499744 >> 172.21.15.40:0/1695499744 conn(0x7fbfd006a640 msgr2=0x7fbfd00b1ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:48:33.843 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:33.841+0000 7fbfcffff640 1 -- 172.21.15.40:0/1695499744 shutdown_connections 2023-12-17T11:48:33.843 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:33.841+0000 7fbfcffff640 1 -- 172.21.15.40:0/1695499744 wait complete. 2023-12-17T11:48:33.865 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-12-17T11:48:34.094 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:34.092+0000 7fb955c1e640 1 Processor -- start 2023-12-17T11:48:34.095 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:34.092+0000 7fb955c1e640 1 -- start start 2023-12-17T11:48:34.096 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:34.094+0000 7fb955c1e640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7fb95006d770 0x7fb9500b1e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:34.096 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:34.094+0000 7fb955c1e640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fb95006db50 0x7fb950141250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:34.096 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:34.094+0000 7fb955c1e640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb95015b780 con 0x7fb950141790 2023-12-17T11:48:34.097 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:34.094+0000 7fb955c1e640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb950141c20 con 0x7fb95006db50 2023-12-17T11:48:34.097 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:34.094+0000 7fb955c1e640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb95015b9d0 con 0x7fb95006d770 2023-12-17T11:48:34.097 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:34.094+0000 7fb94effd640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fb95006db50 0x7fb950141250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:34.097 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:34.095+0000 7fb94effd640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fb95006db50 0x7fb950141250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:40896/0 (socket says 172.21.15.40:40896) 2023-12-17T11:48:34.097 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:34.095+0000 7fb94effd640 1 -- 172.21.15.40:0/851537662 learned_addr learned my addr 172.21.15.40:0/851537662 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-17T11:48:34.097 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:34.095+0000 7fb94f7fe640 1 --2- 172.21.15.40:0/851537662 >> v2:172.21.15.159:3300/0 conn(0x7fb95006d770 0x7fb9500b1e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:34.098 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:34.095+0000 7fb94effd640 1 -- 172.21.15.40:0/851537662 >> v2:172.21.15.159:3300/0 conn(0x7fb95006d770 msgr2=0x7fb9500b1e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:48:34.098 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:34.095+0000 7fb94effd640 1 --2- 172.21.15.40:0/851537662 >> v2:172.21.15.159:3300/0 conn(0x7fb95006d770 0x7fb9500b1e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:34.098 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:34.095+0000 7fb94effd640 1 -- 172.21.15.40:0/851537662 >> v1:172.21.15.159:6789/0 conn(0x7fb950141790 legacy=0x7fb95015ed70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:48:34.098 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:34.095+0000 7fb94effd640 1 -- 172.21.15.40:0/851537662 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb95015bcb0 con 0x7fb95006db50 2023-12-17T11:48:34.098 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:34.096+0000 7fb94effd640 1 --2- 172.21.15.40:0/851537662 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb95006db50 0x7fb950141250 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fb9500b1aa0 tx=0x7fb94402b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17a9e9114961ad7c server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:48:34.098 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:34.097+0000 7fb94e7fc640 1 -- 172.21.15.40:0/851537662 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb944031870 con 0x7fb95006db50 2023-12-17T11:48:34.099 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:34.097+0000 7fb94e7fc640 1 -- 172.21.15.40:0/851537662 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9440319d0 con 0x7fb95006db50 2023-12-17T11:48:34.099 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:34.097+0000 7fb94e7fc640 1 -- 172.21.15.40:0/851537662 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb944031d60 con 0x7fb95006db50 2023-12-17T11:48:34.099 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:34.097+0000 7fb955c1e640 1 -- 172.21.15.40:0/851537662 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb95006db50 msgr2=0x7fb950141250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:34.099 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:34.097+0000 7fb955c1e640 1 --2- 172.21.15.40:0/851537662 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb95006db50 0x7fb950141250 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fb9500b1aa0 tx=0x7fb94402b910 comp rx=0 tx=0).stop 2023-12-17T11:48:34.099 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:34.097+0000 7fb955c1e640 1 -- 172.21.15.40:0/851537662 shutdown_connections 2023-12-17T11:48:34.099 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:34.097+0000 7fb955c1e640 1 --2- 172.21.15.40:0/851537662 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb95006db50 0x7fb950141250 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:34.100 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:34.097+0000 7fb955c1e640 1 --2- 172.21.15.40:0/851537662 >> v2:172.21.15.159:3300/0 conn(0x7fb95006d770 0x7fb9500b1e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:34.100 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:34.097+0000 7fb955c1e640 1 -- 172.21.15.40:0/851537662 >> 172.21.15.40:0/851537662 conn(0x7fb9500cb850 msgr2=0x7fb9500cbc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:48:34.100 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:34.097+0000 7fb955c1e640 1 -- 172.21.15.40:0/851537662 shutdown_connections 2023-12-17T11:48:34.100 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:34.097+0000 7fb955c1e640 1 -- 172.21.15.40:0/851537662 wait complete. 2023-12-17T11:48:34.101 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:34.099+0000 7fb955c1e640 1 Processor -- start 2023-12-17T11:48:34.101 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:34.099+0000 7fb955c1e640 1 -- start start 2023-12-17T11:48:34.102 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:34.100+0000 7fb955c1e640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb95006d770 0x7fb95013bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:34.102 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:34.100+0000 7fb955c1e640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb95006db50 0x7fb95015aab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:34.103 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:34.100+0000 7fb955c1e640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb950141790 0x7fb9500aed60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:34.103 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:34.100+0000 7fb955c1e640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb95013c640 con 0x7fb95006db50 2023-12-17T11:48:34.103 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:34.100+0000 7fb955c1e640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb95013c920 con 0x7fb95006d770 2023-12-17T11:48:34.103 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:34.100+0000 7fb955c1e640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb95013cc00 con 0x7fb950141790 2023-12-17T11:48:34.103 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:34.101+0000 7fb94effd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb95006db50 0x7fb95015aab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:34.103 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:34.101+0000 7fb94effd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb95006db50 0x7fb95015aab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:40904/0 (socket says 172.21.15.40:40904) 2023-12-17T11:48:34.103 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:34.101+0000 7fb94effd640 1 -- 172.21.15.40:0/311507029 learned_addr learned my addr 172.21.15.40:0/311507029 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-17T11:48:34.103 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:34.101+0000 7fb94f7fe640 1 --2- 172.21.15.40:0/311507029 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb95006d770 0x7fb95013bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:34.104 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:34.101+0000 7fb94ffff640 1 --2- 172.21.15.40:0/311507029 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb950141790 0x7fb9500aed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:34.104 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:34.101+0000 7fb94effd640 1 -- 172.21.15.40:0/311507029 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb950141790 msgr2=0x7fb9500aed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:34.104 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:34.101+0000 7fb94effd640 1 --2- 172.21.15.40:0/311507029 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb950141790 0x7fb9500aed60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:34.104 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:34.101+0000 7fb94effd640 1 -- 172.21.15.40:0/311507029 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb95006d770 msgr2=0x7fb95013bdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:34.104 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:34.101+0000 7fb94effd640 1 --2- 172.21.15.40:0/311507029 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb95006d770 0x7fb95013bdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:34.105 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:34.101+0000 7fb94effd640 1 -- 172.21.15.40:0/311507029 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9440094d0 con 0x7fb95006db50 2023-12-17T11:48:34.105 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:34.101+0000 7fb94ffff640 1 --2- 172.21.15.40:0/311507029 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb950141790 0x7fb9500aed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-17T11:48:34.105 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:34.101+0000 7fb94effd640 1 --2- 172.21.15.40:0/311507029 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb95006db50 0x7fb95015aab0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fb944000c00 tx=0x7fb9440046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:48:34.105 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:34.102+0000 7fb937fff640 1 -- 172.21.15.40:0/311507029 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb94403abe0 con 0x7fb95006db50 2023-12-17T11:48:34.105 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:34.102+0000 7fb937fff640 1 -- 172.21.15.40:0/311507029 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb94403ad40 con 0x7fb95006db50 2023-12-17T11:48:34.105 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:34.102+0000 7fb937fff640 1 -- 172.21.15.40:0/311507029 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb944044610 con 0x7fb95006db50 2023-12-17T11:48:34.105 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:34.102+0000 7fb955c1e640 1 -- 172.21.15.40:0/311507029 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb95013cee0 con 0x7fb95006db50 2023-12-17T11:48:34.105 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:34.102+0000 7fb955c1e640 1 -- 172.21.15.40:0/311507029 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb95013c2f0 con 0x7fb95006db50 2023-12-17T11:48:34.106 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:34.103+0000 7fb955c1e640 1 -- 172.21.15.40:0/311507029 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9500745d0 con 0x7fb95006db50 2023-12-17T11:48:34.106 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:34.104+0000 7fb937fff640 1 -- 172.21.15.40:0/311507029 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fb94404d450 con 0x7fb95006db50 2023-12-17T11:48:34.107 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:34.105+0000 7fb937fff640 1 --2- 172.21.15.40:0/311507029 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7fb93c06ae40 0x7fb93c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:34.107 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:34.105+0000 7fb937fff640 1 -- 172.21.15.40:0/311507029 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fb94402d040 con 0x7fb95006db50 2023-12-17T11:48:34.107 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:34.105+0000 7fb94f7fe640 1 --2- 172.21.15.40:0/311507029 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7fb93c06ae40 0x7fb93c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:34.108 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:34.106+0000 7fb94f7fe640 1 --2- 172.21.15.40:0/311507029 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7fb93c06ae40 0x7fb93c06d300 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fb9500ce700 tx=0x7fb9400039b0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:48:34.111 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:34.109+0000 7fb937fff640 1 -- 172.21.15.40:0/311507029 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fb944076d00 con 0x7fb95006db50 2023-12-17T11:48:34.310 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:34.308+0000 7fb955c1e640 1 -- 172.21.15.40:0/311507029 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fb950072770 con 0x7fb95006db50 2023-12-17T11:48:34.311 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:34.309+0000 7fb937fff640 1 -- 172.21.15.40:0/311507029 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v25) v1 ==== 103+0+11 (secure 0 0 0) 0x7fb944035020 con 0x7fb95006db50 2023-12-17T11:48:34.311 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 32 2023-12-17T11:48:34.314 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:34.312+0000 7fb955c1e640 1 -- 172.21.15.40:0/311507029 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7fb93c06ae40 msgr2=0x7fb93c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:34.314 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:34.312+0000 7fb955c1e640 1 --2- 172.21.15.40:0/311507029 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7fb93c06ae40 0x7fb93c06d300 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fb9500ce700 tx=0x7fb9400039b0 comp rx=0 tx=0).stop 2023-12-17T11:48:34.314 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:34.312+0000 7fb955c1e640 1 -- 172.21.15.40:0/311507029 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb95006db50 msgr2=0x7fb95015aab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:34.314 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:34.312+0000 7fb955c1e640 1 --2- 172.21.15.40:0/311507029 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb95006db50 0x7fb95015aab0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fb944000c00 tx=0x7fb9440046c0 comp rx=0 tx=0).stop 2023-12-17T11:48:34.314 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:34.312+0000 7fb955c1e640 1 -- 172.21.15.40:0/311507029 shutdown_connections 2023-12-17T11:48:34.314 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:34.312+0000 7fb955c1e640 1 --2- 172.21.15.40:0/311507029 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7fb93c06ae40 0x7fb93c06d300 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:34.315 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:34.312+0000 7fb955c1e640 1 --2- 172.21.15.40:0/311507029 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb950141790 0x7fb9500aed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:34.315 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:34.312+0000 7fb955c1e640 1 --2- 172.21.15.40:0/311507029 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb95006db50 0x7fb95015aab0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:34.315 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:34.312+0000 7fb955c1e640 1 --2- 172.21.15.40:0/311507029 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb95006d770 0x7fb95013bdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:34.315 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:34.312+0000 7fb955c1e640 1 -- 172.21.15.40:0/311507029 >> 172.21.15.40:0/311507029 conn(0x7fb9500cb850 msgr2=0x7fb9500cd590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:48:34.315 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:34.312+0000 7fb955c1e640 1 -- 172.21.15.40:0/311507029 shutdown_connections 2023-12-17T11:48:34.315 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:34.312+0000 7fb955c1e640 1 -- 172.21.15.40:0/311507029 wait complete. 2023-12-17T11:48:34.335 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-17T11:48:34.562 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:34.559+0000 7f530a1a9640 1 Processor -- start 2023-12-17T11:48:34.562 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:34.560+0000 7f530a1a9640 1 -- start start 2023-12-17T11:48:34.564 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:34.561+0000 7f530a1a9640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f53040cd000 0x7f530406c7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:34.564 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:34.562+0000 7f530a1a9640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f5304146ba0 0x7f530406cd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:34.564 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:34.562+0000 7f530a1a9640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f530406d260 con 0x7f53041467c0 2023-12-17T11:48:34.564 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:34.562+0000 7f530a1a9640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53040ac860 con 0x7f5304146ba0 2023-12-17T11:48:34.564 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:34.562+0000 7f530a1a9640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f530406d510 con 0x7f53040cd000 2023-12-17T11:48:34.565 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:34.562+0000 7f5303fff640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f5304146ba0 0x7f530406cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:34.565 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:34.562+0000 7f5303fff640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f5304146ba0 0x7f530406cd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.40:51580/0 (socket says 172.21.15.40:51580) 2023-12-17T11:48:34.565 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:34.562+0000 7f5303fff640 1 -- 172.21.15.40:0/2982049845 learned_addr learned my addr 172.21.15.40:0/2982049845 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-17T11:48:34.565 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:34.562+0000 7f52fbfff640 1 --2- 172.21.15.40:0/2982049845 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f53040cd000 0x7f530406c7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:34.565 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:34.563+0000 7f5303fff640 1 -- 172.21.15.40:0/2982049845 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f53040cd000 msgr2=0x7f530406c7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:48:34.565 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:34.563+0000 7f5303fff640 1 --2- 172.21.15.40:0/2982049845 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f53040cd000 0x7f530406c7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:34.565 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:34.563+0000 7f5303fff640 1 -- 172.21.15.40:0/2982049845 >> v1:172.21.15.159:6789/0 conn(0x7f53041467c0 legacy=0x7f53040cc8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:34.566 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:34.563+0000 7f5303fff640 1 -- 172.21.15.40:0/2982049845 --> v2:172.21.15.159:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f530406d7f0 con 0x7f5304146ba0 2023-12-17T11:48:34.566 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:34.564+0000 7f5303fff640 1 --2- 172.21.15.40:0/2982049845 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5304146ba0 0x7f530406cd20 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f52fc009e50 tx=0x7f52fc02bf60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cf6838d549391374 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:48:34.567 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:34.565+0000 7f5302ffd640 1 -- 172.21.15.40:0/2982049845 <== mon.1 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52fc02cb00 con 0x7f5304146ba0 2023-12-17T11:48:34.567 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:34.565+0000 7f5302ffd640 1 -- 172.21.15.40:0/2982049845 <== mon.1 v2:172.21.15.159:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52fc02cc60 con 0x7f5304146ba0 2023-12-17T11:48:34.567 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:34.565+0000 7f5302ffd640 1 -- 172.21.15.40:0/2982049845 <== mon.1 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52fc0343f0 con 0x7f5304146ba0 2023-12-17T11:48:34.568 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:34.566+0000 7f530a1a9640 1 -- 172.21.15.40:0/2982049845 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5304146ba0 msgr2=0x7f530406cd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:34.568 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:34.566+0000 7f530a1a9640 1 --2- 172.21.15.40:0/2982049845 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5304146ba0 0x7f530406cd20 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f52fc009e50 tx=0x7f52fc02bf60 comp rx=0 tx=0).stop 2023-12-17T11:48:34.568 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:34.566+0000 7f530a1a9640 1 -- 172.21.15.40:0/2982049845 shutdown_connections 2023-12-17T11:48:34.568 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:34.566+0000 7f530a1a9640 1 --2- 172.21.15.40:0/2982049845 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f53040cd000 0x7f530406c7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:34.568 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:34.566+0000 7f530a1a9640 1 --2- 172.21.15.40:0/2982049845 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5304146ba0 0x7f530406cd20 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:34.568 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:34.566+0000 7f530a1a9640 1 -- 172.21.15.40:0/2982049845 >> 172.21.15.40:0/2982049845 conn(0x7f53040b0a90 msgr2=0x7f53040b0e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:48:34.568 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:34.566+0000 7f530a1a9640 1 -- 172.21.15.40:0/2982049845 shutdown_connections 2023-12-17T11:48:34.568 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:34.566+0000 7f530a1a9640 1 -- 172.21.15.40:0/2982049845 wait complete. 2023-12-17T11:48:34.570 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:34.568+0000 7f530a1a9640 1 Processor -- start 2023-12-17T11:48:34.570 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:34.568+0000 7f530a1a9640 1 -- start start 2023-12-17T11:48:34.571 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:34.569+0000 7f530a1a9640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f53040cd000 0x7f5304156c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:34.571 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:34.569+0000 7f530a1a9640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f53041467c0 0x7f53041330d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:34.571 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:34.569+0000 7f530a1a9640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5304146ba0 0x7f5304141990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:34.571 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:34.569+0000 7f530a1a9640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5304157150 con 0x7f53040cd000 2023-12-17T11:48:34.571 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:34.569+0000 7f530a1a9640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53040b1b80 con 0x7f5304146ba0 2023-12-17T11:48:34.572 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:34.569+0000 7f530a1a9640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53040b1e60 con 0x7f53041467c0 2023-12-17T11:48:34.572 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:34.569+0000 7f53037fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f53040cd000 0x7f5304156c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:34.572 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:34.569+0000 7f53037fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f53040cd000 0x7f5304156c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:40908/0 (socket says 172.21.15.40:40908) 2023-12-17T11:48:34.572 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:34.569+0000 7f53037fe640 1 -- 172.21.15.40:0/1334049817 learned_addr learned my addr 172.21.15.40:0/1334049817 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-17T11:48:34.573 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:34.570+0000 7f5303fff640 1 --2- 172.21.15.40:0/1334049817 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5304146ba0 0x7f5304141990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:34.573 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:34.570+0000 7f52fbfff640 1 --2- 172.21.15.40:0/1334049817 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f53041467c0 0x7f53041330d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:34.573 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:34.570+0000 7f53037fe640 1 -- 172.21.15.40:0/1334049817 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f53041467c0 msgr2=0x7f53041330d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:34.573 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:34.570+0000 7f53037fe640 1 --2- 172.21.15.40:0/1334049817 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f53041467c0 0x7f53041330d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:34.573 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:34.570+0000 7f53037fe640 1 -- 172.21.15.40:0/1334049817 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5304146ba0 msgr2=0x7f5304141990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:34.573 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:34.570+0000 7f53037fe640 1 --2- 172.21.15.40:0/1334049817 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5304146ba0 0x7f5304141990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:34.574 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:34.570+0000 7f53037fe640 1 -- 172.21.15.40:0/1334049817 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52fc009b30 con 0x7f53040cd000 2023-12-17T11:48:34.574 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:34.570+0000 7f53037fe640 1 --2- 172.21.15.40:0/1334049817 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f53040cd000 0x7f5304156c10 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f52f400c400 tx=0x7f52f400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:48:34.574 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:34.570+0000 7f5300ff9640 1 -- 172.21.15.40:0/1334049817 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52f40052d0 con 0x7f53040cd000 2023-12-17T11:48:34.574 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:34.571+0000 7f5300ff9640 1 -- 172.21.15.40:0/1334049817 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52f4005450 con 0x7f53040cd000 2023-12-17T11:48:34.574 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:34.571+0000 7f5300ff9640 1 -- 172.21.15.40:0/1334049817 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52f4007260 con 0x7f53040cd000 2023-12-17T11:48:34.574 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:34.571+0000 7f530a1a9640 1 -- 172.21.15.40:0/1334049817 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53040b2140 con 0x7f53040cd000 2023-12-17T11:48:34.574 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:34.571+0000 7f530a1a9640 1 -- 172.21.15.40:0/1334049817 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53040b2700 con 0x7f53040cd000 2023-12-17T11:48:34.575 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:34.572+0000 7f530a1a9640 1 -- 172.21.15.40:0/1334049817 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53041576d0 con 0x7f53040cd000 2023-12-17T11:48:34.575 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:34.573+0000 7f5300ff9640 1 -- 172.21.15.40:0/1334049817 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f52f40073c0 con 0x7f53040cd000 2023-12-17T11:48:34.575 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:34.574+0000 7f5300ff9640 1 --2- 172.21.15.40:0/1334049817 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f52e406ae40 0x7f52e406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:34.576 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:34.574+0000 7f5300ff9640 1 -- 172.21.15.40:0/1334049817 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f52f4088e30 con 0x7f53040cd000 2023-12-17T11:48:34.576 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:34.574+0000 7f52fbfff640 1 --2- 172.21.15.40:0/1334049817 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f52e406ae40 0x7f52e406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:34.577 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:34.576+0000 7f52fbfff640 1 --2- 172.21.15.40:0/1334049817 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f52e406ae40 0x7f52e406d300 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f53040cfd00 tx=0x7f52ec008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:48:34.580 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:34.578+0000 7f5300ff9640 1 -- 172.21.15.40:0/1334049817 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f52f4053ac0 con 0x7f53040cd000 2023-12-17T11:48:34.789 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:34.787+0000 7f530a1a9640 1 -- 172.21.15.40:0/1334049817 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f53040745d0 con 0x7f53040cd000 2023-12-17T11:48:34.790 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:34.788+0000 7f5300ff9640 1 -- 172.21.15.40:0/1334049817 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v25) v1 ==== 80+0+0 (secure 0 0 0) 0x7f52f40570e0 con 0x7f53040cd000 2023-12-17T11:48:34.790 INFO:teuthology.orchestra.run.smithi040.stderr:listed 0 entries 2023-12-17T11:48:34.794 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:34.791+0000 7f530a1a9640 1 -- 172.21.15.40:0/1334049817 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f52e406ae40 msgr2=0x7f52e406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:34.794 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:34.791+0000 7f530a1a9640 1 --2- 172.21.15.40:0/1334049817 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f52e406ae40 0x7f52e406d300 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f53040cfd00 tx=0x7f52ec008040 comp rx=0 tx=0).stop 2023-12-17T11:48:34.794 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:34.791+0000 7f530a1a9640 1 -- 172.21.15.40:0/1334049817 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f53040cd000 msgr2=0x7f5304156c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:34.794 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:34.791+0000 7f530a1a9640 1 --2- 172.21.15.40:0/1334049817 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f53040cd000 0x7f5304156c10 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f52f400c400 tx=0x7f52f400c8c0 comp rx=0 tx=0).stop 2023-12-17T11:48:34.794 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:34.791+0000 7f530a1a9640 1 -- 172.21.15.40:0/1334049817 shutdown_connections 2023-12-17T11:48:34.794 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:34.791+0000 7f530a1a9640 1 --2- 172.21.15.40:0/1334049817 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f52e406ae40 0x7f52e406d300 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:34.794 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:34.791+0000 7f530a1a9640 1 --2- 172.21.15.40:0/1334049817 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5304146ba0 0x7f5304141990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:34.794 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:34.791+0000 7f530a1a9640 1 --2- 172.21.15.40:0/1334049817 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f53041467c0 0x7f53041330d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:34.794 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:34.791+0000 7f530a1a9640 1 --2- 172.21.15.40:0/1334049817 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f53040cd000 0x7f5304156c10 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:34.794 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:34.791+0000 7f530a1a9640 1 -- 172.21.15.40:0/1334049817 >> 172.21.15.40:0/1334049817 conn(0x7f53040b0a90 msgr2=0x7f53040ae900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:48:34.794 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:34.792+0000 7f530a1a9640 1 -- 172.21.15.40:0/1334049817 shutdown_connections 2023-12-17T11:48:34.794 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:34.792+0000 7f530a1a9640 1 -- 172.21.15.40:0/1334049817 wait complete. 2023-12-17T11:48:34.811 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2023-12-17T11:48:34.811 DEBUG:teuthology.orchestra.run.smithi040:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-17T11:48:34.865 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-17T11:48:35.087 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:35.085+0000 7f3144c39640 1 Processor -- start 2023-12-17T11:48:35.087 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:35.085+0000 7f3144c39640 1 -- start start 2023-12-17T11:48:35.089 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:35.087+0000 7f3144c39640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f3140159fd0 0x7f31400ae1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:35.089 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:35.087+0000 7f3144c39640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f31400713b0 0x7f31400b27e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:35.089 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:35.087+0000 7f3144c39640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3140070070 con 0x7f3140070750 2023-12-17T11:48:35.089 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:35.087+0000 7f3144c39640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31400705f0 con 0x7f3140159fd0 2023-12-17T11:48:35.090 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:35.087+0000 7f3144c39640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3140070310 con 0x7f31400713b0 2023-12-17T11:48:35.090 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:35.087+0000 7f313f7fe640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f3140159fd0 0x7f31400ae1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:35.093 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:35.088+0000 7f313f7fe640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f3140159fd0 0x7f31400ae1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:35004/0 (socket says 172.21.15.40:35004) 2023-12-17T11:48:35.093 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:35.088+0000 7f313f7fe640 1 -- 172.21.15.40:0/1829338075 learned_addr learned my addr 172.21.15.40:0/1829338075 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-17T11:48:35.095 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:35.088+0000 7f313ffff640 1 --2- 172.21.15.40:0/1829338075 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f31400713b0 0x7f31400b27e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:35.095 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:35.088+0000 7f313f7fe640 1 -- 172.21.15.40:0/1829338075 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f31400713b0 msgr2=0x7f31400b27e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:48:35.095 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:35.088+0000 7f313f7fe640 1 --2- 172.21.15.40:0/1829338075 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f31400713b0 0x7f31400b27e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:35.095 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:35.088+0000 7f313f7fe640 1 -- 172.21.15.40:0/1829338075 >> v1:172.21.15.159:6789/0 conn(0x7f3140070750 legacy=0x7f3140070ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:48:35.095 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:35.088+0000 7f313f7fe640 1 -- 172.21.15.40:0/1829338075 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31400b1d00 con 0x7f3140159fd0 2023-12-17T11:48:35.096 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:35.088+0000 7f313ffff640 1 --2- 172.21.15.40:0/1829338075 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f31400713b0 0x7f31400b27e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-17T11:48:35.096 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:35.089+0000 7f313f7fe640 1 --2- 172.21.15.40:0/1829338075 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3140159fd0 0x7f31400ae1d0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f314006e4f0 tx=0x7f313002b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0c10ca361481442 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:48:35.096 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:35.089+0000 7f313effd640 1 -- 172.21.15.40:0/1829338075 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3130030610 con 0x7f3140159fd0 2023-12-17T11:48:35.096 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:35.089+0000 7f313effd640 1 -- 172.21.15.40:0/1829338075 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3130030770 con 0x7f3140159fd0 2023-12-17T11:48:35.096 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:35.089+0000 7f313effd640 1 -- 172.21.15.40:0/1829338075 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3130030b00 con 0x7f3140159fd0 2023-12-17T11:48:35.096 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:35.090+0000 7f3144c39640 1 -- 172.21.15.40:0/1829338075 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3140159fd0 msgr2=0x7f31400ae1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:35.096 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:35.090+0000 7f3144c39640 1 --2- 172.21.15.40:0/1829338075 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3140159fd0 0x7f31400ae1d0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f314006e4f0 tx=0x7f313002b960 comp rx=0 tx=0).stop 2023-12-17T11:48:35.096 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:35.090+0000 7f3144c39640 1 -- 172.21.15.40:0/1829338075 shutdown_connections 2023-12-17T11:48:35.096 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:35.090+0000 7f3144c39640 1 --2- 172.21.15.40:0/1829338075 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f31400713b0 0x7f31400b27e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:35.096 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:35.090+0000 7f3144c39640 1 --2- 172.21.15.40:0/1829338075 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3140159fd0 0x7f31400ae1d0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:35.096 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:35.090+0000 7f3144c39640 1 -- 172.21.15.40:0/1829338075 >> 172.21.15.40:0/1829338075 conn(0x7f31400b0860 msgr2=0x7f31400b0c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:48:35.096 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:35.090+0000 7f3144c39640 1 -- 172.21.15.40:0/1829338075 shutdown_connections 2023-12-17T11:48:35.096 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:35.090+0000 7f3144c39640 1 -- 172.21.15.40:0/1829338075 wait complete. 2023-12-17T11:48:35.096 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:35.092+0000 7f3144c39640 1 Processor -- start 2023-12-17T11:48:35.097 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:35.092+0000 7f3144c39640 1 -- start start 2023-12-17T11:48:35.097 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:35.093+0000 7f3144c39640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3140070750 0x7f3140151780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:35.097 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:35.093+0000 7f3144c39640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f31400713b0 0x7f314014b810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:35.097 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:35.093+0000 7f3144c39640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3140159fd0 0x7f314009c2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:35.097 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:35.093+0000 7f3144c39640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3140151cc0 con 0x7f3140070750 2023-12-17T11:48:35.097 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:35.093+0000 7f3144c39640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3140150750 con 0x7f3140159fd0 2023-12-17T11:48:35.097 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:35.093+0000 7f3144c39640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f314014bd50 con 0x7f31400713b0 2023-12-17T11:48:35.097 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:35.093+0000 7f313f7fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3140070750 0x7f3140151780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:35.097 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:35.093+0000 7f313f7fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3140070750 0x7f3140151780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:35014/0 (socket says 172.21.15.40:35014) 2023-12-17T11:48:35.097 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:35.093+0000 7f313f7fe640 1 -- 172.21.15.40:0/65251136 learned_addr learned my addr 172.21.15.40:0/65251136 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-17T11:48:35.099 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:35.094+0000 7f313ffff640 1 --2- 172.21.15.40:0/65251136 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3140159fd0 0x7f314009c2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:35.099 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:35.094+0000 7f313f7fe640 1 -- 172.21.15.40:0/65251136 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f31400713b0 msgr2=0x7f314014b810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:35.099 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:35.094+0000 7f3136ffd640 1 --2- 172.21.15.40:0/65251136 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f31400713b0 0x7f314014b810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:35.099 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:35.094+0000 7f313f7fe640 1 --2- 172.21.15.40:0/65251136 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f31400713b0 0x7f314014b810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:35.099 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:35.094+0000 7f313f7fe640 1 -- 172.21.15.40:0/65251136 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3140159fd0 msgr2=0x7f314009c2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:35.099 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:35.094+0000 7f313f7fe640 1 --2- 172.21.15.40:0/65251136 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3140159fd0 0x7f314009c2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:35.099 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:35.094+0000 7f313f7fe640 1 -- 172.21.15.40:0/65251136 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31300094d0 con 0x7f3140070750 2023-12-17T11:48:35.099 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:35.094+0000 7f313ffff640 1 --2- 172.21.15.40:0/65251136 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3140159fd0 0x7f314009c2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-17T11:48:35.099 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:35.094+0000 7f3136ffd640 1 --2- 172.21.15.40:0/65251136 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f31400713b0 0x7f314014b810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-17T11:48:35.099 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:35.094+0000 7f313f7fe640 1 --2- 172.21.15.40:0/65251136 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3140070750 0x7f3140151780 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f313002b9a0 tx=0x7f3130004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:48:35.099 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:35.094+0000 7f313cff9640 1 -- 172.21.15.40:0/65251136 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3130039a90 con 0x7f3140070750 2023-12-17T11:48:35.099 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:35.094+0000 7f313cff9640 1 -- 172.21.15.40:0/65251136 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3130039bf0 con 0x7f3140070750 2023-12-17T11:48:35.100 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:35.095+0000 7f3144c39640 1 -- 172.21.15.40:0/65251136 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31401509c0 con 0x7f3140070750 2023-12-17T11:48:35.100 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:35.095+0000 7f313cff9640 1 -- 172.21.15.40:0/65251136 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3130043410 con 0x7f3140070750 2023-12-17T11:48:35.100 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:35.095+0000 7f3144c39640 1 -- 172.21.15.40:0/65251136 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3140150f80 con 0x7f3140070750 2023-12-17T11:48:35.100 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:35.096+0000 7f3144c39640 1 -- 172.21.15.40:0/65251136 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3140074450 con 0x7f3140070750 2023-12-17T11:48:35.100 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:35.097+0000 7f313cff9640 1 -- 172.21.15.40:0/65251136 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f313004c3b0 con 0x7f3140070750 2023-12-17T11:48:35.100 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:35.098+0000 7f313cff9640 1 --2- 172.21.15.40:0/65251136 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f312006ae70 0x7f312006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:35.100 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:35.098+0000 7f313cff9640 1 -- 172.21.15.40:0/65251136 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f31300abce0 con 0x7f3140070750 2023-12-17T11:48:35.101 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:35.098+0000 7f3136ffd640 1 --2- 172.21.15.40:0/65251136 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f312006ae70 0x7f312006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:35.101 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:35.099+0000 7f3136ffd640 1 --2- 172.21.15.40:0/65251136 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f312006ae70 0x7f312006d330 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f314006be10 tx=0x7f3128009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:48:35.104 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:35.102+0000 7f313cff9640 1 -- 172.21.15.40:0/65251136 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f3130076c50 con 0x7f3140070750 2023-12-17T11:48:35.301 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:35.299+0000 7f3144c39640 1 -- 172.21.15.40:0/65251136 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f31400cf750 con 0x7f3140070750 2023-12-17T11:48:35.304 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:35.302+0000 7f313cff9640 1 -- 172.21.15.40:0/65251136 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18322 (secure 0 0 0) 0x7f3130034090 con 0x7f3140070750 2023-12-17T11:48:35.304 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T11:48:35.304 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":25,"fsid":"099cd35d-80d9-4ca4-8424-de13b3b03ac7","created":"2023-12-17T11:47:53.450097+0000","modified":"2023-12-17T11:48:22.971195+0000","last_up_change":"2023-12-17T11:48:05.724195+0000","last_in_change":"2023-12-17T11:47:56.956499+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-17T11:48:06.668943+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-17T11:48:16.151444+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-17T11:48:16.717726+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-17T11:48:20.534819+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a88bfd46-63b8-48b1-9c0e-5c9cdc31bd38","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":555204741},{"type":"v1","addr":"172.21.15.40:6802","nonce":555204741}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":555204741},{"type":"v1","addr":"172.21.15.40:6807","nonce":555204741}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":555204741},{"type":"v1","addr":"172.21.15.40:6815","nonce":555204741}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6809","nonce":555204741},{"type":"v1","addr":"172.21.15.40:6812","nonce":555204741}]},"public_addr":"172.21.15.40:6802/555204741","cluster_addr":"172.21.15.40:6807/555204741","heartbeat_back_addr":"172.21.15.40:6815/555204741","heartbeat_front_addr":"172.21.15.40:6812/555204741","state":["exists","up"]},{"osd":1,"uuid":"c5d628ae-36f4-4866-802c-b162f0e90add","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6801","nonce":1221318112},{"type":"v1","addr":"172.21.15.40:6803","nonce":1221318112}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6805","nonce":1221318112},{"type":"v1","addr":"172.21.15.40:6806","nonce":1221318112}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6811","nonce":1221318112},{"type":"v1","addr":"172.21.15.40:6813","nonce":1221318112}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":1221318112},{"type":"v1","addr":"172.21.15.40:6810","nonce":1221318112}]},"public_addr":"172.21.15.40:6803/1221318112","cluster_addr":"172.21.15.40:6806/1221318112","heartbeat_back_addr":"172.21.15.40:6813/1221318112","heartbeat_front_addr":"172.21.15.40:6810/1221318112","state":["exists","up"]},{"osd":2,"uuid":"d986ad6a-af2f-47fc-9c3b-fbda27b82b73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":1959000265},{"type":"v1","addr":"172.21.15.40:6817","nonce":1959000265}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6818","nonce":1959000265},{"type":"v1","addr":"172.21.15.40:6819","nonce":1959000265}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":1959000265},{"type":"v1","addr":"172.21.15.40:6827","nonce":1959000265}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":1959000265},{"type":"v1","addr":"172.21.15.40:6822","nonce":1959000265}]},"public_addr":"172.21.15.40:6817/1959000265","cluster_addr":"172.21.15.40:6819/1959000265","heartbeat_back_addr":"172.21.15.40:6827/1959000265","heartbeat_front_addr":"172.21.15.40:6822/1959000265","state":["exists","up"]},{"osd":3,"uuid":"d79d22b7-be05-41b2-b95d-697db677fd02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6821","nonce":974040287},{"type":"v1","addr":"172.21.15.40:6823","nonce":974040287}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6825","nonce":974040287},{"type":"v1","addr":"172.21.15.40:6826","nonce":974040287}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":974040287},{"type":"v1","addr":"172.21.15.40:6831","nonce":974040287}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":974040287},{"type":"v1","addr":"172.21.15.40:6829","nonce":974040287}]},"public_addr":"172.21.15.40:6823/974040287","cluster_addr":"172.21.15.40:6826/974040287","heartbeat_back_addr":"172.21.15.40:6831/974040287","heartbeat_front_addr":"172.21.15.40:6829/974040287","state":["exists","up"]},{"osd":4,"uuid":"62a7a233-d3ea-40be-91de-180c0208d639","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6808","nonce":3937787733},{"type":"v1","addr":"172.21.15.159:6809","nonce":3937787733}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6810","nonce":3937787733},{"type":"v1","addr":"172.21.15.159:6811","nonce":3937787733}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6814","nonce":3937787733},{"type":"v1","addr":"172.21.15.159:6815","nonce":3937787733}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6812","nonce":3937787733},{"type":"v1","addr":"172.21.15.159:6813","nonce":3937787733}]},"public_addr":"172.21.15.159:6809/3937787733","cluster_addr":"172.21.15.159:6811/3937787733","heartbeat_back_addr":"172.21.15.159:6815/3937787733","heartbeat_front_addr":"172.21.15.159:6813/3937787733","state":["exists","up"]},{"osd":5,"uuid":"84629cea-dc0e-4b5e-b203-5ea963839281","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6816","nonce":3032505240},{"type":"v1","addr":"172.21.15.159:6817","nonce":3032505240}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6818","nonce":3032505240},{"type":"v1","addr":"172.21.15.159:6819","nonce":3032505240}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6822","nonce":3032505240},{"type":"v1","addr":"172.21.15.159:6823","nonce":3032505240}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6820","nonce":3032505240},{"type":"v1","addr":"172.21.15.159:6821","nonce":3032505240}]},"public_addr":"172.21.15.159:6817/3032505240","cluster_addr":"172.21.15.159:6819/3032505240","heartbeat_back_addr":"172.21.15.159:6823/3032505240","heartbeat_front_addr":"172.21.15.159:6821/3032505240","state":["exists","up"]},{"osd":6,"uuid":"4ae3af3a-1743-4070-a91d-8be5c31cdb04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6800","nonce":2411788597},{"type":"v1","addr":"172.21.15.159:6801","nonce":2411788597}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6802","nonce":2411788597},{"type":"v1","addr":"172.21.15.159:6803","nonce":2411788597}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6806","nonce":2411788597},{"type":"v1","addr":"172.21.15.159:6807","nonce":2411788597}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6804","nonce":2411788597},{"type":"v1","addr":"172.21.15.159:6805","nonce":2411788597}]},"public_addr":"172.21.15.159:6801/2411788597","cluster_addr":"172.21.15.159:6803/2411788597","heartbeat_back_addr":"172.21.15.159:6807/2411788597","heartbeat_front_addr":"172.21.15.159:6805/2411788597","state":["exists","up"]},{"osd":7,"uuid":"c1f4c7f2-8f75-4f95-bc63-a332773e3b8e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6824","nonce":478953349},{"type":"v1","addr":"172.21.15.159:6825","nonce":478953349}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6826","nonce":478953349},{"type":"v1","addr":"172.21.15.159:6827","nonce":478953349}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6830","nonce":478953349},{"type":"v1","addr":"172.21.15.159:6831","nonce":478953349}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6828","nonce":478953349},{"type":"v1","addr":"172.21.15.159:6829","nonce":478953349}]},"public_addr":"172.21.15.159:6825/478953349","cluster_addr":"172.21.15.159:6827/478953349","heartbeat_back_addr":"172.21.15.159:6831/478953349","heartbeat_front_addr":"172.21.15.159:6829/478953349","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T11:48:02.023567+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T11:48:02.278216+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T11:48:02.311843+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T11:48:01.773372+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T11:48:02.618910+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T11:48:02.361559+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T11:48:02.223997+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T11:48:02.604403+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-17T11:48:35.307 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:35.305+0000 7f3144c39640 1 -- 172.21.15.40:0/65251136 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f312006ae70 msgr2=0x7f312006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:35.307 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:35.305+0000 7f3144c39640 1 --2- 172.21.15.40:0/65251136 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f312006ae70 0x7f312006d330 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f314006be10 tx=0x7f3128009040 comp rx=0 tx=0).stop 2023-12-17T11:48:35.307 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:35.305+0000 7f3144c39640 1 -- 172.21.15.40:0/65251136 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3140070750 msgr2=0x7f3140151780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:35.307 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:35.305+0000 7f3144c39640 1 --2- 172.21.15.40:0/65251136 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3140070750 0x7f3140151780 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f313002b9a0 tx=0x7f3130004730 comp rx=0 tx=0).stop 2023-12-17T11:48:35.307 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:35.305+0000 7f3144c39640 1 -- 172.21.15.40:0/65251136 shutdown_connections 2023-12-17T11:48:35.307 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:35.305+0000 7f3144c39640 1 --2- 172.21.15.40:0/65251136 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f312006ae70 0x7f312006d330 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:35.307 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:35.305+0000 7f3144c39640 1 --2- 172.21.15.40:0/65251136 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3140159fd0 0x7f314009c2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:35.307 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:35.305+0000 7f3144c39640 1 --2- 172.21.15.40:0/65251136 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f31400713b0 0x7f314014b810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:35.308 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:35.305+0000 7f3144c39640 1 --2- 172.21.15.40:0/65251136 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3140070750 0x7f3140151780 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:35.308 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:35.305+0000 7f3144c39640 1 -- 172.21.15.40:0/65251136 >> 172.21.15.40:0/65251136 conn(0x7f31400b0860 msgr2=0x7f3140158df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:48:35.308 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:35.305+0000 7f3144c39640 1 -- 172.21.15.40:0/65251136 shutdown_connections 2023-12-17T11:48:35.308 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:35.305+0000 7f3144c39640 1 -- 172.21.15.40:0/65251136 wait complete. 2023-12-17T11:48:35.326 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-17T11:48:06.668943+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-17T11:48:16.151444+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-17T11:48:16.717726+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-12-17T11:48:20.534819+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-12-17T11:48:35.327 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-17T11:48:35.558 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:35.556+0000 7f6cec590640 1 Processor -- start 2023-12-17T11:48:35.558 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:35.556+0000 7f6cec590640 1 -- start start 2023-12-17T11:48:35.560 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:35.557+0000 7f6cec590640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6ce4072210 0x7f6ce4161530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:35.560 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:35.557+0000 7f6cec590640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f6ce4161a70 0x7f6ce40c92e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:35.560 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:35.557+0000 7f6cec590640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ce4160dc0 con 0x7f6ce415d0e0 2023-12-17T11:48:35.560 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:35.557+0000 7f6cec590640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ce40ceab0 con 0x7f6ce4161a70 2023-12-17T11:48:35.560 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:35.557+0000 7f6cec590640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ce4070280 con 0x7f6ce4072210 2023-12-17T11:48:35.560 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:35.558+0000 7f6cea32c640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f6ce415d0e0 0x7f6ce40ce3a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:39848/0 (socket says 172.21.15.40:39848) 2023-12-17T11:48:35.560 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:35.558+0000 7f6cea32c640 1 -- 172.21.15.40:0/1668148309 learned_addr learned my addr 172.21.15.40:0/1668148309 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-12-17T11:48:35.560 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:35.558+0000 7f6ceab2d640 1 --2- 172.21.15.40:0/1668148309 >> v2:172.21.15.159:3300/0 conn(0x7f6ce4161a70 0x7f6ce40c92e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:35.560 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:35.558+0000 7f6ce9b2b640 1 --2- 172.21.15.40:0/1668148309 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6ce4072210 0x7f6ce4161530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:35.561 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:35.558+0000 7f6ce932a640 1 -- 172.21.15.40:0/1668148309 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1833258821 0 0) 0x7f6ce4160dc0 con 0x7f6ce415d0e0 2023-12-17T11:48:35.561 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:35.558+0000 7f6ce932a640 1 -- 172.21.15.40:0/1668148309 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6cd0003520 con 0x7f6ce415d0e0 2023-12-17T11:48:35.561 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:35.559+0000 7f6ceab2d640 1 -- 172.21.15.40:0/1668148309 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6ce4072210 msgr2=0x7f6ce4161530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:48:35.561 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:35.559+0000 7f6ceab2d640 1 --2- 172.21.15.40:0/1668148309 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6ce4072210 0x7f6ce4161530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:35.561 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:35.559+0000 7f6ceab2d640 1 -- 172.21.15.40:0/1668148309 >> v1:172.21.15.40:6789/0 conn(0x7f6ce415d0e0 legacy=0x7f6ce40ce3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:35.561 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:35.559+0000 7f6ceab2d640 1 -- 172.21.15.40:0/1668148309 --> v2:172.21.15.159:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ce4070560 con 0x7f6ce4161a70 2023-12-17T11:48:35.562 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:35.560+0000 7f6ceab2d640 1 --2- 172.21.15.40:0/1668148309 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6ce4161a70 0x7f6ce40c92e0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f6cdc0097a0 tx=0x7f6cdc02b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=43b2ab467f4be1eb server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:48:35.562 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:35.561+0000 7f6ce932a640 1 -- 172.21.15.40:0/1668148309 <== mon.1 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cdc031830 con 0x7f6ce4161a70 2023-12-17T11:48:35.562 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:35.561+0000 7f6ce932a640 1 -- 172.21.15.40:0/1668148309 <== mon.1 v2:172.21.15.159:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6cdc031990 con 0x7f6ce4161a70 2023-12-17T11:48:35.563 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:35.561+0000 7f6ce932a640 1 -- 172.21.15.40:0/1668148309 <== mon.1 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cdc031d20 con 0x7f6ce4161a70 2023-12-17T11:48:35.563 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:35.561+0000 7f6cec590640 1 -- 172.21.15.40:0/1668148309 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6ce4161a70 msgr2=0x7f6ce40c92e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:35.563 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:35.561+0000 7f6cec590640 1 --2- 172.21.15.40:0/1668148309 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6ce4161a70 0x7f6ce40c92e0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f6cdc0097a0 tx=0x7f6cdc02b8d0 comp rx=0 tx=0).stop 2023-12-17T11:48:35.564 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:35.561+0000 7f6cec590640 1 -- 172.21.15.40:0/1668148309 shutdown_connections 2023-12-17T11:48:35.564 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:35.561+0000 7f6cec590640 1 --2- 172.21.15.40:0/1668148309 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6ce4161a70 0x7f6ce40c92e0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:35.564 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:35.561+0000 7f6cec590640 1 --2- 172.21.15.40:0/1668148309 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6ce4072210 0x7f6ce4161530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:35.564 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:35.561+0000 7f6cec590640 1 -- 172.21.15.40:0/1668148309 >> 172.21.15.40:0/1668148309 conn(0x7f6ce40cee70 msgr2=0x7f6ce40cf280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:48:35.564 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:35.562+0000 7f6cec590640 1 -- 172.21.15.40:0/1668148309 shutdown_connections 2023-12-17T11:48:35.564 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:35.562+0000 7f6cec590640 1 -- 172.21.15.40:0/1668148309 wait complete. 2023-12-17T11:48:35.565 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:35.563+0000 7f6cec590640 1 Processor -- start 2023-12-17T11:48:35.565 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:35.564+0000 7f6cec590640 1 -- start start 2023-12-17T11:48:35.567 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:35.565+0000 7f6cec590640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6ce4072210 0x7f6ce40c4490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:35.567 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:35.565+0000 7f6cec590640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6ce415d0e0 0x7f6ce415b910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:35.567 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:35.565+0000 7f6cec590640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6ce415be50 0x7f6ce40c3520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:35.567 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:35.565+0000 7f6cec590640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ce41e6c20 con 0x7f6ce415d0e0 2023-12-17T11:48:35.567 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:35.565+0000 7f6cec590640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ce40c72e0 con 0x7f6ce415be50 2023-12-17T11:48:35.567 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:35.565+0000 7f6cec590640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ce40c75c0 con 0x7f6ce4072210 2023-12-17T11:48:35.567 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:35.565+0000 7f6ce9b2b640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6ce415d0e0 0x7f6ce415b910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:35.567 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:35.565+0000 7f6ce9b2b640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6ce415d0e0 0x7f6ce415b910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:35020/0 (socket says 172.21.15.40:35020) 2023-12-17T11:48:35.567 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:35.565+0000 7f6ce9b2b640 1 -- 172.21.15.40:0/2007879237 learned_addr learned my addr 172.21.15.40:0/2007879237 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-17T11:48:35.568 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:35.565+0000 7f6cea32c640 1 --2- 172.21.15.40:0/2007879237 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6ce4072210 0x7f6ce40c4490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:35.568 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:35.565+0000 7f6ceab2d640 1 --2- 172.21.15.40:0/2007879237 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6ce415be50 0x7f6ce40c3520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:35.569 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:35.565+0000 7f6ce9b2b640 1 -- 172.21.15.40:0/2007879237 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6ce4072210 msgr2=0x7f6ce40c4490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:35.569 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:35.565+0000 7f6ce9b2b640 1 --2- 172.21.15.40:0/2007879237 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6ce4072210 0x7f6ce40c4490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:35.569 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:35.565+0000 7f6ce9b2b640 1 -- 172.21.15.40:0/2007879237 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6ce415be50 msgr2=0x7f6ce40c3520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:35.569 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:35.565+0000 7f6ce9b2b640 1 --2- 172.21.15.40:0/2007879237 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6ce415be50 0x7f6ce40c3520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:35.569 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:35.566+0000 7f6ce9b2b640 1 -- 172.21.15.40:0/2007879237 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cdc009400 con 0x7f6ce415d0e0 2023-12-17T11:48:35.569 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:35.566+0000 7f6ce9b2b640 1 --2- 172.21.15.40:0/2007879237 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6ce415d0e0 0x7f6ce415b910 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f6cd400e9b0 tx=0x7f6cd400ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:48:35.569 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:35.566+0000 7f6cdaffd640 1 -- 172.21.15.40:0/2007879237 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cd4009670 con 0x7f6ce415d0e0 2023-12-17T11:48:35.569 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:35.566+0000 7f6cdaffd640 1 -- 172.21.15.40:0/2007879237 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6cd400c9a0 con 0x7f6ce415d0e0 2023-12-17T11:48:35.569 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:35.566+0000 7f6cdaffd640 1 -- 172.21.15.40:0/2007879237 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cd400cd50 con 0x7f6ce415d0e0 2023-12-17T11:48:35.569 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:35.566+0000 7f6cec590640 1 -- 172.21.15.40:0/2007879237 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ce41e6e70 con 0x7f6ce415d0e0 2023-12-17T11:48:35.569 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:35.566+0000 7f6cec590640 1 -- 172.21.15.40:0/2007879237 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ce40c49d0 con 0x7f6ce415d0e0 2023-12-17T11:48:35.570 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:35.568+0000 7f6cec590640 1 -- 172.21.15.40:0/2007879237 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ce4074450 con 0x7f6ce415d0e0 2023-12-17T11:48:35.570 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:35.569+0000 7f6cdaffd640 1 -- 172.21.15.40:0/2007879237 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f6cd4013470 con 0x7f6ce415d0e0 2023-12-17T11:48:35.572 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:35.570+0000 7f6cdaffd640 1 --2- 172.21.15.40:0/2007879237 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f6cc806ae40 0x7f6cc806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:35.572 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:35.570+0000 7f6cdaffd640 1 -- 172.21.15.40:0/2007879237 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f6cd4089a80 con 0x7f6ce415d0e0 2023-12-17T11:48:35.573 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:35.571+0000 7f6cea32c640 1 --2- 172.21.15.40:0/2007879237 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f6cc806ae40 0x7f6cc806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:35.574 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:35.572+0000 7f6cea32c640 1 --2- 172.21.15.40:0/2007879237 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f6cc806ae40 0x7f6cc806d300 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f6ce0005c00 tx=0x7f6ce0009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:48:35.577 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:35.575+0000 7f6cdaffd640 1 -- 172.21.15.40:0/2007879237 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f6cd40548d0 con 0x7f6ce415d0e0 2023-12-17T11:48:35.767 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:35.765+0000 7f6cec590640 1 -- 172.21.15.40:0/2007879237 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f6ce40cae00 con 0x7f6ce415d0e0 2023-12-17T11:48:35.768 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:35.766+0000 7f6cdaffd640 1 -- 172.21.15.40:0/2007879237 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) v1 ==== 93+0+10 (secure 0 0 0) 0x7f6cd40170a0 con 0x7f6ce415d0e0 2023-12-17T11:48:35.768 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 1 2023-12-17T11:48:35.771 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:35.769+0000 7f6cec590640 1 -- 172.21.15.40:0/2007879237 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f6cc806ae40 msgr2=0x7f6cc806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:35.771 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:35.769+0000 7f6cec590640 1 --2- 172.21.15.40:0/2007879237 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f6cc806ae40 0x7f6cc806d300 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f6ce0005c00 tx=0x7f6ce0009040 comp rx=0 tx=0).stop 2023-12-17T11:48:35.771 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:35.769+0000 7f6cec590640 1 -- 172.21.15.40:0/2007879237 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6ce415d0e0 msgr2=0x7f6ce415b910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:35.771 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:35.769+0000 7f6cec590640 1 --2- 172.21.15.40:0/2007879237 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6ce415d0e0 0x7f6ce415b910 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f6cd400e9b0 tx=0x7f6cd400ee70 comp rx=0 tx=0).stop 2023-12-17T11:48:35.771 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:35.769+0000 7f6cec590640 1 -- 172.21.15.40:0/2007879237 shutdown_connections 2023-12-17T11:48:35.771 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:35.769+0000 7f6cec590640 1 --2- 172.21.15.40:0/2007879237 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f6cc806ae40 0x7f6cc806d300 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:35.771 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:35.769+0000 7f6cec590640 1 --2- 172.21.15.40:0/2007879237 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6ce415be50 0x7f6ce40c3520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:35.772 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:35.769+0000 7f6cec590640 1 --2- 172.21.15.40:0/2007879237 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6ce415d0e0 0x7f6ce415b910 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:35.772 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:35.769+0000 7f6cec590640 1 --2- 172.21.15.40:0/2007879237 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6ce4072210 0x7f6ce40c4490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:35.772 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:35.769+0000 7f6cec590640 1 -- 172.21.15.40:0/2007879237 >> 172.21.15.40:0/2007879237 conn(0x7f6ce40cee70 msgr2=0x7f6ce40730a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:48:35.772 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:35.769+0000 7f6cec590640 1 -- 172.21.15.40:0/2007879237 shutdown_connections 2023-12-17T11:48:35.772 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:35.769+0000 7f6cec590640 1 -- 172.21.15.40:0/2007879237 wait complete. 2023-12-17T11:48:35.790 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-17T11:48:36.013 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:36.011+0000 7fb7b8c1a640 1 Processor -- start 2023-12-17T11:48:36.014 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:36.012+0000 7fb7b8c1a640 1 -- start start 2023-12-17T11:48:36.016 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:36.013+0000 7fb7b8c1a640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fb7b40cece0 0x7fb7b40d1530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:36.016 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:36.013+0000 7fb7b8c1a640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7b40d3d70 con 0x7fb7b415d360 2023-12-17T11:48:36.016 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:36.013+0000 7fb7b8c1a640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7b40cdf20 con 0x7fb7b40d1a70 2023-12-17T11:48:36.016 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:36.013+0000 7fb7b8c1a640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7b40d1f00 con 0x7fb7b40cece0 2023-12-17T11:48:36.016 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:36.014+0000 7fb7abfff640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fb7b40cece0 0x7fb7b40d1530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:36.016 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:36.014+0000 7fb7b37fe640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fb7b415d360 0x7fb7b40d3660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:39862/0 (socket says 172.21.15.40:39862) 2023-12-17T11:48:36.016 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:36.014+0000 7fb7b37fe640 1 -- 172.21.15.40:0/859445552 learned_addr learned my addr 172.21.15.40:0/859445552 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-12-17T11:48:36.017 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:36.014+0000 7fb7abfff640 1 -- 172.21.15.40:0/859445552 >> v1:172.21.15.159:6789/0 conn(0x7fb7b40d1a70 legacy=0x7fb7b40b28b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:48:36.017 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:36.014+0000 7fb7abfff640 1 -- 172.21.15.40:0/859445552 >> v1:172.21.15.40:6789/0 conn(0x7fb7b415d360 legacy=0x7fb7b40d3660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:36.017 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:36.014+0000 7fb7abfff640 1 -- 172.21.15.40:0/859445552 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7b40ce200 con 0x7fb7b40cece0 2023-12-17T11:48:36.018 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:36.015+0000 7fb7abfff640 1 --2- 172.21.15.40:0/859445552 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb7b40cece0 0x7fb7b40d1530 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fb79c0097a0 tx=0x7fb79c02b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a0881c460de7340 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:48:36.018 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:36.016+0000 7fb7b2ffd640 1 -- 172.21.15.40:0/859445552 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb79c030610 con 0x7fb7b40cece0 2023-12-17T11:48:36.018 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:36.016+0000 7fb7b2ffd640 1 -- 172.21.15.40:0/859445552 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb79c030770 con 0x7fb7b40cece0 2023-12-17T11:48:36.018 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:36.016+0000 7fb7b2ffd640 1 -- 172.21.15.40:0/859445552 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb79c030b00 con 0x7fb7b40cece0 2023-12-17T11:48:36.019 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:36.016+0000 7fb7b8c1a640 1 -- 172.21.15.40:0/859445552 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb7b40cece0 msgr2=0x7fb7b40d1530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:36.019 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:36.016+0000 7fb7b8c1a640 1 --2- 172.21.15.40:0/859445552 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb7b40cece0 0x7fb7b40d1530 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fb79c0097a0 tx=0x7fb79c02b960 comp rx=0 tx=0).stop 2023-12-17T11:48:36.019 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:36.017+0000 7fb7b8c1a640 1 -- 172.21.15.40:0/859445552 shutdown_connections 2023-12-17T11:48:36.019 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:36.017+0000 7fb7b8c1a640 1 --2- 172.21.15.40:0/859445552 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb7b40cece0 0x7fb7b40d1530 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:36.019 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:36.017+0000 7fb7b8c1a640 1 -- 172.21.15.40:0/859445552 >> 172.21.15.40:0/859445552 conn(0x7fb7b409c230 msgr2=0x7fb7b40d2f50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:48:36.019 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:36.017+0000 7fb7b8c1a640 1 -- 172.21.15.40:0/859445552 shutdown_connections 2023-12-17T11:48:36.019 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:36.017+0000 7fb7b8c1a640 1 -- 172.21.15.40:0/859445552 wait complete. 2023-12-17T11:48:36.020 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:36.018+0000 7fb7b8c1a640 1 Processor -- start 2023-12-17T11:48:36.020 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:36.019+0000 7fb7b8c1a640 1 -- start start 2023-12-17T11:48:36.023 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:36.020+0000 7fb7b8c1a640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb7b40cece0 0x7fb7b40ccc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:36.023 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:36.020+0000 7fb7b8c1a640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb7b40d1a70 0x7fb7b4151360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:36.023 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:36.020+0000 7fb7b8c1a640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb7b415d360 0x7fb7b41f3120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:36.023 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:36.020+0000 7fb7b8c1a640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7b41518a0 con 0x7fb7b40cece0 2023-12-17T11:48:36.023 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:36.020+0000 7fb7b8c1a640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7b415fc10 con 0x7fb7b40d1a70 2023-12-17T11:48:36.023 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:36.020+0000 7fb7b8c1a640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7b415f000 con 0x7fb7b415d360 2023-12-17T11:48:36.023 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:36.020+0000 7fb7b37fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb7b40cece0 0x7fb7b40ccc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:36.023 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:36.020+0000 7fb7b37fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb7b40cece0 0x7fb7b40ccc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:35044/0 (socket says 172.21.15.40:35044) 2023-12-17T11:48:36.023 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:36.020+0000 7fb7b37fe640 1 -- 172.21.15.40:0/3686880544 learned_addr learned my addr 172.21.15.40:0/3686880544 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-17T11:48:36.024 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:36.020+0000 7fb7b37fe640 1 -- 172.21.15.40:0/3686880544 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb7b415d360 msgr2=0x7fb7b41f3120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:36.024 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:36.020+0000 7fb7b37fe640 1 --2- 172.21.15.40:0/3686880544 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb7b415d360 0x7fb7b41f3120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:36.024 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:36.020+0000 7fb7b37fe640 1 -- 172.21.15.40:0/3686880544 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb7b40d1a70 msgr2=0x7fb7b4151360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:36.024 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:36.020+0000 7fb7abfff640 1 --2- 172.21.15.40:0/3686880544 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb7b40d1a70 0x7fb7b4151360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:36.024 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:36.020+0000 7fb7b37fe640 1 --2- 172.21.15.40:0/3686880544 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb7b40d1a70 0x7fb7b4151360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:36.024 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:36.020+0000 7fb7b37fe640 1 -- 172.21.15.40:0/3686880544 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb79c009400 con 0x7fb7b40cece0 2023-12-17T11:48:36.024 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:36.021+0000 7fb7b37fe640 1 --2- 172.21.15.40:0/3686880544 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb7b40cece0 0x7fb7b40ccc90 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fb7a400c4a0 tx=0x7fb7a400c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:48:36.024 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:36.021+0000 7fb7b0ff9640 1 -- 172.21.15.40:0/3686880544 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7a4005ce0 con 0x7fb7b40cece0 2023-12-17T11:48:36.024 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:36.021+0000 7fb7b0ff9640 1 -- 172.21.15.40:0/3686880544 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7a4005e40 con 0x7fb7b40cece0 2023-12-17T11:48:36.024 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:36.021+0000 7fb7b0ff9640 1 -- 172.21.15.40:0/3686880544 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7a4007270 con 0x7fb7b40cece0 2023-12-17T11:48:36.024 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:36.021+0000 7fb7b8c1a640 1 -- 172.21.15.40:0/3686880544 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7b415f2e0 con 0x7fb7b40cece0 2023-12-17T11:48:36.024 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:36.021+0000 7fb7b8c1a640 1 -- 172.21.15.40:0/3686880544 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7b415f8a0 con 0x7fb7b40cece0 2023-12-17T11:48:36.025 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:36.022+0000 7fb7b8c1a640 1 -- 172.21.15.40:0/3686880544 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7b40678e0 con 0x7fb7b40cece0 2023-12-17T11:48:36.025 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:36.023+0000 7fb7b0ff9640 1 -- 172.21.15.40:0/3686880544 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fb7a4007490 con 0x7fb7b40cece0 2023-12-17T11:48:36.026 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:36.024+0000 7fb7b0ff9640 1 --2- 172.21.15.40:0/3686880544 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7fb79406ae40 0x7fb79406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:36.026 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:36.025+0000 7fb7b0ff9640 1 -- 172.21.15.40:0/3686880544 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fb7a4088dd0 con 0x7fb7b40cece0 2023-12-17T11:48:36.027 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:36.025+0000 7fb7abfff640 1 --2- 172.21.15.40:0/3686880544 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7fb79406ae40 0x7fb79406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:36.028 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:36.026+0000 7fb7abfff640 1 --2- 172.21.15.40:0/3686880544 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7fb79406ae40 0x7fb79406d300 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fb79c036000 tx=0x7fb79c03b040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:48:36.031 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:36.029+0000 7fb7b0ff9640 1 -- 172.21.15.40:0/3686880544 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fb7a4053c30 con 0x7fb7b40cece0 2023-12-17T11:48:36.227 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:36.224+0000 7fb7b8c1a640 1 -- 172.21.15.40:0/3686880544 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fb7b4074450 con 0x7fb7b40cece0 2023-12-17T11:48:36.227 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:36.226+0000 7fb7b0ff9640 1 -- 172.21.15.40:0/3686880544 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) v1 ==== 104+0+11 (secure 0 0 0) 0x7fb7a40170a0 con 0x7fb7b40cece0 2023-12-17T11:48:36.228 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 32 2023-12-17T11:48:36.230 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:36.228+0000 7fb7b8c1a640 1 -- 172.21.15.40:0/3686880544 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7fb79406ae40 msgr2=0x7fb79406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:36.230 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:36.228+0000 7fb7b8c1a640 1 --2- 172.21.15.40:0/3686880544 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7fb79406ae40 0x7fb79406d300 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fb79c036000 tx=0x7fb79c03b040 comp rx=0 tx=0).stop 2023-12-17T11:48:36.230 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:36.228+0000 7fb7b8c1a640 1 -- 172.21.15.40:0/3686880544 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb7b40cece0 msgr2=0x7fb7b40ccc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:36.230 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:36.228+0000 7fb7b8c1a640 1 --2- 172.21.15.40:0/3686880544 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb7b40cece0 0x7fb7b40ccc90 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fb7a400c4a0 tx=0x7fb7a400c960 comp rx=0 tx=0).stop 2023-12-17T11:48:36.230 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:36.228+0000 7fb7b8c1a640 1 -- 172.21.15.40:0/3686880544 shutdown_connections 2023-12-17T11:48:36.230 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:36.228+0000 7fb7b8c1a640 1 --2- 172.21.15.40:0/3686880544 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7fb79406ae40 0x7fb79406d300 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:36.231 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:36.228+0000 7fb7b8c1a640 1 --2- 172.21.15.40:0/3686880544 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb7b415d360 0x7fb7b41f3120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:36.231 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:36.228+0000 7fb7b8c1a640 1 --2- 172.21.15.40:0/3686880544 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb7b40d1a70 0x7fb7b4151360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:36.231 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:36.228+0000 7fb7b8c1a640 1 --2- 172.21.15.40:0/3686880544 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb7b40cece0 0x7fb7b40ccc90 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:36.231 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:36.228+0000 7fb7b8c1a640 1 -- 172.21.15.40:0/3686880544 >> 172.21.15.40:0/3686880544 conn(0x7fb7b409c230 msgr2=0x7fb7b40d3630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:48:36.231 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:36.228+0000 7fb7b8c1a640 1 -- 172.21.15.40:0/3686880544 shutdown_connections 2023-12-17T11:48:36.231 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:36.228+0000 7fb7b8c1a640 1 -- 172.21.15.40:0/3686880544 wait complete. 2023-12-17T11:48:36.249 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-17T11:48:36.481 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:36.479+0000 7fddf23ed640 1 Processor -- start 2023-12-17T11:48:36.482 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:36.479+0000 7fddf23ed640 1 -- start start 2023-12-17T11:48:36.483 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:36.481+0000 7fddf23ed640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fddec0cfe70 0x7fddec168530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:36.483 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:36.481+0000 7fddf23ed640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fddec0c6b80 con 0x7fddec0b3730 2023-12-17T11:48:36.483 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:36.481+0000 7fddf23ed640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fddec0d3bf0 con 0x7fddec0b3350 2023-12-17T11:48:36.483 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:36.481+0000 7fddf23ed640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fddec0d3ed0 con 0x7fddec0cfe70 2023-12-17T11:48:36.483 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:36.481+0000 7fddf0bea640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fddec0b3730 0x7fddec0cf760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:39876/0 (socket says 172.21.15.40:39876) 2023-12-17T11:48:36.483 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:36.481+0000 7fddf0bea640 1 -- 172.21.15.40:0/2948906773 learned_addr learned my addr 172.21.15.40:0/2948906773 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-12-17T11:48:36.485 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:36.482+0000 7fddf1bec640 1 --2- 172.21.15.40:0/2948906773 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fddec0cfe70 0x7fddec168530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:36.485 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:36.482+0000 7fdde3fff640 1 -- 172.21.15.40:0/2948906773 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 246486821 0 0) 0x7fddec0c6b80 con 0x7fddec0b3730 2023-12-17T11:48:36.486 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:36.482+0000 7fdde3fff640 1 -- 172.21.15.40:0/2948906773 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fddd8003520 con 0x7fddec0b3730 2023-12-17T11:48:36.486 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:36.482+0000 7fdde3fff640 1 -- 172.21.15.40:0/2948906773 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1896516247 0 0) 0x7fddd8003520 con 0x7fddec0b3730 2023-12-17T11:48:36.486 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:36.482+0000 7fdde3fff640 1 -- 172.21.15.40:0/2948906773 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fddec0cfe70 msgr2=0x7fddec168530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:48:36.486 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:36.482+0000 7fdde3fff640 1 --2- 172.21.15.40:0/2948906773 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fddec0cfe70 0x7fddec168530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:36.486 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:36.482+0000 7fdde3fff640 1 -- 172.21.15.40:0/2948906773 >> v1:172.21.15.159:6789/0 conn(0x7fddec0b3350 legacy=0x7fddec0b3ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:36.486 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:36.482+0000 7fdde3fff640 1 -- 172.21.15.40:0/2948906773 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddec0d18c0 con 0x7fddec0b3730 2023-12-17T11:48:36.486 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:36.482+0000 7fdde3fff640 1 -- 172.21.15.40:0/2948906773 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2643242555 0 0) 0x7fdddc001670 con 0x7fddec0b3730 2023-12-17T11:48:36.486 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:36.482+0000 7fddf1bec640 1 --2- 172.21.15.40:0/2948906773 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fddec0cfe70 0x7fddec168530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-17T11:48:36.486 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:36.482+0000 7fdde3fff640 1 -- 172.21.15.40:0/2948906773 >> v1:172.21.15.40:6789/0 conn(0x7fddec0b3730 legacy=0x7fddec0cf760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:36.486 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:36.482+0000 7fdde3fff640 1 --2- 172.21.15.40:0/2948906773 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fddec0cfe70 0x7fddd80039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:36.486 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:36.482+0000 7fdde3fff640 1 --2- 172.21.15.40:0/2948906773 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fddd8003f90 0x7fddd80047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:36.486 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:36.482+0000 7fdde3fff640 1 --2- 172.21.15.40:0/2948906773 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fddd8004d00 0x7fddd8005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:36.486 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:36.482+0000 7fdde3fff640 1 -- 172.21.15.40:0/2948906773 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddec0d3ed0 con 0x7fddd8003f90 2023-12-17T11:48:36.486 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:36.482+0000 7fdde3fff640 1 -- 172.21.15.40:0/2948906773 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddd800bae0 con 0x7fddd8004d00 2023-12-17T11:48:36.487 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:36.482+0000 7fdde3fff640 1 -- 172.21.15.40:0/2948906773 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fddd800bca0 con 0x7fddec0cfe70 2023-12-17T11:48:36.487 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:36.483+0000 7fddf0bea640 1 --2- 172.21.15.40:0/2948906773 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fddd8003f90 0x7fddd80047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:36.487 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:36.483+0000 7fddf1bec640 1 --2- 172.21.15.40:0/2948906773 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fddd8004d00 0x7fddd8005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:36.487 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:36.483+0000 7fddf13eb640 1 --2- 172.21.15.40:0/2948906773 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fddec0cfe70 0x7fddd80039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:36.487 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:36.483+0000 7fddf0bea640 1 -- 172.21.15.40:0/2948906773 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fddec0cfe70 msgr2=0x7fddd80039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:48:36.487 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:36.483+0000 7fddf0bea640 1 --2- 172.21.15.40:0/2948906773 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fddec0cfe70 0x7fddd80039a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:36.487 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:36.483+0000 7fddf0bea640 1 -- 172.21.15.40:0/2948906773 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fddd8004d00 msgr2=0x7fddd8005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:48:36.487 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:36.483+0000 7fddf0bea640 1 --2- 172.21.15.40:0/2948906773 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fddd8004d00 0x7fddd8005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:36.487 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:36.483+0000 7fddf0bea640 1 -- 172.21.15.40:0/2948906773 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddd8003520 con 0x7fddd8003f90 2023-12-17T11:48:36.487 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:36.483+0000 7fddf1bec640 1 --2- 172.21.15.40:0/2948906773 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fddd8004d00 0x7fddd8005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-17T11:48:36.489 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:36.484+0000 7fddf0bea640 1 --2- 172.21.15.40:0/2948906773 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fddd8003f90 0x7fddd80047c0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fdddc00c240 tx=0x7fddd80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=203367239ca56ab server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:48:36.489 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:36.485+0000 7fdde3fff640 1 -- 172.21.15.40:0/2948906773 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdddc005ad0 con 0x7fddd8003f90 2023-12-17T11:48:36.489 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:36.485+0000 7fdde3fff640 1 -- 172.21.15.40:0/2948906773 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdddc005c30 con 0x7fddd8003f90 2023-12-17T11:48:36.489 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:36.485+0000 7fdde3fff640 1 -- 172.21.15.40:0/2948906773 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdddc02ca50 con 0x7fddd8003f90 2023-12-17T11:48:36.489 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:36.485+0000 7fddf23ed640 1 -- 172.21.15.40:0/2948906773 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fddd8003f90 msgr2=0x7fddd80047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:36.489 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:36.485+0000 7fddf23ed640 1 --2- 172.21.15.40:0/2948906773 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fddd8003f90 0x7fddd80047c0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fdddc00c240 tx=0x7fddd80057f0 comp rx=0 tx=0).stop 2023-12-17T11:48:36.489 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:36.485+0000 7fddf1bec640 1 -- 172.21.15.40:0/2948906773 reap_dead start 2023-12-17T11:48:36.489 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:36.485+0000 7fddf23ed640 1 -- 172.21.15.40:0/2948906773 shutdown_connections 2023-12-17T11:48:36.490 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:36.485+0000 7fddf23ed640 1 -- 172.21.15.40:0/2948906773 >> 172.21.15.40:0/2948906773 conn(0x7fddec0d3030 msgr2=0x7fddec0d3440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:48:36.490 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:36.485+0000 7fddf23ed640 1 -- 172.21.15.40:0/2948906773 shutdown_connections 2023-12-17T11:48:36.490 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:36.486+0000 7fddf23ed640 1 -- 172.21.15.40:0/2948906773 wait complete. 2023-12-17T11:48:36.491 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:36.487+0000 7fddf23ed640 1 Processor -- start 2023-12-17T11:48:36.491 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:36.488+0000 7fddf23ed640 1 -- start start 2023-12-17T11:48:36.491 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:36.489+0000 7fddf23ed640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fddd8003f90 0x7fddec0b0b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:36.491 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:36.489+0000 7fddf23ed640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fddec0ca100 0x7fddec0cc720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:36.492 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:36.489+0000 7fddf23ed640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fddec15f340 0x7fddec15b3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:36.492 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:36.489+0000 7fddf23ed640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddec0b6da0 con 0x7fddec0ca100 2023-12-17T11:48:36.492 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:36.489+0000 7fddf23ed640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddec0ca560 con 0x7fddec15f340 2023-12-17T11:48:36.492 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:36.489+0000 7fddf23ed640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fddec0ccc60 con 0x7fddd8003f90 2023-12-17T11:48:36.492 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:36.489+0000 7fddf0bea640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fddec0ca100 0x7fddec0cc720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:36.492 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:36.489+0000 7fddf0bea640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fddec0ca100 0x7fddec0cc720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:35060/0 (socket says 172.21.15.40:35060) 2023-12-17T11:48:36.492 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:36.489+0000 7fddf0bea640 1 -- 172.21.15.40:0/2199285612 learned_addr learned my addr 172.21.15.40:0/2199285612 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-17T11:48:36.492 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:36.489+0000 7fddf1bec640 1 --2- 172.21.15.40:0/2199285612 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fddec15f340 0x7fddec15b3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:36.492 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:36.489+0000 7fddf13eb640 1 --2- 172.21.15.40:0/2199285612 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fddd8003f90 0x7fddec0b0b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:36.492 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:36.489+0000 7fddf0bea640 1 -- 172.21.15.40:0/2199285612 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fddd8003f90 msgr2=0x7fddec0b0b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:36.492 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:36.489+0000 7fddf0bea640 1 --2- 172.21.15.40:0/2199285612 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fddd8003f90 0x7fddec0b0b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:36.492 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:36.489+0000 7fddf0bea640 1 -- 172.21.15.40:0/2199285612 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fddec15f340 msgr2=0x7fddec15b3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:36.492 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:36.489+0000 7fddf0bea640 1 --2- 172.21.15.40:0/2199285612 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fddec15f340 0x7fddec15b3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:36.493 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:36.489+0000 7fddf0bea640 1 -- 172.21.15.40:0/2199285612 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddec0b48a0 con 0x7fddec0ca100 2023-12-17T11:48:36.493 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:36.489+0000 7fddf13eb640 1 --2- 172.21.15.40:0/2199285612 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fddd8003f90 0x7fddec0b0b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-17T11:48:36.493 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:36.489+0000 7fddf1bec640 1 --2- 172.21.15.40:0/2199285612 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fddec15f340 0x7fddec15b3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-17T11:48:36.494 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:36.490+0000 7fddf0bea640 1 --2- 172.21.15.40:0/2199285612 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fddec0ca100 0x7fddec0cc720 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fdddc00c240 tx=0x7fdddc001a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:48:36.494 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:36.490+0000 7fdde1ffb640 1 -- 172.21.15.40:0/2199285612 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdddc039070 con 0x7fddec0ca100 2023-12-17T11:48:36.494 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:36.490+0000 7fdde1ffb640 1 -- 172.21.15.40:0/2199285612 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdddc02cc20 con 0x7fddec0ca100 2023-12-17T11:48:36.494 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:36.490+0000 7fdde1ffb640 1 -- 172.21.15.40:0/2199285612 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdddc03c040 con 0x7fddec0ca100 2023-12-17T11:48:36.494 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:36.490+0000 7fddf23ed640 1 -- 172.21.15.40:0/2199285612 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fddec0ca7c0 con 0x7fddec0ca100 2023-12-17T11:48:36.494 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:36.490+0000 7fddf23ed640 1 -- 172.21.15.40:0/2199285612 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fddec0cad80 con 0x7fddec0ca100 2023-12-17T11:48:36.494 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:36.491+0000 7fddf23ed640 1 -- 172.21.15.40:0/2199285612 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fddec074450 con 0x7fddec0ca100 2023-12-17T11:48:36.494 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:36.492+0000 7fdde1ffb640 1 -- 172.21.15.40:0/2199285612 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fdddc032070 con 0x7fddec0ca100 2023-12-17T11:48:36.495 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:36.493+0000 7fdde1ffb640 1 --2- 172.21.15.40:0/2199285612 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7fddd006ae40 0x7fddd006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:36.495 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:36.493+0000 7fdde1ffb640 1 -- 172.21.15.40:0/2199285612 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fdddc0aace0 con 0x7fddec0ca100 2023-12-17T11:48:36.496 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:36.494+0000 7fddf13eb640 1 --2- 172.21.15.40:0/2199285612 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7fddd006ae40 0x7fddd006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:36.496 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:36.495+0000 7fddf13eb640 1 --2- 172.21.15.40:0/2199285612 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7fddd006ae40 0x7fddd006d300 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fdde80016f0 tx=0x7fdde8009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:48:36.499 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:36.498+0000 7fdde1ffb640 1 -- 172.21.15.40:0/2199285612 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fdddc075a90 con 0x7fddec0ca100 2023-12-17T11:48:36.693 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:36.691+0000 7fddf23ed640 1 -- 172.21.15.40:0/2199285612 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fddec0d36f0 con 0x7fddec0ca100 2023-12-17T11:48:36.694 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:36.692+0000 7fdde1ffb640 1 -- 172.21.15.40:0/2199285612 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) v1 ==== 100+0+11 (secure 0 0 0) 0x7fdddc0790b0 con 0x7fddec0ca100 2023-12-17T11:48:36.695 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 64 2023-12-17T11:48:36.697 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:36.695+0000 7fddf23ed640 1 -- 172.21.15.40:0/2199285612 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7fddd006ae40 msgr2=0x7fddd006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:36.697 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:36.695+0000 7fddf23ed640 1 --2- 172.21.15.40:0/2199285612 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7fddd006ae40 0x7fddd006d300 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fdde80016f0 tx=0x7fdde8009040 comp rx=0 tx=0).stop 2023-12-17T11:48:36.698 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:36.695+0000 7fddf23ed640 1 -- 172.21.15.40:0/2199285612 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fddec0ca100 msgr2=0x7fddec0cc720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:36.698 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:36.695+0000 7fddf23ed640 1 --2- 172.21.15.40:0/2199285612 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fddec0ca100 0x7fddec0cc720 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fdddc00c240 tx=0x7fdddc001a00 comp rx=0 tx=0).stop 2023-12-17T11:48:36.698 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:36.695+0000 7fddf23ed640 1 -- 172.21.15.40:0/2199285612 shutdown_connections 2023-12-17T11:48:36.698 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:36.695+0000 7fddf23ed640 1 --2- 172.21.15.40:0/2199285612 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7fddd006ae40 0x7fddd006d300 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:36.698 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:36.695+0000 7fddf23ed640 1 --2- 172.21.15.40:0/2199285612 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fddec15f340 0x7fddec15b3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:36.698 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:36.695+0000 7fddf23ed640 1 --2- 172.21.15.40:0/2199285612 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fddec0ca100 0x7fddec0cc720 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:36.698 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:36.695+0000 7fddf23ed640 1 --2- 172.21.15.40:0/2199285612 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fddd8003f90 0x7fddec0b0b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:36.698 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:36.695+0000 7fddf23ed640 1 -- 172.21.15.40:0/2199285612 >> 172.21.15.40:0/2199285612 conn(0x7fddec0d3030 msgr2=0x7fddec0cece0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:48:36.698 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:36.696+0000 7fddf23ed640 1 -- 172.21.15.40:0/2199285612 shutdown_connections 2023-12-17T11:48:36.698 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:36.696+0000 7fddf23ed640 1 -- 172.21.15.40:0/2199285612 wait complete. 2023-12-17T11:48:36.717 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-12-17T11:48:36.944 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:36.942+0000 7f46e2e3d640 1 Processor -- start 2023-12-17T11:48:36.944 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:36.942+0000 7f46e2e3d640 1 -- start start 2023-12-17T11:48:36.946 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:36.943+0000 7f46e2e3d640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f46dc15d5f0 0x7f46dc0d1d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:36.946 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:36.943+0000 7f46e2e3d640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f46dc0d0200 0x7f46dc0cdca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:36.946 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:36.943+0000 7f46e2e3d640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46dc0d3ee0 con 0x7f46dc0d3a50 2023-12-17T11:48:36.946 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:36.944+0000 7f46e2e3d640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46dc15e620 con 0x7f46dc0d0200 2023-12-17T11:48:36.946 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:36.944+0000 7f46e2e3d640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46dc15ea40 con 0x7f46dc15d5f0 2023-12-17T11:48:36.946 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:36.944+0000 7f46dbfff640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f46dc0d3a50 0x7f46dc0cfaf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:39878/0 (socket says 172.21.15.40:39878) 2023-12-17T11:48:36.946 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:36.944+0000 7f46dbfff640 1 -- 172.21.15.40:0/401779581 learned_addr learned my addr 172.21.15.40:0/401779581 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-12-17T11:48:36.946 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:36.944+0000 7f46e13da640 1 --2- 172.21.15.40:0/401779581 >> v2:172.21.15.40:3300/0 conn(0x7f46dc0d0200 0x7f46dc0cdca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:36.946 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:36.944+0000 7f46e0bd9640 1 --2- 172.21.15.40:0/401779581 >> v2:172.21.15.159:3300/0 conn(0x7f46dc15d5f0 0x7f46dc0d1d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:36.947 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:36.944+0000 7f46db7fe640 1 -- 172.21.15.40:0/401779581 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2732905957 0 0) 0x7f46dc0d3ee0 con 0x7f46dc0d3a50 2023-12-17T11:48:36.947 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:36.944+0000 7f46e13da640 1 -- 172.21.15.40:0/401779581 >> v2:172.21.15.159:3300/0 conn(0x7f46dc15d5f0 msgr2=0x7f46dc0d1d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:48:36.947 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:36.944+0000 7f46e13da640 1 --2- 172.21.15.40:0/401779581 >> v2:172.21.15.159:3300/0 conn(0x7f46dc15d5f0 0x7f46dc0d1d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:36.947 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:36.944+0000 7f46e13da640 1 -- 172.21.15.40:0/401779581 >> v1:172.21.15.40:6789/0 conn(0x7f46dc0d3a50 legacy=0x7f46dc0cfaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:36.947 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:36.944+0000 7f46e13da640 1 -- 172.21.15.40:0/401779581 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46dc0b2300 con 0x7f46dc0d0200 2023-12-17T11:48:36.948 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:36.945+0000 7f46e13da640 1 --2- 172.21.15.40:0/401779581 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f46dc0d0200 0x7f46dc0cdca0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f46dc0b5cb0 tx=0x7f46d402b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80617234799dee42 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:48:36.948 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:36.946+0000 7f46db7fe640 1 -- 172.21.15.40:0/401779581 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46d402e070 con 0x7f46dc0d0200 2023-12-17T11:48:36.948 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:36.946+0000 7f46db7fe640 1 -- 172.21.15.40:0/401779581 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46d40315a0 con 0x7f46dc0d0200 2023-12-17T11:48:36.948 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:36.946+0000 7f46db7fe640 1 -- 172.21.15.40:0/401779581 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46d4031930 con 0x7f46dc0d0200 2023-12-17T11:48:36.949 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:36.946+0000 7f46e2e3d640 1 -- 172.21.15.40:0/401779581 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f46dc0d0200 msgr2=0x7f46dc0cdca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:36.949 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:36.946+0000 7f46e2e3d640 1 --2- 172.21.15.40:0/401779581 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f46dc0d0200 0x7f46dc0cdca0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f46dc0b5cb0 tx=0x7f46d402b840 comp rx=0 tx=0).stop 2023-12-17T11:48:36.949 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:36.946+0000 7f46e2e3d640 1 -- 172.21.15.40:0/401779581 shutdown_connections 2023-12-17T11:48:36.949 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:36.946+0000 7f46e2e3d640 1 --2- 172.21.15.40:0/401779581 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f46dc0d0200 0x7f46dc0cdca0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:36.949 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:36.946+0000 7f46e2e3d640 1 --2- 172.21.15.40:0/401779581 >> v2:172.21.15.159:3300/0 conn(0x7f46dc15d5f0 0x7f46dc0d1d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:36.949 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:36.946+0000 7f46e2e3d640 1 -- 172.21.15.40:0/401779581 >> 172.21.15.40:0/401779581 conn(0x7f46dc09c450 msgr2=0x7f46dc0d3120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:48:36.949 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:36.947+0000 7f46e2e3d640 1 -- 172.21.15.40:0/401779581 shutdown_connections 2023-12-17T11:48:36.949 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:36.947+0000 7f46e2e3d640 1 -- 172.21.15.40:0/401779581 wait complete. 2023-12-17T11:48:36.950 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:36.948+0000 7f46e2e3d640 1 Processor -- start 2023-12-17T11:48:36.950 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:36.948+0000 7f46e2e3d640 1 -- start start 2023-12-17T11:48:36.952 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:36.949+0000 7f46e2e3d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f46dc0d0200 0x7f46dc14f4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:36.952 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:36.949+0000 7f46e2e3d640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f46dc0d3a50 0x7f46dc0b3700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:36.952 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:36.949+0000 7f46e2e3d640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f46dc15d5f0 0x7f46dc0b43b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:36.952 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:36.949+0000 7f46e2e3d640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46dc15c3c0 con 0x7f46dc0d0200 2023-12-17T11:48:36.952 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:36.949+0000 7f46e2e3d640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46dc0b3270 con 0x7f46dc15d5f0 2023-12-17T11:48:36.952 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:36.949+0000 7f46e2e3d640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46dc0b2660 con 0x7f46dc0d3a50 2023-12-17T11:48:36.953 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:36.950+0000 7f46e0bd9640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f46dc0d0200 0x7f46dc14f4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:36.953 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:36.950+0000 7f46e0bd9640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f46dc0d0200 0x7f46dc14f4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:35064/0 (socket says 172.21.15.40:35064) 2023-12-17T11:48:36.953 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:36.950+0000 7f46e0bd9640 1 -- 172.21.15.40:0/1997205457 learned_addr learned my addr 172.21.15.40:0/1997205457 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-17T11:48:36.953 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:36.950+0000 7f46dbfff640 1 --2- 172.21.15.40:0/1997205457 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f46dc0d3a50 0x7f46dc0b3700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:36.953 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:36.950+0000 7f46e13da640 1 --2- 172.21.15.40:0/1997205457 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f46dc15d5f0 0x7f46dc0b43b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:36.953 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:36.950+0000 7f46e0bd9640 1 -- 172.21.15.40:0/1997205457 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f46dc0d3a50 msgr2=0x7f46dc0b3700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:36.953 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:36.950+0000 7f46e0bd9640 1 --2- 172.21.15.40:0/1997205457 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f46dc0d3a50 0x7f46dc0b3700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:36.953 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:36.950+0000 7f46e0bd9640 1 -- 172.21.15.40:0/1997205457 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f46dc15d5f0 msgr2=0x7f46dc0b43b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:36.954 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:36.950+0000 7f46e0bd9640 1 --2- 172.21.15.40:0/1997205457 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f46dc15d5f0 0x7f46dc0b43b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:36.954 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:36.950+0000 7f46e0bd9640 1 -- 172.21.15.40:0/1997205457 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46d4009400 con 0x7f46dc0d0200 2023-12-17T11:48:36.954 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:36.951+0000 7f46e0bd9640 1 --2- 172.21.15.40:0/1997205457 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f46dc0d0200 0x7f46dc14f4f0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f46cc007e70 tx=0x7f46cc00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:48:36.954 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:36.951+0000 7f46d97fa640 1 -- 172.21.15.40:0/1997205457 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46cc014620 con 0x7f46dc0d0200 2023-12-17T11:48:36.955 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:36.951+0000 7f46d97fa640 1 -- 172.21.15.40:0/1997205457 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46cc014780 con 0x7f46dc0d0200 2023-12-17T11:48:36.955 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:36.951+0000 7f46d97fa640 1 -- 172.21.15.40:0/1997205457 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46cc014b30 con 0x7f46dc0d0200 2023-12-17T11:48:36.955 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:36.951+0000 7f46e2e3d640 1 -- 172.21.15.40:0/1997205457 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46dc0b2940 con 0x7f46dc0d0200 2023-12-17T11:48:36.955 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:36.951+0000 7f46e2e3d640 1 -- 172.21.15.40:0/1997205457 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46dc0b2f00 con 0x7f46dc0d0200 2023-12-17T11:48:36.955 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:36.952+0000 7f46e2e3d640 1 -- 172.21.15.40:0/1997205457 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46dc0745d0 con 0x7f46dc0d0200 2023-12-17T11:48:36.955 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:36.953+0000 7f46d97fa640 1 -- 172.21.15.40:0/1997205457 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f46cc014c90 con 0x7f46dc0d0200 2023-12-17T11:48:36.956 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:36.954+0000 7f46d97fa640 1 --2- 172.21.15.40:0/1997205457 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f46bc06ae40 0x7f46bc06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:36.956 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:36.954+0000 7f46d97fa640 1 -- 172.21.15.40:0/1997205457 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f46cc08a340 con 0x7f46dc0d0200 2023-12-17T11:48:36.956 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:36.955+0000 7f46dbfff640 1 --2- 172.21.15.40:0/1997205457 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f46bc06ae40 0x7f46bc06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:36.957 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:36.956+0000 7f46dbfff640 1 --2- 172.21.15.40:0/1997205457 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f46bc06ae40 0x7f46bc06d300 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f46dc160e40 tx=0x7f46c4009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:48:36.960 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:36.958+0000 7f46d97fa640 1 -- 172.21.15.40:0/1997205457 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f46cc055060 con 0x7f46dc0d0200 2023-12-17T11:48:37.011 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T11:48:37.020 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T11:48:37.161 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:37.159+0000 7f46e2e3d640 1 -- 172.21.15.40:0/1997205457 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f46dc0d3830 con 0x7f46dc0d0200 2023-12-17T11:48:37.161 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:37.159+0000 7f46d97fa640 1 -- 172.21.15.40:0/1997205457 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v25) v1 ==== 103+0+11 (secure 0 0 0) 0x7f46cc058680 con 0x7f46dc0d0200 2023-12-17T11:48:37.162 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 32 2023-12-17T11:48:37.164 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:37.162+0000 7f46e2e3d640 1 -- 172.21.15.40:0/1997205457 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f46bc06ae40 msgr2=0x7f46bc06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:37.164 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:37.162+0000 7f46e2e3d640 1 --2- 172.21.15.40:0/1997205457 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f46bc06ae40 0x7f46bc06d300 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f46dc160e40 tx=0x7f46c4009040 comp rx=0 tx=0).stop 2023-12-17T11:48:37.164 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:37.162+0000 7f46e2e3d640 1 -- 172.21.15.40:0/1997205457 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f46dc0d0200 msgr2=0x7f46dc14f4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:37.164 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:37.162+0000 7f46e2e3d640 1 --2- 172.21.15.40:0/1997205457 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f46dc0d0200 0x7f46dc14f4f0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f46cc007e70 tx=0x7f46cc00e4b0 comp rx=0 tx=0).stop 2023-12-17T11:48:37.164 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:37.162+0000 7f46e2e3d640 1 -- 172.21.15.40:0/1997205457 shutdown_connections 2023-12-17T11:48:37.164 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:37.162+0000 7f46e2e3d640 1 --2- 172.21.15.40:0/1997205457 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f46bc06ae40 0x7f46bc06d300 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:37.164 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:37.162+0000 7f46e2e3d640 1 --2- 172.21.15.40:0/1997205457 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f46dc15d5f0 0x7f46dc0b43b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:37.164 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:37.162+0000 7f46e2e3d640 1 --2- 172.21.15.40:0/1997205457 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f46dc0d3a50 0x7f46dc0b3700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:37.165 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:37.162+0000 7f46e2e3d640 1 --2- 172.21.15.40:0/1997205457 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f46dc0d0200 0x7f46dc14f4f0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:37.165 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:37.162+0000 7f46e2e3d640 1 -- 172.21.15.40:0/1997205457 >> 172.21.15.40:0/1997205457 conn(0x7f46dc09c450 msgr2=0x7f46dc0b7d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:48:37.165 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:37.162+0000 7f46e2e3d640 1 -- 172.21.15.40:0/1997205457 shutdown_connections 2023-12-17T11:48:37.165 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:37.162+0000 7f46e2e3d640 1 -- 172.21.15.40:0/1997205457 wait complete. 2023-12-17T11:48:37.184 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-17T11:48:37.443 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:37.441+0000 7fd87e490640 1 Processor -- start 2023-12-17T11:48:37.443 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:37.441+0000 7fd87e490640 1 -- start start 2023-12-17T11:48:37.445 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:37.442+0000 7fd87e490640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7fd8780cfb20 0x7fd8780cff60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:37.445 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:37.442+0000 7fd87e490640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fd87815cd60 0x7fd87815d1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:37.445 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:37.442+0000 7fd87e490640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8780d04a0 con 0x7fd8781609b0 2023-12-17T11:48:37.445 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:37.442+0000 7fd87e490640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd878160d90 con 0x7fd87815cd60 2023-12-17T11:48:37.445 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:37.442+0000 7fd87e490640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd87815dd60 con 0x7fd8780cfb20 2023-12-17T11:48:37.445 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:37.443+0000 7fd87ca2d640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fd87815cd60 0x7fd87815d1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:37.445 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:37.443+0000 7fd877fff640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fd8781609b0 0x7fd8780d0ce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:39886/0 (socket says 172.21.15.40:39886) 2023-12-17T11:48:37.445 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:37.443+0000 7fd877fff640 1 -- 172.21.15.40:0/3380447650 learned_addr learned my addr 172.21.15.40:0/3380447650 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-12-17T11:48:37.445 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:37.443+0000 7fd86ffff640 1 --2- 172.21.15.40:0/3380447650 >> v2:172.21.15.159:3300/0 conn(0x7fd8780cfb20 0x7fd8780cff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:37.446 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:37.443+0000 7fd87ca2d640 1 -- 172.21.15.40:0/3380447650 >> v2:172.21.15.159:3300/0 conn(0x7fd8780cfb20 msgr2=0x7fd8780cff60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:48:37.446 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:37.443+0000 7fd87ca2d640 1 --2- 172.21.15.40:0/3380447650 >> v2:172.21.15.159:3300/0 conn(0x7fd8780cfb20 0x7fd8780cff60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:37.446 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:37.443+0000 7fd87ca2d640 1 -- 172.21.15.40:0/3380447650 >> v1:172.21.15.40:6789/0 conn(0x7fd8781609b0 legacy=0x7fd8780d0ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:37.446 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:37.443+0000 7fd8777fe640 1 -- 172.21.15.40:0/3380447650 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1170535884 0 0) 0x7fd8780d04a0 con 0x7fd8781609b0 2023-12-17T11:48:37.446 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:37.443+0000 7fd87ca2d640 1 -- 172.21.15.40:0/3380447650 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd87815e040 con 0x7fd87815cd60 2023-12-17T11:48:37.447 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:37.445+0000 7fd87ca2d640 1 --2- 172.21.15.40:0/3380447650 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd87815cd60 0x7fd87815d1b0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fd87808d680 tx=0x7fd87002bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=102252be3a43771f server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:48:37.447 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:37.446+0000 7fd8777fe640 1 -- 172.21.15.40:0/3380447650 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd87002cc80 con 0x7fd87815cd60 2023-12-17T11:48:37.448 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:37.446+0000 7fd8777fe640 1 -- 172.21.15.40:0/3380447650 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd87002cde0 con 0x7fd87815cd60 2023-12-17T11:48:37.448 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:37.446+0000 7fd8777fe640 1 -- 172.21.15.40:0/3380447650 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd870034660 con 0x7fd87815cd60 2023-12-17T11:48:37.448 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:37.446+0000 7fd87e490640 1 -- 172.21.15.40:0/3380447650 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd87815cd60 msgr2=0x7fd87815d1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:37.449 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:37.446+0000 7fd87e490640 1 --2- 172.21.15.40:0/3380447650 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd87815cd60 0x7fd87815d1b0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fd87808d680 tx=0x7fd87002bed0 comp rx=0 tx=0).stop 2023-12-17T11:48:37.449 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:37.446+0000 7fd87e490640 1 -- 172.21.15.40:0/3380447650 shutdown_connections 2023-12-17T11:48:37.449 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:37.446+0000 7fd87e490640 1 --2- 172.21.15.40:0/3380447650 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd87815cd60 0x7fd87815d1b0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:37.449 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:37.446+0000 7fd87e490640 1 --2- 172.21.15.40:0/3380447650 >> v2:172.21.15.159:3300/0 conn(0x7fd8780cfb20 0x7fd8780cff60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:37.449 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:37.446+0000 7fd87e490640 1 -- 172.21.15.40:0/3380447650 >> 172.21.15.40:0/3380447650 conn(0x7fd87809c450 msgr2=0x7fd8780d3110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:48:37.449 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:37.447+0000 7fd87e490640 1 -- 172.21.15.40:0/3380447650 shutdown_connections 2023-12-17T11:48:37.449 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:37.447+0000 7fd87e490640 1 -- 172.21.15.40:0/3380447650 wait complete. 2023-12-17T11:48:37.450 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:37.448+0000 7fd87e490640 1 Processor -- start 2023-12-17T11:48:37.450 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:37.448+0000 7fd87e490640 1 -- start start 2023-12-17T11:48:37.452 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:37.449+0000 7fd87e490640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd8780cfb20 0x7fd87815a440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:37.452 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:37.449+0000 7fd87e490640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd87815cd60 0x7fd8781543e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:37.453 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:37.449+0000 7fd87e490640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd8781609b0 0x7fd878154920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:37.453 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:37.449+0000 7fd87e490640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8780b6360 con 0x7fd87815cd60 2023-12-17T11:48:37.453 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:37.449+0000 7fd87e490640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8780b5d30 con 0x7fd8780cfb20 2023-12-17T11:48:37.453 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:37.449+0000 7fd87e490640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8780cae60 con 0x7fd8781609b0 2023-12-17T11:48:37.453 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:37.450+0000 7fd86ffff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd87815cd60 0x7fd8781543e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:37.453 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:37.450+0000 7fd86ffff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd87815cd60 0x7fd8781543e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:35082/0 (socket says 172.21.15.40:35082) 2023-12-17T11:48:37.453 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:37.450+0000 7fd86ffff640 1 -- 172.21.15.40:0/971641130 learned_addr learned my addr 172.21.15.40:0/971641130 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-17T11:48:37.453 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:37.450+0000 7fd877fff640 1 --2- 172.21.15.40:0/971641130 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd8780cfb20 0x7fd87815a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:37.453 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:37.450+0000 7fd87ca2d640 1 --2- 172.21.15.40:0/971641130 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd8781609b0 0x7fd878154920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:37.453 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:37.450+0000 7fd86ffff640 1 -- 172.21.15.40:0/971641130 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd8781609b0 msgr2=0x7fd878154920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:37.453 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:37.450+0000 7fd86ffff640 1 --2- 172.21.15.40:0/971641130 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd8781609b0 0x7fd878154920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:37.453 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:37.450+0000 7fd86ffff640 1 -- 172.21.15.40:0/971641130 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd8780cfb20 msgr2=0x7fd87815a440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:37.454 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:37.450+0000 7fd86ffff640 1 --2- 172.21.15.40:0/971641130 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd8780cfb20 0x7fd87815a440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:37.454 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:37.450+0000 7fd86ffff640 1 -- 172.21.15.40:0/971641130 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd870009a70 con 0x7fd87815cd60 2023-12-17T11:48:37.454 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:37.450+0000 7fd87ca2d640 1 --2- 172.21.15.40:0/971641130 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd8781609b0 0x7fd878154920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-17T11:48:37.454 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:37.451+0000 7fd86ffff640 1 --2- 172.21.15.40:0/971641130 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd87815cd60 0x7fd8781543e0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fd86000d5f0 tx=0x7fd86000dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:48:37.454 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:37.451+0000 7fd8757fa640 1 -- 172.21.15.40:0/971641130 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8600125f0 con 0x7fd87815cd60 2023-12-17T11:48:37.454 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:37.451+0000 7fd8757fa640 1 -- 172.21.15.40:0/971641130 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd860012750 con 0x7fd87815cd60 2023-12-17T11:48:37.455 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:37.451+0000 7fd87e490640 1 -- 172.21.15.40:0/971641130 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8780cb140 con 0x7fd87815cd60 2023-12-17T11:48:37.455 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:37.451+0000 7fd8757fa640 1 -- 172.21.15.40:0/971641130 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd860012b00 con 0x7fd87815cd60 2023-12-17T11:48:37.455 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:37.451+0000 7fd87e490640 1 -- 172.21.15.40:0/971641130 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd87815a980 con 0x7fd87815cd60 2023-12-17T11:48:37.455 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:37.452+0000 7fd87e490640 1 -- 172.21.15.40:0/971641130 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd87815ab40 con 0x7fd87815cd60 2023-12-17T11:48:37.455 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:37.453+0000 7fd8757fa640 1 -- 172.21.15.40:0/971641130 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fd860012c60 con 0x7fd87815cd60 2023-12-17T11:48:37.456 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:37.454+0000 7fd8757fa640 1 --2- 172.21.15.40:0/971641130 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7fd85806ae40 0x7fd85806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:37.456 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:37.454+0000 7fd8757fa640 1 -- 172.21.15.40:0/971641130 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fd860089ea0 con 0x7fd87815cd60 2023-12-17T11:48:37.456 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:37.455+0000 7fd877fff640 1 --2- 172.21.15.40:0/971641130 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7fd85806ae40 0x7fd85806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:37.457 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:37.456+0000 7fd877fff640 1 --2- 172.21.15.40:0/971641130 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7fd85806ae40 0x7fd85806d300 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fd868000f60 tx=0x7fd868007b50 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:48:37.460 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:37.459+0000 7fd8757fa640 1 -- 172.21.15.40:0/971641130 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fd860054bd0 con 0x7fd87815cd60 2023-12-17T11:48:37.672 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:37.670+0000 7fd87e490640 1 -- 172.21.15.40:0/971641130 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fd8780745d0 con 0x7fd87815cd60 2023-12-17T11:48:37.673 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:37.671+0000 7fd8757fa640 1 -- 172.21.15.40:0/971641130 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v25) v1 ==== 80+0+0 (secure 0 0 0) 0x7fd8600581f0 con 0x7fd87815cd60 2023-12-17T11:48:37.673 INFO:teuthology.orchestra.run.smithi040.stderr:listed 0 entries 2023-12-17T11:48:37.675 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:37.673+0000 7fd87e490640 1 -- 172.21.15.40:0/971641130 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7fd85806ae40 msgr2=0x7fd85806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:37.675 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:37.673+0000 7fd87e490640 1 --2- 172.21.15.40:0/971641130 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7fd85806ae40 0x7fd85806d300 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fd868000f60 tx=0x7fd868007b50 comp rx=0 tx=0).stop 2023-12-17T11:48:37.676 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:37.673+0000 7fd87e490640 1 -- 172.21.15.40:0/971641130 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd87815cd60 msgr2=0x7fd8781543e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:37.676 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:37.673+0000 7fd87e490640 1 --2- 172.21.15.40:0/971641130 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd87815cd60 0x7fd8781543e0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fd86000d5f0 tx=0x7fd86000dab0 comp rx=0 tx=0).stop 2023-12-17T11:48:37.676 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:37.673+0000 7fd87e490640 1 -- 172.21.15.40:0/971641130 shutdown_connections 2023-12-17T11:48:37.676 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:37.673+0000 7fd87e490640 1 --2- 172.21.15.40:0/971641130 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7fd85806ae40 0x7fd85806d300 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:37.676 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:37.673+0000 7fd87e490640 1 --2- 172.21.15.40:0/971641130 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd8781609b0 0x7fd878154920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:37.676 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:37.673+0000 7fd87e490640 1 --2- 172.21.15.40:0/971641130 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd87815cd60 0x7fd8781543e0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:37.676 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:37.673+0000 7fd87e490640 1 --2- 172.21.15.40:0/971641130 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd8780cfb20 0x7fd87815a440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:37.676 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:37.673+0000 7fd87e490640 1 -- 172.21.15.40:0/971641130 >> 172.21.15.40:0/971641130 conn(0x7fd87809c450 msgr2=0x7fd8780d3110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:48:37.676 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:37.673+0000 7fd87e490640 1 -- 172.21.15.40:0/971641130 shutdown_connections 2023-12-17T11:48:37.676 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:37.673+0000 7fd87e490640 1 -- 172.21.15.40:0/971641130 wait complete. 2023-12-17T11:48:37.697 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi040.front.sepia.ceph.com... 2023-12-17T11:48:37.697 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-17T11:48:37.698 DEBUG:teuthology.orchestra.run.smithi040:> sudo fusermount -u /home/ubuntu/cephtest/mnt.admin 2023-12-17T11:48:37.781 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi040.stderr:ceph-fuse[95122]: fuse finished with error 0 and tester_r 0 2023-12-17T11:48:37.796 INFO:teuthology.orchestra.run:waiting for 300 2023-12-17T11:48:37.827 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi040.front.sepia.ceph.com 2023-12-17T11:48:37.827 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-17T11:48:37.827 DEBUG:teuthology.orchestra.run.smithi040:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.admin) 2023-12-17T11:48:37.932 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-17T11:48:38.131 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:38.129+0000 7fc12801e640 1 Processor -- start 2023-12-17T11:48:38.131 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:38.129+0000 7fc12801e640 1 -- start start 2023-12-17T11:48:38.133 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:38.130+0000 7fc12801e640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7fc120143e00 0x7fc1200b4040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:38.133 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:38.130+0000 7fc12801e640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fc12006c410 0x7fc12015ecb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:38.133 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:38.130+0000 7fc12801e640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1200b3bb0 con 0x7fc120072180 2023-12-17T11:48:38.133 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:38.130+0000 7fc12801e640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1201441e0 con 0x7fc12006c410 2023-12-17T11:48:38.133 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:38.130+0000 7fc12801e640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc120072680 con 0x7fc120143e00 2023-12-17T11:48:38.133 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:38.130+0000 7fc1265bb640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fc12006c410 0x7fc12015ecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:38.133 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:38.131+0000 7fc1265bb640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fc12006c410 0x7fc12015ecb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:35094/0 (socket says 172.21.15.40:35094) 2023-12-17T11:48:38.133 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:38.131+0000 7fc1265bb640 1 -- 172.21.15.40:0/3816076885 learned_addr learned my addr 172.21.15.40:0/3816076885 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-17T11:48:38.133 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:38.131+0000 7fc125dba640 1 --2- 172.21.15.40:0/3816076885 >> v2:172.21.15.159:3300/0 conn(0x7fc120143e00 0x7fc1200b4040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:38.133 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:38.131+0000 7fc1265bb640 1 -- 172.21.15.40:0/3816076885 >> v2:172.21.15.159:3300/0 conn(0x7fc120143e00 msgr2=0x7fc1200b4040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:48:38.134 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:38.131+0000 7fc1265bb640 1 --2- 172.21.15.40:0/3816076885 >> v2:172.21.15.159:3300/0 conn(0x7fc120143e00 0x7fc1200b4040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:38.134 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:38.131+0000 7fc1265bb640 1 -- 172.21.15.40:0/3816076885 >> v1:172.21.15.40:6789/0 conn(0x7fc120072180 legacy=0x7fc1200b4580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:38.134 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:38.131+0000 7fc1265bb640 1 -- 172.21.15.40:0/3816076885 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1200b1e30 con 0x7fc12006c410 2023-12-17T11:48:38.134 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:38.132+0000 7fc1265bb640 1 --2- 172.21.15.40:0/3816076885 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc12006c410 0x7fc12015ecb0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fc12006b760 tx=0x7fc11802bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1176b34aca4a41c server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:48:38.134 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:38.132+0000 7fc124db8640 1 -- 172.21.15.40:0/3816076885 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc11802cb20 con 0x7fc12006c410 2023-12-17T11:48:38.134 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:38.132+0000 7fc124db8640 1 -- 172.21.15.40:0/3816076885 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc11802cc80 con 0x7fc12006c410 2023-12-17T11:48:38.135 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:38.132+0000 7fc124db8640 1 -- 172.21.15.40:0/3816076885 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1180343f0 con 0x7fc12006c410 2023-12-17T11:48:38.135 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:38.133+0000 7fc12801e640 1 -- 172.21.15.40:0/3816076885 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc12006c410 msgr2=0x7fc12015ecb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:38.135 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:38.133+0000 7fc12801e640 1 --2- 172.21.15.40:0/3816076885 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc12006c410 0x7fc12015ecb0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fc12006b760 tx=0x7fc11802bf80 comp rx=0 tx=0).stop 2023-12-17T11:48:38.136 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:38.133+0000 7fc12801e640 1 -- 172.21.15.40:0/3816076885 shutdown_connections 2023-12-17T11:48:38.136 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:38.133+0000 7fc12801e640 1 --2- 172.21.15.40:0/3816076885 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc12006c410 0x7fc12015ecb0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:38.136 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:38.133+0000 7fc12801e640 1 --2- 172.21.15.40:0/3816076885 >> v2:172.21.15.159:3300/0 conn(0x7fc120143e00 0x7fc1200b4040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:38.136 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:38.133+0000 7fc12801e640 1 -- 172.21.15.40:0/3816076885 >> 172.21.15.40:0/3816076885 conn(0x7fc1200b0a90 msgr2=0x7fc1200b0e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:48:38.136 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:38.133+0000 7fc12801e640 1 -- 172.21.15.40:0/3816076885 shutdown_connections 2023-12-17T11:48:38.136 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:38.133+0000 7fc12801e640 1 -- 172.21.15.40:0/3816076885 wait complete. 2023-12-17T11:48:38.137 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:38.135+0000 7fc12801e640 1 Processor -- start 2023-12-17T11:48:38.137 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:38.135+0000 7fc12801e640 1 -- start start 2023-12-17T11:48:38.138 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:38.136+0000 7fc12801e640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc12006c410 0x7fc12013fa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:38.139 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:38.136+0000 7fc12801e640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc120072180 0x7fc1201f3f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:38.139 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:38.136+0000 7fc12801e640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc120143e00 0x7fc1201f4450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:38.139 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:38.136+0000 7fc12801e640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc120139b50 con 0x7fc120143e00 2023-12-17T11:48:38.139 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:38.136+0000 7fc12801e640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc120139d60 con 0x7fc120072180 2023-12-17T11:48:38.139 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:38.136+0000 7fc12801e640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc12013a040 con 0x7fc12006c410 2023-12-17T11:48:38.139 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:38.136+0000 7fc1265bb640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc120143e00 0x7fc1201f4450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:38.139 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:38.136+0000 7fc1265bb640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc120143e00 0x7fc1201f4450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:35098/0 (socket says 172.21.15.40:35098) 2023-12-17T11:48:38.139 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:38.136+0000 7fc1265bb640 1 -- 172.21.15.40:0/405922673 learned_addr learned my addr 172.21.15.40:0/405922673 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-17T11:48:38.139 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:38.136+0000 7fc1255b9640 1 --2- 172.21.15.40:0/405922673 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc120072180 0x7fc1201f3f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:38.139 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:38.137+0000 7fc125dba640 1 --2- 172.21.15.40:0/405922673 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc12006c410 0x7fc12013fa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:38.139 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:38.137+0000 7fc1265bb640 1 -- 172.21.15.40:0/405922673 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc12006c410 msgr2=0x7fc12013fa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:38.139 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:38.137+0000 7fc1265bb640 1 --2- 172.21.15.40:0/405922673 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc12006c410 0x7fc12013fa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:38.139 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:38.137+0000 7fc1265bb640 1 -- 172.21.15.40:0/405922673 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc120072180 msgr2=0x7fc1201f3f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:38.139 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:38.137+0000 7fc1265bb640 1 --2- 172.21.15.40:0/405922673 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc120072180 0x7fc1201f3f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:38.140 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:38.137+0000 7fc1265bb640 1 -- 172.21.15.40:0/405922673 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc118009b30 con 0x7fc120143e00 2023-12-17T11:48:38.140 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:38.137+0000 7fc1265bb640 1 --2- 172.21.15.40:0/405922673 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc120143e00 0x7fc1201f4450 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fc118036040 tx=0x7fc118004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:48:38.141 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:38.137+0000 7fc1167fc640 1 -- 172.21.15.40:0/405922673 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc118007e70 con 0x7fc120143e00 2023-12-17T11:48:38.141 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:38.137+0000 7fc1167fc640 1 -- 172.21.15.40:0/405922673 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc118009510 con 0x7fc120143e00 2023-12-17T11:48:38.141 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:38.137+0000 7fc12801e640 1 -- 172.21.15.40:0/405922673 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc12013a320 con 0x7fc120143e00 2023-12-17T11:48:38.141 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:38.137+0000 7fc1167fc640 1 -- 172.21.15.40:0/405922673 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc11803e690 con 0x7fc120143e00 2023-12-17T11:48:38.141 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:38.137+0000 7fc12801e640 1 -- 172.21.15.40:0/405922673 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc12013a8e0 con 0x7fc120143e00 2023-12-17T11:48:38.141 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:38.139+0000 7fc12801e640 1 -- 172.21.15.40:0/405922673 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc120141680 con 0x7fc120143e00 2023-12-17T11:48:38.141 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:38.139+0000 7fc1167fc640 1 -- 172.21.15.40:0/405922673 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fc11803e7f0 con 0x7fc120143e00 2023-12-17T11:48:38.142 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:38.140+0000 7fc1167fc640 1 --2- 172.21.15.40:0/405922673 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7fc10406ae40 0x7fc10406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:38.142 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:38.140+0000 7fc1167fc640 1 -- 172.21.15.40:0/405922673 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fc1180ac4e0 con 0x7fc120143e00 2023-12-17T11:48:38.142 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:38.141+0000 7fc125dba640 1 --2- 172.21.15.40:0/405922673 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7fc10406ae40 0x7fc10406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:38.143 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:38.142+0000 7fc125dba640 1 --2- 172.21.15.40:0/405922673 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7fc10406ae40 0x7fc10406d300 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fc11c006fd0 tx=0x7fc11c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:48:38.146 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:38.145+0000 7fc1167fc640 1 -- 172.21.15.40:0/405922673 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fc1180773b0 con 0x7fc120143e00 2023-12-17T11:48:38.335 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:38.333+0000 7fc12801e640 1 -- 172.21.15.40:0/405922673 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc1200745d0 con 0x7fc120143e00 2023-12-17T11:48:38.337 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:38.335+0000 7fc1167fc640 1 -- 172.21.15.40:0/405922673 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18322 (secure 0 0 0) 0x7fc11807a9d0 con 0x7fc120143e00 2023-12-17T11:48:38.338 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T11:48:38.338 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":25,"fsid":"099cd35d-80d9-4ca4-8424-de13b3b03ac7","created":"2023-12-17T11:47:53.450097+0000","modified":"2023-12-17T11:48:22.971195+0000","last_up_change":"2023-12-17T11:48:05.724195+0000","last_in_change":"2023-12-17T11:47:56.956499+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-17T11:48:06.668943+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-17T11:48:16.151444+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-17T11:48:16.717726+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-17T11:48:20.534819+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a88bfd46-63b8-48b1-9c0e-5c9cdc31bd38","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":555204741},{"type":"v1","addr":"172.21.15.40:6802","nonce":555204741}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":555204741},{"type":"v1","addr":"172.21.15.40:6807","nonce":555204741}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":555204741},{"type":"v1","addr":"172.21.15.40:6815","nonce":555204741}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6809","nonce":555204741},{"type":"v1","addr":"172.21.15.40:6812","nonce":555204741}]},"public_addr":"172.21.15.40:6802/555204741","cluster_addr":"172.21.15.40:6807/555204741","heartbeat_back_addr":"172.21.15.40:6815/555204741","heartbeat_front_addr":"172.21.15.40:6812/555204741","state":["exists","up"]},{"osd":1,"uuid":"c5d628ae-36f4-4866-802c-b162f0e90add","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6801","nonce":1221318112},{"type":"v1","addr":"172.21.15.40:6803","nonce":1221318112}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6805","nonce":1221318112},{"type":"v1","addr":"172.21.15.40:6806","nonce":1221318112}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6811","nonce":1221318112},{"type":"v1","addr":"172.21.15.40:6813","nonce":1221318112}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":1221318112},{"type":"v1","addr":"172.21.15.40:6810","nonce":1221318112}]},"public_addr":"172.21.15.40:6803/1221318112","cluster_addr":"172.21.15.40:6806/1221318112","heartbeat_back_addr":"172.21.15.40:6813/1221318112","heartbeat_front_addr":"172.21.15.40:6810/1221318112","state":["exists","up"]},{"osd":2,"uuid":"d986ad6a-af2f-47fc-9c3b-fbda27b82b73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":1959000265},{"type":"v1","addr":"172.21.15.40:6817","nonce":1959000265}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6818","nonce":1959000265},{"type":"v1","addr":"172.21.15.40:6819","nonce":1959000265}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":1959000265},{"type":"v1","addr":"172.21.15.40:6827","nonce":1959000265}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":1959000265},{"type":"v1","addr":"172.21.15.40:6822","nonce":1959000265}]},"public_addr":"172.21.15.40:6817/1959000265","cluster_addr":"172.21.15.40:6819/1959000265","heartbeat_back_addr":"172.21.15.40:6827/1959000265","heartbeat_front_addr":"172.21.15.40:6822/1959000265","state":["exists","up"]},{"osd":3,"uuid":"d79d22b7-be05-41b2-b95d-697db677fd02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6821","nonce":974040287},{"type":"v1","addr":"172.21.15.40:6823","nonce":974040287}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6825","nonce":974040287},{"type":"v1","addr":"172.21.15.40:6826","nonce":974040287}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":974040287},{"type":"v1","addr":"172.21.15.40:6831","nonce":974040287}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":974040287},{"type":"v1","addr":"172.21.15.40:6829","nonce":974040287}]},"public_addr":"172.21.15.40:6823/974040287","cluster_addr":"172.21.15.40:6826/974040287","heartbeat_back_addr":"172.21.15.40:6831/974040287","heartbeat_front_addr":"172.21.15.40:6829/974040287","state":["exists","up"]},{"osd":4,"uuid":"62a7a233-d3ea-40be-91de-180c0208d639","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6808","nonce":3937787733},{"type":"v1","addr":"172.21.15.159:6809","nonce":3937787733}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6810","nonce":3937787733},{"type":"v1","addr":"172.21.15.159:6811","nonce":3937787733}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6814","nonce":3937787733},{"type":"v1","addr":"172.21.15.159:6815","nonce":3937787733}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6812","nonce":3937787733},{"type":"v1","addr":"172.21.15.159:6813","nonce":3937787733}]},"public_addr":"172.21.15.159:6809/3937787733","cluster_addr":"172.21.15.159:6811/3937787733","heartbeat_back_addr":"172.21.15.159:6815/3937787733","heartbeat_front_addr":"172.21.15.159:6813/3937787733","state":["exists","up"]},{"osd":5,"uuid":"84629cea-dc0e-4b5e-b203-5ea963839281","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6816","nonce":3032505240},{"type":"v1","addr":"172.21.15.159:6817","nonce":3032505240}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6818","nonce":3032505240},{"type":"v1","addr":"172.21.15.159:6819","nonce":3032505240}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6822","nonce":3032505240},{"type":"v1","addr":"172.21.15.159:6823","nonce":3032505240}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6820","nonce":3032505240},{"type":"v1","addr":"172.21.15.159:6821","nonce":3032505240}]},"public_addr":"172.21.15.159:6817/3032505240","cluster_addr":"172.21.15.159:6819/3032505240","heartbeat_back_addr":"172.21.15.159:6823/3032505240","heartbeat_front_addr":"172.21.15.159:6821/3032505240","state":["exists","up"]},{"osd":6,"uuid":"4ae3af3a-1743-4070-a91d-8be5c31cdb04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6800","nonce":2411788597},{"type":"v1","addr":"172.21.15.159:6801","nonce":2411788597}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6802","nonce":2411788597},{"type":"v1","addr":"172.21.15.159:6803","nonce":2411788597}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6806","nonce":2411788597},{"type":"v1","addr":"172.21.15.159:6807","nonce":2411788597}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6804","nonce":2411788597},{"type":"v1","addr":"172.21.15.159:6805","nonce":2411788597}]},"public_addr":"172.21.15.159:6801/2411788597","cluster_addr":"172.21.15.159:6803/2411788597","heartbeat_back_addr":"172.21.15.159:6807/2411788597","heartbeat_front_addr":"172.21.15.159:6805/2411788597","state":["exists","up"]},{"osd":7,"uuid":"c1f4c7f2-8f75-4f95-bc63-a332773e3b8e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6824","nonce":478953349},{"type":"v1","addr":"172.21.15.159:6825","nonce":478953349}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6826","nonce":478953349},{"type":"v1","addr":"172.21.15.159:6827","nonce":478953349}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6830","nonce":478953349},{"type":"v1","addr":"172.21.15.159:6831","nonce":478953349}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6828","nonce":478953349},{"type":"v1","addr":"172.21.15.159:6829","nonce":478953349}]},"public_addr":"172.21.15.159:6825/478953349","cluster_addr":"172.21.15.159:6827/478953349","heartbeat_back_addr":"172.21.15.159:6831/478953349","heartbeat_front_addr":"172.21.15.159:6829/478953349","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T11:48:02.023567+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T11:48:02.278216+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T11:48:02.311843+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T11:48:01.773372+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T11:48:02.618910+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T11:48:02.361559+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T11:48:02.223997+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T11:48:02.604403+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-17T11:48:38.340 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:38.337+0000 7fc12801e640 1 -- 172.21.15.40:0/405922673 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7fc10406ae40 msgr2=0x7fc10406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:38.340 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:38.337+0000 7fc12801e640 1 --2- 172.21.15.40:0/405922673 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7fc10406ae40 0x7fc10406d300 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fc11c006fd0 tx=0x7fc11c008040 comp rx=0 tx=0).stop 2023-12-17T11:48:38.340 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:38.338+0000 7fc12801e640 1 -- 172.21.15.40:0/405922673 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc120143e00 msgr2=0x7fc1201f4450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:38.340 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:38.338+0000 7fc12801e640 1 --2- 172.21.15.40:0/405922673 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc120143e00 0x7fc1201f4450 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fc118036040 tx=0x7fc118004a40 comp rx=0 tx=0).stop 2023-12-17T11:48:38.340 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:38.338+0000 7fc12801e640 1 -- 172.21.15.40:0/405922673 shutdown_connections 2023-12-17T11:48:38.340 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:38.338+0000 7fc12801e640 1 --2- 172.21.15.40:0/405922673 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7fc10406ae40 0x7fc10406d300 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:38.340 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:38.338+0000 7fc12801e640 1 --2- 172.21.15.40:0/405922673 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc120143e00 0x7fc1201f4450 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:38.340 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:38.338+0000 7fc12801e640 1 --2- 172.21.15.40:0/405922673 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc120072180 0x7fc1201f3f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:38.341 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:38.338+0000 7fc12801e640 1 --2- 172.21.15.40:0/405922673 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc12006c410 0x7fc12013fa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:38.341 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:38.338+0000 7fc12801e640 1 -- 172.21.15.40:0/405922673 >> 172.21.15.40:0/405922673 conn(0x7fc1200b0a90 msgr2=0x7fc1200cebf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:48:38.341 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:38.338+0000 7fc12801e640 1 -- 172.21.15.40:0/405922673 shutdown_connections 2023-12-17T11:48:38.341 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:38.338+0000 7fc12801e640 1 -- 172.21.15.40:0/405922673 wait complete. 2023-12-17T11:48:38.359 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-17T11:48:38.570 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:38.567+0000 7f0dfbfff640 1 Processor -- start 2023-12-17T11:48:38.571 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:38.567+0000 7f0dfbfff640 1 -- start start 2023-12-17T11:48:38.571 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:38.568+0000 7f0dfbfff640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0dfc0d13c0 0x7f0dfc0ce5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:38.571 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:38.569+0000 7f0dfbfff640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f0dfc0d0d70 0x7f0dfc0d17a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:38.571 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:38.569+0000 7f0dfbfff640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0dfc0b2280 con 0x7f0dfc0cf6a0 2023-12-17T11:48:38.571 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:38.569+0000 7f0dfbfff640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0dfc0cee70 con 0x7f0dfc0d0d70 2023-12-17T11:48:38.571 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:38.569+0000 7f0dfbfff640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0dfc0d1190 con 0x7f0dfc0d13c0 2023-12-17T11:48:38.573 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:38.569+0000 7f0dfb7fe640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f0dfc0cf6a0 0x7f0dfc0cfb10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:39908/0 (socket says 172.21.15.40:39908) 2023-12-17T11:48:38.573 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:38.569+0000 7f0dfb7fe640 1 -- 172.21.15.40:0/2502151023 learned_addr learned my addr 172.21.15.40:0/2502151023 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-12-17T11:48:38.573 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:38.569+0000 7f0df27fc640 1 --2- 172.21.15.40:0/2502151023 >> v2:172.21.15.159:3300/0 conn(0x7f0dfc0d0d70 0x7f0dfc0d17a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:38.573 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:38.569+0000 7f0dfaffd640 1 --2- 172.21.15.40:0/2502151023 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0dfc0d13c0 0x7f0dfc0ce5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:38.574 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:38.569+0000 7f0dfa7fc640 1 -- 172.21.15.40:0/2502151023 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 329386166 0 0) 0x7f0dfc0b2280 con 0x7f0dfc0cf6a0 2023-12-17T11:48:38.574 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:38.569+0000 7f0dfa7fc640 1 -- 172.21.15.40:0/2502151023 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0de8003520 con 0x7f0dfc0cf6a0 2023-12-17T11:48:38.574 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:38.570+0000 7f0dfa7fc640 1 -- 172.21.15.40:0/2502151023 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1484823339 0 0) 0x7f0de8003520 con 0x7f0dfc0cf6a0 2023-12-17T11:48:38.574 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:38.570+0000 7f0dfa7fc640 1 -- 172.21.15.40:0/2502151023 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0dfc0d13c0 msgr2=0x7f0dfc0ce5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:48:38.574 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:38.570+0000 7f0dfa7fc640 1 --2- 172.21.15.40:0/2502151023 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0dfc0d13c0 0x7f0dfc0ce5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:38.574 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:38.570+0000 7f0dfa7fc640 1 -- 172.21.15.40:0/2502151023 >> v2:172.21.15.159:3300/0 conn(0x7f0dfc0d0d70 msgr2=0x7f0dfc0d17a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:48:38.574 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:38.570+0000 7f0dfa7fc640 1 --2- 172.21.15.40:0/2502151023 >> v2:172.21.15.159:3300/0 conn(0x7f0dfc0d0d70 0x7f0dfc0d17a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:38.574 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:38.570+0000 7f0dfa7fc640 1 -- 172.21.15.40:0/2502151023 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0dfc0d1ce0 con 0x7f0dfc0cf6a0 2023-12-17T11:48:38.574 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:38.570+0000 7f0dfa7fc640 1 -- 172.21.15.40:0/2502151023 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2643242555 0 0) 0x7f0df4001670 con 0x7f0dfc0cf6a0 2023-12-17T11:48:38.574 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:38.570+0000 7f0dfa7fc640 1 -- 172.21.15.40:0/2502151023 >> v1:172.21.15.40:6789/0 conn(0x7f0dfc0cf6a0 legacy=0x7f0dfc0cfb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:38.574 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:38.570+0000 7f0dfa7fc640 1 --2- 172.21.15.40:0/2502151023 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0de8003970 0x7f0de8003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:38.574 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:38.570+0000 7f0dfa7fc640 1 --2- 172.21.15.40:0/2502151023 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0de80047c0 0x7f0de8004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:38.574 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:38.570+0000 7f0dfa7fc640 1 --2- 172.21.15.40:0/2502151023 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0dfc0d13c0 0x7f0de8005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:38.575 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:38.570+0000 7f0dfa7fc640 1 -- 172.21.15.40:0/2502151023 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0dfc0cee70 con 0x7f0de8003970 2023-12-17T11:48:38.575 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:38.570+0000 7f0dfa7fc640 1 -- 172.21.15.40:0/2502151023 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0dfc0d1190 con 0x7f0de80047c0 2023-12-17T11:48:38.575 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:38.570+0000 7f0dfa7fc640 1 -- 172.21.15.40:0/2502151023 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0de800b980 con 0x7f0dfc0d13c0 2023-12-17T11:48:38.575 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:38.570+0000 7f0dfaffd640 1 --2- 172.21.15.40:0/2502151023 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0de8003970 0x7f0de8003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:38.575 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:38.571+0000 7f0df27fc640 1 --2- 172.21.15.40:0/2502151023 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0de80047c0 0x7f0de8004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:38.575 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:38.571+0000 7f0dfb7fe640 1 --2- 172.21.15.40:0/2502151023 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0dfc0d13c0 0x7f0de8005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:38.575 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:38.571+0000 7f0dfaffd640 1 -- 172.21.15.40:0/2502151023 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0dfc0d13c0 msgr2=0x7f0de8005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:48:38.575 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:38.571+0000 7f0dfaffd640 1 --2- 172.21.15.40:0/2502151023 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0dfc0d13c0 0x7f0de8005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:38.575 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:38.571+0000 7f0dfaffd640 1 -- 172.21.15.40:0/2502151023 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0de80047c0 msgr2=0x7f0de8004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:48:38.575 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:38.571+0000 7f0dfaffd640 1 --2- 172.21.15.40:0/2502151023 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0de80047c0 0x7f0de8004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:38.575 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:38.571+0000 7f0dfaffd640 1 -- 172.21.15.40:0/2502151023 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0de8003520 con 0x7f0de8003970 2023-12-17T11:48:38.575 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:38.571+0000 7f0dfb7fe640 1 --2- 172.21.15.40:0/2502151023 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0dfc0d13c0 0x7f0de8005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-17T11:48:38.577 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:38.572+0000 7f0dfaffd640 1 --2- 172.21.15.40:0/2502151023 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0de8003970 0x7f0de8003d90 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f0dec00e170 tx=0x7f0de80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f5190d32ab12df3 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:48:38.577 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:38.572+0000 7f0dfa7fc640 1 -- 172.21.15.40:0/2502151023 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dec02cbf0 con 0x7f0de8003970 2023-12-17T11:48:38.577 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:38.572+0000 7f0dfa7fc640 1 -- 172.21.15.40:0/2502151023 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0dec00f040 con 0x7f0de8003970 2023-12-17T11:48:38.577 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:38.572+0000 7f0dfa7fc640 1 -- 172.21.15.40:0/2502151023 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dec034440 con 0x7f0de8003970 2023-12-17T11:48:38.577 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:38.573+0000 7f0dfbfff640 1 -- 172.21.15.40:0/2502151023 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0de8003970 msgr2=0x7f0de8003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:38.577 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:38.573+0000 7f0dfbfff640 1 --2- 172.21.15.40:0/2502151023 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0de8003970 0x7f0de8003d90 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f0dec00e170 tx=0x7f0de80057f0 comp rx=0 tx=0).stop 2023-12-17T11:48:38.577 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:38.573+0000 7f0dfb7fe640 1 -- 172.21.15.40:0/2502151023 reap_dead start 2023-12-17T11:48:38.577 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:38.573+0000 7f0dfbfff640 1 -- 172.21.15.40:0/2502151023 shutdown_connections 2023-12-17T11:48:38.577 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:38.573+0000 7f0dfbfff640 1 -- 172.21.15.40:0/2502151023 >> 172.21.15.40:0/2502151023 conn(0x7f0dfc09c260 msgr2=0x7f0dfc0d2f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:48:38.577 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:38.573+0000 7f0dfbfff640 1 -- 172.21.15.40:0/2502151023 shutdown_connections 2023-12-17T11:48:38.577 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:38.573+0000 7f0dfbfff640 1 -- 172.21.15.40:0/2502151023 wait complete. 2023-12-17T11:48:38.578 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:38.575+0000 7f0dfbfff640 1 Processor -- start 2023-12-17T11:48:38.578 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:38.575+0000 7f0dfbfff640 1 -- start start 2023-12-17T11:48:38.580 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:38.576+0000 7f0dfbfff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0de8003970 0x7f0dfc0c94a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:38.580 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:38.576+0000 7f0dfbfff640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0dfc09ccd0 0x7f0dfc148c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:38.580 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:38.576+0000 7f0dfbfff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0dfc0d2f90 0x7f0dfc0d3410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:38.580 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:38.576+0000 7f0dfbfff640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0dfc0d3950 con 0x7f0dfc0d2f90 2023-12-17T11:48:38.580 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:38.576+0000 7f0dfbfff640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0dfc146cb0 con 0x7f0de8003970 2023-12-17T11:48:38.580 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:38.576+0000 7f0dfbfff640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0dfc09d200 con 0x7f0dfc09ccd0 2023-12-17T11:48:38.581 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:38.576+0000 7f0dfb7fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0dfc0d2f90 0x7f0dfc0d3410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:38.581 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:38.576+0000 7f0dfb7fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0dfc0d2f90 0x7f0dfc0d3410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:35120/0 (socket says 172.21.15.40:35120) 2023-12-17T11:48:38.581 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:38.576+0000 7f0dfb7fe640 1 -- 172.21.15.40:0/3490326095 learned_addr learned my addr 172.21.15.40:0/3490326095 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-17T11:48:38.581 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:38.576+0000 7f0dfaffd640 1 --2- 172.21.15.40:0/3490326095 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0de8003970 0x7f0dfc0c94a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:38.581 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:38.576+0000 7f0df27fc640 1 --2- 172.21.15.40:0/3490326095 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0dfc09ccd0 0x7f0dfc148c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:38.581 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:38.576+0000 7f0dfb7fe640 1 -- 172.21.15.40:0/3490326095 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0dfc09ccd0 msgr2=0x7f0dfc148c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:38.581 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:38.576+0000 7f0dfb7fe640 1 --2- 172.21.15.40:0/3490326095 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0dfc09ccd0 0x7f0dfc148c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:38.581 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:38.576+0000 7f0dfb7fe640 1 -- 172.21.15.40:0/3490326095 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0de8003970 msgr2=0x7f0dfc0c94a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:38.581 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:38.576+0000 7f0dfb7fe640 1 --2- 172.21.15.40:0/3490326095 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0de8003970 0x7f0dfc0c94a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:38.581 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:38.576+0000 7f0dfb7fe640 1 -- 172.21.15.40:0/3490326095 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0dfc146380 con 0x7f0dfc0d2f90 2023-12-17T11:48:38.581 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:38.577+0000 7f0dfb7fe640 1 --2- 172.21.15.40:0/3490326095 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0dfc0d2f90 0x7f0dfc0d3410 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f0dfc0d0b10 tx=0x7f0df400d9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:48:38.581 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:38.577+0000 7f0df3fff640 1 -- 172.21.15.40:0/3490326095 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0df4007440 con 0x7f0dfc0d2f90 2023-12-17T11:48:38.581 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:38.577+0000 7f0df3fff640 1 -- 172.21.15.40:0/3490326095 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0df40075a0 con 0x7f0dfc0d2f90 2023-12-17T11:48:38.582 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:38.577+0000 7f0df3fff640 1 -- 172.21.15.40:0/3490326095 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0df4004a20 con 0x7f0dfc0d2f90 2023-12-17T11:48:38.582 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:38.577+0000 7f0dfbfff640 1 -- 172.21.15.40:0/3490326095 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0dfc146660 con 0x7f0dfc0d2f90 2023-12-17T11:48:38.582 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:38.577+0000 7f0dfbfff640 1 -- 172.21.15.40:0/3490326095 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0dfc1491a0 con 0x7f0dfc0d2f90 2023-12-17T11:48:38.582 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:38.578+0000 7f0dfbfff640 1 -- 172.21.15.40:0/3490326095 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0dfc074450 con 0x7f0dfc0d2f90 2023-12-17T11:48:38.582 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:38.579+0000 7f0df3fff640 1 -- 172.21.15.40:0/3490326095 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f0df4004b80 con 0x7f0dfc0d2f90 2023-12-17T11:48:38.582 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:38.580+0000 7f0df3fff640 1 --2- 172.21.15.40:0/3490326095 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f0ddc06ae40 0x7f0ddc06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:38.583 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:38.580+0000 7f0df3fff640 1 -- 172.21.15.40:0/3490326095 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f0df4089620 con 0x7f0dfc0d2f90 2023-12-17T11:48:38.583 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:38.581+0000 7f0dfaffd640 1 --2- 172.21.15.40:0/3490326095 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f0ddc06ae40 0x7f0ddc06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:38.584 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:38.582+0000 7f0dfaffd640 1 --2- 172.21.15.40:0/3490326095 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f0ddc06ae40 0x7f0ddc06d300 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f0dec036000 tx=0x7f0dec02e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:48:38.587 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:38.585+0000 7f0df3fff640 1 -- 172.21.15.40:0/3490326095 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f0df40542b0 con 0x7f0dfc0d2f90 2023-12-17T11:48:38.784 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:38.782+0000 7f0dfbfff640 1 -- 172.21.15.40:0/3490326095 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0dfc149330 con 0x7f0dfc0d2f90 2023-12-17T11:48:38.786 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:38.784+0000 7f0df3fff640 1 -- 172.21.15.40:0/3490326095 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18322 (secure 0 0 0) 0x7f0df40578d0 con 0x7f0dfc0d2f90 2023-12-17T11:48:38.787 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T11:48:38.787 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":25,"fsid":"099cd35d-80d9-4ca4-8424-de13b3b03ac7","created":"2023-12-17T11:47:53.450097+0000","modified":"2023-12-17T11:48:22.971195+0000","last_up_change":"2023-12-17T11:48:05.724195+0000","last_in_change":"2023-12-17T11:47:56.956499+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-17T11:48:06.668943+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-17T11:48:16.151444+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-17T11:48:16.717726+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-17T11:48:20.534819+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a88bfd46-63b8-48b1-9c0e-5c9cdc31bd38","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":555204741},{"type":"v1","addr":"172.21.15.40:6802","nonce":555204741}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":555204741},{"type":"v1","addr":"172.21.15.40:6807","nonce":555204741}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":555204741},{"type":"v1","addr":"172.21.15.40:6815","nonce":555204741}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6809","nonce":555204741},{"type":"v1","addr":"172.21.15.40:6812","nonce":555204741}]},"public_addr":"172.21.15.40:6802/555204741","cluster_addr":"172.21.15.40:6807/555204741","heartbeat_back_addr":"172.21.15.40:6815/555204741","heartbeat_front_addr":"172.21.15.40:6812/555204741","state":["exists","up"]},{"osd":1,"uuid":"c5d628ae-36f4-4866-802c-b162f0e90add","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6801","nonce":1221318112},{"type":"v1","addr":"172.21.15.40:6803","nonce":1221318112}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6805","nonce":1221318112},{"type":"v1","addr":"172.21.15.40:6806","nonce":1221318112}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6811","nonce":1221318112},{"type":"v1","addr":"172.21.15.40:6813","nonce":1221318112}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":1221318112},{"type":"v1","addr":"172.21.15.40:6810","nonce":1221318112}]},"public_addr":"172.21.15.40:6803/1221318112","cluster_addr":"172.21.15.40:6806/1221318112","heartbeat_back_addr":"172.21.15.40:6813/1221318112","heartbeat_front_addr":"172.21.15.40:6810/1221318112","state":["exists","up"]},{"osd":2,"uuid":"d986ad6a-af2f-47fc-9c3b-fbda27b82b73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":1959000265},{"type":"v1","addr":"172.21.15.40:6817","nonce":1959000265}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6818","nonce":1959000265},{"type":"v1","addr":"172.21.15.40:6819","nonce":1959000265}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":1959000265},{"type":"v1","addr":"172.21.15.40:6827","nonce":1959000265}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":1959000265},{"type":"v1","addr":"172.21.15.40:6822","nonce":1959000265}]},"public_addr":"172.21.15.40:6817/1959000265","cluster_addr":"172.21.15.40:6819/1959000265","heartbeat_back_addr":"172.21.15.40:6827/1959000265","heartbeat_front_addr":"172.21.15.40:6822/1959000265","state":["exists","up"]},{"osd":3,"uuid":"d79d22b7-be05-41b2-b95d-697db677fd02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6821","nonce":974040287},{"type":"v1","addr":"172.21.15.40:6823","nonce":974040287}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6825","nonce":974040287},{"type":"v1","addr":"172.21.15.40:6826","nonce":974040287}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":974040287},{"type":"v1","addr":"172.21.15.40:6831","nonce":974040287}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":974040287},{"type":"v1","addr":"172.21.15.40:6829","nonce":974040287}]},"public_addr":"172.21.15.40:6823/974040287","cluster_addr":"172.21.15.40:6826/974040287","heartbeat_back_addr":"172.21.15.40:6831/974040287","heartbeat_front_addr":"172.21.15.40:6829/974040287","state":["exists","up"]},{"osd":4,"uuid":"62a7a233-d3ea-40be-91de-180c0208d639","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6808","nonce":3937787733},{"type":"v1","addr":"172.21.15.159:6809","nonce":3937787733}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6810","nonce":3937787733},{"type":"v1","addr":"172.21.15.159:6811","nonce":3937787733}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6814","nonce":3937787733},{"type":"v1","addr":"172.21.15.159:6815","nonce":3937787733}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6812","nonce":3937787733},{"type":"v1","addr":"172.21.15.159:6813","nonce":3937787733}]},"public_addr":"172.21.15.159:6809/3937787733","cluster_addr":"172.21.15.159:6811/3937787733","heartbeat_back_addr":"172.21.15.159:6815/3937787733","heartbeat_front_addr":"172.21.15.159:6813/3937787733","state":["exists","up"]},{"osd":5,"uuid":"84629cea-dc0e-4b5e-b203-5ea963839281","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6816","nonce":3032505240},{"type":"v1","addr":"172.21.15.159:6817","nonce":3032505240}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6818","nonce":3032505240},{"type":"v1","addr":"172.21.15.159:6819","nonce":3032505240}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6822","nonce":3032505240},{"type":"v1","addr":"172.21.15.159:6823","nonce":3032505240}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6820","nonce":3032505240},{"type":"v1","addr":"172.21.15.159:6821","nonce":3032505240}]},"public_addr":"172.21.15.159:6817/3032505240","cluster_addr":"172.21.15.159:6819/3032505240","heartbeat_back_addr":"172.21.15.159:6823/3032505240","heartbeat_front_addr":"172.21.15.159:6821/3032505240","state":["exists","up"]},{"osd":6,"uuid":"4ae3af3a-1743-4070-a91d-8be5c31cdb04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6800","nonce":2411788597},{"type":"v1","addr":"172.21.15.159:6801","nonce":2411788597}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6802","nonce":2411788597},{"type":"v1","addr":"172.21.15.159:6803","nonce":2411788597}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6806","nonce":2411788597},{"type":"v1","addr":"172.21.15.159:6807","nonce":2411788597}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6804","nonce":2411788597},{"type":"v1","addr":"172.21.15.159:6805","nonce":2411788597}]},"public_addr":"172.21.15.159:6801/2411788597","cluster_addr":"172.21.15.159:6803/2411788597","heartbeat_back_addr":"172.21.15.159:6807/2411788597","heartbeat_front_addr":"172.21.15.159:6805/2411788597","state":["exists","up"]},{"osd":7,"uuid":"c1f4c7f2-8f75-4f95-bc63-a332773e3b8e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6824","nonce":478953349},{"type":"v1","addr":"172.21.15.159:6825","nonce":478953349}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6826","nonce":478953349},{"type":"v1","addr":"172.21.15.159:6827","nonce":478953349}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6830","nonce":478953349},{"type":"v1","addr":"172.21.15.159:6831","nonce":478953349}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6828","nonce":478953349},{"type":"v1","addr":"172.21.15.159:6829","nonce":478953349}]},"public_addr":"172.21.15.159:6825/478953349","cluster_addr":"172.21.15.159:6827/478953349","heartbeat_back_addr":"172.21.15.159:6831/478953349","heartbeat_front_addr":"172.21.15.159:6829/478953349","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T11:48:02.023567+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T11:48:02.278216+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T11:48:02.311843+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T11:48:01.773372+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T11:48:02.618910+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T11:48:02.361559+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T11:48:02.223997+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T11:48:02.604403+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-17T11:48:38.789 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:38.787+0000 7f0dfbfff640 1 -- 172.21.15.40:0/3490326095 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f0ddc06ae40 msgr2=0x7f0ddc06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:38.789 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:38.787+0000 7f0dfbfff640 1 --2- 172.21.15.40:0/3490326095 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f0ddc06ae40 0x7f0ddc06d300 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f0dec036000 tx=0x7f0dec02e000 comp rx=0 tx=0).stop 2023-12-17T11:48:38.789 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:38.787+0000 7f0dfbfff640 1 -- 172.21.15.40:0/3490326095 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0dfc0d2f90 msgr2=0x7f0dfc0d3410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:38.790 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:38.787+0000 7f0dfbfff640 1 --2- 172.21.15.40:0/3490326095 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0dfc0d2f90 0x7f0dfc0d3410 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f0dfc0d0b10 tx=0x7f0df400d9d0 comp rx=0 tx=0).stop 2023-12-17T11:48:38.790 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:38.787+0000 7f0dfbfff640 1 -- 172.21.15.40:0/3490326095 shutdown_connections 2023-12-17T11:48:38.790 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:38.787+0000 7f0dfbfff640 1 --2- 172.21.15.40:0/3490326095 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f0ddc06ae40 0x7f0ddc06d300 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:38.790 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:38.787+0000 7f0dfbfff640 1 --2- 172.21.15.40:0/3490326095 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0dfc0d2f90 0x7f0dfc0d3410 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:38.790 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:38.787+0000 7f0dfbfff640 1 --2- 172.21.15.40:0/3490326095 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0dfc09ccd0 0x7f0dfc148c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:38.790 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:38.787+0000 7f0dfbfff640 1 --2- 172.21.15.40:0/3490326095 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0de8003970 0x7f0dfc0c94a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:38.790 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:38.787+0000 7f0dfbfff640 1 -- 172.21.15.40:0/3490326095 >> 172.21.15.40:0/3490326095 conn(0x7f0dfc09c260 msgr2=0x7f0dfc0b15c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:48:38.790 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:38.787+0000 7f0dfbfff640 1 -- 172.21.15.40:0/3490326095 shutdown_connections 2023-12-17T11:48:38.790 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:38.788+0000 7f0dfbfff640 1 -- 172.21.15.40:0/3490326095 wait complete. 2023-12-17T11:48:38.807 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-12-17T11:48:39.018 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:39.016+0000 7f41da039640 1 Processor -- start 2023-12-17T11:48:39.018 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:39.016+0000 7f41da039640 1 -- start start 2023-12-17T11:48:39.020 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:39.018+0000 7f41da039640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f41d4071c70 0x7f41d4165ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:39.020 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:39.018+0000 7f41da039640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41d406c770 con 0x7f41d406c130 2023-12-17T11:48:39.020 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:39.018+0000 7f41da039640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41d406ca50 con 0x7f41d40cb5b0 2023-12-17T11:48:39.020 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:39.018+0000 7f41da039640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41d406cd30 con 0x7f41d4071c70 2023-12-17T11:48:39.020 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:39.018+0000 7f41d8836640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f41d406c130 0x7f41d415f510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:39914/0 (socket says 172.21.15.40:39914) 2023-12-17T11:48:39.020 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:39.018+0000 7f41d8836640 1 -- 172.21.15.40:0/2959709289 learned_addr learned my addr 172.21.15.40:0/2959709289 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-12-17T11:48:39.020 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:39.018+0000 7f41d9838640 1 --2- 172.21.15.40:0/2959709289 >> v2:172.21.15.40:3300/0 conn(0x7f41d4071c70 0x7f41d4165ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:39.021 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:39.018+0000 7f41cbfff640 1 -- 172.21.15.40:0/2959709289 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2277703477 0 0) 0x7f41d406c770 con 0x7f41d406c130 2023-12-17T11:48:39.021 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:39.019+0000 7f41cbfff640 1 -- 172.21.15.40:0/2959709289 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f41c0003520 con 0x7f41d406c130 2023-12-17T11:48:39.021 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:39.019+0000 7f41d9838640 1 -- 172.21.15.40:0/2959709289 >> v1:172.21.15.159:6789/0 conn(0x7f41d40cb5b0 legacy=0x7f41d40cb990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:48:39.021 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:39.019+0000 7f41d9838640 1 -- 172.21.15.40:0/2959709289 >> v1:172.21.15.40:6789/0 conn(0x7f41d406c130 legacy=0x7f41d415f510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:39.021 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:39.019+0000 7f41d9838640 1 -- 172.21.15.40:0/2959709289 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41d406d010 con 0x7f41d4071c70 2023-12-17T11:48:39.022 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:39.020+0000 7f41d9838640 1 --2- 172.21.15.40:0/2959709289 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f41d4071c70 0x7f41d4165ee0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f41cc009d90 tx=0x7f41cc02bf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95c5ee981451251c server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:48:39.022 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:39.020+0000 7f41cbfff640 1 -- 172.21.15.40:0/2959709289 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41cc02cd00 con 0x7f41d4071c70 2023-12-17T11:48:39.022 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:39.020+0000 7f41cbfff640 1 -- 172.21.15.40:0/2959709289 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41cc02ce60 con 0x7f41d4071c70 2023-12-17T11:48:39.022 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:39.020+0000 7f41cbfff640 1 -- 172.21.15.40:0/2959709289 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41cc034660 con 0x7f41d4071c70 2023-12-17T11:48:39.023 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:39.021+0000 7f41da039640 1 -- 172.21.15.40:0/2959709289 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f41d4071c70 msgr2=0x7f41d4165ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:39.023 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:39.021+0000 7f41da039640 1 --2- 172.21.15.40:0/2959709289 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f41d4071c70 0x7f41d4165ee0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f41cc009d90 tx=0x7f41cc02bf50 comp rx=0 tx=0).stop 2023-12-17T11:48:39.023 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:39.021+0000 7f41da039640 1 -- 172.21.15.40:0/2959709289 shutdown_connections 2023-12-17T11:48:39.023 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:39.021+0000 7f41da039640 1 --2- 172.21.15.40:0/2959709289 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f41d4071c70 0x7f41d4165ee0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:39.023 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:39.021+0000 7f41da039640 1 -- 172.21.15.40:0/2959709289 >> 172.21.15.40:0/2959709289 conn(0x7f41d40b0940 msgr2=0x7f41d40b0d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:48:39.023 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:39.021+0000 7f41da039640 1 -- 172.21.15.40:0/2959709289 shutdown_connections 2023-12-17T11:48:39.023 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:39.021+0000 7f41da039640 1 -- 172.21.15.40:0/2959709289 wait complete. 2023-12-17T11:48:39.024 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:39.023+0000 7f41da039640 1 Processor -- start 2023-12-17T11:48:39.024 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:39.023+0000 7f41da039640 1 -- start start 2023-12-17T11:48:39.026 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:39.024+0000 7f41da039640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f41d406c130 0x7f41d4152ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:39.027 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:39.024+0000 7f41da039640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f41d4071c70 0x7f41d40b3040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:39.027 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:39.024+0000 7f41da039640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f41d40cb5b0 0x7f41d41577b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:39.027 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:39.024+0000 7f41da039640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41d41f3710 con 0x7f41d40cb5b0 2023-12-17T11:48:39.027 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:39.024+0000 7f41da039640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41d40b3d70 con 0x7f41d406c130 2023-12-17T11:48:39.027 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:39.024+0000 7f41da039640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41d40b3a90 con 0x7f41d4071c70 2023-12-17T11:48:39.027 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:39.024+0000 7f41d9838640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f41d40cb5b0 0x7f41d41577b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:39.027 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:39.024+0000 7f41d9838640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f41d40cb5b0 0x7f41d41577b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:35142/0 (socket says 172.21.15.40:35142) 2023-12-17T11:48:39.027 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:39.024+0000 7f41d9838640 1 -- 172.21.15.40:0/2877634973 learned_addr learned my addr 172.21.15.40:0/2877634973 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-17T11:48:39.027 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:39.024+0000 7f41d9037640 1 --2- 172.21.15.40:0/2877634973 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f41d406c130 0x7f41d4152ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:39.027 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:39.024+0000 7f41d8836640 1 --2- 172.21.15.40:0/2877634973 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f41d4071c70 0x7f41d40b3040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:39.027 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:39.024+0000 7f41d9838640 1 -- 172.21.15.40:0/2877634973 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f41d4071c70 msgr2=0x7f41d40b3040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:39.027 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:39.025+0000 7f41d9838640 1 --2- 172.21.15.40:0/2877634973 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f41d4071c70 0x7f41d40b3040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:39.027 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:39.025+0000 7f41d9838640 1 -- 172.21.15.40:0/2877634973 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f41d406c130 msgr2=0x7f41d4152ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:39.028 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:39.025+0000 7f41d9838640 1 --2- 172.21.15.40:0/2877634973 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f41d406c130 0x7f41d4152ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:39.028 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:39.025+0000 7f41d9838640 1 -- 172.21.15.40:0/2877634973 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41cc009a70 con 0x7f41d40cb5b0 2023-12-17T11:48:39.028 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:39.025+0000 7f41d9838640 1 --2- 172.21.15.40:0/2877634973 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f41d40cb5b0 0x7f41d41577b0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f41cc009d90 tx=0x7f41cc004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:48:39.028 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:39.025+0000 7f41c9ffb640 1 -- 172.21.15.40:0/2877634973 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41cc03d600 con 0x7f41d40cb5b0 2023-12-17T11:48:39.028 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:39.025+0000 7f41c9ffb640 1 -- 172.21.15.40:0/2877634973 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41cc03d780 con 0x7f41d40cb5b0 2023-12-17T11:48:39.029 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:39.025+0000 7f41c9ffb640 1 -- 172.21.15.40:0/2877634973 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41cc03db30 con 0x7f41d40cb5b0 2023-12-17T11:48:39.029 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:39.025+0000 7f41da039640 1 -- 172.21.15.40:0/2877634973 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41d41f3050 con 0x7f41d40cb5b0 2023-12-17T11:48:39.029 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:39.025+0000 7f41da039640 1 -- 172.21.15.40:0/2877634973 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41d4159100 con 0x7f41d40cb5b0 2023-12-17T11:48:39.029 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:39.026+0000 7f41da039640 1 -- 172.21.15.40:0/2877634973 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f41d4067910 con 0x7f41d40cb5b0 2023-12-17T11:48:39.029 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:39.027+0000 7f41c9ffb640 1 -- 172.21.15.40:0/2877634973 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f41cc03b040 con 0x7f41d40cb5b0 2023-12-17T11:48:39.030 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:39.028+0000 7f41c9ffb640 1 --2- 172.21.15.40:0/2877634973 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f41b806ae40 0x7f41b806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:39.030 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:39.028+0000 7f41c9ffb640 1 -- 172.21.15.40:0/2877634973 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f41cc0abe40 con 0x7f41d40cb5b0 2023-12-17T11:48:39.030 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:39.029+0000 7f41d9037640 1 --2- 172.21.15.40:0/2877634973 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f41b806ae40 0x7f41b806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:39.031 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:39.030+0000 7f41d9037640 1 --2- 172.21.15.40:0/2877634973 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f41b806ae40 0x7f41b806d300 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f41d0000f60 tx=0x7f41d0009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:48:39.034 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:39.032+0000 7f41c9ffb640 1 -- 172.21.15.40:0/2877634973 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f41cc076bf0 con 0x7f41d40cb5b0 2023-12-17T11:48:39.266 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:39.265+0000 7f41da039640 1 -- 172.21.15.40:0/2877634973 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f41d41f3850 con 0x7f41d40cb5b0 2023-12-17T11:48:39.559 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:39.557+0000 7f41c9ffb640 1 -- 172.21.15.40:0/2877634973 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v7) v1 ==== 118+0+0 (secure 0 0 0) 0x7f41d41f3850 con 0x7f41d40cb5b0 2023-12-17T11:48:39.563 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:39.560+0000 7f41da039640 1 -- 172.21.15.40:0/2877634973 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f41b806ae40 msgr2=0x7f41b806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:39.563 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:39.560+0000 7f41da039640 1 --2- 172.21.15.40:0/2877634973 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f41b806ae40 0x7f41b806d300 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f41d0000f60 tx=0x7f41d0009040 comp rx=0 tx=0).stop 2023-12-17T11:48:39.563 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:39.561+0000 7f41da039640 1 -- 172.21.15.40:0/2877634973 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f41d40cb5b0 msgr2=0x7f41d41577b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:39.563 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:39.561+0000 7f41da039640 1 --2- 172.21.15.40:0/2877634973 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f41d40cb5b0 0x7f41d41577b0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f41cc009d90 tx=0x7f41cc004a40 comp rx=0 tx=0).stop 2023-12-17T11:48:39.563 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:39.561+0000 7f41da039640 1 -- 172.21.15.40:0/2877634973 shutdown_connections 2023-12-17T11:48:39.563 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:39.561+0000 7f41da039640 1 --2- 172.21.15.40:0/2877634973 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f41b806ae40 0x7f41b806d300 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:39.563 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:39.561+0000 7f41da039640 1 --2- 172.21.15.40:0/2877634973 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f41d40cb5b0 0x7f41d41577b0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:39.563 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:39.561+0000 7f41da039640 1 --2- 172.21.15.40:0/2877634973 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f41d4071c70 0x7f41d40b3040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:39.563 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:39.561+0000 7f41da039640 1 --2- 172.21.15.40:0/2877634973 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f41d406c130 0x7f41d4152ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:39.563 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:39.561+0000 7f41da039640 1 -- 172.21.15.40:0/2877634973 >> 172.21.15.40:0/2877634973 conn(0x7f41d40b0940 msgr2=0x7f41d40ad730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:48:39.564 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:39.561+0000 7f41da039640 1 -- 172.21.15.40:0/2877634973 shutdown_connections 2023-12-17T11:48:39.564 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:39.561+0000 7f41da039640 1 -- 172.21.15.40:0/2877634973 wait complete. 2023-12-17T11:48:39.584 DEBUG:tasks.cephfs.filesystem:fs_config: {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']} 2023-12-17T11:48:39.584 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-12-17T11:48:39.808 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:39.806+0000 7f689339e640 1 Processor -- start 2023-12-17T11:48:39.809 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:39.807+0000 7f689339e640 1 -- start start 2023-12-17T11:48:39.810 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:39.808+0000 7f689339e640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f688c143810 0x7f688c0ada80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:39.810 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:39.808+0000 7f689339e640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f688c0cd7d0 0x7f688c06d500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:39.810 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:39.808+0000 7f689339e640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f688c143bf0 con 0x7f688c0adfc0 2023-12-17T11:48:39.810 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:39.808+0000 7f689339e640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f688c0ae520 con 0x7f688c143810 2023-12-17T11:48:39.811 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:39.808+0000 7f689339e640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f688c0ae800 con 0x7f688c0cd7d0 2023-12-17T11:48:39.811 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:39.809+0000 7f689113a640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f688c143810 0x7f688c0ada80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:39.811 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:39.809+0000 7f6890939640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f688c0cd7d0 0x7f688c06d500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:39.811 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:39.809+0000 7f689113a640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f688c143810 0x7f688c0ada80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.40:39266/0 (socket says 172.21.15.40:39266) 2023-12-17T11:48:39.811 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:39.809+0000 7f689113a640 1 -- 172.21.15.40:0/2415105024 learned_addr learned my addr 172.21.15.40:0/2415105024 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-17T11:48:39.811 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:39.809+0000 7f6890939640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f688c0cd7d0 0x7f688c06d500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3301/0 says I am v2:172.21.15.40:55634/0 (socket says 172.21.15.40:55634) 2023-12-17T11:48:39.812 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:39.810+0000 7f6890939640 1 -- 172.21.15.40:0/2415105024 >> v2:172.21.15.159:3300/0 conn(0x7f688c143810 msgr2=0x7f688c0ada80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:48:39.812 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:39.810+0000 7f6890939640 1 --2- 172.21.15.40:0/2415105024 >> v2:172.21.15.159:3300/0 conn(0x7f688c143810 0x7f688c0ada80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:39.812 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:39.810+0000 7f6890939640 1 -- 172.21.15.40:0/2415105024 >> v1:172.21.15.159:6789/0 conn(0x7f688c0adfc0 legacy=0x7f688c0ac860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:39.812 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:39.810+0000 7f6890939640 1 -- 172.21.15.40:0/2415105024 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f688c0cccf0 con 0x7f688c0cd7d0 2023-12-17T11:48:39.813 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:39.811+0000 7f6890939640 1 --2- 172.21.15.40:0/2415105024 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f688c0cd7d0 0x7f688c06d500 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f687c0097a0 tx=0x7f687c02b8b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e8b20f0fe1314b73 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:48:39.814 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:39.812+0000 7f6883fff640 1 -- 172.21.15.40:0/2415105024 <== mon.2 v2:172.21.15.159:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f687c02d040 con 0x7f688c0cd7d0 2023-12-17T11:48:39.814 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:39.812+0000 7f6883fff640 1 -- 172.21.15.40:0/2415105024 <== mon.2 v2:172.21.15.159:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f687c031810 con 0x7f688c0cd7d0 2023-12-17T11:48:39.814 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:39.812+0000 7f6883fff640 1 -- 172.21.15.40:0/2415105024 <== mon.2 v2:172.21.15.159:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f687c031ba0 con 0x7f688c0cd7d0 2023-12-17T11:48:39.815 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:39.813+0000 7f689339e640 1 -- 172.21.15.40:0/2415105024 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f688c0cd7d0 msgr2=0x7f688c06d500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:39.815 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:39.813+0000 7f689339e640 1 --2- 172.21.15.40:0/2415105024 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f688c0cd7d0 0x7f688c06d500 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f687c0097a0 tx=0x7f687c02b8b0 comp rx=0 tx=0).stop 2023-12-17T11:48:39.815 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:39.813+0000 7f689339e640 1 -- 172.21.15.40:0/2415105024 shutdown_connections 2023-12-17T11:48:39.815 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:39.813+0000 7f689339e640 1 --2- 172.21.15.40:0/2415105024 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f688c0cd7d0 0x7f688c06d500 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:39.815 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:39.813+0000 7f689339e640 1 --2- 172.21.15.40:0/2415105024 >> v2:172.21.15.159:3300/0 conn(0x7f688c143810 0x7f688c0ada80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:39.815 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:39.813+0000 7f689339e640 1 -- 172.21.15.40:0/2415105024 >> 172.21.15.40:0/2415105024 conn(0x7f688c0cb850 msgr2=0x7f688c0cbc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:48:39.815 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:39.813+0000 7f689339e640 1 -- 172.21.15.40:0/2415105024 shutdown_connections 2023-12-17T11:48:39.815 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:39.813+0000 7f689339e640 1 -- 172.21.15.40:0/2415105024 wait complete. 2023-12-17T11:48:39.817 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:39.815+0000 7f689339e640 1 Processor -- start 2023-12-17T11:48:39.817 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:39.815+0000 7f689339e640 1 -- start start 2023-12-17T11:48:39.819 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:39.816+0000 7f689339e640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f688c0adfc0 0x7f688c1f3270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:39.819 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:39.817+0000 7f689339e640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f688c0cd7d0 0x7f688c0b0180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:39.819 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:39.817+0000 7f689339e640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f688c143810 0x7f688c0b3be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:39.819 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:39.817+0000 7f689339e640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f688c1f37b0 con 0x7f688c0cd7d0 2023-12-17T11:48:39.819 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:39.817+0000 7f689339e640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f688c15d820 con 0x7f688c143810 2023-12-17T11:48:39.819 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:39.817+0000 7f689339e640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f688c160ff0 con 0x7f688c0adfc0 2023-12-17T11:48:39.819 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:39.817+0000 7f6890939640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f688c0cd7d0 0x7f688c0b0180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:39.819 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:39.817+0000 7f6890939640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f688c0cd7d0 0x7f688c0b0180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:35158/0 (socket says 172.21.15.40:35158) 2023-12-17T11:48:39.819 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:39.817+0000 7f6890939640 1 -- 172.21.15.40:0/3232233907 learned_addr learned my addr 172.21.15.40:0/3232233907 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-17T11:48:39.820 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:39.817+0000 7f689113a640 1 --2- 172.21.15.40:0/3232233907 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f688c0adfc0 0x7f688c1f3270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:39.820 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:39.817+0000 7f689193b640 1 --2- 172.21.15.40:0/3232233907 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f688c143810 0x7f688c0b3be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:39.821 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:39.817+0000 7f6890939640 1 -- 172.21.15.40:0/3232233907 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f688c0adfc0 msgr2=0x7f688c1f3270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:39.821 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:39.817+0000 7f6890939640 1 --2- 172.21.15.40:0/3232233907 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f688c0adfc0 0x7f688c1f3270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:39.821 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:39.817+0000 7f6890939640 1 -- 172.21.15.40:0/3232233907 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f688c143810 msgr2=0x7f688c0b3be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:39.821 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:39.817+0000 7f6890939640 1 --2- 172.21.15.40:0/3232233907 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f688c143810 0x7f688c0b3be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:39.821 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:39.817+0000 7f6890939640 1 -- 172.21.15.40:0/3232233907 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f687c009400 con 0x7f688c0cd7d0 2023-12-17T11:48:39.821 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:39.818+0000 7f6890939640 1 --2- 172.21.15.40:0/3232233907 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f688c0cd7d0 0x7f688c0b0180 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f687c0098c0 tx=0x7f687c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:48:39.821 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:39.818+0000 7f6881ffb640 1 -- 172.21.15.40:0/3232233907 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f687c03ace0 con 0x7f688c0cd7d0 2023-12-17T11:48:39.821 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:39.818+0000 7f6881ffb640 1 -- 172.21.15.40:0/3232233907 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f687c03ae60 con 0x7f688c0cd7d0 2023-12-17T11:48:39.821 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:39.818+0000 7f6881ffb640 1 -- 172.21.15.40:0/3232233907 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f687c044640 con 0x7f688c0cd7d0 2023-12-17T11:48:39.821 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:39.818+0000 7f689339e640 1 -- 172.21.15.40:0/3232233907 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f688c1612d0 con 0x7f688c0cd7d0 2023-12-17T11:48:39.822 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:39.818+0000 7f689339e640 1 -- 172.21.15.40:0/3232233907 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f688c161890 con 0x7f688c0cd7d0 2023-12-17T11:48:39.822 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:39.820+0000 7f689339e640 1 -- 172.21.15.40:0/3232233907 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f688c15d990 con 0x7f688c0cd7d0 2023-12-17T11:48:39.822 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:39.820+0000 7f6881ffb640 1 -- 172.21.15.40:0/3232233907 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f687c04d440 con 0x7f688c0cd7d0 2023-12-17T11:48:39.823 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:39.821+0000 7f6881ffb640 1 --2- 172.21.15.40:0/3232233907 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f687006ae40 0x7f687006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:39.823 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:39.821+0000 7f6881ffb640 1 -- 172.21.15.40:0/3232233907 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f687c0abc10 con 0x7f688c0cd7d0 2023-12-17T11:48:39.824 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:39.822+0000 7f689113a640 1 --2- 172.21.15.40:0/3232233907 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f687006ae40 0x7f687006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:39.825 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:39.823+0000 7f689113a640 1 --2- 172.21.15.40:0/3232233907 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f687006ae40 0x7f687006d300 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f6888009ac0 tx=0x7f6888008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:48:39.827 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:39.826+0000 7f6881ffb640 1 -- 172.21.15.40:0/3232233907 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f687c0769d0 con 0x7f688c0cd7d0 2023-12-17T11:48:40.061 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:40.058+0000 7f689339e640 1 -- 172.21.15.40:0/3232233907 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f688c161a20 con 0x7f688c0cd7d0 2023-12-17T11:48:40.571 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:40.569+0000 7f6881ffb640 1 -- 172.21.15.40:0/3232233907 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v8) v1 ==== 122+0+0 (secure 0 0 0) 0x7f688c161a20 con 0x7f688c0cd7d0 2023-12-17T11:48:40.576 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:40.573+0000 7f689339e640 1 -- 172.21.15.40:0/3232233907 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f687006ae40 msgr2=0x7f687006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:40.576 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:40.573+0000 7f689339e640 1 --2- 172.21.15.40:0/3232233907 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f687006ae40 0x7f687006d300 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f6888009ac0 tx=0x7f6888008040 comp rx=0 tx=0).stop 2023-12-17T11:48:40.576 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:40.573+0000 7f689339e640 1 -- 172.21.15.40:0/3232233907 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f688c0cd7d0 msgr2=0x7f688c0b0180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:40.576 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:40.573+0000 7f689339e640 1 --2- 172.21.15.40:0/3232233907 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f688c0cd7d0 0x7f688c0b0180 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f687c0098c0 tx=0x7f687c0046c0 comp rx=0 tx=0).stop 2023-12-17T11:48:40.576 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:40.573+0000 7f689339e640 1 -- 172.21.15.40:0/3232233907 shutdown_connections 2023-12-17T11:48:40.576 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:40.573+0000 7f689339e640 1 --2- 172.21.15.40:0/3232233907 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f687006ae40 0x7f687006d300 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:40.576 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:40.573+0000 7f689339e640 1 --2- 172.21.15.40:0/3232233907 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f688c143810 0x7f688c0b3be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:40.576 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:40.573+0000 7f689339e640 1 --2- 172.21.15.40:0/3232233907 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f688c0cd7d0 0x7f688c0b0180 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:40.576 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:40.573+0000 7f689339e640 1 --2- 172.21.15.40:0/3232233907 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f688c0adfc0 0x7f688c1f3270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:40.576 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:40.573+0000 7f689339e640 1 -- 172.21.15.40:0/3232233907 >> 172.21.15.40:0/3232233907 conn(0x7f688c0cb850 msgr2=0x7f688c145db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:48:40.577 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:40.574+0000 7f689339e640 1 -- 172.21.15.40:0/3232233907 shutdown_connections 2023-12-17T11:48:40.577 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:40.574+0000 7f689339e640 1 -- 172.21.15.40:0/3232233907 wait complete. 2023-12-17T11:48:40.598 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-12-17T11:48:40.598 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-17T11:48:40.821 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:40.819+0000 7fd2195a9640 1 Processor -- start 2023-12-17T11:48:40.821 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:40.819+0000 7fd2195a9640 1 -- start start 2023-12-17T11:48:40.823 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:40.821+0000 7fd2195a9640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7fd214159c50 0x7fd2140cec30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:40.823 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:40.821+0000 7fd2195a9640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fd2140b2670 0x7fd21415a030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:40.823 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:40.821+0000 7fd2195a9640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd214159a90 con 0x7fd21415a570 2023-12-17T11:48:40.823 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:40.821+0000 7fd2195a9640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2140ce790 con 0x7fd2140b2670 2023-12-17T11:48:40.823 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:40.821+0000 7fd2195a9640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2140cd6f0 con 0x7fd214159c50 2023-12-17T11:48:40.823 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:40.821+0000 7fd2137fe640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fd21415a570 0x7fd21406a460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:39922/0 (socket says 172.21.15.40:39922) 2023-12-17T11:48:40.824 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:40.821+0000 7fd2137fe640 1 -- 172.21.15.40:0/4024547935 learned_addr learned my addr 172.21.15.40:0/4024547935 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-12-17T11:48:40.824 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:40.821+0000 7fd2127fc640 1 --2- 172.21.15.40:0/4024547935 >> v2:172.21.15.40:3300/0 conn(0x7fd2140b2670 0x7fd21415a030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:40.825 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:40.822+0000 7fd212ffd640 1 --2- 172.21.15.40:0/4024547935 >> v2:172.21.15.159:3300/0 conn(0x7fd214159c50 0x7fd2140cec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:40.825 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:40.822+0000 7fd211ffb640 1 -- 172.21.15.40:0/4024547935 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3623211517 0 0) 0x7fd214159a90 con 0x7fd21415a570 2023-12-17T11:48:40.825 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:40.822+0000 7fd211ffb640 1 -- 172.21.15.40:0/4024547935 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd200003520 con 0x7fd21415a570 2023-12-17T11:48:40.825 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:40.822+0000 7fd2127fc640 1 -- 172.21.15.40:0/4024547935 >> v2:172.21.15.159:3300/0 conn(0x7fd214159c50 msgr2=0x7fd2140cec30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:48:40.825 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:40.822+0000 7fd2127fc640 1 --2- 172.21.15.40:0/4024547935 >> v2:172.21.15.159:3300/0 conn(0x7fd214159c50 0x7fd2140cec30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:40.825 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:40.822+0000 7fd2127fc640 1 -- 172.21.15.40:0/4024547935 >> v1:172.21.15.40:6789/0 conn(0x7fd21415a570 legacy=0x7fd21406a460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:40.825 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:40.822+0000 7fd2127fc640 1 -- 172.21.15.40:0/4024547935 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2140cd9d0 con 0x7fd2140b2670 2023-12-17T11:48:40.826 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:40.823+0000 7fd2127fc640 1 --2- 172.21.15.40:0/4024547935 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd2140b2670 0x7fd21415a030 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fd214070480 tx=0x7fd1fc02b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17d52879775439b8 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:48:40.827 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:40.823+0000 7fd211ffb640 1 -- 172.21.15.40:0/4024547935 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1fc02e070 con 0x7fd2140b2670 2023-12-17T11:48:40.827 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:40.823+0000 7fd211ffb640 1 -- 172.21.15.40:0/4024547935 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1fc0315a0 con 0x7fd2140b2670 2023-12-17T11:48:40.827 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:40.824+0000 7fd211ffb640 1 -- 172.21.15.40:0/4024547935 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1fc031930 con 0x7fd2140b2670 2023-12-17T11:48:40.827 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:40.824+0000 7fd2195a9640 1 -- 172.21.15.40:0/4024547935 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd2140b2670 msgr2=0x7fd21415a030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:40.827 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:40.824+0000 7fd2195a9640 1 --2- 172.21.15.40:0/4024547935 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd2140b2670 0x7fd21415a030 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fd214070480 tx=0x7fd1fc02b840 comp rx=0 tx=0).stop 2023-12-17T11:48:40.827 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:40.824+0000 7fd2195a9640 1 -- 172.21.15.40:0/4024547935 shutdown_connections 2023-12-17T11:48:40.827 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:40.824+0000 7fd2195a9640 1 --2- 172.21.15.40:0/4024547935 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd2140b2670 0x7fd21415a030 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:40.827 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:40.824+0000 7fd2195a9640 1 --2- 172.21.15.40:0/4024547935 >> v2:172.21.15.159:3300/0 conn(0x7fd214159c50 0x7fd2140cec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:40.827 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:40.824+0000 7fd2195a9640 1 -- 172.21.15.40:0/4024547935 >> 172.21.15.40:0/4024547935 conn(0x7fd2140cf540 msgr2=0x7fd2140cf950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:48:40.827 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:40.824+0000 7fd2195a9640 1 -- 172.21.15.40:0/4024547935 shutdown_connections 2023-12-17T11:48:40.827 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:40.824+0000 7fd2195a9640 1 -- 172.21.15.40:0/4024547935 wait complete. 2023-12-17T11:48:40.828 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:40.826+0000 7fd2195a9640 1 Processor -- start 2023-12-17T11:48:40.828 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:40.826+0000 7fd2195a9640 1 -- start start 2023-12-17T11:48:40.830 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:40.827+0000 7fd2195a9640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd2140b2670 0x7fd214156a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:40.831 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:40.827+0000 7fd2195a9640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd214159c50 0x7fd214154090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:40.831 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:40.827+0000 7fd2195a9640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd21415a570 0x7fd2140c4500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:40.831 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:40.827+0000 7fd2195a9640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2141565f0 con 0x7fd2140b2670 2023-12-17T11:48:40.831 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:40.827+0000 7fd2195a9640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2141574e0 con 0x7fd21415a570 2023-12-17T11:48:40.831 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:40.827+0000 7fd2195a9640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2140c4e90 con 0x7fd214159c50 2023-12-17T11:48:40.831 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:40.827+0000 7fd212ffd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd2140b2670 0x7fd214156a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:40.831 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:40.828+0000 7fd212ffd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd2140b2670 0x7fd214156a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:35184/0 (socket says 172.21.15.40:35184) 2023-12-17T11:48:40.831 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:40.828+0000 7fd212ffd640 1 -- 172.21.15.40:0/198877080 learned_addr learned my addr 172.21.15.40:0/198877080 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-17T11:48:40.831 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:40.828+0000 7fd2127fc640 1 --2- 172.21.15.40:0/198877080 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd214159c50 0x7fd214154090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:40.831 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:40.828+0000 7fd2137fe640 1 --2- 172.21.15.40:0/198877080 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd21415a570 0x7fd2140c4500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:40.831 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:40.828+0000 7fd212ffd640 1 -- 172.21.15.40:0/198877080 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd214159c50 msgr2=0x7fd214154090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:40.831 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:40.828+0000 7fd212ffd640 1 --2- 172.21.15.40:0/198877080 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd214159c50 0x7fd214154090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:40.831 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:40.828+0000 7fd212ffd640 1 -- 172.21.15.40:0/198877080 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd21415a570 msgr2=0x7fd2140c4500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:40.832 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:40.828+0000 7fd212ffd640 1 --2- 172.21.15.40:0/198877080 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd21415a570 0x7fd2140c4500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:40.832 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:40.828+0000 7fd212ffd640 1 -- 172.21.15.40:0/198877080 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1fc009400 con 0x7fd2140b2670 2023-12-17T11:48:40.832 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:40.828+0000 7fd2137fe640 1 --2- 172.21.15.40:0/198877080 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd21415a570 0x7fd2140c4500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-17T11:48:40.832 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:40.828+0000 7fd212ffd640 1 --2- 172.21.15.40:0/198877080 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd2140b2670 0x7fd214156a10 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fd20400efc0 tx=0x7fd20400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:48:40.832 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:40.829+0000 7fd20b7fe640 1 -- 172.21.15.40:0/198877080 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd204014480 con 0x7fd2140b2670 2023-12-17T11:48:40.832 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:40.829+0000 7fd20b7fe640 1 -- 172.21.15.40:0/198877080 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd20400f040 con 0x7fd2140b2670 2023-12-17T11:48:40.832 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:40.829+0000 7fd2195a9640 1 -- 172.21.15.40:0/198877080 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2140c5170 con 0x7fd2140b2670 2023-12-17T11:48:40.832 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:40.829+0000 7fd20b7fe640 1 -- 172.21.15.40:0/198877080 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd204014800 con 0x7fd2140b2670 2023-12-17T11:48:40.832 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:40.829+0000 7fd2195a9640 1 -- 172.21.15.40:0/198877080 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2141545d0 con 0x7fd2140b2670 2023-12-17T11:48:40.833 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:40.830+0000 7fd2195a9640 1 -- 172.21.15.40:0/198877080 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd214156860 con 0x7fd2140b2670 2023-12-17T11:48:40.833 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:40.831+0000 7fd20b7fe640 1 -- 172.21.15.40:0/198877080 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fd204014960 con 0x7fd2140b2670 2023-12-17T11:48:40.833 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:40.832+0000 7fd20b7fe640 1 --2- 172.21.15.40:0/198877080 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7fd1f406ae40 0x7fd1f406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:40.834 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:40.832+0000 7fd20b7fe640 1 -- 172.21.15.40:0/198877080 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fd20408a540 con 0x7fd2140b2670 2023-12-17T11:48:40.834 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:40.832+0000 7fd2127fc640 1 --2- 172.21.15.40:0/198877080 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7fd1f406ae40 0x7fd1f406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:40.835 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:40.833+0000 7fd2127fc640 1 --2- 172.21.15.40:0/198877080 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7fd1f406ae40 0x7fd1f406d300 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fd1fc036000 tx=0x7fd1fc03d040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:48:40.837 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:40.836+0000 7fd20b7fe640 1 -- 172.21.15.40:0/198877080 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fd2040552f0 con 0x7fd2140b2670 2023-12-17T11:48:41.070 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:41.068+0000 7fd2195a9640 1 -- 172.21.15.40:0/198877080 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd2140745d0 con 0x7fd2140b2670 2023-12-17T11:48:41.071 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:41.069+0000 7fd20b7fe640 1 -- 172.21.15.40:0/198877080 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4915 (secure 0 0 0) 0x7fd204058910 con 0x7fd2140b2670 2023-12-17T11:48:41.071 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T11:48:41.071 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/3337931457","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":3337931457},{"type":"v1","addr":"172.21.15.40:6835","nonce":3337931457}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4257,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6833/1874601964","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6832","nonce":1874601964},{"type":"v1","addr":"172.21.15.40:6833","nonce":1874601964}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4267,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6836/3645037845","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6834","nonce":3645037845},{"type":"v1","addr":"172.21.15.159:6836","nonce":3645037845}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-17T11:48:17.696113+0000","modified":"2023-12-17T11:48:40.061005+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4270},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4270":{"gid":4270,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.159:6837/1288849778","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6835","nonce":1288849778},{"type":"v1","addr":"172.21.15.159:6837","nonce":1288849778}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-12-17T11:48:41.071 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 8 2023-12-17T11:48:41.074 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:41.071+0000 7fd2195a9640 1 -- 172.21.15.40:0/198877080 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7fd1f406ae40 msgr2=0x7fd1f406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:41.074 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:41.071+0000 7fd2195a9640 1 --2- 172.21.15.40:0/198877080 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7fd1f406ae40 0x7fd1f406d300 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fd1fc036000 tx=0x7fd1fc03d040 comp rx=0 tx=0).stop 2023-12-17T11:48:41.074 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:41.072+0000 7fd2195a9640 1 -- 172.21.15.40:0/198877080 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd2140b2670 msgr2=0x7fd214156a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:41.074 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:41.072+0000 7fd2195a9640 1 --2- 172.21.15.40:0/198877080 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd2140b2670 0x7fd214156a10 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fd20400efc0 tx=0x7fd20400c490 comp rx=0 tx=0).stop 2023-12-17T11:48:41.074 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:41.072+0000 7fd2195a9640 1 -- 172.21.15.40:0/198877080 shutdown_connections 2023-12-17T11:48:41.074 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:41.072+0000 7fd2195a9640 1 --2- 172.21.15.40:0/198877080 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7fd1f406ae40 0x7fd1f406d300 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:41.074 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:41.072+0000 7fd2195a9640 1 --2- 172.21.15.40:0/198877080 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd21415a570 0x7fd2140c4500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:41.074 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:41.072+0000 7fd2195a9640 1 --2- 172.21.15.40:0/198877080 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd214159c50 0x7fd214154090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:41.074 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:41.072+0000 7fd2195a9640 1 --2- 172.21.15.40:0/198877080 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd2140b2670 0x7fd214156a10 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:41.075 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:41.072+0000 7fd2195a9640 1 -- 172.21.15.40:0/198877080 >> 172.21.15.40:0/198877080 conn(0x7fd2140cf540 msgr2=0x7fd21406a460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:48:41.075 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:41.072+0000 7fd2195a9640 1 -- 172.21.15.40:0/198877080 shutdown_connections 2023-12-17T11:48:41.075 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:41.072+0000 7fd2195a9640 1 -- 172.21.15.40:0/198877080 wait complete. 2023-12-17T11:48:41.092 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-17T11:48:41.321 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:41.319+0000 7f47176e7640 1 Processor -- start 2023-12-17T11:48:41.321 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:41.319+0000 7f47176e7640 1 -- start start 2023-12-17T11:48:41.323 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:41.321+0000 7f47176e7640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f4710143e00 0x7f47100b4040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:41.323 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:41.321+0000 7f47176e7640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47100b3bb0 con 0x7f471006c410 2023-12-17T11:48:41.323 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:41.321+0000 7f47176e7640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47101441e0 con 0x7f4710072180 2023-12-17T11:48:41.323 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:41.321+0000 7f47176e7640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4710072680 con 0x7f4710143e00 2023-12-17T11:48:41.324 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:41.321+0000 7f4715483640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f4710143e00 0x7f47100b4040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:41.324 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:41.321+0000 7f4715483640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f4710143e00 0x7f47100b4040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:35194/0 (socket says 172.21.15.40:35194) 2023-12-17T11:48:41.324 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:41.321+0000 7f4715483640 1 -- 172.21.15.40:0/3482608498 learned_addr learned my addr 172.21.15.40:0/3482608498 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-17T11:48:41.324 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:41.321+0000 7f4715c84640 1 --1- 172.21.15.40:0/3482608498 >> v1:172.21.15.40:6789/0 conn(0x7f471006c410 0x7f471015ecb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:39928/0 (socket says 172.21.15.40:39928) 2023-12-17T11:48:41.324 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:41.322+0000 7f4715483640 1 -- 172.21.15.40:0/3482608498 >> v1:172.21.15.159:6789/0 conn(0x7f4710072180 legacy=0x7f47100b4580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:41.324 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:41.322+0000 7f4715483640 1 -- 172.21.15.40:0/3482608498 >> v1:172.21.15.40:6789/0 conn(0x7f471006c410 legacy=0x7f471015ecb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:41.324 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:41.322+0000 7f4715483640 1 -- 172.21.15.40:0/3482608498 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47100b1e30 con 0x7f4710143e00 2023-12-17T11:48:41.324 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:41.322+0000 7f4707fff640 1 -- 172.21.15.40:0/3482608498 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 959172856 0 0) 0x7f47100b3bb0 con 0x7f471006c410 2023-12-17T11:48:41.325 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:41.323+0000 7f4715483640 1 --2- 172.21.15.40:0/3482608498 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4710143e00 0x7f47100b4040 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f470c009870 tx=0x7f470c02ba20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ece4ccef8f51fd server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:48:41.325 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:41.323+0000 7f4707fff640 1 -- 172.21.15.40:0/3482608498 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f470c02f840 con 0x7f4710143e00 2023-12-17T11:48:41.325 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:41.323+0000 7f4707fff640 1 -- 172.21.15.40:0/3482608498 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f470c02f9a0 con 0x7f4710143e00 2023-12-17T11:48:41.326 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:41.323+0000 7f4707fff640 1 -- 172.21.15.40:0/3482608498 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f470c02fd30 con 0x7f4710143e00 2023-12-17T11:48:41.326 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:41.324+0000 7f47176e7640 1 -- 172.21.15.40:0/3482608498 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4710143e00 msgr2=0x7f47100b4040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:41.326 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:41.324+0000 7f47176e7640 1 --2- 172.21.15.40:0/3482608498 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4710143e00 0x7f47100b4040 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f470c009870 tx=0x7f470c02ba20 comp rx=0 tx=0).stop 2023-12-17T11:48:41.326 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:41.324+0000 7f47176e7640 1 -- 172.21.15.40:0/3482608498 shutdown_connections 2023-12-17T11:48:41.327 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:41.324+0000 7f47176e7640 1 --2- 172.21.15.40:0/3482608498 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4710143e00 0x7f47100b4040 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:41.327 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:41.324+0000 7f47176e7640 1 -- 172.21.15.40:0/3482608498 >> 172.21.15.40:0/3482608498 conn(0x7f47100b0a90 msgr2=0x7f47100b0e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:48:41.327 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:41.324+0000 7f47176e7640 1 -- 172.21.15.40:0/3482608498 shutdown_connections 2023-12-17T11:48:41.327 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:41.324+0000 7f47176e7640 1 -- 172.21.15.40:0/3482608498 wait complete. 2023-12-17T11:48:41.328 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:41.326+0000 7f47176e7640 1 Processor -- start 2023-12-17T11:48:41.328 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:41.326+0000 7f47176e7640 1 -- start start 2023-12-17T11:48:41.330 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:41.327+0000 7f47176e7640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f471006c410 0x7f4710138f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:41.330 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:41.327+0000 7f47176e7640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f4710072180 0x7f47101f2bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:41.330 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:41.327+0000 7f47176e7640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4710143e00 0x7f4710139b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:41.330 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:41.327+0000 7f47176e7640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47100ce270 con 0x7f4710143e00 2023-12-17T11:48:41.330 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:41.327+0000 7f47176e7640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f471015aed0 con 0x7f471006c410 2023-12-17T11:48:41.330 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:41.327+0000 7f47176e7640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47100cd660 con 0x7f4710072180 2023-12-17T11:48:41.330 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:41.327+0000 7f4715c84640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4710143e00 0x7f4710139b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:41.330 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:41.327+0000 7f4715c84640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4710143e00 0x7f4710139b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:35202/0 (socket says 172.21.15.40:35202) 2023-12-17T11:48:41.330 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:41.327+0000 7f4715c84640 1 -- 172.21.15.40:0/4173923874 learned_addr learned my addr 172.21.15.40:0/4173923874 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-17T11:48:41.331 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:41.328+0000 7f4715483640 1 --2- 172.21.15.40:0/4173923874 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f471006c410 0x7f4710138f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:41.331 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:41.328+0000 7f4714c82640 1 --2- 172.21.15.40:0/4173923874 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f4710072180 0x7f47101f2bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:41.331 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:41.328+0000 7f4715c84640 1 -- 172.21.15.40:0/4173923874 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f4710072180 msgr2=0x7f47101f2bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:41.331 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:41.328+0000 7f4715c84640 1 --2- 172.21.15.40:0/4173923874 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f4710072180 0x7f47101f2bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:41.331 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:41.328+0000 7f4715c84640 1 -- 172.21.15.40:0/4173923874 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f471006c410 msgr2=0x7f4710138f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:41.331 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:41.328+0000 7f4715c84640 1 --2- 172.21.15.40:0/4173923874 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f471006c410 0x7f4710138f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:41.331 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:41.328+0000 7f4715c84640 1 -- 172.21.15.40:0/4173923874 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f470c0094d0 con 0x7f4710143e00 2023-12-17T11:48:41.331 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:41.328+0000 7f4714c82640 1 --2- 172.21.15.40:0/4173923874 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f4710072180 0x7f47101f2bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-17T11:48:41.331 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:41.328+0000 7f4715c84640 1 --2- 172.21.15.40:0/4173923874 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4710143e00 0x7f4710139b60 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f470800c7a0 tx=0x7f470800cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:48:41.332 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:41.328+0000 7f4705ffb640 1 -- 172.21.15.40:0/4173923874 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f470800a640 con 0x7f4710143e00 2023-12-17T11:48:41.332 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:41.328+0000 7f4705ffb640 1 -- 172.21.15.40:0/4173923874 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f470800a7a0 con 0x7f4710143e00 2023-12-17T11:48:41.332 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:41.329+0000 7f47176e7640 1 -- 172.21.15.40:0/4173923874 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47100cd940 con 0x7f4710143e00 2023-12-17T11:48:41.332 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:41.329+0000 7f4705ffb640 1 -- 172.21.15.40:0/4173923874 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f470800abd0 con 0x7f4710143e00 2023-12-17T11:48:41.332 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:41.329+0000 7f47176e7640 1 -- 172.21.15.40:0/4173923874 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47100cdf00 con 0x7f4710143e00 2023-12-17T11:48:41.332 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:41.330+0000 7f47176e7640 1 -- 172.21.15.40:0/4173923874 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47100ce3e0 con 0x7f4710143e00 2023-12-17T11:48:41.333 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:41.331+0000 7f4705ffb640 1 -- 172.21.15.40:0/4173923874 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f470800ad30 con 0x7f4710143e00 2023-12-17T11:48:41.333 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:41.332+0000 7f4705ffb640 1 --2- 172.21.15.40:0/4173923874 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f46f406ae40 0x7f46f406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:41.334 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:41.332+0000 7f4705ffb640 1 -- 172.21.15.40:0/4173923874 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f47080891b0 con 0x7f4710143e00 2023-12-17T11:48:41.334 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:41.332+0000 7f4715483640 1 --2- 172.21.15.40:0/4173923874 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f46f406ae40 0x7f46f406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:41.335 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:41.333+0000 7f4715483640 1 --2- 172.21.15.40:0/4173923874 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f46f406ae40 0x7f46f406d300 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f470c036000 tx=0x7f470c008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:48:41.337 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:41.336+0000 7f4705ffb640 1 -- 172.21.15.40:0/4173923874 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f4708053ed0 con 0x7f4710143e00 2023-12-17T11:48:41.536 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:41.534+0000 7f47176e7640 1 -- 172.21.15.40:0/4173923874 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f47100745d0 con 0x7f4710143e00 2023-12-17T11:48:41.537 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:41.536+0000 7f4705ffb640 1 -- 172.21.15.40:0/4173923874 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18322 (secure 0 0 0) 0x7f47080574f0 con 0x7f4710143e00 2023-12-17T11:48:41.538 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T11:48:41.538 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":25,"fsid":"099cd35d-80d9-4ca4-8424-de13b3b03ac7","created":"2023-12-17T11:47:53.450097+0000","modified":"2023-12-17T11:48:22.971195+0000","last_up_change":"2023-12-17T11:48:05.724195+0000","last_in_change":"2023-12-17T11:47:56.956499+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-17T11:48:06.668943+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-17T11:48:16.151444+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-17T11:48:16.717726+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-17T11:48:20.534819+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a88bfd46-63b8-48b1-9c0e-5c9cdc31bd38","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":555204741},{"type":"v1","addr":"172.21.15.40:6802","nonce":555204741}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":555204741},{"type":"v1","addr":"172.21.15.40:6807","nonce":555204741}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":555204741},{"type":"v1","addr":"172.21.15.40:6815","nonce":555204741}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6809","nonce":555204741},{"type":"v1","addr":"172.21.15.40:6812","nonce":555204741}]},"public_addr":"172.21.15.40:6802/555204741","cluster_addr":"172.21.15.40:6807/555204741","heartbeat_back_addr":"172.21.15.40:6815/555204741","heartbeat_front_addr":"172.21.15.40:6812/555204741","state":["exists","up"]},{"osd":1,"uuid":"c5d628ae-36f4-4866-802c-b162f0e90add","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6801","nonce":1221318112},{"type":"v1","addr":"172.21.15.40:6803","nonce":1221318112}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6805","nonce":1221318112},{"type":"v1","addr":"172.21.15.40:6806","nonce":1221318112}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6811","nonce":1221318112},{"type":"v1","addr":"172.21.15.40:6813","nonce":1221318112}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":1221318112},{"type":"v1","addr":"172.21.15.40:6810","nonce":1221318112}]},"public_addr":"172.21.15.40:6803/1221318112","cluster_addr":"172.21.15.40:6806/1221318112","heartbeat_back_addr":"172.21.15.40:6813/1221318112","heartbeat_front_addr":"172.21.15.40:6810/1221318112","state":["exists","up"]},{"osd":2,"uuid":"d986ad6a-af2f-47fc-9c3b-fbda27b82b73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":1959000265},{"type":"v1","addr":"172.21.15.40:6817","nonce":1959000265}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6818","nonce":1959000265},{"type":"v1","addr":"172.21.15.40:6819","nonce":1959000265}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":1959000265},{"type":"v1","addr":"172.21.15.40:6827","nonce":1959000265}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":1959000265},{"type":"v1","addr":"172.21.15.40:6822","nonce":1959000265}]},"public_addr":"172.21.15.40:6817/1959000265","cluster_addr":"172.21.15.40:6819/1959000265","heartbeat_back_addr":"172.21.15.40:6827/1959000265","heartbeat_front_addr":"172.21.15.40:6822/1959000265","state":["exists","up"]},{"osd":3,"uuid":"d79d22b7-be05-41b2-b95d-697db677fd02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6821","nonce":974040287},{"type":"v1","addr":"172.21.15.40:6823","nonce":974040287}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6825","nonce":974040287},{"type":"v1","addr":"172.21.15.40:6826","nonce":974040287}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":974040287},{"type":"v1","addr":"172.21.15.40:6831","nonce":974040287}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":974040287},{"type":"v1","addr":"172.21.15.40:6829","nonce":974040287}]},"public_addr":"172.21.15.40:6823/974040287","cluster_addr":"172.21.15.40:6826/974040287","heartbeat_back_addr":"172.21.15.40:6831/974040287","heartbeat_front_addr":"172.21.15.40:6829/974040287","state":["exists","up"]},{"osd":4,"uuid":"62a7a233-d3ea-40be-91de-180c0208d639","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6808","nonce":3937787733},{"type":"v1","addr":"172.21.15.159:6809","nonce":3937787733}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6810","nonce":3937787733},{"type":"v1","addr":"172.21.15.159:6811","nonce":3937787733}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6814","nonce":3937787733},{"type":"v1","addr":"172.21.15.159:6815","nonce":3937787733}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6812","nonce":3937787733},{"type":"v1","addr":"172.21.15.159:6813","nonce":3937787733}]},"public_addr":"172.21.15.159:6809/3937787733","cluster_addr":"172.21.15.159:6811/3937787733","heartbeat_back_addr":"172.21.15.159:6815/3937787733","heartbeat_front_addr":"172.21.15.159:6813/3937787733","state":["exists","up"]},{"osd":5,"uuid":"84629cea-dc0e-4b5e-b203-5ea963839281","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6816","nonce":3032505240},{"type":"v1","addr":"172.21.15.159:6817","nonce":3032505240}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6818","nonce":3032505240},{"type":"v1","addr":"172.21.15.159:6819","nonce":3032505240}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6822","nonce":3032505240},{"type":"v1","addr":"172.21.15.159:6823","nonce":3032505240}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6820","nonce":3032505240},{"type":"v1","addr":"172.21.15.159:6821","nonce":3032505240}]},"public_addr":"172.21.15.159:6817/3032505240","cluster_addr":"172.21.15.159:6819/3032505240","heartbeat_back_addr":"172.21.15.159:6823/3032505240","heartbeat_front_addr":"172.21.15.159:6821/3032505240","state":["exists","up"]},{"osd":6,"uuid":"4ae3af3a-1743-4070-a91d-8be5c31cdb04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6800","nonce":2411788597},{"type":"v1","addr":"172.21.15.159:6801","nonce":2411788597}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6802","nonce":2411788597},{"type":"v1","addr":"172.21.15.159:6803","nonce":2411788597}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6806","nonce":2411788597},{"type":"v1","addr":"172.21.15.159:6807","nonce":2411788597}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6804","nonce":2411788597},{"type":"v1","addr":"172.21.15.159:6805","nonce":2411788597}]},"public_addr":"172.21.15.159:6801/2411788597","cluster_addr":"172.21.15.159:6803/2411788597","heartbeat_back_addr":"172.21.15.159:6807/2411788597","heartbeat_front_addr":"172.21.15.159:6805/2411788597","state":["exists","up"]},{"osd":7,"uuid":"c1f4c7f2-8f75-4f95-bc63-a332773e3b8e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6824","nonce":478953349},{"type":"v1","addr":"172.21.15.159:6825","nonce":478953349}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6826","nonce":478953349},{"type":"v1","addr":"172.21.15.159:6827","nonce":478953349}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6830","nonce":478953349},{"type":"v1","addr":"172.21.15.159:6831","nonce":478953349}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6828","nonce":478953349},{"type":"v1","addr":"172.21.15.159:6829","nonce":478953349}]},"public_addr":"172.21.15.159:6825/478953349","cluster_addr":"172.21.15.159:6827/478953349","heartbeat_back_addr":"172.21.15.159:6831/478953349","heartbeat_front_addr":"172.21.15.159:6829/478953349","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T11:48:02.023567+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T11:48:02.278216+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T11:48:02.311843+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T11:48:01.773372+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T11:48:02.618910+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T11:48:02.361559+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T11:48:02.223997+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T11:48:02.604403+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-17T11:48:41.540 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:41.538+0000 7f47176e7640 1 -- 172.21.15.40:0/4173923874 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f46f406ae40 msgr2=0x7f46f406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:41.541 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:41.538+0000 7f47176e7640 1 --2- 172.21.15.40:0/4173923874 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f46f406ae40 0x7f46f406d300 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f470c036000 tx=0x7f470c008030 comp rx=0 tx=0).stop 2023-12-17T11:48:41.541 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:41.538+0000 7f47176e7640 1 -- 172.21.15.40:0/4173923874 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4710143e00 msgr2=0x7f4710139b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:41.541 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:41.538+0000 7f47176e7640 1 --2- 172.21.15.40:0/4173923874 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4710143e00 0x7f4710139b60 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f470800c7a0 tx=0x7f470800cc60 comp rx=0 tx=0).stop 2023-12-17T11:48:41.541 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:41.538+0000 7f47176e7640 1 -- 172.21.15.40:0/4173923874 shutdown_connections 2023-12-17T11:48:41.541 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:41.538+0000 7f47176e7640 1 --2- 172.21.15.40:0/4173923874 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f46f406ae40 0x7f46f406d300 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:41.541 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:41.538+0000 7f47176e7640 1 --2- 172.21.15.40:0/4173923874 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4710143e00 0x7f4710139b60 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:41.541 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:41.538+0000 7f47176e7640 1 --2- 172.21.15.40:0/4173923874 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f4710072180 0x7f47101f2bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:41.541 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:41.538+0000 7f47176e7640 1 --2- 172.21.15.40:0/4173923874 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f471006c410 0x7f4710138f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:41.541 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:41.538+0000 7f47176e7640 1 -- 172.21.15.40:0/4173923874 >> 172.21.15.40:0/4173923874 conn(0x7f47100b0a90 msgr2=0x7f4710144400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:48:41.541 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:41.538+0000 7f47176e7640 1 -- 172.21.15.40:0/4173923874 shutdown_connections 2023-12-17T11:48:41.542 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:41.539+0000 7f47176e7640 1 -- 172.21.15.40:0/4173923874 wait complete. 2023-12-17T11:48:41.561 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-12-17T11:48:41.561 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-17T11:48:41.778 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:41.776+0000 7f10e92ea640 1 Processor -- start 2023-12-17T11:48:41.778 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:41.776+0000 7f10e92ea640 1 -- start start 2023-12-17T11:48:41.780 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:41.778+0000 7f10e92ea640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f10e415e5d0 0x7f10e406bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:41.780 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:41.778+0000 7f10e92ea640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f10e4071260 0x7f10e40cded0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:41.780 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:41.778+0000 7f10e92ea640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10e4071f90 con 0x7f10e40ae200 2023-12-17T11:48:41.780 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:41.778+0000 7f10e92ea640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10e4072270 con 0x7f10e4071260 2023-12-17T11:48:41.780 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:41.778+0000 7f10e92ea640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10e4070070 con 0x7f10e415e5d0 2023-12-17T11:48:41.781 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:41.779+0000 7f10e8ae9640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f10e4071260 0x7f10e40cded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:41.781 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:41.779+0000 7f10e8ae9640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f10e4071260 0x7f10e40cded0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.40:39312/0 (socket says 172.21.15.40:39312) 2023-12-17T11:48:41.781 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:41.779+0000 7f10db7fe640 1 --1- >> v1:172.21.15.159:6789/0 conn(0x7f10e40ae200 0x7f10e4070b50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.159:6789/0 says I am v1:172.21.15.40:53836/0 (socket says 172.21.15.40:53836) 2023-12-17T11:48:41.781 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:41.779+0000 7f10e8ae9640 1 -- 172.21.15.40:0/985225464 learned_addr learned my addr 172.21.15.40:0/985225464 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-17T11:48:41.781 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:41.779+0000 7f10e3fff640 1 --2- 172.21.15.40:0/985225464 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f10e415e5d0 0x7f10e406bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:41.781 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:41.779+0000 7f10e8ae9640 1 -- 172.21.15.40:0/985225464 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f10e415e5d0 msgr2=0x7f10e406bdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:48:41.782 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:41.779+0000 7f10e8ae9640 1 --2- 172.21.15.40:0/985225464 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f10e415e5d0 0x7f10e406bdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:41.782 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:41.779+0000 7f10e8ae9640 1 -- 172.21.15.40:0/985225464 >> v1:172.21.15.159:6789/0 conn(0x7f10e40ae200 legacy=0x7f10e4070b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:41.782 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:41.779+0000 7f10e8ae9640 1 -- 172.21.15.40:0/985225464 --> v2:172.21.15.159:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10e4070350 con 0x7f10e4071260 2023-12-17T11:48:41.782 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:41.781+0000 7f10e8ae9640 1 --2- 172.21.15.40:0/985225464 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f10e4071260 0x7f10e40cded0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f10dc009e50 tx=0x7f10dc02bed0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=38bdc20701246886 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:48:41.783 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:41.781+0000 7f10e37fe640 1 -- 172.21.15.40:0/985225464 <== mon.1 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10dc02ca70 con 0x7f10e4071260 2023-12-17T11:48:41.783 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:41.781+0000 7f10e37fe640 1 -- 172.21.15.40:0/985225464 <== mon.1 v2:172.21.15.159:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10dc02cbd0 con 0x7f10e4071260 2023-12-17T11:48:41.783 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:41.781+0000 7f10e37fe640 1 -- 172.21.15.40:0/985225464 <== mon.1 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10dc0343f0 con 0x7f10e4071260 2023-12-17T11:48:41.784 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:41.782+0000 7f10e92ea640 1 -- 172.21.15.40:0/985225464 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f10e4071260 msgr2=0x7f10e40cded0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:41.784 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:41.782+0000 7f10e92ea640 1 --2- 172.21.15.40:0/985225464 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f10e4071260 0x7f10e40cded0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f10dc009e50 tx=0x7f10dc02bed0 comp rx=0 tx=0).stop 2023-12-17T11:48:41.784 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:41.782+0000 7f10e92ea640 1 -- 172.21.15.40:0/985225464 shutdown_connections 2023-12-17T11:48:41.784 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:41.782+0000 7f10e92ea640 1 --2- 172.21.15.40:0/985225464 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f10e4071260 0x7f10e40cded0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:41.784 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:41.782+0000 7f10e92ea640 1 --2- 172.21.15.40:0/985225464 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f10e415e5d0 0x7f10e406bdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:41.784 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:41.782+0000 7f10e92ea640 1 -- 172.21.15.40:0/985225464 >> 172.21.15.40:0/985225464 conn(0x7f10e40b0860 msgr2=0x7f10e40b0c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:48:41.784 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:41.782+0000 7f10e92ea640 1 -- 172.21.15.40:0/985225464 shutdown_connections 2023-12-17T11:48:41.784 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:41.782+0000 7f10e92ea640 1 -- 172.21.15.40:0/985225464 wait complete. 2023-12-17T11:48:41.786 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:41.784+0000 7f10e92ea640 1 Processor -- start 2023-12-17T11:48:41.786 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:41.784+0000 7f10e92ea640 1 -- start start 2023-12-17T11:48:41.789 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:41.785+0000 7f10e92ea640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f10e4071260 0x7f10e409bbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:41.790 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:41.785+0000 7f10e92ea640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f10e40ae200 0x7f10e4141990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:41.790 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:41.785+0000 7f10e92ea640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f10e415e5d0 0x7f10e415ea40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:41.790 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:41.785+0000 7f10e92ea640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10e41426d0 con 0x7f10e4071260 2023-12-17T11:48:41.790 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:41.785+0000 7f10e92ea640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10e4150b80 con 0x7f10e40ae200 2023-12-17T11:48:41.790 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:41.785+0000 7f10e92ea640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10e409c410 con 0x7f10e415e5d0 2023-12-17T11:48:41.790 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:41.785+0000 7f10e3fff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f10e4071260 0x7f10e409bbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:41.790 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:41.785+0000 7f10e3fff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f10e4071260 0x7f10e409bbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:35212/0 (socket says 172.21.15.40:35212) 2023-12-17T11:48:41.791 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:41.786+0000 7f10e3fff640 1 -- 172.21.15.40:0/3445461184 learned_addr learned my addr 172.21.15.40:0/3445461184 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-17T11:48:41.791 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:41.786+0000 7f10db7fe640 1 --2- 172.21.15.40:0/3445461184 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f10e40ae200 0x7f10e4141990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:41.791 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:41.786+0000 7f10e8ae9640 1 --2- 172.21.15.40:0/3445461184 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f10e415e5d0 0x7f10e415ea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:41.791 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:41.786+0000 7f10e3fff640 1 -- 172.21.15.40:0/3445461184 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f10e415e5d0 msgr2=0x7f10e415ea40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:41.791 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:41.786+0000 7f10e3fff640 1 --2- 172.21.15.40:0/3445461184 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f10e415e5d0 0x7f10e415ea40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:41.791 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:41.786+0000 7f10e3fff640 1 -- 172.21.15.40:0/3445461184 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f10e40ae200 msgr2=0x7f10e4141990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:41.792 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:41.786+0000 7f10e3fff640 1 --2- 172.21.15.40:0/3445461184 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f10e40ae200 0x7f10e4141990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:41.792 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:41.786+0000 7f10e3fff640 1 -- 172.21.15.40:0/3445461184 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10dc009b30 con 0x7f10e4071260 2023-12-17T11:48:41.792 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:41.786+0000 7f10e3fff640 1 --2- 172.21.15.40:0/3445461184 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f10e4071260 0x7f10e409bbe0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f10d400e9e0 tx=0x7f10d400eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:48:41.792 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:41.787+0000 7f10e17fa640 1 -- 172.21.15.40:0/3445461184 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10d4009670 con 0x7f10e4071260 2023-12-17T11:48:41.792 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:41.787+0000 7f10e17fa640 1 -- 172.21.15.40:0/3445461184 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10d400c9d0 con 0x7f10e4071260 2023-12-17T11:48:41.792 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:41.787+0000 7f10e17fa640 1 -- 172.21.15.40:0/3445461184 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10d400cd80 con 0x7f10e4071260 2023-12-17T11:48:41.792 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:41.787+0000 7f10e92ea640 1 -- 172.21.15.40:0/3445461184 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10e409c6f0 con 0x7f10e4071260 2023-12-17T11:48:41.793 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:41.787+0000 7f10e92ea640 1 -- 172.21.15.40:0/3445461184 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10e41422f0 con 0x7f10e4071260 2023-12-17T11:48:41.794 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:41.788+0000 7f10e92ea640 1 -- 172.21.15.40:0/3445461184 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10e4142940 con 0x7f10e4071260 2023-12-17T11:48:41.794 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:41.789+0000 7f10e17fa640 1 -- 172.21.15.40:0/3445461184 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f10d4013470 con 0x7f10e4071260 2023-12-17T11:48:41.794 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:41.790+0000 7f10e17fa640 1 --2- 172.21.15.40:0/3445461184 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f10c806ae40 0x7f10c806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:41.795 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:41.790+0000 7f10e17fa640 1 -- 172.21.15.40:0/3445461184 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f10d4089ba0 con 0x7f10e4071260 2023-12-17T11:48:41.795 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:41.791+0000 7f10db7fe640 1 --2- 172.21.15.40:0/3445461184 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f10c806ae40 0x7f10c806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:41.795 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:41.792+0000 7f10db7fe640 1 --2- 172.21.15.40:0/3445461184 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f10c806ae40 0x7f10c806d300 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f10e41f6200 tx=0x7f10cc007c80 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:48:41.796 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:41.794+0000 7f10e17fa640 1 -- 172.21.15.40:0/3445461184 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f10d4054950 con 0x7f10e4071260 2023-12-17T11:48:41.989 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:41.986+0000 7f10e92ea640 1 -- 172.21.15.40:0/3445461184 --> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f10e4071c20 con 0x7f10c806ae40 2023-12-17T11:48:42.021 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:42.019+0000 7f10e17fa640 1 -- 172.21.15.40:0/3445461184 <== mgr.4105 v2:172.21.15.159:6832/479465803 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+345132 (secure 0 0 0) 0x7f10cc005a50 con 0x7f10c806ae40 2023-12-17T11:48:42.027 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T11:48:42.029 INFO:teuthology.orchestra.run.smithi040.stderr:dumped all 2023-12-17T11:48:42.031 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:42.026+0000 7f10e92ea640 1 -- 172.21.15.40:0/3445461184 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f10c806ae40 msgr2=0x7f10c806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:42.031 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:42.026+0000 7f10e92ea640 1 --2- 172.21.15.40:0/3445461184 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f10c806ae40 0x7f10c806d300 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f10e41f6200 tx=0x7f10cc007c80 comp rx=0 tx=0).stop 2023-12-17T11:48:42.031 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:42.026+0000 7f10e92ea640 1 -- 172.21.15.40:0/3445461184 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f10e4071260 msgr2=0x7f10e409bbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:42.031 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:42.026+0000 7f10e92ea640 1 --2- 172.21.15.40:0/3445461184 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f10e4071260 0x7f10e409bbe0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f10d400e9e0 tx=0x7f10d400eea0 comp rx=0 tx=0).stop 2023-12-17T11:48:42.031 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:42.026+0000 7f10e92ea640 1 -- 172.21.15.40:0/3445461184 shutdown_connections 2023-12-17T11:48:42.031 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:42.026+0000 7f10e92ea640 1 --2- 172.21.15.40:0/3445461184 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f10c806ae40 0x7f10c806d300 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:42.031 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:42.026+0000 7f10e92ea640 1 --2- 172.21.15.40:0/3445461184 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f10e415e5d0 0x7f10e415ea40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:42.031 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:42.026+0000 7f10e92ea640 1 --2- 172.21.15.40:0/3445461184 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f10e40ae200 0x7f10e4141990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:42.031 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:42.026+0000 7f10e92ea640 1 --2- 172.21.15.40:0/3445461184 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f10e4071260 0x7f10e409bbe0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:42.031 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:42.026+0000 7f10e92ea640 1 -- 172.21.15.40:0/3445461184 >> 172.21.15.40:0/3445461184 conn(0x7f10e40b0860 msgr2=0x7f10e406c7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:48:42.031 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:42.026+0000 7f10e92ea640 1 -- 172.21.15.40:0/3445461184 shutdown_connections 2023-12-17T11:48:42.031 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:42.026+0000 7f10e92ea640 1 -- 172.21.15.40:0/3445461184 wait complete. 2023-12-17T11:48:42.049 INFO:teuthology.orchestra.run.smithi040.stdout:{"pg_ready":true,"pg_map":{"version":35,"stamp":"2023-12-17T11:48:40.600696+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594865,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":206,"num_write_kb":2433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":158,"ondisk_log_size":158,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219440,"kb_used_data":3272,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755280,"statfs":{"total":773094113280,"available":772869406720,"internally_reserved":0,"allocated":3350528,"data_stored":2014426,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":221236786},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2087,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005715"},"pg_stats":[{"pgid":"2.1f","version":"20'4","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-17T11:48:22.517845+0000","last_change":"2023-12-17T11:48:17.243309+0000","last_active":"2023-12-17T11:48:22.517845+0000","last_peered":"2023-12-17T11:48:22.517845+0000","last_clean":"2023-12-17T11:48:22.517845+0000","last_became_active":"2023-12-17T11:48:17.242970+0000","last_became_peered":"2023-12-17T11:48:17.242970+0000","last_unstale":"2023-12-17T11:48:22.517845+0000","last_undegraded":"2023-12-17T11:48:22.517845+0000","last_fullsized":"2023-12-17T11:48:22.517845+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:16.193911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:16.193911+0000","last_clean_scrub_stamp":"2023-12-17T11:48:16.193911+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T21:33:08.409177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-17T11:48:22.501333+0000","last_change":"2023-12-17T11:48:18.269881+0000","last_active":"2023-12-17T11:48:22.501333+0000","last_peered":"2023-12-17T11:48:22.501333+0000","last_clean":"2023-12-17T11:48:22.501333+0000","last_became_active":"2023-12-17T11:48:18.268658+0000","last_became_peered":"2023-12-17T11:48:18.268658+0000","last_unstale":"2023-12-17T11:48:22.501333+0000","last_undegraded":"2023-12-17T11:48:22.501333+0000","last_fullsized":"2023-12-17T11:48:22.501333+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_clean_scrub_stamp":"2023-12-17T11:48:17.199970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T22:33:29.994957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-17T11:48:24.563717+0000","last_change":"2023-12-17T11:48:22.536397+0000","last_active":"2023-12-17T11:48:24.563717+0000","last_peered":"2023-12-17T11:48:24.563717+0000","last_clean":"2023-12-17T11:48:24.563717+0000","last_became_active":"2023-12-17T11:48:22.535833+0000","last_became_peered":"2023-12-17T11:48:22.535833+0000","last_unstale":"2023-12-17T11:48:24.563717+0000","last_undegraded":"2023-12-17T11:48:24.563717+0000","last_fullsized":"2023-12-17T11:48:24.563717+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:21.473989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:21.473989+0000","last_clean_scrub_stamp":"2023-12-17T11:48:21.473989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T13:25:07.551873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-17T11:48:22.500677+0000","last_change":"2023-12-17T11:48:17.242548+0000","last_active":"2023-12-17T11:48:22.500677+0000","last_peered":"2023-12-17T11:48:22.500677+0000","last_clean":"2023-12-17T11:48:22.500677+0000","last_became_active":"2023-12-17T11:48:17.242261+0000","last_became_peered":"2023-12-17T11:48:17.242261+0000","last_unstale":"2023-12-17T11:48:22.500677+0000","last_undegraded":"2023-12-17T11:48:22.500677+0000","last_fullsized":"2023-12-17T11:48:22.500677+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:16.193911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:16.193911+0000","last_clean_scrub_stamp":"2023-12-17T11:48:16.193911+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T17:25:44.412598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-17T11:48:22.517637+0000","last_change":"2023-12-17T11:48:18.284502+0000","last_active":"2023-12-17T11:48:22.517637+0000","last_peered":"2023-12-17T11:48:22.517637+0000","last_clean":"2023-12-17T11:48:22.517637+0000","last_became_active":"2023-12-17T11:48:18.284224+0000","last_became_peered":"2023-12-17T11:48:18.284224+0000","last_unstale":"2023-12-17T11:48:22.517637+0000","last_undegraded":"2023-12-17T11:48:22.517637+0000","last_fullsized":"2023-12-17T11:48:22.517637+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_clean_scrub_stamp":"2023-12-17T11:48:17.199970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T16:14:48.723317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-17T11:48:23.467417+0000","last_change":"2023-12-17T11:48:22.534382+0000","last_active":"2023-12-17T11:48:23.467417+0000","last_peered":"2023-12-17T11:48:23.467417+0000","last_clean":"2023-12-17T11:48:23.467417+0000","last_became_active":"2023-12-17T11:48:22.533910+0000","last_became_peered":"2023-12-17T11:48:22.533910+0000","last_unstale":"2023-12-17T11:48:23.467417+0000","last_undegraded":"2023-12-17T11:48:23.467417+0000","last_fullsized":"2023-12-17T11:48:23.467417+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:21.473989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:21.473989+0000","last_clean_scrub_stamp":"2023-12-17T11:48:21.473989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T22:33:34.268975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-17T11:48:22.538051+0000","last_change":"2023-12-17T11:48:17.252782+0000","last_active":"2023-12-17T11:48:22.538051+0000","last_peered":"2023-12-17T11:48:22.538051+0000","last_clean":"2023-12-17T11:48:22.538051+0000","last_became_active":"2023-12-17T11:48:17.252501+0000","last_became_peered":"2023-12-17T11:48:17.252501+0000","last_unstale":"2023-12-17T11:48:22.538051+0000","last_undegraded":"2023-12-17T11:48:22.538051+0000","last_fullsized":"2023-12-17T11:48:22.538051+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:16.193911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:16.193911+0000","last_clean_scrub_stamp":"2023-12-17T11:48:16.193911+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T18:12:00.944371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-17T11:48:22.521803+0000","last_change":"2023-12-17T11:48:18.283410+0000","last_active":"2023-12-17T11:48:22.521803+0000","last_peered":"2023-12-17T11:48:22.521803+0000","last_clean":"2023-12-17T11:48:22.521803+0000","last_became_active":"2023-12-17T11:48:18.283129+0000","last_became_peered":"2023-12-17T11:48:18.283129+0000","last_unstale":"2023-12-17T11:48:22.521803+0000","last_undegraded":"2023-12-17T11:48:22.521803+0000","last_fullsized":"2023-12-17T11:48:22.521803+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_clean_scrub_stamp":"2023-12-17T11:48:17.199970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T13:18:38.029532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-17T11:48:23.468045+0000","last_change":"2023-12-17T11:48:22.532489+0000","last_active":"2023-12-17T11:48:23.468045+0000","last_peered":"2023-12-17T11:48:23.468045+0000","last_clean":"2023-12-17T11:48:23.468045+0000","last_became_active":"2023-12-17T11:48:22.531971+0000","last_became_peered":"2023-12-17T11:48:22.531971+0000","last_unstale":"2023-12-17T11:48:23.468045+0000","last_undegraded":"2023-12-17T11:48:23.468045+0000","last_fullsized":"2023-12-17T11:48:23.468045+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:21.473989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:21.473989+0000","last_clean_scrub_stamp":"2023-12-17T11:48:21.473989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T14:39:15.707189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-17T11:48:22.538470+0000","last_change":"2023-12-17T11:48:17.259412+0000","last_active":"2023-12-17T11:48:22.538470+0000","last_peered":"2023-12-17T11:48:22.538470+0000","last_clean":"2023-12-17T11:48:22.538470+0000","last_became_active":"2023-12-17T11:48:17.259092+0000","last_became_peered":"2023-12-17T11:48:17.259092+0000","last_unstale":"2023-12-17T11:48:22.538470+0000","last_undegraded":"2023-12-17T11:48:22.538470+0000","last_fullsized":"2023-12-17T11:48:22.538470+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:16.193911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:16.193911+0000","last_clean_scrub_stamp":"2023-12-17T11:48:16.193911+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T21:38:11.246682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-17T11:48:22.522929+0000","last_change":"2023-12-17T11:48:18.282884+0000","last_active":"2023-12-17T11:48:22.522929+0000","last_peered":"2023-12-17T11:48:22.522929+0000","last_clean":"2023-12-17T11:48:22.522929+0000","last_became_active":"2023-12-17T11:48:18.282589+0000","last_became_peered":"2023-12-17T11:48:18.282589+0000","last_unstale":"2023-12-17T11:48:22.522929+0000","last_undegraded":"2023-12-17T11:48:22.522929+0000","last_fullsized":"2023-12-17T11:48:22.522929+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_clean_scrub_stamp":"2023-12-17T11:48:17.199970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T14:46:31.139617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-17T11:48:23.468065+0000","last_change":"2023-12-17T11:48:22.524129+0000","last_active":"2023-12-17T11:48:23.468065+0000","last_peered":"2023-12-17T11:48:23.468065+0000","last_clean":"2023-12-17T11:48:23.468065+0000","last_became_active":"2023-12-17T11:48:22.523749+0000","last_became_peered":"2023-12-17T11:48:22.523749+0000","last_unstale":"2023-12-17T11:48:23.468065+0000","last_undegraded":"2023-12-17T11:48:23.468065+0000","last_fullsized":"2023-12-17T11:48:23.468065+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:21.473989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:21.473989+0000","last_clean_scrub_stamp":"2023-12-17T11:48:21.473989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T14:35:42.104042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-17T11:48:22.528476+0000","last_change":"2023-12-17T11:48:18.262498+0000","last_active":"2023-12-17T11:48:22.528476+0000","last_peered":"2023-12-17T11:48:22.528476+0000","last_clean":"2023-12-17T11:48:22.528476+0000","last_became_active":"2023-12-17T11:48:18.260747+0000","last_became_peered":"2023-12-17T11:48:18.260747+0000","last_unstale":"2023-12-17T11:48:22.528476+0000","last_undegraded":"2023-12-17T11:48:22.528476+0000","last_fullsized":"2023-12-17T11:48:22.528476+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_clean_scrub_stamp":"2023-12-17T11:48:17.199970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T19:01:46.435511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-17T11:48:22.538318+0000","last_change":"2023-12-17T11:48:17.254579+0000","last_active":"2023-12-17T11:48:22.538318+0000","last_peered":"2023-12-17T11:48:22.538318+0000","last_clean":"2023-12-17T11:48:22.538318+0000","last_became_active":"2023-12-17T11:48:17.254302+0000","last_became_peered":"2023-12-17T11:48:17.254302+0000","last_unstale":"2023-12-17T11:48:22.538318+0000","last_undegraded":"2023-12-17T11:48:22.538318+0000","last_fullsized":"2023-12-17T11:48:22.538318+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:16.193911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:16.193911+0000","last_clean_scrub_stamp":"2023-12-17T11:48:16.193911+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T22:46:18.442258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-17T11:48:23.469632+0000","last_change":"2023-12-17T11:48:22.541168+0000","last_active":"2023-12-17T11:48:23.469632+0000","last_peered":"2023-12-17T11:48:23.469632+0000","last_clean":"2023-12-17T11:48:23.469632+0000","last_became_active":"2023-12-17T11:48:22.539739+0000","last_became_peered":"2023-12-17T11:48:22.539739+0000","last_unstale":"2023-12-17T11:48:23.469632+0000","last_undegraded":"2023-12-17T11:48:23.469632+0000","last_fullsized":"2023-12-17T11:48:23.469632+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:21.473989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:21.473989+0000","last_clean_scrub_stamp":"2023-12-17T11:48:21.473989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T13:18:42.303550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-17T11:48:22.498917+0000","last_change":"2023-12-17T11:48:18.271462+0000","last_active":"2023-12-17T11:48:22.498917+0000","last_peered":"2023-12-17T11:48:22.498917+0000","last_clean":"2023-12-17T11:48:22.498917+0000","last_became_active":"2023-12-17T11:48:18.270639+0000","last_became_peered":"2023-12-17T11:48:18.270639+0000","last_unstale":"2023-12-17T11:48:22.498917+0000","last_undegraded":"2023-12-17T11:48:22.498917+0000","last_fullsized":"2023-12-17T11:48:22.498917+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_clean_scrub_stamp":"2023-12-17T11:48:17.199970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T16:14:48.723317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-17T11:48:22.528530+0000","last_change":"2023-12-17T11:48:17.243128+0000","last_active":"2023-12-17T11:48:22.528530+0000","last_peered":"2023-12-17T11:48:22.528530+0000","last_clean":"2023-12-17T11:48:22.528530+0000","last_became_active":"2023-12-17T11:48:17.242656+0000","last_became_peered":"2023-12-17T11:48:17.242656+0000","last_unstale":"2023-12-17T11:48:22.528530+0000","last_undegraded":"2023-12-17T11:48:22.528530+0000","last_fullsized":"2023-12-17T11:48:22.528530+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:16.193911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:16.193911+0000","last_clean_scrub_stamp":"2023-12-17T11:48:16.193911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T21:33:08.409177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-17T11:48:23.468866+0000","last_change":"2023-12-17T11:48:22.539973+0000","last_active":"2023-12-17T11:48:23.468866+0000","last_peered":"2023-12-17T11:48:23.468866+0000","last_clean":"2023-12-17T11:48:23.468866+0000","last_became_active":"2023-12-17T11:48:22.539592+0000","last_became_peered":"2023-12-17T11:48:22.539592+0000","last_unstale":"2023-12-17T11:48:23.468866+0000","last_undegraded":"2023-12-17T11:48:23.468866+0000","last_fullsized":"2023-12-17T11:48:23.468866+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:21.473989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:21.473989+0000","last_clean_scrub_stamp":"2023-12-17T11:48:21.473989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T19:19:54.372270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-17T11:48:22.498149+0000","last_change":"2023-12-17T11:48:18.272948+0000","last_active":"2023-12-17T11:48:22.498149+0000","last_peered":"2023-12-17T11:48:22.498149+0000","last_clean":"2023-12-17T11:48:22.498149+0000","last_became_active":"2023-12-17T11:48:18.272251+0000","last_became_peered":"2023-12-17T11:48:18.272251+0000","last_unstale":"2023-12-17T11:48:22.498149+0000","last_undegraded":"2023-12-17T11:48:22.498149+0000","last_fullsized":"2023-12-17T11:48:22.498149+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_clean_scrub_stamp":"2023-12-17T11:48:17.199970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T23:46:39.140775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-17T11:48:22.529348+0000","last_change":"2023-12-17T11:48:17.249233+0000","last_active":"2023-12-17T11:48:22.529348+0000","last_peered":"2023-12-17T11:48:22.529348+0000","last_clean":"2023-12-17T11:48:22.529348+0000","last_became_active":"2023-12-17T11:48:17.248693+0000","last_became_peered":"2023-12-17T11:48:17.248693+0000","last_unstale":"2023-12-17T11:48:22.529348+0000","last_undegraded":"2023-12-17T11:48:22.529348+0000","last_fullsized":"2023-12-17T11:48:22.529348+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:16.193911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:16.193911+0000","last_clean_scrub_stamp":"2023-12-17T11:48:16.193911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T15:52:21.914780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-17T11:48:24.569901+0000","last_change":"2023-12-17T11:48:22.546268+0000","last_active":"2023-12-17T11:48:24.569901+0000","last_peered":"2023-12-17T11:48:24.569901+0000","last_clean":"2023-12-17T11:48:24.569901+0000","last_became_active":"2023-12-17T11:48:22.545873+0000","last_became_peered":"2023-12-17T11:48:22.545873+0000","last_unstale":"2023-12-17T11:48:24.569901+0000","last_undegraded":"2023-12-17T11:48:24.569901+0000","last_fullsized":"2023-12-17T11:48:24.569901+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:21.473989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:21.473989+0000","last_clean_scrub_stamp":"2023-12-17T11:48:21.473989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T21:28:14.069617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-17T11:48:22.514153+0000","last_change":"2023-12-17T11:48:18.258783+0000","last_active":"2023-12-17T11:48:22.514153+0000","last_peered":"2023-12-17T11:48:22.514153+0000","last_clean":"2023-12-17T11:48:22.514153+0000","last_became_active":"2023-12-17T11:48:18.258068+0000","last_became_peered":"2023-12-17T11:48:18.258068+0000","last_unstale":"2023-12-17T11:48:22.514153+0000","last_undegraded":"2023-12-17T11:48:22.514153+0000","last_fullsized":"2023-12-17T11:48:22.514153+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_clean_scrub_stamp":"2023-12-17T11:48:17.199970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T15:07:39.743439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-17T11:48:22.537435+0000","last_change":"2023-12-17T11:48:17.253559+0000","last_active":"2023-12-17T11:48:22.537435+0000","last_peered":"2023-12-17T11:48:22.537435+0000","last_clean":"2023-12-17T11:48:22.537435+0000","last_became_active":"2023-12-17T11:48:17.253271+0000","last_became_peered":"2023-12-17T11:48:17.253271+0000","last_unstale":"2023-12-17T11:48:22.537435+0000","last_undegraded":"2023-12-17T11:48:22.537435+0000","last_fullsized":"2023-12-17T11:48:22.537435+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:16.193911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:16.193911+0000","last_clean_scrub_stamp":"2023-12-17T11:48:16.193911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T22:20:08.219855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-17T11:48:23.470614+0000","last_change":"2023-12-17T11:48:22.541511+0000","last_active":"2023-12-17T11:48:23.470614+0000","last_peered":"2023-12-17T11:48:23.470614+0000","last_clean":"2023-12-17T11:48:23.470614+0000","last_became_active":"2023-12-17T11:48:22.540975+0000","last_became_peered":"2023-12-17T11:48:22.540975+0000","last_unstale":"2023-12-17T11:48:23.470614+0000","last_undegraded":"2023-12-17T11:48:23.470614+0000","last_fullsized":"2023-12-17T11:48:23.470614+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:21.473989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:21.473989+0000","last_clean_scrub_stamp":"2023-12-17T11:48:21.473989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T14:46:35.413635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-17T11:48:22.517573+0000","last_change":"2023-12-17T11:48:18.270278+0000","last_active":"2023-12-17T11:48:22.517573+0000","last_peered":"2023-12-17T11:48:22.517573+0000","last_clean":"2023-12-17T11:48:22.517573+0000","last_became_active":"2023-12-17T11:48:18.269966+0000","last_became_peered":"2023-12-17T11:48:18.269966+0000","last_unstale":"2023-12-17T11:48:22.517573+0000","last_undegraded":"2023-12-17T11:48:22.517573+0000","last_fullsized":"2023-12-17T11:48:22.517573+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_clean_scrub_stamp":"2023-12-17T11:48:17.199970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T19:40:13.516541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-17T11:48:22.530568+0000","last_change":"2023-12-17T11:48:17.249856+0000","last_active":"2023-12-17T11:48:22.530568+0000","last_peered":"2023-12-17T11:48:22.530568+0000","last_clean":"2023-12-17T11:48:22.530568+0000","last_became_active":"2023-12-17T11:48:17.249564+0000","last_became_peered":"2023-12-17T11:48:17.249564+0000","last_unstale":"2023-12-17T11:48:22.530568+0000","last_undegraded":"2023-12-17T11:48:22.530568+0000","last_fullsized":"2023-12-17T11:48:22.530568+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:16.193911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:16.193911+0000","last_clean_scrub_stamp":"2023-12-17T11:48:16.193911+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T15:07:38.737379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-17T11:48:23.467555+0000","last_change":"2023-12-17T11:48:22.541474+0000","last_active":"2023-12-17T11:48:23.467555+0000","last_peered":"2023-12-17T11:48:23.467555+0000","last_clean":"2023-12-17T11:48:23.467555+0000","last_became_active":"2023-12-17T11:48:22.541092+0000","last_became_peered":"2023-12-17T11:48:22.541092+0000","last_unstale":"2023-12-17T11:48:23.467555+0000","last_undegraded":"2023-12-17T11:48:23.467555+0000","last_fullsized":"2023-12-17T11:48:23.467555+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:21.473989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:21.473989+0000","last_clean_scrub_stamp":"2023-12-17T11:48:21.473989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T20:54:02.500358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-17T11:48:22.502585+0000","last_change":"2023-12-17T11:48:18.270544+0000","last_active":"2023-12-17T11:48:22.502585+0000","last_peered":"2023-12-17T11:48:22.502585+0000","last_clean":"2023-12-17T11:48:22.502585+0000","last_became_active":"2023-12-17T11:48:18.270216+0000","last_became_peered":"2023-12-17T11:48:18.270216+0000","last_unstale":"2023-12-17T11:48:22.502585+0000","last_undegraded":"2023-12-17T11:48:22.502585+0000","last_fullsized":"2023-12-17T11:48:22.502585+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_clean_scrub_stamp":"2023-12-17T11:48:17.199970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T14:39:11.433170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"24'1","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-17T11:48:23.109451+0000","last_change":"2023-12-17T11:48:17.239499+0000","last_active":"2023-12-17T11:48:23.109451+0000","last_peered":"2023-12-17T11:48:23.109451+0000","last_clean":"2023-12-17T11:48:23.109451+0000","last_became_active":"2023-12-17T11:48:17.239256+0000","last_became_peered":"2023-12-17T11:48:17.239256+0000","last_unstale":"2023-12-17T11:48:23.109451+0000","last_undegraded":"2023-12-17T11:48:23.109451+0000","last_fullsized":"2023-12-17T11:48:23.109451+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:16.193911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:16.193911+0000","last_clean_scrub_stamp":"2023-12-17T11:48:16.193911+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T19:10:09.191716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-17T11:48:24.562916+0000","last_change":"2023-12-17T11:48:22.538930+0000","last_active":"2023-12-17T11:48:24.562916+0000","last_peered":"2023-12-17T11:48:24.562916+0000","last_clean":"2023-12-17T11:48:24.562916+0000","last_became_active":"2023-12-17T11:48:22.538189+0000","last_became_peered":"2023-12-17T11:48:22.538189+0000","last_unstale":"2023-12-17T11:48:24.562916+0000","last_undegraded":"2023-12-17T11:48:24.562916+0000","last_fullsized":"2023-12-17T11:48:24.562916+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:21.473989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:21.473989+0000","last_clean_scrub_stamp":"2023-12-17T11:48:21.473989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T15:43:12.098532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-17T11:48:22.529901+0000","last_change":"2023-12-17T11:48:18.266039+0000","last_active":"2023-12-17T11:48:22.529901+0000","last_peered":"2023-12-17T11:48:22.529901+0000","last_clean":"2023-12-17T11:48:22.529901+0000","last_became_active":"2023-12-17T11:48:18.264294+0000","last_became_peered":"2023-12-17T11:48:18.264294+0000","last_unstale":"2023-12-17T11:48:22.529901+0000","last_undegraded":"2023-12-17T11:48:22.529901+0000","last_fullsized":"2023-12-17T11:48:22.529901+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_clean_scrub_stamp":"2023-12-17T11:48:17.199970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T23:46:39.140775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-17T11:48:22.538134+0000","last_change":"2023-12-17T11:48:17.255352+0000","last_active":"2023-12-17T11:48:22.538134+0000","last_peered":"2023-12-17T11:48:22.538134+0000","last_clean":"2023-12-17T11:48:22.538134+0000","last_became_active":"2023-12-17T11:48:17.254987+0000","last_became_peered":"2023-12-17T11:48:17.254987+0000","last_unstale":"2023-12-17T11:48:22.538134+0000","last_undegraded":"2023-12-17T11:48:22.538134+0000","last_fullsized":"2023-12-17T11:48:22.538134+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:16.193911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:16.193911+0000","last_clean_scrub_stamp":"2023-12-17T11:48:16.193911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T13:39:47.600568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-17T11:48:24.565796+0000","last_change":"2023-12-17T11:48:22.541369+0000","last_active":"2023-12-17T11:48:24.565796+0000","last_peered":"2023-12-17T11:48:24.565796+0000","last_clean":"2023-12-17T11:48:24.565796+0000","last_became_active":"2023-12-17T11:48:22.540908+0000","last_became_peered":"2023-12-17T11:48:22.540908+0000","last_unstale":"2023-12-17T11:48:24.565796+0000","last_undegraded":"2023-12-17T11:48:24.565796+0000","last_fullsized":"2023-12-17T11:48:24.565796+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:21.473989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:21.473989+0000","last_clean_scrub_stamp":"2023-12-17T11:48:21.473989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T19:44:20.727021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-17T11:48:22.523020+0000","last_change":"2023-12-17T11:48:18.281474+0000","last_active":"2023-12-17T11:48:22.523020+0000","last_peered":"2023-12-17T11:48:22.523020+0000","last_clean":"2023-12-17T11:48:22.523020+0000","last_became_active":"2023-12-17T11:48:18.281189+0000","last_became_peered":"2023-12-17T11:48:18.281189+0000","last_unstale":"2023-12-17T11:48:22.523020+0000","last_undegraded":"2023-12-17T11:48:22.523020+0000","last_fullsized":"2023-12-17T11:48:22.523020+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_clean_scrub_stamp":"2023-12-17T11:48:17.199970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T19:37:12.473709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-17T11:48:22.530125+0000","last_change":"2023-12-17T11:48:17.240666+0000","last_active":"2023-12-17T11:48:22.530125+0000","last_peered":"2023-12-17T11:48:22.530125+0000","last_clean":"2023-12-17T11:48:22.530125+0000","last_became_active":"2023-12-17T11:48:17.239901+0000","last_became_peered":"2023-12-17T11:48:17.239901+0000","last_unstale":"2023-12-17T11:48:22.530125+0000","last_undegraded":"2023-12-17T11:48:22.530125+0000","last_fullsized":"2023-12-17T11:48:22.530125+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:16.193911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:16.193911+0000","last_clean_scrub_stamp":"2023-12-17T11:48:16.193911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T23:35:00.926850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-17T11:48:24.568012+0000","last_change":"2023-12-17T11:48:22.534424+0000","last_active":"2023-12-17T11:48:24.568012+0000","last_peered":"2023-12-17T11:48:24.568012+0000","last_clean":"2023-12-17T11:48:24.568012+0000","last_became_active":"2023-12-17T11:48:22.533095+0000","last_became_peered":"2023-12-17T11:48:22.533095+0000","last_unstale":"2023-12-17T11:48:24.568012+0000","last_undegraded":"2023-12-17T11:48:24.568012+0000","last_fullsized":"2023-12-17T11:48:24.568012+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:21.473989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:21.473989+0000","last_clean_scrub_stamp":"2023-12-17T11:48:21.473989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T19:19:54.372270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-17T11:48:22.513971+0000","last_change":"2023-12-17T11:48:18.271892+0000","last_active":"2023-12-17T11:48:22.513971+0000","last_peered":"2023-12-17T11:48:22.513971+0000","last_clean":"2023-12-17T11:48:22.513971+0000","last_became_active":"2023-12-17T11:48:18.269149+0000","last_became_peered":"2023-12-17T11:48:18.269149+0000","last_unstale":"2023-12-17T11:48:22.513971+0000","last_undegraded":"2023-12-17T11:48:22.513971+0000","last_fullsized":"2023-12-17T11:48:22.513971+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_clean_scrub_stamp":"2023-12-17T11:48:17.199970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T23:05:27.950618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-17T11:48:22.519931+0000","last_change":"2023-12-17T11:48:17.256166+0000","last_active":"2023-12-17T11:48:22.519931+0000","last_peered":"2023-12-17T11:48:22.519931+0000","last_clean":"2023-12-17T11:48:22.519931+0000","last_became_active":"2023-12-17T11:48:17.255858+0000","last_became_peered":"2023-12-17T11:48:17.255858+0000","last_unstale":"2023-12-17T11:48:22.519931+0000","last_undegraded":"2023-12-17T11:48:22.519931+0000","last_fullsized":"2023-12-17T11:48:22.519931+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:16.193911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:16.193911+0000","last_clean_scrub_stamp":"2023-12-17T11:48:16.193911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T19:40:12.510482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-17T11:48:24.569042+0000","last_change":"2023-12-17T11:48:22.537931+0000","last_active":"2023-12-17T11:48:24.569042+0000","last_peered":"2023-12-17T11:48:24.569042+0000","last_clean":"2023-12-17T11:48:24.569042+0000","last_became_active":"2023-12-17T11:48:22.537530+0000","last_became_peered":"2023-12-17T11:48:22.537530+0000","last_unstale":"2023-12-17T11:48:24.569042+0000","last_undegraded":"2023-12-17T11:48:24.569042+0000","last_fullsized":"2023-12-17T11:48:24.569042+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:21.473989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:21.473989+0000","last_clean_scrub_stamp":"2023-12-17T11:48:21.473989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T14:46:35.413635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-17T11:48:22.524745+0000","last_change":"2023-12-17T11:48:18.264485+0000","last_active":"2023-12-17T11:48:22.524745+0000","last_peered":"2023-12-17T11:48:22.524745+0000","last_clean":"2023-12-17T11:48:22.524745+0000","last_became_active":"2023-12-17T11:48:18.264150+0000","last_became_peered":"2023-12-17T11:48:18.264150+0000","last_unstale":"2023-12-17T11:48:22.524745+0000","last_undegraded":"2023-12-17T11:48:22.524745+0000","last_fullsized":"2023-12-17T11:48:22.524745+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_clean_scrub_stamp":"2023-12-17T11:48:17.199970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T12:59:53.414167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-17T11:48:22.505049+0000","last_change":"2023-12-17T11:48:17.234956+0000","last_active":"2023-12-17T11:48:22.505049+0000","last_peered":"2023-12-17T11:48:22.505049+0000","last_clean":"2023-12-17T11:48:22.505049+0000","last_became_active":"2023-12-17T11:48:17.234640+0000","last_became_peered":"2023-12-17T11:48:17.234640+0000","last_unstale":"2023-12-17T11:48:22.505049+0000","last_undegraded":"2023-12-17T11:48:22.505049+0000","last_fullsized":"2023-12-17T11:48:22.505049+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:16.193911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:16.193911+0000","last_clean_scrub_stamp":"2023-12-17T11:48:16.193911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T19:54:11.544716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-17T11:48:24.570107+0000","last_change":"2023-12-17T11:48:22.535731+0000","last_active":"2023-12-17T11:48:24.570107+0000","last_peered":"2023-12-17T11:48:24.570107+0000","last_clean":"2023-12-17T11:48:24.570107+0000","last_became_active":"2023-12-17T11:48:22.529961+0000","last_became_peered":"2023-12-17T11:48:22.529961+0000","last_unstale":"2023-12-17T11:48:24.570107+0000","last_undegraded":"2023-12-17T11:48:24.570107+0000","last_fullsized":"2023-12-17T11:48:24.570107+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:21.473989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:21.473989+0000","last_clean_scrub_stamp":"2023-12-17T11:48:21.473989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T19:37:16.747727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-17T11:48:22.518013+0000","last_change":"2023-12-17T11:48:18.266746+0000","last_active":"2023-12-17T11:48:22.518013+0000","last_peered":"2023-12-17T11:48:22.518013+0000","last_clean":"2023-12-17T11:48:22.518013+0000","last_became_active":"2023-12-17T11:48:18.266331+0000","last_became_peered":"2023-12-17T11:48:18.266331+0000","last_unstale":"2023-12-17T11:48:22.518013+0000","last_undegraded":"2023-12-17T11:48:22.518013+0000","last_fullsized":"2023-12-17T11:48:22.518013+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_clean_scrub_stamp":"2023-12-17T11:48:17.199970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T19:10:10.197776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-17T11:48:22.537457+0000","last_change":"2023-12-17T11:48:17.253489+0000","last_active":"2023-12-17T11:48:22.537457+0000","last_peered":"2023-12-17T11:48:22.537457+0000","last_clean":"2023-12-17T11:48:22.537457+0000","last_became_active":"2023-12-17T11:48:17.253243+0000","last_became_peered":"2023-12-17T11:48:17.253243+0000","last_unstale":"2023-12-17T11:48:22.537457+0000","last_undegraded":"2023-12-17T11:48:22.537457+0000","last_fullsized":"2023-12-17T11:48:22.537457+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:16.193911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:16.193911+0000","last_clean_scrub_stamp":"2023-12-17T11:48:16.193911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T22:05:53.158992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-17T11:48:24.564814+0000","last_change":"2023-12-17T11:48:22.543885+0000","last_active":"2023-12-17T11:48:24.564814+0000","last_peered":"2023-12-17T11:48:24.564814+0000","last_clean":"2023-12-17T11:48:24.564814+0000","last_became_active":"2023-12-17T11:48:22.543458+0000","last_became_peered":"2023-12-17T11:48:22.543458+0000","last_unstale":"2023-12-17T11:48:24.564814+0000","last_undegraded":"2023-12-17T11:48:24.564814+0000","last_fullsized":"2023-12-17T11:48:24.564814+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:21.473989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:21.473989+0000","last_clean_scrub_stamp":"2023-12-17T11:48:21.473989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T21:28:14.069617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-17T11:48:22.497613+0000","last_change":"2023-12-17T11:48:18.286605+0000","last_active":"2023-12-17T11:48:22.497613+0000","last_peered":"2023-12-17T11:48:22.497613+0000","last_clean":"2023-12-17T11:48:22.497613+0000","last_became_active":"2023-12-17T11:48:18.286391+0000","last_became_peered":"2023-12-17T11:48:18.286391+0000","last_unstale":"2023-12-17T11:48:22.497613+0000","last_undegraded":"2023-12-17T11:48:22.497613+0000","last_fullsized":"2023-12-17T11:48:22.497613+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_clean_scrub_stamp":"2023-12-17T11:48:17.199970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T19:40:13.516541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-17T11:48:22.522726+0000","last_change":"2023-12-17T11:48:17.250745+0000","last_active":"2023-12-17T11:48:22.522726+0000","last_peered":"2023-12-17T11:48:22.522726+0000","last_clean":"2023-12-17T11:48:22.522726+0000","last_became_active":"2023-12-17T11:48:17.250462+0000","last_became_peered":"2023-12-17T11:48:17.250462+0000","last_unstale":"2023-12-17T11:48:22.522726+0000","last_undegraded":"2023-12-17T11:48:22.522726+0000","last_fullsized":"2023-12-17T11:48:22.522726+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:16.193911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:16.193911+0000","last_clean_scrub_stamp":"2023-12-17T11:48:16.193911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T19:10:09.191716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":169,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-17T11:48:22.537554+0000","last_change":"2023-12-17T11:48:07.952584+0000","last_active":"2023-12-17T11:48:22.537554+0000","last_peered":"2023-12-17T11:48:22.537554+0000","last_clean":"2023-12-17T11:48:22.537554+0000","last_became_active":"2023-12-17T11:48:07.950361+0000","last_became_peered":"2023-12-17T11:48:07.950361+0000","last_unstale":"2023-12-17T11:48:22.537554+0000","last_undegraded":"2023-12-17T11:48:22.537554+0000","last_fullsized":"2023-12-17T11:48:22.537554+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:06.728199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:06.728199+0000","last_clean_scrub_stamp":"2023-12-17T11:48:06.728199+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T12:47:55.048065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-17T11:48:23.469722+0000","last_change":"2023-12-17T11:48:22.546171+0000","last_active":"2023-12-17T11:48:23.469722+0000","last_peered":"2023-12-17T11:48:23.469722+0000","last_clean":"2023-12-17T11:48:23.469722+0000","last_became_active":"2023-12-17T11:48:22.545741+0000","last_became_peered":"2023-12-17T11:48:22.545741+0000","last_unstale":"2023-12-17T11:48:23.469722+0000","last_undegraded":"2023-12-17T11:48:23.469722+0000","last_fullsized":"2023-12-17T11:48:23.469722+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:21.473989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:21.473989+0000","last_clean_scrub_stamp":"2023-12-17T11:48:21.473989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T14:13:28.976491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-17T11:48:22.537982+0000","last_change":"2023-12-17T11:48:18.295996+0000","last_active":"2023-12-17T11:48:22.537982+0000","last_peered":"2023-12-17T11:48:22.537982+0000","last_clean":"2023-12-17T11:48:22.537982+0000","last_became_active":"2023-12-17T11:48:18.295731+0000","last_became_peered":"2023-12-17T11:48:18.295731+0000","last_unstale":"2023-12-17T11:48:22.537982+0000","last_undegraded":"2023-12-17T11:48:22.537982+0000","last_fullsized":"2023-12-17T11:48:22.537982+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_clean_scrub_stamp":"2023-12-17T11:48:17.199970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T12:06:33.791186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-17T11:48:22.508663+0000","last_change":"2023-12-17T11:48:17.248889+0000","last_active":"2023-12-17T11:48:22.508663+0000","last_peered":"2023-12-17T11:48:22.508663+0000","last_clean":"2023-12-17T11:48:22.508663+0000","last_became_active":"2023-12-17T11:48:17.248340+0000","last_became_peered":"2023-12-17T11:48:17.248340+0000","last_unstale":"2023-12-17T11:48:22.508663+0000","last_undegraded":"2023-12-17T11:48:22.508663+0000","last_fullsized":"2023-12-17T11:48:22.508663+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:16.193911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:16.193911+0000","last_clean_scrub_stamp":"2023-12-17T11:48:16.193911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T15:52:21.914780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-17T11:48:23.468537+0000","last_change":"2023-12-17T11:48:22.550329+0000","last_active":"2023-12-17T11:48:23.468537+0000","last_peered":"2023-12-17T11:48:23.468537+0000","last_clean":"2023-12-17T11:48:23.468537+0000","last_became_active":"2023-12-17T11:48:22.549902+0000","last_became_peered":"2023-12-17T11:48:22.549902+0000","last_unstale":"2023-12-17T11:48:23.468537+0000","last_undegraded":"2023-12-17T11:48:23.468537+0000","last_fullsized":"2023-12-17T11:48:23.468537+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:21.473989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:21.473989+0000","last_clean_scrub_stamp":"2023-12-17T11:48:21.473989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T14:35:42.104042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-17T11:48:22.521889+0000","last_change":"2023-12-17T11:48:18.280528+0000","last_active":"2023-12-17T11:48:22.521889+0000","last_peered":"2023-12-17T11:48:22.521889+0000","last_clean":"2023-12-17T11:48:22.521889+0000","last_became_active":"2023-12-17T11:48:18.279633+0000","last_became_peered":"2023-12-17T11:48:18.279633+0000","last_unstale":"2023-12-17T11:48:22.521889+0000","last_undegraded":"2023-12-17T11:48:22.521889+0000","last_fullsized":"2023-12-17T11:48:22.521889+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_clean_scrub_stamp":"2023-12-17T11:48:17.199970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T21:28:09.795599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-17T11:48:22.532812+0000","last_change":"2023-12-17T11:48:17.247687+0000","last_active":"2023-12-17T11:48:22.532812+0000","last_peered":"2023-12-17T11:48:22.532812+0000","last_clean":"2023-12-17T11:48:22.532812+0000","last_became_active":"2023-12-17T11:48:17.247332+0000","last_became_peered":"2023-12-17T11:48:17.247332+0000","last_unstale":"2023-12-17T11:48:22.532812+0000","last_undegraded":"2023-12-17T11:48:22.532812+0000","last_fullsized":"2023-12-17T11:48:22.532812+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:16.193911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:16.193911+0000","last_clean_scrub_stamp":"2023-12-17T11:48:16.193911+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T14:38:16.218634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-17T11:48:24.566096+0000","last_change":"2023-12-17T11:48:22.529299+0000","last_active":"2023-12-17T11:48:24.566096+0000","last_peered":"2023-12-17T11:48:24.566096+0000","last_clean":"2023-12-17T11:48:24.566096+0000","last_became_active":"2023-12-17T11:48:22.528363+0000","last_became_peered":"2023-12-17T11:48:22.528363+0000","last_unstale":"2023-12-17T11:48:24.566096+0000","last_undegraded":"2023-12-17T11:48:24.566096+0000","last_fullsized":"2023-12-17T11:48:24.566096+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:21.473989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:21.473989+0000","last_clean_scrub_stamp":"2023-12-17T11:48:21.473989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T19:47:39.333206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-17T11:48:22.541528+0000","last_change":"2023-12-17T11:48:18.282746+0000","last_active":"2023-12-17T11:48:22.541528+0000","last_peered":"2023-12-17T11:48:22.541528+0000","last_clean":"2023-12-17T11:48:22.541528+0000","last_became_active":"2023-12-17T11:48:18.282435+0000","last_became_peered":"2023-12-17T11:48:18.282435+0000","last_unstale":"2023-12-17T11:48:22.541528+0000","last_undegraded":"2023-12-17T11:48:22.541528+0000","last_fullsized":"2023-12-17T11:48:22.541528+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_clean_scrub_stamp":"2023-12-17T11:48:17.199970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T17:07:27.804112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-17T11:48:22.504269+0000","last_change":"2023-12-17T11:48:17.236101+0000","last_active":"2023-12-17T11:48:22.504269+0000","last_peered":"2023-12-17T11:48:22.504269+0000","last_clean":"2023-12-17T11:48:22.504269+0000","last_became_active":"2023-12-17T11:48:17.235810+0000","last_became_peered":"2023-12-17T11:48:17.235810+0000","last_unstale":"2023-12-17T11:48:22.504269+0000","last_undegraded":"2023-12-17T11:48:22.504269+0000","last_fullsized":"2023-12-17T11:48:22.504269+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:16.193911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:16.193911+0000","last_clean_scrub_stamp":"2023-12-17T11:48:16.193911+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T17:25:44.412598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-17T11:48:24.533865+0000","last_change":"2023-12-17T11:48:22.543015+0000","last_active":"2023-12-17T11:48:24.533865+0000","last_peered":"2023-12-17T11:48:24.533865+0000","last_clean":"2023-12-17T11:48:24.533865+0000","last_became_active":"2023-12-17T11:48:22.542625+0000","last_became_peered":"2023-12-17T11:48:22.542625+0000","last_unstale":"2023-12-17T11:48:24.533865+0000","last_undegraded":"2023-12-17T11:48:24.533865+0000","last_fullsized":"2023-12-17T11:48:24.533865+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:21.473989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:21.473989+0000","last_clean_scrub_stamp":"2023-12-17T11:48:21.473989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T19:02:34.642001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-17T11:48:22.538912+0000","last_change":"2023-12-17T11:48:18.286716+0000","last_active":"2023-12-17T11:48:22.538912+0000","last_peered":"2023-12-17T11:48:22.538912+0000","last_clean":"2023-12-17T11:48:22.538912+0000","last_became_active":"2023-12-17T11:48:18.286399+0000","last_became_peered":"2023-12-17T11:48:18.286399+0000","last_unstale":"2023-12-17T11:48:22.538912+0000","last_undegraded":"2023-12-17T11:48:22.538912+0000","last_fullsized":"2023-12-17T11:48:22.538912+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_clean_scrub_stamp":"2023-12-17T11:48:17.199970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T15:49:17.071958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-17T11:48:22.518272+0000","last_change":"2023-12-17T11:48:17.241745+0000","last_active":"2023-12-17T11:48:22.518272+0000","last_peered":"2023-12-17T11:48:22.518272+0000","last_clean":"2023-12-17T11:48:22.518272+0000","last_became_active":"2023-12-17T11:48:17.241424+0000","last_became_peered":"2023-12-17T11:48:17.241424+0000","last_unstale":"2023-12-17T11:48:22.518272+0000","last_undegraded":"2023-12-17T11:48:22.518272+0000","last_fullsized":"2023-12-17T11:48:22.518272+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:16.193911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:16.193911+0000","last_clean_scrub_stamp":"2023-12-17T11:48:16.193911+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T22:07:41.457520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-17T11:48:23.467268+0000","last_change":"2023-12-17T11:48:22.532344+0000","last_active":"2023-12-17T11:48:23.467268+0000","last_peered":"2023-12-17T11:48:23.467268+0000","last_clean":"2023-12-17T11:48:23.467268+0000","last_became_active":"2023-12-17T11:48:22.531938+0000","last_became_peered":"2023-12-17T11:48:22.531938+0000","last_unstale":"2023-12-17T11:48:23.467268+0000","last_undegraded":"2023-12-17T11:48:23.467268+0000","last_fullsized":"2023-12-17T11:48:23.467268+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:21.473989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:21.473989+0000","last_clean_scrub_stamp":"2023-12-17T11:48:21.473989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T16:14:52.997336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-17T11:48:22.537682+0000","last_change":"2023-12-17T11:48:18.283595+0000","last_active":"2023-12-17T11:48:22.537682+0000","last_peered":"2023-12-17T11:48:22.537682+0000","last_clean":"2023-12-17T11:48:22.537682+0000","last_became_active":"2023-12-17T11:48:18.283279+0000","last_became_peered":"2023-12-17T11:48:18.283279+0000","last_unstale":"2023-12-17T11:48:22.537682+0000","last_undegraded":"2023-12-17T11:48:22.537682+0000","last_fullsized":"2023-12-17T11:48:22.537682+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_clean_scrub_stamp":"2023-12-17T11:48:17.199970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T15:36:16.504476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-17T11:48:22.505421+0000","last_change":"2023-12-17T11:48:17.240169+0000","last_active":"2023-12-17T11:48:22.505421+0000","last_peered":"2023-12-17T11:48:22.505421+0000","last_clean":"2023-12-17T11:48:22.505421+0000","last_became_active":"2023-12-17T11:48:17.239871+0000","last_became_peered":"2023-12-17T11:48:17.239871+0000","last_unstale":"2023-12-17T11:48:22.505421+0000","last_undegraded":"2023-12-17T11:48:22.505421+0000","last_fullsized":"2023-12-17T11:48:22.505421+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:16.193911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:16.193911+0000","last_clean_scrub_stamp":"2023-12-17T11:48:16.193911+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T22:07:41.457520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-17T11:48:24.564852+0000","last_change":"2023-12-17T11:48:22.525953+0000","last_active":"2023-12-17T11:48:24.564852+0000","last_peered":"2023-12-17T11:48:24.564852+0000","last_clean":"2023-12-17T11:48:24.564852+0000","last_became_active":"2023-12-17T11:48:22.525562+0000","last_became_peered":"2023-12-17T11:48:22.525562+0000","last_unstale":"2023-12-17T11:48:24.564852+0000","last_undegraded":"2023-12-17T11:48:24.564852+0000","last_fullsized":"2023-12-17T11:48:24.564852+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:21.473989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:21.473989+0000","last_clean_scrub_stamp":"2023-12-17T11:48:21.473989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T19:37:16.747727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-17T11:48:22.528552+0000","last_change":"2023-12-17T11:48:18.266704+0000","last_active":"2023-12-17T11:48:22.528552+0000","last_peered":"2023-12-17T11:48:22.528552+0000","last_clean":"2023-12-17T11:48:22.528552+0000","last_became_active":"2023-12-17T11:48:18.266160+0000","last_became_peered":"2023-12-17T11:48:18.266160+0000","last_unstale":"2023-12-17T11:48:22.528552+0000","last_undegraded":"2023-12-17T11:48:22.528552+0000","last_fullsized":"2023-12-17T11:48:22.528552+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_clean_scrub_stamp":"2023-12-17T11:48:17.199970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T12:09:17.721558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-17T11:48:22.529180+0000","last_change":"2023-12-17T11:48:17.246492+0000","last_active":"2023-12-17T11:48:22.529180+0000","last_peered":"2023-12-17T11:48:22.529180+0000","last_clean":"2023-12-17T11:48:22.529180+0000","last_became_active":"2023-12-17T11:48:17.243482+0000","last_became_peered":"2023-12-17T11:48:17.243482+0000","last_unstale":"2023-12-17T11:48:22.529180+0000","last_undegraded":"2023-12-17T11:48:22.529180+0000","last_fullsized":"2023-12-17T11:48:22.529180+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:16.193911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:16.193911+0000","last_clean_scrub_stamp":"2023-12-17T11:48:16.193911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T23:35:00.926850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-17T11:48:24.566395+0000","last_change":"2023-12-17T11:48:22.533474+0000","last_active":"2023-12-17T11:48:24.566395+0000","last_peered":"2023-12-17T11:48:24.566395+0000","last_clean":"2023-12-17T11:48:24.566395+0000","last_became_active":"2023-12-17T11:48:22.533035+0000","last_became_peered":"2023-12-17T11:48:22.533035+0000","last_unstale":"2023-12-17T11:48:24.566395+0000","last_undegraded":"2023-12-17T11:48:24.566395+0000","last_fullsized":"2023-12-17T11:48:24.566395+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:21.473989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:21.473989+0000","last_clean_scrub_stamp":"2023-12-17T11:48:21.473989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T19:55:52.117357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-17T11:48:22.538223+0000","last_change":"2023-12-17T11:48:18.282530+0000","last_active":"2023-12-17T11:48:22.538223+0000","last_peered":"2023-12-17T11:48:22.538223+0000","last_clean":"2023-12-17T11:48:22.538223+0000","last_became_active":"2023-12-17T11:48:18.282201+0000","last_became_peered":"2023-12-17T11:48:18.282201+0000","last_unstale":"2023-12-17T11:48:22.538223+0000","last_undegraded":"2023-12-17T11:48:22.538223+0000","last_fullsized":"2023-12-17T11:48:22.538223+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_clean_scrub_stamp":"2023-12-17T11:48:17.199970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T13:22:09.491732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-17T11:48:22.519788+0000","last_change":"2023-12-17T11:48:17.255597+0000","last_active":"2023-12-17T11:48:22.519788+0000","last_peered":"2023-12-17T11:48:22.519788+0000","last_clean":"2023-12-17T11:48:22.519788+0000","last_became_active":"2023-12-17T11:48:17.255278+0000","last_became_peered":"2023-12-17T11:48:17.255278+0000","last_unstale":"2023-12-17T11:48:22.519788+0000","last_undegraded":"2023-12-17T11:48:22.519788+0000","last_fullsized":"2023-12-17T11:48:22.519788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:16.193911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:16.193911+0000","last_clean_scrub_stamp":"2023-12-17T11:48:16.193911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T19:01:45.429452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-17T11:48:24.565975+0000","last_change":"2023-12-17T11:48:22.547206+0000","last_active":"2023-12-17T11:48:24.565975+0000","last_peered":"2023-12-17T11:48:24.565975+0000","last_clean":"2023-12-17T11:48:24.565975+0000","last_became_active":"2023-12-17T11:48:22.539605+0000","last_became_peered":"2023-12-17T11:48:22.539605+0000","last_unstale":"2023-12-17T11:48:24.565975+0000","last_undegraded":"2023-12-17T11:48:24.565975+0000","last_fullsized":"2023-12-17T11:48:24.565975+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:21.473989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:21.473989+0000","last_clean_scrub_stamp":"2023-12-17T11:48:21.473989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T16:15:07.576617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-17T11:48:22.509553+0000","last_change":"2023-12-17T11:48:18.266780+0000","last_active":"2023-12-17T11:48:22.509553+0000","last_peered":"2023-12-17T11:48:22.509553+0000","last_clean":"2023-12-17T11:48:22.509553+0000","last_became_active":"2023-12-17T11:48:18.266437+0000","last_became_peered":"2023-12-17T11:48:18.266437+0000","last_unstale":"2023-12-17T11:48:22.509553+0000","last_undegraded":"2023-12-17T11:48:22.509553+0000","last_fullsized":"2023-12-17T11:48:22.509553+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_clean_scrub_stamp":"2023-12-17T11:48:17.199970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T15:10:04.983689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-17T11:48:22.517086+0000","last_change":"2023-12-17T11:48:17.237336+0000","last_active":"2023-12-17T11:48:22.517086+0000","last_peered":"2023-12-17T11:48:22.517086+0000","last_clean":"2023-12-17T11:48:22.517086+0000","last_became_active":"2023-12-17T11:48:17.237079+0000","last_became_peered":"2023-12-17T11:48:17.237079+0000","last_unstale":"2023-12-17T11:48:22.517086+0000","last_undegraded":"2023-12-17T11:48:22.517086+0000","last_fullsized":"2023-12-17T11:48:22.517086+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:16.193911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:16.193911+0000","last_clean_scrub_stamp":"2023-12-17T11:48:16.193911+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T23:05:26.944558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-17T11:48:24.534842+0000","last_change":"2023-12-17T11:48:22.531210+0000","last_active":"2023-12-17T11:48:24.534842+0000","last_peered":"2023-12-17T11:48:24.534842+0000","last_clean":"2023-12-17T11:48:24.534842+0000","last_became_active":"2023-12-17T11:48:22.530786+0000","last_became_peered":"2023-12-17T11:48:22.530786+0000","last_unstale":"2023-12-17T11:48:24.534842+0000","last_undegraded":"2023-12-17T11:48:24.534842+0000","last_fullsized":"2023-12-17T11:48:24.534842+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:21.473989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:21.473989+0000","last_clean_scrub_stamp":"2023-12-17T11:48:21.473989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T23:05:37.198518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-17T11:48:22.537940+0000","last_change":"2023-12-17T11:48:18.271847+0000","last_active":"2023-12-17T11:48:22.537940+0000","last_peered":"2023-12-17T11:48:22.537940+0000","last_clean":"2023-12-17T11:48:22.537940+0000","last_became_active":"2023-12-17T11:48:18.271609+0000","last_became_peered":"2023-12-17T11:48:18.271609+0000","last_unstale":"2023-12-17T11:48:22.537940+0000","last_undegraded":"2023-12-17T11:48:22.537940+0000","last_fullsized":"2023-12-17T11:48:22.537940+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_clean_scrub_stamp":"2023-12-17T11:48:17.199970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T14:01:37.582731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"25'8","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-17T11:48:29.854575+0000","last_change":"2023-12-17T11:48:17.241228+0000","last_active":"2023-12-17T11:48:29.854575+0000","last_peered":"2023-12-17T11:48:29.854575+0000","last_clean":"2023-12-17T11:48:29.854575+0000","last_became_active":"2023-12-17T11:48:17.240813+0000","last_became_peered":"2023-12-17T11:48:17.240813+0000","last_unstale":"2023-12-17T11:48:29.854575+0000","last_undegraded":"2023-12-17T11:48:29.854575+0000","last_fullsized":"2023-12-17T11:48:29.854575+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:16.193911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:16.193911+0000","last_clean_scrub_stamp":"2023-12-17T11:48:16.193911+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T21:33:08.409177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3699,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-17T11:48:24.568565+0000","last_change":"2023-12-17T11:48:22.541559+0000","last_active":"2023-12-17T11:48:24.568565+0000","last_peered":"2023-12-17T11:48:24.568565+0000","last_clean":"2023-12-17T11:48:24.568565+0000","last_became_active":"2023-12-17T11:48:22.537020+0000","last_became_peered":"2023-12-17T11:48:22.537020+0000","last_unstale":"2023-12-17T11:48:24.568565+0000","last_undegraded":"2023-12-17T11:48:24.568565+0000","last_fullsized":"2023-12-17T11:48:24.568565+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:21.473989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:21.473989+0000","last_clean_scrub_stamp":"2023-12-17T11:48:21.473989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T13:18:42.303550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-17T11:48:22.519017+0000","last_change":"2023-12-17T11:48:18.275481+0000","last_active":"2023-12-17T11:48:22.519017+0000","last_peered":"2023-12-17T11:48:22.519017+0000","last_clean":"2023-12-17T11:48:22.519017+0000","last_became_active":"2023-12-17T11:48:18.273155+0000","last_became_peered":"2023-12-17T11:48:18.273155+0000","last_unstale":"2023-12-17T11:48:22.519017+0000","last_undegraded":"2023-12-17T11:48:22.519017+0000","last_fullsized":"2023-12-17T11:48:22.519017+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_clean_scrub_stamp":"2023-12-17T11:48:17.199970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T12:41:34.675326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-17T11:48:22.530443+0000","last_change":"2023-12-17T11:48:17.255083+0000","last_active":"2023-12-17T11:48:22.530443+0000","last_peered":"2023-12-17T11:48:22.530443+0000","last_clean":"2023-12-17T11:48:22.530443+0000","last_became_active":"2023-12-17T11:48:17.254631+0000","last_became_peered":"2023-12-17T11:48:17.254631+0000","last_unstale":"2023-12-17T11:48:22.530443+0000","last_undegraded":"2023-12-17T11:48:22.530443+0000","last_fullsized":"2023-12-17T11:48:22.530443+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:16.193911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:16.193911+0000","last_clean_scrub_stamp":"2023-12-17T11:48:16.193911+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T23:05:26.944558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-17T11:48:23.468594+0000","last_change":"2023-12-17T11:48:22.532773+0000","last_active":"2023-12-17T11:48:23.468594+0000","last_peered":"2023-12-17T11:48:23.468594+0000","last_clean":"2023-12-17T11:48:23.468594+0000","last_became_active":"2023-12-17T11:48:22.531998+0000","last_became_peered":"2023-12-17T11:48:22.531998+0000","last_unstale":"2023-12-17T11:48:23.468594+0000","last_undegraded":"2023-12-17T11:48:23.468594+0000","last_fullsized":"2023-12-17T11:48:23.468594+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:21.473989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:21.473989+0000","last_clean_scrub_stamp":"2023-12-17T11:48:21.473989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T14:13:28.976491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-17T11:48:22.517736+0000","last_change":"2023-12-17T11:48:18.283970+0000","last_active":"2023-12-17T11:48:22.517736+0000","last_peered":"2023-12-17T11:48:22.517736+0000","last_clean":"2023-12-17T11:48:22.517736+0000","last_became_active":"2023-12-17T11:48:18.282081+0000","last_became_peered":"2023-12-17T11:48:18.282081+0000","last_unstale":"2023-12-17T11:48:22.517736+0000","last_undegraded":"2023-12-17T11:48:22.517736+0000","last_fullsized":"2023-12-17T11:48:22.517736+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_clean_scrub_stamp":"2023-12-17T11:48:17.199970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T22:33:29.994957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-17T11:48:22.524090+0000","last_change":"2023-12-17T11:48:17.251813+0000","last_active":"2023-12-17T11:48:22.524090+0000","last_peered":"2023-12-17T11:48:22.524090+0000","last_clean":"2023-12-17T11:48:22.524090+0000","last_became_active":"2023-12-17T11:48:17.251383+0000","last_became_peered":"2023-12-17T11:48:17.251383+0000","last_unstale":"2023-12-17T11:48:22.524090+0000","last_undegraded":"2023-12-17T11:48:22.524090+0000","last_fullsized":"2023-12-17T11:48:22.524090+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:16.193911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:16.193911+0000","last_clean_scrub_stamp":"2023-12-17T11:48:16.193911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T20:47:09.518146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-17T11:48:24.563175+0000","last_change":"2023-12-17T11:48:22.532023+0000","last_active":"2023-12-17T11:48:24.563175+0000","last_peered":"2023-12-17T11:48:24.563175+0000","last_clean":"2023-12-17T11:48:24.563175+0000","last_became_active":"2023-12-17T11:48:22.531600+0000","last_became_peered":"2023-12-17T11:48:22.531600+0000","last_unstale":"2023-12-17T11:48:24.563175+0000","last_undegraded":"2023-12-17T11:48:24.563175+0000","last_fullsized":"2023-12-17T11:48:24.563175+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:21.473989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:21.473989+0000","last_clean_scrub_stamp":"2023-12-17T11:48:21.473989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T11:48:26.447870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-17T11:48:22.524000+0000","last_change":"2023-12-17T11:48:18.284906+0000","last_active":"2023-12-17T11:48:22.524000+0000","last_peered":"2023-12-17T11:48:22.524000+0000","last_clean":"2023-12-17T11:48:22.524000+0000","last_became_active":"2023-12-17T11:48:18.280252+0000","last_became_peered":"2023-12-17T11:48:18.280252+0000","last_unstale":"2023-12-17T11:48:22.524000+0000","last_undegraded":"2023-12-17T11:48:22.524000+0000","last_fullsized":"2023-12-17T11:48:22.524000+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_clean_scrub_stamp":"2023-12-17T11:48:17.199970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T14:35:37.830024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-17T11:48:22.531506+0000","last_change":"2023-12-17T11:48:17.256841+0000","last_active":"2023-12-17T11:48:22.531506+0000","last_peered":"2023-12-17T11:48:22.531506+0000","last_clean":"2023-12-17T11:48:22.531506+0000","last_became_active":"2023-12-17T11:48:17.256528+0000","last_became_peered":"2023-12-17T11:48:17.256528+0000","last_unstale":"2023-12-17T11:48:22.531506+0000","last_undegraded":"2023-12-17T11:48:22.531506+0000","last_fullsized":"2023-12-17T11:48:22.531506+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:16.193911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:16.193911+0000","last_clean_scrub_stamp":"2023-12-17T11:48:16.193911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T23:05:26.944558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-17T11:48:24.564180+0000","last_change":"2023-12-17T11:48:22.536175+0000","last_active":"2023-12-17T11:48:24.564180+0000","last_peered":"2023-12-17T11:48:24.564180+0000","last_clean":"2023-12-17T11:48:24.564180+0000","last_became_active":"2023-12-17T11:48:22.535544+0000","last_became_peered":"2023-12-17T11:48:22.535544+0000","last_unstale":"2023-12-17T11:48:24.564180+0000","last_undegraded":"2023-12-17T11:48:24.564180+0000","last_fullsized":"2023-12-17T11:48:24.564180+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:21.473989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:21.473989+0000","last_clean_scrub_stamp":"2023-12-17T11:48:21.473989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T19:02:34.642001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-17T11:48:24.564459+0000","last_change":"2023-12-17T11:48:22.543719+0000","last_active":"2023-12-17T11:48:24.564459+0000","last_peered":"2023-12-17T11:48:24.564459+0000","last_clean":"2023-12-17T11:48:24.564459+0000","last_became_active":"2023-12-17T11:48:22.543315+0000","last_became_peered":"2023-12-17T11:48:22.543315+0000","last_unstale":"2023-12-17T11:48:24.564459+0000","last_undegraded":"2023-12-17T11:48:24.564459+0000","last_fullsized":"2023-12-17T11:48:24.564459+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:21.473989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:21.473989+0000","last_clean_scrub_stamp":"2023-12-17T11:48:21.473989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T14:46:35.413635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-17T11:48:22.525084+0000","last_change":"2023-12-17T11:48:18.273197+0000","last_active":"2023-12-17T11:48:22.525084+0000","last_peered":"2023-12-17T11:48:22.525084+0000","last_clean":"2023-12-17T11:48:22.525084+0000","last_became_active":"2023-12-17T11:48:18.272904+0000","last_became_peered":"2023-12-17T11:48:18.272904+0000","last_unstale":"2023-12-17T11:48:22.525084+0000","last_undegraded":"2023-12-17T11:48:22.525084+0000","last_fullsized":"2023-12-17T11:48:22.525084+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_clean_scrub_stamp":"2023-12-17T11:48:17.199970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T19:01:46.435511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-17T11:48:22.515616+0000","last_change":"2023-12-17T11:48:17.254838+0000","last_active":"2023-12-17T11:48:22.515616+0000","last_peered":"2023-12-17T11:48:22.515616+0000","last_clean":"2023-12-17T11:48:22.515616+0000","last_became_active":"2023-12-17T11:48:17.254549+0000","last_became_peered":"2023-12-17T11:48:17.254549+0000","last_unstale":"2023-12-17T11:48:22.515616+0000","last_undegraded":"2023-12-17T11:48:22.515616+0000","last_fullsized":"2023-12-17T11:48:22.515616+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:16.193911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:16.193911+0000","last_clean_scrub_stamp":"2023-12-17T11:48:16.193911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T15:10:03.977630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-17T11:48:23.467487+0000","last_change":"2023-12-17T11:48:22.544106+0000","last_active":"2023-12-17T11:48:23.467487+0000","last_peered":"2023-12-17T11:48:23.467487+0000","last_clean":"2023-12-17T11:48:23.467487+0000","last_became_active":"2023-12-17T11:48:22.543121+0000","last_became_peered":"2023-12-17T11:48:22.543121+0000","last_unstale":"2023-12-17T11:48:23.467487+0000","last_undegraded":"2023-12-17T11:48:23.467487+0000","last_fullsized":"2023-12-17T11:48:23.467487+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:21.473989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:21.473989+0000","last_clean_scrub_stamp":"2023-12-17T11:48:21.473989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T14:39:15.707189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-17T11:48:22.498074+0000","last_change":"2023-12-17T11:48:18.273173+0000","last_active":"2023-12-17T11:48:22.498074+0000","last_peered":"2023-12-17T11:48:22.498074+0000","last_clean":"2023-12-17T11:48:22.498074+0000","last_became_active":"2023-12-17T11:48:18.272646+0000","last_became_peered":"2023-12-17T11:48:18.272646+0000","last_unstale":"2023-12-17T11:48:22.498074+0000","last_undegraded":"2023-12-17T11:48:22.498074+0000","last_fullsized":"2023-12-17T11:48:22.498074+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_clean_scrub_stamp":"2023-12-17T11:48:17.199970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T12:59:53.414167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-17T11:48:22.498535+0000","last_change":"2023-12-17T11:48:17.242171+0000","last_active":"2023-12-17T11:48:22.498535+0000","last_peered":"2023-12-17T11:48:22.498535+0000","last_clean":"2023-12-17T11:48:22.498535+0000","last_became_active":"2023-12-17T11:48:17.241764+0000","last_became_peered":"2023-12-17T11:48:17.241764+0000","last_unstale":"2023-12-17T11:48:22.498535+0000","last_undegraded":"2023-12-17T11:48:22.498535+0000","last_fullsized":"2023-12-17T11:48:22.498535+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:16.193911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:16.193911+0000","last_clean_scrub_stamp":"2023-12-17T11:48:16.193911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T14:38:16.218634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-17T11:48:22.528584+0000","last_change":"2023-12-17T11:48:17.242535+0000","last_active":"2023-12-17T11:48:22.528584+0000","last_peered":"2023-12-17T11:48:22.528584+0000","last_clean":"2023-12-17T11:48:22.528584+0000","last_became_active":"2023-12-17T11:48:17.242250+0000","last_became_peered":"2023-12-17T11:48:17.242250+0000","last_unstale":"2023-12-17T11:48:22.528584+0000","last_undegraded":"2023-12-17T11:48:22.528584+0000","last_fullsized":"2023-12-17T11:48:22.528584+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:16.193911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:16.193911+0000","last_clean_scrub_stamp":"2023-12-17T11:48:16.193911+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T15:52:21.914780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-17T11:48:22.513125+0000","last_change":"2023-12-17T11:48:18.264311+0000","last_active":"2023-12-17T11:48:22.513125+0000","last_peered":"2023-12-17T11:48:22.513125+0000","last_clean":"2023-12-17T11:48:22.513125+0000","last_became_active":"2023-12-17T11:48:18.263005+0000","last_became_peered":"2023-12-17T11:48:18.263005+0000","last_unstale":"2023-12-17T11:48:22.513125+0000","last_undegraded":"2023-12-17T11:48:22.513125+0000","last_fullsized":"2023-12-17T11:48:22.513125+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_clean_scrub_stamp":"2023-12-17T11:48:17.199970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T20:47:10.524205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-17T11:48:23.465100+0000","last_change":"2023-12-17T11:48:22.536488+0000","last_active":"2023-12-17T11:48:23.465100+0000","last_peered":"2023-12-17T11:48:23.465100+0000","last_clean":"2023-12-17T11:48:23.465100+0000","last_became_active":"2023-12-17T11:48:22.536091+0000","last_became_peered":"2023-12-17T11:48:22.536091+0000","last_unstale":"2023-12-17T11:48:23.465100+0000","last_undegraded":"2023-12-17T11:48:23.465100+0000","last_fullsized":"2023-12-17T11:48:23.465100+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:21.473989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:21.473989+0000","last_clean_scrub_stamp":"2023-12-17T11:48:21.473989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T19:10:14.471794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-17T11:48:22.499106+0000","last_change":"2023-12-17T11:48:17.241269+0000","last_active":"2023-12-17T11:48:22.499106+0000","last_peered":"2023-12-17T11:48:22.499106+0000","last_clean":"2023-12-17T11:48:22.499106+0000","last_became_active":"2023-12-17T11:48:17.240984+0000","last_became_peered":"2023-12-17T11:48:17.240984+0000","last_unstale":"2023-12-17T11:48:22.499106+0000","last_undegraded":"2023-12-17T11:48:22.499106+0000","last_fullsized":"2023-12-17T11:48:22.499106+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:16.193911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:16.193911+0000","last_clean_scrub_stamp":"2023-12-17T11:48:16.193911+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T21:33:08.409177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-17T11:48:22.514122+0000","last_change":"2023-12-17T11:48:18.269242+0000","last_active":"2023-12-17T11:48:22.514122+0000","last_peered":"2023-12-17T11:48:22.514122+0000","last_clean":"2023-12-17T11:48:22.514122+0000","last_became_active":"2023-12-17T11:48:18.262805+0000","last_became_peered":"2023-12-17T11:48:18.262805+0000","last_unstale":"2023-12-17T11:48:22.514122+0000","last_undegraded":"2023-12-17T11:48:22.514122+0000","last_fullsized":"2023-12-17T11:48:22.514122+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_clean_scrub_stamp":"2023-12-17T11:48:17.199970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T17:25:45.418657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-17T11:48:24.565907+0000","last_change":"2023-12-17T11:48:22.528378+0000","last_active":"2023-12-17T11:48:24.565907+0000","last_peered":"2023-12-17T11:48:24.565907+0000","last_clean":"2023-12-17T11:48:24.565907+0000","last_became_active":"2023-12-17T11:48:22.527917+0000","last_became_peered":"2023-12-17T11:48:22.527917+0000","last_unstale":"2023-12-17T11:48:24.565907+0000","last_undegraded":"2023-12-17T11:48:24.565907+0000","last_fullsized":"2023-12-17T11:48:24.565907+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:21.473989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:21.473989+0000","last_clean_scrub_stamp":"2023-12-17T11:48:21.473989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T23:05:37.198518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-17T11:48:22.528435+0000","last_change":"2023-12-17T11:48:18.266478+0000","last_active":"2023-12-17T11:48:22.528435+0000","last_peered":"2023-12-17T11:48:22.528435+0000","last_clean":"2023-12-17T11:48:22.528435+0000","last_became_active":"2023-12-17T11:48:18.265774+0000","last_became_peered":"2023-12-17T11:48:18.265774+0000","last_unstale":"2023-12-17T11:48:22.528435+0000","last_undegraded":"2023-12-17T11:48:22.528435+0000","last_fullsized":"2023-12-17T11:48:22.528435+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_clean_scrub_stamp":"2023-12-17T11:48:17.199970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T15:10:04.983689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-17T11:48:22.504939+0000","last_change":"2023-12-17T11:48:18.282141+0000","last_active":"2023-12-17T11:48:22.504939+0000","last_peered":"2023-12-17T11:48:22.504939+0000","last_clean":"2023-12-17T11:48:22.504939+0000","last_became_active":"2023-12-17T11:48:18.281103+0000","last_became_peered":"2023-12-17T11:48:18.281103+0000","last_unstale":"2023-12-17T11:48:22.504939+0000","last_undegraded":"2023-12-17T11:48:22.504939+0000","last_fullsized":"2023-12-17T11:48:22.504939+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_clean_scrub_stamp":"2023-12-17T11:48:17.199970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T14:38:17.224694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-17T11:48:22.519670+0000","last_change":"2023-12-17T11:48:18.280946+0000","last_active":"2023-12-17T11:48:22.519670+0000","last_peered":"2023-12-17T11:48:22.519670+0000","last_clean":"2023-12-17T11:48:22.519670+0000","last_became_active":"2023-12-17T11:48:18.280193+0000","last_became_peered":"2023-12-17T11:48:18.280193+0000","last_unstale":"2023-12-17T11:48:22.519670+0000","last_undegraded":"2023-12-17T11:48:22.519670+0000","last_fullsized":"2023-12-17T11:48:22.519670+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_clean_scrub_stamp":"2023-12-17T11:48:17.199970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T14:39:11.433170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-17T11:48:22.512528+0000","last_change":"2023-12-17T11:48:18.271322+0000","last_active":"2023-12-17T11:48:22.512528+0000","last_peered":"2023-12-17T11:48:22.512528+0000","last_clean":"2023-12-17T11:48:22.512528+0000","last_became_active":"2023-12-17T11:48:18.271029+0000","last_became_peered":"2023-12-17T11:48:18.271029+0000","last_unstale":"2023-12-17T11:48:22.512528+0000","last_undegraded":"2023-12-17T11:48:22.512528+0000","last_fullsized":"2023-12-17T11:48:22.512528+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_clean_scrub_stamp":"2023-12-17T11:48:17.199970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T23:46:39.140775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-17T11:48:22.499687+0000","last_change":"2023-12-17T11:48:18.280759+0000","last_active":"2023-12-17T11:48:22.499687+0000","last_peered":"2023-12-17T11:48:22.499687+0000","last_clean":"2023-12-17T11:48:22.499687+0000","last_became_active":"2023-12-17T11:48:18.279419+0000","last_became_peered":"2023-12-17T11:48:18.279419+0000","last_unstale":"2023-12-17T11:48:22.499687+0000","last_undegraded":"2023-12-17T11:48:22.499687+0000","last_fullsized":"2023-12-17T11:48:22.499687+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_clean_scrub_stamp":"2023-12-17T11:48:17.199970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T14:35:37.830024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-17T11:48:22.529945+0000","last_change":"2023-12-17T11:48:18.275948+0000","last_active":"2023-12-17T11:48:22.529945+0000","last_peered":"2023-12-17T11:48:22.529945+0000","last_clean":"2023-12-17T11:48:22.529945+0000","last_became_active":"2023-12-17T11:48:18.275186+0000","last_became_peered":"2023-12-17T11:48:18.275186+0000","last_unstale":"2023-12-17T11:48:22.529945+0000","last_undegraded":"2023-12-17T11:48:22.529945+0000","last_fullsized":"2023-12-17T11:48:22.529945+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_clean_scrub_stamp":"2023-12-17T11:48:17.199970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T20:47:10.524205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-17T11:48:22.528941+0000","last_change":"2023-12-17T11:48:18.266168+0000","last_active":"2023-12-17T11:48:22.528941+0000","last_peered":"2023-12-17T11:48:22.528941+0000","last_clean":"2023-12-17T11:48:22.528941+0000","last_became_active":"2023-12-17T11:48:18.265873+0000","last_became_peered":"2023-12-17T11:48:18.265873+0000","last_unstale":"2023-12-17T11:48:22.528941+0000","last_undegraded":"2023-12-17T11:48:22.528941+0000","last_fullsized":"2023-12-17T11:48:22.528941+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_clean_scrub_stamp":"2023-12-17T11:48:17.199970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T19:40:13.516541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-17T11:48:22.502538+0000","last_change":"2023-12-17T11:48:18.276992+0000","last_active":"2023-12-17T11:48:22.502538+0000","last_peered":"2023-12-17T11:48:22.502538+0000","last_clean":"2023-12-17T11:48:22.502538+0000","last_became_active":"2023-12-17T11:48:18.276731+0000","last_became_peered":"2023-12-17T11:48:18.276731+0000","last_unstale":"2023-12-17T11:48:22.502538+0000","last_undegraded":"2023-12-17T11:48:22.502538+0000","last_fullsized":"2023-12-17T11:48:22.502538+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_clean_scrub_stamp":"2023-12-17T11:48:17.199970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T20:53:58.226339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-17T11:48:22.515412+0000","last_change":"2023-12-17T11:48:18.282302+0000","last_active":"2023-12-17T11:48:22.515412+0000","last_peered":"2023-12-17T11:48:22.515412+0000","last_clean":"2023-12-17T11:48:22.515412+0000","last_became_active":"2023-12-17T11:48:18.282033+0000","last_became_peered":"2023-12-17T11:48:18.282033+0000","last_unstale":"2023-12-17T11:48:22.515412+0000","last_undegraded":"2023-12-17T11:48:22.515412+0000","last_fullsized":"2023-12-17T11:48:22.515412+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_clean_scrub_stamp":"2023-12-17T11:48:17.199970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T19:19:50.098252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-17T11:48:22.498331+0000","last_change":"2023-12-17T11:48:18.278722+0000","last_active":"2023-12-17T11:48:22.498331+0000","last_peered":"2023-12-17T11:48:22.498331+0000","last_clean":"2023-12-17T11:48:22.498331+0000","last_became_active":"2023-12-17T11:48:18.278416+0000","last_became_peered":"2023-12-17T11:48:18.278416+0000","last_unstale":"2023-12-17T11:48:22.498331+0000","last_undegraded":"2023-12-17T11:48:22.498331+0000","last_fullsized":"2023-12-17T11:48:22.498331+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_clean_scrub_stamp":"2023-12-17T11:48:17.199970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T12:09:17.721558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-17T11:48:22.523002+0000","last_change":"2023-12-17T11:48:18.280465+0000","last_active":"2023-12-17T11:48:22.523002+0000","last_peered":"2023-12-17T11:48:22.523002+0000","last_clean":"2023-12-17T11:48:22.523002+0000","last_became_active":"2023-12-17T11:48:18.279834+0000","last_became_peered":"2023-12-17T11:48:18.279834+0000","last_unstale":"2023-12-17T11:48:22.523002+0000","last_undegraded":"2023-12-17T11:48:22.523002+0000","last_fullsized":"2023-12-17T11:48:22.523002+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_clean_scrub_stamp":"2023-12-17T11:48:17.199970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T20:53:58.226339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-17T11:48:22.512247+0000","last_change":"2023-12-17T11:48:18.265956+0000","last_active":"2023-12-17T11:48:22.512247+0000","last_peered":"2023-12-17T11:48:22.512247+0000","last_clean":"2023-12-17T11:48:22.512247+0000","last_became_active":"2023-12-17T11:48:18.264308+0000","last_became_peered":"2023-12-17T11:48:18.264308+0000","last_unstale":"2023-12-17T11:48:22.512247+0000","last_undegraded":"2023-12-17T11:48:22.512247+0000","last_fullsized":"2023-12-17T11:48:22.512247+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_clean_scrub_stamp":"2023-12-17T11:48:17.199970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T12:09:17.721558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-17T11:48:22.528941+0000","last_change":"2023-12-17T11:48:18.277893+0000","last_active":"2023-12-17T11:48:22.528941+0000","last_peered":"2023-12-17T11:48:22.528941+0000","last_clean":"2023-12-17T11:48:22.528941+0000","last_became_active":"2023-12-17T11:48:18.277557+0000","last_became_peered":"2023-12-17T11:48:18.277557+0000","last_unstale":"2023-12-17T11:48:22.528941+0000","last_undegraded":"2023-12-17T11:48:22.528941+0000","last_fullsized":"2023-12-17T11:48:22.528941+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_clean_scrub_stamp":"2023-12-17T11:48:17.199970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T23:46:39.140775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-17T11:48:22.538075+0000","last_change":"2023-12-17T11:48:18.274779+0000","last_active":"2023-12-17T11:48:22.538075+0000","last_peered":"2023-12-17T11:48:22.538075+0000","last_clean":"2023-12-17T11:48:22.538075+0000","last_became_active":"2023-12-17T11:48:18.274509+0000","last_became_peered":"2023-12-17T11:48:18.274509+0000","last_unstale":"2023-12-17T11:48:22.538075+0000","last_undegraded":"2023-12-17T11:48:22.538075+0000","last_fullsized":"2023-12-17T11:48:22.538075+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_clean_scrub_stamp":"2023-12-17T11:48:17.199970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T22:05:51.790351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-17T11:48:22.504169+0000","last_change":"2023-12-17T11:48:18.266606+0000","last_active":"2023-12-17T11:48:22.504169+0000","last_peered":"2023-12-17T11:48:22.504169+0000","last_clean":"2023-12-17T11:48:22.504169+0000","last_became_active":"2023-12-17T11:48:18.265428+0000","last_became_peered":"2023-12-17T11:48:18.265428+0000","last_unstale":"2023-12-17T11:48:22.504169+0000","last_undegraded":"2023-12-17T11:48:22.504169+0000","last_fullsized":"2023-12-17T11:48:22.504169+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_clean_scrub_stamp":"2023-12-17T11:48:17.199970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T23:05:27.950618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-17T11:48:22.522838+0000","last_change":"2023-12-17T11:48:18.284558+0000","last_active":"2023-12-17T11:48:22.522838+0000","last_peered":"2023-12-17T11:48:22.522838+0000","last_clean":"2023-12-17T11:48:22.522838+0000","last_became_active":"2023-12-17T11:48:18.284223+0000","last_became_peered":"2023-12-17T11:48:18.284223+0000","last_unstale":"2023-12-17T11:48:22.522838+0000","last_undegraded":"2023-12-17T11:48:22.522838+0000","last_fullsized":"2023-12-17T11:48:22.522838+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_clean_scrub_stamp":"2023-12-17T11:48:17.199970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T19:44:16.453002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-17T11:48:22.515217+0000","last_change":"2023-12-17T11:48:18.285584+0000","last_active":"2023-12-17T11:48:22.515217+0000","last_peered":"2023-12-17T11:48:22.515217+0000","last_clean":"2023-12-17T11:48:22.515217+0000","last_became_active":"2023-12-17T11:48:18.285361+0000","last_became_peered":"2023-12-17T11:48:18.285361+0000","last_unstale":"2023-12-17T11:48:22.515217+0000","last_undegraded":"2023-12-17T11:48:22.515217+0000","last_fullsized":"2023-12-17T11:48:22.515217+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_clean_scrub_stamp":"2023-12-17T11:48:17.199970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T16:14:48.723317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-17T11:48:22.529429+0000","last_change":"2023-12-17T11:48:18.279879+0000","last_active":"2023-12-17T11:48:22.529429+0000","last_peered":"2023-12-17T11:48:22.529429+0000","last_clean":"2023-12-17T11:48:22.529429+0000","last_became_active":"2023-12-17T11:48:18.279462+0000","last_became_peered":"2023-12-17T11:48:18.279462+0000","last_unstale":"2023-12-17T11:48:22.529429+0000","last_undegraded":"2023-12-17T11:48:22.529429+0000","last_fullsized":"2023-12-17T11:48:22.529429+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_clean_scrub_stamp":"2023-12-17T11:48:17.199970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T12:09:17.721558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-17T11:48:22.509512+0000","last_change":"2023-12-17T11:48:18.268736+0000","last_active":"2023-12-17T11:48:22.509512+0000","last_peered":"2023-12-17T11:48:22.509512+0000","last_clean":"2023-12-17T11:48:22.509512+0000","last_became_active":"2023-12-17T11:48:18.268299+0000","last_became_peered":"2023-12-17T11:48:18.268299+0000","last_unstale":"2023-12-17T11:48:22.509512+0000","last_undegraded":"2023-12-17T11:48:22.509512+0000","last_fullsized":"2023-12-17T11:48:22.509512+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_clean_scrub_stamp":"2023-12-17T11:48:17.199970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T12:59:53.414167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-17T11:48:22.498921+0000","last_change":"2023-12-17T11:48:18.270384+0000","last_active":"2023-12-17T11:48:22.498921+0000","last_peered":"2023-12-17T11:48:22.498921+0000","last_clean":"2023-12-17T11:48:22.498921+0000","last_became_active":"2023-12-17T11:48:18.270042+0000","last_became_peered":"2023-12-17T11:48:18.270042+0000","last_unstale":"2023-12-17T11:48:22.498921+0000","last_undegraded":"2023-12-17T11:48:22.498921+0000","last_fullsized":"2023-12-17T11:48:22.498921+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_clean_scrub_stamp":"2023-12-17T11:48:17.199970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T20:47:10.524205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-17T11:48:22.518885+0000","last_change":"2023-12-17T11:48:18.261294+0000","last_active":"2023-12-17T11:48:22.518885+0000","last_peered":"2023-12-17T11:48:22.518885+0000","last_clean":"2023-12-17T11:48:22.518885+0000","last_became_active":"2023-12-17T11:48:18.260956+0000","last_became_peered":"2023-12-17T11:48:18.260956+0000","last_unstale":"2023-12-17T11:48:22.518885+0000","last_undegraded":"2023-12-17T11:48:22.518885+0000","last_fullsized":"2023-12-17T11:48:22.518885+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_clean_scrub_stamp":"2023-12-17T11:48:17.199970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T14:38:17.224694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-17T11:48:22.531412+0000","last_change":"2023-12-17T11:48:18.288322+0000","last_active":"2023-12-17T11:48:22.531412+0000","last_peered":"2023-12-17T11:48:22.531412+0000","last_clean":"2023-12-17T11:48:22.531412+0000","last_became_active":"2023-12-17T11:48:18.288079+0000","last_became_peered":"2023-12-17T11:48:18.288079+0000","last_unstale":"2023-12-17T11:48:22.531412+0000","last_undegraded":"2023-12-17T11:48:22.531412+0000","last_fullsized":"2023-12-17T11:48:22.531412+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_clean_scrub_stamp":"2023-12-17T11:48:17.199970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T12:59:53.414167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-17T11:48:22.528855+0000","last_change":"2023-12-17T11:48:18.284571+0000","last_active":"2023-12-17T11:48:22.528855+0000","last_peered":"2023-12-17T11:48:22.528855+0000","last_clean":"2023-12-17T11:48:22.528855+0000","last_became_active":"2023-12-17T11:48:18.284293+0000","last_became_peered":"2023-12-17T11:48:18.284293+0000","last_unstale":"2023-12-17T11:48:22.528855+0000","last_undegraded":"2023-12-17T11:48:22.528855+0000","last_fullsized":"2023-12-17T11:48:22.528855+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_clean_scrub_stamp":"2023-12-17T11:48:17.199970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T20:47:10.524205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-17T11:48:22.539887+0000","last_change":"2023-12-17T11:48:18.291564+0000","last_active":"2023-12-17T11:48:22.539887+0000","last_peered":"2023-12-17T11:48:22.539887+0000","last_clean":"2023-12-17T11:48:22.539887+0000","last_became_active":"2023-12-17T11:48:18.289522+0000","last_became_peered":"2023-12-17T11:48:18.289522+0000","last_unstale":"2023-12-17T11:48:22.539887+0000","last_undegraded":"2023-12-17T11:48:22.539887+0000","last_fullsized":"2023-12-17T11:48:22.539887+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_clean_scrub_stamp":"2023-12-17T11:48:17.199970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T17:39:16.718281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-17T11:48:22.497188+0000","last_change":"2023-12-17T11:48:18.282696+0000","last_active":"2023-12-17T11:48:22.497188+0000","last_peered":"2023-12-17T11:48:22.497188+0000","last_clean":"2023-12-17T11:48:22.497188+0000","last_became_active":"2023-12-17T11:48:18.282388+0000","last_became_peered":"2023-12-17T11:48:18.282388+0000","last_unstale":"2023-12-17T11:48:22.497188+0000","last_undegraded":"2023-12-17T11:48:22.497188+0000","last_fullsized":"2023-12-17T11:48:22.497188+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_clean_scrub_stamp":"2023-12-17T11:48:17.199970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T19:01:46.435511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-17T11:48:22.537605+0000","last_change":"2023-12-17T11:48:18.279029+0000","last_active":"2023-12-17T11:48:22.537605+0000","last_peered":"2023-12-17T11:48:22.537605+0000","last_clean":"2023-12-17T11:48:22.537605+0000","last_became_active":"2023-12-17T11:48:18.278719+0000","last_became_peered":"2023-12-17T11:48:18.278719+0000","last_unstale":"2023-12-17T11:48:22.537605+0000","last_undegraded":"2023-12-17T11:48:22.537605+0000","last_fullsized":"2023-12-17T11:48:22.537605+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_clean_scrub_stamp":"2023-12-17T11:48:17.199970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T14:24:55.101826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-17T11:48:22.517795+0000","last_change":"2023-12-17T11:48:18.286319+0000","last_active":"2023-12-17T11:48:22.517795+0000","last_peered":"2023-12-17T11:48:22.517795+0000","last_clean":"2023-12-17T11:48:22.517795+0000","last_became_active":"2023-12-17T11:48:18.286027+0000","last_became_peered":"2023-12-17T11:48:18.286027+0000","last_unstale":"2023-12-17T11:48:22.517795+0000","last_undegraded":"2023-12-17T11:48:22.517795+0000","last_fullsized":"2023-12-17T11:48:22.517795+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_clean_scrub_stamp":"2023-12-17T11:48:17.199970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T22:33:29.994957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-17T11:48:22.538176+0000","last_change":"2023-12-17T11:48:18.268834+0000","last_active":"2023-12-17T11:48:22.538176+0000","last_peered":"2023-12-17T11:48:22.538176+0000","last_clean":"2023-12-17T11:48:22.538176+0000","last_became_active":"2023-12-17T11:48:18.268143+0000","last_became_peered":"2023-12-17T11:48:18.268143+0000","last_unstale":"2023-12-17T11:48:22.538176+0000","last_undegraded":"2023-12-17T11:48:22.538176+0000","last_fullsized":"2023-12-17T11:48:22.538176+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_clean_scrub_stamp":"2023-12-17T11:48:17.199970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T12:22:21.171846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-17T11:48:22.521713+0000","last_change":"2023-12-17T11:48:18.280307+0000","last_active":"2023-12-17T11:48:22.521713+0000","last_peered":"2023-12-17T11:48:22.521713+0000","last_clean":"2023-12-17T11:48:22.521713+0000","last_became_active":"2023-12-17T11:48:18.280015+0000","last_became_peered":"2023-12-17T11:48:18.280015+0000","last_unstale":"2023-12-17T11:48:22.521713+0000","last_undegraded":"2023-12-17T11:48:22.521713+0000","last_fullsized":"2023-12-17T11:48:22.521713+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_clean_scrub_stamp":"2023-12-17T11:48:17.199970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T14:13:24.702473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-17T11:48:22.517974+0000","last_change":"2023-12-17T11:48:18.268732+0000","last_active":"2023-12-17T11:48:22.517974+0000","last_peered":"2023-12-17T11:48:22.517974+0000","last_clean":"2023-12-17T11:48:22.517974+0000","last_became_active":"2023-12-17T11:48:18.268356+0000","last_became_peered":"2023-12-17T11:48:18.268356+0000","last_unstale":"2023-12-17T11:48:22.517974+0000","last_undegraded":"2023-12-17T11:48:22.517974+0000","last_fullsized":"2023-12-17T11:48:22.517974+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_clean_scrub_stamp":"2023-12-17T11:48:17.199970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T19:01:46.435511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-17T11:48:22.536284+0000","last_change":"2023-12-17T11:48:18.278820+0000","last_active":"2023-12-17T11:48:22.536284+0000","last_peered":"2023-12-17T11:48:22.536284+0000","last_clean":"2023-12-17T11:48:22.536284+0000","last_became_active":"2023-12-17T11:48:18.275659+0000","last_became_peered":"2023-12-17T11:48:18.275659+0000","last_unstale":"2023-12-17T11:48:22.536284+0000","last_undegraded":"2023-12-17T11:48:22.536284+0000","last_fullsized":"2023-12-17T11:48:22.536284+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_clean_scrub_stamp":"2023-12-17T11:48:17.199970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T19:40:13.516541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-17T11:48:22.539766+0000","last_change":"2023-12-17T11:48:18.263983+0000","last_active":"2023-12-17T11:48:22.539766+0000","last_peered":"2023-12-17T11:48:22.539766+0000","last_clean":"2023-12-17T11:48:22.539766+0000","last_became_active":"2023-12-17T11:48:18.263574+0000","last_became_peered":"2023-12-17T11:48:18.263574+0000","last_unstale":"2023-12-17T11:48:22.539766+0000","last_undegraded":"2023-12-17T11:48:22.539766+0000","last_fullsized":"2023-12-17T11:48:22.539766+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_clean_scrub_stamp":"2023-12-17T11:48:17.199970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T22:56:05.187224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4497,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":8994,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":41,"ondisk_log_size":41,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542153,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27864,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343976,"statfs":{"total":96636764160,"available":96608231424,"internally_reserved":0,"allocated":860160,"data_stored":694037,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.212}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2669999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5489999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0369999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96899999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.403}]}]},{"osd":6,"up_from":14,"seq":60129542153,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":274432,"data_stored":106786,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90100000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0629999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.173}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.613}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2470000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3420000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.575}]}]},{"osd":5,"up_from":14,"seq":60129542152,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":266240,"data_stored":103177,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0329999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1679999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90600000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2529999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.141}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6599999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5069999999999999}]}]},{"osd":4,"up_from":14,"seq":60129542153,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":274432,"data_stored":103213,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1599999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83999999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.393}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.278}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96799999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.212}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5620000000000001}]}]},{"osd":3,"up_from":14,"seq":60129542152,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":274432,"data_stored":106786,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91500000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69799999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.022}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.198}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4159999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3600000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4390000000000001}]}]},{"osd":2,"up_from":14,"seq":60129542153,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":262144,"data_stored":103087,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59099999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76300000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64000000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98399999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.143}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.107}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1899999999999999}]}]},{"osd":1,"up_from":14,"seq":60129542152,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":270336,"data_stored":103247,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64100000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83799999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81399999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97599999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.468}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.093}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0349999999999999}]}]},{"osd":0,"up_from":14,"seq":60129542152,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27868,"kb_used_data":848,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343972,"statfs":{"total":96636764160,"available":96608227328,"internally_reserved":0,"allocated":868352,"data_stored":694093,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1479999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0349999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1080000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.413}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2470000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3700000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3699,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3699,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-17T11:48:42.059 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-17T11:48:42.324 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:42.322+0000 7f166f59e640 1 Processor -- start 2023-12-17T11:48:42.325 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:42.322+0000 7f166f59e640 1 -- start start 2023-12-17T11:48:42.326 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:42.324+0000 7f166f59e640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f16700ce5b0 0x7f16700d0d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:42.326 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:42.324+0000 7f166f59e640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16700b2280 con 0x7f16700b0760 2023-12-17T11:48:42.326 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:42.324+0000 7f166f59e640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16700cee70 con 0x7f16700d13c0 2023-12-17T11:48:42.326 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:42.324+0000 7f166f59e640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16700ceb90 con 0x7f16700ce5b0 2023-12-17T11:48:42.326 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:42.324+0000 7f166ed9d640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f16700b0760 0x7f16700b0bb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:39940/0 (socket says 172.21.15.40:39940) 2023-12-17T11:48:42.326 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:42.324+0000 7f166ed9d640 1 -- 172.21.15.40:0/270522558 learned_addr learned my addr 172.21.15.40:0/270522558 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-12-17T11:48:42.328 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:42.325+0000 7f1667fff640 1 --2- 172.21.15.40:0/270522558 >> v2:172.21.15.159:3300/0 conn(0x7f16700ce5b0 0x7f16700d0d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:42.329 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:42.325+0000 7f166dd9b640 1 -- 172.21.15.40:0/270522558 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3233807832 0 0) 0x7f16700b2280 con 0x7f16700b0760 2023-12-17T11:48:42.329 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:42.325+0000 7f166dd9b640 1 -- 172.21.15.40:0/270522558 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f165c003520 con 0x7f16700b0760 2023-12-17T11:48:42.329 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:42.325+0000 7f166dd9b640 1 -- 172.21.15.40:0/270522558 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3354278288 0 0) 0x7f165c003520 con 0x7f16700b0760 2023-12-17T11:48:42.329 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:42.325+0000 7f166dd9b640 1 -- 172.21.15.40:0/270522558 >> v2:172.21.15.159:3300/0 conn(0x7f16700ce5b0 msgr2=0x7f16700d0d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:48:42.329 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:42.325+0000 7f166dd9b640 1 --2- 172.21.15.40:0/270522558 >> v2:172.21.15.159:3300/0 conn(0x7f16700ce5b0 0x7f16700d0d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:42.329 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:42.325+0000 7f166dd9b640 1 -- 172.21.15.40:0/270522558 >> v1:172.21.15.159:6789/0 conn(0x7f16700d13c0 legacy=0x7f16700d17a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:42.329 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:42.325+0000 7f166dd9b640 1 -- 172.21.15.40:0/270522558 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16700afc80 con 0x7f16700b0760 2023-12-17T11:48:42.329 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:42.325+0000 7f166dd9b640 1 -- 172.21.15.40:0/270522558 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2643242555 0 0) 0x7f16680019f0 con 0x7f16700b0760 2023-12-17T11:48:42.330 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:42.325+0000 7f166dd9b640 1 -- 172.21.15.40:0/270522558 >> v1:172.21.15.40:6789/0 conn(0x7f16700b0760 legacy=0x7f16700b0bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:42.330 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:42.325+0000 7f166dd9b640 1 --2- 172.21.15.40:0/270522558 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f165c003970 0x7f165c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:42.330 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:42.325+0000 7f166dd9b640 1 --2- 172.21.15.40:0/270522558 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f165c0047c0 0x7f165c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:42.330 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:42.326+0000 7f166dd9b640 1 --2- 172.21.15.40:0/270522558 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f165c005180 0x7f165c00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:42.330 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:42.326+0000 7f166dd9b640 1 -- 172.21.15.40:0/270522558 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16700ceb90 con 0x7f165c003970 2023-12-17T11:48:42.330 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:42.326+0000 7f166dd9b640 1 -- 172.21.15.40:0/270522558 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f165c00c120 con 0x7f165c0047c0 2023-12-17T11:48:42.330 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:42.326+0000 7f166dd9b640 1 -- 172.21.15.40:0/270522558 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f165c00c2e0 con 0x7f165c005180 2023-12-17T11:48:42.330 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:42.326+0000 7f166e59c640 1 --2- 172.21.15.40:0/270522558 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f165c003970 0x7f165c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:42.330 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:42.326+0000 7f1667fff640 1 --2- 172.21.15.40:0/270522558 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f165c0047c0 0x7f165c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:42.330 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:42.326+0000 7f166e59c640 1 -- 172.21.15.40:0/270522558 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f165c005180 msgr2=0x7f165c00b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:48:42.330 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:42.326+0000 7f166ed9d640 1 --2- 172.21.15.40:0/270522558 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f165c005180 0x7f165c00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:42.330 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:42.326+0000 7f166e59c640 1 --2- 172.21.15.40:0/270522558 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f165c005180 0x7f165c00b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:42.331 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:42.327+0000 7f166e59c640 1 -- 172.21.15.40:0/270522558 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f165c0047c0 msgr2=0x7f165c004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:48:42.331 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:42.327+0000 7f166e59c640 1 --2- 172.21.15.40:0/270522558 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f165c0047c0 0x7f165c004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:42.331 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:42.327+0000 7f166e59c640 1 -- 172.21.15.40:0/270522558 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f165c003520 con 0x7f165c003970 2023-12-17T11:48:42.331 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:42.327+0000 7f166ed9d640 1 --2- 172.21.15.40:0/270522558 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f165c005180 0x7f165c00b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-17T11:48:42.331 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:42.327+0000 7f166ed9d640 1 -- 172.21.15.40:0/270522558 reap_dead start 2023-12-17T11:48:42.332 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:42.328+0000 7f166e59c640 1 --2- 172.21.15.40:0/270522558 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f165c003970 0x7f165c003d90 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f1660001750 tx=0x7f165c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2854d1a5100a410 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:48:42.332 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:42.329+0000 7f166dd9b640 1 -- 172.21.15.40:0/270522558 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16600052d0 con 0x7f165c003970 2023-12-17T11:48:42.332 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:42.329+0000 7f166dd9b640 1 -- 172.21.15.40:0/270522558 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f166002e050 con 0x7f165c003970 2023-12-17T11:48:42.332 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:42.329+0000 7f166dd9b640 1 -- 172.21.15.40:0/270522558 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1660003830 con 0x7f165c003970 2023-12-17T11:48:42.332 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:42.329+0000 7f166f59e640 1 -- 172.21.15.40:0/270522558 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f165c003970 msgr2=0x7f165c003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:42.332 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:42.329+0000 7f166f59e640 1 --2- 172.21.15.40:0/270522558 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f165c003970 0x7f165c003d90 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f1660001750 tx=0x7f165c0057f0 comp rx=0 tx=0).stop 2023-12-17T11:48:42.333 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:42.329+0000 7f166f59e640 1 -- 172.21.15.40:0/270522558 shutdown_connections 2023-12-17T11:48:42.333 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:42.329+0000 7f166f59e640 1 --2- 172.21.15.40:0/270522558 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f165c003970 0x7f165c003d90 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:42.333 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:42.329+0000 7f166f59e640 1 -- 172.21.15.40:0/270522558 >> 172.21.15.40:0/270522558 conn(0x7f167009c260 msgr2=0x7f16700d2f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:48:42.333 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:42.330+0000 7f166f59e640 1 -- 172.21.15.40:0/270522558 shutdown_connections 2023-12-17T11:48:42.333 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:42.330+0000 7f166f59e640 1 -- 172.21.15.40:0/270522558 wait complete. 2023-12-17T11:48:42.333 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:42.332+0000 7f166f59e640 1 Processor -- start 2023-12-17T11:48:42.334 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:42.332+0000 7f166f59e640 1 -- start start 2023-12-17T11:48:42.336 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:42.333+0000 7f166f59e640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f165c003970 0x7f16700b2160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:42.336 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:42.333+0000 7f166f59e640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f16700cb0b0 0x7f16700cb510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:42.336 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:42.333+0000 7f166f59e640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f16700cba50 0x7f16700b4680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:42.336 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:42.333+0000 7f166f59e640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16700b26a0 con 0x7f16700cb0b0 2023-12-17T11:48:42.336 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:42.333+0000 7f166f59e640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16700cbf00 con 0x7f16700cba50 2023-12-17T11:48:42.336 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:42.333+0000 7f166f59e640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16701f2a80 con 0x7f165c003970 2023-12-17T11:48:42.336 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:42.333+0000 7f1667fff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f16700cb0b0 0x7f16700cb510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:42.336 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:42.333+0000 7f1667fff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f16700cb0b0 0x7f16700cb510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:35224/0 (socket says 172.21.15.40:35224) 2023-12-17T11:48:42.336 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:42.333+0000 7f1667fff640 1 -- 172.21.15.40:0/2811866364 learned_addr learned my addr 172.21.15.40:0/2811866364 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-17T11:48:42.336 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:42.333+0000 7f166ed9d640 1 --2- 172.21.15.40:0/2811866364 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f16700cba50 0x7f16700b4680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:42.336 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:42.333+0000 7f166e59c640 1 --2- 172.21.15.40:0/2811866364 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f165c003970 0x7f16700b2160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:42.337 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:42.334+0000 7f1667fff640 1 -- 172.21.15.40:0/2811866364 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f165c003970 msgr2=0x7f16700b2160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:42.337 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:42.334+0000 7f1667fff640 1 --2- 172.21.15.40:0/2811866364 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f165c003970 0x7f16700b2160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:42.337 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:42.334+0000 7f1667fff640 1 -- 172.21.15.40:0/2811866364 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f16700cba50 msgr2=0x7f16700b4680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:42.337 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:42.334+0000 7f1667fff640 1 --2- 172.21.15.40:0/2811866364 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f16700cba50 0x7f16700b4680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:42.337 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:42.334+0000 7f1667fff640 1 -- 172.21.15.40:0/2811866364 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16700c9570 con 0x7f16700cb0b0 2023-12-17T11:48:42.337 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:42.334+0000 7f1667fff640 1 --2- 172.21.15.40:0/2811866364 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f16700cb0b0 0x7f16700cb510 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f1658011aa0 tx=0x7f1658011f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:48:42.338 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:42.334+0000 7f1666ffd640 1 -- 172.21.15.40:0/2811866364 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1658009680 con 0x7f16700cb0b0 2023-12-17T11:48:42.338 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:42.334+0000 7f1666ffd640 1 -- 172.21.15.40:0/2811866364 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f165800fb80 con 0x7f16700cb0b0 2023-12-17T11:48:42.338 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:42.334+0000 7f166f59e640 1 -- 172.21.15.40:0/2811866364 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16700c9850 con 0x7f16700cb0b0 2023-12-17T11:48:42.338 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:42.334+0000 7f1666ffd640 1 -- 172.21.15.40:0/2811866364 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1658014440 con 0x7f16700cb0b0 2023-12-17T11:48:42.338 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:42.334+0000 7f166f59e640 1 -- 172.21.15.40:0/2811866364 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16700b4160 con 0x7f16700cb0b0 2023-12-17T11:48:42.338 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:42.336+0000 7f166f59e640 1 -- 172.21.15.40:0/2811866364 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1670074450 con 0x7f16700cb0b0 2023-12-17T11:48:42.339 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:42.336+0000 7f1666ffd640 1 -- 172.21.15.40:0/2811866364 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f165801d400 con 0x7f16700cb0b0 2023-12-17T11:48:42.339 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:42.337+0000 7f1666ffd640 1 --2- 172.21.15.40:0/2811866364 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f165006ae40 0x7f165006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:42.339 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:42.337+0000 7f1666ffd640 1 -- 172.21.15.40:0/2811866364 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f165808a290 con 0x7f16700cb0b0 2023-12-17T11:48:42.340 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:42.338+0000 7f166e59c640 1 --2- 172.21.15.40:0/2811866364 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f165006ae40 0x7f165006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:42.341 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:42.339+0000 7f166e59c640 1 --2- 172.21.15.40:0/2811866364 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f165006ae40 0x7f165006d300 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f1660033000 tx=0x7f1660009030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:48:42.343 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:42.341+0000 7f1666ffd640 1 -- 172.21.15.40:0/2811866364 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f1658054f20 con 0x7f16700cb0b0 2023-12-17T11:48:42.535 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:42.533+0000 7f166f59e640 1 -- 172.21.15.40:0/2811866364 --> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f16700b0240 con 0x7f165006ae40 2023-12-17T11:48:42.561 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:42.559+0000 7f1666ffd640 1 -- 172.21.15.40:0/2811866364 <== mgr.4105 v2:172.21.15.159:6832/479465803 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+345132 (secure 0 0 0) 0x7f1660005410 con 0x7f165006ae40 2023-12-17T11:48:42.566 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T11:48:42.568 INFO:teuthology.orchestra.run.smithi040.stderr:dumped all 2023-12-17T11:48:42.569 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:42.564+0000 7f166f59e640 1 -- 172.21.15.40:0/2811866364 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f165006ae40 msgr2=0x7f165006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:42.570 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:42.564+0000 7f166f59e640 1 --2- 172.21.15.40:0/2811866364 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f165006ae40 0x7f165006d300 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f1660033000 tx=0x7f1660009030 comp rx=0 tx=0).stop 2023-12-17T11:48:42.570 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:42.564+0000 7f166f59e640 1 -- 172.21.15.40:0/2811866364 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f16700cb0b0 msgr2=0x7f16700cb510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:42.570 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:42.564+0000 7f166f59e640 1 --2- 172.21.15.40:0/2811866364 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f16700cb0b0 0x7f16700cb510 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f1658011aa0 tx=0x7f1658011f60 comp rx=0 tx=0).stop 2023-12-17T11:48:42.570 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:42.565+0000 7f166f59e640 1 -- 172.21.15.40:0/2811866364 shutdown_connections 2023-12-17T11:48:42.570 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:42.565+0000 7f166f59e640 1 --2- 172.21.15.40:0/2811866364 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f165006ae40 0x7f165006d300 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:42.570 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:42.565+0000 7f166f59e640 1 --2- 172.21.15.40:0/2811866364 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f16700cba50 0x7f16700b4680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:42.570 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:42.565+0000 7f166f59e640 1 --2- 172.21.15.40:0/2811866364 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f16700cb0b0 0x7f16700cb510 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:42.570 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:42.565+0000 7f166f59e640 1 --2- 172.21.15.40:0/2811866364 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f165c003970 0x7f16700b2160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:42.570 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:42.565+0000 7f166f59e640 1 -- 172.21.15.40:0/2811866364 >> 172.21.15.40:0/2811866364 conn(0x7f167009c260 msgr2=0x7f167006c6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:48:42.570 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:42.565+0000 7f166f59e640 1 -- 172.21.15.40:0/2811866364 shutdown_connections 2023-12-17T11:48:42.570 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:42.565+0000 7f166f59e640 1 -- 172.21.15.40:0/2811866364 wait complete. 2023-12-17T11:48:42.585 INFO:teuthology.orchestra.run.smithi040.stdout:{"pg_ready":true,"pg_map":{"version":35,"stamp":"2023-12-17T11:48:40.600696+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594865,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":206,"num_write_kb":2433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":158,"ondisk_log_size":158,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219440,"kb_used_data":3272,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755280,"statfs":{"total":773094113280,"available":772869406720,"internally_reserved":0,"allocated":3350528,"data_stored":2014426,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":221236786},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2087,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005715"},"pg_stats":[{"pgid":"2.1f","version":"20'4","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-17T11:48:22.517845+0000","last_change":"2023-12-17T11:48:17.243309+0000","last_active":"2023-12-17T11:48:22.517845+0000","last_peered":"2023-12-17T11:48:22.517845+0000","last_clean":"2023-12-17T11:48:22.517845+0000","last_became_active":"2023-12-17T11:48:17.242970+0000","last_became_peered":"2023-12-17T11:48:17.242970+0000","last_unstale":"2023-12-17T11:48:22.517845+0000","last_undegraded":"2023-12-17T11:48:22.517845+0000","last_fullsized":"2023-12-17T11:48:22.517845+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:16.193911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:16.193911+0000","last_clean_scrub_stamp":"2023-12-17T11:48:16.193911+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T21:33:08.409177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-17T11:48:22.501333+0000","last_change":"2023-12-17T11:48:18.269881+0000","last_active":"2023-12-17T11:48:22.501333+0000","last_peered":"2023-12-17T11:48:22.501333+0000","last_clean":"2023-12-17T11:48:22.501333+0000","last_became_active":"2023-12-17T11:48:18.268658+0000","last_became_peered":"2023-12-17T11:48:18.268658+0000","last_unstale":"2023-12-17T11:48:22.501333+0000","last_undegraded":"2023-12-17T11:48:22.501333+0000","last_fullsized":"2023-12-17T11:48:22.501333+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_clean_scrub_stamp":"2023-12-17T11:48:17.199970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T22:33:29.994957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-17T11:48:24.563717+0000","last_change":"2023-12-17T11:48:22.536397+0000","last_active":"2023-12-17T11:48:24.563717+0000","last_peered":"2023-12-17T11:48:24.563717+0000","last_clean":"2023-12-17T11:48:24.563717+0000","last_became_active":"2023-12-17T11:48:22.535833+0000","last_became_peered":"2023-12-17T11:48:22.535833+0000","last_unstale":"2023-12-17T11:48:24.563717+0000","last_undegraded":"2023-12-17T11:48:24.563717+0000","last_fullsized":"2023-12-17T11:48:24.563717+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:21.473989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:21.473989+0000","last_clean_scrub_stamp":"2023-12-17T11:48:21.473989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T13:25:07.551873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-17T11:48:22.500677+0000","last_change":"2023-12-17T11:48:17.242548+0000","last_active":"2023-12-17T11:48:22.500677+0000","last_peered":"2023-12-17T11:48:22.500677+0000","last_clean":"2023-12-17T11:48:22.500677+0000","last_became_active":"2023-12-17T11:48:17.242261+0000","last_became_peered":"2023-12-17T11:48:17.242261+0000","last_unstale":"2023-12-17T11:48:22.500677+0000","last_undegraded":"2023-12-17T11:48:22.500677+0000","last_fullsized":"2023-12-17T11:48:22.500677+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:16.193911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:16.193911+0000","last_clean_scrub_stamp":"2023-12-17T11:48:16.193911+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T17:25:44.412598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-17T11:48:22.517637+0000","last_change":"2023-12-17T11:48:18.284502+0000","last_active":"2023-12-17T11:48:22.517637+0000","last_peered":"2023-12-17T11:48:22.517637+0000","last_clean":"2023-12-17T11:48:22.517637+0000","last_became_active":"2023-12-17T11:48:18.284224+0000","last_became_peered":"2023-12-17T11:48:18.284224+0000","last_unstale":"2023-12-17T11:48:22.517637+0000","last_undegraded":"2023-12-17T11:48:22.517637+0000","last_fullsized":"2023-12-17T11:48:22.517637+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_clean_scrub_stamp":"2023-12-17T11:48:17.199970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T16:14:48.723317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-17T11:48:23.467417+0000","last_change":"2023-12-17T11:48:22.534382+0000","last_active":"2023-12-17T11:48:23.467417+0000","last_peered":"2023-12-17T11:48:23.467417+0000","last_clean":"2023-12-17T11:48:23.467417+0000","last_became_active":"2023-12-17T11:48:22.533910+0000","last_became_peered":"2023-12-17T11:48:22.533910+0000","last_unstale":"2023-12-17T11:48:23.467417+0000","last_undegraded":"2023-12-17T11:48:23.467417+0000","last_fullsized":"2023-12-17T11:48:23.467417+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:21.473989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:21.473989+0000","last_clean_scrub_stamp":"2023-12-17T11:48:21.473989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T22:33:34.268975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-17T11:48:22.538051+0000","last_change":"2023-12-17T11:48:17.252782+0000","last_active":"2023-12-17T11:48:22.538051+0000","last_peered":"2023-12-17T11:48:22.538051+0000","last_clean":"2023-12-17T11:48:22.538051+0000","last_became_active":"2023-12-17T11:48:17.252501+0000","last_became_peered":"2023-12-17T11:48:17.252501+0000","last_unstale":"2023-12-17T11:48:22.538051+0000","last_undegraded":"2023-12-17T11:48:22.538051+0000","last_fullsized":"2023-12-17T11:48:22.538051+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:16.193911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:16.193911+0000","last_clean_scrub_stamp":"2023-12-17T11:48:16.193911+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T18:12:00.944371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-17T11:48:22.521803+0000","last_change":"2023-12-17T11:48:18.283410+0000","last_active":"2023-12-17T11:48:22.521803+0000","last_peered":"2023-12-17T11:48:22.521803+0000","last_clean":"2023-12-17T11:48:22.521803+0000","last_became_active":"2023-12-17T11:48:18.283129+0000","last_became_peered":"2023-12-17T11:48:18.283129+0000","last_unstale":"2023-12-17T11:48:22.521803+0000","last_undegraded":"2023-12-17T11:48:22.521803+0000","last_fullsized":"2023-12-17T11:48:22.521803+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_clean_scrub_stamp":"2023-12-17T11:48:17.199970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T13:18:38.029532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-17T11:48:23.468045+0000","last_change":"2023-12-17T11:48:22.532489+0000","last_active":"2023-12-17T11:48:23.468045+0000","last_peered":"2023-12-17T11:48:23.468045+0000","last_clean":"2023-12-17T11:48:23.468045+0000","last_became_active":"2023-12-17T11:48:22.531971+0000","last_became_peered":"2023-12-17T11:48:22.531971+0000","last_unstale":"2023-12-17T11:48:23.468045+0000","last_undegraded":"2023-12-17T11:48:23.468045+0000","last_fullsized":"2023-12-17T11:48:23.468045+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:21.473989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:21.473989+0000","last_clean_scrub_stamp":"2023-12-17T11:48:21.473989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T14:39:15.707189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-17T11:48:22.538470+0000","last_change":"2023-12-17T11:48:17.259412+0000","last_active":"2023-12-17T11:48:22.538470+0000","last_peered":"2023-12-17T11:48:22.538470+0000","last_clean":"2023-12-17T11:48:22.538470+0000","last_became_active":"2023-12-17T11:48:17.259092+0000","last_became_peered":"2023-12-17T11:48:17.259092+0000","last_unstale":"2023-12-17T11:48:22.538470+0000","last_undegraded":"2023-12-17T11:48:22.538470+0000","last_fullsized":"2023-12-17T11:48:22.538470+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:16.193911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:16.193911+0000","last_clean_scrub_stamp":"2023-12-17T11:48:16.193911+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T21:38:11.246682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-17T11:48:22.522929+0000","last_change":"2023-12-17T11:48:18.282884+0000","last_active":"2023-12-17T11:48:22.522929+0000","last_peered":"2023-12-17T11:48:22.522929+0000","last_clean":"2023-12-17T11:48:22.522929+0000","last_became_active":"2023-12-17T11:48:18.282589+0000","last_became_peered":"2023-12-17T11:48:18.282589+0000","last_unstale":"2023-12-17T11:48:22.522929+0000","last_undegraded":"2023-12-17T11:48:22.522929+0000","last_fullsized":"2023-12-17T11:48:22.522929+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_clean_scrub_stamp":"2023-12-17T11:48:17.199970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T14:46:31.139617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-17T11:48:23.468065+0000","last_change":"2023-12-17T11:48:22.524129+0000","last_active":"2023-12-17T11:48:23.468065+0000","last_peered":"2023-12-17T11:48:23.468065+0000","last_clean":"2023-12-17T11:48:23.468065+0000","last_became_active":"2023-12-17T11:48:22.523749+0000","last_became_peered":"2023-12-17T11:48:22.523749+0000","last_unstale":"2023-12-17T11:48:23.468065+0000","last_undegraded":"2023-12-17T11:48:23.468065+0000","last_fullsized":"2023-12-17T11:48:23.468065+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:21.473989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:21.473989+0000","last_clean_scrub_stamp":"2023-12-17T11:48:21.473989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T14:35:42.104042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-17T11:48:22.528476+0000","last_change":"2023-12-17T11:48:18.262498+0000","last_active":"2023-12-17T11:48:22.528476+0000","last_peered":"2023-12-17T11:48:22.528476+0000","last_clean":"2023-12-17T11:48:22.528476+0000","last_became_active":"2023-12-17T11:48:18.260747+0000","last_became_peered":"2023-12-17T11:48:18.260747+0000","last_unstale":"2023-12-17T11:48:22.528476+0000","last_undegraded":"2023-12-17T11:48:22.528476+0000","last_fullsized":"2023-12-17T11:48:22.528476+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_clean_scrub_stamp":"2023-12-17T11:48:17.199970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T19:01:46.435511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-17T11:48:22.538318+0000","last_change":"2023-12-17T11:48:17.254579+0000","last_active":"2023-12-17T11:48:22.538318+0000","last_peered":"2023-12-17T11:48:22.538318+0000","last_clean":"2023-12-17T11:48:22.538318+0000","last_became_active":"2023-12-17T11:48:17.254302+0000","last_became_peered":"2023-12-17T11:48:17.254302+0000","last_unstale":"2023-12-17T11:48:22.538318+0000","last_undegraded":"2023-12-17T11:48:22.538318+0000","last_fullsized":"2023-12-17T11:48:22.538318+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:16.193911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:16.193911+0000","last_clean_scrub_stamp":"2023-12-17T11:48:16.193911+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T22:46:18.442258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-17T11:48:23.469632+0000","last_change":"2023-12-17T11:48:22.541168+0000","last_active":"2023-12-17T11:48:23.469632+0000","last_peered":"2023-12-17T11:48:23.469632+0000","last_clean":"2023-12-17T11:48:23.469632+0000","last_became_active":"2023-12-17T11:48:22.539739+0000","last_became_peered":"2023-12-17T11:48:22.539739+0000","last_unstale":"2023-12-17T11:48:23.469632+0000","last_undegraded":"2023-12-17T11:48:23.469632+0000","last_fullsized":"2023-12-17T11:48:23.469632+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:21.473989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:21.473989+0000","last_clean_scrub_stamp":"2023-12-17T11:48:21.473989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T13:18:42.303550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-17T11:48:22.498917+0000","last_change":"2023-12-17T11:48:18.271462+0000","last_active":"2023-12-17T11:48:22.498917+0000","last_peered":"2023-12-17T11:48:22.498917+0000","last_clean":"2023-12-17T11:48:22.498917+0000","last_became_active":"2023-12-17T11:48:18.270639+0000","last_became_peered":"2023-12-17T11:48:18.270639+0000","last_unstale":"2023-12-17T11:48:22.498917+0000","last_undegraded":"2023-12-17T11:48:22.498917+0000","last_fullsized":"2023-12-17T11:48:22.498917+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_clean_scrub_stamp":"2023-12-17T11:48:17.199970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T16:14:48.723317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-17T11:48:22.528530+0000","last_change":"2023-12-17T11:48:17.243128+0000","last_active":"2023-12-17T11:48:22.528530+0000","last_peered":"2023-12-17T11:48:22.528530+0000","last_clean":"2023-12-17T11:48:22.528530+0000","last_became_active":"2023-12-17T11:48:17.242656+0000","last_became_peered":"2023-12-17T11:48:17.242656+0000","last_unstale":"2023-12-17T11:48:22.528530+0000","last_undegraded":"2023-12-17T11:48:22.528530+0000","last_fullsized":"2023-12-17T11:48:22.528530+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:16.193911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:16.193911+0000","last_clean_scrub_stamp":"2023-12-17T11:48:16.193911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T21:33:08.409177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-17T11:48:23.468866+0000","last_change":"2023-12-17T11:48:22.539973+0000","last_active":"2023-12-17T11:48:23.468866+0000","last_peered":"2023-12-17T11:48:23.468866+0000","last_clean":"2023-12-17T11:48:23.468866+0000","last_became_active":"2023-12-17T11:48:22.539592+0000","last_became_peered":"2023-12-17T11:48:22.539592+0000","last_unstale":"2023-12-17T11:48:23.468866+0000","last_undegraded":"2023-12-17T11:48:23.468866+0000","last_fullsized":"2023-12-17T11:48:23.468866+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:21.473989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:21.473989+0000","last_clean_scrub_stamp":"2023-12-17T11:48:21.473989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T19:19:54.372270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-17T11:48:22.498149+0000","last_change":"2023-12-17T11:48:18.272948+0000","last_active":"2023-12-17T11:48:22.498149+0000","last_peered":"2023-12-17T11:48:22.498149+0000","last_clean":"2023-12-17T11:48:22.498149+0000","last_became_active":"2023-12-17T11:48:18.272251+0000","last_became_peered":"2023-12-17T11:48:18.272251+0000","last_unstale":"2023-12-17T11:48:22.498149+0000","last_undegraded":"2023-12-17T11:48:22.498149+0000","last_fullsized":"2023-12-17T11:48:22.498149+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_clean_scrub_stamp":"2023-12-17T11:48:17.199970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T23:46:39.140775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-17T11:48:22.529348+0000","last_change":"2023-12-17T11:48:17.249233+0000","last_active":"2023-12-17T11:48:22.529348+0000","last_peered":"2023-12-17T11:48:22.529348+0000","last_clean":"2023-12-17T11:48:22.529348+0000","last_became_active":"2023-12-17T11:48:17.248693+0000","last_became_peered":"2023-12-17T11:48:17.248693+0000","last_unstale":"2023-12-17T11:48:22.529348+0000","last_undegraded":"2023-12-17T11:48:22.529348+0000","last_fullsized":"2023-12-17T11:48:22.529348+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:16.193911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:16.193911+0000","last_clean_scrub_stamp":"2023-12-17T11:48:16.193911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T15:52:21.914780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-17T11:48:24.569901+0000","last_change":"2023-12-17T11:48:22.546268+0000","last_active":"2023-12-17T11:48:24.569901+0000","last_peered":"2023-12-17T11:48:24.569901+0000","last_clean":"2023-12-17T11:48:24.569901+0000","last_became_active":"2023-12-17T11:48:22.545873+0000","last_became_peered":"2023-12-17T11:48:22.545873+0000","last_unstale":"2023-12-17T11:48:24.569901+0000","last_undegraded":"2023-12-17T11:48:24.569901+0000","last_fullsized":"2023-12-17T11:48:24.569901+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:21.473989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:21.473989+0000","last_clean_scrub_stamp":"2023-12-17T11:48:21.473989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T21:28:14.069617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-17T11:48:22.514153+0000","last_change":"2023-12-17T11:48:18.258783+0000","last_active":"2023-12-17T11:48:22.514153+0000","last_peered":"2023-12-17T11:48:22.514153+0000","last_clean":"2023-12-17T11:48:22.514153+0000","last_became_active":"2023-12-17T11:48:18.258068+0000","last_became_peered":"2023-12-17T11:48:18.258068+0000","last_unstale":"2023-12-17T11:48:22.514153+0000","last_undegraded":"2023-12-17T11:48:22.514153+0000","last_fullsized":"2023-12-17T11:48:22.514153+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_clean_scrub_stamp":"2023-12-17T11:48:17.199970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T15:07:39.743439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-17T11:48:22.537435+0000","last_change":"2023-12-17T11:48:17.253559+0000","last_active":"2023-12-17T11:48:22.537435+0000","last_peered":"2023-12-17T11:48:22.537435+0000","last_clean":"2023-12-17T11:48:22.537435+0000","last_became_active":"2023-12-17T11:48:17.253271+0000","last_became_peered":"2023-12-17T11:48:17.253271+0000","last_unstale":"2023-12-17T11:48:22.537435+0000","last_undegraded":"2023-12-17T11:48:22.537435+0000","last_fullsized":"2023-12-17T11:48:22.537435+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:16.193911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:16.193911+0000","last_clean_scrub_stamp":"2023-12-17T11:48:16.193911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T22:20:08.219855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-17T11:48:23.470614+0000","last_change":"2023-12-17T11:48:22.541511+0000","last_active":"2023-12-17T11:48:23.470614+0000","last_peered":"2023-12-17T11:48:23.470614+0000","last_clean":"2023-12-17T11:48:23.470614+0000","last_became_active":"2023-12-17T11:48:22.540975+0000","last_became_peered":"2023-12-17T11:48:22.540975+0000","last_unstale":"2023-12-17T11:48:23.470614+0000","last_undegraded":"2023-12-17T11:48:23.470614+0000","last_fullsized":"2023-12-17T11:48:23.470614+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:21.473989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:21.473989+0000","last_clean_scrub_stamp":"2023-12-17T11:48:21.473989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T14:46:35.413635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-17T11:48:22.517573+0000","last_change":"2023-12-17T11:48:18.270278+0000","last_active":"2023-12-17T11:48:22.517573+0000","last_peered":"2023-12-17T11:48:22.517573+0000","last_clean":"2023-12-17T11:48:22.517573+0000","last_became_active":"2023-12-17T11:48:18.269966+0000","last_became_peered":"2023-12-17T11:48:18.269966+0000","last_unstale":"2023-12-17T11:48:22.517573+0000","last_undegraded":"2023-12-17T11:48:22.517573+0000","last_fullsized":"2023-12-17T11:48:22.517573+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_clean_scrub_stamp":"2023-12-17T11:48:17.199970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T19:40:13.516541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-17T11:48:22.530568+0000","last_change":"2023-12-17T11:48:17.249856+0000","last_active":"2023-12-17T11:48:22.530568+0000","last_peered":"2023-12-17T11:48:22.530568+0000","last_clean":"2023-12-17T11:48:22.530568+0000","last_became_active":"2023-12-17T11:48:17.249564+0000","last_became_peered":"2023-12-17T11:48:17.249564+0000","last_unstale":"2023-12-17T11:48:22.530568+0000","last_undegraded":"2023-12-17T11:48:22.530568+0000","last_fullsized":"2023-12-17T11:48:22.530568+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:16.193911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:16.193911+0000","last_clean_scrub_stamp":"2023-12-17T11:48:16.193911+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T15:07:38.737379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-17T11:48:23.467555+0000","last_change":"2023-12-17T11:48:22.541474+0000","last_active":"2023-12-17T11:48:23.467555+0000","last_peered":"2023-12-17T11:48:23.467555+0000","last_clean":"2023-12-17T11:48:23.467555+0000","last_became_active":"2023-12-17T11:48:22.541092+0000","last_became_peered":"2023-12-17T11:48:22.541092+0000","last_unstale":"2023-12-17T11:48:23.467555+0000","last_undegraded":"2023-12-17T11:48:23.467555+0000","last_fullsized":"2023-12-17T11:48:23.467555+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:21.473989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:21.473989+0000","last_clean_scrub_stamp":"2023-12-17T11:48:21.473989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T20:54:02.500358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-17T11:48:22.502585+0000","last_change":"2023-12-17T11:48:18.270544+0000","last_active":"2023-12-17T11:48:22.502585+0000","last_peered":"2023-12-17T11:48:22.502585+0000","last_clean":"2023-12-17T11:48:22.502585+0000","last_became_active":"2023-12-17T11:48:18.270216+0000","last_became_peered":"2023-12-17T11:48:18.270216+0000","last_unstale":"2023-12-17T11:48:22.502585+0000","last_undegraded":"2023-12-17T11:48:22.502585+0000","last_fullsized":"2023-12-17T11:48:22.502585+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_clean_scrub_stamp":"2023-12-17T11:48:17.199970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T14:39:11.433170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"24'1","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-17T11:48:23.109451+0000","last_change":"2023-12-17T11:48:17.239499+0000","last_active":"2023-12-17T11:48:23.109451+0000","last_peered":"2023-12-17T11:48:23.109451+0000","last_clean":"2023-12-17T11:48:23.109451+0000","last_became_active":"2023-12-17T11:48:17.239256+0000","last_became_peered":"2023-12-17T11:48:17.239256+0000","last_unstale":"2023-12-17T11:48:23.109451+0000","last_undegraded":"2023-12-17T11:48:23.109451+0000","last_fullsized":"2023-12-17T11:48:23.109451+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:16.193911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:16.193911+0000","last_clean_scrub_stamp":"2023-12-17T11:48:16.193911+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T19:10:09.191716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-17T11:48:24.562916+0000","last_change":"2023-12-17T11:48:22.538930+0000","last_active":"2023-12-17T11:48:24.562916+0000","last_peered":"2023-12-17T11:48:24.562916+0000","last_clean":"2023-12-17T11:48:24.562916+0000","last_became_active":"2023-12-17T11:48:22.538189+0000","last_became_peered":"2023-12-17T11:48:22.538189+0000","last_unstale":"2023-12-17T11:48:24.562916+0000","last_undegraded":"2023-12-17T11:48:24.562916+0000","last_fullsized":"2023-12-17T11:48:24.562916+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:21.473989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:21.473989+0000","last_clean_scrub_stamp":"2023-12-17T11:48:21.473989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T15:43:12.098532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-17T11:48:22.529901+0000","last_change":"2023-12-17T11:48:18.266039+0000","last_active":"2023-12-17T11:48:22.529901+0000","last_peered":"2023-12-17T11:48:22.529901+0000","last_clean":"2023-12-17T11:48:22.529901+0000","last_became_active":"2023-12-17T11:48:18.264294+0000","last_became_peered":"2023-12-17T11:48:18.264294+0000","last_unstale":"2023-12-17T11:48:22.529901+0000","last_undegraded":"2023-12-17T11:48:22.529901+0000","last_fullsized":"2023-12-17T11:48:22.529901+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_clean_scrub_stamp":"2023-12-17T11:48:17.199970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T23:46:39.140775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-17T11:48:22.538134+0000","last_change":"2023-12-17T11:48:17.255352+0000","last_active":"2023-12-17T11:48:22.538134+0000","last_peered":"2023-12-17T11:48:22.538134+0000","last_clean":"2023-12-17T11:48:22.538134+0000","last_became_active":"2023-12-17T11:48:17.254987+0000","last_became_peered":"2023-12-17T11:48:17.254987+0000","last_unstale":"2023-12-17T11:48:22.538134+0000","last_undegraded":"2023-12-17T11:48:22.538134+0000","last_fullsized":"2023-12-17T11:48:22.538134+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:16.193911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:16.193911+0000","last_clean_scrub_stamp":"2023-12-17T11:48:16.193911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T13:39:47.600568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-17T11:48:24.565796+0000","last_change":"2023-12-17T11:48:22.541369+0000","last_active":"2023-12-17T11:48:24.565796+0000","last_peered":"2023-12-17T11:48:24.565796+0000","last_clean":"2023-12-17T11:48:24.565796+0000","last_became_active":"2023-12-17T11:48:22.540908+0000","last_became_peered":"2023-12-17T11:48:22.540908+0000","last_unstale":"2023-12-17T11:48:24.565796+0000","last_undegraded":"2023-12-17T11:48:24.565796+0000","last_fullsized":"2023-12-17T11:48:24.565796+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:21.473989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:21.473989+0000","last_clean_scrub_stamp":"2023-12-17T11:48:21.473989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T19:44:20.727021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-17T11:48:22.523020+0000","last_change":"2023-12-17T11:48:18.281474+0000","last_active":"2023-12-17T11:48:22.523020+0000","last_peered":"2023-12-17T11:48:22.523020+0000","last_clean":"2023-12-17T11:48:22.523020+0000","last_became_active":"2023-12-17T11:48:18.281189+0000","last_became_peered":"2023-12-17T11:48:18.281189+0000","last_unstale":"2023-12-17T11:48:22.523020+0000","last_undegraded":"2023-12-17T11:48:22.523020+0000","last_fullsized":"2023-12-17T11:48:22.523020+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_clean_scrub_stamp":"2023-12-17T11:48:17.199970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T19:37:12.473709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-17T11:48:22.530125+0000","last_change":"2023-12-17T11:48:17.240666+0000","last_active":"2023-12-17T11:48:22.530125+0000","last_peered":"2023-12-17T11:48:22.530125+0000","last_clean":"2023-12-17T11:48:22.530125+0000","last_became_active":"2023-12-17T11:48:17.239901+0000","last_became_peered":"2023-12-17T11:48:17.239901+0000","last_unstale":"2023-12-17T11:48:22.530125+0000","last_undegraded":"2023-12-17T11:48:22.530125+0000","last_fullsized":"2023-12-17T11:48:22.530125+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:16.193911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:16.193911+0000","last_clean_scrub_stamp":"2023-12-17T11:48:16.193911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T23:35:00.926850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-17T11:48:24.568012+0000","last_change":"2023-12-17T11:48:22.534424+0000","last_active":"2023-12-17T11:48:24.568012+0000","last_peered":"2023-12-17T11:48:24.568012+0000","last_clean":"2023-12-17T11:48:24.568012+0000","last_became_active":"2023-12-17T11:48:22.533095+0000","last_became_peered":"2023-12-17T11:48:22.533095+0000","last_unstale":"2023-12-17T11:48:24.568012+0000","last_undegraded":"2023-12-17T11:48:24.568012+0000","last_fullsized":"2023-12-17T11:48:24.568012+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:21.473989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:21.473989+0000","last_clean_scrub_stamp":"2023-12-17T11:48:21.473989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T19:19:54.372270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-17T11:48:22.513971+0000","last_change":"2023-12-17T11:48:18.271892+0000","last_active":"2023-12-17T11:48:22.513971+0000","last_peered":"2023-12-17T11:48:22.513971+0000","last_clean":"2023-12-17T11:48:22.513971+0000","last_became_active":"2023-12-17T11:48:18.269149+0000","last_became_peered":"2023-12-17T11:48:18.269149+0000","last_unstale":"2023-12-17T11:48:22.513971+0000","last_undegraded":"2023-12-17T11:48:22.513971+0000","last_fullsized":"2023-12-17T11:48:22.513971+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_clean_scrub_stamp":"2023-12-17T11:48:17.199970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T23:05:27.950618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-17T11:48:22.519931+0000","last_change":"2023-12-17T11:48:17.256166+0000","last_active":"2023-12-17T11:48:22.519931+0000","last_peered":"2023-12-17T11:48:22.519931+0000","last_clean":"2023-12-17T11:48:22.519931+0000","last_became_active":"2023-12-17T11:48:17.255858+0000","last_became_peered":"2023-12-17T11:48:17.255858+0000","last_unstale":"2023-12-17T11:48:22.519931+0000","last_undegraded":"2023-12-17T11:48:22.519931+0000","last_fullsized":"2023-12-17T11:48:22.519931+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:16.193911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:16.193911+0000","last_clean_scrub_stamp":"2023-12-17T11:48:16.193911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T19:40:12.510482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-17T11:48:24.569042+0000","last_change":"2023-12-17T11:48:22.537931+0000","last_active":"2023-12-17T11:48:24.569042+0000","last_peered":"2023-12-17T11:48:24.569042+0000","last_clean":"2023-12-17T11:48:24.569042+0000","last_became_active":"2023-12-17T11:48:22.537530+0000","last_became_peered":"2023-12-17T11:48:22.537530+0000","last_unstale":"2023-12-17T11:48:24.569042+0000","last_undegraded":"2023-12-17T11:48:24.569042+0000","last_fullsized":"2023-12-17T11:48:24.569042+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:21.473989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:21.473989+0000","last_clean_scrub_stamp":"2023-12-17T11:48:21.473989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T14:46:35.413635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-17T11:48:22.524745+0000","last_change":"2023-12-17T11:48:18.264485+0000","last_active":"2023-12-17T11:48:22.524745+0000","last_peered":"2023-12-17T11:48:22.524745+0000","last_clean":"2023-12-17T11:48:22.524745+0000","last_became_active":"2023-12-17T11:48:18.264150+0000","last_became_peered":"2023-12-17T11:48:18.264150+0000","last_unstale":"2023-12-17T11:48:22.524745+0000","last_undegraded":"2023-12-17T11:48:22.524745+0000","last_fullsized":"2023-12-17T11:48:22.524745+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_clean_scrub_stamp":"2023-12-17T11:48:17.199970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T12:59:53.414167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-17T11:48:22.505049+0000","last_change":"2023-12-17T11:48:17.234956+0000","last_active":"2023-12-17T11:48:22.505049+0000","last_peered":"2023-12-17T11:48:22.505049+0000","last_clean":"2023-12-17T11:48:22.505049+0000","last_became_active":"2023-12-17T11:48:17.234640+0000","last_became_peered":"2023-12-17T11:48:17.234640+0000","last_unstale":"2023-12-17T11:48:22.505049+0000","last_undegraded":"2023-12-17T11:48:22.505049+0000","last_fullsized":"2023-12-17T11:48:22.505049+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:16.193911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:16.193911+0000","last_clean_scrub_stamp":"2023-12-17T11:48:16.193911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T19:54:11.544716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-17T11:48:24.570107+0000","last_change":"2023-12-17T11:48:22.535731+0000","last_active":"2023-12-17T11:48:24.570107+0000","last_peered":"2023-12-17T11:48:24.570107+0000","last_clean":"2023-12-17T11:48:24.570107+0000","last_became_active":"2023-12-17T11:48:22.529961+0000","last_became_peered":"2023-12-17T11:48:22.529961+0000","last_unstale":"2023-12-17T11:48:24.570107+0000","last_undegraded":"2023-12-17T11:48:24.570107+0000","last_fullsized":"2023-12-17T11:48:24.570107+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:21.473989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:21.473989+0000","last_clean_scrub_stamp":"2023-12-17T11:48:21.473989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T19:37:16.747727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-17T11:48:22.518013+0000","last_change":"2023-12-17T11:48:18.266746+0000","last_active":"2023-12-17T11:48:22.518013+0000","last_peered":"2023-12-17T11:48:22.518013+0000","last_clean":"2023-12-17T11:48:22.518013+0000","last_became_active":"2023-12-17T11:48:18.266331+0000","last_became_peered":"2023-12-17T11:48:18.266331+0000","last_unstale":"2023-12-17T11:48:22.518013+0000","last_undegraded":"2023-12-17T11:48:22.518013+0000","last_fullsized":"2023-12-17T11:48:22.518013+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_clean_scrub_stamp":"2023-12-17T11:48:17.199970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T19:10:10.197776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-17T11:48:22.537457+0000","last_change":"2023-12-17T11:48:17.253489+0000","last_active":"2023-12-17T11:48:22.537457+0000","last_peered":"2023-12-17T11:48:22.537457+0000","last_clean":"2023-12-17T11:48:22.537457+0000","last_became_active":"2023-12-17T11:48:17.253243+0000","last_became_peered":"2023-12-17T11:48:17.253243+0000","last_unstale":"2023-12-17T11:48:22.537457+0000","last_undegraded":"2023-12-17T11:48:22.537457+0000","last_fullsized":"2023-12-17T11:48:22.537457+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:16.193911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:16.193911+0000","last_clean_scrub_stamp":"2023-12-17T11:48:16.193911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T22:05:53.158992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-17T11:48:24.564814+0000","last_change":"2023-12-17T11:48:22.543885+0000","last_active":"2023-12-17T11:48:24.564814+0000","last_peered":"2023-12-17T11:48:24.564814+0000","last_clean":"2023-12-17T11:48:24.564814+0000","last_became_active":"2023-12-17T11:48:22.543458+0000","last_became_peered":"2023-12-17T11:48:22.543458+0000","last_unstale":"2023-12-17T11:48:24.564814+0000","last_undegraded":"2023-12-17T11:48:24.564814+0000","last_fullsized":"2023-12-17T11:48:24.564814+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:21.473989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:21.473989+0000","last_clean_scrub_stamp":"2023-12-17T11:48:21.473989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T21:28:14.069617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-17T11:48:22.497613+0000","last_change":"2023-12-17T11:48:18.286605+0000","last_active":"2023-12-17T11:48:22.497613+0000","last_peered":"2023-12-17T11:48:22.497613+0000","last_clean":"2023-12-17T11:48:22.497613+0000","last_became_active":"2023-12-17T11:48:18.286391+0000","last_became_peered":"2023-12-17T11:48:18.286391+0000","last_unstale":"2023-12-17T11:48:22.497613+0000","last_undegraded":"2023-12-17T11:48:22.497613+0000","last_fullsized":"2023-12-17T11:48:22.497613+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_clean_scrub_stamp":"2023-12-17T11:48:17.199970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T19:40:13.516541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-17T11:48:22.522726+0000","last_change":"2023-12-17T11:48:17.250745+0000","last_active":"2023-12-17T11:48:22.522726+0000","last_peered":"2023-12-17T11:48:22.522726+0000","last_clean":"2023-12-17T11:48:22.522726+0000","last_became_active":"2023-12-17T11:48:17.250462+0000","last_became_peered":"2023-12-17T11:48:17.250462+0000","last_unstale":"2023-12-17T11:48:22.522726+0000","last_undegraded":"2023-12-17T11:48:22.522726+0000","last_fullsized":"2023-12-17T11:48:22.522726+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:16.193911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:16.193911+0000","last_clean_scrub_stamp":"2023-12-17T11:48:16.193911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T19:10:09.191716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":169,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-17T11:48:22.537554+0000","last_change":"2023-12-17T11:48:07.952584+0000","last_active":"2023-12-17T11:48:22.537554+0000","last_peered":"2023-12-17T11:48:22.537554+0000","last_clean":"2023-12-17T11:48:22.537554+0000","last_became_active":"2023-12-17T11:48:07.950361+0000","last_became_peered":"2023-12-17T11:48:07.950361+0000","last_unstale":"2023-12-17T11:48:22.537554+0000","last_undegraded":"2023-12-17T11:48:22.537554+0000","last_fullsized":"2023-12-17T11:48:22.537554+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:06.728199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:06.728199+0000","last_clean_scrub_stamp":"2023-12-17T11:48:06.728199+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T12:47:55.048065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-17T11:48:23.469722+0000","last_change":"2023-12-17T11:48:22.546171+0000","last_active":"2023-12-17T11:48:23.469722+0000","last_peered":"2023-12-17T11:48:23.469722+0000","last_clean":"2023-12-17T11:48:23.469722+0000","last_became_active":"2023-12-17T11:48:22.545741+0000","last_became_peered":"2023-12-17T11:48:22.545741+0000","last_unstale":"2023-12-17T11:48:23.469722+0000","last_undegraded":"2023-12-17T11:48:23.469722+0000","last_fullsized":"2023-12-17T11:48:23.469722+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:21.473989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:21.473989+0000","last_clean_scrub_stamp":"2023-12-17T11:48:21.473989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T14:13:28.976491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-17T11:48:22.537982+0000","last_change":"2023-12-17T11:48:18.295996+0000","last_active":"2023-12-17T11:48:22.537982+0000","last_peered":"2023-12-17T11:48:22.537982+0000","last_clean":"2023-12-17T11:48:22.537982+0000","last_became_active":"2023-12-17T11:48:18.295731+0000","last_became_peered":"2023-12-17T11:48:18.295731+0000","last_unstale":"2023-12-17T11:48:22.537982+0000","last_undegraded":"2023-12-17T11:48:22.537982+0000","last_fullsized":"2023-12-17T11:48:22.537982+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_clean_scrub_stamp":"2023-12-17T11:48:17.199970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T12:06:33.791186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-17T11:48:22.508663+0000","last_change":"2023-12-17T11:48:17.248889+0000","last_active":"2023-12-17T11:48:22.508663+0000","last_peered":"2023-12-17T11:48:22.508663+0000","last_clean":"2023-12-17T11:48:22.508663+0000","last_became_active":"2023-12-17T11:48:17.248340+0000","last_became_peered":"2023-12-17T11:48:17.248340+0000","last_unstale":"2023-12-17T11:48:22.508663+0000","last_undegraded":"2023-12-17T11:48:22.508663+0000","last_fullsized":"2023-12-17T11:48:22.508663+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:16.193911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:16.193911+0000","last_clean_scrub_stamp":"2023-12-17T11:48:16.193911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T15:52:21.914780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-17T11:48:23.468537+0000","last_change":"2023-12-17T11:48:22.550329+0000","last_active":"2023-12-17T11:48:23.468537+0000","last_peered":"2023-12-17T11:48:23.468537+0000","last_clean":"2023-12-17T11:48:23.468537+0000","last_became_active":"2023-12-17T11:48:22.549902+0000","last_became_peered":"2023-12-17T11:48:22.549902+0000","last_unstale":"2023-12-17T11:48:23.468537+0000","last_undegraded":"2023-12-17T11:48:23.468537+0000","last_fullsized":"2023-12-17T11:48:23.468537+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:21.473989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:21.473989+0000","last_clean_scrub_stamp":"2023-12-17T11:48:21.473989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T14:35:42.104042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-17T11:48:22.521889+0000","last_change":"2023-12-17T11:48:18.280528+0000","last_active":"2023-12-17T11:48:22.521889+0000","last_peered":"2023-12-17T11:48:22.521889+0000","last_clean":"2023-12-17T11:48:22.521889+0000","last_became_active":"2023-12-17T11:48:18.279633+0000","last_became_peered":"2023-12-17T11:48:18.279633+0000","last_unstale":"2023-12-17T11:48:22.521889+0000","last_undegraded":"2023-12-17T11:48:22.521889+0000","last_fullsized":"2023-12-17T11:48:22.521889+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_clean_scrub_stamp":"2023-12-17T11:48:17.199970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T21:28:09.795599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-17T11:48:22.532812+0000","last_change":"2023-12-17T11:48:17.247687+0000","last_active":"2023-12-17T11:48:22.532812+0000","last_peered":"2023-12-17T11:48:22.532812+0000","last_clean":"2023-12-17T11:48:22.532812+0000","last_became_active":"2023-12-17T11:48:17.247332+0000","last_became_peered":"2023-12-17T11:48:17.247332+0000","last_unstale":"2023-12-17T11:48:22.532812+0000","last_undegraded":"2023-12-17T11:48:22.532812+0000","last_fullsized":"2023-12-17T11:48:22.532812+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:16.193911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:16.193911+0000","last_clean_scrub_stamp":"2023-12-17T11:48:16.193911+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T14:38:16.218634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-17T11:48:24.566096+0000","last_change":"2023-12-17T11:48:22.529299+0000","last_active":"2023-12-17T11:48:24.566096+0000","last_peered":"2023-12-17T11:48:24.566096+0000","last_clean":"2023-12-17T11:48:24.566096+0000","last_became_active":"2023-12-17T11:48:22.528363+0000","last_became_peered":"2023-12-17T11:48:22.528363+0000","last_unstale":"2023-12-17T11:48:24.566096+0000","last_undegraded":"2023-12-17T11:48:24.566096+0000","last_fullsized":"2023-12-17T11:48:24.566096+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:21.473989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:21.473989+0000","last_clean_scrub_stamp":"2023-12-17T11:48:21.473989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T19:47:39.333206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-17T11:48:22.541528+0000","last_change":"2023-12-17T11:48:18.282746+0000","last_active":"2023-12-17T11:48:22.541528+0000","last_peered":"2023-12-17T11:48:22.541528+0000","last_clean":"2023-12-17T11:48:22.541528+0000","last_became_active":"2023-12-17T11:48:18.282435+0000","last_became_peered":"2023-12-17T11:48:18.282435+0000","last_unstale":"2023-12-17T11:48:22.541528+0000","last_undegraded":"2023-12-17T11:48:22.541528+0000","last_fullsized":"2023-12-17T11:48:22.541528+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_clean_scrub_stamp":"2023-12-17T11:48:17.199970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T17:07:27.804112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-17T11:48:22.504269+0000","last_change":"2023-12-17T11:48:17.236101+0000","last_active":"2023-12-17T11:48:22.504269+0000","last_peered":"2023-12-17T11:48:22.504269+0000","last_clean":"2023-12-17T11:48:22.504269+0000","last_became_active":"2023-12-17T11:48:17.235810+0000","last_became_peered":"2023-12-17T11:48:17.235810+0000","last_unstale":"2023-12-17T11:48:22.504269+0000","last_undegraded":"2023-12-17T11:48:22.504269+0000","last_fullsized":"2023-12-17T11:48:22.504269+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:16.193911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:16.193911+0000","last_clean_scrub_stamp":"2023-12-17T11:48:16.193911+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T17:25:44.412598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-17T11:48:24.533865+0000","last_change":"2023-12-17T11:48:22.543015+0000","last_active":"2023-12-17T11:48:24.533865+0000","last_peered":"2023-12-17T11:48:24.533865+0000","last_clean":"2023-12-17T11:48:24.533865+0000","last_became_active":"2023-12-17T11:48:22.542625+0000","last_became_peered":"2023-12-17T11:48:22.542625+0000","last_unstale":"2023-12-17T11:48:24.533865+0000","last_undegraded":"2023-12-17T11:48:24.533865+0000","last_fullsized":"2023-12-17T11:48:24.533865+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:21.473989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:21.473989+0000","last_clean_scrub_stamp":"2023-12-17T11:48:21.473989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T19:02:34.642001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-17T11:48:22.538912+0000","last_change":"2023-12-17T11:48:18.286716+0000","last_active":"2023-12-17T11:48:22.538912+0000","last_peered":"2023-12-17T11:48:22.538912+0000","last_clean":"2023-12-17T11:48:22.538912+0000","last_became_active":"2023-12-17T11:48:18.286399+0000","last_became_peered":"2023-12-17T11:48:18.286399+0000","last_unstale":"2023-12-17T11:48:22.538912+0000","last_undegraded":"2023-12-17T11:48:22.538912+0000","last_fullsized":"2023-12-17T11:48:22.538912+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_clean_scrub_stamp":"2023-12-17T11:48:17.199970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T15:49:17.071958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-17T11:48:22.518272+0000","last_change":"2023-12-17T11:48:17.241745+0000","last_active":"2023-12-17T11:48:22.518272+0000","last_peered":"2023-12-17T11:48:22.518272+0000","last_clean":"2023-12-17T11:48:22.518272+0000","last_became_active":"2023-12-17T11:48:17.241424+0000","last_became_peered":"2023-12-17T11:48:17.241424+0000","last_unstale":"2023-12-17T11:48:22.518272+0000","last_undegraded":"2023-12-17T11:48:22.518272+0000","last_fullsized":"2023-12-17T11:48:22.518272+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:16.193911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:16.193911+0000","last_clean_scrub_stamp":"2023-12-17T11:48:16.193911+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T22:07:41.457520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-17T11:48:23.467268+0000","last_change":"2023-12-17T11:48:22.532344+0000","last_active":"2023-12-17T11:48:23.467268+0000","last_peered":"2023-12-17T11:48:23.467268+0000","last_clean":"2023-12-17T11:48:23.467268+0000","last_became_active":"2023-12-17T11:48:22.531938+0000","last_became_peered":"2023-12-17T11:48:22.531938+0000","last_unstale":"2023-12-17T11:48:23.467268+0000","last_undegraded":"2023-12-17T11:48:23.467268+0000","last_fullsized":"2023-12-17T11:48:23.467268+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:21.473989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:21.473989+0000","last_clean_scrub_stamp":"2023-12-17T11:48:21.473989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T16:14:52.997336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-17T11:48:22.537682+0000","last_change":"2023-12-17T11:48:18.283595+0000","last_active":"2023-12-17T11:48:22.537682+0000","last_peered":"2023-12-17T11:48:22.537682+0000","last_clean":"2023-12-17T11:48:22.537682+0000","last_became_active":"2023-12-17T11:48:18.283279+0000","last_became_peered":"2023-12-17T11:48:18.283279+0000","last_unstale":"2023-12-17T11:48:22.537682+0000","last_undegraded":"2023-12-17T11:48:22.537682+0000","last_fullsized":"2023-12-17T11:48:22.537682+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_clean_scrub_stamp":"2023-12-17T11:48:17.199970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T15:36:16.504476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-17T11:48:22.505421+0000","last_change":"2023-12-17T11:48:17.240169+0000","last_active":"2023-12-17T11:48:22.505421+0000","last_peered":"2023-12-17T11:48:22.505421+0000","last_clean":"2023-12-17T11:48:22.505421+0000","last_became_active":"2023-12-17T11:48:17.239871+0000","last_became_peered":"2023-12-17T11:48:17.239871+0000","last_unstale":"2023-12-17T11:48:22.505421+0000","last_undegraded":"2023-12-17T11:48:22.505421+0000","last_fullsized":"2023-12-17T11:48:22.505421+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:16.193911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:16.193911+0000","last_clean_scrub_stamp":"2023-12-17T11:48:16.193911+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T22:07:41.457520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-17T11:48:24.564852+0000","last_change":"2023-12-17T11:48:22.525953+0000","last_active":"2023-12-17T11:48:24.564852+0000","last_peered":"2023-12-17T11:48:24.564852+0000","last_clean":"2023-12-17T11:48:24.564852+0000","last_became_active":"2023-12-17T11:48:22.525562+0000","last_became_peered":"2023-12-17T11:48:22.525562+0000","last_unstale":"2023-12-17T11:48:24.564852+0000","last_undegraded":"2023-12-17T11:48:24.564852+0000","last_fullsized":"2023-12-17T11:48:24.564852+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:21.473989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:21.473989+0000","last_clean_scrub_stamp":"2023-12-17T11:48:21.473989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T19:37:16.747727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-17T11:48:22.528552+0000","last_change":"2023-12-17T11:48:18.266704+0000","last_active":"2023-12-17T11:48:22.528552+0000","last_peered":"2023-12-17T11:48:22.528552+0000","last_clean":"2023-12-17T11:48:22.528552+0000","last_became_active":"2023-12-17T11:48:18.266160+0000","last_became_peered":"2023-12-17T11:48:18.266160+0000","last_unstale":"2023-12-17T11:48:22.528552+0000","last_undegraded":"2023-12-17T11:48:22.528552+0000","last_fullsized":"2023-12-17T11:48:22.528552+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_clean_scrub_stamp":"2023-12-17T11:48:17.199970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T12:09:17.721558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-17T11:48:22.529180+0000","last_change":"2023-12-17T11:48:17.246492+0000","last_active":"2023-12-17T11:48:22.529180+0000","last_peered":"2023-12-17T11:48:22.529180+0000","last_clean":"2023-12-17T11:48:22.529180+0000","last_became_active":"2023-12-17T11:48:17.243482+0000","last_became_peered":"2023-12-17T11:48:17.243482+0000","last_unstale":"2023-12-17T11:48:22.529180+0000","last_undegraded":"2023-12-17T11:48:22.529180+0000","last_fullsized":"2023-12-17T11:48:22.529180+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:16.193911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:16.193911+0000","last_clean_scrub_stamp":"2023-12-17T11:48:16.193911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T23:35:00.926850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-17T11:48:24.566395+0000","last_change":"2023-12-17T11:48:22.533474+0000","last_active":"2023-12-17T11:48:24.566395+0000","last_peered":"2023-12-17T11:48:24.566395+0000","last_clean":"2023-12-17T11:48:24.566395+0000","last_became_active":"2023-12-17T11:48:22.533035+0000","last_became_peered":"2023-12-17T11:48:22.533035+0000","last_unstale":"2023-12-17T11:48:24.566395+0000","last_undegraded":"2023-12-17T11:48:24.566395+0000","last_fullsized":"2023-12-17T11:48:24.566395+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:21.473989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:21.473989+0000","last_clean_scrub_stamp":"2023-12-17T11:48:21.473989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T19:55:52.117357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-17T11:48:22.538223+0000","last_change":"2023-12-17T11:48:18.282530+0000","last_active":"2023-12-17T11:48:22.538223+0000","last_peered":"2023-12-17T11:48:22.538223+0000","last_clean":"2023-12-17T11:48:22.538223+0000","last_became_active":"2023-12-17T11:48:18.282201+0000","last_became_peered":"2023-12-17T11:48:18.282201+0000","last_unstale":"2023-12-17T11:48:22.538223+0000","last_undegraded":"2023-12-17T11:48:22.538223+0000","last_fullsized":"2023-12-17T11:48:22.538223+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_clean_scrub_stamp":"2023-12-17T11:48:17.199970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T13:22:09.491732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-17T11:48:22.519788+0000","last_change":"2023-12-17T11:48:17.255597+0000","last_active":"2023-12-17T11:48:22.519788+0000","last_peered":"2023-12-17T11:48:22.519788+0000","last_clean":"2023-12-17T11:48:22.519788+0000","last_became_active":"2023-12-17T11:48:17.255278+0000","last_became_peered":"2023-12-17T11:48:17.255278+0000","last_unstale":"2023-12-17T11:48:22.519788+0000","last_undegraded":"2023-12-17T11:48:22.519788+0000","last_fullsized":"2023-12-17T11:48:22.519788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:16.193911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:16.193911+0000","last_clean_scrub_stamp":"2023-12-17T11:48:16.193911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T19:01:45.429452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-17T11:48:24.565975+0000","last_change":"2023-12-17T11:48:22.547206+0000","last_active":"2023-12-17T11:48:24.565975+0000","last_peered":"2023-12-17T11:48:24.565975+0000","last_clean":"2023-12-17T11:48:24.565975+0000","last_became_active":"2023-12-17T11:48:22.539605+0000","last_became_peered":"2023-12-17T11:48:22.539605+0000","last_unstale":"2023-12-17T11:48:24.565975+0000","last_undegraded":"2023-12-17T11:48:24.565975+0000","last_fullsized":"2023-12-17T11:48:24.565975+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:21.473989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:21.473989+0000","last_clean_scrub_stamp":"2023-12-17T11:48:21.473989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T16:15:07.576617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-17T11:48:22.509553+0000","last_change":"2023-12-17T11:48:18.266780+0000","last_active":"2023-12-17T11:48:22.509553+0000","last_peered":"2023-12-17T11:48:22.509553+0000","last_clean":"2023-12-17T11:48:22.509553+0000","last_became_active":"2023-12-17T11:48:18.266437+0000","last_became_peered":"2023-12-17T11:48:18.266437+0000","last_unstale":"2023-12-17T11:48:22.509553+0000","last_undegraded":"2023-12-17T11:48:22.509553+0000","last_fullsized":"2023-12-17T11:48:22.509553+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_clean_scrub_stamp":"2023-12-17T11:48:17.199970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T15:10:04.983689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-17T11:48:22.517086+0000","last_change":"2023-12-17T11:48:17.237336+0000","last_active":"2023-12-17T11:48:22.517086+0000","last_peered":"2023-12-17T11:48:22.517086+0000","last_clean":"2023-12-17T11:48:22.517086+0000","last_became_active":"2023-12-17T11:48:17.237079+0000","last_became_peered":"2023-12-17T11:48:17.237079+0000","last_unstale":"2023-12-17T11:48:22.517086+0000","last_undegraded":"2023-12-17T11:48:22.517086+0000","last_fullsized":"2023-12-17T11:48:22.517086+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:16.193911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:16.193911+0000","last_clean_scrub_stamp":"2023-12-17T11:48:16.193911+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T23:05:26.944558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-17T11:48:24.534842+0000","last_change":"2023-12-17T11:48:22.531210+0000","last_active":"2023-12-17T11:48:24.534842+0000","last_peered":"2023-12-17T11:48:24.534842+0000","last_clean":"2023-12-17T11:48:24.534842+0000","last_became_active":"2023-12-17T11:48:22.530786+0000","last_became_peered":"2023-12-17T11:48:22.530786+0000","last_unstale":"2023-12-17T11:48:24.534842+0000","last_undegraded":"2023-12-17T11:48:24.534842+0000","last_fullsized":"2023-12-17T11:48:24.534842+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:21.473989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:21.473989+0000","last_clean_scrub_stamp":"2023-12-17T11:48:21.473989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T23:05:37.198518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-17T11:48:22.537940+0000","last_change":"2023-12-17T11:48:18.271847+0000","last_active":"2023-12-17T11:48:22.537940+0000","last_peered":"2023-12-17T11:48:22.537940+0000","last_clean":"2023-12-17T11:48:22.537940+0000","last_became_active":"2023-12-17T11:48:18.271609+0000","last_became_peered":"2023-12-17T11:48:18.271609+0000","last_unstale":"2023-12-17T11:48:22.537940+0000","last_undegraded":"2023-12-17T11:48:22.537940+0000","last_fullsized":"2023-12-17T11:48:22.537940+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_clean_scrub_stamp":"2023-12-17T11:48:17.199970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T14:01:37.582731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"25'8","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-17T11:48:29.854575+0000","last_change":"2023-12-17T11:48:17.241228+0000","last_active":"2023-12-17T11:48:29.854575+0000","last_peered":"2023-12-17T11:48:29.854575+0000","last_clean":"2023-12-17T11:48:29.854575+0000","last_became_active":"2023-12-17T11:48:17.240813+0000","last_became_peered":"2023-12-17T11:48:17.240813+0000","last_unstale":"2023-12-17T11:48:29.854575+0000","last_undegraded":"2023-12-17T11:48:29.854575+0000","last_fullsized":"2023-12-17T11:48:29.854575+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:16.193911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:16.193911+0000","last_clean_scrub_stamp":"2023-12-17T11:48:16.193911+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T21:33:08.409177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3699,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-17T11:48:24.568565+0000","last_change":"2023-12-17T11:48:22.541559+0000","last_active":"2023-12-17T11:48:24.568565+0000","last_peered":"2023-12-17T11:48:24.568565+0000","last_clean":"2023-12-17T11:48:24.568565+0000","last_became_active":"2023-12-17T11:48:22.537020+0000","last_became_peered":"2023-12-17T11:48:22.537020+0000","last_unstale":"2023-12-17T11:48:24.568565+0000","last_undegraded":"2023-12-17T11:48:24.568565+0000","last_fullsized":"2023-12-17T11:48:24.568565+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:21.473989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:21.473989+0000","last_clean_scrub_stamp":"2023-12-17T11:48:21.473989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T13:18:42.303550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-17T11:48:22.519017+0000","last_change":"2023-12-17T11:48:18.275481+0000","last_active":"2023-12-17T11:48:22.519017+0000","last_peered":"2023-12-17T11:48:22.519017+0000","last_clean":"2023-12-17T11:48:22.519017+0000","last_became_active":"2023-12-17T11:48:18.273155+0000","last_became_peered":"2023-12-17T11:48:18.273155+0000","last_unstale":"2023-12-17T11:48:22.519017+0000","last_undegraded":"2023-12-17T11:48:22.519017+0000","last_fullsized":"2023-12-17T11:48:22.519017+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_clean_scrub_stamp":"2023-12-17T11:48:17.199970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T12:41:34.675326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-17T11:48:22.530443+0000","last_change":"2023-12-17T11:48:17.255083+0000","last_active":"2023-12-17T11:48:22.530443+0000","last_peered":"2023-12-17T11:48:22.530443+0000","last_clean":"2023-12-17T11:48:22.530443+0000","last_became_active":"2023-12-17T11:48:17.254631+0000","last_became_peered":"2023-12-17T11:48:17.254631+0000","last_unstale":"2023-12-17T11:48:22.530443+0000","last_undegraded":"2023-12-17T11:48:22.530443+0000","last_fullsized":"2023-12-17T11:48:22.530443+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:16.193911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:16.193911+0000","last_clean_scrub_stamp":"2023-12-17T11:48:16.193911+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T23:05:26.944558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-17T11:48:23.468594+0000","last_change":"2023-12-17T11:48:22.532773+0000","last_active":"2023-12-17T11:48:23.468594+0000","last_peered":"2023-12-17T11:48:23.468594+0000","last_clean":"2023-12-17T11:48:23.468594+0000","last_became_active":"2023-12-17T11:48:22.531998+0000","last_became_peered":"2023-12-17T11:48:22.531998+0000","last_unstale":"2023-12-17T11:48:23.468594+0000","last_undegraded":"2023-12-17T11:48:23.468594+0000","last_fullsized":"2023-12-17T11:48:23.468594+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:21.473989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:21.473989+0000","last_clean_scrub_stamp":"2023-12-17T11:48:21.473989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T14:13:28.976491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-17T11:48:22.517736+0000","last_change":"2023-12-17T11:48:18.283970+0000","last_active":"2023-12-17T11:48:22.517736+0000","last_peered":"2023-12-17T11:48:22.517736+0000","last_clean":"2023-12-17T11:48:22.517736+0000","last_became_active":"2023-12-17T11:48:18.282081+0000","last_became_peered":"2023-12-17T11:48:18.282081+0000","last_unstale":"2023-12-17T11:48:22.517736+0000","last_undegraded":"2023-12-17T11:48:22.517736+0000","last_fullsized":"2023-12-17T11:48:22.517736+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_clean_scrub_stamp":"2023-12-17T11:48:17.199970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T22:33:29.994957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-17T11:48:22.524090+0000","last_change":"2023-12-17T11:48:17.251813+0000","last_active":"2023-12-17T11:48:22.524090+0000","last_peered":"2023-12-17T11:48:22.524090+0000","last_clean":"2023-12-17T11:48:22.524090+0000","last_became_active":"2023-12-17T11:48:17.251383+0000","last_became_peered":"2023-12-17T11:48:17.251383+0000","last_unstale":"2023-12-17T11:48:22.524090+0000","last_undegraded":"2023-12-17T11:48:22.524090+0000","last_fullsized":"2023-12-17T11:48:22.524090+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:16.193911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:16.193911+0000","last_clean_scrub_stamp":"2023-12-17T11:48:16.193911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T20:47:09.518146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-17T11:48:24.563175+0000","last_change":"2023-12-17T11:48:22.532023+0000","last_active":"2023-12-17T11:48:24.563175+0000","last_peered":"2023-12-17T11:48:24.563175+0000","last_clean":"2023-12-17T11:48:24.563175+0000","last_became_active":"2023-12-17T11:48:22.531600+0000","last_became_peered":"2023-12-17T11:48:22.531600+0000","last_unstale":"2023-12-17T11:48:24.563175+0000","last_undegraded":"2023-12-17T11:48:24.563175+0000","last_fullsized":"2023-12-17T11:48:24.563175+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:21.473989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:21.473989+0000","last_clean_scrub_stamp":"2023-12-17T11:48:21.473989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T11:48:26.447870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-17T11:48:22.524000+0000","last_change":"2023-12-17T11:48:18.284906+0000","last_active":"2023-12-17T11:48:22.524000+0000","last_peered":"2023-12-17T11:48:22.524000+0000","last_clean":"2023-12-17T11:48:22.524000+0000","last_became_active":"2023-12-17T11:48:18.280252+0000","last_became_peered":"2023-12-17T11:48:18.280252+0000","last_unstale":"2023-12-17T11:48:22.524000+0000","last_undegraded":"2023-12-17T11:48:22.524000+0000","last_fullsized":"2023-12-17T11:48:22.524000+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_clean_scrub_stamp":"2023-12-17T11:48:17.199970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T14:35:37.830024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-17T11:48:22.531506+0000","last_change":"2023-12-17T11:48:17.256841+0000","last_active":"2023-12-17T11:48:22.531506+0000","last_peered":"2023-12-17T11:48:22.531506+0000","last_clean":"2023-12-17T11:48:22.531506+0000","last_became_active":"2023-12-17T11:48:17.256528+0000","last_became_peered":"2023-12-17T11:48:17.256528+0000","last_unstale":"2023-12-17T11:48:22.531506+0000","last_undegraded":"2023-12-17T11:48:22.531506+0000","last_fullsized":"2023-12-17T11:48:22.531506+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:16.193911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:16.193911+0000","last_clean_scrub_stamp":"2023-12-17T11:48:16.193911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T23:05:26.944558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-17T11:48:24.564180+0000","last_change":"2023-12-17T11:48:22.536175+0000","last_active":"2023-12-17T11:48:24.564180+0000","last_peered":"2023-12-17T11:48:24.564180+0000","last_clean":"2023-12-17T11:48:24.564180+0000","last_became_active":"2023-12-17T11:48:22.535544+0000","last_became_peered":"2023-12-17T11:48:22.535544+0000","last_unstale":"2023-12-17T11:48:24.564180+0000","last_undegraded":"2023-12-17T11:48:24.564180+0000","last_fullsized":"2023-12-17T11:48:24.564180+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:21.473989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:21.473989+0000","last_clean_scrub_stamp":"2023-12-17T11:48:21.473989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T19:02:34.642001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-17T11:48:24.564459+0000","last_change":"2023-12-17T11:48:22.543719+0000","last_active":"2023-12-17T11:48:24.564459+0000","last_peered":"2023-12-17T11:48:24.564459+0000","last_clean":"2023-12-17T11:48:24.564459+0000","last_became_active":"2023-12-17T11:48:22.543315+0000","last_became_peered":"2023-12-17T11:48:22.543315+0000","last_unstale":"2023-12-17T11:48:24.564459+0000","last_undegraded":"2023-12-17T11:48:24.564459+0000","last_fullsized":"2023-12-17T11:48:24.564459+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:21.473989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:21.473989+0000","last_clean_scrub_stamp":"2023-12-17T11:48:21.473989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T14:46:35.413635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-17T11:48:22.525084+0000","last_change":"2023-12-17T11:48:18.273197+0000","last_active":"2023-12-17T11:48:22.525084+0000","last_peered":"2023-12-17T11:48:22.525084+0000","last_clean":"2023-12-17T11:48:22.525084+0000","last_became_active":"2023-12-17T11:48:18.272904+0000","last_became_peered":"2023-12-17T11:48:18.272904+0000","last_unstale":"2023-12-17T11:48:22.525084+0000","last_undegraded":"2023-12-17T11:48:22.525084+0000","last_fullsized":"2023-12-17T11:48:22.525084+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_clean_scrub_stamp":"2023-12-17T11:48:17.199970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T19:01:46.435511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-17T11:48:22.515616+0000","last_change":"2023-12-17T11:48:17.254838+0000","last_active":"2023-12-17T11:48:22.515616+0000","last_peered":"2023-12-17T11:48:22.515616+0000","last_clean":"2023-12-17T11:48:22.515616+0000","last_became_active":"2023-12-17T11:48:17.254549+0000","last_became_peered":"2023-12-17T11:48:17.254549+0000","last_unstale":"2023-12-17T11:48:22.515616+0000","last_undegraded":"2023-12-17T11:48:22.515616+0000","last_fullsized":"2023-12-17T11:48:22.515616+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:16.193911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:16.193911+0000","last_clean_scrub_stamp":"2023-12-17T11:48:16.193911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T15:10:03.977630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-17T11:48:23.467487+0000","last_change":"2023-12-17T11:48:22.544106+0000","last_active":"2023-12-17T11:48:23.467487+0000","last_peered":"2023-12-17T11:48:23.467487+0000","last_clean":"2023-12-17T11:48:23.467487+0000","last_became_active":"2023-12-17T11:48:22.543121+0000","last_became_peered":"2023-12-17T11:48:22.543121+0000","last_unstale":"2023-12-17T11:48:23.467487+0000","last_undegraded":"2023-12-17T11:48:23.467487+0000","last_fullsized":"2023-12-17T11:48:23.467487+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:21.473989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:21.473989+0000","last_clean_scrub_stamp":"2023-12-17T11:48:21.473989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T14:39:15.707189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-17T11:48:22.498074+0000","last_change":"2023-12-17T11:48:18.273173+0000","last_active":"2023-12-17T11:48:22.498074+0000","last_peered":"2023-12-17T11:48:22.498074+0000","last_clean":"2023-12-17T11:48:22.498074+0000","last_became_active":"2023-12-17T11:48:18.272646+0000","last_became_peered":"2023-12-17T11:48:18.272646+0000","last_unstale":"2023-12-17T11:48:22.498074+0000","last_undegraded":"2023-12-17T11:48:22.498074+0000","last_fullsized":"2023-12-17T11:48:22.498074+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_clean_scrub_stamp":"2023-12-17T11:48:17.199970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T12:59:53.414167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-17T11:48:22.498535+0000","last_change":"2023-12-17T11:48:17.242171+0000","last_active":"2023-12-17T11:48:22.498535+0000","last_peered":"2023-12-17T11:48:22.498535+0000","last_clean":"2023-12-17T11:48:22.498535+0000","last_became_active":"2023-12-17T11:48:17.241764+0000","last_became_peered":"2023-12-17T11:48:17.241764+0000","last_unstale":"2023-12-17T11:48:22.498535+0000","last_undegraded":"2023-12-17T11:48:22.498535+0000","last_fullsized":"2023-12-17T11:48:22.498535+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:16.193911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:16.193911+0000","last_clean_scrub_stamp":"2023-12-17T11:48:16.193911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T14:38:16.218634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-17T11:48:22.528584+0000","last_change":"2023-12-17T11:48:17.242535+0000","last_active":"2023-12-17T11:48:22.528584+0000","last_peered":"2023-12-17T11:48:22.528584+0000","last_clean":"2023-12-17T11:48:22.528584+0000","last_became_active":"2023-12-17T11:48:17.242250+0000","last_became_peered":"2023-12-17T11:48:17.242250+0000","last_unstale":"2023-12-17T11:48:22.528584+0000","last_undegraded":"2023-12-17T11:48:22.528584+0000","last_fullsized":"2023-12-17T11:48:22.528584+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:16.193911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:16.193911+0000","last_clean_scrub_stamp":"2023-12-17T11:48:16.193911+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T15:52:21.914780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-17T11:48:22.513125+0000","last_change":"2023-12-17T11:48:18.264311+0000","last_active":"2023-12-17T11:48:22.513125+0000","last_peered":"2023-12-17T11:48:22.513125+0000","last_clean":"2023-12-17T11:48:22.513125+0000","last_became_active":"2023-12-17T11:48:18.263005+0000","last_became_peered":"2023-12-17T11:48:18.263005+0000","last_unstale":"2023-12-17T11:48:22.513125+0000","last_undegraded":"2023-12-17T11:48:22.513125+0000","last_fullsized":"2023-12-17T11:48:22.513125+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_clean_scrub_stamp":"2023-12-17T11:48:17.199970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T20:47:10.524205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-17T11:48:23.465100+0000","last_change":"2023-12-17T11:48:22.536488+0000","last_active":"2023-12-17T11:48:23.465100+0000","last_peered":"2023-12-17T11:48:23.465100+0000","last_clean":"2023-12-17T11:48:23.465100+0000","last_became_active":"2023-12-17T11:48:22.536091+0000","last_became_peered":"2023-12-17T11:48:22.536091+0000","last_unstale":"2023-12-17T11:48:23.465100+0000","last_undegraded":"2023-12-17T11:48:23.465100+0000","last_fullsized":"2023-12-17T11:48:23.465100+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:21.473989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:21.473989+0000","last_clean_scrub_stamp":"2023-12-17T11:48:21.473989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T19:10:14.471794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-17T11:48:22.499106+0000","last_change":"2023-12-17T11:48:17.241269+0000","last_active":"2023-12-17T11:48:22.499106+0000","last_peered":"2023-12-17T11:48:22.499106+0000","last_clean":"2023-12-17T11:48:22.499106+0000","last_became_active":"2023-12-17T11:48:17.240984+0000","last_became_peered":"2023-12-17T11:48:17.240984+0000","last_unstale":"2023-12-17T11:48:22.499106+0000","last_undegraded":"2023-12-17T11:48:22.499106+0000","last_fullsized":"2023-12-17T11:48:22.499106+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:16.193911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:16.193911+0000","last_clean_scrub_stamp":"2023-12-17T11:48:16.193911+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T21:33:08.409177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-17T11:48:22.514122+0000","last_change":"2023-12-17T11:48:18.269242+0000","last_active":"2023-12-17T11:48:22.514122+0000","last_peered":"2023-12-17T11:48:22.514122+0000","last_clean":"2023-12-17T11:48:22.514122+0000","last_became_active":"2023-12-17T11:48:18.262805+0000","last_became_peered":"2023-12-17T11:48:18.262805+0000","last_unstale":"2023-12-17T11:48:22.514122+0000","last_undegraded":"2023-12-17T11:48:22.514122+0000","last_fullsized":"2023-12-17T11:48:22.514122+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_clean_scrub_stamp":"2023-12-17T11:48:17.199970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T17:25:45.418657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-17T11:48:24.565907+0000","last_change":"2023-12-17T11:48:22.528378+0000","last_active":"2023-12-17T11:48:24.565907+0000","last_peered":"2023-12-17T11:48:24.565907+0000","last_clean":"2023-12-17T11:48:24.565907+0000","last_became_active":"2023-12-17T11:48:22.527917+0000","last_became_peered":"2023-12-17T11:48:22.527917+0000","last_unstale":"2023-12-17T11:48:24.565907+0000","last_undegraded":"2023-12-17T11:48:24.565907+0000","last_fullsized":"2023-12-17T11:48:24.565907+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:21.473989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:21.473989+0000","last_clean_scrub_stamp":"2023-12-17T11:48:21.473989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T23:05:37.198518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-17T11:48:22.528435+0000","last_change":"2023-12-17T11:48:18.266478+0000","last_active":"2023-12-17T11:48:22.528435+0000","last_peered":"2023-12-17T11:48:22.528435+0000","last_clean":"2023-12-17T11:48:22.528435+0000","last_became_active":"2023-12-17T11:48:18.265774+0000","last_became_peered":"2023-12-17T11:48:18.265774+0000","last_unstale":"2023-12-17T11:48:22.528435+0000","last_undegraded":"2023-12-17T11:48:22.528435+0000","last_fullsized":"2023-12-17T11:48:22.528435+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_clean_scrub_stamp":"2023-12-17T11:48:17.199970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T15:10:04.983689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-17T11:48:22.504939+0000","last_change":"2023-12-17T11:48:18.282141+0000","last_active":"2023-12-17T11:48:22.504939+0000","last_peered":"2023-12-17T11:48:22.504939+0000","last_clean":"2023-12-17T11:48:22.504939+0000","last_became_active":"2023-12-17T11:48:18.281103+0000","last_became_peered":"2023-12-17T11:48:18.281103+0000","last_unstale":"2023-12-17T11:48:22.504939+0000","last_undegraded":"2023-12-17T11:48:22.504939+0000","last_fullsized":"2023-12-17T11:48:22.504939+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_clean_scrub_stamp":"2023-12-17T11:48:17.199970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T14:38:17.224694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-17T11:48:22.519670+0000","last_change":"2023-12-17T11:48:18.280946+0000","last_active":"2023-12-17T11:48:22.519670+0000","last_peered":"2023-12-17T11:48:22.519670+0000","last_clean":"2023-12-17T11:48:22.519670+0000","last_became_active":"2023-12-17T11:48:18.280193+0000","last_became_peered":"2023-12-17T11:48:18.280193+0000","last_unstale":"2023-12-17T11:48:22.519670+0000","last_undegraded":"2023-12-17T11:48:22.519670+0000","last_fullsized":"2023-12-17T11:48:22.519670+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_clean_scrub_stamp":"2023-12-17T11:48:17.199970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T14:39:11.433170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-17T11:48:22.512528+0000","last_change":"2023-12-17T11:48:18.271322+0000","last_active":"2023-12-17T11:48:22.512528+0000","last_peered":"2023-12-17T11:48:22.512528+0000","last_clean":"2023-12-17T11:48:22.512528+0000","last_became_active":"2023-12-17T11:48:18.271029+0000","last_became_peered":"2023-12-17T11:48:18.271029+0000","last_unstale":"2023-12-17T11:48:22.512528+0000","last_undegraded":"2023-12-17T11:48:22.512528+0000","last_fullsized":"2023-12-17T11:48:22.512528+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_clean_scrub_stamp":"2023-12-17T11:48:17.199970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T23:46:39.140775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-17T11:48:22.499687+0000","last_change":"2023-12-17T11:48:18.280759+0000","last_active":"2023-12-17T11:48:22.499687+0000","last_peered":"2023-12-17T11:48:22.499687+0000","last_clean":"2023-12-17T11:48:22.499687+0000","last_became_active":"2023-12-17T11:48:18.279419+0000","last_became_peered":"2023-12-17T11:48:18.279419+0000","last_unstale":"2023-12-17T11:48:22.499687+0000","last_undegraded":"2023-12-17T11:48:22.499687+0000","last_fullsized":"2023-12-17T11:48:22.499687+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_clean_scrub_stamp":"2023-12-17T11:48:17.199970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T14:35:37.830024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-17T11:48:22.529945+0000","last_change":"2023-12-17T11:48:18.275948+0000","last_active":"2023-12-17T11:48:22.529945+0000","last_peered":"2023-12-17T11:48:22.529945+0000","last_clean":"2023-12-17T11:48:22.529945+0000","last_became_active":"2023-12-17T11:48:18.275186+0000","last_became_peered":"2023-12-17T11:48:18.275186+0000","last_unstale":"2023-12-17T11:48:22.529945+0000","last_undegraded":"2023-12-17T11:48:22.529945+0000","last_fullsized":"2023-12-17T11:48:22.529945+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_clean_scrub_stamp":"2023-12-17T11:48:17.199970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T20:47:10.524205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-17T11:48:22.528941+0000","last_change":"2023-12-17T11:48:18.266168+0000","last_active":"2023-12-17T11:48:22.528941+0000","last_peered":"2023-12-17T11:48:22.528941+0000","last_clean":"2023-12-17T11:48:22.528941+0000","last_became_active":"2023-12-17T11:48:18.265873+0000","last_became_peered":"2023-12-17T11:48:18.265873+0000","last_unstale":"2023-12-17T11:48:22.528941+0000","last_undegraded":"2023-12-17T11:48:22.528941+0000","last_fullsized":"2023-12-17T11:48:22.528941+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_clean_scrub_stamp":"2023-12-17T11:48:17.199970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T19:40:13.516541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-17T11:48:22.502538+0000","last_change":"2023-12-17T11:48:18.276992+0000","last_active":"2023-12-17T11:48:22.502538+0000","last_peered":"2023-12-17T11:48:22.502538+0000","last_clean":"2023-12-17T11:48:22.502538+0000","last_became_active":"2023-12-17T11:48:18.276731+0000","last_became_peered":"2023-12-17T11:48:18.276731+0000","last_unstale":"2023-12-17T11:48:22.502538+0000","last_undegraded":"2023-12-17T11:48:22.502538+0000","last_fullsized":"2023-12-17T11:48:22.502538+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_clean_scrub_stamp":"2023-12-17T11:48:17.199970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T20:53:58.226339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-17T11:48:22.515412+0000","last_change":"2023-12-17T11:48:18.282302+0000","last_active":"2023-12-17T11:48:22.515412+0000","last_peered":"2023-12-17T11:48:22.515412+0000","last_clean":"2023-12-17T11:48:22.515412+0000","last_became_active":"2023-12-17T11:48:18.282033+0000","last_became_peered":"2023-12-17T11:48:18.282033+0000","last_unstale":"2023-12-17T11:48:22.515412+0000","last_undegraded":"2023-12-17T11:48:22.515412+0000","last_fullsized":"2023-12-17T11:48:22.515412+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_clean_scrub_stamp":"2023-12-17T11:48:17.199970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T19:19:50.098252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-17T11:48:22.498331+0000","last_change":"2023-12-17T11:48:18.278722+0000","last_active":"2023-12-17T11:48:22.498331+0000","last_peered":"2023-12-17T11:48:22.498331+0000","last_clean":"2023-12-17T11:48:22.498331+0000","last_became_active":"2023-12-17T11:48:18.278416+0000","last_became_peered":"2023-12-17T11:48:18.278416+0000","last_unstale":"2023-12-17T11:48:22.498331+0000","last_undegraded":"2023-12-17T11:48:22.498331+0000","last_fullsized":"2023-12-17T11:48:22.498331+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_clean_scrub_stamp":"2023-12-17T11:48:17.199970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T12:09:17.721558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-17T11:48:22.523002+0000","last_change":"2023-12-17T11:48:18.280465+0000","last_active":"2023-12-17T11:48:22.523002+0000","last_peered":"2023-12-17T11:48:22.523002+0000","last_clean":"2023-12-17T11:48:22.523002+0000","last_became_active":"2023-12-17T11:48:18.279834+0000","last_became_peered":"2023-12-17T11:48:18.279834+0000","last_unstale":"2023-12-17T11:48:22.523002+0000","last_undegraded":"2023-12-17T11:48:22.523002+0000","last_fullsized":"2023-12-17T11:48:22.523002+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_clean_scrub_stamp":"2023-12-17T11:48:17.199970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T20:53:58.226339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-17T11:48:22.512247+0000","last_change":"2023-12-17T11:48:18.265956+0000","last_active":"2023-12-17T11:48:22.512247+0000","last_peered":"2023-12-17T11:48:22.512247+0000","last_clean":"2023-12-17T11:48:22.512247+0000","last_became_active":"2023-12-17T11:48:18.264308+0000","last_became_peered":"2023-12-17T11:48:18.264308+0000","last_unstale":"2023-12-17T11:48:22.512247+0000","last_undegraded":"2023-12-17T11:48:22.512247+0000","last_fullsized":"2023-12-17T11:48:22.512247+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_clean_scrub_stamp":"2023-12-17T11:48:17.199970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T12:09:17.721558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-17T11:48:22.528941+0000","last_change":"2023-12-17T11:48:18.277893+0000","last_active":"2023-12-17T11:48:22.528941+0000","last_peered":"2023-12-17T11:48:22.528941+0000","last_clean":"2023-12-17T11:48:22.528941+0000","last_became_active":"2023-12-17T11:48:18.277557+0000","last_became_peered":"2023-12-17T11:48:18.277557+0000","last_unstale":"2023-12-17T11:48:22.528941+0000","last_undegraded":"2023-12-17T11:48:22.528941+0000","last_fullsized":"2023-12-17T11:48:22.528941+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_clean_scrub_stamp":"2023-12-17T11:48:17.199970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T23:46:39.140775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-17T11:48:22.538075+0000","last_change":"2023-12-17T11:48:18.274779+0000","last_active":"2023-12-17T11:48:22.538075+0000","last_peered":"2023-12-17T11:48:22.538075+0000","last_clean":"2023-12-17T11:48:22.538075+0000","last_became_active":"2023-12-17T11:48:18.274509+0000","last_became_peered":"2023-12-17T11:48:18.274509+0000","last_unstale":"2023-12-17T11:48:22.538075+0000","last_undegraded":"2023-12-17T11:48:22.538075+0000","last_fullsized":"2023-12-17T11:48:22.538075+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_clean_scrub_stamp":"2023-12-17T11:48:17.199970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T22:05:51.790351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-17T11:48:22.504169+0000","last_change":"2023-12-17T11:48:18.266606+0000","last_active":"2023-12-17T11:48:22.504169+0000","last_peered":"2023-12-17T11:48:22.504169+0000","last_clean":"2023-12-17T11:48:22.504169+0000","last_became_active":"2023-12-17T11:48:18.265428+0000","last_became_peered":"2023-12-17T11:48:18.265428+0000","last_unstale":"2023-12-17T11:48:22.504169+0000","last_undegraded":"2023-12-17T11:48:22.504169+0000","last_fullsized":"2023-12-17T11:48:22.504169+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_clean_scrub_stamp":"2023-12-17T11:48:17.199970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T23:05:27.950618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-17T11:48:22.522838+0000","last_change":"2023-12-17T11:48:18.284558+0000","last_active":"2023-12-17T11:48:22.522838+0000","last_peered":"2023-12-17T11:48:22.522838+0000","last_clean":"2023-12-17T11:48:22.522838+0000","last_became_active":"2023-12-17T11:48:18.284223+0000","last_became_peered":"2023-12-17T11:48:18.284223+0000","last_unstale":"2023-12-17T11:48:22.522838+0000","last_undegraded":"2023-12-17T11:48:22.522838+0000","last_fullsized":"2023-12-17T11:48:22.522838+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_clean_scrub_stamp":"2023-12-17T11:48:17.199970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T19:44:16.453002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-17T11:48:22.515217+0000","last_change":"2023-12-17T11:48:18.285584+0000","last_active":"2023-12-17T11:48:22.515217+0000","last_peered":"2023-12-17T11:48:22.515217+0000","last_clean":"2023-12-17T11:48:22.515217+0000","last_became_active":"2023-12-17T11:48:18.285361+0000","last_became_peered":"2023-12-17T11:48:18.285361+0000","last_unstale":"2023-12-17T11:48:22.515217+0000","last_undegraded":"2023-12-17T11:48:22.515217+0000","last_fullsized":"2023-12-17T11:48:22.515217+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_clean_scrub_stamp":"2023-12-17T11:48:17.199970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T16:14:48.723317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-17T11:48:22.529429+0000","last_change":"2023-12-17T11:48:18.279879+0000","last_active":"2023-12-17T11:48:22.529429+0000","last_peered":"2023-12-17T11:48:22.529429+0000","last_clean":"2023-12-17T11:48:22.529429+0000","last_became_active":"2023-12-17T11:48:18.279462+0000","last_became_peered":"2023-12-17T11:48:18.279462+0000","last_unstale":"2023-12-17T11:48:22.529429+0000","last_undegraded":"2023-12-17T11:48:22.529429+0000","last_fullsized":"2023-12-17T11:48:22.529429+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_clean_scrub_stamp":"2023-12-17T11:48:17.199970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T12:09:17.721558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-17T11:48:22.509512+0000","last_change":"2023-12-17T11:48:18.268736+0000","last_active":"2023-12-17T11:48:22.509512+0000","last_peered":"2023-12-17T11:48:22.509512+0000","last_clean":"2023-12-17T11:48:22.509512+0000","last_became_active":"2023-12-17T11:48:18.268299+0000","last_became_peered":"2023-12-17T11:48:18.268299+0000","last_unstale":"2023-12-17T11:48:22.509512+0000","last_undegraded":"2023-12-17T11:48:22.509512+0000","last_fullsized":"2023-12-17T11:48:22.509512+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_clean_scrub_stamp":"2023-12-17T11:48:17.199970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T12:59:53.414167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-17T11:48:22.498921+0000","last_change":"2023-12-17T11:48:18.270384+0000","last_active":"2023-12-17T11:48:22.498921+0000","last_peered":"2023-12-17T11:48:22.498921+0000","last_clean":"2023-12-17T11:48:22.498921+0000","last_became_active":"2023-12-17T11:48:18.270042+0000","last_became_peered":"2023-12-17T11:48:18.270042+0000","last_unstale":"2023-12-17T11:48:22.498921+0000","last_undegraded":"2023-12-17T11:48:22.498921+0000","last_fullsized":"2023-12-17T11:48:22.498921+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_clean_scrub_stamp":"2023-12-17T11:48:17.199970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T20:47:10.524205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-17T11:48:22.518885+0000","last_change":"2023-12-17T11:48:18.261294+0000","last_active":"2023-12-17T11:48:22.518885+0000","last_peered":"2023-12-17T11:48:22.518885+0000","last_clean":"2023-12-17T11:48:22.518885+0000","last_became_active":"2023-12-17T11:48:18.260956+0000","last_became_peered":"2023-12-17T11:48:18.260956+0000","last_unstale":"2023-12-17T11:48:22.518885+0000","last_undegraded":"2023-12-17T11:48:22.518885+0000","last_fullsized":"2023-12-17T11:48:22.518885+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_clean_scrub_stamp":"2023-12-17T11:48:17.199970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T14:38:17.224694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-17T11:48:22.531412+0000","last_change":"2023-12-17T11:48:18.288322+0000","last_active":"2023-12-17T11:48:22.531412+0000","last_peered":"2023-12-17T11:48:22.531412+0000","last_clean":"2023-12-17T11:48:22.531412+0000","last_became_active":"2023-12-17T11:48:18.288079+0000","last_became_peered":"2023-12-17T11:48:18.288079+0000","last_unstale":"2023-12-17T11:48:22.531412+0000","last_undegraded":"2023-12-17T11:48:22.531412+0000","last_fullsized":"2023-12-17T11:48:22.531412+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_clean_scrub_stamp":"2023-12-17T11:48:17.199970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T12:59:53.414167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-17T11:48:22.528855+0000","last_change":"2023-12-17T11:48:18.284571+0000","last_active":"2023-12-17T11:48:22.528855+0000","last_peered":"2023-12-17T11:48:22.528855+0000","last_clean":"2023-12-17T11:48:22.528855+0000","last_became_active":"2023-12-17T11:48:18.284293+0000","last_became_peered":"2023-12-17T11:48:18.284293+0000","last_unstale":"2023-12-17T11:48:22.528855+0000","last_undegraded":"2023-12-17T11:48:22.528855+0000","last_fullsized":"2023-12-17T11:48:22.528855+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_clean_scrub_stamp":"2023-12-17T11:48:17.199970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T20:47:10.524205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-17T11:48:22.539887+0000","last_change":"2023-12-17T11:48:18.291564+0000","last_active":"2023-12-17T11:48:22.539887+0000","last_peered":"2023-12-17T11:48:22.539887+0000","last_clean":"2023-12-17T11:48:22.539887+0000","last_became_active":"2023-12-17T11:48:18.289522+0000","last_became_peered":"2023-12-17T11:48:18.289522+0000","last_unstale":"2023-12-17T11:48:22.539887+0000","last_undegraded":"2023-12-17T11:48:22.539887+0000","last_fullsized":"2023-12-17T11:48:22.539887+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_clean_scrub_stamp":"2023-12-17T11:48:17.199970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T17:39:16.718281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-17T11:48:22.497188+0000","last_change":"2023-12-17T11:48:18.282696+0000","last_active":"2023-12-17T11:48:22.497188+0000","last_peered":"2023-12-17T11:48:22.497188+0000","last_clean":"2023-12-17T11:48:22.497188+0000","last_became_active":"2023-12-17T11:48:18.282388+0000","last_became_peered":"2023-12-17T11:48:18.282388+0000","last_unstale":"2023-12-17T11:48:22.497188+0000","last_undegraded":"2023-12-17T11:48:22.497188+0000","last_fullsized":"2023-12-17T11:48:22.497188+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_clean_scrub_stamp":"2023-12-17T11:48:17.199970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T19:01:46.435511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-17T11:48:22.537605+0000","last_change":"2023-12-17T11:48:18.279029+0000","last_active":"2023-12-17T11:48:22.537605+0000","last_peered":"2023-12-17T11:48:22.537605+0000","last_clean":"2023-12-17T11:48:22.537605+0000","last_became_active":"2023-12-17T11:48:18.278719+0000","last_became_peered":"2023-12-17T11:48:18.278719+0000","last_unstale":"2023-12-17T11:48:22.537605+0000","last_undegraded":"2023-12-17T11:48:22.537605+0000","last_fullsized":"2023-12-17T11:48:22.537605+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_clean_scrub_stamp":"2023-12-17T11:48:17.199970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T14:24:55.101826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-17T11:48:22.517795+0000","last_change":"2023-12-17T11:48:18.286319+0000","last_active":"2023-12-17T11:48:22.517795+0000","last_peered":"2023-12-17T11:48:22.517795+0000","last_clean":"2023-12-17T11:48:22.517795+0000","last_became_active":"2023-12-17T11:48:18.286027+0000","last_became_peered":"2023-12-17T11:48:18.286027+0000","last_unstale":"2023-12-17T11:48:22.517795+0000","last_undegraded":"2023-12-17T11:48:22.517795+0000","last_fullsized":"2023-12-17T11:48:22.517795+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_clean_scrub_stamp":"2023-12-17T11:48:17.199970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T22:33:29.994957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-17T11:48:22.538176+0000","last_change":"2023-12-17T11:48:18.268834+0000","last_active":"2023-12-17T11:48:22.538176+0000","last_peered":"2023-12-17T11:48:22.538176+0000","last_clean":"2023-12-17T11:48:22.538176+0000","last_became_active":"2023-12-17T11:48:18.268143+0000","last_became_peered":"2023-12-17T11:48:18.268143+0000","last_unstale":"2023-12-17T11:48:22.538176+0000","last_undegraded":"2023-12-17T11:48:22.538176+0000","last_fullsized":"2023-12-17T11:48:22.538176+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_clean_scrub_stamp":"2023-12-17T11:48:17.199970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T12:22:21.171846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-17T11:48:22.521713+0000","last_change":"2023-12-17T11:48:18.280307+0000","last_active":"2023-12-17T11:48:22.521713+0000","last_peered":"2023-12-17T11:48:22.521713+0000","last_clean":"2023-12-17T11:48:22.521713+0000","last_became_active":"2023-12-17T11:48:18.280015+0000","last_became_peered":"2023-12-17T11:48:18.280015+0000","last_unstale":"2023-12-17T11:48:22.521713+0000","last_undegraded":"2023-12-17T11:48:22.521713+0000","last_fullsized":"2023-12-17T11:48:22.521713+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_clean_scrub_stamp":"2023-12-17T11:48:17.199970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T14:13:24.702473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-17T11:48:22.517974+0000","last_change":"2023-12-17T11:48:18.268732+0000","last_active":"2023-12-17T11:48:22.517974+0000","last_peered":"2023-12-17T11:48:22.517974+0000","last_clean":"2023-12-17T11:48:22.517974+0000","last_became_active":"2023-12-17T11:48:18.268356+0000","last_became_peered":"2023-12-17T11:48:18.268356+0000","last_unstale":"2023-12-17T11:48:22.517974+0000","last_undegraded":"2023-12-17T11:48:22.517974+0000","last_fullsized":"2023-12-17T11:48:22.517974+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_clean_scrub_stamp":"2023-12-17T11:48:17.199970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T19:01:46.435511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-17T11:48:22.536284+0000","last_change":"2023-12-17T11:48:18.278820+0000","last_active":"2023-12-17T11:48:22.536284+0000","last_peered":"2023-12-17T11:48:22.536284+0000","last_clean":"2023-12-17T11:48:22.536284+0000","last_became_active":"2023-12-17T11:48:18.275659+0000","last_became_peered":"2023-12-17T11:48:18.275659+0000","last_unstale":"2023-12-17T11:48:22.536284+0000","last_undegraded":"2023-12-17T11:48:22.536284+0000","last_fullsized":"2023-12-17T11:48:22.536284+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_clean_scrub_stamp":"2023-12-17T11:48:17.199970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T19:40:13.516541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-17T11:48:22.539766+0000","last_change":"2023-12-17T11:48:18.263983+0000","last_active":"2023-12-17T11:48:22.539766+0000","last_peered":"2023-12-17T11:48:22.539766+0000","last_clean":"2023-12-17T11:48:22.539766+0000","last_became_active":"2023-12-17T11:48:18.263574+0000","last_became_peered":"2023-12-17T11:48:18.263574+0000","last_unstale":"2023-12-17T11:48:22.539766+0000","last_undegraded":"2023-12-17T11:48:22.539766+0000","last_fullsized":"2023-12-17T11:48:22.539766+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_clean_scrub_stamp":"2023-12-17T11:48:17.199970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T22:56:05.187224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4497,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":8994,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":41,"ondisk_log_size":41,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542153,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27864,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343976,"statfs":{"total":96636764160,"available":96608231424,"internally_reserved":0,"allocated":860160,"data_stored":694037,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.212}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2669999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5489999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0369999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96899999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.403}]}]},{"osd":6,"up_from":14,"seq":60129542153,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":274432,"data_stored":106786,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90100000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0629999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.173}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.613}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2470000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3420000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.575}]}]},{"osd":5,"up_from":14,"seq":60129542152,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":266240,"data_stored":103177,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0329999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1679999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90600000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2529999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.141}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6599999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5069999999999999}]}]},{"osd":4,"up_from":14,"seq":60129542153,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":274432,"data_stored":103213,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1599999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83999999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.393}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.278}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96799999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.212}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5620000000000001}]}]},{"osd":3,"up_from":14,"seq":60129542152,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":274432,"data_stored":106786,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91500000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69799999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.022}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.198}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4159999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3600000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4390000000000001}]}]},{"osd":2,"up_from":14,"seq":60129542153,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":262144,"data_stored":103087,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59099999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76300000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64000000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98399999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.143}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.107}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1899999999999999}]}]},{"osd":1,"up_from":14,"seq":60129542152,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":270336,"data_stored":103247,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64100000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83799999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81399999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97599999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.468}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.093}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0349999999999999}]}]},{"osd":0,"up_from":14,"seq":60129542152,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27868,"kb_used_data":848,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343972,"statfs":{"total":96636764160,"available":96608227328,"internally_reserved":0,"allocated":868352,"data_stored":694093,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1479999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0349999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1080000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.413}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2470000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3700000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3699,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3699,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-17T11:48:42.590 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-12-17T11:48:42.591 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-12-17T11:48:42.591 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2023-12-17T11:48:42.591 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2023-12-17T11:48:42.591 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2023-12-17T11:48:42.843 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:42.841+0000 7fdaa2064640 1 Processor -- start 2023-12-17T11:48:42.844 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:42.842+0000 7fdaa2064640 1 -- start start 2023-12-17T11:48:42.845 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:42.843+0000 7fdaa2064640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fda9c144880 0x7fda9c0ce270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:42.846 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:42.843+0000 7fdaa2064640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7fda9c06ab70 0x7fda9c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:42.846 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:42.843+0000 7fdaa2064640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda9c15e9b0 con 0x7fda9c15be40 2023-12-17T11:48:42.846 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:42.843+0000 7fdaa2064640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda9c15f810 con 0x7fda9c144880 2023-12-17T11:48:42.846 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:42.843+0000 7fdaa2064640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda9c15ec00 con 0x7fda9c06ab70 2023-12-17T11:48:42.846 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:42.844+0000 7fdaa1062640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fda9c144880 0x7fda9c0ce270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:42.846 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:42.844+0000 7fdaa1062640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fda9c144880 0x7fda9c0ce270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:35230/0 (socket says 172.21.15.40:35230) 2023-12-17T11:48:42.846 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:42.844+0000 7fdaa1062640 1 -- 172.21.15.40:0/3997896247 learned_addr learned my addr 172.21.15.40:0/3997896247 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-17T11:48:42.846 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:42.844+0000 7fdaa1863640 1 --2- 172.21.15.40:0/3997896247 >> v2:172.21.15.159:3300/0 conn(0x7fda9c06ab70 0x7fda9c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:42.847 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:42.844+0000 7fdaa1062640 1 -- 172.21.15.40:0/3997896247 >> v2:172.21.15.159:3300/0 conn(0x7fda9c06ab70 msgr2=0x7fda9c06d300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:48:42.847 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:42.844+0000 7fdaa1062640 1 --2- 172.21.15.40:0/3997896247 >> v2:172.21.15.159:3300/0 conn(0x7fda9c06ab70 0x7fda9c06d300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:42.847 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:42.844+0000 7fdaa1062640 1 -- 172.21.15.40:0/3997896247 >> v1:172.21.15.159:6789/0 conn(0x7fda9c15be40 legacy=0x7fda9c06a460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:48:42.847 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:42.844+0000 7fdaa1062640 1 -- 172.21.15.40:0/3997896247 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda9c15eee0 con 0x7fda9c144880 2023-12-17T11:48:42.847 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:42.845+0000 7fdaa1062640 1 --2- 172.21.15.40:0/3997896247 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fda9c144880 0x7fda9c0ce270 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fda9c06b510 tx=0x7fda9802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=295af4cc7f901655 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:48:42.848 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:42.846+0000 7fda93fff640 1 -- 172.21.15.40:0/3997896247 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda98031870 con 0x7fda9c144880 2023-12-17T11:48:42.848 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:42.846+0000 7fda93fff640 1 -- 172.21.15.40:0/3997896247 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda980319d0 con 0x7fda9c144880 2023-12-17T11:48:42.848 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:42.846+0000 7fda93fff640 1 -- 172.21.15.40:0/3997896247 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda98031d60 con 0x7fda9c144880 2023-12-17T11:48:42.849 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:42.846+0000 7fdaa2064640 1 -- 172.21.15.40:0/3997896247 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fda9c144880 msgr2=0x7fda9c0ce270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:42.849 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:42.846+0000 7fdaa2064640 1 --2- 172.21.15.40:0/3997896247 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fda9c144880 0x7fda9c0ce270 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fda9c06b510 tx=0x7fda9802b910 comp rx=0 tx=0).stop 2023-12-17T11:48:42.849 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:42.847+0000 7fdaa2064640 1 -- 172.21.15.40:0/3997896247 shutdown_connections 2023-12-17T11:48:42.849 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:42.847+0000 7fdaa2064640 1 --2- 172.21.15.40:0/3997896247 >> v2:172.21.15.159:3300/0 conn(0x7fda9c06ab70 0x7fda9c06d300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:42.849 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:42.847+0000 7fdaa2064640 1 --2- 172.21.15.40:0/3997896247 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fda9c144880 0x7fda9c0ce270 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:42.849 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:42.847+0000 7fdaa2064640 1 -- 172.21.15.40:0/3997896247 >> 172.21.15.40:0/3997896247 conn(0x7fda9c0b1840 msgr2=0x7fda9c0b1c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:48:42.849 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:42.847+0000 7fdaa2064640 1 -- 172.21.15.40:0/3997896247 shutdown_connections 2023-12-17T11:48:42.849 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:42.847+0000 7fdaa2064640 1 -- 172.21.15.40:0/3997896247 wait complete. 2023-12-17T11:48:42.851 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:42.849+0000 7fdaa2064640 1 Processor -- start 2023-12-17T11:48:42.851 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:42.849+0000 7fdaa2064640 1 -- start start 2023-12-17T11:48:42.853 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:42.850+0000 7fdaa2064640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fda9c06ab70 0x7fda9c1546d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:42.853 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:42.851+0000 7fdaa2064640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fda9c144880 0x7fda9c140d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:42.853 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:42.851+0000 7fdaa2064640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fda9c15be40 0x7fda9c06b6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:42.853 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:42.851+0000 7fdaa2064640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda9c13e960 con 0x7fda9c15be40 2023-12-17T11:48:42.853 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:42.851+0000 7fdaa2064640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda9c1e47e0 con 0x7fda9c144880 2023-12-17T11:48:42.853 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:42.851+0000 7fdaa2064640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda9c1e4ac0 con 0x7fda9c06ab70 2023-12-17T11:48:42.853 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:42.851+0000 7fdaa1863640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fda9c15be40 0x7fda9c06b6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:42.853 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:42.851+0000 7fdaa1863640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fda9c15be40 0x7fda9c06b6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:35232/0 (socket says 172.21.15.40:35232) 2023-12-17T11:48:42.853 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:42.851+0000 7fdaa1863640 1 -- 172.21.15.40:0/1084673803 learned_addr learned my addr 172.21.15.40:0/1084673803 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-17T11:48:42.854 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:42.851+0000 7fdaa1062640 1 --2- 172.21.15.40:0/1084673803 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fda9c06ab70 0x7fda9c1546d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:42.854 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:42.851+0000 7fdaa0861640 1 --2- 172.21.15.40:0/1084673803 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fda9c144880 0x7fda9c140d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:42.855 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:42.851+0000 7fdaa1863640 1 -- 172.21.15.40:0/1084673803 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fda9c06ab70 msgr2=0x7fda9c1546d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:42.855 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:42.851+0000 7fdaa1863640 1 --2- 172.21.15.40:0/1084673803 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fda9c06ab70 0x7fda9c1546d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:42.855 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:42.851+0000 7fdaa1863640 1 -- 172.21.15.40:0/1084673803 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fda9c144880 msgr2=0x7fda9c140d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:42.855 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:42.851+0000 7fdaa1863640 1 --2- 172.21.15.40:0/1084673803 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fda9c144880 0x7fda9c140d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:42.855 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:42.851+0000 7fdaa1863640 1 -- 172.21.15.40:0/1084673803 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda980094d0 con 0x7fda9c15be40 2023-12-17T11:48:42.855 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:42.851+0000 7fdaa0861640 1 --2- 172.21.15.40:0/1084673803 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fda9c144880 0x7fda9c140d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-17T11:48:42.855 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:42.852+0000 7fdaa1863640 1 --2- 172.21.15.40:0/1084673803 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fda9c15be40 0x7fda9c06b6d0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fda94007e30 tx=0x7fda9400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:48:42.855 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:42.852+0000 7fda91ffb640 1 -- 172.21.15.40:0/1084673803 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda94014620 con 0x7fda9c15be40 2023-12-17T11:48:42.855 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:42.852+0000 7fda91ffb640 1 -- 172.21.15.40:0/1084673803 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda9400ee90 con 0x7fda9c15be40 2023-12-17T11:48:42.855 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:42.852+0000 7fda91ffb640 1 -- 172.21.15.40:0/1084673803 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda940149c0 con 0x7fda9c15be40 2023-12-17T11:48:42.855 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:42.852+0000 7fdaa2064640 1 -- 172.21.15.40:0/1084673803 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda9c1e4da0 con 0x7fda9c15be40 2023-12-17T11:48:42.855 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:42.852+0000 7fdaa2064640 1 -- 172.21.15.40:0/1084673803 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda9c1e5360 con 0x7fda9c15be40 2023-12-17T11:48:42.856 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:42.853+0000 7fdaa2064640 1 -- 172.21.15.40:0/1084673803 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda9c15c280 con 0x7fda9c15be40 2023-12-17T11:48:42.856 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:42.854+0000 7fda91ffb640 1 -- 172.21.15.40:0/1084673803 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fda94014b20 con 0x7fda9c15be40 2023-12-17T11:48:42.857 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:42.855+0000 7fda91ffb640 1 --2- 172.21.15.40:0/1084673803 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7fda8006ae40 0x7fda8006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:42.857 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:42.856+0000 7fda91ffb640 1 -- 172.21.15.40:0/1084673803 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fda9408a360 con 0x7fda9c15be40 2023-12-17T11:48:42.858 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:42.856+0000 7fdaa1062640 1 --2- 172.21.15.40:0/1084673803 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7fda8006ae40 0x7fda8006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:42.859 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:42.857+0000 7fdaa1062640 1 --2- 172.21.15.40:0/1084673803 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7fda8006ae40 0x7fda8006d300 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fda98036000 tx=0x7fda9803c040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:48:42.861 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:42.860+0000 7fda91ffb640 1 -- 172.21.15.40:0/1084673803 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fda9c15c280 con 0x7fda9c15be40 2023-12-17T11:48:43.103 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:43.101+0000 7fdaa2064640 1 -- 172.21.15.40:0/1084673803 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7fda9c15c280 con 0x7fda9c15be40 2023-12-17T11:48:43.112 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:43.110+0000 7fda91ffb640 1 -- 172.21.15.40:0/1084673803 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+171036 (secure 0 0 0) 0x7fda9c15c280 con 0x7fda9c15be40 2023-12-17T11:48:43.115 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T11:48:43.117 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:43.114+0000 7fdaa2064640 1 -- 172.21.15.40:0/1084673803 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7fda8006ae40 msgr2=0x7fda8006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:43.117 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:43.114+0000 7fdaa2064640 1 --2- 172.21.15.40:0/1084673803 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7fda8006ae40 0x7fda8006d300 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fda98036000 tx=0x7fda9803c040 comp rx=0 tx=0).stop 2023-12-17T11:48:43.118 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:43.114+0000 7fdaa2064640 1 -- 172.21.15.40:0/1084673803 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fda9c15be40 msgr2=0x7fda9c06b6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:43.118 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:43.114+0000 7fdaa2064640 1 --2- 172.21.15.40:0/1084673803 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fda9c15be40 0x7fda9c06b6d0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fda94007e30 tx=0x7fda9400e4b0 comp rx=0 tx=0).stop 2023-12-17T11:48:43.118 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:43.115+0000 7fdaa2064640 1 -- 172.21.15.40:0/1084673803 shutdown_connections 2023-12-17T11:48:43.118 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:43.115+0000 7fdaa2064640 1 --2- 172.21.15.40:0/1084673803 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7fda8006ae40 0x7fda8006d300 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:43.118 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:43.115+0000 7fdaa2064640 1 --2- 172.21.15.40:0/1084673803 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fda9c15be40 0x7fda9c06b6d0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:43.118 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:43.115+0000 7fdaa2064640 1 --2- 172.21.15.40:0/1084673803 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fda9c144880 0x7fda9c140d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:43.118 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:43.115+0000 7fdaa2064640 1 --2- 172.21.15.40:0/1084673803 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fda9c06ab70 0x7fda9c1546d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:43.119 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:43.115+0000 7fdaa2064640 1 -- 172.21.15.40:0/1084673803 >> 172.21.15.40:0/1084673803 conn(0x7fda9c0b1840 msgr2=0x7fda9c154e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:48:43.119 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:43.115+0000 7fdaa2064640 1 -- 172.21.15.40:0/1084673803 shutdown_connections 2023-12-17T11:48:43.119 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:43.115+0000 7fdaa2064640 1 -- 172.21.15.40:0/1084673803 wait complete. 2023-12-17T11:48:43.137 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":5,"active_gid":4105,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6832","nonce":479465803},{"type":"v1","addr":"172.21.15.159:6833","nonce":479465803}]},"active_addr":"172.21.15.159:6833/479465803","active_change":"2023-12-17T11:47:58.570909+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[{"gid":4116,"name":"y","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:latest","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:latest","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.159:0","nonce":1755401993}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.159:0","nonce":2152269387}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.159:0","nonce":2851486225}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.159:0","nonce":2136489397}]}]} 2023-12-17T11:48:43.140 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2023-12-17T11:48:43.141 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2023-12-17T11:48:43.141 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-17T11:48:43.364 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:43.361+0000 7f38e1578640 1 Processor -- start 2023-12-17T11:48:43.364 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:43.362+0000 7f38e1578640 1 -- start start 2023-12-17T11:48:43.366 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:43.364+0000 7f38e1578640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f38dc143e00 0x7f38dc0b4040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:43.366 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:43.364+0000 7f38e1578640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f38dc072180 0x7f38dc0b4580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:43.367 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:43.364+0000 7f38e1578640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f38dc06c410 0x7f38dc0b4ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:43.367 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:43.364+0000 7f38e1578640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38dc0b3bb0 con 0x7f38dc143e00 2023-12-17T11:48:43.367 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:43.364+0000 7f38e1578640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38dc1441e0 con 0x7f38dc072180 2023-12-17T11:48:43.367 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:43.364+0000 7f38e1578640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38dc072680 con 0x7f38dc06c410 2023-12-17T11:48:43.367 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:43.364+0000 7f38daffd640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f38dc143e00 0x7f38dc0b4040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:43.367 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:43.364+0000 7f38daffd640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f38dc143e00 0x7f38dc0b4040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:35248/0 (socket says 172.21.15.40:35248) 2023-12-17T11:48:43.367 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:43.365+0000 7f38daffd640 1 -- 172.21.15.40:0/1277343219 learned_addr learned my addr 172.21.15.40:0/1277343219 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-17T11:48:43.367 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:43.365+0000 7f38da7fc640 1 --2- 172.21.15.40:0/1277343219 >> v2:172.21.15.159:3300/0 conn(0x7f38dc072180 0x7f38dc0b4580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:43.367 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:43.365+0000 7f38db7fe640 1 --2- 172.21.15.40:0/1277343219 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f38dc06c410 0x7f38dc0b4ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:43.368 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:43.365+0000 7f38daffd640 1 -- 172.21.15.40:0/1277343219 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f38dc06c410 msgr2=0x7f38dc0b4ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:48:43.368 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:43.365+0000 7f38daffd640 1 --2- 172.21.15.40:0/1277343219 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f38dc06c410 0x7f38dc0b4ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:43.368 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:43.365+0000 7f38daffd640 1 -- 172.21.15.40:0/1277343219 >> v2:172.21.15.159:3300/0 conn(0x7f38dc072180 msgr2=0x7f38dc0b4580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:48:43.368 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:43.365+0000 7f38daffd640 1 --2- 172.21.15.40:0/1277343219 >> v2:172.21.15.159:3300/0 conn(0x7f38dc072180 0x7f38dc0b4580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:43.368 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:43.365+0000 7f38daffd640 1 -- 172.21.15.40:0/1277343219 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38dc0b1e30 con 0x7f38dc143e00 2023-12-17T11:48:43.368 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:43.367+0000 7f38daffd640 1 --2- 172.21.15.40:0/1277343219 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f38dc143e00 0x7f38dc0b4040 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f38dc067da0 tx=0x7f38cc02b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed997af8384e398a server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:48:43.369 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:43.367+0000 7f38d9ffb640 1 -- 172.21.15.40:0/1277343219 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38cc031870 con 0x7f38dc143e00 2023-12-17T11:48:43.369 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:43.367+0000 7f38d9ffb640 1 -- 172.21.15.40:0/1277343219 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38cc0319d0 con 0x7f38dc143e00 2023-12-17T11:48:43.369 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:43.367+0000 7f38d9ffb640 1 -- 172.21.15.40:0/1277343219 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38cc031d60 con 0x7f38dc143e00 2023-12-17T11:48:43.370 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:43.368+0000 7f38e1578640 1 -- 172.21.15.40:0/1277343219 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f38dc143e00 msgr2=0x7f38dc0b4040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:43.370 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:43.368+0000 7f38e1578640 1 --2- 172.21.15.40:0/1277343219 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f38dc143e00 0x7f38dc0b4040 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f38dc067da0 tx=0x7f38cc02b910 comp rx=0 tx=0).stop 2023-12-17T11:48:43.370 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:43.368+0000 7f38e1578640 1 -- 172.21.15.40:0/1277343219 shutdown_connections 2023-12-17T11:48:43.370 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:43.368+0000 7f38e1578640 1 --2- 172.21.15.40:0/1277343219 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f38dc06c410 0x7f38dc0b4ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:43.370 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:43.368+0000 7f38e1578640 1 --2- 172.21.15.40:0/1277343219 >> v2:172.21.15.159:3300/0 conn(0x7f38dc072180 0x7f38dc0b4580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:43.370 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:43.368+0000 7f38e1578640 1 --2- 172.21.15.40:0/1277343219 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f38dc143e00 0x7f38dc0b4040 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:43.370 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:43.368+0000 7f38e1578640 1 -- 172.21.15.40:0/1277343219 >> 172.21.15.40:0/1277343219 conn(0x7f38dc0b0a90 msgr2=0x7f38dc0b0e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:48:43.371 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:43.368+0000 7f38e1578640 1 -- 172.21.15.40:0/1277343219 shutdown_connections 2023-12-17T11:48:43.371 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:43.368+0000 7f38e1578640 1 -- 172.21.15.40:0/1277343219 wait complete. 2023-12-17T11:48:43.372 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:43.370+0000 7f38e1578640 1 Processor -- start 2023-12-17T11:48:43.372 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:43.370+0000 7f38e1578640 1 -- start start 2023-12-17T11:48:43.373 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:43.371+0000 7f38e1578640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f38dc06c410 0x7f38dc141130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:43.373 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:43.371+0000 7f38e1578640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f38dc072180 0x7f38dc15bc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:43.373 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:43.371+0000 7f38e1578640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f38dc143e00 0x7f38dc15c160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:43.373 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:43.371+0000 7f38e1578640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38dc15caf0 con 0x7f38dc06c410 2023-12-17T11:48:43.373 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:43.371+0000 7f38e1578640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38dc142ba0 con 0x7f38dc072180 2023-12-17T11:48:43.374 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:43.371+0000 7f38e1578640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38dc140ca0 con 0x7f38dc143e00 2023-12-17T11:48:43.374 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:43.371+0000 7f38daffd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f38dc06c410 0x7f38dc141130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:43.374 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:43.371+0000 7f38daffd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f38dc06c410 0x7f38dc141130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:35262/0 (socket says 172.21.15.40:35262) 2023-12-17T11:48:43.374 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:43.371+0000 7f38daffd640 1 -- 172.21.15.40:0/26852052 learned_addr learned my addr 172.21.15.40:0/26852052 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-17T11:48:43.375 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:43.372+0000 7f38da7fc640 1 --2- 172.21.15.40:0/26852052 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f38dc072180 0x7f38dc15bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:43.375 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:43.372+0000 7f38db7fe640 1 --2- 172.21.15.40:0/26852052 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f38dc143e00 0x7f38dc15c160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:43.375 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:43.372+0000 7f38daffd640 1 -- 172.21.15.40:0/26852052 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f38dc143e00 msgr2=0x7f38dc15c160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:43.375 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:43.372+0000 7f38daffd640 1 --2- 172.21.15.40:0/26852052 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f38dc143e00 0x7f38dc15c160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:43.375 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:43.372+0000 7f38daffd640 1 -- 172.21.15.40:0/26852052 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f38dc072180 msgr2=0x7f38dc15bc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:43.375 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:43.372+0000 7f38daffd640 1 --2- 172.21.15.40:0/26852052 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f38dc072180 0x7f38dc15bc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:43.375 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:43.372+0000 7f38daffd640 1 -- 172.21.15.40:0/26852052 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38cc0094d0 con 0x7f38dc06c410 2023-12-17T11:48:43.376 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:43.372+0000 7f38da7fc640 1 --2- 172.21.15.40:0/26852052 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f38dc072180 0x7f38dc15bc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-17T11:48:43.376 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:43.372+0000 7f38daffd640 1 --2- 172.21.15.40:0/26852052 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f38dc06c410 0x7f38dc141130 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f38cc02b950 tx=0x7f38cc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:48:43.376 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:43.372+0000 7f38d37fe640 1 -- 172.21.15.40:0/26852052 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38cc03abe0 con 0x7f38dc06c410 2023-12-17T11:48:43.376 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:43.373+0000 7f38d37fe640 1 -- 172.21.15.40:0/26852052 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38cc03ad60 con 0x7f38dc06c410 2023-12-17T11:48:43.376 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:43.373+0000 7f38d37fe640 1 -- 172.21.15.40:0/26852052 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38cc044630 con 0x7f38dc06c410 2023-12-17T11:48:43.376 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:43.373+0000 7f38e1578640 1 -- 172.21.15.40:0/26852052 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38dc1433b0 con 0x7f38dc06c410 2023-12-17T11:48:43.376 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:43.373+0000 7f38e1578640 1 -- 172.21.15.40:0/26852052 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38dc142df0 con 0x7f38dc06c410 2023-12-17T11:48:43.376 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:43.374+0000 7f38e1578640 1 -- 172.21.15.40:0/26852052 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38dc0745d0 con 0x7f38dc06c410 2023-12-17T11:48:43.376 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:43.375+0000 7f38d37fe640 1 -- 172.21.15.40:0/26852052 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f38cc044790 con 0x7f38dc06c410 2023-12-17T11:48:43.377 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:43.376+0000 7f38d37fe640 1 --2- 172.21.15.40:0/26852052 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f38c006ae40 0x7f38c006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:43.377 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:43.376+0000 7f38d37fe640 1 -- 172.21.15.40:0/26852052 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f38cc02d040 con 0x7f38dc06c410 2023-12-17T11:48:43.378 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:43.376+0000 7f38da7fc640 1 --2- 172.21.15.40:0/26852052 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f38c006ae40 0x7f38c006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:43.379 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:43.377+0000 7f38da7fc640 1 --2- 172.21.15.40:0/26852052 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f38c006ae40 0x7f38c006d300 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f38dc15f5a0 tx=0x7f38c400b040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:48:43.382 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:43.380+0000 7f38d37fe640 1 -- 172.21.15.40:0/26852052 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f38cc076cd0 con 0x7f38dc06c410 2023-12-17T11:48:43.579 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:43.577+0000 7f38e1578640 1 -- 172.21.15.40:0/26852052 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f38dc15ba00 con 0x7f38dc06c410 2023-12-17T11:48:43.582 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:43.580+0000 7f38d37fe640 1 -- 172.21.15.40:0/26852052 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18322 (secure 0 0 0) 0x7f38cc035020 con 0x7f38dc06c410 2023-12-17T11:48:43.582 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T11:48:43.582 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":25,"fsid":"099cd35d-80d9-4ca4-8424-de13b3b03ac7","created":"2023-12-17T11:47:53.450097+0000","modified":"2023-12-17T11:48:22.971195+0000","last_up_change":"2023-12-17T11:48:05.724195+0000","last_in_change":"2023-12-17T11:47:56.956499+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-17T11:48:06.668943+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-17T11:48:16.151444+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-17T11:48:16.717726+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-17T11:48:20.534819+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a88bfd46-63b8-48b1-9c0e-5c9cdc31bd38","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":555204741},{"type":"v1","addr":"172.21.15.40:6802","nonce":555204741}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":555204741},{"type":"v1","addr":"172.21.15.40:6807","nonce":555204741}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":555204741},{"type":"v1","addr":"172.21.15.40:6815","nonce":555204741}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6809","nonce":555204741},{"type":"v1","addr":"172.21.15.40:6812","nonce":555204741}]},"public_addr":"172.21.15.40:6802/555204741","cluster_addr":"172.21.15.40:6807/555204741","heartbeat_back_addr":"172.21.15.40:6815/555204741","heartbeat_front_addr":"172.21.15.40:6812/555204741","state":["exists","up"]},{"osd":1,"uuid":"c5d628ae-36f4-4866-802c-b162f0e90add","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6801","nonce":1221318112},{"type":"v1","addr":"172.21.15.40:6803","nonce":1221318112}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6805","nonce":1221318112},{"type":"v1","addr":"172.21.15.40:6806","nonce":1221318112}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6811","nonce":1221318112},{"type":"v1","addr":"172.21.15.40:6813","nonce":1221318112}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":1221318112},{"type":"v1","addr":"172.21.15.40:6810","nonce":1221318112}]},"public_addr":"172.21.15.40:6803/1221318112","cluster_addr":"172.21.15.40:6806/1221318112","heartbeat_back_addr":"172.21.15.40:6813/1221318112","heartbeat_front_addr":"172.21.15.40:6810/1221318112","state":["exists","up"]},{"osd":2,"uuid":"d986ad6a-af2f-47fc-9c3b-fbda27b82b73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":1959000265},{"type":"v1","addr":"172.21.15.40:6817","nonce":1959000265}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6818","nonce":1959000265},{"type":"v1","addr":"172.21.15.40:6819","nonce":1959000265}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":1959000265},{"type":"v1","addr":"172.21.15.40:6827","nonce":1959000265}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":1959000265},{"type":"v1","addr":"172.21.15.40:6822","nonce":1959000265}]},"public_addr":"172.21.15.40:6817/1959000265","cluster_addr":"172.21.15.40:6819/1959000265","heartbeat_back_addr":"172.21.15.40:6827/1959000265","heartbeat_front_addr":"172.21.15.40:6822/1959000265","state":["exists","up"]},{"osd":3,"uuid":"d79d22b7-be05-41b2-b95d-697db677fd02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6821","nonce":974040287},{"type":"v1","addr":"172.21.15.40:6823","nonce":974040287}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6825","nonce":974040287},{"type":"v1","addr":"172.21.15.40:6826","nonce":974040287}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":974040287},{"type":"v1","addr":"172.21.15.40:6831","nonce":974040287}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":974040287},{"type":"v1","addr":"172.21.15.40:6829","nonce":974040287}]},"public_addr":"172.21.15.40:6823/974040287","cluster_addr":"172.21.15.40:6826/974040287","heartbeat_back_addr":"172.21.15.40:6831/974040287","heartbeat_front_addr":"172.21.15.40:6829/974040287","state":["exists","up"]},{"osd":4,"uuid":"62a7a233-d3ea-40be-91de-180c0208d639","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6808","nonce":3937787733},{"type":"v1","addr":"172.21.15.159:6809","nonce":3937787733}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6810","nonce":3937787733},{"type":"v1","addr":"172.21.15.159:6811","nonce":3937787733}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6814","nonce":3937787733},{"type":"v1","addr":"172.21.15.159:6815","nonce":3937787733}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6812","nonce":3937787733},{"type":"v1","addr":"172.21.15.159:6813","nonce":3937787733}]},"public_addr":"172.21.15.159:6809/3937787733","cluster_addr":"172.21.15.159:6811/3937787733","heartbeat_back_addr":"172.21.15.159:6815/3937787733","heartbeat_front_addr":"172.21.15.159:6813/3937787733","state":["exists","up"]},{"osd":5,"uuid":"84629cea-dc0e-4b5e-b203-5ea963839281","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6816","nonce":3032505240},{"type":"v1","addr":"172.21.15.159:6817","nonce":3032505240}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6818","nonce":3032505240},{"type":"v1","addr":"172.21.15.159:6819","nonce":3032505240}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6822","nonce":3032505240},{"type":"v1","addr":"172.21.15.159:6823","nonce":3032505240}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6820","nonce":3032505240},{"type":"v1","addr":"172.21.15.159:6821","nonce":3032505240}]},"public_addr":"172.21.15.159:6817/3032505240","cluster_addr":"172.21.15.159:6819/3032505240","heartbeat_back_addr":"172.21.15.159:6823/3032505240","heartbeat_front_addr":"172.21.15.159:6821/3032505240","state":["exists","up"]},{"osd":6,"uuid":"4ae3af3a-1743-4070-a91d-8be5c31cdb04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6800","nonce":2411788597},{"type":"v1","addr":"172.21.15.159:6801","nonce":2411788597}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6802","nonce":2411788597},{"type":"v1","addr":"172.21.15.159:6803","nonce":2411788597}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6806","nonce":2411788597},{"type":"v1","addr":"172.21.15.159:6807","nonce":2411788597}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6804","nonce":2411788597},{"type":"v1","addr":"172.21.15.159:6805","nonce":2411788597}]},"public_addr":"172.21.15.159:6801/2411788597","cluster_addr":"172.21.15.159:6803/2411788597","heartbeat_back_addr":"172.21.15.159:6807/2411788597","heartbeat_front_addr":"172.21.15.159:6805/2411788597","state":["exists","up"]},{"osd":7,"uuid":"c1f4c7f2-8f75-4f95-bc63-a332773e3b8e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6824","nonce":478953349},{"type":"v1","addr":"172.21.15.159:6825","nonce":478953349}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6826","nonce":478953349},{"type":"v1","addr":"172.21.15.159:6827","nonce":478953349}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6830","nonce":478953349},{"type":"v1","addr":"172.21.15.159:6831","nonce":478953349}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6828","nonce":478953349},{"type":"v1","addr":"172.21.15.159:6829","nonce":478953349}]},"public_addr":"172.21.15.159:6825/478953349","cluster_addr":"172.21.15.159:6827/478953349","heartbeat_back_addr":"172.21.15.159:6831/478953349","heartbeat_front_addr":"172.21.15.159:6829/478953349","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T11:48:02.023567+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T11:48:02.278216+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T11:48:02.311843+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T11:48:01.773372+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T11:48:02.618910+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T11:48:02.361559+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T11:48:02.223997+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T11:48:02.604403+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-17T11:48:43.585 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:43.582+0000 7f38e1578640 1 -- 172.21.15.40:0/26852052 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f38c006ae40 msgr2=0x7f38c006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:43.585 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:43.582+0000 7f38e1578640 1 --2- 172.21.15.40:0/26852052 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f38c006ae40 0x7f38c006d300 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f38dc15f5a0 tx=0x7f38c400b040 comp rx=0 tx=0).stop 2023-12-17T11:48:43.585 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:43.582+0000 7f38e1578640 1 -- 172.21.15.40:0/26852052 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f38dc06c410 msgr2=0x7f38dc141130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:43.585 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:43.582+0000 7f38e1578640 1 --2- 172.21.15.40:0/26852052 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f38dc06c410 0x7f38dc141130 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f38cc02b950 tx=0x7f38cc0046c0 comp rx=0 tx=0).stop 2023-12-17T11:48:43.586 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:43.583+0000 7f38e1578640 1 -- 172.21.15.40:0/26852052 shutdown_connections 2023-12-17T11:48:43.586 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:43.583+0000 7f38e1578640 1 --2- 172.21.15.40:0/26852052 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f38c006ae40 0x7f38c006d300 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:43.586 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:43.583+0000 7f38e1578640 1 --2- 172.21.15.40:0/26852052 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f38dc143e00 0x7f38dc15c160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:43.586 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:43.583+0000 7f38e1578640 1 --2- 172.21.15.40:0/26852052 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f38dc072180 0x7f38dc15bc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:43.586 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:43.583+0000 7f38e1578640 1 --2- 172.21.15.40:0/26852052 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f38dc06c410 0x7f38dc141130 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:43.586 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:43.583+0000 7f38e1578640 1 -- 172.21.15.40:0/26852052 >> 172.21.15.40:0/26852052 conn(0x7f38dc0b0a90 msgr2=0x7f38dc144320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:48:43.586 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:43.583+0000 7f38e1578640 1 -- 172.21.15.40:0/26852052 shutdown_connections 2023-12-17T11:48:43.586 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:43.583+0000 7f38e1578640 1 -- 172.21.15.40:0/26852052 wait complete. 2023-12-17T11:48:43.606 INFO:tasks.ceph.ceph_manager.ceph:all up! 2023-12-17T11:48:43.607 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-17T11:48:43.827 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:43.825+0000 7ff5245c9640 1 Processor -- start 2023-12-17T11:48:43.827 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:43.825+0000 7ff5245c9640 1 -- start start 2023-12-17T11:48:43.828 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:43.826+0000 7ff5245c9640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7ff51c06a460 0x7ff51c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:43.828 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:43.826+0000 7ff5245c9640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff51c06d1c0 0x7ff51c0aede0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:43.828 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:43.826+0000 7ff5245c9640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff51c06ad80 con 0x7ff51c0af320 2023-12-17T11:48:43.829 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:43.826+0000 7ff5245c9640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff51c0cabd0 con 0x7ff51c06d1c0 2023-12-17T11:48:43.829 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:43.826+0000 7ff5245c9640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff51c0caeb0 con 0x7ff51c06a460 2023-12-17T11:48:43.829 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:43.826+0000 7ff521b64640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff51c06d1c0 0x7ff51c0aede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:43.829 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:43.826+0000 7ff521b64640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff51c06d1c0 0x7ff51c0aede0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:35272/0 (socket says 172.21.15.40:35272) 2023-12-17T11:48:43.829 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:43.827+0000 7ff521b64640 1 -- 172.21.15.40:0/2387072077 learned_addr learned my addr 172.21.15.40:0/2387072077 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-17T11:48:43.829 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:43.826+0000 7ff522b66640 1 --1- 172.21.15.40:0/2387072077 >> v1:172.21.15.40:6789/0 conn(0x7ff51c0af320 0x7ff51c15f170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:39950/0 (socket says 172.21.15.40:39950) 2023-12-17T11:48:43.830 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:43.827+0000 7ff522365640 1 --2- 172.21.15.40:0/2387072077 >> v2:172.21.15.159:3300/0 conn(0x7ff51c06a460 0x7ff51c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:43.830 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:43.827+0000 7ff521b64640 1 -- 172.21.15.40:0/2387072077 >> v2:172.21.15.159:3300/0 conn(0x7ff51c06a460 msgr2=0x7ff51c06a840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:48:43.830 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:43.827+0000 7ff521b64640 1 --2- 172.21.15.40:0/2387072077 >> v2:172.21.15.159:3300/0 conn(0x7ff51c06a460 0x7ff51c06a840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:43.830 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:43.827+0000 7ff521b64640 1 -- 172.21.15.40:0/2387072077 >> v1:172.21.15.40:6789/0 conn(0x7ff51c0af320 legacy=0x7ff51c15f170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:43.830 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:43.827+0000 7ff521b64640 1 -- 172.21.15.40:0/2387072077 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff51c0cb190 con 0x7ff51c06d1c0 2023-12-17T11:48:43.831 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:43.828+0000 7ff521b64640 1 --2- 172.21.15.40:0/2387072077 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff51c06d1c0 0x7ff51c0aede0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7ff51c06b480 tx=0x7ff50c02b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=409f406c2c012c1a server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:48:43.831 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:43.828+0000 7ff521363640 1 -- 172.21.15.40:0/2387072077 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff50c030860 con 0x7ff51c06d1c0 2023-12-17T11:48:43.831 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:43.829+0000 7ff521363640 1 -- 172.21.15.40:0/2387072077 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff50c0309c0 con 0x7ff51c06d1c0 2023-12-17T11:48:43.832 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:43.829+0000 7ff521363640 1 -- 172.21.15.40:0/2387072077 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff50c030d50 con 0x7ff51c06d1c0 2023-12-17T11:48:43.832 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:43.829+0000 7ff5245c9640 1 -- 172.21.15.40:0/2387072077 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff51c06d1c0 msgr2=0x7ff51c0aede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:43.832 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:43.829+0000 7ff5245c9640 1 --2- 172.21.15.40:0/2387072077 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff51c06d1c0 0x7ff51c0aede0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7ff51c06b480 tx=0x7ff50c02b9a0 comp rx=0 tx=0).stop 2023-12-17T11:48:43.832 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:43.829+0000 7ff5245c9640 1 -- 172.21.15.40:0/2387072077 shutdown_connections 2023-12-17T11:48:43.832 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:43.829+0000 7ff5245c9640 1 --2- 172.21.15.40:0/2387072077 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff51c06d1c0 0x7ff51c0aede0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:43.832 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:43.829+0000 7ff5245c9640 1 --2- 172.21.15.40:0/2387072077 >> v2:172.21.15.159:3300/0 conn(0x7ff51c06a460 0x7ff51c06a840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:43.832 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:43.829+0000 7ff5245c9640 1 -- 172.21.15.40:0/2387072077 >> 172.21.15.40:0/2387072077 conn(0x7ff51c0cc7d0 msgr2=0x7ff51c0ccbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:48:43.832 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:43.829+0000 7ff5245c9640 1 -- 172.21.15.40:0/2387072077 shutdown_connections 2023-12-17T11:48:43.832 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:43.829+0000 7ff5245c9640 1 -- 172.21.15.40:0/2387072077 wait complete. 2023-12-17T11:48:43.833 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:43.831+0000 7ff5245c9640 1 Processor -- start 2023-12-17T11:48:43.833 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:43.831+0000 7ff5245c9640 1 -- start start 2023-12-17T11:48:43.835 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:43.832+0000 7ff5245c9640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff51c06a460 0x7ff51c14e820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:43.835 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:43.832+0000 7ff5245c9640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff51c06d1c0 0x7ff51c1f2200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:43.835 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:43.832+0000 7ff5245c9640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff51c0af320 0x7ff51c15ce90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:43.835 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:43.832+0000 7ff5245c9640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff51c0c6e20 con 0x7ff51c06a460 2023-12-17T11:48:43.835 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:43.832+0000 7ff5245c9640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff51c0c7650 con 0x7ff51c0af320 2023-12-17T11:48:43.835 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:43.832+0000 7ff5245c9640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff51c1f1cf0 con 0x7ff51c06d1c0 2023-12-17T11:48:43.836 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:43.833+0000 7ff522365640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff51c06a460 0x7ff51c14e820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:43.836 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:43.833+0000 7ff522365640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff51c06a460 0x7ff51c14e820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:35288/0 (socket says 172.21.15.40:35288) 2023-12-17T11:48:43.836 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:43.833+0000 7ff522365640 1 -- 172.21.15.40:0/1372986195 learned_addr learned my addr 172.21.15.40:0/1372986195 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-17T11:48:43.836 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:43.833+0000 7ff522b66640 1 --2- 172.21.15.40:0/1372986195 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff51c0af320 0x7ff51c15ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:43.836 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:43.833+0000 7ff521b64640 1 --2- 172.21.15.40:0/1372986195 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff51c06d1c0 0x7ff51c1f2200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:43.836 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:43.833+0000 7ff522365640 1 -- 172.21.15.40:0/1372986195 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff51c06d1c0 msgr2=0x7ff51c1f2200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:43.836 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:43.833+0000 7ff522365640 1 --2- 172.21.15.40:0/1372986195 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff51c06d1c0 0x7ff51c1f2200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:43.836 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:43.833+0000 7ff522365640 1 -- 172.21.15.40:0/1372986195 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff51c0af320 msgr2=0x7ff51c15ce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:43.836 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:43.833+0000 7ff522365640 1 --2- 172.21.15.40:0/1372986195 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff51c0af320 0x7ff51c15ce90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:43.836 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:43.833+0000 7ff522365640 1 -- 172.21.15.40:0/1372986195 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff50c0094d0 con 0x7ff51c06a460 2023-12-17T11:48:43.836 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:43.833+0000 7ff521b64640 1 --2- 172.21.15.40:0/1372986195 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff51c06d1c0 0x7ff51c1f2200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-17T11:48:43.836 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:43.833+0000 7ff522365640 1 --2- 172.21.15.40:0/1372986195 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff51c06a460 0x7ff51c14e820 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7ff518007e40 tx=0x7ff51800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:48:43.837 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:43.834+0000 7ff512ffd640 1 -- 172.21.15.40:0/1372986195 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff518014620 con 0x7ff51c06a460 2023-12-17T11:48:43.837 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:43.834+0000 7ff512ffd640 1 -- 172.21.15.40:0/1372986195 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff51800ee90 con 0x7ff51c06a460 2023-12-17T11:48:43.838 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:43.834+0000 7ff512ffd640 1 -- 172.21.15.40:0/1372986195 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5180149a0 con 0x7ff51c06a460 2023-12-17T11:48:43.838 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:43.834+0000 7ff5245c9640 1 -- 172.21.15.40:0/1372986195 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff51c0c7000 con 0x7ff51c06a460 2023-12-17T11:48:43.838 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:43.834+0000 7ff5245c9640 1 -- 172.21.15.40:0/1372986195 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff51c15d3d0 con 0x7ff51c06a460 2023-12-17T11:48:43.838 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:43.835+0000 7ff5245c9640 1 -- 172.21.15.40:0/1372986195 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff51c0745d0 con 0x7ff51c06a460 2023-12-17T11:48:43.838 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:43.836+0000 7ff512ffd640 1 -- 172.21.15.40:0/1372986195 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ff518014b00 con 0x7ff51c06a460 2023-12-17T11:48:43.839 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:43.837+0000 7ff512ffd640 1 --2- 172.21.15.40:0/1372986195 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7ff50006ae40 0x7ff50006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:43.839 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:43.837+0000 7ff512ffd640 1 -- 172.21.15.40:0/1372986195 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7ff51808a2c0 con 0x7ff51c06a460 2023-12-17T11:48:43.839 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:43.837+0000 7ff521b64640 1 --2- 172.21.15.40:0/1372986195 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7ff50006ae40 0x7ff50006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:43.840 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:43.839+0000 7ff521b64640 1 --2- 172.21.15.40:0/1372986195 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7ff50006ae40 0x7ff50006d300 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7ff50c036000 tx=0x7ff50c03b040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:48:43.843 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:43.841+0000 7ff512ffd640 1 -- 172.21.15.40:0/1372986195 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7ff518054ff0 con 0x7ff51c06a460 2023-12-17T11:48:44.038 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.036+0000 7ff5245c9640 1 -- 172.21.15.40:0/1372986195 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff51c0cd4d0 con 0x7ff51c06a460 2023-12-17T11:48:44.040 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.038+0000 7ff512ffd640 1 -- 172.21.15.40:0/1372986195 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18322 (secure 0 0 0) 0x7ff518014db0 con 0x7ff51c06a460 2023-12-17T11:48:44.040 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T11:48:44.041 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":25,"fsid":"099cd35d-80d9-4ca4-8424-de13b3b03ac7","created":"2023-12-17T11:47:53.450097+0000","modified":"2023-12-17T11:48:22.971195+0000","last_up_change":"2023-12-17T11:48:05.724195+0000","last_in_change":"2023-12-17T11:47:56.956499+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-17T11:48:06.668943+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-17T11:48:16.151444+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-17T11:48:16.717726+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-17T11:48:20.534819+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a88bfd46-63b8-48b1-9c0e-5c9cdc31bd38","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":555204741},{"type":"v1","addr":"172.21.15.40:6802","nonce":555204741}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":555204741},{"type":"v1","addr":"172.21.15.40:6807","nonce":555204741}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":555204741},{"type":"v1","addr":"172.21.15.40:6815","nonce":555204741}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6809","nonce":555204741},{"type":"v1","addr":"172.21.15.40:6812","nonce":555204741}]},"public_addr":"172.21.15.40:6802/555204741","cluster_addr":"172.21.15.40:6807/555204741","heartbeat_back_addr":"172.21.15.40:6815/555204741","heartbeat_front_addr":"172.21.15.40:6812/555204741","state":["exists","up"]},{"osd":1,"uuid":"c5d628ae-36f4-4866-802c-b162f0e90add","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6801","nonce":1221318112},{"type":"v1","addr":"172.21.15.40:6803","nonce":1221318112}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6805","nonce":1221318112},{"type":"v1","addr":"172.21.15.40:6806","nonce":1221318112}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6811","nonce":1221318112},{"type":"v1","addr":"172.21.15.40:6813","nonce":1221318112}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":1221318112},{"type":"v1","addr":"172.21.15.40:6810","nonce":1221318112}]},"public_addr":"172.21.15.40:6803/1221318112","cluster_addr":"172.21.15.40:6806/1221318112","heartbeat_back_addr":"172.21.15.40:6813/1221318112","heartbeat_front_addr":"172.21.15.40:6810/1221318112","state":["exists","up"]},{"osd":2,"uuid":"d986ad6a-af2f-47fc-9c3b-fbda27b82b73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":1959000265},{"type":"v1","addr":"172.21.15.40:6817","nonce":1959000265}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6818","nonce":1959000265},{"type":"v1","addr":"172.21.15.40:6819","nonce":1959000265}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":1959000265},{"type":"v1","addr":"172.21.15.40:6827","nonce":1959000265}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":1959000265},{"type":"v1","addr":"172.21.15.40:6822","nonce":1959000265}]},"public_addr":"172.21.15.40:6817/1959000265","cluster_addr":"172.21.15.40:6819/1959000265","heartbeat_back_addr":"172.21.15.40:6827/1959000265","heartbeat_front_addr":"172.21.15.40:6822/1959000265","state":["exists","up"]},{"osd":3,"uuid":"d79d22b7-be05-41b2-b95d-697db677fd02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6821","nonce":974040287},{"type":"v1","addr":"172.21.15.40:6823","nonce":974040287}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6825","nonce":974040287},{"type":"v1","addr":"172.21.15.40:6826","nonce":974040287}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":974040287},{"type":"v1","addr":"172.21.15.40:6831","nonce":974040287}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":974040287},{"type":"v1","addr":"172.21.15.40:6829","nonce":974040287}]},"public_addr":"172.21.15.40:6823/974040287","cluster_addr":"172.21.15.40:6826/974040287","heartbeat_back_addr":"172.21.15.40:6831/974040287","heartbeat_front_addr":"172.21.15.40:6829/974040287","state":["exists","up"]},{"osd":4,"uuid":"62a7a233-d3ea-40be-91de-180c0208d639","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6808","nonce":3937787733},{"type":"v1","addr":"172.21.15.159:6809","nonce":3937787733}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6810","nonce":3937787733},{"type":"v1","addr":"172.21.15.159:6811","nonce":3937787733}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6814","nonce":3937787733},{"type":"v1","addr":"172.21.15.159:6815","nonce":3937787733}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6812","nonce":3937787733},{"type":"v1","addr":"172.21.15.159:6813","nonce":3937787733}]},"public_addr":"172.21.15.159:6809/3937787733","cluster_addr":"172.21.15.159:6811/3937787733","heartbeat_back_addr":"172.21.15.159:6815/3937787733","heartbeat_front_addr":"172.21.15.159:6813/3937787733","state":["exists","up"]},{"osd":5,"uuid":"84629cea-dc0e-4b5e-b203-5ea963839281","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6816","nonce":3032505240},{"type":"v1","addr":"172.21.15.159:6817","nonce":3032505240}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6818","nonce":3032505240},{"type":"v1","addr":"172.21.15.159:6819","nonce":3032505240}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6822","nonce":3032505240},{"type":"v1","addr":"172.21.15.159:6823","nonce":3032505240}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6820","nonce":3032505240},{"type":"v1","addr":"172.21.15.159:6821","nonce":3032505240}]},"public_addr":"172.21.15.159:6817/3032505240","cluster_addr":"172.21.15.159:6819/3032505240","heartbeat_back_addr":"172.21.15.159:6823/3032505240","heartbeat_front_addr":"172.21.15.159:6821/3032505240","state":["exists","up"]},{"osd":6,"uuid":"4ae3af3a-1743-4070-a91d-8be5c31cdb04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6800","nonce":2411788597},{"type":"v1","addr":"172.21.15.159:6801","nonce":2411788597}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6802","nonce":2411788597},{"type":"v1","addr":"172.21.15.159:6803","nonce":2411788597}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6806","nonce":2411788597},{"type":"v1","addr":"172.21.15.159:6807","nonce":2411788597}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6804","nonce":2411788597},{"type":"v1","addr":"172.21.15.159:6805","nonce":2411788597}]},"public_addr":"172.21.15.159:6801/2411788597","cluster_addr":"172.21.15.159:6803/2411788597","heartbeat_back_addr":"172.21.15.159:6807/2411788597","heartbeat_front_addr":"172.21.15.159:6805/2411788597","state":["exists","up"]},{"osd":7,"uuid":"c1f4c7f2-8f75-4f95-bc63-a332773e3b8e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6824","nonce":478953349},{"type":"v1","addr":"172.21.15.159:6825","nonce":478953349}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6826","nonce":478953349},{"type":"v1","addr":"172.21.15.159:6827","nonce":478953349}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6830","nonce":478953349},{"type":"v1","addr":"172.21.15.159:6831","nonce":478953349}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6828","nonce":478953349},{"type":"v1","addr":"172.21.15.159:6829","nonce":478953349}]},"public_addr":"172.21.15.159:6825/478953349","cluster_addr":"172.21.15.159:6827/478953349","heartbeat_back_addr":"172.21.15.159:6831/478953349","heartbeat_front_addr":"172.21.15.159:6829/478953349","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T11:48:02.023567+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T11:48:02.278216+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T11:48:02.311843+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T11:48:01.773372+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T11:48:02.618910+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T11:48:02.361559+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T11:48:02.223997+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T11:48:02.604403+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-17T11:48:44.043 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.041+0000 7ff5245c9640 1 -- 172.21.15.40:0/1372986195 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7ff50006ae40 msgr2=0x7ff50006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:44.043 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.041+0000 7ff5245c9640 1 --2- 172.21.15.40:0/1372986195 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7ff50006ae40 0x7ff50006d300 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7ff50c036000 tx=0x7ff50c03b040 comp rx=0 tx=0).stop 2023-12-17T11:48:44.043 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.041+0000 7ff5245c9640 1 -- 172.21.15.40:0/1372986195 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff51c06a460 msgr2=0x7ff51c14e820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:44.043 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.041+0000 7ff5245c9640 1 --2- 172.21.15.40:0/1372986195 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff51c06a460 0x7ff51c14e820 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7ff518007e40 tx=0x7ff51800e4b0 comp rx=0 tx=0).stop 2023-12-17T11:48:44.043 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.041+0000 7ff5245c9640 1 -- 172.21.15.40:0/1372986195 shutdown_connections 2023-12-17T11:48:44.043 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.041+0000 7ff5245c9640 1 --2- 172.21.15.40:0/1372986195 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7ff50006ae40 0x7ff50006d300 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:44.044 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.041+0000 7ff5245c9640 1 --2- 172.21.15.40:0/1372986195 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff51c0af320 0x7ff51c15ce90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:44.044 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.041+0000 7ff5245c9640 1 --2- 172.21.15.40:0/1372986195 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff51c06d1c0 0x7ff51c1f2200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:44.044 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.041+0000 7ff5245c9640 1 --2- 172.21.15.40:0/1372986195 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff51c06a460 0x7ff51c14e820 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:44.044 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.041+0000 7ff5245c9640 1 -- 172.21.15.40:0/1372986195 >> 172.21.15.40:0/1372986195 conn(0x7ff51c0cc7d0 msgr2=0x7ff51c1508f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:48:44.044 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.041+0000 7ff5245c9640 1 -- 172.21.15.40:0/1372986195 shutdown_connections 2023-12-17T11:48:44.044 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.041+0000 7ff5245c9640 1 -- 172.21.15.40:0/1372986195 wait complete. 2023-12-17T11:48:44.063 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2023-12-17T11:48:44.063 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2023-12-17T11:48:44.064 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2023-12-17T11:48:44.064 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2023-12-17T11:48:44.065 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2023-12-17T11:48:44.065 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2023-12-17T11:48:44.065 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2023-12-17T11:48:44.066 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2023-12-17T11:48:44.376 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.373+0000 7f2174301640 1 Processor -- start 2023-12-17T11:48:44.377 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.373+0000 7f2174301640 1 -- start start 2023-12-17T11:48:44.377 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.374+0000 7ff61ae72640 1 Processor -- start 2023-12-17T11:48:44.377 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.374+0000 7ff61ae72640 1 -- start start 2023-12-17T11:48:44.378 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.375+0000 7f2174301640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f2164048010 0x7f216404fa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:44.379 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.375+0000 7f2174301640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2164037b80 0x7f2164037fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:44.379 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.375+0000 7f2174301640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21640483f0 con 0x7f2164038520 2023-12-17T11:48:44.379 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.375+0000 7f2174301640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2164054770 con 0x7f2164048010 2023-12-17T11:48:44.379 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.375+0000 7f2174301640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21640536d0 con 0x7f2164037b80 2023-12-17T11:48:44.379 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.376+0000 7f217209d640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f2164048010 0x7f216404fa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:44.379 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.376+0000 7f217209d640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f2164048010 0x7f216404fa60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.40:39410/0 (socket says 172.21.15.40:39410) 2023-12-17T11:48:44.379 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.376+0000 7f217209d640 1 -- 172.21.15.40:0/3951342026 learned_addr learned my addr 172.21.15.40:0/3951342026 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-17T11:48:44.379 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.377+0000 7f217189c640 1 --2- 172.21.15.40:0/3951342026 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2164037b80 0x7f2164037fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:44.380 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.377+0000 7ff61ae72640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff61406d330 0x7ff6140b3ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:44.380 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.377+0000 7ff61ae72640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6140b3630 con 0x7ff61406c160 2023-12-17T11:48:44.380 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.377+0000 7ff61ae72640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6140b2aa0 con 0x7ff6141615c0 2023-12-17T11:48:44.380 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.377+0000 7ff61ae72640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6140b4000 con 0x7ff61406d330 2023-12-17T11:48:44.381 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.378+0000 7f217189c640 1 -- 172.21.15.40:0/3951342026 >> v2:172.21.15.159:3300/0 conn(0x7f2164048010 msgr2=0x7f216404fa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:48:44.381 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.378+0000 7f217189c640 1 --2- 172.21.15.40:0/3951342026 >> v2:172.21.15.159:3300/0 conn(0x7f2164048010 0x7f216404fa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:44.381 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.378+0000 7f217189c640 1 -- 172.21.15.40:0/3951342026 >> v1:172.21.15.40:6789/0 conn(0x7f2164038520 legacy=0x7f2164005e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:48:44.381 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.378+0000 7f217189c640 1 -- 172.21.15.40:0/3951342026 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21640539b0 con 0x7f2164037b80 2023-12-17T11:48:44.382 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.378+0000 7ff618c0e640 1 --1- >> v1:172.21.15.159:6789/0 conn(0x7ff6141615c0 0x7ff6140cbf70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.159:6789/0 says I am v1:172.21.15.40:53856/0 (socket says 172.21.15.40:53856) 2023-12-17T11:48:44.382 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.378+0000 7ff618c0e640 1 -- 172.21.15.40:0/1088914442 learned_addr learned my addr 172.21.15.40:0/1088914442 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-12-17T11:48:44.382 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.378+0000 7ff60bfff640 1 --1- 172.21.15.40:0/1088914442 >> v1:172.21.15.40:6789/0 conn(0x7ff61406c160 0x7ff61406cc20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:39972/0 (socket says 172.21.15.40:39972) 2023-12-17T11:48:44.382 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.378+0000 7ff61940f640 1 --2- 172.21.15.40:0/1088914442 >> v2:172.21.15.40:3300/0 conn(0x7ff61406d330 0x7ff6140b3ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:44.382 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.379+0000 7ff60b7fe640 1 -- 172.21.15.40:0/1088914442 <== mon.1 v1:172.21.15.159:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4025567390 0 0) 0x7ff6140b2aa0 con 0x7ff6141615c0 2023-12-17T11:48:44.382 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.379+0000 7ff60b7fe640 1 -- 172.21.15.40:0/1088914442 --> v1:172.21.15.159:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff5fc003520 con 0x7ff6141615c0 2023-12-17T11:48:44.382 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.379+0000 7ff61940f640 1 -- 172.21.15.40:0/1088914442 >> v1:172.21.15.159:6789/0 conn(0x7ff6141615c0 legacy=0x7ff6140cbf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:44.382 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.379+0000 7ff61940f640 1 -- 172.21.15.40:0/1088914442 >> v1:172.21.15.40:6789/0 conn(0x7ff61406c160 legacy=0x7ff61406cc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:44.382 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.379+0000 7ff61940f640 1 -- 172.21.15.40:0/1088914442 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6141619a0 con 0x7ff61406d330 2023-12-17T11:48:44.383 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.380+0000 7f3e6b59e640 1 Processor -- start 2023-12-17T11:48:44.383 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.380+0000 7f217189c640 1 --2- 172.21.15.40:0/3951342026 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2164037b80 0x7f2164037fe0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f216c068ea0 tx=0x7f216c066000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=21f2edc99fe77ede server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:48:44.383 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.380+0000 7f3e6b59e640 1 -- start start 2023-12-17T11:48:44.384 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.381+0000 7f217109b640 1 -- 172.21.15.40:0/3951342026 <== mon.2 v2:172.21.15.159:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f216c0a6be0 con 0x7f2164037b80 2023-12-17T11:48:44.384 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.381+0000 7f217109b640 1 -- 172.21.15.40:0/3951342026 <== mon.2 v2:172.21.15.159:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f216c0a6d80 con 0x7f2164037b80 2023-12-17T11:48:44.384 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.381+0000 7f217109b640 1 -- 172.21.15.40:0/3951342026 <== mon.2 v2:172.21.15.159:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f216c0ae640 con 0x7f2164037b80 2023-12-17T11:48:44.384 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.381+0000 7ff61940f640 1 --2- 172.21.15.40:0/1088914442 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff61406d330 0x7ff6140b3ac0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7ff60c009d90 tx=0x7ff60c02bf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c16afc8da82cc04a server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:48:44.385 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.382+0000 7f2174301640 1 -- 172.21.15.40:0/3951342026 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2164037b80 msgr2=0x7f2164037fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:44.385 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.382+0000 7ff60b7fe640 1 -- 172.21.15.40:0/1088914442 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff60c02ccf0 con 0x7ff61406d330 2023-12-17T11:48:44.385 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.382+0000 7ff60b7fe640 1 -- 172.21.15.40:0/1088914442 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff60c02ce50 con 0x7ff61406d330 2023-12-17T11:48:44.385 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.382+0000 7ff60b7fe640 1 -- 172.21.15.40:0/1088914442 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff60c034660 con 0x7ff61406d330 2023-12-17T11:48:44.385 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.382+0000 7f2174301640 1 --2- 172.21.15.40:0/3951342026 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2164037b80 0x7f2164037fe0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f216c068ea0 tx=0x7f216c066000 comp rx=0 tx=0).stop 2023-12-17T11:48:44.386 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.382+0000 7f2174301640 1 -- 172.21.15.40:0/3951342026 shutdown_connections 2023-12-17T11:48:44.386 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.382+0000 7f2174301640 1 --2- 172.21.15.40:0/3951342026 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2164037b80 0x7f2164037fe0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:44.386 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.382+0000 7f2174301640 1 --2- 172.21.15.40:0/3951342026 >> v2:172.21.15.159:3300/0 conn(0x7f2164048010 0x7f216404fa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:44.387 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.382+0000 7f2174301640 1 -- 172.21.15.40:0/3951342026 >> 172.21.15.40:0/3951342026 conn(0x7f2164009f80 msgr2=0x7f216400a360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:48:44.387 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.383+0000 7ff61ae72640 1 -- 172.21.15.40:0/1088914442 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff61406d330 msgr2=0x7ff6140b3ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:44.387 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.383+0000 7ff61ae72640 1 --2- 172.21.15.40:0/1088914442 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff61406d330 0x7ff6140b3ac0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7ff60c009d90 tx=0x7ff60c02bf40 comp rx=0 tx=0).stop 2023-12-17T11:48:44.387 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.383+0000 7f2174301640 1 -- 172.21.15.40:0/3951342026 shutdown_connections 2023-12-17T11:48:44.388 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.383+0000 7f2174301640 1 -- 172.21.15.40:0/3951342026 wait complete. 2023-12-17T11:48:44.388 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.385+0000 7f3e6b59e640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f3e6403c070 0x7f3e640e7750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:44.388 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.385+0000 7f3e6b59e640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f3e64053c80 0x7f3e64054110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:44.388 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.385+0000 7f3e6b59e640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e64054650 con 0x7f3e640e3130 2023-12-17T11:48:44.388 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.385+0000 7f3e6b59e640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e64007b40 con 0x7f3e6403c070 2023-12-17T11:48:44.388 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.385+0000 7f3e6b59e640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e640587e0 con 0x7f3e64053c80 2023-12-17T11:48:44.389 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.385+0000 7f2174301640 1 Processor -- start 2023-12-17T11:48:44.389 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.385+0000 7f3e69d9b640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f3e6403c070 0x7f3e640e7750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:44.389 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.386+0000 7ff61ae72640 1 -- 172.21.15.40:0/1088914442 shutdown_connections 2023-12-17T11:48:44.389 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.386+0000 7ff61ae72640 1 --2- 172.21.15.40:0/1088914442 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff61406d330 0x7ff6140b3ac0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:44.389 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.386+0000 7ff61ae72640 1 -- 172.21.15.40:0/1088914442 >> 172.21.15.40:0/1088914442 conn(0x7ff6140b0940 msgr2=0x7ff6140b0d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:48:44.390 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.386+0000 7f2174301640 1 -- start start 2023-12-17T11:48:44.390 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.386+0000 7ff61ae72640 1 -- 172.21.15.40:0/1088914442 shutdown_connections 2023-12-17T11:48:44.391 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.386+0000 7f3e6ad9d640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f3e64053c80 0x7f3e64054110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:44.391 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.386+0000 7f3e6ad9d640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f3e64053c80 0x7f3e64054110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3301/0 says I am v2:172.21.15.40:55774/0 (socket says 172.21.15.40:55774) 2023-12-17T11:48:44.391 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.386+0000 7f3e6ad9d640 1 -- 172.21.15.40:0/2331348205 learned_addr learned my addr 172.21.15.40:0/2331348205 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-17T11:48:44.391 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.386+0000 7ff61ae72640 1 -- 172.21.15.40:0/1088914442 wait complete. 2023-12-17T11:48:44.392 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.387+0000 7f2174301640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2164037b80 0x7f21640d1cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:44.392 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.387+0000 7f2174301640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2164038520 0x7f21640e1940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:44.392 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.387+0000 7f2174301640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2164048010 0x7f21640d01c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:44.392 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.387+0000 7f2174301640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21640e29e0 con 0x7f2164038520 2023-12-17T11:48:44.392 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.387+0000 7f2174301640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21640e2420 con 0x7f2164048010 2023-12-17T11:48:44.392 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.387+0000 7f2174301640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21640e2700 con 0x7f2164037b80 2023-12-17T11:48:44.393 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.388+0000 7f3e69d9b640 1 -- 172.21.15.40:0/2331348205 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f3e64053c80 msgr2=0x7f3e64054110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:48:44.393 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.388+0000 7f3e6959a640 1 -- 172.21.15.40:0/2331348205 <== mon.1 v1:172.21.15.159:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4092906207 0 0) 0x7f3e64054650 con 0x7f3e640e3130 2023-12-17T11:48:44.393 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.388+0000 7f217189c640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2164038520 0x7f21640e1940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:44.393 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.388+0000 7f217189c640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2164038520 0x7f21640e1940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:35326/0 (socket says 172.21.15.40:35326) 2023-12-17T11:48:44.394 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.388+0000 7f217189c640 1 -- 172.21.15.40:0/3417165098 learned_addr learned my addr 172.21.15.40:0/3417165098 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-17T11:48:44.394 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.388+0000 7f217209d640 1 --2- 172.21.15.40:0/3417165098 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2164037b80 0x7f21640d1cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:44.394 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.388+0000 7f3e69d9b640 1 --2- 172.21.15.40:0/2331348205 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f3e64053c80 0x7f3e64054110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:44.394 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.388+0000 7f3e69d9b640 1 -- 172.21.15.40:0/2331348205 >> v1:172.21.15.159:6789/0 conn(0x7f3e640e3130 legacy=0x7f3e64058020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:44.394 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.388+0000 7f3e69d9b640 1 -- 172.21.15.40:0/2331348205 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e64058ac0 con 0x7f3e6403c070 2023-12-17T11:48:44.395 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.389+0000 7f217289e640 1 --2- 172.21.15.40:0/3417165098 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2164048010 0x7f21640d01c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:44.395 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.389+0000 7f217189c640 1 -- 172.21.15.40:0/3417165098 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2164037b80 msgr2=0x7f21640d1cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:44.395 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.389+0000 7f217189c640 1 --2- 172.21.15.40:0/3417165098 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2164037b80 0x7f21640d1cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:44.395 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.389+0000 7f217189c640 1 -- 172.21.15.40:0/3417165098 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2164048010 msgr2=0x7f21640d01c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:44.395 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.389+0000 7f217189c640 1 --2- 172.21.15.40:0/3417165098 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2164048010 0x7f21640d01c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:44.395 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.389+0000 7f217189c640 1 -- 172.21.15.40:0/3417165098 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f216c074230 con 0x7f2164038520 2023-12-17T11:48:44.395 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.389+0000 7f3e6ad9d640 1 --2- 172.21.15.40:0/2331348205 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f3e64053c80 0x7f3e64054110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-17T11:48:44.396 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.389+0000 7f217189c640 1 --2- 172.21.15.40:0/3417165098 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2164038520 0x7f21640e1940 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f216c079b10 tx=0x7f216c069ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:48:44.396 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.389+0000 7fe1cb59e640 1 Processor -- start 2023-12-17T11:48:44.397 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.390+0000 7fe1cb59e640 1 -- start start 2023-12-17T11:48:44.397 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.390+0000 7ff61ae72640 1 Processor -- start 2023-12-17T11:48:44.397 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.390+0000 7f3e69d9b640 1 --2- 172.21.15.40:0/2331348205 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3e6403c070 0x7f3e640e7750 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f3e600097a0 tx=0x7f3e6002b7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8df28abea51df3b6 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:48:44.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.390+0000 7ff61ae72640 1 -- start start 2023-12-17T11:48:44.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.390+0000 7f3e6959a640 1 -- 172.21.15.40:0/2331348205 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e60031750 con 0x7f3e6403c070 2023-12-17T11:48:44.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.391+0000 7f3e6959a640 1 -- 172.21.15.40:0/2331348205 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e600318b0 con 0x7f3e6403c070 2023-12-17T11:48:44.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.391+0000 7f3e6959a640 1 -- 172.21.15.40:0/2331348205 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e60031750 con 0x7f3e6403c070 2023-12-17T11:48:44.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.391+0000 7f2162ffd640 1 -- 172.21.15.40:0/3417165098 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f216c0ba650 con 0x7f2164038520 2023-12-17T11:48:44.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.391+0000 7f2162ffd640 1 -- 172.21.15.40:0/3417165098 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f216c0ba7b0 con 0x7f2164038520 2023-12-17T11:48:44.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.391+0000 7f2162ffd640 1 -- 172.21.15.40:0/3417165098 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f216c0baba0 con 0x7f2164038520 2023-12-17T11:48:44.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.391+0000 7f2174301640 1 -- 172.21.15.40:0/3417165098 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21640cf9c0 con 0x7f2164038520 2023-12-17T11:48:44.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.392+0000 7ff61ae72640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff61406c160 0x7ff614160830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:44.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.392+0000 7ff61ae72640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff61406d330 0x7ff61409c140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:44.400 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.392+0000 7ff61ae72640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff6141615c0 0x7ff614070f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:44.400 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.393+0000 7ff60bfff640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff61406d330 0x7ff61409c140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:44.400 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.393+0000 7ff61ae72640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6141fb010 con 0x7ff61406c160 2023-12-17T11:48:44.400 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.393+0000 7ff61ae72640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6141fa390 con 0x7ff6141615c0 2023-12-17T11:48:44.400 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.393+0000 7ff61ae72640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6141fa670 con 0x7ff61406d330 2023-12-17T11:48:44.400 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.393+0000 7ff60bfff640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff61406d330 0x7ff61409c140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3301/0 says I am v2:172.21.15.40:55796/0 (socket says 172.21.15.40:55796) 2023-12-17T11:48:44.400 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.393+0000 7ff60bfff640 1 -- 172.21.15.40:0/599199872 learned_addr learned my addr 172.21.15.40:0/599199872 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-17T11:48:44.400 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.394+0000 7ff61940f640 1 --2- 172.21.15.40:0/599199872 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff6141615c0 0x7ff614070f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:44.400 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.393+0000 7f3e6b59e640 1 -- 172.21.15.40:0/2331348205 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3e6403c070 msgr2=0x7f3e640e7750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:44.401 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.393+0000 7f3e6b59e640 1 --2- 172.21.15.40:0/2331348205 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3e6403c070 0x7f3e640e7750 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f3e600097a0 tx=0x7f3e6002b7f0 comp rx=0 tx=0).stop 2023-12-17T11:48:44.401 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.394+0000 7f3e6b59e640 1 -- 172.21.15.40:0/2331348205 shutdown_connections 2023-12-17T11:48:44.401 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.394+0000 7f3e6b59e640 1 --2- 172.21.15.40:0/2331348205 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f3e64053c80 0x7f3e64054110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:44.401 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.394+0000 7f3e6b59e640 1 --2- 172.21.15.40:0/2331348205 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3e6403c070 0x7f3e640e7750 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:44.401 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.394+0000 7f3e6b59e640 1 -- 172.21.15.40:0/2331348205 >> 172.21.15.40:0/2331348205 conn(0x7f3e64058eb0 msgr2=0x7f3e64059290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:48:44.401 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.394+0000 7ff618c0e640 1 --2- 172.21.15.40:0/599199872 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff61406c160 0x7ff614160830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:44.401 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.392+0000 7fe1cb59e640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fe1cc0d13c0 0x7fe1cc0ce5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:44.402 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.392+0000 7fe1cb59e640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe1cc0d0d70 0x7fe1cc0d17a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:44.402 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.392+0000 7fe1cb59e640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7fe1cc0cf6a0 0x7fe1cc0cfb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:44.402 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.392+0000 7fe1cb59e640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1cc0b2280 con 0x7fe1cc0d13c0 2023-12-17T11:48:44.402 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.394+0000 7f3e6b59e640 1 -- 172.21.15.40:0/2331348205 shutdown_connections 2023-12-17T11:48:44.403 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.392+0000 7fe1cb59e640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1cc0cee70 con 0x7fe1cc0cf6a0 2023-12-17T11:48:44.403 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.392+0000 7fe1cb59e640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1cc0d1190 con 0x7fe1cc0d0d70 2023-12-17T11:48:44.403 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.393+0000 7fe1ca59c640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fe1cc0d13c0 0x7fe1cc0ce5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:44.403 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.393+0000 7fe1ca59c640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fe1cc0d13c0 0x7fe1cc0ce5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:35340/0 (socket says 172.21.15.40:35340) 2023-12-17T11:48:44.403 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.393+0000 7fe1ca59c640 1 -- 172.21.15.40:0/110429129 learned_addr learned my addr 172.21.15.40:0/110429129 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-17T11:48:44.403 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.394+0000 7fe1cad9d640 1 --2- 172.21.15.40:0/110429129 >> v2:172.21.15.159:3300/0 conn(0x7fe1cc0cf6a0 0x7fe1cc0cfb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:44.403 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.394+0000 7fe1ca59c640 1 -- 172.21.15.40:0/110429129 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe1cc0d0d70 msgr2=0x7fe1cc0d17a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:48:44.403 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.394+0000 7fe1ca59c640 1 --2- 172.21.15.40:0/110429129 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe1cc0d0d70 0x7fe1cc0d17a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:44.403 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.394+0000 7fe1ca59c640 1 -- 172.21.15.40:0/110429129 >> v2:172.21.15.159:3300/0 conn(0x7fe1cc0cf6a0 msgr2=0x7fe1cc0cfb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:48:44.403 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.394+0000 7fe1ca59c640 1 --2- 172.21.15.40:0/110429129 >> v2:172.21.15.159:3300/0 conn(0x7fe1cc0cf6a0 0x7fe1cc0cfb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:44.403 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.394+0000 7fe1ca59c640 1 -- 172.21.15.40:0/110429129 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1cc0d1ce0 con 0x7fe1cc0d13c0 2023-12-17T11:48:44.404 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.391+0000 7f2174301640 1 -- 172.21.15.40:0/3417165098 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21640d2200 con 0x7f2164038520 2023-12-17T11:48:44.404 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.394+0000 7ff60bfff640 1 -- 172.21.15.40:0/599199872 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff6141615c0 msgr2=0x7ff614070f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:44.404 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.394+0000 7ff60bfff640 1 --2- 172.21.15.40:0/599199872 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff6141615c0 0x7ff614070f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:44.404 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.394+0000 7ff60bfff640 1 -- 172.21.15.40:0/599199872 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff61406c160 msgr2=0x7ff614160830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:44.405 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.394+0000 7ff60bfff640 1 --2- 172.21.15.40:0/599199872 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff61406c160 0x7ff614160830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:44.405 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.394+0000 7ff60bfff640 1 -- 172.21.15.40:0/599199872 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff60c009a70 con 0x7ff61406d330 2023-12-17T11:48:44.405 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.395+0000 7ff60bfff640 1 --2- 172.21.15.40:0/599199872 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff61406d330 0x7ff61409c140 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7ff61000c4d0 tx=0x7ff61000c990 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:48:44.405 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.396+0000 7ff6097fa640 1 -- 172.21.15.40:0/599199872 <== mon.2 v2:172.21.15.159:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff610007480 con 0x7ff61406d330 2023-12-17T11:48:44.405 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.396+0000 7f2160ff9640 1 -- 172.21.15.40:0/3417165098 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f2148000fc0 con 0x7f2164038520 2023-12-17T11:48:44.406 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.396+0000 7ff6097fa640 1 -- 172.21.15.40:0/599199872 <== mon.2 v2:172.21.15.159:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6100075e0 con 0x7ff61406d330 2023-12-17T11:48:44.406 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.396+0000 7ff6097fa640 1 -- 172.21.15.40:0/599199872 <== mon.2 v2:172.21.15.159:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6100049e0 con 0x7ff61406d330 2023-12-17T11:48:44.406 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.396+0000 7ff61ae72640 1 -- 172.21.15.40:0/599199872 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6141fa950 con 0x7ff61406d330 2023-12-17T11:48:44.406 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.396+0000 7ff61ae72640 1 -- 172.21.15.40:0/599199872 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff614160d70 con 0x7ff61406d330 2023-12-17T11:48:44.406 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.397+0000 7fe1ca59c640 1 --2- 172.21.15.40:0/110429129 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe1cc0d13c0 0x7fe1cc0ce5b0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fe1cc0cf2e0 tx=0x7fe1b402bb00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c8de2519bd4231e server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:48:44.407 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.397+0000 7f2162ffd640 1 -- 172.21.15.40:0/3417165098 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f216c0bad00 con 0x7f2164038520 2023-12-17T11:48:44.407 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.396+0000 7ff618c0e640 1 --2- 172.21.15.40:0/599199872 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff61406c160 0x7ff614160830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-17T11:48:44.407 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.397+0000 7ff61ae72640 1 -- 172.21.15.40:0/599199872 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7ff6140b32c0 con 0x7ff61406d330 2023-12-17T11:48:44.408 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.394+0000 7f3e6b59e640 1 -- 172.21.15.40:0/2331348205 wait complete. 2023-12-17T11:48:44.408 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.396+0000 7f3e6b59e640 1 Processor -- start 2023-12-17T11:48:44.408 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.398+0000 7f3e6b59e640 1 -- start start 2023-12-17T11:48:44.408 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.398+0000 7fe1c9d9b640 1 -- 172.21.15.40:0/110429129 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1b402d6b0 con 0x7fe1cc0d13c0 2023-12-17T11:48:44.408 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.398+0000 7fe1c9d9b640 1 -- 172.21.15.40:0/110429129 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1b402d810 con 0x7fe1cc0d13c0 2023-12-17T11:48:44.408 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.398+0000 7fe1c9d9b640 1 -- 172.21.15.40:0/110429129 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1b402d6b0 con 0x7fe1cc0d13c0 2023-12-17T11:48:44.409 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.399+0000 7f3e6b59e640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3e6403c070 0x7f3e64039d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:44.409 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.399+0000 7f3e6b59e640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3e64053c80 0x7f3e64056de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:44.409 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.399+0000 7fb581743640 1 Processor -- start 2023-12-17T11:48:44.409 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.399+0000 7f3e6b59e640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f3e640e3130 0x7f3e64057320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:44.410 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.399+0000 7fe1cb59e640 1 -- 172.21.15.40:0/110429129 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe1cc0d13c0 msgr2=0x7fe1cc0ce5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:44.410 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.399+0000 7fe1cb59e640 1 --2- 172.21.15.40:0/110429129 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe1cc0d13c0 0x7fe1cc0ce5b0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fe1cc0cf2e0 tx=0x7fe1b402bb00 comp rx=0 tx=0).stop 2023-12-17T11:48:44.410 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.399+0000 7f3e6b59e640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e640e4920 con 0x7f3e6403c070 2023-12-17T11:48:44.410 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.400+0000 7f3e6b59e640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e6404b760 con 0x7f3e64053c80 2023-12-17T11:48:44.410 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.400+0000 7f3e6b59e640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e6404ba40 con 0x7f3e640e3130 2023-12-17T11:48:44.411 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.400+0000 7f3e6a59c640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3e6403c070 0x7f3e64039d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:44.411 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.400+0000 7f3e6a59c640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3e6403c070 0x7f3e64039d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:35364/0 (socket says 172.21.15.40:35364) 2023-12-17T11:48:44.411 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.400+0000 7f3e6a59c640 1 -- 172.21.15.40:0/116405307 learned_addr learned my addr 172.21.15.40:0/116405307 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-17T11:48:44.411 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.400+0000 7fe1cb59e640 1 -- 172.21.15.40:0/110429129 shutdown_connections 2023-12-17T11:48:44.411 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.400+0000 7fe1cb59e640 1 --2- 172.21.15.40:0/110429129 >> v2:172.21.15.159:3300/0 conn(0x7fe1cc0cf6a0 0x7fe1cc0cfb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:44.411 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.400+0000 7fe1cb59e640 1 --2- 172.21.15.40:0/110429129 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe1cc0d0d70 0x7fe1cc0d17a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:44.411 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.400+0000 7fe1cb59e640 1 --2- 172.21.15.40:0/110429129 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe1cc0d13c0 0x7fe1cc0ce5b0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:44.411 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.400+0000 7fe1cb59e640 1 -- 172.21.15.40:0/110429129 >> 172.21.15.40:0/110429129 conn(0x7fe1cc09c260 msgr2=0x7fe1cc0d2f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:48:44.412 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.399+0000 7f2162ffd640 1 --2- 172.21.15.40:0/3417165098 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f215006ae90 0x7f215006d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:44.412 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.399+0000 7f2162ffd640 1 -- 172.21.15.40:0/3417165098 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f216c125fd0 con 0x7f2164038520 2023-12-17T11:48:44.412 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.400+0000 7f2162ffd640 1 --2- 172.21.15.40:0/3417165098 >> [v2:172.21.15.40:6800/555204741,v1:172.21.15.40:6802/555204741] conn(0x7f21500744d0 0x7f2150076910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:44.412 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.400+0000 7f2162ffd640 1 -- 172.21.15.40:0/3417165098 --> [v2:172.21.15.40:6800/555204741,v1:172.21.15.40:6802/555204741] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f2150076fe0 con 0x7f21500744d0 2023-12-17T11:48:44.412 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.400+0000 7f2162ffd640 1 -- 172.21.15.40:0/3417165098 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f216c1286e0 con 0x7f2164038520 2023-12-17T11:48:44.412 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.400+0000 7f3e69d9b640 1 --2- 172.21.15.40:0/116405307 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3e64053c80 0x7f3e64056de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:44.412 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.400+0000 7f3e6ad9d640 1 --2- 172.21.15.40:0/116405307 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f3e640e3130 0x7f3e64057320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:44.413 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.401+0000 7fe1cb59e640 1 -- 172.21.15.40:0/110429129 shutdown_connections 2023-12-17T11:48:44.413 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.400+0000 7f217209d640 1 --2- 172.21.15.40:0/3417165098 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f215006ae90 0x7f215006d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:44.413 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.401+0000 7f217289e640 1 --2- 172.21.15.40:0/3417165098 >> [v2:172.21.15.40:6800/555204741,v1:172.21.15.40:6802/555204741] conn(0x7f21500744d0 0x7f2150076910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:44.413 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.401+0000 7f3e6a59c640 1 -- 172.21.15.40:0/116405307 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f3e640e3130 msgr2=0x7f3e64057320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:44.414 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.401+0000 7f3e6a59c640 1 --2- 172.21.15.40:0/116405307 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f3e640e3130 0x7f3e64057320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:44.414 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.401+0000 7f3e6a59c640 1 -- 172.21.15.40:0/116405307 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3e64053c80 msgr2=0x7f3e64056de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:44.414 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.401+0000 7f3e6a59c640 1 --2- 172.21.15.40:0/116405307 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3e64053c80 0x7f3e64056de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:44.414 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.401+0000 7f726403d640 1 Processor -- start 2023-12-17T11:48:44.414 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.401+0000 7f3e6a59c640 1 -- 172.21.15.40:0/116405307 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e60009400 con 0x7f3e6403c070 2023-12-17T11:48:44.414 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.402+0000 7f3e69d9b640 1 --2- 172.21.15.40:0/116405307 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3e64053c80 0x7f3e64056de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-17T11:48:44.415 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.402+0000 7f726403d640 1 -- start start 2023-12-17T11:48:44.415 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.402+0000 7f217289e640 1 --2- 172.21.15.40:0/3417165098 >> [v2:172.21.15.40:6800/555204741,v1:172.21.15.40:6802/555204741] conn(0x7f21500744d0 0x7f2150076910 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:48:44.415 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.402+0000 7ff6097fa640 1 -- 172.21.15.40:0/599199872 <== mon.2 v2:172.21.15.159:3301/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ff610004b40 con 0x7ff61406d330 2023-12-17T11:48:44.416 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.402+0000 7f55ff6cf640 1 Processor -- start 2023-12-17T11:48:44.416 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.402+0000 7f3e6a59c640 1 --2- 172.21.15.40:0/116405307 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3e6403c070 0x7f3e64039d00 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f3e5c00c410 tx=0x7f3e5c00c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:48:44.416 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.399+0000 7fb581743640 1 -- start start 2023-12-17T11:48:44.416 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.402+0000 7f55ff6cf640 1 -- start start 2023-12-17T11:48:44.417 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.402+0000 7fb581743640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fb57c153900 0x7fb57c070a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:44.417 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.403+0000 7fb581743640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb57c153ce0 con 0x7fb57c15a580 2023-12-17T11:48:44.417 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.403+0000 7fb57affd640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fb57c153900 0x7fb57c070a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:44.417 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.403+0000 7fb57affd640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fb57c153900 0x7fb57c070a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:35376/0 (socket says 172.21.15.40:35376) 2023-12-17T11:48:44.417 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.403+0000 7fb57affd640 1 -- 172.21.15.40:0/4193749340 learned_addr learned my addr 172.21.15.40:0/4193749340 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-17T11:48:44.418 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.403+0000 7f3e5affd640 1 -- 172.21.15.40:0/116405307 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e5c0035f0 con 0x7f3e6403c070 2023-12-17T11:48:44.418 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.403+0000 7fb581743640 1 -- 172.21.15.40:0/4193749340 --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb57c06d650 con 0x7fb57c0b43e0 2023-12-17T11:48:44.418 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.401+0000 7fe1cb59e640 1 -- 172.21.15.40:0/110429129 wait complete. 2023-12-17T11:48:44.418 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.404+0000 7fb581743640 1 -- 172.21.15.40:0/4193749340 --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb57c06d3a0 con 0x7fb57c153900 2023-12-17T11:48:44.419 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.404+0000 7f217209d640 1 --2- 172.21.15.40:0/3417165098 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f215006ae90 0x7f215006d350 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f215c009ac0 tx=0x7f215c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:48:44.419 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.404+0000 7fe1cb59e640 1 Processor -- start 2023-12-17T11:48:44.419 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.404+0000 7f726403d640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f725c1609b0 0x7f725c0d0ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:44.419 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.404+0000 7f726403d640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f725c0d0230 0x7f725c15cd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:44.419 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.404+0000 7f726403d640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f725c15dd60 con 0x7f725c0d1220 2023-12-17T11:48:44.419 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.404+0000 7f726403d640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f725c160d90 con 0x7f725c0d0230 2023-12-17T11:48:44.420 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.404+0000 7f726403d640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f725c15e040 con 0x7f725c1609b0 2023-12-17T11:48:44.420 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.404+0000 7f55ff6cf640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f55f80d3dd0 0x7f55f80cec30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:44.420 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.404+0000 7f55ff6cf640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f55f80cfb80 0x7f55f80d0030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:44.420 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.404+0000 7f55ff6cf640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55f80cdc40 con 0x7f55f815d480 2023-12-17T11:48:44.420 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.404+0000 7f55ff6cf640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55f80d0570 con 0x7f55f80d3dd0 2023-12-17T11:48:44.420 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.404+0000 7f55ff6cf640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55f80d1e60 con 0x7f55f80cfb80 2023-12-17T11:48:44.420 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.404+0000 7f2162ffd640 1 -- 172.21.15.40:0/3417165098 <== osd.0 v2:172.21.15.40:6800/555204741 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f2150076fe0 con 0x7f21500744d0 2023-12-17T11:48:44.421 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.404+0000 7fe1cb59e640 1 -- start start 2023-12-17T11:48:44.421 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.404+0000 7f3e5affd640 1 -- 172.21.15.40:0/116405307 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e5c003770 con 0x7f3e6403c070 2023-12-17T11:48:44.421 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.404+0000 7f3e5affd640 1 -- 172.21.15.40:0/116405307 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e5c003b60 con 0x7f3e6403c070 2023-12-17T11:48:44.421 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.405+0000 7f7261dd9640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f725c1609b0 0x7f725c0d0ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:44.421 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.405+0000 7f72615d8640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f725c0d1220 0x7f725c0cfb20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:39988/0 (socket says 172.21.15.40:39988) 2023-12-17T11:48:44.422 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.405+0000 7f72615d8640 1 -- 172.21.15.40:0/4294430532 learned_addr learned my addr 172.21.15.40:0/4294430532 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-12-17T11:48:44.422 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.405+0000 7f55fdc6c640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f55f80cfb80 0x7f55f80d0030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:44.422 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.405+0000 7f55fdc6c640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f55f80cfb80 0x7f55f80d0030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.40:39460/0 (socket says 172.21.15.40:39460) 2023-12-17T11:48:44.422 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.405+0000 7f55fdc6c640 1 -- 172.21.15.40:0/1725883293 learned_addr learned my addr 172.21.15.40:0/1725883293 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-17T11:48:44.422 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.405+0000 7f3e6b59e640 1 -- 172.21.15.40:0/116405307 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e6404bd20 con 0x7f3e6403c070 2023-12-17T11:48:44.422 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.405+0000 7f3e6b59e640 1 -- 172.21.15.40:0/116405307 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e640f5a80 con 0x7f3e6403c070 2023-12-17T11:48:44.423 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.405+0000 7f7261dd9640 1 -- 172.21.15.40:0/4294430532 >> v2:172.21.15.40:3300/0 conn(0x7f725c0d0230 msgr2=0x7f725c15cd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:48:44.423 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.405+0000 7f72625da640 1 --2- 172.21.15.40:0/4294430532 >> v2:172.21.15.40:3300/0 conn(0x7f725c0d0230 0x7f725c15cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:44.423 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.405+0000 7fb57affd640 1 -- 172.21.15.40:0/4193749340 >> v1:172.21.15.159:6789/0 conn(0x7fb57c0b43e0 legacy=0x7fb57c0cd850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:44.423 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.406+0000 7fb579ffb640 1 -- 172.21.15.40:0/4193749340 <== mon.1 v1:172.21.15.159:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1771181223 0 0) 0x7fb574001490 con 0x7fb57c0b43e0 2023-12-17T11:48:44.423 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.405+0000 7f55fdc6c640 1 -- 172.21.15.40:0/1725883293 >> v2:172.21.15.40:3300/0 conn(0x7f55f80d3dd0 msgr2=0x7f55f80cec30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:48:44.423 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.405+0000 7f55fdc6c640 1 --2- 172.21.15.40:0/1725883293 >> v2:172.21.15.40:3300/0 conn(0x7f55f80d3dd0 0x7f55f80cec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:44.424 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.405+0000 7f55fdc6c640 1 -- 172.21.15.40:0/1725883293 >> v1:172.21.15.159:6789/0 conn(0x7f55f815d480 legacy=0x7f55f80d1750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:48:44.424 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.406+0000 7fb57affd640 1 -- 172.21.15.40:0/4193749340 >> v1:172.21.15.40:6789/0 conn(0x7fb57c15a580 legacy=0x7fb57c06cc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:48:44.424 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.406+0000 7fe1cb59e640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe1cc0cf6a0 0x7fe1cc0cae50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:44.424 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.406+0000 7fb57affd640 1 -- 172.21.15.40:0/4193749340 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb57c0cca90 con 0x7fb57c153900 2023-12-17T11:48:44.425 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.407+0000 7fe1cb59e640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe1cc0d0d70 0x7fe1cc1fef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:44.425 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.407+0000 7f7261dd9640 1 --2- 172.21.15.40:0/4294430532 >> v2:172.21.15.40:3300/0 conn(0x7f725c0d0230 0x7f725c15cd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:44.425 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.407+0000 7f7261dd9640 1 -- 172.21.15.40:0/4294430532 >> v1:172.21.15.40:6789/0 conn(0x7f725c0d1220 legacy=0x7f725c0cfb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:48:44.425 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.407+0000 7f7261dd9640 1 -- 172.21.15.40:0/4294430532 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f725c15e320 con 0x7f725c1609b0 2023-12-17T11:48:44.425 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.407+0000 7f72625da640 1 --2- 172.21.15.40:0/4294430532 >> v2:172.21.15.40:3300/0 conn(0x7f725c0d0230 0x7f725c15cd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-17T11:48:44.426 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.406+0000 7f3e6b59e640 1 -- 172.21.15.40:0/116405307 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f3e50000fc0 con 0x7f3e6403c070 2023-12-17T11:48:44.427 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.407+0000 7fe1cb59e640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe1cc0d13c0 0x7fe1cc06e690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:44.427 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.407+0000 7fe1cb59e640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1cc0b3dd0 con 0x7fe1cc0d13c0 2023-12-17T11:48:44.427 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.407+0000 7fe1cb59e640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1cc0b34e0 con 0x7fe1cc0cf6a0 2023-12-17T11:48:44.427 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.407+0000 7fe1ca59c640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe1cc0cf6a0 0x7fe1cc0cae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:44.427 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.407+0000 7fe1ca59c640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe1cc0cf6a0 0x7fe1cc0cae50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.40:39466/0 (socket says 172.21.15.40:39466) 2023-12-17T11:48:44.427 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.407+0000 7fe1c1d9b640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe1cc0d0d70 0x7fe1cc1fef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:44.427 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.407+0000 7fe1c1d9b640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe1cc0d0d70 0x7fe1cc1fef70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3301/0 says I am v2:172.21.15.40:55826/0 (socket says 172.21.15.40:55826) 2023-12-17T11:48:44.427 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.407+0000 7fe1c1d9b640 1 -- 172.21.15.40:0/1808517459 learned_addr learned my addr 172.21.15.40:0/1808517459 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-17T11:48:44.427 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.407+0000 7fe1cb59e640 1 -- 172.21.15.40:0/1808517459 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1cc0b3780 con 0x7fe1cc0d0d70 2023-12-17T11:48:44.428 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.406+0000 7f55fdc6c640 1 -- 172.21.15.40:0/1725883293 --> v2:172.21.15.159:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55f80cde70 con 0x7f55f80cfb80 2023-12-17T11:48:44.428 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.408+0000 7fe1cad9d640 1 --2- 172.21.15.40:0/1808517459 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe1cc0d13c0 0x7fe1cc06e690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:44.428 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.408+0000 7ff6097fa640 1 --2- 172.21.15.40:0/599199872 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7ff60006af10 0x7ff60006d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:44.428 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.408+0000 7ff6097fa640 1 -- 172.21.15.40:0/599199872 <== mon.2 v2:172.21.15.159:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7ff610089890 con 0x7ff61406d330 2023-12-17T11:48:44.429 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.409+0000 7fe1c1d9b640 1 -- 172.21.15.40:0/1808517459 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe1cc0cf6a0 msgr2=0x7fe1cc0cae50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:44.429 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.409+0000 7f7261dd9640 1 --2- 172.21.15.40:0/4294430532 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f725c1609b0 0x7f725c0d0ce0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f724c0097a0 tx=0x7f724c02b840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ba700ecebbfb0144 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:48:44.429 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.408+0000 7ff6097fa640 1 --2- 172.21.15.40:0/599199872 >> [v2:172.21.15.40:6801/1221318112,v1:172.21.15.40:6803/1221318112] conn(0x7ff600074550 0x7ff600076990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:44.429 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.408+0000 7ff6097fa640 1 -- 172.21.15.40:0/599199872 --> [v2:172.21.15.40:6801/1221318112,v1:172.21.15.40:6803/1221318112] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ff600077060 con 0x7ff600074550 2023-12-17T11:48:44.430 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.408+0000 7ff6097fa640 1 -- 172.21.15.40:0/599199872 <== mon.2 v2:172.21.15.159:3301/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff610089c40 con 0x7ff61406d330 2023-12-17T11:48:44.430 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.409+0000 7fe1c1d9b640 1 --2- 172.21.15.40:0/1808517459 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe1cc0cf6a0 0x7fe1cc0cae50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:44.430 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.409+0000 7fe1c1d9b640 1 -- 172.21.15.40:0/1808517459 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe1cc0d13c0 msgr2=0x7fe1cc06e690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:44.430 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.409+0000 7fe1c1d9b640 1 --2- 172.21.15.40:0/1808517459 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe1cc0d13c0 0x7fe1cc06e690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:44.430 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.409+0000 7fe1c1d9b640 1 -- 172.21.15.40:0/1808517459 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1b40094d0 con 0x7fe1cc0d0d70 2023-12-17T11:48:44.431 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.409+0000 7f55fdc6c640 1 --2- 172.21.15.40:0/1725883293 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f55f80cfb80 0x7f55f80d0030 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f55f806b000 tx=0x7f55ec02b910 comp rx=0 tx=0).ready entity=mon.1 client_cookie=884131983f3b753e server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:48:44.431 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.409+0000 7f7260dd7640 1 -- 172.21.15.40:0/4294430532 <== mon.2 v2:172.21.15.159:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f724c02e070 con 0x7f725c1609b0 2023-12-17T11:48:44.431 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.409+0000 7fe1ca59c640 1 --2- 172.21.15.40:0/1808517459 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe1cc0cf6a0 0x7fe1cc0cae50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-17T11:48:44.431 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.409+0000 7fe1cad9d640 1 --2- 172.21.15.40:0/1808517459 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe1cc0d13c0 0x7fe1cc06e690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-17T11:48:44.432 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.409+0000 7f7260dd7640 1 -- 172.21.15.40:0/4294430532 <== mon.2 v2:172.21.15.159:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f724c0315a0 con 0x7f725c1609b0 2023-12-17T11:48:44.432 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.409+0000 7fb57affd640 1 --2- 172.21.15.40:0/4193749340 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb57c153900 0x7fb57c070a80 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fb564007360 tx=0x7fb56402cac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf1c4304547a11bc server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:48:44.432 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.410+0000 7f7260dd7640 1 -- 172.21.15.40:0/4294430532 <== mon.2 v2:172.21.15.159:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f724c02e070 con 0x7f725c1609b0 2023-12-17T11:48:44.432 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.410+0000 7fe1c1d9b640 1 --2- 172.21.15.40:0/1808517459 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe1cc0d0d70 0x7fe1cc1fef70 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fe1bc00b4a0 tx=0x7fe1bc00b960 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:48:44.433 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.409+0000 7ff618c0e640 1 --2- 172.21.15.40:0/599199872 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7ff60006af10 0x7ff60006d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:44.433 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.410+0000 7fb579ffb640 1 -- 172.21.15.40:0/4193749340 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb564008df0 con 0x7fb57c153900 2023-12-17T11:48:44.433 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.410+0000 7f55f7fff640 1 -- 172.21.15.40:0/1725883293 <== mon.1 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55ec031870 con 0x7f55f80cfb80 2023-12-17T11:48:44.434 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.410+0000 7f55f7fff640 1 -- 172.21.15.40:0/1725883293 <== mon.1 v2:172.21.15.159:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55ec0319d0 con 0x7f55f80cfb80 2023-12-17T11:48:44.434 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.410+0000 7f55f7fff640 1 -- 172.21.15.40:0/1725883293 <== mon.1 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55ec031d60 con 0x7f55f80cfb80 2023-12-17T11:48:44.434 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.410+0000 7ff61940f640 1 --2- 172.21.15.40:0/599199872 >> [v2:172.21.15.40:6801/1221318112,v1:172.21.15.40:6803/1221318112] conn(0x7ff600074550 0x7ff600076990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:44.434 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.410+0000 7fb579ffb640 1 -- 172.21.15.40:0/4193749340 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb56400a0d0 con 0x7fb57c153900 2023-12-17T11:48:44.434 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.410+0000 7f726403d640 1 -- 172.21.15.40:0/4294430532 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f725c1609b0 msgr2=0x7f725c0d0ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:44.434 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.410+0000 7f726403d640 1 --2- 172.21.15.40:0/4294430532 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f725c1609b0 0x7f725c0d0ce0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f724c0097a0 tx=0x7f724c02b840 comp rx=0 tx=0).stop 2023-12-17T11:48:44.435 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.410+0000 7fb579ffb640 1 -- 172.21.15.40:0/4193749340 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb56400a460 con 0x7fb57c153900 2023-12-17T11:48:44.435 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.410+0000 7fe1c37fe640 1 -- 172.21.15.40:0/1808517459 <== mon.2 v2:172.21.15.159:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1bc010610 con 0x7fe1cc0d0d70 2023-12-17T11:48:44.435 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.410+0000 7fe1c37fe640 1 -- 172.21.15.40:0/1808517459 <== mon.2 v2:172.21.15.159:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1bc010770 con 0x7fe1cc0d0d70 2023-12-17T11:48:44.435 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.410+0000 7fe1c37fe640 1 -- 172.21.15.40:0/1808517459 <== mon.2 v2:172.21.15.159:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1bc010b00 con 0x7fe1cc0d0d70 2023-12-17T11:48:44.436 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.411+0000 7f726403d640 1 -- 172.21.15.40:0/4294430532 shutdown_connections 2023-12-17T11:48:44.436 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.411+0000 7f726403d640 1 --2- 172.21.15.40:0/4294430532 >> v2:172.21.15.40:3300/0 conn(0x7f725c0d0230 0x7f725c15cd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:44.436 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.411+0000 7f726403d640 1 --2- 172.21.15.40:0/4294430532 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f725c1609b0 0x7f725c0d0ce0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:44.436 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.411+0000 7f726403d640 1 -- 172.21.15.40:0/4294430532 >> 172.21.15.40:0/4294430532 conn(0x7f725c09c450 msgr2=0x7f725c0d3110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:48:44.436 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.411+0000 7ff618c0e640 1 --2- 172.21.15.40:0/599199872 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7ff60006af10 0x7ff60006d3d0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7ff6040011e0 tx=0x7ff604009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:48:44.437 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.411+0000 7f726403d640 1 -- 172.21.15.40:0/4294430532 shutdown_connections 2023-12-17T11:48:44.437 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.411+0000 7fe1cb59e640 1 -- 172.21.15.40:0/1808517459 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1cc0b3a60 con 0x7fe1cc0d0d70 2023-12-17T11:48:44.437 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.411+0000 7fe1cb59e640 1 -- 172.21.15.40:0/1808517459 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1cc0cb550 con 0x7fe1cc0d0d70 2023-12-17T11:48:44.437 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.411+0000 7f726403d640 1 -- 172.21.15.40:0/4294430532 wait complete. 2023-12-17T11:48:44.438 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.411+0000 7fb581743640 1 -- 172.21.15.40:0/4193749340 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb57c153900 msgr2=0x7fb57c070a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:44.438 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.411+0000 7fb581743640 1 --2- 172.21.15.40:0/4193749340 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb57c153900 0x7fb57c070a80 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fb564007360 tx=0x7fb56402cac0 comp rx=0 tx=0).stop 2023-12-17T11:48:44.438 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.411+0000 7f3e5affd640 1 -- 172.21.15.40:0/116405307 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f3e5c003cc0 con 0x7f3e6403c070 2023-12-17T11:48:44.439 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.412+0000 7fb581743640 1 -- 172.21.15.40:0/4193749340 shutdown_connections 2023-12-17T11:48:44.439 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.412+0000 7f125a04b640 1 Processor -- start 2023-12-17T11:48:44.439 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.412+0000 7fe1cb59e640 1 -- 172.21.15.40:0/1808517459 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fe1cc0aff60 con 0x7fe1cc0d0d70 2023-12-17T11:48:44.439 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.412+0000 7fb581743640 1 --2- 172.21.15.40:0/4193749340 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb57c153900 0x7fb57c070a80 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:44.440 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.412+0000 7fb581743640 1 -- 172.21.15.40:0/4193749340 >> 172.21.15.40:0/4193749340 conn(0x7fb57c0b0a90 msgr2=0x7fb57c0b0e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:48:44.440 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.413+0000 7fb581743640 1 -- 172.21.15.40:0/4193749340 shutdown_connections 2023-12-17T11:48:44.440 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.413+0000 7f55ff6cf640 1 -- 172.21.15.40:0/1725883293 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f55f80cfb80 msgr2=0x7f55f80d0030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:44.440 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.413+0000 7f55ff6cf640 1 --2- 172.21.15.40:0/1725883293 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f55f80cfb80 0x7f55f80d0030 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f55f806b000 tx=0x7f55ec02b910 comp rx=0 tx=0).stop 2023-12-17T11:48:44.440 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.412+0000 7f125a04b640 1 -- start start 2023-12-17T11:48:44.441 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.412+0000 7ff61940f640 1 --2- 172.21.15.40:0/599199872 >> [v2:172.21.15.40:6801/1221318112,v1:172.21.15.40:6803/1221318112] conn(0x7ff600074550 0x7ff600076990 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:48:44.441 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.413+0000 7fb581743640 1 -- 172.21.15.40:0/4193749340 wait complete. 2023-12-17T11:48:44.442 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.413+0000 7f3e5affd640 1 --2- 172.21.15.40:0/116405307 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f3e4c06af10 0x7f3e4c06d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:44.442 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.413+0000 7f3e5affd640 1 -- 172.21.15.40:0/116405307 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f3e5c088ea0 con 0x7f3e6403c070 2023-12-17T11:48:44.442 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.413+0000 7f726403d640 1 Processor -- start 2023-12-17T11:48:44.442 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.414+0000 7f55ff6cf640 1 -- 172.21.15.40:0/1725883293 shutdown_connections 2023-12-17T11:48:44.442 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.414+0000 7f55ff6cf640 1 --2- 172.21.15.40:0/1725883293 >> v2:172.21.15.40:3300/0 conn(0x7f55f80d3dd0 0x7f55f80cec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:44.442 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.414+0000 7f55ff6cf640 1 --2- 172.21.15.40:0/1725883293 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f55f80cfb80 0x7f55f80d0030 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:44.443 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.414+0000 7f55ff6cf640 1 -- 172.21.15.40:0/1725883293 >> 172.21.15.40:0/1725883293 conn(0x7f55f809c4b0 msgr2=0x7f55f80d3170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:48:44.443 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.414+0000 7f726403d640 1 -- start start 2023-12-17T11:48:44.443 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.414+0000 7f55ff6cf640 1 -- 172.21.15.40:0/1725883293 shutdown_connections 2023-12-17T11:48:44.444 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.414+0000 7f3e5affd640 1 --2- 172.21.15.40:0/116405307 >> [v2:172.21.15.40:6816/1959000265,v1:172.21.15.40:6817/1959000265] conn(0x7f3e4c074550 0x7f3e4c076990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:44.444 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.414+0000 7f3e69d9b640 1 --2- 172.21.15.40:0/116405307 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f3e4c06af10 0x7f3e4c06d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:44.444 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.414+0000 7f3e5affd640 1 -- 172.21.15.40:0/116405307 --> [v2:172.21.15.40:6816/1959000265,v1:172.21.15.40:6817/1959000265] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f3e4c077060 con 0x7f3e4c074550 2023-12-17T11:48:44.444 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.414+0000 7f3e5affd640 1 -- 172.21.15.40:0/116405307 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3e5c08b4c0 con 0x7f3e6403c070 2023-12-17T11:48:44.444 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.414+0000 7f3e6ad9d640 1 --2- 172.21.15.40:0/116405307 >> [v2:172.21.15.40:6816/1959000265,v1:172.21.15.40:6817/1959000265] conn(0x7f3e4c074550 0x7f3e4c076990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:44.444 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.415+0000 7fb581743640 1 Processor -- start 2023-12-17T11:48:44.445 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.415+0000 7ff6097fa640 1 -- 172.21.15.40:0/599199872 <== osd.1 v2:172.21.15.40:6801/1221318112 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7ff600077060 con 0x7ff600074550 2023-12-17T11:48:44.445 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.415+0000 7f3e69d9b640 1 --2- 172.21.15.40:0/116405307 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f3e4c06af10 0x7f3e4c06d3d0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f3e60035000 tx=0x7f3e60008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:48:44.445 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.415+0000 7fb581743640 1 -- start start 2023-12-17T11:48:44.445 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.415+0000 7f3e6ad9d640 1 --2- 172.21.15.40:0/116405307 >> [v2:172.21.15.40:6816/1959000265,v1:172.21.15.40:6817/1959000265] conn(0x7f3e4c074550 0x7f3e4c076990 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:48:44.446 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.415+0000 7f55ff6cf640 1 -- 172.21.15.40:0/1725883293 wait complete. 2023-12-17T11:48:44.446 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.416+0000 7fb581743640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb57c0b43e0 0x7fb57c155b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:44.446 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.416+0000 7f726403d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f725c0d0230 0x7f725c0c9480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:44.446 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.417+0000 7fe1c37fe640 1 -- 172.21.15.40:0/1808517459 <== mon.2 v2:172.21.15.159:3301/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fe1bc010c60 con 0x7fe1cc0d0d70 2023-12-17T11:48:44.447 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.417+0000 7fb581743640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb57c153900 0x7fb57c15b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:44.447 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.416+0000 7f726403d640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f725c0d1220 0x7f725c1e8ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:44.447 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.417+0000 7f726403d640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f725c1609b0 0x7f725c0c72f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:44.447 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.417+0000 7f726403d640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f725c154120 con 0x7f725c0d0230 2023-12-17T11:48:44.447 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.417+0000 7f726403d640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f725c1e8b60 con 0x7f725c0d1220 2023-12-17T11:48:44.447 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.417+0000 7f726403d640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f725c0c99c0 con 0x7f725c1609b0 2023-12-17T11:48:44.448 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.417+0000 7fb581743640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb57c15a580 0x7fb57c15bef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:44.448 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.417+0000 7fb581743640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb57c1ef8a0 con 0x7fb57c15a580 2023-12-17T11:48:44.448 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.418+0000 7f72615d8640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f725c0d1220 0x7f725c1e8ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:44.448 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.418+0000 7f7261dd9640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f725c0d0230 0x7f725c0c9480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:44.449 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.418+0000 7f55ff6cf640 1 Processor -- start 2023-12-17T11:48:44.449 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.418+0000 7fb581743640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb57c1ee9b0 con 0x7fb57c153900 2023-12-17T11:48:44.449 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.418+0000 7fe1c37fe640 1 --2- 172.21.15.40:0/1808517459 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7fe1ac06ae40 0x7fe1ac06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:44.450 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.418+0000 7f125a04b640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f12540cff60 0x7f125415d470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:44.450 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.418+0000 7f125a04b640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f125415dd60 con 0x7f12541609b0 2023-12-17T11:48:44.450 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.418+0000 7f125a04b640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f125415e040 con 0x7f12540cfb20 2023-12-17T11:48:44.450 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.418+0000 7f125a04b640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1254160d90 con 0x7f12540cff60 2023-12-17T11:48:44.450 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.418+0000 7fe1c37fe640 1 -- 172.21.15.40:0/1808517459 <== mon.2 v2:172.21.15.159:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fe1bc089ae0 con 0x7fe1cc0d0d70 2023-12-17T11:48:44.451 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.418+0000 7fe1c37fe640 1 --2- 172.21.15.40:0/1808517459 >> [v2:172.21.15.40:6821/974040287,v1:172.21.15.40:6823/974040287] conn(0x7fe1ac074400 0x7fe1ac076840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:44.451 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.418+0000 7fb57b7fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb57c15a580 0x7fb57c15bef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:44.451 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.418+0000 7f55ff6cf640 1 -- start start 2023-12-17T11:48:44.451 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.419+0000 7fe1c37fe640 1 -- 172.21.15.40:0/1808517459 --> [v2:172.21.15.40:6821/974040287,v1:172.21.15.40:6823/974040287] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fe1ac076f10 con 0x7fe1ac074400 2023-12-17T11:48:44.451 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.419+0000 7fe1c37fe640 1 -- 172.21.15.40:0/1808517459 <== mon.2 v2:172.21.15.159:3301/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe1bc089e50 con 0x7fe1cc0d0d70 2023-12-17T11:48:44.452 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.418+0000 7f1253fff640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f12540cff60 0x7f125415d470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:44.452 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.419+0000 7f3e5affd640 1 -- 172.21.15.40:0/116405307 <== osd.2 v2:172.21.15.40:6816/1959000265 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f3e4c077060 con 0x7f3e4c074550 2023-12-17T11:48:44.452 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.418+0000 7f7261dd9640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f725c0d0230 0x7f725c0c9480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:35410/0 (socket says 172.21.15.40:35410) 2023-12-17T11:48:44.452 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.418+0000 7f7261dd9640 1 -- 172.21.15.40:0/1473952884 learned_addr learned my addr 172.21.15.40:0/1473952884 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-17T11:48:44.453 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.419+0000 7f1253fff640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f12540cff60 0x7f125415d470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:35426/0 (socket says 172.21.15.40:35426) 2023-12-17T11:48:44.453 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.419+0000 7f1253fff640 1 -- 172.21.15.40:0/1916916775 learned_addr learned my addr 172.21.15.40:0/1916916775 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-17T11:48:44.453 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.419+0000 7fb57b7fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb57c15a580 0x7fb57c15bef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:35420/0 (socket says 172.21.15.40:35420) 2023-12-17T11:48:44.453 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.419+0000 7fb57b7fe640 1 -- 172.21.15.40:0/1979610805 learned_addr learned my addr 172.21.15.40:0/1979610805 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-17T11:48:44.453 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.419+0000 7fb581743640 1 -- 172.21.15.40:0/1979610805 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb57c1eec20 con 0x7fb57c0b43e0 2023-12-17T11:48:44.454 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.419+0000 7fe1ca59c640 1 --2- 172.21.15.40:0/1808517459 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7fe1ac06ae40 0x7fe1ac06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:44.454 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.419+0000 7fe1cad9d640 1 --2- 172.21.15.40:0/1808517459 >> [v2:172.21.15.40:6821/974040287,v1:172.21.15.40:6823/974040287] conn(0x7fe1ac074400 0x7fe1ac076840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:44.454 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.419+0000 7fb57a7fc640 1 --2- 172.21.15.40:0/1979610805 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb57c153900 0x7fb57c15b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:44.454 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.419+0000 7f72625da640 1 --2- 172.21.15.40:0/1473952884 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f725c1609b0 0x7f725c0c72f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:44.455 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.420+0000 7f12527fc640 1 -- 172.21.15.40:0/1916916775 <== mon.1 v1:172.21.15.159:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2317451620 0 0) 0x7f125415e040 con 0x7f12540cfb20 2023-12-17T11:48:44.455 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.420+0000 7f12527fc640 1 -- 172.21.15.40:0/1916916775 --> v1:172.21.15.159:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f123c003520 con 0x7f12540cfb20 2023-12-17T11:48:44.455 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.420+0000 7fb57b7fe640 1 -- 172.21.15.40:0/1979610805 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb57c0b43e0 msgr2=0x7fb57c155b70 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-12-17T11:48:44.455 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.420+0000 7fb57b7fe640 1 --2- 172.21.15.40:0/1979610805 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb57c0b43e0 0x7fb57c155b70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:44.455 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.420+0000 7fb57b7fe640 1 -- 172.21.15.40:0/1979610805 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb57c153900 msgr2=0x7fb57c15b9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:44.455 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.420+0000 7fb57b7fe640 1 --2- 172.21.15.40:0/1979610805 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb57c153900 0x7fb57c15b9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:44.456 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.421+0000 7f12527fc640 1 -- 172.21.15.40:0/1916916775 <== mon.1 v1:172.21.15.159:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 993713712 0 0) 0x7f123c003520 con 0x7f12540cfb20 2023-12-17T11:48:44.456 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.421+0000 7f12527fc640 1 -- 172.21.15.40:0/1916916775 >> v2:172.21.15.40:3300/0 conn(0x7f12540cff60 msgr2=0x7f125415d470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:48:44.456 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.421+0000 7f12527fc640 1 --2- 172.21.15.40:0/1916916775 >> v2:172.21.15.40:3300/0 conn(0x7f12540cff60 0x7f125415d470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:44.456 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.421+0000 7f12527fc640 1 -- 172.21.15.40:0/1916916775 >> v1:172.21.15.40:6789/0 conn(0x7f12541609b0 legacy=0x7f12540d0ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:44.456 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.420+0000 7f7261dd9640 1 -- 172.21.15.40:0/1473952884 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f725c1609b0 msgr2=0x7f725c0c72f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:44.456 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.420+0000 7f7261dd9640 1 --2- 172.21.15.40:0/1473952884 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f725c1609b0 0x7f725c0c72f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:44.456 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.420+0000 7f7261dd9640 1 -- 172.21.15.40:0/1473952884 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f725c0d1220 msgr2=0x7f725c1e8ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:44.457 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.420+0000 7f7261dd9640 1 --2- 172.21.15.40:0/1473952884 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f725c0d1220 0x7f725c1e8ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:44.457 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.420+0000 7f7261dd9640 1 -- 172.21.15.40:0/1473952884 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f724c009400 con 0x7f725c0d0230 2023-12-17T11:48:44.457 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.421+0000 7f55ff6cf640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f55f80cfb80 0x7f55f80ca240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:44.457 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.421+0000 7f55ff6cf640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f55f80d3dd0 0x7f55f81e8cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:44.457 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.421+0000 7f55ff6cf640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f55f815d480 0x7f55f81e9210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:44.457 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.421+0000 7f55ff6cf640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55f8151180 con 0x7f55f80d3dd0 2023-12-17T11:48:44.457 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.421+0000 7f55ff6cf640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55f80c6c00 con 0x7f55f815d480 2023-12-17T11:48:44.457 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.421+0000 7f55ff6cf640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55f80ccc80 con 0x7f55f80cfb80 2023-12-17T11:48:44.458 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.421+0000 7fb57b7fe640 1 -- 172.21.15.40:0/1979610805 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb564007040 con 0x7fb57c15a580 2023-12-17T11:48:44.458 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.421+0000 7fb57b7fe640 1 --2- 172.21.15.40:0/1979610805 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb57c15a580 0x7fb57c15bef0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fb57400c7e0 tx=0x7fb57400cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:48:44.458 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.421+0000 7f12527fc640 1 -- 172.21.15.40:0/1916916775 --> v1:172.21.15.159:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f125415e320 con 0x7f12540cfb20 2023-12-17T11:48:44.458 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.421+0000 7fe1cad9d640 1 --2- 172.21.15.40:0/1808517459 >> [v2:172.21.15.40:6821/974040287,v1:172.21.15.40:6823/974040287] conn(0x7fe1ac074400 0x7fe1ac076840 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:48:44.459 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.421+0000 7f12527fc640 1 -- 172.21.15.40:0/1916916775 <== mon.1 v1:172.21.15.159:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2643242555 0 0) 0x7f1248001670 con 0x7f12540cfb20 2023-12-17T11:48:44.459 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.421+0000 7f12527fc640 1 -- 172.21.15.40:0/1916916775 >> v1:172.21.15.159:6789/0 conn(0x7f12540cfb20 legacy=0x7f125415cd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:44.459 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.422+0000 7f55fd46b640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f55f80cfb80 0x7f55f80ca240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:44.459 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.422+0000 7f55fd46b640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f55f80cfb80 0x7f55f80ca240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3301/0 says I am v2:172.21.15.40:55840/0 (socket says 172.21.15.40:55840) 2023-12-17T11:48:44.459 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.422+0000 7f55fd46b640 1 -- 172.21.15.40:0/358800057 learned_addr learned my addr 172.21.15.40:0/358800057 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-17T11:48:44.460 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.421+0000 7f12527fc640 1 --2- 172.21.15.40:0/1916916775 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f123c003970 0x7f123c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:44.460 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.421+0000 7f12527fc640 1 --2- 172.21.15.40:0/1916916775 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f123c0047c0 0x7f123c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:44.460 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.421+0000 7f12527fc640 1 --2- 172.21.15.40:0/1916916775 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f123c005180 0x7f123c014190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:44.460 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.421+0000 7f12527fc640 1 -- 172.21.15.40:0/1916916775 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1254160d90 con 0x7f123c0047c0 2023-12-17T11:48:44.460 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.421+0000 7f12527fc640 1 -- 172.21.15.40:0/1916916775 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f123c0148e0 con 0x7f123c003970 2023-12-17T11:48:44.460 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.421+0000 7f12527fc640 1 -- 172.21.15.40:0/1916916775 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f123c014aa0 con 0x7f123c005180 2023-12-17T11:48:44.461 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.422+0000 7f1253fff640 1 --2- 172.21.15.40:0/1916916775 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f123c005180 0x7f123c014190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:44.461 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.422+0000 7f12537fe640 1 --2- 172.21.15.40:0/1916916775 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f123c003970 0x7f123c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:44.461 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.422+0000 7fe1c37fe640 1 -- 172.21.15.40:0/1808517459 <== osd.3 v2:172.21.15.40:6821/974040287 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7fe1ac076f10 con 0x7fe1ac074400 2023-12-17T11:48:44.461 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.423+0000 7f55fdc6c640 1 --2- 172.21.15.40:0/358800057 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f55f815d480 0x7f55f81e9210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:44.462 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.423+0000 7fb5737fe640 1 -- 172.21.15.40:0/1979610805 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb574003da0 con 0x7fb57c15a580 2023-12-17T11:48:44.462 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.423+0000 7fb5737fe640 1 -- 172.21.15.40:0/1979610805 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb574005070 con 0x7fb57c15a580 2023-12-17T11:48:44.462 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.423+0000 7f55fd46b640 1 -- 172.21.15.40:0/358800057 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f55f815d480 msgr2=0x7f55f81e9210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:44.462 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.423+0000 7f55fd46b640 1 --2- 172.21.15.40:0/358800057 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f55f815d480 0x7f55f81e9210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:44.462 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.423+0000 7f55fd46b640 1 -- 172.21.15.40:0/358800057 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f55f80d3dd0 msgr2=0x7f55f81e8cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:44.462 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.423+0000 7f55fd46b640 1 --2- 172.21.15.40:0/358800057 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f55f80d3dd0 0x7f55f81e8cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:44.462 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.423+0000 7f55fd46b640 1 -- 172.21.15.40:0/358800057 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55ec0094d0 con 0x7f55f80cfb80 2023-12-17T11:48:44.463 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.423+0000 7fb5737fe640 1 -- 172.21.15.40:0/1979610805 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb574005420 con 0x7fb57c15a580 2023-12-17T11:48:44.463 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.424+0000 7fb581743640 1 -- 172.21.15.40:0/1979610805 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb57c1eef00 con 0x7fb57c15a580 2023-12-17T11:48:44.463 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.423+0000 7f1252ffd640 1 --2- 172.21.15.40:0/1916916775 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f123c0047c0 0x7f123c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:44.463 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.423+0000 7f1253fff640 1 -- 172.21.15.40:0/1916916775 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f123c003970 msgr2=0x7f123c003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:48:44.463 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.423+0000 7f1253fff640 1 --2- 172.21.15.40:0/1916916775 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f123c003970 0x7f123c003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:44.463 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.423+0000 7f1253fff640 1 -- 172.21.15.40:0/1916916775 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f123c0047c0 msgr2=0x7f123c004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:48:44.464 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.424+0000 7f55fd46b640 1 --2- 172.21.15.40:0/358800057 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f55f80cfb80 0x7f55f80ca240 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f55f000c430 tx=0x7f55f000c8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:48:44.464 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.423+0000 7f7261dd9640 1 --2- 172.21.15.40:0/1473952884 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f725c0d0230 0x7f725c0c9480 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f724c0098c0 tx=0x7f724c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:48:44.464 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.424+0000 7f1253fff640 1 --2- 172.21.15.40:0/1916916775 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f123c0047c0 0x7f123c004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:44.464 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.424+0000 7f1253fff640 1 -- 172.21.15.40:0/1916916775 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f125415e320 con 0x7f123c005180 2023-12-17T11:48:44.465 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.424+0000 7fb581743640 1 -- 172.21.15.40:0/1979610805 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb57c1ef4c0 con 0x7fb57c15a580 2023-12-17T11:48:44.465 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.424+0000 7f72527fc640 1 -- 172.21.15.40:0/1473952884 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f724c003810 con 0x7f725c0d0230 2023-12-17T11:48:44.465 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.424+0000 7f72527fc640 1 -- 172.21.15.40:0/1473952884 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f724c040070 con 0x7f725c0d0230 2023-12-17T11:48:44.465 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.424+0000 7f72527fc640 1 -- 172.21.15.40:0/1473952884 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f724c003b70 con 0x7f725c0d0230 2023-12-17T11:48:44.465 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.424+0000 7f726403d640 1 -- 172.21.15.40:0/1473952884 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f725c1e7cb0 con 0x7f725c0d0230 2023-12-17T11:48:44.465 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.424+0000 7f726403d640 1 -- 172.21.15.40:0/1473952884 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f725c1e8230 con 0x7f725c0d0230 2023-12-17T11:48:44.466 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.424+0000 7f12537fe640 1 --2- 172.21.15.40:0/1916916775 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f123c003970 0x7f123c003d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-17T11:48:44.466 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.424+0000 7f1252ffd640 1 --2- 172.21.15.40:0/1916916775 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f123c0047c0 0x7f123c004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-17T11:48:44.466 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.425+0000 7fb581743640 1 -- 172.21.15.40:0/1979610805 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fb57c0cd330 con 0x7fb57c15a580 2023-12-17T11:48:44.466 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.425+0000 7f55f5ffb640 1 -- 172.21.15.40:0/358800057 <== mon.2 v2:172.21.15.159:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55f0011790 con 0x7f55f80cfb80 2023-12-17T11:48:44.467 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.426+0000 7f55f5ffb640 1 -- 172.21.15.40:0/358800057 <== mon.2 v2:172.21.15.159:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55f00118f0 con 0x7f55f80cfb80 2023-12-17T11:48:44.467 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.426+0000 7f55f5ffb640 1 -- 172.21.15.40:0/358800057 <== mon.2 v2:172.21.15.159:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55f0011ce0 con 0x7f55f80cfb80 2023-12-17T11:48:44.467 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.425+0000 7f1253fff640 1 -- 172.21.15.40:0/1916916775 reap_dead start 2023-12-17T11:48:44.467 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.427+0000 7f55ff6cf640 1 -- 172.21.15.40:0/358800057 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55f80ccf60 con 0x7f55f80cfb80 2023-12-17T11:48:44.467 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.427+0000 7f55ff6cf640 1 -- 172.21.15.40:0/358800057 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55f80cd240 con 0x7f55f80cfb80 2023-12-17T11:48:44.468 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.427+0000 7f1253fff640 1 --2- 172.21.15.40:0/1916916775 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f123c005180 0x7f123c014190 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f124c009d00 tx=0x7f123c0057f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b03ce8c69cbb9ed8 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:48:44.468 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.427+0000 7fe1ca59c640 1 --2- 172.21.15.40:0/1808517459 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7fe1ac06ae40 0x7fe1ac06d300 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fe1b4036000 tx=0x7fe1b4008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:48:44.468 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.428+0000 7f12527fc640 1 -- 172.21.15.40:0/1916916775 <== mon.2 v2:172.21.15.159:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f124c003b90 con 0x7f123c005180 2023-12-17T11:48:44.468 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.428+0000 7f12527fc640 1 -- 172.21.15.40:0/1916916775 <== mon.2 v2:172.21.15.159:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f124c003d30 con 0x7f123c005180 2023-12-17T11:48:44.469 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.428+0000 7f12527fc640 1 -- 172.21.15.40:0/1916916775 <== mon.2 v2:172.21.15.159:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f124c003ea0 con 0x7f123c005180 2023-12-17T11:48:44.469 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.428+0000 7f55ff6cf640 1 -- 172.21.15.40:0/358800057 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f55f80ce710 con 0x7f55f80cfb80 2023-12-17T11:48:44.469 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.429+0000 7f125a04b640 1 -- 172.21.15.40:0/1916916775 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f123c005180 msgr2=0x7f123c014190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:44.469 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.429+0000 7f125a04b640 1 --2- 172.21.15.40:0/1916916775 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f123c005180 0x7f123c014190 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f124c009d00 tx=0x7f123c0057f0 comp rx=0 tx=0).stop 2023-12-17T11:48:44.469 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.428+0000 7fb5737fe640 1 -- 172.21.15.40:0/1979610805 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fb574005580 con 0x7fb57c15a580 2023-12-17T11:48:44.470 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.429+0000 7f726403d640 1 -- 172.21.15.40:0/1473952884 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f7244000fc0 con 0x7f725c0d0230 2023-12-17T11:48:44.470 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.430+0000 7f125a04b640 1 -- 172.21.15.40:0/1916916775 shutdown_connections 2023-12-17T11:48:44.470 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.430+0000 7f125a04b640 1 --2- 172.21.15.40:0/1916916775 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f123c005180 0x7f123c014190 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:44.470 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.430+0000 7f125a04b640 1 -- 172.21.15.40:0/1916916775 >> 172.21.15.40:0/1916916775 conn(0x7f125409c450 msgr2=0x7f12540d3110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:48:44.471 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.430+0000 7fb5737fe640 1 --2- 172.21.15.40:0/1979610805 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7fb55c06d120 0x7fb55c06f5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:44.471 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.430+0000 7fb5737fe640 1 -- 172.21.15.40:0/1979610805 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fb574089650 con 0x7fb57c15a580 2023-12-17T11:48:44.471 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.430+0000 7f125a04b640 1 -- 172.21.15.40:0/1916916775 shutdown_connections 2023-12-17T11:48:44.472 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.430+0000 7fb5737fe640 1 --2- 172.21.15.40:0/1979610805 >> [v2:172.21.15.159:6816/3032505240,v1:172.21.15.159:6817/3032505240] conn(0x7fb55c076760 0x7fb55c078ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:44.472 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.430+0000 7fb5737fe640 1 -- 172.21.15.40:0/1979610805 --> [v2:172.21.15.159:6816/3032505240,v1:172.21.15.159:6817/3032505240] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fb55c079270 con 0x7fb55c076760 2023-12-17T11:48:44.472 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.430+0000 7fb5737fe640 1 -- 172.21.15.40:0/1979610805 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb574089a00 con 0x7fb57c15a580 2023-12-17T11:48:44.472 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.430+0000 7fb57affd640 1 --2- 172.21.15.40:0/1979610805 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7fb55c06d120 0x7fb55c06f5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:44.472 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.430+0000 7f72527fc640 1 -- 172.21.15.40:0/1473952884 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f724c003cd0 con 0x7f725c0d0230 2023-12-17T11:48:44.473 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.433+0000 7f2160ff9640 1 -- 172.21.15.40:0/3417165098 --> [v2:172.21.15.40:6800/555204741,v1:172.21.15.40:6802/555204741] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f2148002cb0 con 0x7f21500744d0 2023-12-17T11:48:44.473 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.432+0000 7f72527fc640 1 --2- 172.21.15.40:0/1473952884 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f724006af40 0x7f724006d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:44.473 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.432+0000 7f72527fc640 1 -- 172.21.15.40:0/1473952884 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f724c042070 con 0x7f725c0d0230 2023-12-17T11:48:44.473 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.432+0000 7f72527fc640 1 --2- 172.21.15.40:0/1473952884 >> [v2:172.21.15.159:6808/3937787733,v1:172.21.15.159:6809/3937787733] conn(0x7f7240074580 0x7f72400769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:44.473 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.432+0000 7f72527fc640 1 -- 172.21.15.40:0/1473952884 --> [v2:172.21.15.159:6808/3937787733,v1:172.21.15.159:6809/3937787733] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f7240077090 con 0x7f7240074580 2023-12-17T11:48:44.473 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.432+0000 7f72527fc640 1 -- 172.21.15.40:0/1473952884 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f724c0ae430 con 0x7f725c0d0230 2023-12-17T11:48:44.473 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.433+0000 7f72615d8640 1 --2- 172.21.15.40:0/1473952884 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f724006af40 0x7f724006d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:44.473 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.433+0000 7f72625da640 1 --2- 172.21.15.40:0/1473952884 >> [v2:172.21.15.159:6808/3937787733,v1:172.21.15.159:6809/3937787733] conn(0x7f7240074580 0x7f72400769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:44.474 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.431+0000 7fb57a7fc640 1 --2- 172.21.15.40:0/1979610805 >> [v2:172.21.15.159:6816/3032505240,v1:172.21.15.159:6817/3032505240] conn(0x7fb55c076760 0x7fb55c078ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:44.474 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.432+0000 7fb57affd640 1 --2- 172.21.15.40:0/1979610805 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7fb55c06d120 0x7fb55c06f5e0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fb564036000 tx=0x7fb56400a000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:48:44.474 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.432+0000 7fb57a7fc640 1 --2- 172.21.15.40:0/1979610805 >> [v2:172.21.15.159:6816/3032505240,v1:172.21.15.159:6817/3032505240] conn(0x7fb55c076760 0x7fb55c078ba0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:48:44.474 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.431+0000 7f55f5ffb640 1 -- 172.21.15.40:0/358800057 <== mon.2 v2:172.21.15.159:3301/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f55f001c460 con 0x7f55f80cfb80 2023-12-17T11:48:44.474 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.433+0000 7f55f5ffb640 1 --2- 172.21.15.40:0/358800057 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f55e406af10 0x7f55e406d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:44.474 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.433+0000 7f55f5ffb640 1 -- 172.21.15.40:0/358800057 <== mon.2 v2:172.21.15.159:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f55f008a2d0 con 0x7f55f80cfb80 2023-12-17T11:48:44.474 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.433+0000 7f55f5ffb640 1 --2- 172.21.15.40:0/358800057 >> [v2:172.21.15.159:6800/2411788597,v1:172.21.15.159:6801/2411788597] conn(0x7f55e4074550 0x7f55e4076990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:44.475 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.433+0000 7f55f5ffb640 1 -- 172.21.15.40:0/358800057 --> [v2:172.21.15.159:6800/2411788597,v1:172.21.15.159:6801/2411788597] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f55e4077060 con 0x7f55e4074550 2023-12-17T11:48:44.475 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.433+0000 7f55f5ffb640 1 -- 172.21.15.40:0/358800057 <== mon.2 v2:172.21.15.159:3301/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f55f008a680 con 0x7f55f80cfb80 2023-12-17T11:48:44.475 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.430+0000 7f125a04b640 1 -- 172.21.15.40:0/1916916775 wait complete. 2023-12-17T11:48:44.475 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.434+0000 7f55fcc6a640 1 --2- 172.21.15.40:0/358800057 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f55e406af10 0x7f55e406d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:44.476 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.434+0000 7f2162ffd640 1 -- 172.21.15.40:0/3417165098 <== osd.0 v2:172.21.15.40:6800/555204741 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f2148002cb0 con 0x7f21500744d0 2023-12-17T11:48:44.476 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.434+0000 7f72615d8640 1 --2- 172.21.15.40:0/1473952884 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f724006af40 0x7f724006d400 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f7258005620 tx=0x7f72580055b0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:48:44.476 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.435+0000 7f72625da640 1 --2- 172.21.15.40:0/1473952884 >> [v2:172.21.15.159:6808/3937787733,v1:172.21.15.159:6809/3937787733] conn(0x7f7240074580 0x7f72400769c0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:48:44.477 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.435+0000 7f2160ff9640 1 -- 172.21.15.40:0/3417165098 >> [v2:172.21.15.40:6800/555204741,v1:172.21.15.40:6802/555204741] conn(0x7f21500744d0 msgr2=0x7f2150076910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:44.477 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.435+0000 7f2160ff9640 1 --2- 172.21.15.40:0/3417165098 >> [v2:172.21.15.40:6800/555204741,v1:172.21.15.40:6802/555204741] conn(0x7f21500744d0 0x7f2150076910 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:44.477 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.435+0000 7f2160ff9640 1 -- 172.21.15.40:0/3417165098 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f215006ae90 msgr2=0x7f215006d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:44.477 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.435+0000 7f2160ff9640 1 --2- 172.21.15.40:0/3417165098 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f215006ae90 0x7f215006d350 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f215c009ac0 tx=0x7f215c008040 comp rx=0 tx=0).stop 2023-12-17T11:48:44.477 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.435+0000 7f2160ff9640 1 -- 172.21.15.40:0/3417165098 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2164038520 msgr2=0x7f21640e1940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:44.477 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.435+0000 7f2160ff9640 1 --2- 172.21.15.40:0/3417165098 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2164038520 0x7f21640e1940 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f216c079b10 tx=0x7f216c069ea0 comp rx=0 tx=0).stop 2023-12-17T11:48:44.477 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.435+0000 7f217289e640 1 -- 172.21.15.40:0/3417165098 reap_dead start 2023-12-17T11:48:44.477 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.436+0000 7f2160ff9640 1 -- 172.21.15.40:0/3417165098 shutdown_connections 2023-12-17T11:48:44.477 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.436+0000 7f2160ff9640 1 -- 172.21.15.40:0/3417165098 >> 172.21.15.40:0/3417165098 conn(0x7f2164009f80 msgr2=0x7f2164034e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:48:44.477 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.436+0000 7f2160ff9640 1 -- 172.21.15.40:0/3417165098 shutdown_connections 2023-12-17T11:48:44.478 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.436+0000 7f2160ff9640 1 -- 172.21.15.40:0/3417165098 wait complete. 2023-12-17T11:48:44.478 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.435+0000 7fb5737fe640 1 -- 172.21.15.40:0/1979610805 <== osd.5 v2:172.21.15.159:6816/3032505240 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7fb55c079270 con 0x7fb55c076760 2023-12-17T11:48:44.478 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.436+0000 7f125a04b640 1 Processor -- start 2023-12-17T11:48:44.479 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.436+0000 7f55fdc6c640 1 --2- 172.21.15.40:0/358800057 >> [v2:172.21.15.159:6800/2411788597,v1:172.21.15.159:6801/2411788597] conn(0x7f55e4074550 0x7f55e4076990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:44.479 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.437+0000 7f55fcc6a640 1 --2- 172.21.15.40:0/358800057 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f55e406af10 0x7f55e406d3d0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f55f80b4b20 tx=0x7f55e8009250 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:48:44.479 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.437+0000 7f72527fc640 1 -- 172.21.15.40:0/1473952884 <== osd.4 v2:172.21.15.159:6808/3937787733 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f7240077090 con 0x7f7240074580 2023-12-17T11:48:44.479 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.437+0000 7f125a04b640 1 -- start start 2023-12-17T11:48:44.480 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.437+0000 7f55fdc6c640 1 --2- 172.21.15.40:0/358800057 >> [v2:172.21.15.159:6800/2411788597,v1:172.21.15.159:6801/2411788597] conn(0x7f55e4074550 0x7f55e4076990 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:48:44.480 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.438+0000 7f125a04b640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f123c005180 0x7f12541ff7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:44.480 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.438+0000 7f125a04b640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f12540b8070 0x7f125415c500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:44.480 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.438+0000 7f125a04b640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f125415ca40 0x7f1254153330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:44.481 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.438+0000 7f125a04b640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12540b6d80 con 0x7f123c005180 2023-12-17T11:48:44.481 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.438+0000 7f125a04b640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12540b6fd0 con 0x7f125415ca40 2023-12-17T11:48:44.481 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.438+0000 7f125a04b640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12540b72b0 con 0x7f12540b8070 2023-12-17T11:48:44.481 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.440+0000 7f55f5ffb640 1 -- 172.21.15.40:0/358800057 <== osd.6 v2:172.21.15.159:6800/2411788597 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f55e4077060 con 0x7f55e4074550 2023-12-17T11:48:44.482 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.439+0000 7f12537fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f123c005180 0x7f12541ff7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:44.483 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.439+0000 7f12537fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f123c005180 0x7f12541ff7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:35450/0 (socket says 172.21.15.40:35450) 2023-12-17T11:48:44.483 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.439+0000 7f12537fe640 1 -- 172.21.15.40:0/275142160 learned_addr learned my addr 172.21.15.40:0/275142160 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-17T11:48:44.483 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.439+0000 7f1252ffd640 1 --2- 172.21.15.40:0/275142160 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f12540b8070 0x7f125415c500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:44.483 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.439+0000 7f12537fe640 1 -- 172.21.15.40:0/275142160 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f12540b8070 msgr2=0x7f125415c500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:44.483 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.439+0000 7f12537fe640 1 --2- 172.21.15.40:0/275142160 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f12540b8070 0x7f125415c500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:44.483 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.439+0000 7f12537fe640 1 -- 172.21.15.40:0/275142160 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f125415ca40 msgr2=0x7f1254153330 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-12-17T11:48:44.483 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.439+0000 7f12537fe640 1 --2- 172.21.15.40:0/275142160 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f125415ca40 0x7f1254153330 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:44.483 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.439+0000 7f12537fe640 1 -- 172.21.15.40:0/275142160 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12540b7590 con 0x7f123c005180 2023-12-17T11:48:44.483 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.440+0000 7f12537fe640 1 --2- 172.21.15.40:0/275142160 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f123c005180 0x7f12541ff7f0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f124400f8b0 tx=0x7f124400fd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:48:44.483 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.440+0000 7f123bfff640 1 -- 172.21.15.40:0/275142160 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12440052e0 con 0x7f123c005180 2023-12-17T11:48:44.483 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.440+0000 7f123bfff640 1 -- 172.21.15.40:0/275142160 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1244005440 con 0x7f123c005180 2023-12-17T11:48:44.483 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.440+0000 7f123bfff640 1 -- 172.21.15.40:0/275142160 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f124400d950 con 0x7f123c005180 2023-12-17T11:48:44.484 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.441+0000 7f125a04b640 1 -- 172.21.15.40:0/275142160 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12540b7870 con 0x7f123c005180 2023-12-17T11:48:44.484 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.441+0000 7f125a04b640 1 -- 172.21.15.40:0/275142160 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f125415cec0 con 0x7f123c005180 2023-12-17T11:48:44.484 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.444+0000 7f123bfff640 1 -- 172.21.15.40:0/275142160 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f124400dab0 con 0x7f123c005180 2023-12-17T11:48:44.484 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.446+0000 7f123bfff640 1 --2- 172.21.15.40:0/275142160 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f124006ae40 0x7f124006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:44.484 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.446+0000 7f123bfff640 1 -- 172.21.15.40:0/275142160 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f1244089b20 con 0x7f123c005180 2023-12-17T11:48:44.484 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.447+0000 7f1252ffd640 1 --2- 172.21.15.40:0/275142160 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f124006ae40 0x7f124006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:44.484 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.447+0000 7f125a04b640 1 --2- 172.21.15.40:0/275142160 >> [v2:172.21.15.159:6824/478953349,v1:172.21.15.159:6825/478953349] conn(0x7f12540b8450 0x7f125415eff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:44.484 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.447+0000 7f125a04b640 1 -- 172.21.15.40:0/275142160 --> [v2:172.21.15.159:6824/478953349,v1:172.21.15.159:6825/478953349] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f125415e8e0 con 0x7f12540b8450 2023-12-17T11:48:44.484 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.449+0000 7f1252ffd640 1 --2- 172.21.15.40:0/275142160 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f124006ae40 0x7f124006d300 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f12540cae70 tx=0x7f1248009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:48:44.484 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.452+0000 7f1253fff640 1 --2- 172.21.15.40:0/275142160 >> [v2:172.21.15.159:6824/478953349,v1:172.21.15.159:6825/478953349] conn(0x7f12540b8450 0x7f125415eff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:44.484 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.454+0000 7fe1cb59e640 1 -- 172.21.15.40:0/1808517459 --> [v2:172.21.15.40:6821/974040287,v1:172.21.15.40:6823/974040287] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fe1cc0afc80 con 0x7fe1ac074400 2023-12-17T11:48:44.485 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.454+0000 7f1253fff640 1 --2- 172.21.15.40:0/275142160 >> [v2:172.21.15.159:6824/478953349,v1:172.21.15.159:6825/478953349] conn(0x7f12540b8450 0x7f125415eff0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:48:44.485 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.455+0000 7fe1c37fe640 1 -- 172.21.15.40:0/1808517459 <== osd.3 v2:172.21.15.40:6821/974040287 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fe1c4009df0 con 0x7fe1ac074400 2023-12-17T11:48:44.486 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.455+0000 7fe1cb59e640 1 -- 172.21.15.40:0/1808517459 >> [v2:172.21.15.40:6821/974040287,v1:172.21.15.40:6823/974040287] conn(0x7fe1ac074400 msgr2=0x7fe1ac076840 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:44.486 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.455+0000 7fe1cb59e640 1 --2- 172.21.15.40:0/1808517459 >> [v2:172.21.15.40:6821/974040287,v1:172.21.15.40:6823/974040287] conn(0x7fe1ac074400 0x7fe1ac076840 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:44.486 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.455+0000 7fe1cb59e640 1 -- 172.21.15.40:0/1808517459 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7fe1ac06ae40 msgr2=0x7fe1ac06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:44.486 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.455+0000 7fe1cb59e640 1 --2- 172.21.15.40:0/1808517459 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7fe1ac06ae40 0x7fe1ac06d300 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fe1b4036000 tx=0x7fe1b4008030 comp rx=0 tx=0).stop 2023-12-17T11:48:44.486 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.455+0000 7fe1cb59e640 1 -- 172.21.15.40:0/1808517459 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe1cc0d0d70 msgr2=0x7fe1cc1fef70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:44.486 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.455+0000 7fe1cb59e640 1 --2- 172.21.15.40:0/1808517459 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe1cc0d0d70 0x7fe1cc1fef70 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fe1bc00b4a0 tx=0x7fe1bc00b960 comp rx=0 tx=0).stop 2023-12-17T11:48:44.487 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.455+0000 7fe1cad9d640 1 -- 172.21.15.40:0/1808517459 reap_dead start 2023-12-17T11:48:44.487 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.455+0000 7fe1cb59e640 1 -- 172.21.15.40:0/1808517459 shutdown_connections 2023-12-17T11:48:44.487 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.455+0000 7fe1cb59e640 1 -- 172.21.15.40:0/1808517459 >> 172.21.15.40:0/1808517459 conn(0x7fe1cc09c260 msgr2=0x7fe1cc0b05b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:48:44.487 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.455+0000 7fe1cb59e640 1 -- 172.21.15.40:0/1808517459 shutdown_connections 2023-12-17T11:48:44.487 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.456+0000 7fe1cb59e640 1 -- 172.21.15.40:0/1808517459 wait complete. 2023-12-17T11:48:44.487 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.457+0000 7f123bfff640 1 -- 172.21.15.40:0/275142160 <== osd.7 v2:172.21.15.159:6824/478953349 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f124c000fb0 con 0x7f12540b8450 2023-12-17T11:48:44.487 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.461+0000 7f3e6b59e640 1 -- 172.21.15.40:0/116405307 --> [v2:172.21.15.40:6816/1959000265,v1:172.21.15.40:6817/1959000265] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f3e50002cb0 con 0x7f3e4c074550 2023-12-17T11:48:44.488 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.461+0000 7ff61ae72640 1 -- 172.21.15.40:0/599199872 --> [v2:172.21.15.40:6801/1221318112,v1:172.21.15.40:6803/1221318112] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7ff6140b2fe0 con 0x7ff600074550 2023-12-17T11:48:44.488 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.462+0000 7f3e5affd640 1 -- 172.21.15.40:0/116405307 <== osd.2 v2:172.21.15.40:6816/1959000265 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f3e50002cb0 con 0x7f3e4c074550 2023-12-17T11:48:44.489 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.463+0000 7f3e6b59e640 1 -- 172.21.15.40:0/116405307 >> [v2:172.21.15.40:6816/1959000265,v1:172.21.15.40:6817/1959000265] conn(0x7f3e4c074550 msgr2=0x7f3e4c076990 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:44.489 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.463+0000 7f3e6b59e640 1 --2- 172.21.15.40:0/116405307 >> [v2:172.21.15.40:6816/1959000265,v1:172.21.15.40:6817/1959000265] conn(0x7f3e4c074550 0x7f3e4c076990 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:44.489 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.463+0000 7f3e6b59e640 1 -- 172.21.15.40:0/116405307 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f3e4c06af10 msgr2=0x7f3e4c06d3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:44.489 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.463+0000 7f3e6b59e640 1 --2- 172.21.15.40:0/116405307 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f3e4c06af10 0x7f3e4c06d3d0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f3e60035000 tx=0x7f3e60008030 comp rx=0 tx=0).stop 2023-12-17T11:48:44.490 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.463+0000 7f3e6b59e640 1 -- 172.21.15.40:0/116405307 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3e6403c070 msgr2=0x7f3e64039d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:44.490 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.463+0000 7f3e6b59e640 1 --2- 172.21.15.40:0/116405307 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3e6403c070 0x7f3e64039d00 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f3e5c00c410 tx=0x7f3e5c00c8d0 comp rx=0 tx=0).stop 2023-12-17T11:48:44.490 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.463+0000 7f3e6ad9d640 1 -- 172.21.15.40:0/116405307 reap_dead start 2023-12-17T11:48:44.490 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.464+0000 7f3e6b59e640 1 -- 172.21.15.40:0/116405307 shutdown_connections 2023-12-17T11:48:44.490 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.464+0000 7f3e6b59e640 1 -- 172.21.15.40:0/116405307 >> 172.21.15.40:0/116405307 conn(0x7f3e64058eb0 msgr2=0x7f3e640e6c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:48:44.490 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.462+0000 7ff6097fa640 1 -- 172.21.15.40:0/599199872 <== osd.1 v2:172.21.15.40:6801/1221318112 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7ff60c034440 con 0x7ff600074550 2023-12-17T11:48:44.491 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.465+0000 7f3e6b59e640 1 -- 172.21.15.40:0/116405307 shutdown_connections 2023-12-17T11:48:44.491 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.465+0000 7f3e6b59e640 1 -- 172.21.15.40:0/116405307 wait complete. 2023-12-17T11:48:44.491 INFO:teuthology.orchestra.run.smithi040.stdout:60129542154 2023-12-17T11:48:44.492 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.465+0000 7ff61ae72640 1 -- 172.21.15.40:0/599199872 >> [v2:172.21.15.40:6801/1221318112,v1:172.21.15.40:6803/1221318112] conn(0x7ff600074550 msgr2=0x7ff600076990 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:44.492 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.465+0000 7ff61ae72640 1 --2- 172.21.15.40:0/599199872 >> [v2:172.21.15.40:6801/1221318112,v1:172.21.15.40:6803/1221318112] conn(0x7ff600074550 0x7ff600076990 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:44.492 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-12-17T11:48:44.493 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.466+0000 7ff61ae72640 1 -- 172.21.15.40:0/599199872 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7ff60006af10 msgr2=0x7ff60006d3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:44.493 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.466+0000 7ff61ae72640 1 --2- 172.21.15.40:0/599199872 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7ff60006af10 0x7ff60006d3d0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7ff6040011e0 tx=0x7ff604009040 comp rx=0 tx=0).stop 2023-12-17T11:48:44.493 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.466+0000 7ff61ae72640 1 -- 172.21.15.40:0/599199872 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff61406d330 msgr2=0x7ff61409c140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:44.493 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.466+0000 7ff61ae72640 1 --2- 172.21.15.40:0/599199872 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff61406d330 0x7ff61409c140 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7ff61000c4d0 tx=0x7ff61000c990 comp rx=0 tx=0).stop 2023-12-17T11:48:44.493 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.466+0000 7ff61940f640 1 -- 172.21.15.40:0/599199872 reap_dead start 2023-12-17T11:48:44.493 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.466+0000 7ff61ae72640 1 -- 172.21.15.40:0/599199872 shutdown_connections 2023-12-17T11:48:44.494 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.466+0000 7ff61ae72640 1 -- 172.21.15.40:0/599199872 >> 172.21.15.40:0/599199872 conn(0x7ff6140b0940 msgr2=0x7ff6140af4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:48:44.494 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.467+0000 7ff61ae72640 1 -- 172.21.15.40:0/599199872 shutdown_connections 2023-12-17T11:48:44.494 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.467+0000 7ff61ae72640 1 -- 172.21.15.40:0/599199872 wait complete. 2023-12-17T11:48:44.494 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.467+0000 7fb581743640 1 -- 172.21.15.40:0/1979610805 --> [v2:172.21.15.159:6816/3032505240,v1:172.21.15.159:6817/3032505240] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fb57c0cd050 con 0x7fb55c076760 2023-12-17T11:48:44.494 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.469+0000 7fb5737fe640 1 -- 172.21.15.40:0/1979610805 <== osd.5 v2:172.21.15.159:6816/3032505240 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fb56c0095b0 con 0x7fb55c076760 2023-12-17T11:48:44.495 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.469+0000 7fb581743640 1 -- 172.21.15.40:0/1979610805 >> [v2:172.21.15.159:6816/3032505240,v1:172.21.15.159:6817/3032505240] conn(0x7fb55c076760 msgr2=0x7fb55c078ba0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:44.495 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.469+0000 7fb581743640 1 --2- 172.21.15.40:0/1979610805 >> [v2:172.21.15.159:6816/3032505240,v1:172.21.15.159:6817/3032505240] conn(0x7fb55c076760 0x7fb55c078ba0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:44.495 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.470+0000 7fb581743640 1 -- 172.21.15.40:0/1979610805 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7fb55c06d120 msgr2=0x7fb55c06f5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:44.495 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.470+0000 7fb581743640 1 --2- 172.21.15.40:0/1979610805 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7fb55c06d120 0x7fb55c06f5e0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fb564036000 tx=0x7fb56400a000 comp rx=0 tx=0).stop 2023-12-17T11:48:44.495 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.470+0000 7fb581743640 1 -- 172.21.15.40:0/1979610805 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb57c15a580 msgr2=0x7fb57c15bef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:44.495 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.470+0000 7fb581743640 1 --2- 172.21.15.40:0/1979610805 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb57c15a580 0x7fb57c15bef0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fb57400c7e0 tx=0x7fb57400cca0 comp rx=0 tx=0).stop 2023-12-17T11:48:44.495 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.470+0000 7fb57b7fe640 1 -- 172.21.15.40:0/1979610805 reap_dead start 2023-12-17T11:48:44.496 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.470+0000 7f726403d640 1 -- 172.21.15.40:0/1473952884 --> [v2:172.21.15.159:6808/3937787733,v1:172.21.15.159:6809/3937787733] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f7244002cb0 con 0x7f7240074580 2023-12-17T11:48:44.496 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.471+0000 7fb581743640 1 -- 172.21.15.40:0/1979610805 shutdown_connections 2023-12-17T11:48:44.496 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.471+0000 7fb581743640 1 -- 172.21.15.40:0/1979610805 >> 172.21.15.40:0/1979610805 conn(0x7fb57c0b0a90 msgr2=0x7fb57c0ced00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:48:44.496 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.471+0000 7fb581743640 1 -- 172.21.15.40:0/1979610805 shutdown_connections 2023-12-17T11:48:44.497 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.472+0000 7f72527fc640 1 -- 172.21.15.40:0/1473952884 <== osd.4 v2:172.21.15.159:6808/3937787733 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f7244002cb0 con 0x7f7240074580 2023-12-17T11:48:44.497 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.472+0000 7f726403d640 1 -- 172.21.15.40:0/1473952884 >> [v2:172.21.15.159:6808/3937787733,v1:172.21.15.159:6809/3937787733] conn(0x7f7240074580 msgr2=0x7f72400769c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:44.498 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.472+0000 7f726403d640 1 --2- 172.21.15.40:0/1473952884 >> [v2:172.21.15.159:6808/3937787733,v1:172.21.15.159:6809/3937787733] conn(0x7f7240074580 0x7f72400769c0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:44.498 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.473+0000 7f726403d640 1 -- 172.21.15.40:0/1473952884 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f724006af40 msgr2=0x7f724006d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:44.498 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.473+0000 7f726403d640 1 --2- 172.21.15.40:0/1473952884 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f724006af40 0x7f724006d400 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f7258005620 tx=0x7f72580055b0 comp rx=0 tx=0).stop 2023-12-17T11:48:44.498 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.473+0000 7f726403d640 1 -- 172.21.15.40:0/1473952884 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f725c0d0230 msgr2=0x7f725c0c9480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:44.498 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.473+0000 7f726403d640 1 --2- 172.21.15.40:0/1473952884 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f725c0d0230 0x7f725c0c9480 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f724c0098c0 tx=0x7f724c0046c0 comp rx=0 tx=0).stop 2023-12-17T11:48:44.498 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.473+0000 7f72625da640 1 -- 172.21.15.40:0/1473952884 reap_dead start 2023-12-17T11:48:44.498 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.474+0000 7fb581743640 1 -- 172.21.15.40:0/1979610805 wait complete. 2023-12-17T11:48:44.498 INFO:teuthology.orchestra.run.smithi040.stdout:60129542154 2023-12-17T11:48:44.499 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.474+0000 7f726403d640 1 -- 172.21.15.40:0/1473952884 shutdown_connections 2023-12-17T11:48:44.499 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-12-17T11:48:44.500 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.474+0000 7f55ff6cf640 1 -- 172.21.15.40:0/358800057 --> [v2:172.21.15.159:6800/2411788597,v1:172.21.15.159:6801/2411788597] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f55f80ce430 con 0x7f55e4074550 2023-12-17T11:48:44.500 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.474+0000 7f726403d640 1 -- 172.21.15.40:0/1473952884 >> 172.21.15.40:0/1473952884 conn(0x7f725c09c450 msgr2=0x7f725c06b540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:48:44.500 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.475+0000 7f726403d640 1 -- 172.21.15.40:0/1473952884 shutdown_connections 2023-12-17T11:48:44.500 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.475+0000 7f726403d640 1 -- 172.21.15.40:0/1473952884 wait complete. 2023-12-17T11:48:44.501 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.476+0000 7f55f5ffb640 1 -- 172.21.15.40:0/358800057 <== osd.6 v2:172.21.15.159:6800/2411788597 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f55ec031bc0 con 0x7f55e4074550 2023-12-17T11:48:44.502 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.478+0000 7f55ff6cf640 1 -- 172.21.15.40:0/358800057 >> [v2:172.21.15.159:6800/2411788597,v1:172.21.15.159:6801/2411788597] conn(0x7f55e4074550 msgr2=0x7f55e4076990 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:44.502 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.478+0000 7f55ff6cf640 1 --2- 172.21.15.40:0/358800057 >> [v2:172.21.15.159:6800/2411788597,v1:172.21.15.159:6801/2411788597] conn(0x7f55e4074550 0x7f55e4076990 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:44.502 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.478+0000 7f55ff6cf640 1 -- 172.21.15.40:0/358800057 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f55e406af10 msgr2=0x7f55e406d3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:44.502 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.478+0000 7f55ff6cf640 1 --2- 172.21.15.40:0/358800057 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f55e406af10 0x7f55e406d3d0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f55f80b4b20 tx=0x7f55e8009250 comp rx=0 tx=0).stop 2023-12-17T11:48:44.502 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.478+0000 7f55ff6cf640 1 -- 172.21.15.40:0/358800057 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f55f80cfb80 msgr2=0x7f55f80ca240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:44.502 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.478+0000 7f55ff6cf640 1 --2- 172.21.15.40:0/358800057 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f55f80cfb80 0x7f55f80ca240 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f55f000c430 tx=0x7f55f000c8f0 comp rx=0 tx=0).stop 2023-12-17T11:48:44.502 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.478+0000 7f55fdc6c640 1 -- 172.21.15.40:0/358800057 reap_dead start 2023-12-17T11:48:44.502 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.479+0000 7f55ff6cf640 1 -- 172.21.15.40:0/358800057 shutdown_connections 2023-12-17T11:48:44.502 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.479+0000 7f55ff6cf640 1 -- 172.21.15.40:0/358800057 >> 172.21.15.40:0/358800057 conn(0x7f55f809c4b0 msgr2=0x7f55f8160400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:48:44.502 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.479+0000 7f55ff6cf640 1 -- 172.21.15.40:0/358800057 shutdown_connections 2023-12-17T11:48:44.502 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.479+0000 7f55ff6cf640 1 -- 172.21.15.40:0/358800057 wait complete. 2023-12-17T11:48:44.503 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.488+0000 7f125a04b640 1 -- 172.21.15.40:0/275142160 --> [v2:172.21.15.159:6824/478953349,v1:172.21.15.159:6825/478953349] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f125415ed80 con 0x7f12540b8450 2023-12-17T11:48:44.503 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.489+0000 7f123bfff640 1 -- 172.21.15.40:0/275142160 <== osd.7 v2:172.21.15.159:6824/478953349 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f124c003990 con 0x7f12540b8450 2023-12-17T11:48:44.504 INFO:teuthology.orchestra.run.smithi040.stdout:60129542155 2023-12-17T11:48:44.504 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-12-17T11:48:44.505 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.490+0000 7f125a04b640 1 -- 172.21.15.40:0/275142160 >> [v2:172.21.15.159:6824/478953349,v1:172.21.15.159:6825/478953349] conn(0x7f12540b8450 msgr2=0x7f125415eff0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:44.505 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.490+0000 7f125a04b640 1 --2- 172.21.15.40:0/275142160 >> [v2:172.21.15.159:6824/478953349,v1:172.21.15.159:6825/478953349] conn(0x7f12540b8450 0x7f125415eff0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:44.506 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.490+0000 7f125a04b640 1 -- 172.21.15.40:0/275142160 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f124006ae40 msgr2=0x7f124006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:44.506 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.490+0000 7f125a04b640 1 --2- 172.21.15.40:0/275142160 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f124006ae40 0x7f124006d300 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f12540cae70 tx=0x7f1248009040 comp rx=0 tx=0).stop 2023-12-17T11:48:44.506 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.490+0000 7f125a04b640 1 -- 172.21.15.40:0/275142160 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f123c005180 msgr2=0x7f12541ff7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:44.506 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.490+0000 7f125a04b640 1 --2- 172.21.15.40:0/275142160 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f123c005180 0x7f12541ff7f0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f124400f8b0 tx=0x7f124400fd70 comp rx=0 tx=0).stop 2023-12-17T11:48:44.506 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.490+0000 7f1253fff640 1 -- 172.21.15.40:0/275142160 reap_dead start 2023-12-17T11:48:44.506 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.490+0000 7f125a04b640 1 -- 172.21.15.40:0/275142160 shutdown_connections 2023-12-17T11:48:44.506 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.490+0000 7f125a04b640 1 -- 172.21.15.40:0/275142160 >> 172.21.15.40:0/275142160 conn(0x7f125409c450 msgr2=0x7f12540cf360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:48:44.506 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.490+0000 7f125a04b640 1 -- 172.21.15.40:0/275142160 shutdown_connections 2023-12-17T11:48:44.506 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.490+0000 7f125a04b640 1 -- 172.21.15.40:0/275142160 wait complete. 2023-12-17T11:48:44.507 INFO:teuthology.orchestra.run.smithi040.stdout:60129542154 2023-12-17T11:48:44.507 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-12-17T11:48:44.508 INFO:teuthology.orchestra.run.smithi040.stdout:60129542154 2023-12-17T11:48:44.508 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-12-17T11:48:44.509 INFO:teuthology.orchestra.run.smithi040.stdout:60129542155 2023-12-17T11:48:44.510 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-12-17T11:48:44.510 INFO:teuthology.orchestra.run.smithi040.stdout:60129542155 2023-12-17T11:48:44.511 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-12-17T11:48:44.511 INFO:teuthology.orchestra.run.smithi040.stdout:60129542155 2023-12-17T11:48:44.512 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-12-17T11:48:44.808 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.805+0000 7fe46ee1e640 1 Processor -- start 2023-12-17T11:48:44.808 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.805+0000 7fe46ee1e640 1 -- start start 2023-12-17T11:48:44.809 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.807+0000 7f380aec9640 1 Processor -- start 2023-12-17T11:48:44.810 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.808+0000 7fe46ee1e640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7fe4680b1430 0x7fe46806d230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:44.810 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.808+0000 7fe46ee1e640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4680ce9f0 con 0x7fe4680cbd10 2023-12-17T11:48:44.810 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.808+0000 7fe46ee1e640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe46815dda0 con 0x7fe46806d770 2023-12-17T11:48:44.810 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.808+0000 7fe46ee1e640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4680b3000 con 0x7fe4680b1430 2023-12-17T11:48:44.810 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.808+0000 7fe46d3bb640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fe4680cbd10 0x7fe4680ccab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:40026/0 (socket says 172.21.15.40:40026) 2023-12-17T11:48:44.811 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.808+0000 7fe46cbba640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7fe4680b1430 0x7fe46806d230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:44.811 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.808+0000 7fe46cbba640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7fe4680b1430 0x7fe46806d230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.40:39508/0 (socket says 172.21.15.40:39508) 2023-12-17T11:48:44.811 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.808+0000 7fe46cbba640 1 -- 172.21.15.40:0/4105007324 learned_addr learned my addr 172.21.15.40:0/4105007324 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-17T11:48:44.811 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.808+0000 7fe467fff640 1 --1- 172.21.15.40:0/4105007324 >> v1:172.21.15.159:6789/0 conn(0x7fe46806d770 0x7fe4680cb600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.159:6789/0 says I am v1:172.21.15.40:53900/0 (socket says 172.21.15.40:53900) 2023-12-17T11:48:44.812 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.808+0000 7f380aec9640 1 -- start start 2023-12-17T11:48:44.812 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.809+0000 7fe46cbba640 1 -- 172.21.15.40:0/4105007324 >> v1:172.21.15.159:6789/0 conn(0x7fe46806d770 legacy=0x7fe4680cb600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:48:44.812 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.809+0000 7fe46cbba640 1 -- 172.21.15.40:0/4105007324 >> v1:172.21.15.40:6789/0 conn(0x7fe4680cbd10 legacy=0x7fe4680ccab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:44.812 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.809+0000 7fe46cbba640 1 -- 172.21.15.40:0/4105007324 --> v2:172.21.15.159:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4680b32e0 con 0x7fe4680b1430 2023-12-17T11:48:44.813 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.810+0000 7f380aec9640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f380415f260 0x7f38040ccb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:44.813 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.811+0000 7f6d998da640 1 Processor -- start 2023-12-17T11:48:44.814 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.811+0000 7f380aec9640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f38040708d0 0x7f380416b1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:44.814 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.811+0000 7f380aec9640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38040cde40 con 0x7f38041626b0 2023-12-17T11:48:44.814 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.811+0000 7f380aec9640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38040cd040 con 0x7f380415f260 2023-12-17T11:48:44.814 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.811+0000 7f380aec9640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f380415f640 con 0x7f38040708d0 2023-12-17T11:48:44.814 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.812+0000 7f3808c65640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f380415f260 0x7f38040ccb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:44.815 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.811+0000 7f6d998da640 1 -- start start 2023-12-17T11:48:44.815 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.812+0000 7f3808c65640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f380415f260 0x7f38040ccb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:35456/0 (socket says 172.21.15.40:35456) 2023-12-17T11:48:44.815 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.812+0000 7f3808c65640 1 -- 172.21.15.40:0/3030245864 learned_addr learned my addr 172.21.15.40:0/3030245864 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-17T11:48:44.815 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.812+0000 7fe46cbba640 1 --2- 172.21.15.40:0/4105007324 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe4680b1430 0x7fe46806d230 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fe45c009870 tx=0x7fe45c02b7e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=25a2c8d22dd22c9b server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:48:44.816 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.812+0000 7f3809466640 1 --2- 172.21.15.40:0/3030245864 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f38040708d0 0x7f380416b1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:44.816 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.813+0000 7fe4677fe640 1 -- 172.21.15.40:0/4105007324 <== mon.1 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe45c004230 con 0x7fe4680b1430 2023-12-17T11:48:44.816 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.813+0000 7fe4677fe640 1 -- 172.21.15.40:0/4105007324 <== mon.1 v2:172.21.15.159:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe45c02e050 con 0x7fe4680b1430 2023-12-17T11:48:44.816 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.813+0000 7fe4677fe640 1 -- 172.21.15.40:0/4105007324 <== mon.1 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe45c003610 con 0x7fe4680b1430 2023-12-17T11:48:44.817 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.814+0000 7f38037fe640 1 -- 172.21.15.40:0/3030245864 <== mon.1 v1:172.21.15.159:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2368190446 0 0) 0x7f38040cde40 con 0x7f38041626b0 2023-12-17T11:48:44.817 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.814+0000 7fdf5d7e5640 1 Processor -- start 2023-12-17T11:48:44.817 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.814+0000 7fe46ee1e640 1 -- 172.21.15.40:0/4105007324 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe4680b1430 msgr2=0x7fe46806d230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:44.817 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.814+0000 7fe46ee1e640 1 --2- 172.21.15.40:0/4105007324 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe4680b1430 0x7fe46806d230 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fe45c009870 tx=0x7fe45c02b7e0 comp rx=0 tx=0).stop 2023-12-17T11:48:44.818 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.814+0000 7f3808c65640 1 -- 172.21.15.40:0/3030245864 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f38040708d0 msgr2=0x7f380416b1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:48:44.818 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.814+0000 7f3808c65640 1 --2- 172.21.15.40:0/3030245864 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f38040708d0 0x7f380416b1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:44.818 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.814+0000 7f3808c65640 1 -- 172.21.15.40:0/3030245864 >> v1:172.21.15.159:6789/0 conn(0x7f38041626b0 legacy=0x7f38040701c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:44.818 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.814+0000 7f3808c65640 1 -- 172.21.15.40:0/3030245864 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3804162b40 con 0x7f380415f260 2023-12-17T11:48:44.818 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.814+0000 7fe46ee1e640 1 -- 172.21.15.40:0/4105007324 shutdown_connections 2023-12-17T11:48:44.818 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.814+0000 7fe46ee1e640 1 --2- 172.21.15.40:0/4105007324 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe4680b1430 0x7fe46806d230 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:44.819 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.814+0000 7fe46ee1e640 1 -- 172.21.15.40:0/4105007324 >> 172.21.15.40:0/4105007324 conn(0x7fe4680b0940 msgr2=0x7fe4680b0d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:48:44.819 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.814+0000 7fdf5d7e5640 1 -- start start 2023-12-17T11:48:44.819 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.815+0000 7fe46ee1e640 1 -- 172.21.15.40:0/4105007324 shutdown_connections 2023-12-17T11:48:44.820 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.815+0000 7f6d998da640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6d8c0e3090 0x7f6d8c057d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:44.820 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.815+0000 7f6d998da640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f6d8c03e810 0x7f6d8c053bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:44.820 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.816+0000 7f6d998da640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d8c0582a0 con 0x7f6d8c054100 2023-12-17T11:48:44.820 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.816+0000 7f6d998da640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d8c054590 con 0x7f6d8c03e810 2023-12-17T11:48:44.820 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.816+0000 7f6d998da640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d8c006170 con 0x7f6d8c0e3090 2023-12-17T11:48:44.820 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.816+0000 7f6d93fff640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f6d8c03e810 0x7f6d8c053bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:44.820 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.816+0000 7fdf5d7e5640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7fdf5815f260 0x7fdf580ccb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:44.820 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.816+0000 7fdf5d7e5640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fdf581626b0 0x7fdf580701c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:44.820 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.816+0000 7fdf5d7e5640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf58070b60 con 0x7fdf58070700 2023-12-17T11:48:44.821 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.816+0000 7f6d988d8640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6d8c0e3090 0x7f6d8c057d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:44.821 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.816+0000 7fdf5d7e5640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf580cd040 con 0x7fdf581626b0 2023-12-17T11:48:44.821 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.816+0000 7fdf5d7e5640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf5815f640 con 0x7fdf5815f260 2023-12-17T11:48:44.821 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.816+0000 7f6d988d8640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6d8c0e3090 0x7f6d8c057d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3301/0 says I am v2:172.21.15.40:55872/0 (socket says 172.21.15.40:55872) 2023-12-17T11:48:44.821 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.816+0000 7f6d988d8640 1 -- 172.21.15.40:0/3342035537 learned_addr learned my addr 172.21.15.40:0/3342035537 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-17T11:48:44.822 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.815+0000 7fe46ee1e640 1 -- 172.21.15.40:0/4105007324 wait complete. 2023-12-17T11:48:44.822 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.817+0000 7fdf567fc640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fdf581626b0 0x7fdf580701c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:44.822 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.817+0000 7fdf567fc640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fdf581626b0 0x7fdf580701c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:35472/0 (socket says 172.21.15.40:35472) 2023-12-17T11:48:44.822 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.817+0000 7fdf567fc640 1 -- 172.21.15.40:0/3720446812 learned_addr learned my addr 172.21.15.40:0/3720446812 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-17T11:48:44.822 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.817+0000 7fdf56ffd640 1 --2- 172.21.15.40:0/3720446812 >> v2:172.21.15.159:3300/0 conn(0x7fdf5815f260 0x7fdf580ccb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:44.823 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.817+0000 7f3808c65640 1 --2- 172.21.15.40:0/3030245864 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f380415f260 0x7f38040ccb00 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f37f40098a0 tx=0x7f37f402b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b40185994fd0f0b4 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:48:44.823 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.818+0000 7fe46ee1e640 1 Processor -- start 2023-12-17T11:48:44.823 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.817+0000 7f6d988d8640 1 -- 172.21.15.40:0/3342035537 >> v2:172.21.15.159:3300/0 conn(0x7f6d8c03e810 msgr2=0x7f6d8c053bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:48:44.824 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.817+0000 7f6d988d8640 1 --2- 172.21.15.40:0/3342035537 >> v2:172.21.15.159:3300/0 conn(0x7f6d8c03e810 0x7f6d8c053bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:44.824 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.817+0000 7f6d988d8640 1 -- 172.21.15.40:0/3342035537 >> v1:172.21.15.40:6789/0 conn(0x7f6d8c054100 legacy=0x7f6d8c0e6c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:48:44.824 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.818+0000 7f6d988d8640 1 -- 172.21.15.40:0/3342035537 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d8c058540 con 0x7f6d8c0e3090 2023-12-17T11:48:44.824 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.818+0000 7fe46ee1e640 1 -- start start 2023-12-17T11:48:44.824 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.819+0000 7f38037fe640 1 -- 172.21.15.40:0/3030245864 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37f4030840 con 0x7f380415f260 2023-12-17T11:48:44.825 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.820+0000 7f38037fe640 1 -- 172.21.15.40:0/3030245864 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37f40309a0 con 0x7f380415f260 2023-12-17T11:48:44.825 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.820+0000 7f38037fe640 1 -- 172.21.15.40:0/3030245864 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37f4030840 con 0x7f380415f260 2023-12-17T11:48:44.825 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.818+0000 7fdf56ffd640 1 -- 172.21.15.40:0/3720446812 >> v2:172.21.15.40:3300/0 conn(0x7fdf581626b0 msgr2=0x7fdf580701c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:48:44.825 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.818+0000 7fdf56ffd640 1 --2- 172.21.15.40:0/3720446812 >> v2:172.21.15.40:3300/0 conn(0x7fdf581626b0 0x7fdf580701c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:44.825 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.819+0000 7fdf56ffd640 1 -- 172.21.15.40:0/3720446812 >> v1:172.21.15.40:6789/0 conn(0x7fdf58070700 legacy=0x7fdf5806c510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:44.825 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.819+0000 7fdf56ffd640 1 -- 172.21.15.40:0/3720446812 --> v2:172.21.15.159:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf580cde40 con 0x7fdf5815f260 2023-12-17T11:48:44.826 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.820+0000 7f6d988d8640 1 --2- 172.21.15.40:0/3342035537 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6d8c0e3090 0x7f6d8c057d60 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f6d88009870 tx=0x7f6d8802ba30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cad7e94b1ece313c server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:48:44.826 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.820+0000 7fdf56ffd640 1 --2- 172.21.15.40:0/3720446812 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdf5815f260 0x7fdf580ccb00 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fdf580b1710 tx=0x7fdf4802b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7857a464a276f7e2 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:48:44.826 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.821+0000 7fe46ee1e640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe46806d770 0x7fe468141ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:44.827 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.821+0000 7f6d937fe640 1 -- 172.21.15.40:0/3342035537 <== mon.2 v2:172.21.15.159:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d8802f850 con 0x7f6d8c0e3090 2023-12-17T11:48:44.827 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.821+0000 7f6d937fe640 1 -- 172.21.15.40:0/3342035537 <== mon.2 v2:172.21.15.159:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d8802f9b0 con 0x7f6d8c0e3090 2023-12-17T11:48:44.827 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.821+0000 7fdf55ffb640 1 -- 172.21.15.40:0/3720446812 <== mon.1 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf48031830 con 0x7fdf5815f260 2023-12-17T11:48:44.827 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.821+0000 7f6d937fe640 1 -- 172.21.15.40:0/3342035537 <== mon.2 v2:172.21.15.159:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d8802fd80 con 0x7f6d8c0e3090 2023-12-17T11:48:44.827 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.821+0000 7fdf55ffb640 1 -- 172.21.15.40:0/3720446812 <== mon.1 v2:172.21.15.159:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf48031990 con 0x7fdf5815f260 2023-12-17T11:48:44.828 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.821+0000 7fdf55ffb640 1 -- 172.21.15.40:0/3720446812 <== mon.1 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf48031d20 con 0x7fdf5815f260 2023-12-17T11:48:44.828 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.821+0000 7f380aec9640 1 -- 172.21.15.40:0/3030245864 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f380415f260 msgr2=0x7f38040ccb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:44.828 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.821+0000 7f380aec9640 1 --2- 172.21.15.40:0/3030245864 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f380415f260 0x7f38040ccb00 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f37f40098a0 tx=0x7f37f402b980 comp rx=0 tx=0).stop 2023-12-17T11:48:44.829 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.821+0000 7fe46ee1e640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe4680b1430 0x7fe468152780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:44.829 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.821+0000 7fe46ee1e640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe4680cbd10 0x7fe468152cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:44.829 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.821+0000 7fe46ee1e640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe46809c5e0 con 0x7fe46806d770 2023-12-17T11:48:44.829 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.821+0000 7fe46ee1e640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4681523d0 con 0x7fe4680cbd10 2023-12-17T11:48:44.829 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.821+0000 7fe46ee1e640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe46809b9a0 con 0x7fe4680b1430 2023-12-17T11:48:44.829 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.822+0000 7f380aec9640 1 -- 172.21.15.40:0/3030245864 shutdown_connections 2023-12-17T11:48:44.829 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.822+0000 7f380aec9640 1 --2- 172.21.15.40:0/3030245864 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f38040708d0 0x7f380416b1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:44.829 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.822+0000 7f380aec9640 1 --2- 172.21.15.40:0/3030245864 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f380415f260 0x7f38040ccb00 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:44.830 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.822+0000 7f380aec9640 1 -- 172.21.15.40:0/3030245864 >> 172.21.15.40:0/3030245864 conn(0x7f38040b0a90 msgr2=0x7f38040b0e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:48:44.830 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.822+0000 7fe46cbba640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe46806d770 0x7fe468141ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:44.830 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.822+0000 7f6d998da640 1 -- 172.21.15.40:0/3342035537 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6d8c0e3090 msgr2=0x7f6d8c057d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:44.830 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.822+0000 7f6d998da640 1 --2- 172.21.15.40:0/3342035537 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6d8c0e3090 0x7f6d8c057d60 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f6d88009870 tx=0x7f6d8802ba30 comp rx=0 tx=0).stop 2023-12-17T11:48:44.830 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.822+0000 7f380aec9640 1 -- 172.21.15.40:0/3030245864 shutdown_connections 2023-12-17T11:48:44.831 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.822+0000 7fdf5d7e5640 1 -- 172.21.15.40:0/3720446812 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdf5815f260 msgr2=0x7fdf580ccb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:44.831 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.822+0000 7f380aec9640 1 -- 172.21.15.40:0/3030245864 wait complete. 2023-12-17T11:48:44.831 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.822+0000 7fe46cbba640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe46806d770 0x7fe468141ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:35476/0 (socket says 172.21.15.40:35476) 2023-12-17T11:48:44.831 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.822+0000 7fe46cbba640 1 -- 172.21.15.40:0/3380796404 learned_addr learned my addr 172.21.15.40:0/3380796404 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-17T11:48:44.832 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.823+0000 7fe46cbba640 1 -- 172.21.15.40:0/3380796404 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe4680b1430 msgr2=0x7fe468152780 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-17T11:48:44.832 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.823+0000 7fe46cbba640 1 --2- 172.21.15.40:0/3380796404 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe4680b1430 0x7fe468152780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:44.832 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.823+0000 7fe46cbba640 1 -- 172.21.15.40:0/3380796404 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe4680cbd10 msgr2=0x7fe468152cc0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-12-17T11:48:44.832 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.823+0000 7fe46cbba640 1 --2- 172.21.15.40:0/3380796404 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe4680cbd10 0x7fe468152cc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:44.832 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.823+0000 7fe46cbba640 1 -- 172.21.15.40:0/3380796404 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe45c0094d0 con 0x7fe46806d770 2023-12-17T11:48:44.832 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.824+0000 7fe46cbba640 1 --2- 172.21.15.40:0/3380796404 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe46806d770 0x7fe468141ab0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fe45c0090b0 tx=0x7fe45c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:48:44.832 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.823+0000 7fdf5d7e5640 1 --2- 172.21.15.40:0/3720446812 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdf5815f260 0x7fdf580ccb00 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fdf580b1710 tx=0x7fdf4802b8d0 comp rx=0 tx=0).stop 2023-12-17T11:48:44.832 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.823+0000 7fdf5d7e5640 1 -- 172.21.15.40:0/3720446812 shutdown_connections 2023-12-17T11:48:44.832 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.823+0000 7fdf5d7e5640 1 --2- 172.21.15.40:0/3720446812 >> v2:172.21.15.40:3300/0 conn(0x7fdf581626b0 0x7fdf580701c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:44.832 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.823+0000 7fdf5d7e5640 1 --2- 172.21.15.40:0/3720446812 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdf5815f260 0x7fdf580ccb00 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:44.833 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.823+0000 7fdf5d7e5640 1 -- 172.21.15.40:0/3720446812 >> 172.21.15.40:0/3720446812 conn(0x7fdf580b0a90 msgr2=0x7fdf580b0e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:48:44.833 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.823+0000 7fdf5d7e5640 1 -- 172.21.15.40:0/3720446812 shutdown_connections 2023-12-17T11:48:44.833 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.822+0000 7f6d998da640 1 -- 172.21.15.40:0/3342035537 shutdown_connections 2023-12-17T11:48:44.833 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.822+0000 7f6d998da640 1 --2- 172.21.15.40:0/3342035537 >> v2:172.21.15.159:3300/0 conn(0x7f6d8c03e810 0x7f6d8c053bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:44.833 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.822+0000 7f6d998da640 1 --2- 172.21.15.40:0/3342035537 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6d8c0e3090 0x7f6d8c057d60 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:44.833 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.822+0000 7f6d998da640 1 -- 172.21.15.40:0/3342035537 >> 172.21.15.40:0/3342035537 conn(0x7f6d8c0559b0 msgr2=0x7f6d8c055dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:48:44.833 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.823+0000 7f6d998da640 1 -- 172.21.15.40:0/3342035537 shutdown_connections 2023-12-17T11:48:44.833 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.823+0000 7f6d998da640 1 -- 172.21.15.40:0/3342035537 wait complete. 2023-12-17T11:48:44.834 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.824+0000 7fdf5d7e5640 1 -- 172.21.15.40:0/3720446812 wait complete. 2023-12-17T11:48:44.834 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.824+0000 7fe4657fa640 1 -- 172.21.15.40:0/3380796404 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe45c030710 con 0x7fe46806d770 2023-12-17T11:48:44.834 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.824+0000 7fe4657fa640 1 -- 172.21.15.40:0/3380796404 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe45c030890 con 0x7fe46806d770 2023-12-17T11:48:44.834 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.825+0000 7fe4657fa640 1 -- 172.21.15.40:0/3380796404 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe45c030c40 con 0x7fe46806d770 2023-12-17T11:48:44.834 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.825+0000 7fe46ee1e640 1 -- 172.21.15.40:0/3380796404 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe46809bc40 con 0x7fe46806d770 2023-12-17T11:48:44.834 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.825+0000 7fe46ee1e640 1 -- 172.21.15.40:0/3380796404 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe46809c200 con 0x7fe46806d770 2023-12-17T11:48:44.835 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.825+0000 7f380aec9640 1 Processor -- start 2023-12-17T11:48:44.835 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.826+0000 7f137b59e640 1 Processor -- start 2023-12-17T11:48:44.835 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.827+0000 7f6d998da640 1 Processor -- start 2023-12-17T11:48:44.835 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.827+0000 7fdf5d7e5640 1 Processor -- start 2023-12-17T11:48:44.836 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.827+0000 7fe452ffd640 1 -- 172.21.15.40:0/3380796404 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe440005250 con 0x7fe46806d770 2023-12-17T11:48:44.836 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.827+0000 7f6d998da640 1 -- start start 2023-12-17T11:48:44.836 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.827+0000 7f380aec9640 1 -- start start 2023-12-17T11:48:44.837 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.828+0000 7f6d998da640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6d8c03e810 0x7f6d8c0d0560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:44.837 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.828+0000 7f6d998da640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6d8c054100 0x7f6d8c03d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:44.837 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.828+0000 7f6d998da640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6d8c0e3090 0x7f6d8c03dd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:44.837 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.828+0000 7f6d998da640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d8c0e6f30 con 0x7f6d8c054100 2023-12-17T11:48:44.837 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.828+0000 7f6d998da640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d8c17d1e0 con 0x7f6d8c0e3090 2023-12-17T11:48:44.837 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.828+0000 7f6d998da640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d8c0e6600 con 0x7f6d8c03e810 2023-12-17T11:48:44.838 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.827+0000 7fdf5d7e5640 1 -- start start 2023-12-17T11:48:44.838 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.829+0000 7fdf5d7e5640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fdf58070700 0x7fdf581522b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:44.841 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.829+0000 7fdf5d7e5640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdf5815f260 0x7fdf580b3a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:44.841 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.829+0000 7fdf5d7e5640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdf581626b0 0x7fdf5815d410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:44.841 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.829+0000 7fdf5d7e5640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf580a89a0 con 0x7fdf581626b0 2023-12-17T11:48:44.841 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.829+0000 7fdf5d7e5640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf580a8c80 con 0x7fdf5815f260 2023-12-17T11:48:44.841 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.829+0000 7fdf5d7e5640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf580a8f60 con 0x7fdf58070700 2023-12-17T11:48:44.842 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.829+0000 7f6d988d8640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6d8c03e810 0x7f6d8c0d0560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:44.842 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.829+0000 7f6d990d9640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6d8c0e3090 0x7f6d8c03dd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:44.842 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.829+0000 7f6d990d9640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6d8c0e3090 0x7f6d8c03dd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.40:39560/0 (socket says 172.21.15.40:39560) 2023-12-17T11:48:44.842 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.829+0000 7f6d990d9640 1 -- 172.21.15.40:0/3650109314 learned_addr learned my addr 172.21.15.40:0/3650109314 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-17T11:48:44.842 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.827+0000 7f137b59e640 1 -- start start 2023-12-17T11:48:44.843 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.829+0000 7f137b59e640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f137c0d13c0 0x7f137c0ce5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:44.843 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.829+0000 7f137b59e640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f137c0b0760 0x7f137c0b0bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:44.843 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.829+0000 7f137b59e640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f137c0b2280 con 0x7f137c0d0d70 2023-12-17T11:48:44.843 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.829+0000 7f137b59e640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f137c0cee70 con 0x7f137c0b0760 2023-12-17T11:48:44.843 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.829+0000 7f137b59e640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f137c0d1190 con 0x7f137c0d13c0 2023-12-17T11:48:44.843 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.830+0000 7fdf567fc640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdf5815f260 0x7fdf580b3a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:44.843 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.830+0000 7fdf567fc640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdf5815f260 0x7fdf580b3a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.40:39568/0 (socket says 172.21.15.40:39568) 2023-12-17T11:48:44.844 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.830+0000 7f6d93fff640 1 --2- 172.21.15.40:0/3650109314 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6d8c054100 0x7f6d8c03d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:44.844 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.830+0000 7fdf56ffd640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fdf58070700 0x7fdf581522b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:44.844 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.830+0000 7fdf56ffd640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fdf58070700 0x7fdf581522b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3301/0 says I am v2:172.21.15.40:55896/0 (socket says 172.21.15.40:55896) 2023-12-17T11:48:44.844 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.830+0000 7fdf56ffd640 1 -- 172.21.15.40:0/1769372445 learned_addr learned my addr 172.21.15.40:0/1769372445 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-17T11:48:44.844 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.830+0000 7fdf577fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdf581626b0 0x7fdf5815d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:44.845 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.831+0000 7f380aec9640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f38040708d0 0x7f38040a9690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:44.845 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.831+0000 7f380aec9640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f380415f260 0x7f38040b19b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:44.845 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.831+0000 7f380aec9640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f38041626b0 0x7f380415b2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:44.845 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.831+0000 7f380aec9640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38040b2200 con 0x7f380415f260 2023-12-17T11:48:44.845 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.831+0000 7f380aec9640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38040b24e0 con 0x7f38041626b0 2023-12-17T11:48:44.846 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.831+0000 7fdf56ffd640 1 -- 172.21.15.40:0/1769372445 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdf5815f260 msgr2=0x7fdf580b3a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:44.846 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.831+0000 7f380aec9640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38040b27c0 con 0x7f38040708d0 2023-12-17T11:48:44.846 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.832+0000 7fdf56ffd640 1 --2- 172.21.15.40:0/1769372445 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdf5815f260 0x7fdf580b3a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:44.847 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.832+0000 7fdf56ffd640 1 -- 172.21.15.40:0/1769372445 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdf581626b0 msgr2=0x7fdf5815d410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:44.847 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.832+0000 7fdf56ffd640 1 --2- 172.21.15.40:0/1769372445 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdf581626b0 0x7fdf5815d410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:44.847 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.831+0000 7f6d990d9640 1 -- 172.21.15.40:0/3650109314 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6d8c03e810 msgr2=0x7f6d8c0d0560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:44.847 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.831+0000 7f3808c65640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f38040708d0 0x7f38040a9690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:44.848 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.832+0000 7fdf567fc640 1 --2- 172.21.15.40:0/1769372445 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdf5815f260 0x7fdf580b3a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-17T11:48:44.848 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.832+0000 7fdf56ffd640 1 -- 172.21.15.40:0/1769372445 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf48009400 con 0x7fdf58070700 2023-12-17T11:48:44.848 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.831+0000 7f3809466640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f38041626b0 0x7f380415b2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:44.848 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.831+0000 7f3808c65640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f38040708d0 0x7f38040a9690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3301/0 says I am v2:172.21.15.40:55908/0 (socket says 172.21.15.40:55908) 2023-12-17T11:48:44.848 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.832+0000 7f6d990d9640 1 --2- 172.21.15.40:0/3650109314 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6d8c03e810 0x7f6d8c0d0560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:44.849 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.832+0000 7fdf577fe640 1 --2- 172.21.15.40:0/1769372445 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdf581626b0 0x7fdf5815d410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-17T11:48:44.849 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.830+0000 7f137a59c640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f137c0d13c0 0x7f137c0ce5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:44.849 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.832+0000 7f137a59c640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f137c0d13c0 0x7f137c0ce5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3301/0 says I am v2:172.21.15.40:55902/0 (socket says 172.21.15.40:55902) 2023-12-17T11:48:44.849 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.832+0000 7f137a59c640 1 -- 172.21.15.40:0/3125257066 learned_addr learned my addr 172.21.15.40:0/3125257066 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-17T11:48:44.849 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.831+0000 7f1379d9b640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f137c0d0d70 0x7f137c0d17a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:40040/0 (socket says 172.21.15.40:40040) 2023-12-17T11:48:44.850 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.831+0000 7f3808c65640 1 -- 172.21.15.40:0/811967031 learned_addr learned my addr 172.21.15.40:0/811967031 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-17T11:48:44.850 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.832+0000 7f3803fff640 1 --2- 172.21.15.40:0/811967031 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f380415f260 0x7f38040b19b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:44.850 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.832+0000 7f3809466640 1 -- 172.21.15.40:0/811967031 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f38040708d0 msgr2=0x7f38040a9690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:44.850 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.832+0000 7f3809466640 1 --2- 172.21.15.40:0/811967031 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f38040708d0 0x7f38040a9690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:44.850 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.833+0000 7fe4657fa640 1 -- 172.21.15.40:0/3380796404 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fe45c039040 con 0x7fe46806d770 2023-12-17T11:48:44.851 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.832+0000 7f3809466640 1 -- 172.21.15.40:0/811967031 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f380415f260 msgr2=0x7f38040b19b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:44.851 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.832+0000 7f1b04133640 1 Processor -- start 2023-12-17T11:48:44.851 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.832+0000 7fdf56ffd640 1 --2- 172.21.15.40:0/1769372445 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fdf58070700 0x7fdf581522b0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fdf48009890 tx=0x7fdf480046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:48:44.852 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.833+0000 7f6d990d9640 1 -- 172.21.15.40:0/3650109314 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6d8c054100 msgr2=0x7f6d8c03d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:44.852 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.833+0000 7f6d990d9640 1 --2- 172.21.15.40:0/3650109314 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6d8c054100 0x7f6d8c03d7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:44.852 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.833+0000 7f137ad9d640 1 --2- 172.21.15.40:0/3125257066 >> v2:172.21.15.40:3300/0 conn(0x7f137c0b0760 0x7f137c0b0bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:44.852 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.833+0000 7fdf3f7fe640 1 -- 172.21.15.40:0/1769372445 <== mon.2 v2:172.21.15.159:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf4803b970 con 0x7fdf58070700 2023-12-17T11:48:44.853 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.833+0000 7f3809466640 1 --2- 172.21.15.40:0/811967031 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f380415f260 0x7f38040b19b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:44.853 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.833+0000 7f3809466640 1 -- 172.21.15.40:0/811967031 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37f40094d0 con 0x7f38041626b0 2023-12-17T11:48:44.853 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.833+0000 7f3803fff640 1 --2- 172.21.15.40:0/811967031 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f380415f260 0x7f38040b19b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-17T11:48:44.853 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.833+0000 7fdf5d7e5640 1 -- 172.21.15.40:0/1769372445 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf580a9240 con 0x7fdf58070700 2023-12-17T11:48:44.853 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.834+0000 7f137a59c640 1 -- 172.21.15.40:0/3125257066 >> v2:172.21.15.40:3300/0 conn(0x7f137c0b0760 msgr2=0x7f137c0b0bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:48:44.853 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.834+0000 7f137a59c640 1 --2- 172.21.15.40:0/3125257066 >> v2:172.21.15.40:3300/0 conn(0x7f137c0b0760 0x7f137c0b0bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:44.854 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.833+0000 7f1b04133640 1 -- start start 2023-12-17T11:48:44.854 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.834+0000 7f137a59c640 1 -- 172.21.15.40:0/3125257066 >> v1:172.21.15.40:6789/0 conn(0x7f137c0d0d70 legacy=0x7f137c0d17a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:44.854 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.833+0000 7f6d990d9640 1 -- 172.21.15.40:0/3650109314 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d880094d0 con 0x7f6d8c0e3090 2023-12-17T11:48:44.854 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.833+0000 7f6d93fff640 1 --2- 172.21.15.40:0/3650109314 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6d8c054100 0x7f6d8c03d7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-17T11:48:44.855 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.834+0000 7f137a59c640 1 -- 172.21.15.40:0/3125257066 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f137c0ceb90 con 0x7f137c0d13c0 2023-12-17T11:48:44.855 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.833+0000 7fdf5d7e5640 1 -- 172.21.15.40:0/1769372445 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf580b3fb0 con 0x7fdf58070700 2023-12-17T11:48:44.855 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.833+0000 7fdf3f7fe640 1 -- 172.21.15.40:0/1769372445 <== mon.2 v2:172.21.15.159:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf4803bad0 con 0x7fdf58070700 2023-12-17T11:48:44.855 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.835+0000 7f3809466640 1 --2- 172.21.15.40:0/811967031 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f38041626b0 0x7f380415b2b0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f37fc00efc0 tx=0x7f37fc00c490 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:48:44.856 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.834+0000 7fe4657fa640 1 --2- 172.21.15.40:0/3380796404 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7fe44c06af10 0x7fe44c06d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:44.856 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.835+0000 7fe4657fa640 1 -- 172.21.15.40:0/3380796404 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fe45c0abe10 con 0x7fe46806d770 2023-12-17T11:48:44.856 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.835+0000 7fdf3f7fe640 1 -- 172.21.15.40:0/1769372445 <== mon.2 v2:172.21.15.159:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf4803be80 con 0x7fdf58070700 2023-12-17T11:48:44.856 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.835+0000 7f6d990d9640 1 --2- 172.21.15.40:0/3650109314 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6d8c0e3090 0x7f6d8c03dd10 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f6d94000b60 tx=0x7f6d94067ed0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:48:44.856 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.835+0000 7fdf5d7e5640 1 -- 172.21.15.40:0/1769372445 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf580b4200 con 0x7fdf58070700 2023-12-17T11:48:44.857 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.836+0000 7f38017fa640 1 -- 172.21.15.40:0/811967031 <== mon.1 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37fc009c00 con 0x7f38041626b0 2023-12-17T11:48:44.857 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.836+0000 7f38017fa640 1 -- 172.21.15.40:0/811967031 <== mon.1 v2:172.21.15.159:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37fc00f040 con 0x7f38041626b0 2023-12-17T11:48:44.857 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.836+0000 7f38017fa640 1 -- 172.21.15.40:0/811967031 <== mon.1 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37fc0146c0 con 0x7f38041626b0 2023-12-17T11:48:44.857 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.836+0000 7f380aec9640 1 -- 172.21.15.40:0/811967031 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38040b2aa0 con 0x7f38041626b0 2023-12-17T11:48:44.857 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.836+0000 7fe467fff640 1 --2- 172.21.15.40:0/3380796404 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7fe44c06af10 0x7fe44c06d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:44.858 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.836+0000 7fa838cad640 1 Processor -- start 2023-12-17T11:48:44.858 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.836+0000 7f6d917fa640 1 -- 172.21.15.40:0/3650109314 <== mon.1 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d94072ee0 con 0x7f6d8c0e3090 2023-12-17T11:48:44.858 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.836+0000 7f6d917fa640 1 -- 172.21.15.40:0/3650109314 <== mon.1 v2:172.21.15.159:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d94073040 con 0x7f6d8c0e3090 2023-12-17T11:48:44.858 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.836+0000 7f6d998da640 1 -- 172.21.15.40:0/3650109314 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d8c0e68e0 con 0x7f6d8c0e3090 2023-12-17T11:48:44.858 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.837+0000 7f6d917fa640 1 -- 172.21.15.40:0/3650109314 <== mon.1 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d94073410 con 0x7f6d8c0e3090 2023-12-17T11:48:44.859 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.836+0000 7fa838cad640 1 -- start start 2023-12-17T11:48:44.859 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.837+0000 7f137a59c640 1 --2- 172.21.15.40:0/3125257066 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f137c0d13c0 0x7f137c0ce5b0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f136c009870 tx=0x7f136c02b8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=eedd3ced4224aaa8 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:48:44.859 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.837+0000 7f6d998da640 1 -- 172.21.15.40:0/3650109314 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d8c0d0aa0 con 0x7f6d8c0e3090 2023-12-17T11:48:44.860 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.836+0000 7f380aec9640 1 -- 172.21.15.40:0/811967031 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38040b1ef0 con 0x7f38041626b0 2023-12-17T11:48:44.860 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.838+0000 7fe467fff640 1 --2- 172.21.15.40:0/3380796404 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7fe44c06af10 0x7fe44c06d3d0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fe46816d820 tx=0x7fe4540079e0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:48:44.860 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.838+0000 7f1b04133640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f1afc06d520 0x7f1afc0ccb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:44.860 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.838+0000 7f1b01ecf640 1 --1- >> v1:172.21.15.159:6789/0 conn(0x7f1afc15f260 0x7f1afc0701c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.159:6789/0 says I am v1:172.21.15.40:53914/0 (socket says 172.21.15.40:53914) 2023-12-17T11:48:44.860 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.838+0000 7f1b01ecf640 1 -- 172.21.15.40:0/1164693299 learned_addr learned my addr 172.21.15.40:0/1164693299 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-12-17T11:48:44.861 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.838+0000 7f380aec9640 1 -- 172.21.15.40:0/811967031 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37e8005250 con 0x7f38041626b0 2023-12-17T11:48:44.861 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.838+0000 7f1b04133640 1 -- 172.21.15.40:0/1164693299 --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1afc0cde40 con 0x7f1afc0708d0 2023-12-17T11:48:44.861 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.839+0000 7f1b04133640 1 -- 172.21.15.40:0/1164693299 --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1afc0cd230 con 0x7f1afc15f260 2023-12-17T11:48:44.861 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.839+0000 7f1b04133640 1 -- 172.21.15.40:0/1164693299 --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1afc0cd040 con 0x7f1afc06d520 2023-12-17T11:48:44.862 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.839+0000 7fe4657fa640 1 -- 172.21.15.40:0/3380796404 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fe45c076bb0 con 0x7fe46806d770 2023-12-17T11:48:44.862 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.839+0000 7f6d998da640 1 -- 172.21.15.40:0/3650109314 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d8c0e6740 con 0x7f6d8c0e3090 2023-12-17T11:48:44.863 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.839+0000 7f1b00ecd640 1 -- 172.21.15.40:0/1164693299 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1621643360 0 0) 0x7f1afc0cde40 con 0x7f1afc0708d0 2023-12-17T11:48:44.863 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.840+0000 7f1b00ecd640 1 -- 172.21.15.40:0/1164693299 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1ae8003520 con 0x7f1afc0708d0 2023-12-17T11:48:44.863 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.840+0000 7fdf3f7fe640 1 -- 172.21.15.40:0/1769372445 <== mon.2 v2:172.21.15.159:3301/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fdf480453f0 con 0x7fdf58070700 2023-12-17T11:48:44.863 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.839+0000 7fa838cad640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fa8340cee80 0x7fa8340cf9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:44.863 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.840+0000 7fa838cad640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8340d0360 con 0x7fa8340cff00 2023-12-17T11:48:44.863 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.840+0000 7fa838cad640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8340d0f60 con 0x7fa8341607f0 2023-12-17T11:48:44.863 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.840+0000 7fa838cad640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8340d1be0 con 0x7fa8340cee80 2023-12-17T11:48:44.864 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.840+0000 7f1b026d0640 1 --2- 172.21.15.40:0/1164693299 >> v2:172.21.15.159:3300/0 conn(0x7f1afc06d520 0x7f1afc0ccb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:44.864 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.840+0000 7fa831d9b640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fa8340cee80 0x7fa8340cf9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:44.864 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.840+0000 7fa831d9b640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fa8340cee80 0x7fa8340cf9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:35514/0 (socket says 172.21.15.40:35514) 2023-12-17T11:48:44.864 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.840+0000 7fa831d9b640 1 -- 172.21.15.40:0/3212508634 learned_addr learned my addr 172.21.15.40:0/3212508634 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-17T11:48:44.864 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.841+0000 7f6d917fa640 1 -- 172.21.15.40:0/3650109314 <== mon.1 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f6d94090020 con 0x7f6d8c0e3090 2023-12-17T11:48:44.865 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.841+0000 7f1b026d0640 1 -- 172.21.15.40:0/1164693299 >> v1:172.21.15.159:6789/0 conn(0x7f1afc15f260 legacy=0x7f1afc0701c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:44.865 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.841+0000 7f1b026d0640 1 -- 172.21.15.40:0/1164693299 >> v1:172.21.15.40:6789/0 conn(0x7f1afc0708d0 legacy=0x7f1afc1691b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:44.865 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.841+0000 7f1b026d0640 1 -- 172.21.15.40:0/1164693299 --> v2:172.21.15.159:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1afc0cd510 con 0x7f1afc06d520 2023-12-17T11:48:44.865 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.841+0000 7f6d917fa640 1 --2- 172.21.15.40:0/3650109314 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f6d7806ae40 0x7f6d7806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:44.865 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.841+0000 7fdf3f7fe640 1 --2- 172.21.15.40:0/1769372445 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7fdf4406ae40 0x7fdf4406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:44.866 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.841+0000 7fdf3f7fe640 1 -- 172.21.15.40:0/1769372445 <== mon.2 v2:172.21.15.159:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fdf480ac020 con 0x7fdf58070700 2023-12-17T11:48:44.866 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.842+0000 7fa83159a640 1 -- 172.21.15.40:0/3212508634 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2400350888 0 0) 0x7fa8340d0360 con 0x7fa8340cff00 2023-12-17T11:48:44.866 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.842+0000 7fa83159a640 1 -- 172.21.15.40:0/3212508634 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa81c003520 con 0x7fa8340cff00 2023-12-17T11:48:44.866 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.842+0000 7f6d917fa640 1 -- 172.21.15.40:0/3650109314 <== mon.1 v2:172.21.15.159:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f6d94103310 con 0x7f6d8c0e3090 2023-12-17T11:48:44.866 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.842+0000 7fa831d9b640 1 -- 172.21.15.40:0/3212508634 >> v1:172.21.15.159:6789/0 conn(0x7fa8341607f0 legacy=0x7fa8340ce770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:48:44.866 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.842+0000 7fa831d9b640 1 -- 172.21.15.40:0/3212508634 >> v1:172.21.15.40:6789/0 conn(0x7fa8340cff00 legacy=0x7fa8340b5fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:44.867 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.842+0000 7fa831d9b640 1 -- 172.21.15.40:0/3212508634 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8340d1240 con 0x7fa8340cee80 2023-12-17T11:48:44.867 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.842+0000 7f38017fa640 1 -- 172.21.15.40:0/811967031 <== mon.1 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f37fc014820 con 0x7f38041626b0 2023-12-17T11:48:44.867 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.842+0000 7f6d988d8640 1 --2- 172.21.15.40:0/3650109314 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f6d7806ae40 0x7f6d7806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:44.867 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.843+0000 7fdf567fc640 1 --2- 172.21.15.40:0/1769372445 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7fdf4406ae40 0x7fdf4406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:44.868 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.843+0000 7f38017fa640 1 --2- 172.21.15.40:0/811967031 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f37e406af40 0x7f37e406d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:44.868 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.843+0000 7f38017fa640 1 -- 172.21.15.40:0/811967031 <== mon.1 v2:172.21.15.159:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f37fc08ac10 con 0x7f38041626b0 2023-12-17T11:48:44.868 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.843+0000 7fa831d9b640 1 --2- 172.21.15.40:0/3212508634 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa8340cee80 0x7fa8340cf9c0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fa824009870 tx=0x7fa82402b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=951d6358a4576594 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:48:44.868 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.844+0000 7f1b026d0640 1 --2- 172.21.15.40:0/1164693299 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1afc06d520 0x7f1afc0ccb00 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f1af00097a0 tx=0x7f1af002b960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1307255da82ffab2 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:48:44.869 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.844+0000 7fa83159a640 1 -- 172.21.15.40:0/3212508634 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa824031870 con 0x7fa8340cee80 2023-12-17T11:48:44.869 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.844+0000 7fa83159a640 1 -- 172.21.15.40:0/3212508634 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8240319d0 con 0x7fa8340cee80 2023-12-17T11:48:44.869 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.844+0000 7fa83159a640 1 -- 172.21.15.40:0/3212508634 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa824031d60 con 0x7fa8340cee80 2023-12-17T11:48:44.869 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.844+0000 7f6d988d8640 1 --2- 172.21.15.40:0/3650109314 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f6d7806ae40 0x7f6d7806d300 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f6d88036000 tx=0x7f6d88008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:48:44.870 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.844+0000 7f3808c65640 1 --2- 172.21.15.40:0/811967031 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f37e406af40 0x7f37e406d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:44.870 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.845+0000 7fdf567fc640 1 --2- 172.21.15.40:0/1769372445 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7fdf4406ae40 0x7fdf4406d300 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fdf580ab610 tx=0x7fdf4c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:48:44.870 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.845+0000 7fa838cad640 1 -- 172.21.15.40:0/3212508634 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa8340cee80 msgr2=0x7fa8340cf9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:44.870 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.845+0000 7fa838cad640 1 --2- 172.21.15.40:0/3212508634 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa8340cee80 0x7fa8340cf9c0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fa824009870 tx=0x7fa82402b910 comp rx=0 tx=0).stop 2023-12-17T11:48:44.871 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.845+0000 7f3808c65640 1 --2- 172.21.15.40:0/811967031 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f37e406af40 0x7f37e406d400 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f37f40097f0 tx=0x7f37f403b040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:48:44.871 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.845+0000 7fa838cad640 1 -- 172.21.15.40:0/3212508634 shutdown_connections 2023-12-17T11:48:44.871 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.845+0000 7fa838cad640 1 --2- 172.21.15.40:0/3212508634 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa8340cee80 0x7fa8340cf9c0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:44.871 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.845+0000 7fa838cad640 1 -- 172.21.15.40:0/3212508634 >> 172.21.15.40:0/3212508634 conn(0x7fa83409c450 msgr2=0x7fa8340d3180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:48:44.872 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.845+0000 7fa838cad640 1 -- 172.21.15.40:0/3212508634 shutdown_connections 2023-12-17T11:48:44.872 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.845+0000 7fa838cad640 1 -- 172.21.15.40:0/3212508634 wait complete. 2023-12-17T11:48:44.872 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.848+0000 7fa838cad640 1 Processor -- start 2023-12-17T11:48:44.872 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.848+0000 7fa838cad640 1 -- start start 2023-12-17T11:48:44.872 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.848+0000 7f5659c23640 1 Processor -- start 2023-12-17T11:48:44.872 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.849+0000 7f5659c23640 1 -- start start 2023-12-17T11:48:44.873 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.850+0000 7fa838cad640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa8340cee80 0x7fa8340c78f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:44.873 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.850+0000 7fa838cad640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa8340cff00 0x7fa8340c7e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:44.873 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.850+0000 7fa838cad640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa8341607f0 0x7fa83415b330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:44.873 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.850+0000 7fa838cad640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa834155f00 con 0x7fa8340cff00 2023-12-17T11:48:44.873 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.850+0000 7fa838cad640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8340c8370 con 0x7fa8341607f0 2023-12-17T11:48:44.873 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.850+0000 7fa838cad640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8340c8620 con 0x7fa8340cee80 2023-12-17T11:48:44.874 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.850+0000 7f5659c23640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f565415d2f0 0x7f56540cfa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:44.874 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.850+0000 7f5659c23640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f56540cee40 0x7f56540cff40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:44.874 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.850+0000 7f5659c23640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56540d0de0 con 0x7f56540d1e80 2023-12-17T11:48:44.874 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.850+0000 7f5659c23640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56540d10c0 con 0x7f56540cee40 2023-12-17T11:48:44.874 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.850+0000 7f5659c23640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56540d13a0 con 0x7f565415d2f0 2023-12-17T11:48:44.874 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.850+0000 7fa831d9b640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa8340cff00 0x7fa8340c7e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:44.874 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.850+0000 7fa831d9b640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa8340cff00 0x7fa8340c7e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:35516/0 (socket says 172.21.15.40:35516) 2023-12-17T11:48:44.874 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.850+0000 7fa831d9b640 1 -- 172.21.15.40:0/292567881 learned_addr learned my addr 172.21.15.40:0/292567881 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-17T11:48:44.875 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.850+0000 7f5652ffd640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f56540d1e80 0x7f56540ce730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:40052/0 (socket says 172.21.15.40:40052) 2023-12-17T11:48:44.875 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.850+0000 7f5652ffd640 1 -- 172.21.15.40:0/4180525332 learned_addr learned my addr 172.21.15.40:0/4180525332 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-12-17T11:48:44.875 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.850+0000 7f5653fff640 1 --2- 172.21.15.40:0/4180525332 >> v2:172.21.15.40:3300/0 conn(0x7f56540cee40 0x7f56540cff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:44.875 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.851+0000 7f56537fe640 1 --2- 172.21.15.40:0/4180525332 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f565415d2f0 0x7f56540cfa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:44.876 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.851+0000 7fa832d9d640 1 --2- 172.21.15.40:0/292567881 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa8341607f0 0x7fa83415b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:44.876 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.851+0000 7fa83259c640 1 --2- 172.21.15.40:0/292567881 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa8340cee80 0x7fa8340c78f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:44.876 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.851+0000 7fa831d9b640 1 -- 172.21.15.40:0/292567881 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa8340cee80 msgr2=0x7fa8340c78f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:44.876 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.851+0000 7fa831d9b640 1 --2- 172.21.15.40:0/292567881 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa8340cee80 0x7fa8340c78f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:44.876 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.851+0000 7fa831d9b640 1 -- 172.21.15.40:0/292567881 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa8341607f0 msgr2=0x7fa83415b330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:44.876 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.851+0000 7fa831d9b640 1 --2- 172.21.15.40:0/292567881 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa8341607f0 0x7fa83415b330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:44.876 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.851+0000 7f56527fc640 1 -- 172.21.15.40:0/4180525332 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4220415882 0 0) 0x7f56540d0de0 con 0x7f56540d1e80 2023-12-17T11:48:44.877 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.851+0000 7f5653fff640 1 -- 172.21.15.40:0/4180525332 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f565415d2f0 msgr2=0x7f56540cfa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:48:44.877 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.851+0000 7f5653fff640 1 --2- 172.21.15.40:0/4180525332 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f565415d2f0 0x7f56540cfa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:44.877 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.851+0000 7f5653fff640 1 -- 172.21.15.40:0/4180525332 >> v1:172.21.15.40:6789/0 conn(0x7f56540d1e80 legacy=0x7f56540ce730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:44.877 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.851+0000 7f5653fff640 1 -- 172.21.15.40:0/4180525332 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56540d1680 con 0x7f56540cee40 2023-12-17T11:48:44.878 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.851+0000 7fa831d9b640 1 -- 172.21.15.40:0/292567881 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8240094d0 con 0x7fa8340cff00 2023-12-17T11:48:44.878 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.851+0000 7fa83259c640 1 --2- 172.21.15.40:0/292567881 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa8340cee80 0x7fa8340c78f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-17T11:48:44.878 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.852+0000 7fa831d9b640 1 --2- 172.21.15.40:0/292567881 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa8340cff00 0x7fa8340c7e30 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fa824009870 tx=0x7fa8240046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:48:44.878 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.852+0000 7fa822ffd640 1 -- 172.21.15.40:0/292567881 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa82403ac60 con 0x7fa8340cff00 2023-12-17T11:48:44.878 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.852+0000 7fa822ffd640 1 -- 172.21.15.40:0/292567881 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa82403adc0 con 0x7fa8340cff00 2023-12-17T11:48:44.878 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.852+0000 7fa822ffd640 1 -- 172.21.15.40:0/292567881 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa824044610 con 0x7fa8340cff00 2023-12-17T11:48:44.878 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.852+0000 7fa838cad640 1 -- 172.21.15.40:0/292567881 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa834155560 con 0x7fa8340cff00 2023-12-17T11:48:44.878 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.852+0000 7fa838cad640 1 -- 172.21.15.40:0/292567881 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa834155b20 con 0x7fa8340cff00 2023-12-17T11:48:44.879 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.853+0000 7f5653fff640 1 --2- 172.21.15.40:0/4180525332 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f56540cee40 0x7f56540cff40 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f564c009d90 tx=0x7f564c02beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d770b436f2f3913 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:48:44.879 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.853+0000 7f56527fc640 1 -- 172.21.15.40:0/4180525332 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f564c02cc60 con 0x7f56540cee40 2023-12-17T11:48:44.880 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.853+0000 7f56527fc640 1 -- 172.21.15.40:0/4180525332 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f564c02cdc0 con 0x7f56540cee40 2023-12-17T11:48:44.880 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.853+0000 7f56527fc640 1 -- 172.21.15.40:0/4180525332 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f564c034660 con 0x7f56540cee40 2023-12-17T11:48:44.880 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.854+0000 7f5659c23640 1 -- 172.21.15.40:0/4180525332 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f56540cee40 msgr2=0x7f56540cff40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:44.880 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.854+0000 7f5659c23640 1 --2- 172.21.15.40:0/4180525332 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f56540cee40 0x7f56540cff40 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f564c009d90 tx=0x7f564c02beb0 comp rx=0 tx=0).stop 2023-12-17T11:48:44.880 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.854+0000 7f5659c23640 1 -- 172.21.15.40:0/4180525332 shutdown_connections 2023-12-17T11:48:44.880 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.854+0000 7f5659c23640 1 --2- 172.21.15.40:0/4180525332 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f56540cee40 0x7f56540cff40 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:44.880 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.854+0000 7f5659c23640 1 --2- 172.21.15.40:0/4180525332 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f565415d2f0 0x7f56540cfa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:44.880 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.854+0000 7f5659c23640 1 -- 172.21.15.40:0/4180525332 >> 172.21.15.40:0/4180525332 conn(0x7f565409c450 msgr2=0x7f56540d3070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:48:44.880 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.854+0000 7f5659c23640 1 -- 172.21.15.40:0/4180525332 shutdown_connections 2023-12-17T11:48:44.880 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.854+0000 7f5659c23640 1 -- 172.21.15.40:0/4180525332 wait complete. 2023-12-17T11:48:44.880 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.855+0000 7f137959a640 1 -- 172.21.15.40:0/3125257066 <== mon.2 v2:172.21.15.159:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f136c031640 con 0x7f137c0d13c0 2023-12-17T11:48:44.881 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.854+0000 7fa838cad640 1 -- 172.21.15.40:0/292567881 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa834156040 con 0x7fa8340cff00 2023-12-17T11:48:44.881 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.855+0000 7f137959a640 1 -- 172.21.15.40:0/3125257066 <== mon.2 v2:172.21.15.159:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f136c0317a0 con 0x7f137c0d13c0 2023-12-17T11:48:44.881 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.855+0000 7f137959a640 1 -- 172.21.15.40:0/3125257066 <== mon.2 v2:172.21.15.159:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f136c031b30 con 0x7f137c0d13c0 2023-12-17T11:48:44.882 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.855+0000 7fdf3f7fe640 1 -- 172.21.15.40:0/1769372445 <== mon.2 v2:172.21.15.159:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fdf48076f10 con 0x7fdf58070700 2023-12-17T11:48:44.882 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.856+0000 7f5659c23640 1 Processor -- start 2023-12-17T11:48:44.882 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.857+0000 7fa822ffd640 1 -- 172.21.15.40:0/292567881 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fa82404d450 con 0x7fa8340cff00 2023-12-17T11:48:44.882 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.857+0000 7f5659c23640 1 -- start start 2023-12-17T11:48:44.883 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.857+0000 7f137b59e640 1 -- 172.21.15.40:0/3125257066 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f137c0d13c0 msgr2=0x7f137c0ce5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:44.883 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.857+0000 7f137b59e640 1 --2- 172.21.15.40:0/3125257066 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f137c0d13c0 0x7f137c0ce5b0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f136c009870 tx=0x7f136c02b8f0 comp rx=0 tx=0).stop 2023-12-17T11:48:44.883 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.858+0000 7f137b59e640 1 -- 172.21.15.40:0/3125257066 shutdown_connections 2023-12-17T11:48:44.883 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.858+0000 7f137b59e640 1 --2- 172.21.15.40:0/3125257066 >> v2:172.21.15.40:3300/0 conn(0x7f137c0b0760 0x7f137c0b0bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:44.884 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.858+0000 7f137b59e640 1 --2- 172.21.15.40:0/3125257066 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f137c0d13c0 0x7f137c0ce5b0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:44.884 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.858+0000 7f137b59e640 1 -- 172.21.15.40:0/3125257066 >> 172.21.15.40:0/3125257066 conn(0x7f137c09c260 msgr2=0x7f137c0d2f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:48:44.884 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.858+0000 7f137b59e640 1 -- 172.21.15.40:0/3125257066 shutdown_connections 2023-12-17T11:48:44.884 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.858+0000 7f137b59e640 1 -- 172.21.15.40:0/3125257066 wait complete. 2023-12-17T11:48:44.884 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.858+0000 7fa822ffd640 1 --2- 172.21.15.40:0/292567881 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7fa81406ae90 0x7fa81406d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:44.884 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.858+0000 7f5659c23640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f56540cee40 0x7f565415b490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:44.884 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.858+0000 7f5659c23640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f56540d1e80 0x7f56540cba00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:44.885 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.858+0000 7fa822ffd640 1 -- 172.21.15.40:0/292567881 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fa82402d040 con 0x7fa8340cff00 2023-12-17T11:48:44.885 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.858+0000 7f5659c23640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f565415d2f0 0x7f56540c8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:44.885 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.859+0000 7f5659c23640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f565415f4a0 con 0x7f565415d2f0 2023-12-17T11:48:44.885 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.859+0000 7fa83259c640 1 --2- 172.21.15.40:0/292567881 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7fa81406ae90 0x7fa81406d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:44.886 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.859+0000 7f56537fe640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f56540cee40 0x7f565415b490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:44.886 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.859+0000 7f5652ffd640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f56540d1e80 0x7f56540cba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:44.886 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.859+0000 7f56537fe640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f56540cee40 0x7f565415b490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3301/0 says I am v2:172.21.15.40:55924/0 (socket says 172.21.15.40:55924) 2023-12-17T11:48:44.886 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.859+0000 7f56537fe640 1 -- 172.21.15.40:0/2927222915 learned_addr learned my addr 172.21.15.40:0/2927222915 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-17T11:48:44.886 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.859+0000 7f6d917fa640 1 -- 172.21.15.40:0/3650109314 <== mon.1 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f6d940ce140 con 0x7f6d8c0e3090 2023-12-17T11:48:44.887 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.859+0000 7f5659c23640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f565415e820 con 0x7f56540d1e80 2023-12-17T11:48:44.887 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.859+0000 7f5659c23640 1 -- 172.21.15.40:0/2927222915 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f565415eb00 con 0x7f56540cee40 2023-12-17T11:48:44.887 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.859+0000 7f5653fff640 1 --2- 172.21.15.40:0/2927222915 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f565415d2f0 0x7f56540c8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:44.887 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.860+0000 7f56537fe640 1 -- 172.21.15.40:0/2927222915 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f56540d1e80 msgr2=0x7f56540cba00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:44.888 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.861+0000 7f137b59e640 1 Processor -- start 2023-12-17T11:48:44.888 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.860+0000 7f56537fe640 1 --2- 172.21.15.40:0/2927222915 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f56540d1e80 0x7f56540cba00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:44.888 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.860+0000 7f56537fe640 1 -- 172.21.15.40:0/2927222915 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f565415d2f0 msgr2=0x7f56540c8b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:44.888 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.860+0000 7f56537fe640 1 --2- 172.21.15.40:0/2927222915 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f565415d2f0 0x7f56540c8b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:44.888 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.860+0000 7f56537fe640 1 -- 172.21.15.40:0/2927222915 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f564c009a70 con 0x7f56540cee40 2023-12-17T11:48:44.888 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.861+0000 7f56537fe640 1 --2- 172.21.15.40:0/2927222915 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f56540cee40 0x7f565415b490 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f564400e870 tx=0x7f564400ed30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:48:44.889 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.861+0000 7f137b59e640 1 -- start start 2023-12-17T11:48:44.889 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.861+0000 7f5653fff640 1 --2- 172.21.15.40:0/2927222915 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f565415d2f0 0x7f56540c8b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-17T11:48:44.889 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.861+0000 7f563bfff640 1 -- 172.21.15.40:0/2927222915 <== mon.2 v2:172.21.15.159:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f564400c940 con 0x7f56540cee40 2023-12-17T11:48:44.889 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.862+0000 7f563bfff640 1 -- 172.21.15.40:0/2927222915 <== mon.2 v2:172.21.15.159:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f564400caa0 con 0x7f56540cee40 2023-12-17T11:48:44.889 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.862+0000 7f563bfff640 1 -- 172.21.15.40:0/2927222915 <== mon.2 v2:172.21.15.159:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f564400ce30 con 0x7f56540cee40 2023-12-17T11:48:44.889 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.862+0000 7f5659c23640 1 -- 172.21.15.40:0/2927222915 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f565415d850 con 0x7f56540cee40 2023-12-17T11:48:44.889 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.862+0000 7f5659c23640 1 -- 172.21.15.40:0/2927222915 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f565415f0c0 con 0x7f56540cee40 2023-12-17T11:48:44.890 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.863+0000 7fa822ffd640 1 -- 172.21.15.40:0/292567881 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fa834156040 con 0x7fa8340cff00 2023-12-17T11:48:44.890 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.863+0000 7f5659c23640 1 -- 172.21.15.40:0/2927222915 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56540745d0 con 0x7f56540cee40 2023-12-17T11:48:44.890 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.863+0000 7f137b59e640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f137c0b0760 0x7f137c14e940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:44.890 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.863+0000 7f137b59e640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f137c0d0d70 0x7f137c06e8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:44.891 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.863+0000 7fa83259c640 1 --2- 172.21.15.40:0/292567881 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7fa81406ae90 0x7fa81406d350 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fa82c007e90 tx=0x7fa82c0073a0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:48:44.892 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.864+0000 7f137b59e640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f137c0d13c0 0x7f137c1ecf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:44.892 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.864+0000 7f137b59e640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f137c06fe70 con 0x7f137c0d13c0 2023-12-17T11:48:44.892 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.864+0000 7f137b59e640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f137c14c0c0 con 0x7f137c0b0760 2023-12-17T11:48:44.892 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.864+0000 7f137b59e640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f137c14bbf0 con 0x7f137c0d0d70 2023-12-17T11:48:44.892 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.864+0000 7f137a59c640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f137c0b0760 0x7f137c14e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:44.892 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.864+0000 7f137ad9d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f137c0d13c0 0x7f137c1ecf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:44.893 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.864+0000 7f137ad9d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f137c0d13c0 0x7f137c1ecf70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:35536/0 (socket says 172.21.15.40:35536) 2023-12-17T11:48:44.893 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.864+0000 7f137ad9d640 1 -- 172.21.15.40:0/1411712155 learned_addr learned my addr 172.21.15.40:0/1411712155 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-17T11:48:44.893 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.865+0000 7f1379d9b640 1 --2- 172.21.15.40:0/1411712155 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f137c0d0d70 0x7f137c06e8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:44.893 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.865+0000 7f137ad9d640 1 -- 172.21.15.40:0/1411712155 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f137c0d0d70 msgr2=0x7f137c06e8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:44.893 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.865+0000 7f137ad9d640 1 --2- 172.21.15.40:0/1411712155 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f137c0d0d70 0x7f137c06e8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:44.893 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.865+0000 7f137ad9d640 1 -- 172.21.15.40:0/1411712155 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f137c0b0760 msgr2=0x7f137c14e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:44.893 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.865+0000 7f137ad9d640 1 --2- 172.21.15.40:0/1411712155 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f137c0b0760 0x7f137c14e940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:44.893 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.865+0000 7f137ad9d640 1 -- 172.21.15.40:0/1411712155 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f136c0094d0 con 0x7f137c0d13c0 2023-12-17T11:48:44.893 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.865+0000 7f1379d9b640 1 --2- 172.21.15.40:0/1411712155 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f137c0d0d70 0x7f137c06e8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-17T11:48:44.893 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.865+0000 7f137ad9d640 1 --2- 172.21.15.40:0/1411712155 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f137c0d13c0 0x7f137c1ecf70 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f1374007dc0 tx=0x7f137400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:48:44.893 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.866+0000 7f136affd640 1 -- 172.21.15.40:0/1411712155 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1374014420 con 0x7f137c0d13c0 2023-12-17T11:48:44.893 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.866+0000 7f136affd640 1 -- 172.21.15.40:0/1411712155 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1374014580 con 0x7f137c0d13c0 2023-12-17T11:48:44.893 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.866+0000 7f136affd640 1 -- 172.21.15.40:0/1411712155 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1374014930 con 0x7f137c0d13c0 2023-12-17T11:48:44.893 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.866+0000 7f137b59e640 1 -- 172.21.15.40:0/1411712155 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f137c06f1f0 con 0x7f137c0d13c0 2023-12-17T11:48:44.894 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.866+0000 7f137b59e640 1 -- 172.21.15.40:0/1411712155 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f137c06f7b0 con 0x7f137c0d13c0 2023-12-17T11:48:44.894 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.867+0000 7f563bfff640 1 -- 172.21.15.40:0/2927222915 <== mon.2 v2:172.21.15.159:3301/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f5644013470 con 0x7f56540cee40 2023-12-17T11:48:44.894 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.868+0000 7f137b59e640 1 -- 172.21.15.40:0/1411712155 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f137c074450 con 0x7f137c0d13c0 2023-12-17T11:48:44.894 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.869+0000 7f563bfff640 1 --2- 172.21.15.40:0/2927222915 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f564006ae40 0x7f564006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:44.894 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.869+0000 7f563bfff640 1 -- 172.21.15.40:0/2927222915 <== mon.2 v2:172.21.15.159:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f564408a0b0 con 0x7f56540cee40 2023-12-17T11:48:44.895 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.870+0000 7f136affd640 1 -- 172.21.15.40:0/1411712155 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f1374014a90 con 0x7f137c0d13c0 2023-12-17T11:48:44.895 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.871+0000 7f5652ffd640 1 --2- 172.21.15.40:0/2927222915 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f564006ae40 0x7f564006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:44.895 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.872+0000 7f136affd640 1 --2- 172.21.15.40:0/1411712155 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f135c06ae90 0x7f135c06d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:44.895 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.872+0000 7f136affd640 1 -- 172.21.15.40:0/1411712155 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f137408a110 con 0x7f137c0d13c0 2023-12-17T11:48:44.896 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.873+0000 7f5652ffd640 1 --2- 172.21.15.40:0/2927222915 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f564006ae40 0x7f564006d300 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f56540c6320 tx=0x7f5648007b50 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:48:44.896 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.873+0000 7f137a59c640 1 --2- 172.21.15.40:0/1411712155 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f135c06ae90 0x7f135c06d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:44.896 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.874+0000 7f1b00ecd640 1 -- 172.21.15.40:0/1164693299 <== mon.1 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1af0030610 con 0x7f1afc06d520 2023-12-17T11:48:44.897 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.874+0000 7f1b00ecd640 1 -- 172.21.15.40:0/1164693299 <== mon.1 v2:172.21.15.159:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1af0030770 con 0x7f1afc06d520 2023-12-17T11:48:44.897 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.874+0000 7f1b00ecd640 1 -- 172.21.15.40:0/1164693299 <== mon.1 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1af0030b00 con 0x7f1afc06d520 2023-12-17T11:48:44.897 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.875+0000 7f137a59c640 1 --2- 172.21.15.40:0/1411712155 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f135c06ae90 0x7f135c06d350 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f136c036000 tx=0x7f136c03c040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:48:44.897 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.874+0000 7f38017fa640 1 -- 172.21.15.40:0/811967031 <== mon.1 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f37fc055a40 con 0x7f38041626b0 2023-12-17T11:48:44.898 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.875+0000 7f1b04133640 1 -- 172.21.15.40:0/1164693299 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1afc06d520 msgr2=0x7f1afc0ccb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:44.898 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.875+0000 7f1b04133640 1 --2- 172.21.15.40:0/1164693299 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1afc06d520 0x7f1afc0ccb00 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f1af00097a0 tx=0x7f1af002b960 comp rx=0 tx=0).stop 2023-12-17T11:48:44.898 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.875+0000 7f1b04133640 1 -- 172.21.15.40:0/1164693299 shutdown_connections 2023-12-17T11:48:44.898 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.875+0000 7f1b04133640 1 --2- 172.21.15.40:0/1164693299 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1afc06d520 0x7f1afc0ccb00 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:44.898 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.875+0000 7f1b04133640 1 -- 172.21.15.40:0/1164693299 >> 172.21.15.40:0/1164693299 conn(0x7f1afc0b0a90 msgr2=0x7f1afc0b0e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:48:44.898 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.877+0000 7f1b04133640 1 -- 172.21.15.40:0/1164693299 shutdown_connections 2023-12-17T11:48:44.898 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.877+0000 7f1b04133640 1 -- 172.21.15.40:0/1164693299 wait complete. 2023-12-17T11:48:44.898 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.880+0000 7f1b04133640 1 Processor -- start 2023-12-17T11:48:44.899 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.880+0000 7f563bfff640 1 -- 172.21.15.40:0/2927222915 <== mon.2 v2:172.21.15.159:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f5644054f90 con 0x7f56540cee40 2023-12-17T11:48:44.899 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.881+0000 7f1b04133640 1 -- start start 2023-12-17T11:48:44.899 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.882+0000 7f136affd640 1 -- 172.21.15.40:0/1411712155 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f1374054eb0 con 0x7f137c0d13c0 2023-12-17T11:48:44.901 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.883+0000 7f1b04133640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1afc06d520 0x7f1afc1f8200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:44.901 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.884+0000 7f1b04133640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1afc0708d0 0x7f1afc1fa630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:44.901 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.884+0000 7f1b04133640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1afc15f260 0x7f1afc1fab70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:44.901 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.884+0000 7f1b04133640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1afc0c8bc0 con 0x7f1afc15f260 2023-12-17T11:48:44.901 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.884+0000 7f1b04133640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1afc0c8e30 con 0x7f1afc0708d0 2023-12-17T11:48:44.901 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.884+0000 7f1b04133640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1afc0c9110 con 0x7f1afc06d520 2023-12-17T11:48:44.901 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.884+0000 7f1b026d0640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1afc15f260 0x7f1afc1fab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:44.902 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.884+0000 7f1b026d0640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1afc15f260 0x7f1afc1fab70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:35552/0 (socket says 172.21.15.40:35552) 2023-12-17T11:48:44.902 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.884+0000 7f1b01ecf640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1afc06d520 0x7f1afc1f8200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:44.902 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.884+0000 7f1b026d0640 1 -- 172.21.15.40:0/890607659 learned_addr learned my addr 172.21.15.40:0/890607659 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-17T11:48:44.902 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.885+0000 7f1b026d0640 1 -- 172.21.15.40:0/890607659 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1afc06d520 msgr2=0x7f1afc1f8200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:44.902 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.885+0000 7f1b026d0640 1 --2- 172.21.15.40:0/890607659 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1afc06d520 0x7f1afc1f8200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:44.902 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.885+0000 7f1b026d0640 1 -- 172.21.15.40:0/890607659 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1afc0708d0 msgr2=0x7f1afc1fa630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:44.902 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.885+0000 7f1b026d0640 1 --2- 172.21.15.40:0/890607659 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1afc0708d0 0x7f1afc1fa630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:44.902 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.885+0000 7f1b026d0640 1 -- 172.21.15.40:0/890607659 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1af0009400 con 0x7f1afc15f260 2023-12-17T11:48:44.902 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.886+0000 7f1b026d0640 1 --2- 172.21.15.40:0/890607659 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1afc15f260 0x7f1afc1fab70 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f1af00098c0 tx=0x7f1af0004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:48:44.902 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.887+0000 7f1aee7fc640 1 -- 172.21.15.40:0/890607659 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1af003e040 con 0x7f1afc15f260 2023-12-17T11:48:44.902 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.887+0000 7f1aee7fc640 1 -- 172.21.15.40:0/890607659 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1af0039b90 con 0x7f1afc15f260 2023-12-17T11:48:44.902 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.887+0000 7f1b04133640 1 -- 172.21.15.40:0/890607659 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1afc0c93f0 con 0x7f1afc15f260 2023-12-17T11:48:44.903 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.887+0000 7f1b04133640 1 -- 172.21.15.40:0/890607659 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1afc0c9bf0 con 0x7f1afc15f260 2023-12-17T11:48:44.903 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.887+0000 7f1aee7fc640 1 -- 172.21.15.40:0/890607659 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1af00443f0 con 0x7f1afc15f260 2023-12-17T11:48:44.903 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.890+0000 7f1b04133640 1 -- 172.21.15.40:0/890607659 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ae4005250 con 0x7f1afc15f260 2023-12-17T11:48:44.903 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.896+0000 7f1aee7fc640 1 -- 172.21.15.40:0/890607659 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f1af004d3b0 con 0x7f1afc15f260 2023-12-17T11:48:44.903 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.898+0000 7f1aee7fc640 1 --2- 172.21.15.40:0/890607659 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f1ae006af10 0x7f1ae006d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:44.903 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.898+0000 7f1aee7fc640 1 -- 172.21.15.40:0/890607659 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f1af00ac220 con 0x7f1afc15f260 2023-12-17T11:48:44.903 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.899+0000 7f1b01ecf640 1 --2- 172.21.15.40:0/890607659 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f1ae006af10 0x7f1ae006d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:44.904 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.902+0000 7f1b01ecf640 1 --2- 172.21.15.40:0/890607659 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f1ae006af10 0x7f1ae006d3d0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f1af4005880 tx=0x7f1af4009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:48:44.905 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:44.903+0000 7f1aee7fc640 1 -- 172.21.15.40:0/890607659 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f1af0077070 con 0x7f1afc15f260 2023-12-17T11:48:45.239 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:45.237+0000 7fe452ffd640 1 -- 172.21.15.40:0/3380796404 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fe4400057d0 con 0x7fe46806d770 2023-12-17T11:48:45.241 INFO:teuthology.orchestra.run.smithi040.stdout:60129542154 2023-12-17T11:48:45.242 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:45.238+0000 7fe4657fa640 1 -- 172.21.15.40:0/3380796404 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fe45c04d020 con 0x7fe46806d770 2023-12-17T11:48:45.243 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:45.241+0000 7fe452ffd640 1 -- 172.21.15.40:0/3380796404 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7fe44c06af10 msgr2=0x7fe44c06d3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:45.243 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:45.242+0000 7fe452ffd640 1 --2- 172.21.15.40:0/3380796404 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7fe44c06af10 0x7fe44c06d3d0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fe46816d820 tx=0x7fe4540079e0 comp rx=0 tx=0).stop 2023-12-17T11:48:45.244 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:45.242+0000 7fe452ffd640 1 -- 172.21.15.40:0/3380796404 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe46806d770 msgr2=0x7fe468141ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:45.244 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:45.242+0000 7fe452ffd640 1 --2- 172.21.15.40:0/3380796404 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe46806d770 0x7fe468141ab0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fe45c0090b0 tx=0x7fe45c0046c0 comp rx=0 tx=0).stop 2023-12-17T11:48:45.245 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:45.243+0000 7fe452ffd640 1 -- 172.21.15.40:0/3380796404 shutdown_connections 2023-12-17T11:48:45.245 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:45.243+0000 7fe452ffd640 1 --2- 172.21.15.40:0/3380796404 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7fe44c06af10 0x7fe44c06d3d0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:45.245 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:45.243+0000 7fe452ffd640 1 --2- 172.21.15.40:0/3380796404 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe4680cbd10 0x7fe468152cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:45.245 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:45.243+0000 7fe452ffd640 1 --2- 172.21.15.40:0/3380796404 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe4680b1430 0x7fe468152780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:45.245 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:45.243+0000 7fe452ffd640 1 --2- 172.21.15.40:0/3380796404 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe46806d770 0x7fe468141ab0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:45.245 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:45.243+0000 7fe452ffd640 1 -- 172.21.15.40:0/3380796404 >> 172.21.15.40:0/3380796404 conn(0x7fe4680b0940 msgr2=0x7fe4680708b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:48:45.246 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:45.244+0000 7fe452ffd640 1 -- 172.21.15.40:0/3380796404 shutdown_connections 2023-12-17T11:48:45.246 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:45.244+0000 7fe452ffd640 1 -- 172.21.15.40:0/3380796404 wait complete. 2023-12-17T11:48:45.273 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542154 got 60129542154 for osd.0 2023-12-17T11:48:45.273 DEBUG:teuthology.parallel:result is None 2023-12-17T11:48:45.281 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:45.279+0000 7fdf5d7e5640 1 -- 172.21.15.40:0/1769372445 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fdf5806ebd0 con 0x7fdf58070700 2023-12-17T11:48:45.283 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:45.281+0000 7fdf3f7fe640 1 -- 172.21.15.40:0/1769372445 <== mon.2 v2:172.21.15.159:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fdf5806ebd0 con 0x7fdf58070700 2023-12-17T11:48:45.283 INFO:teuthology.orchestra.run.smithi040.stdout:60129542154 2023-12-17T11:48:45.283 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:45.281+0000 7f6d998da640 1 -- 172.21.15.40:0/3650109314 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f6d8c0e6740 con 0x7f6d8c0e3090 2023-12-17T11:48:45.284 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:45.282+0000 7f6d917fa640 1 -- 172.21.15.40:0/3650109314 <== mon.1 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f6d8c0e6740 con 0x7f6d8c0e3090 2023-12-17T11:48:45.284 INFO:teuthology.orchestra.run.smithi040.stdout:60129542154 2023-12-17T11:48:45.285 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:45.283+0000 7fa838cad640 1 -- 172.21.15.40:0/292567881 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7fa834156040 con 0x7fa8340cff00 2023-12-17T11:48:45.286 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:45.284+0000 7fa822ffd640 1 -- 172.21.15.40:0/292567881 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fa834156040 con 0x7fa8340cff00 2023-12-17T11:48:45.286 INFO:teuthology.orchestra.run.smithi040.stdout:60129542155 2023-12-17T11:48:45.286 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:45.284+0000 7fdf5d7e5640 1 -- 172.21.15.40:0/1769372445 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7fdf4406ae40 msgr2=0x7fdf4406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:45.287 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:45.284+0000 7fdf5d7e5640 1 --2- 172.21.15.40:0/1769372445 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7fdf4406ae40 0x7fdf4406d300 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fdf580ab610 tx=0x7fdf4c008040 comp rx=0 tx=0).stop 2023-12-17T11:48:45.287 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:45.284+0000 7fdf5d7e5640 1 -- 172.21.15.40:0/1769372445 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fdf58070700 msgr2=0x7fdf581522b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:45.287 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:45.284+0000 7fdf5d7e5640 1 --2- 172.21.15.40:0/1769372445 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fdf58070700 0x7fdf581522b0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fdf48009890 tx=0x7fdf480046c0 comp rx=0 tx=0).stop 2023-12-17T11:48:45.287 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:45.284+0000 7fdf5d7e5640 1 -- 172.21.15.40:0/1769372445 shutdown_connections 2023-12-17T11:48:45.287 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:45.284+0000 7fdf5d7e5640 1 --2- 172.21.15.40:0/1769372445 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7fdf4406ae40 0x7fdf4406d300 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:45.287 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:45.284+0000 7fdf5d7e5640 1 --2- 172.21.15.40:0/1769372445 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdf581626b0 0x7fdf5815d410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:45.287 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:45.284+0000 7fdf5d7e5640 1 --2- 172.21.15.40:0/1769372445 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdf5815f260 0x7fdf580b3a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:45.287 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:45.284+0000 7fdf5d7e5640 1 --2- 172.21.15.40:0/1769372445 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fdf58070700 0x7fdf581522b0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:45.287 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:45.284+0000 7fdf5d7e5640 1 -- 172.21.15.40:0/1769372445 >> 172.21.15.40:0/1769372445 conn(0x7fdf580b0a90 msgr2=0x7fdf58162cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:48:45.287 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:45.285+0000 7fdf5d7e5640 1 -- 172.21.15.40:0/1769372445 shutdown_connections 2023-12-17T11:48:45.287 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:45.285+0000 7fdf5d7e5640 1 -- 172.21.15.40:0/1769372445 wait complete. 2023-12-17T11:48:45.288 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:45.286+0000 7f6d998da640 1 -- 172.21.15.40:0/3650109314 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f6d7806ae40 msgr2=0x7f6d7806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:45.288 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:45.286+0000 7f6d998da640 1 --2- 172.21.15.40:0/3650109314 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f6d7806ae40 0x7f6d7806d300 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f6d88036000 tx=0x7f6d88008030 comp rx=0 tx=0).stop 2023-12-17T11:48:45.288 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:45.286+0000 7f6d998da640 1 -- 172.21.15.40:0/3650109314 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6d8c0e3090 msgr2=0x7f6d8c03dd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:45.288 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:45.286+0000 7f6d998da640 1 --2- 172.21.15.40:0/3650109314 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6d8c0e3090 0x7f6d8c03dd10 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f6d94000b60 tx=0x7f6d94067ed0 comp rx=0 tx=0).stop 2023-12-17T11:48:45.288 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:45.286+0000 7f6d998da640 1 -- 172.21.15.40:0/3650109314 shutdown_connections 2023-12-17T11:48:45.289 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:45.286+0000 7f6d998da640 1 --2- 172.21.15.40:0/3650109314 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f6d7806ae40 0x7f6d7806d300 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:45.289 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:45.286+0000 7f6d998da640 1 --2- 172.21.15.40:0/3650109314 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6d8c0e3090 0x7f6d8c03dd10 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:45.289 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:45.286+0000 7f6d998da640 1 --2- 172.21.15.40:0/3650109314 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6d8c054100 0x7f6d8c03d7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:45.289 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:45.286+0000 7f6d998da640 1 --2- 172.21.15.40:0/3650109314 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6d8c03e810 0x7f6d8c0d0560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:45.289 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:45.286+0000 7f6d998da640 1 -- 172.21.15.40:0/3650109314 >> 172.21.15.40:0/3650109314 conn(0x7f6d8c0559b0 msgr2=0x7f6d8c03c690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:48:45.289 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:45.287+0000 7f6d998da640 1 -- 172.21.15.40:0/3650109314 shutdown_connections 2023-12-17T11:48:45.290 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:45.287+0000 7fa838cad640 1 -- 172.21.15.40:0/292567881 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7fa81406ae90 msgr2=0x7fa81406d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:45.290 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:45.287+0000 7fa838cad640 1 --2- 172.21.15.40:0/292567881 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7fa81406ae90 0x7fa81406d350 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fa82c007e90 tx=0x7fa82c0073a0 comp rx=0 tx=0).stop 2023-12-17T11:48:45.290 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:45.287+0000 7fa838cad640 1 -- 172.21.15.40:0/292567881 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa8340cff00 msgr2=0x7fa8340c7e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:45.290 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:45.287+0000 7fa838cad640 1 --2- 172.21.15.40:0/292567881 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa8340cff00 0x7fa8340c7e30 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fa824009870 tx=0x7fa8240046c0 comp rx=0 tx=0).stop 2023-12-17T11:48:45.290 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:45.288+0000 7fa838cad640 1 -- 172.21.15.40:0/292567881 shutdown_connections 2023-12-17T11:48:45.290 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:45.288+0000 7fa838cad640 1 --2- 172.21.15.40:0/292567881 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7fa81406ae90 0x7fa81406d350 secure :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fa82c007e90 tx=0x7fa82c0073a0 comp rx=0 tx=0).stop 2023-12-17T11:48:45.290 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:45.288+0000 7fa838cad640 1 --2- 172.21.15.40:0/292567881 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa8341607f0 0x7fa83415b330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:45.290 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:45.288+0000 7fa838cad640 1 --2- 172.21.15.40:0/292567881 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa8340cff00 0x7fa8340c7e30 secure :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fa824009870 tx=0x7fa8240046c0 comp rx=0 tx=0).stop 2023-12-17T11:48:45.290 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:45.288+0000 7fa838cad640 1 --2- 172.21.15.40:0/292567881 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa8340cee80 0x7fa8340c78f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:45.290 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:45.288+0000 7fa838cad640 1 -- 172.21.15.40:0/292567881 >> 172.21.15.40:0/292567881 conn(0x7fa83409c450 msgr2=0x7fa8340cdc50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:48:45.291 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:45.287+0000 7f6d998da640 1 -- 172.21.15.40:0/3650109314 wait complete. 2023-12-17T11:48:45.291 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:45.288+0000 7fa838cad640 1 -- 172.21.15.40:0/292567881 shutdown_connections 2023-12-17T11:48:45.291 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:45.289+0000 7fa838cad640 1 -- 172.21.15.40:0/292567881 wait complete. 2023-12-17T11:48:45.299 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:45.297+0000 7f380aec9640 1 -- 172.21.15.40:0/811967031 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f37e80057d0 con 0x7f38041626b0 2023-12-17T11:48:45.300 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:45.298+0000 7f38017fa640 1 -- 172.21.15.40:0/811967031 <== mon.1 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f37fc059060 con 0x7f38041626b0 2023-12-17T11:48:45.300 INFO:teuthology.orchestra.run.smithi040.stdout:60129542155 2023-12-17T11:48:45.302 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:45.300+0000 7f380aec9640 1 -- 172.21.15.40:0/811967031 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f37e406af40 msgr2=0x7f37e406d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:45.302 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:45.300+0000 7f380aec9640 1 --2- 172.21.15.40:0/811967031 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f37e406af40 0x7f37e406d400 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f37f40097f0 tx=0x7f37f403b040 comp rx=0 tx=0).stop 2023-12-17T11:48:45.303 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:45.301+0000 7f380aec9640 1 -- 172.21.15.40:0/811967031 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f38041626b0 msgr2=0x7f380415b2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:45.303 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:45.301+0000 7f380aec9640 1 --2- 172.21.15.40:0/811967031 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f38041626b0 0x7f380415b2b0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f37fc00efc0 tx=0x7f37fc00c490 comp rx=0 tx=0).stop 2023-12-17T11:48:45.303 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:45.301+0000 7f380aec9640 1 -- 172.21.15.40:0/811967031 shutdown_connections 2023-12-17T11:48:45.303 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:45.301+0000 7f380aec9640 1 --2- 172.21.15.40:0/811967031 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f37e406af40 0x7f37e406d400 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:45.303 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:45.301+0000 7f380aec9640 1 --2- 172.21.15.40:0/811967031 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f38041626b0 0x7f380415b2b0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:45.303 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:45.301+0000 7f380aec9640 1 --2- 172.21.15.40:0/811967031 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f380415f260 0x7f38040b19b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:45.303 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:45.301+0000 7f380aec9640 1 --2- 172.21.15.40:0/811967031 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f38040708d0 0x7f38040a9690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:45.303 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:45.301+0000 7f380aec9640 1 -- 172.21.15.40:0/811967031 >> 172.21.15.40:0/811967031 conn(0x7f38040b0a90 msgr2=0x7f3804073070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:48:45.303 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:45.301+0000 7f380aec9640 1 -- 172.21.15.40:0/811967031 shutdown_connections 2023-12-17T11:48:45.304 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:45.301+0000 7f380aec9640 1 -- 172.21.15.40:0/811967031 wait complete. 2023-12-17T11:48:45.305 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:45.303+0000 7f1b04133640 1 -- 172.21.15.40:0/890607659 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f1ae40057d0 con 0x7f1afc15f260 2023-12-17T11:48:45.306 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:45.304+0000 7f1aee7fc640 1 -- 172.21.15.40:0/890607659 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f1af007a690 con 0x7f1afc15f260 2023-12-17T11:48:45.306 INFO:teuthology.orchestra.run.smithi040.stdout:60129542154 2023-12-17T11:48:45.308 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:45.306+0000 7f5659c23640 1 -- 172.21.15.40:0/2927222915 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f56540d07d0 con 0x7f56540cee40 2023-12-17T11:48:45.309 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:45.307+0000 7f563bfff640 1 -- 172.21.15.40:0/2927222915 <== mon.2 v2:172.21.15.159:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f5644021020 con 0x7f56540cee40 2023-12-17T11:48:45.309 INFO:teuthology.orchestra.run.smithi040.stdout:60129542155 2023-12-17T11:48:45.309 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:45.308+0000 7f1b04133640 1 -- 172.21.15.40:0/890607659 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f1ae006af10 msgr2=0x7f1ae006d3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:45.310 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:45.308+0000 7f1b04133640 1 --2- 172.21.15.40:0/890607659 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f1ae006af10 0x7f1ae006d3d0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f1af4005880 tx=0x7f1af4009040 comp rx=0 tx=0).stop 2023-12-17T11:48:45.310 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:45.308+0000 7f1b04133640 1 -- 172.21.15.40:0/890607659 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1afc15f260 msgr2=0x7f1afc1fab70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:45.310 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:45.308+0000 7f1b04133640 1 --2- 172.21.15.40:0/890607659 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1afc15f260 0x7f1afc1fab70 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f1af00098c0 tx=0x7f1af0004730 comp rx=0 tx=0).stop 2023-12-17T11:48:45.310 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:45.308+0000 7f1b04133640 1 -- 172.21.15.40:0/890607659 shutdown_connections 2023-12-17T11:48:45.311 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:45.308+0000 7f1b04133640 1 --2- 172.21.15.40:0/890607659 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f1ae006af10 0x7f1ae006d3d0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:45.311 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:45.308+0000 7f1b04133640 1 --2- 172.21.15.40:0/890607659 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1afc15f260 0x7f1afc1fab70 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:45.311 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:45.308+0000 7f1b04133640 1 --2- 172.21.15.40:0/890607659 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1afc0708d0 0x7f1afc1fa630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:45.311 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:45.308+0000 7f1b04133640 1 --2- 172.21.15.40:0/890607659 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1afc06d520 0x7f1afc1f8200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:45.311 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:45.308+0000 7f1b04133640 1 -- 172.21.15.40:0/890607659 >> 172.21.15.40:0/890607659 conn(0x7f1afc0b0a90 msgr2=0x7f1afc0ce980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:48:45.311 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:45.308+0000 7f1b04133640 1 -- 172.21.15.40:0/890607659 shutdown_connections 2023-12-17T11:48:45.311 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:45.308+0000 7f1b04133640 1 -- 172.21.15.40:0/890607659 wait complete. 2023-12-17T11:48:45.313 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:45.311+0000 7f5659c23640 1 -- 172.21.15.40:0/2927222915 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f564006ae40 msgr2=0x7f564006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:45.313 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:45.311+0000 7f5659c23640 1 --2- 172.21.15.40:0/2927222915 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f564006ae40 0x7f564006d300 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f56540c6320 tx=0x7f5648007b50 comp rx=0 tx=0).stop 2023-12-17T11:48:45.313 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:45.311+0000 7f5659c23640 1 -- 172.21.15.40:0/2927222915 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f56540cee40 msgr2=0x7f565415b490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:45.313 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:45.311+0000 7f5659c23640 1 --2- 172.21.15.40:0/2927222915 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f56540cee40 0x7f565415b490 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f564400e870 tx=0x7f564400ed30 comp rx=0 tx=0).stop 2023-12-17T11:48:45.314 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:45.311+0000 7f5659c23640 1 -- 172.21.15.40:0/2927222915 shutdown_connections 2023-12-17T11:48:45.314 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:45.311+0000 7f5659c23640 1 --2- 172.21.15.40:0/2927222915 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f564006ae40 0x7f564006d300 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:45.314 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:45.311+0000 7f5659c23640 1 --2- 172.21.15.40:0/2927222915 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f565415d2f0 0x7f56540c8b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:45.314 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:45.311+0000 7f5659c23640 1 --2- 172.21.15.40:0/2927222915 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f56540d1e80 0x7f56540cba00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:45.314 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:45.311+0000 7f5659c23640 1 --2- 172.21.15.40:0/2927222915 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f56540cee40 0x7f565415b490 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:45.314 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:45.311+0000 7f5659c23640 1 -- 172.21.15.40:0/2927222915 >> 172.21.15.40:0/2927222915 conn(0x7f565409c450 msgr2=0x7f5654072ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:48:45.314 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:45.312+0000 7f5659c23640 1 -- 172.21.15.40:0/2927222915 shutdown_connections 2023-12-17T11:48:45.314 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:45.312+0000 7f5659c23640 1 -- 172.21.15.40:0/2927222915 wait complete. 2023-12-17T11:48:45.315 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542154 got 60129542154 for osd.1 2023-12-17T11:48:45.315 DEBUG:teuthology.parallel:result is None 2023-12-17T11:48:45.317 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542155 got 60129542155 for osd.6 2023-12-17T11:48:45.317 DEBUG:teuthology.parallel:result is None 2023-12-17T11:48:45.318 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:45.316+0000 7f137b59e640 1 -- 172.21.15.40:0/1411712155 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f137c0d0630 con 0x7f137c0d13c0 2023-12-17T11:48:45.318 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:45.316+0000 7f136affd640 1 -- 172.21.15.40:0/1411712155 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f13740584d0 con 0x7f137c0d13c0 2023-12-17T11:48:45.318 INFO:teuthology.orchestra.run.smithi040.stdout:60129542155 2023-12-17T11:48:45.320 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542154 got 60129542154 for osd.3 2023-12-17T11:48:45.321 DEBUG:teuthology.parallel:result is None 2023-12-17T11:48:45.322 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:45.319+0000 7f137b59e640 1 -- 172.21.15.40:0/1411712155 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f135c06ae90 msgr2=0x7f135c06d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:45.322 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:45.319+0000 7f137b59e640 1 --2- 172.21.15.40:0/1411712155 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f135c06ae90 0x7f135c06d350 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f136c036000 tx=0x7f136c03c040 comp rx=0 tx=0).stop 2023-12-17T11:48:45.322 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:45.319+0000 7f137b59e640 1 -- 172.21.15.40:0/1411712155 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f137c0d13c0 msgr2=0x7f137c1ecf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:45.322 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:45.319+0000 7f137b59e640 1 --2- 172.21.15.40:0/1411712155 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f137c0d13c0 0x7f137c1ecf70 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f1374007dc0 tx=0x7f137400e4b0 comp rx=0 tx=0).stop 2023-12-17T11:48:45.322 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:45.319+0000 7f137b59e640 1 -- 172.21.15.40:0/1411712155 shutdown_connections 2023-12-17T11:48:45.322 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:45.319+0000 7f137b59e640 1 --2- 172.21.15.40:0/1411712155 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f135c06ae90 0x7f135c06d350 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:45.322 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:45.319+0000 7f137b59e640 1 --2- 172.21.15.40:0/1411712155 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f137c0d13c0 0x7f137c1ecf70 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:45.322 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:45.319+0000 7f137b59e640 1 --2- 172.21.15.40:0/1411712155 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f137c0d0d70 0x7f137c06e8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:45.322 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:45.319+0000 7f137b59e640 1 --2- 172.21.15.40:0/1411712155 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f137c0b0760 0x7f137c14e940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:45.322 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:45.320+0000 7f137b59e640 1 -- 172.21.15.40:0/1411712155 >> 172.21.15.40:0/1411712155 conn(0x7f137c09c260 msgr2=0x7f137c0cf370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:48:45.322 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:45.320+0000 7f137b59e640 1 -- 172.21.15.40:0/1411712155 shutdown_connections 2023-12-17T11:48:45.322 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:45.320+0000 7f137b59e640 1 -- 172.21.15.40:0/1411712155 wait complete. 2023-12-17T11:48:45.328 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542155 got 60129542155 for osd.2 2023-12-17T11:48:45.328 DEBUG:teuthology.parallel:result is None 2023-12-17T11:48:45.334 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542154 got 60129542154 for osd.5 2023-12-17T11:48:45.334 DEBUG:teuthology.parallel:result is None 2023-12-17T11:48:45.336 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542155 got 60129542155 for osd.7 2023-12-17T11:48:45.336 DEBUG:teuthology.parallel:result is None 2023-12-17T11:48:45.340 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542155 got 60129542155 for osd.4 2023-12-17T11:48:45.340 DEBUG:teuthology.parallel:result is None 2023-12-17T11:48:45.340 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-12-17T11:48:45.340 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-17T11:48:45.587 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:45.584+0000 7f84fc2e7640 1 Processor -- start 2023-12-17T11:48:45.587 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:45.585+0000 7f84fc2e7640 1 -- start start 2023-12-17T11:48:45.590 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:45.586+0000 7f84fc2e7640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f84f40cee80 0x7f84f40cf9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:45.590 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:45.586+0000 7f84fc2e7640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f84f40cff00 0x7f84f40b5fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:45.591 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:45.586+0000 7f84fc2e7640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84f40d0f60 con 0x7f84f41607f0 2023-12-17T11:48:45.591 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:45.586+0000 7f84fc2e7640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84f40d1be0 con 0x7f84f40cff00 2023-12-17T11:48:45.591 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:45.586+0000 7f84fc2e7640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84f40d0d50 con 0x7f84f40cee80 2023-12-17T11:48:45.591 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:45.587+0000 7f84fa083640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f84f41607f0 0x7f84f40ce770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:57488/0 (socket says 172.21.15.40:57488) 2023-12-17T11:48:45.591 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:45.587+0000 7f84fa083640 1 -- 172.21.15.40:0/75896019 learned_addr learned my addr 172.21.15.40:0/75896019 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-12-17T11:48:45.591 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:45.587+0000 7f84f9882640 1 --2- 172.21.15.40:0/75896019 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f84f40cee80 0x7f84f40cf9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:45.591 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:45.587+0000 7f84fa884640 1 --2- 172.21.15.40:0/75896019 >> v2:172.21.15.159:3300/0 conn(0x7f84f40cff00 0x7f84f40b5fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:45.591 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:45.587+0000 7f84f9081640 1 -- 172.21.15.40:0/75896019 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2892676970 0 0) 0x7f84f40d0f60 con 0x7f84f41607f0 2023-12-17T11:48:45.591 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:45.587+0000 7f84f9081640 1 -- 172.21.15.40:0/75896019 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f84dc003520 con 0x7f84f41607f0 2023-12-17T11:48:45.591 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:45.587+0000 7f84f9081640 1 -- 172.21.15.40:0/75896019 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 109530591 0 0) 0x7f84dc003520 con 0x7f84f41607f0 2023-12-17T11:48:45.591 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:45.587+0000 7f84f9081640 1 -- 172.21.15.40:0/75896019 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f84f40cee80 msgr2=0x7f84f40cf9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:48:45.592 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:45.587+0000 7f84f9081640 1 --2- 172.21.15.40:0/75896019 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f84f40cee80 0x7f84f40cf9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:45.592 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:45.587+0000 7f84f9081640 1 -- 172.21.15.40:0/75896019 >> v2:172.21.15.159:3300/0 conn(0x7f84f40cff00 msgr2=0x7f84f40b5fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:48:45.592 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:45.587+0000 7f84f9081640 1 --2- 172.21.15.40:0/75896019 >> v2:172.21.15.159:3300/0 conn(0x7f84f40cff00 0x7f84f40b5fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:45.592 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:45.587+0000 7f84f9081640 1 -- 172.21.15.40:0/75896019 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84f40d1240 con 0x7f84f41607f0 2023-12-17T11:48:45.592 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:45.587+0000 7f84f9081640 1 -- 172.21.15.40:0/75896019 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2643242555 0 0) 0x7f84e4001670 con 0x7f84f41607f0 2023-12-17T11:48:45.592 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:45.588+0000 7f84f9081640 1 -- 172.21.15.40:0/75896019 >> v1:172.21.15.40:6789/0 conn(0x7f84f41607f0 legacy=0x7f84f40ce770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:45.592 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:45.588+0000 7f84f9081640 1 --2- 172.21.15.40:0/75896019 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f84dc003970 0x7f84dc003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:45.592 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:45.588+0000 7f84f9081640 1 --2- 172.21.15.40:0/75896019 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f84dc0047c0 0x7f84dc004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:45.592 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:45.588+0000 7f84f9081640 1 --2- 172.21.15.40:0/75896019 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f84f40cee80 0x7f84dc005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:45.592 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:45.588+0000 7f84f9081640 1 -- 172.21.15.40:0/75896019 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84f40d1be0 con 0x7f84dc0047c0 2023-12-17T11:48:45.592 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:45.588+0000 7f84f9081640 1 -- 172.21.15.40:0/75896019 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84f40d0d50 con 0x7f84dc003970 2023-12-17T11:48:45.592 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:45.588+0000 7f84f9081640 1 -- 172.21.15.40:0/75896019 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84dc00b980 con 0x7f84f40cee80 2023-12-17T11:48:45.593 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:45.588+0000 7f84f9882640 1 --2- 172.21.15.40:0/75896019 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f84dc0047c0 0x7f84dc004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:45.593 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:45.588+0000 7f84fa884640 1 --2- 172.21.15.40:0/75896019 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f84f40cee80 0x7f84dc005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:45.593 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:45.588+0000 7f84f9882640 1 -- 172.21.15.40:0/75896019 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f84f40cee80 msgr2=0x7f84dc005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:48:45.593 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:45.588+0000 7f84f9882640 1 --2- 172.21.15.40:0/75896019 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f84f40cee80 0x7f84dc005180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:45.593 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:45.588+0000 7f84f9882640 1 -- 172.21.15.40:0/75896019 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f84dc003970 msgr2=0x7f84dc003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:48:45.593 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:45.588+0000 7f84f9882640 1 --2- 172.21.15.40:0/75896019 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f84dc003970 0x7f84dc003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:45.593 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:45.588+0000 7f84f9882640 1 -- 172.21.15.40:0/75896019 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84dc003520 con 0x7f84dc0047c0 2023-12-17T11:48:45.594 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:45.589+0000 7f84f9882640 1 --2- 172.21.15.40:0/75896019 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f84dc0047c0 0x7f84dc004c40 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f84e8009af0 tx=0x7f84dc0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59264ffae001f199 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:48:45.594 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:45.590+0000 7f84f9081640 1 -- 172.21.15.40:0/75896019 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84e802c6b0 con 0x7f84dc0047c0 2023-12-17T11:48:45.595 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:45.590+0000 7f84f9081640 1 -- 172.21.15.40:0/75896019 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84e802c810 con 0x7f84dc0047c0 2023-12-17T11:48:45.595 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:45.590+0000 7f84f9081640 1 -- 172.21.15.40:0/75896019 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84e802cba0 con 0x7f84dc0047c0 2023-12-17T11:48:45.595 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:45.590+0000 7f84fc2e7640 1 -- 172.21.15.40:0/75896019 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f84dc0047c0 msgr2=0x7f84dc004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:45.595 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:45.590+0000 7f84fc2e7640 1 --2- 172.21.15.40:0/75896019 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f84dc0047c0 0x7f84dc004c40 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f84e8009af0 tx=0x7f84dc0057f0 comp rx=0 tx=0).stop 2023-12-17T11:48:45.595 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:45.590+0000 7f84fa884640 1 -- 172.21.15.40:0/75896019 reap_dead start 2023-12-17T11:48:45.595 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:45.590+0000 7f84fc2e7640 1 -- 172.21.15.40:0/75896019 shutdown_connections 2023-12-17T11:48:45.595 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:45.590+0000 7f84fc2e7640 1 -- 172.21.15.40:0/75896019 >> 172.21.15.40:0/75896019 conn(0x7f84f409c450 msgr2=0x7f84f40d3180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:48:45.595 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:45.590+0000 7f84fc2e7640 1 -- 172.21.15.40:0/75896019 shutdown_connections 2023-12-17T11:48:45.595 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:45.590+0000 7f84fc2e7640 1 -- 172.21.15.40:0/75896019 wait complete. 2023-12-17T11:48:45.595 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:45.592+0000 7f84fc2e7640 1 Processor -- start 2023-12-17T11:48:45.595 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:45.592+0000 7f84fc2e7640 1 -- start start 2023-12-17T11:48:45.598 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:45.593+0000 7f84fc2e7640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f84dc0047c0 0x7f84f4152e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:45.598 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:45.593+0000 7f84fc2e7640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f84f414f240 0x7f84f40cb510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:45.598 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:45.593+0000 7f84fc2e7640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f84f414c4d0 0x7f84f414c980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:45.598 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:45.593+0000 7f84fc2e7640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84f414cec0 con 0x7f84f414f240 2023-12-17T11:48:45.598 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:45.593+0000 7f84fc2e7640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84f414f740 con 0x7f84f414c4d0 2023-12-17T11:48:45.598 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:45.593+0000 7f84fc2e7640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84f414fa20 con 0x7f84dc0047c0 2023-12-17T11:48:45.598 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:45.594+0000 7f84f9882640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f84f414f240 0x7f84f40cb510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:45.598 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:45.594+0000 7f84f9882640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f84f414f240 0x7f84f40cb510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:41414/0 (socket says 172.21.15.40:41414) 2023-12-17T11:48:45.598 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:45.594+0000 7f84f9882640 1 -- 172.21.15.40:0/379262969 learned_addr learned my addr 172.21.15.40:0/379262969 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-17T11:48:45.598 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:45.594+0000 7f84fa083640 1 --2- 172.21.15.40:0/379262969 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f84dc0047c0 0x7f84f4152e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:45.599 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:45.594+0000 7f84fa884640 1 --2- 172.21.15.40:0/379262969 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f84f414c4d0 0x7f84f414c980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:45.599 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:45.594+0000 7f84f9882640 1 -- 172.21.15.40:0/379262969 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f84dc0047c0 msgr2=0x7f84f4152e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:45.599 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:45.594+0000 7f84f9882640 1 --2- 172.21.15.40:0/379262969 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f84dc0047c0 0x7f84f4152e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:45.599 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:45.594+0000 7f84f9882640 1 -- 172.21.15.40:0/379262969 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f84f414c4d0 msgr2=0x7f84f414c980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:45.599 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:45.594+0000 7f84f9882640 1 --2- 172.21.15.40:0/379262969 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f84f414c4d0 0x7f84f414c980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:45.599 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:45.594+0000 7f84f9882640 1 -- 172.21.15.40:0/379262969 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84f414fd00 con 0x7f84f414f240 2023-12-17T11:48:45.599 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:45.594+0000 7f84fa884640 1 --2- 172.21.15.40:0/379262969 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f84f414c4d0 0x7f84f414c980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-17T11:48:45.599 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:45.594+0000 7f84f9882640 1 --2- 172.21.15.40:0/379262969 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f84f414f240 0x7f84f40cb510 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f84e8037040 tx=0x7f84e8004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:48:45.599 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:45.594+0000 7f84f2ffd640 1 -- 172.21.15.40:0/379262969 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84e8003810 con 0x7f84f414f240 2023-12-17T11:48:45.599 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:45.595+0000 7f84f2ffd640 1 -- 172.21.15.40:0/379262969 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84e8003970 con 0x7f84f414f240 2023-12-17T11:48:45.599 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:45.595+0000 7f84fc2e7640 1 -- 172.21.15.40:0/379262969 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84f414ffe0 con 0x7f84f414f240 2023-12-17T11:48:45.600 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:45.595+0000 7f84f2ffd640 1 -- 172.21.15.40:0/379262969 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84e8003ce0 con 0x7f84f414f240 2023-12-17T11:48:45.600 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:45.595+0000 7f84fc2e7640 1 -- 172.21.15.40:0/379262969 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84f41533d0 con 0x7f84f414f240 2023-12-17T11:48:45.600 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:45.596+0000 7f84fc2e7640 1 -- 172.21.15.40:0/379262969 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84f409f1b0 con 0x7f84f414f240 2023-12-17T11:48:45.600 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:45.597+0000 7f84f2ffd640 1 -- 172.21.15.40:0/379262969 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f84e8034440 con 0x7f84f414f240 2023-12-17T11:48:45.601 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:45.597+0000 7f84f2ffd640 1 --2- 172.21.15.40:0/379262969 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f84e006ae40 0x7f84e006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:45.601 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:45.598+0000 7f84f2ffd640 1 -- 172.21.15.40:0/379262969 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f84e80abbb0 con 0x7f84f414f240 2023-12-17T11:48:45.601 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:45.598+0000 7f84fa083640 1 --2- 172.21.15.40:0/379262969 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f84e006ae40 0x7f84e006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:45.601 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:45.599+0000 7f84fa083640 1 --2- 172.21.15.40:0/379262969 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f84e006ae40 0x7f84e006d300 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f84e4001eb0 tx=0x7f84e4001610 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:48:45.604 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:45.602+0000 7f84f2ffd640 1 -- 172.21.15.40:0/379262969 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f84f409f1b0 con 0x7f84f414f240 2023-12-17T11:48:45.789 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:45.787+0000 7f84fc2e7640 1 -- 172.21.15.40:0/379262969 --> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f84f414cec0 con 0x7f84e006ae40 2023-12-17T11:48:45.818 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:45.816+0000 7f84f2ffd640 1 -- 172.21.15.40:0/379262969 <== mgr.4105 v2:172.21.15.159:6832/479465803 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+345198 (secure 0 0 0) 0x7f84f414cec0 con 0x7f84e006ae40 2023-12-17T11:48:45.823 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T11:48:45.827 INFO:teuthology.orchestra.run.smithi040.stderr:dumped all 2023-12-17T11:48:45.829 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:45.823+0000 7f84fc2e7640 1 -- 172.21.15.40:0/379262969 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f84e006ae40 msgr2=0x7f84e006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:45.829 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:45.823+0000 7f84fc2e7640 1 --2- 172.21.15.40:0/379262969 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f84e006ae40 0x7f84e006d300 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f84e4001eb0 tx=0x7f84e4001610 comp rx=0 tx=0).stop 2023-12-17T11:48:45.829 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:45.823+0000 7f84fc2e7640 1 -- 172.21.15.40:0/379262969 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f84f414f240 msgr2=0x7f84f40cb510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:45.829 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:45.823+0000 7f84fc2e7640 1 --2- 172.21.15.40:0/379262969 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f84f414f240 0x7f84f40cb510 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f84e8037040 tx=0x7f84e8004730 comp rx=0 tx=0).stop 2023-12-17T11:48:45.830 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:45.823+0000 7f84fc2e7640 1 -- 172.21.15.40:0/379262969 shutdown_connections 2023-12-17T11:48:45.830 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:45.823+0000 7f84fc2e7640 1 --2- 172.21.15.40:0/379262969 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f84e006ae40 0x7f84e006d300 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:45.830 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:45.823+0000 7f84fc2e7640 1 --2- 172.21.15.40:0/379262969 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f84f414c4d0 0x7f84f414c980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:45.830 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:45.823+0000 7f84fc2e7640 1 --2- 172.21.15.40:0/379262969 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f84f414f240 0x7f84f40cb510 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:45.830 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:45.823+0000 7f84fc2e7640 1 --2- 172.21.15.40:0/379262969 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f84dc0047c0 0x7f84f4152e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:45.830 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:45.823+0000 7f84fc2e7640 1 -- 172.21.15.40:0/379262969 >> 172.21.15.40:0/379262969 conn(0x7f84f409c450 msgr2=0x7f84f40cf260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:48:45.830 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:45.823+0000 7f84fc2e7640 1 -- 172.21.15.40:0/379262969 shutdown_connections 2023-12-17T11:48:45.830 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:45.824+0000 7f84fc2e7640 1 -- 172.21.15.40:0/379262969 wait complete. 2023-12-17T11:48:45.842 INFO:teuthology.orchestra.run.smithi040.stdout:{"pg_ready":true,"pg_map":{"version":37,"stamp":"2023-12-17T11:48:44.602457+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595006,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":208,"num_write_kb":2435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160,"ondisk_log_size":160,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219440,"kb_used_data":3272,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755280,"statfs":{"total":773094113280,"available":772869406720,"internally_reserved":0,"allocated":3350528,"data_stored":2014708,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":221236786},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1781,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005615"},"pg_stats":[{"pgid":"2.1f","version":"20'4","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-17T11:48:22.517845+0000","last_change":"2023-12-17T11:48:17.243309+0000","last_active":"2023-12-17T11:48:22.517845+0000","last_peered":"2023-12-17T11:48:22.517845+0000","last_clean":"2023-12-17T11:48:22.517845+0000","last_became_active":"2023-12-17T11:48:17.242970+0000","last_became_peered":"2023-12-17T11:48:17.242970+0000","last_unstale":"2023-12-17T11:48:22.517845+0000","last_undegraded":"2023-12-17T11:48:22.517845+0000","last_fullsized":"2023-12-17T11:48:22.517845+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:16.193911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:16.193911+0000","last_clean_scrub_stamp":"2023-12-17T11:48:16.193911+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T21:33:08.409177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-17T11:48:22.501333+0000","last_change":"2023-12-17T11:48:18.269881+0000","last_active":"2023-12-17T11:48:22.501333+0000","last_peered":"2023-12-17T11:48:22.501333+0000","last_clean":"2023-12-17T11:48:22.501333+0000","last_became_active":"2023-12-17T11:48:18.268658+0000","last_became_peered":"2023-12-17T11:48:18.268658+0000","last_unstale":"2023-12-17T11:48:22.501333+0000","last_undegraded":"2023-12-17T11:48:22.501333+0000","last_fullsized":"2023-12-17T11:48:22.501333+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_clean_scrub_stamp":"2023-12-17T11:48:17.199970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T22:33:29.994957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-17T11:48:24.563717+0000","last_change":"2023-12-17T11:48:22.536397+0000","last_active":"2023-12-17T11:48:24.563717+0000","last_peered":"2023-12-17T11:48:24.563717+0000","last_clean":"2023-12-17T11:48:24.563717+0000","last_became_active":"2023-12-17T11:48:22.535833+0000","last_became_peered":"2023-12-17T11:48:22.535833+0000","last_unstale":"2023-12-17T11:48:24.563717+0000","last_undegraded":"2023-12-17T11:48:24.563717+0000","last_fullsized":"2023-12-17T11:48:24.563717+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:21.473989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:21.473989+0000","last_clean_scrub_stamp":"2023-12-17T11:48:21.473989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T13:25:07.551873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-17T11:48:22.500677+0000","last_change":"2023-12-17T11:48:17.242548+0000","last_active":"2023-12-17T11:48:22.500677+0000","last_peered":"2023-12-17T11:48:22.500677+0000","last_clean":"2023-12-17T11:48:22.500677+0000","last_became_active":"2023-12-17T11:48:17.242261+0000","last_became_peered":"2023-12-17T11:48:17.242261+0000","last_unstale":"2023-12-17T11:48:22.500677+0000","last_undegraded":"2023-12-17T11:48:22.500677+0000","last_fullsized":"2023-12-17T11:48:22.500677+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:16.193911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:16.193911+0000","last_clean_scrub_stamp":"2023-12-17T11:48:16.193911+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T17:25:44.412598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-17T11:48:22.517637+0000","last_change":"2023-12-17T11:48:18.284502+0000","last_active":"2023-12-17T11:48:22.517637+0000","last_peered":"2023-12-17T11:48:22.517637+0000","last_clean":"2023-12-17T11:48:22.517637+0000","last_became_active":"2023-12-17T11:48:18.284224+0000","last_became_peered":"2023-12-17T11:48:18.284224+0000","last_unstale":"2023-12-17T11:48:22.517637+0000","last_undegraded":"2023-12-17T11:48:22.517637+0000","last_fullsized":"2023-12-17T11:48:22.517637+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_clean_scrub_stamp":"2023-12-17T11:48:17.199970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T16:14:48.723317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-17T11:48:23.467417+0000","last_change":"2023-12-17T11:48:22.534382+0000","last_active":"2023-12-17T11:48:23.467417+0000","last_peered":"2023-12-17T11:48:23.467417+0000","last_clean":"2023-12-17T11:48:23.467417+0000","last_became_active":"2023-12-17T11:48:22.533910+0000","last_became_peered":"2023-12-17T11:48:22.533910+0000","last_unstale":"2023-12-17T11:48:23.467417+0000","last_undegraded":"2023-12-17T11:48:23.467417+0000","last_fullsized":"2023-12-17T11:48:23.467417+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:21.473989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:21.473989+0000","last_clean_scrub_stamp":"2023-12-17T11:48:21.473989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T22:33:34.268975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-17T11:48:22.538051+0000","last_change":"2023-12-17T11:48:17.252782+0000","last_active":"2023-12-17T11:48:22.538051+0000","last_peered":"2023-12-17T11:48:22.538051+0000","last_clean":"2023-12-17T11:48:22.538051+0000","last_became_active":"2023-12-17T11:48:17.252501+0000","last_became_peered":"2023-12-17T11:48:17.252501+0000","last_unstale":"2023-12-17T11:48:22.538051+0000","last_undegraded":"2023-12-17T11:48:22.538051+0000","last_fullsized":"2023-12-17T11:48:22.538051+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:16.193911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:16.193911+0000","last_clean_scrub_stamp":"2023-12-17T11:48:16.193911+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T18:12:00.944371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-17T11:48:22.521803+0000","last_change":"2023-12-17T11:48:18.283410+0000","last_active":"2023-12-17T11:48:22.521803+0000","last_peered":"2023-12-17T11:48:22.521803+0000","last_clean":"2023-12-17T11:48:22.521803+0000","last_became_active":"2023-12-17T11:48:18.283129+0000","last_became_peered":"2023-12-17T11:48:18.283129+0000","last_unstale":"2023-12-17T11:48:22.521803+0000","last_undegraded":"2023-12-17T11:48:22.521803+0000","last_fullsized":"2023-12-17T11:48:22.521803+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_clean_scrub_stamp":"2023-12-17T11:48:17.199970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T13:18:38.029532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-17T11:48:23.468045+0000","last_change":"2023-12-17T11:48:22.532489+0000","last_active":"2023-12-17T11:48:23.468045+0000","last_peered":"2023-12-17T11:48:23.468045+0000","last_clean":"2023-12-17T11:48:23.468045+0000","last_became_active":"2023-12-17T11:48:22.531971+0000","last_became_peered":"2023-12-17T11:48:22.531971+0000","last_unstale":"2023-12-17T11:48:23.468045+0000","last_undegraded":"2023-12-17T11:48:23.468045+0000","last_fullsized":"2023-12-17T11:48:23.468045+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:21.473989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:21.473989+0000","last_clean_scrub_stamp":"2023-12-17T11:48:21.473989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T14:39:15.707189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-17T11:48:22.538470+0000","last_change":"2023-12-17T11:48:17.259412+0000","last_active":"2023-12-17T11:48:22.538470+0000","last_peered":"2023-12-17T11:48:22.538470+0000","last_clean":"2023-12-17T11:48:22.538470+0000","last_became_active":"2023-12-17T11:48:17.259092+0000","last_became_peered":"2023-12-17T11:48:17.259092+0000","last_unstale":"2023-12-17T11:48:22.538470+0000","last_undegraded":"2023-12-17T11:48:22.538470+0000","last_fullsized":"2023-12-17T11:48:22.538470+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:16.193911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:16.193911+0000","last_clean_scrub_stamp":"2023-12-17T11:48:16.193911+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T21:38:11.246682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-17T11:48:22.522929+0000","last_change":"2023-12-17T11:48:18.282884+0000","last_active":"2023-12-17T11:48:22.522929+0000","last_peered":"2023-12-17T11:48:22.522929+0000","last_clean":"2023-12-17T11:48:22.522929+0000","last_became_active":"2023-12-17T11:48:18.282589+0000","last_became_peered":"2023-12-17T11:48:18.282589+0000","last_unstale":"2023-12-17T11:48:22.522929+0000","last_undegraded":"2023-12-17T11:48:22.522929+0000","last_fullsized":"2023-12-17T11:48:22.522929+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_clean_scrub_stamp":"2023-12-17T11:48:17.199970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T14:46:31.139617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-17T11:48:23.468065+0000","last_change":"2023-12-17T11:48:22.524129+0000","last_active":"2023-12-17T11:48:23.468065+0000","last_peered":"2023-12-17T11:48:23.468065+0000","last_clean":"2023-12-17T11:48:23.468065+0000","last_became_active":"2023-12-17T11:48:22.523749+0000","last_became_peered":"2023-12-17T11:48:22.523749+0000","last_unstale":"2023-12-17T11:48:23.468065+0000","last_undegraded":"2023-12-17T11:48:23.468065+0000","last_fullsized":"2023-12-17T11:48:23.468065+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:21.473989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:21.473989+0000","last_clean_scrub_stamp":"2023-12-17T11:48:21.473989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T14:35:42.104042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-17T11:48:22.528476+0000","last_change":"2023-12-17T11:48:18.262498+0000","last_active":"2023-12-17T11:48:22.528476+0000","last_peered":"2023-12-17T11:48:22.528476+0000","last_clean":"2023-12-17T11:48:22.528476+0000","last_became_active":"2023-12-17T11:48:18.260747+0000","last_became_peered":"2023-12-17T11:48:18.260747+0000","last_unstale":"2023-12-17T11:48:22.528476+0000","last_undegraded":"2023-12-17T11:48:22.528476+0000","last_fullsized":"2023-12-17T11:48:22.528476+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_clean_scrub_stamp":"2023-12-17T11:48:17.199970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T19:01:46.435511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-17T11:48:22.538318+0000","last_change":"2023-12-17T11:48:17.254579+0000","last_active":"2023-12-17T11:48:22.538318+0000","last_peered":"2023-12-17T11:48:22.538318+0000","last_clean":"2023-12-17T11:48:22.538318+0000","last_became_active":"2023-12-17T11:48:17.254302+0000","last_became_peered":"2023-12-17T11:48:17.254302+0000","last_unstale":"2023-12-17T11:48:22.538318+0000","last_undegraded":"2023-12-17T11:48:22.538318+0000","last_fullsized":"2023-12-17T11:48:22.538318+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:16.193911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:16.193911+0000","last_clean_scrub_stamp":"2023-12-17T11:48:16.193911+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T22:46:18.442258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-17T11:48:23.469632+0000","last_change":"2023-12-17T11:48:22.541168+0000","last_active":"2023-12-17T11:48:23.469632+0000","last_peered":"2023-12-17T11:48:23.469632+0000","last_clean":"2023-12-17T11:48:23.469632+0000","last_became_active":"2023-12-17T11:48:22.539739+0000","last_became_peered":"2023-12-17T11:48:22.539739+0000","last_unstale":"2023-12-17T11:48:23.469632+0000","last_undegraded":"2023-12-17T11:48:23.469632+0000","last_fullsized":"2023-12-17T11:48:23.469632+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:21.473989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:21.473989+0000","last_clean_scrub_stamp":"2023-12-17T11:48:21.473989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T13:18:42.303550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-17T11:48:22.498917+0000","last_change":"2023-12-17T11:48:18.271462+0000","last_active":"2023-12-17T11:48:22.498917+0000","last_peered":"2023-12-17T11:48:22.498917+0000","last_clean":"2023-12-17T11:48:22.498917+0000","last_became_active":"2023-12-17T11:48:18.270639+0000","last_became_peered":"2023-12-17T11:48:18.270639+0000","last_unstale":"2023-12-17T11:48:22.498917+0000","last_undegraded":"2023-12-17T11:48:22.498917+0000","last_fullsized":"2023-12-17T11:48:22.498917+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_clean_scrub_stamp":"2023-12-17T11:48:17.199970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T16:14:48.723317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-17T11:48:22.528530+0000","last_change":"2023-12-17T11:48:17.243128+0000","last_active":"2023-12-17T11:48:22.528530+0000","last_peered":"2023-12-17T11:48:22.528530+0000","last_clean":"2023-12-17T11:48:22.528530+0000","last_became_active":"2023-12-17T11:48:17.242656+0000","last_became_peered":"2023-12-17T11:48:17.242656+0000","last_unstale":"2023-12-17T11:48:22.528530+0000","last_undegraded":"2023-12-17T11:48:22.528530+0000","last_fullsized":"2023-12-17T11:48:22.528530+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:16.193911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:16.193911+0000","last_clean_scrub_stamp":"2023-12-17T11:48:16.193911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T21:33:08.409177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-17T11:48:23.468866+0000","last_change":"2023-12-17T11:48:22.539973+0000","last_active":"2023-12-17T11:48:23.468866+0000","last_peered":"2023-12-17T11:48:23.468866+0000","last_clean":"2023-12-17T11:48:23.468866+0000","last_became_active":"2023-12-17T11:48:22.539592+0000","last_became_peered":"2023-12-17T11:48:22.539592+0000","last_unstale":"2023-12-17T11:48:23.468866+0000","last_undegraded":"2023-12-17T11:48:23.468866+0000","last_fullsized":"2023-12-17T11:48:23.468866+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:21.473989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:21.473989+0000","last_clean_scrub_stamp":"2023-12-17T11:48:21.473989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T19:19:54.372270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-17T11:48:22.498149+0000","last_change":"2023-12-17T11:48:18.272948+0000","last_active":"2023-12-17T11:48:22.498149+0000","last_peered":"2023-12-17T11:48:22.498149+0000","last_clean":"2023-12-17T11:48:22.498149+0000","last_became_active":"2023-12-17T11:48:18.272251+0000","last_became_peered":"2023-12-17T11:48:18.272251+0000","last_unstale":"2023-12-17T11:48:22.498149+0000","last_undegraded":"2023-12-17T11:48:22.498149+0000","last_fullsized":"2023-12-17T11:48:22.498149+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_clean_scrub_stamp":"2023-12-17T11:48:17.199970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T23:46:39.140775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-17T11:48:22.529348+0000","last_change":"2023-12-17T11:48:17.249233+0000","last_active":"2023-12-17T11:48:22.529348+0000","last_peered":"2023-12-17T11:48:22.529348+0000","last_clean":"2023-12-17T11:48:22.529348+0000","last_became_active":"2023-12-17T11:48:17.248693+0000","last_became_peered":"2023-12-17T11:48:17.248693+0000","last_unstale":"2023-12-17T11:48:22.529348+0000","last_undegraded":"2023-12-17T11:48:22.529348+0000","last_fullsized":"2023-12-17T11:48:22.529348+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:16.193911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:16.193911+0000","last_clean_scrub_stamp":"2023-12-17T11:48:16.193911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T15:52:21.914780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-17T11:48:24.569901+0000","last_change":"2023-12-17T11:48:22.546268+0000","last_active":"2023-12-17T11:48:24.569901+0000","last_peered":"2023-12-17T11:48:24.569901+0000","last_clean":"2023-12-17T11:48:24.569901+0000","last_became_active":"2023-12-17T11:48:22.545873+0000","last_became_peered":"2023-12-17T11:48:22.545873+0000","last_unstale":"2023-12-17T11:48:24.569901+0000","last_undegraded":"2023-12-17T11:48:24.569901+0000","last_fullsized":"2023-12-17T11:48:24.569901+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:21.473989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:21.473989+0000","last_clean_scrub_stamp":"2023-12-17T11:48:21.473989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T21:28:14.069617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-17T11:48:22.514153+0000","last_change":"2023-12-17T11:48:18.258783+0000","last_active":"2023-12-17T11:48:22.514153+0000","last_peered":"2023-12-17T11:48:22.514153+0000","last_clean":"2023-12-17T11:48:22.514153+0000","last_became_active":"2023-12-17T11:48:18.258068+0000","last_became_peered":"2023-12-17T11:48:18.258068+0000","last_unstale":"2023-12-17T11:48:22.514153+0000","last_undegraded":"2023-12-17T11:48:22.514153+0000","last_fullsized":"2023-12-17T11:48:22.514153+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_clean_scrub_stamp":"2023-12-17T11:48:17.199970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T15:07:39.743439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-17T11:48:22.537435+0000","last_change":"2023-12-17T11:48:17.253559+0000","last_active":"2023-12-17T11:48:22.537435+0000","last_peered":"2023-12-17T11:48:22.537435+0000","last_clean":"2023-12-17T11:48:22.537435+0000","last_became_active":"2023-12-17T11:48:17.253271+0000","last_became_peered":"2023-12-17T11:48:17.253271+0000","last_unstale":"2023-12-17T11:48:22.537435+0000","last_undegraded":"2023-12-17T11:48:22.537435+0000","last_fullsized":"2023-12-17T11:48:22.537435+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:16.193911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:16.193911+0000","last_clean_scrub_stamp":"2023-12-17T11:48:16.193911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T22:20:08.219855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-17T11:48:23.470614+0000","last_change":"2023-12-17T11:48:22.541511+0000","last_active":"2023-12-17T11:48:23.470614+0000","last_peered":"2023-12-17T11:48:23.470614+0000","last_clean":"2023-12-17T11:48:23.470614+0000","last_became_active":"2023-12-17T11:48:22.540975+0000","last_became_peered":"2023-12-17T11:48:22.540975+0000","last_unstale":"2023-12-17T11:48:23.470614+0000","last_undegraded":"2023-12-17T11:48:23.470614+0000","last_fullsized":"2023-12-17T11:48:23.470614+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:21.473989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:21.473989+0000","last_clean_scrub_stamp":"2023-12-17T11:48:21.473989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T14:46:35.413635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-17T11:48:22.517573+0000","last_change":"2023-12-17T11:48:18.270278+0000","last_active":"2023-12-17T11:48:22.517573+0000","last_peered":"2023-12-17T11:48:22.517573+0000","last_clean":"2023-12-17T11:48:22.517573+0000","last_became_active":"2023-12-17T11:48:18.269966+0000","last_became_peered":"2023-12-17T11:48:18.269966+0000","last_unstale":"2023-12-17T11:48:22.517573+0000","last_undegraded":"2023-12-17T11:48:22.517573+0000","last_fullsized":"2023-12-17T11:48:22.517573+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_clean_scrub_stamp":"2023-12-17T11:48:17.199970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T19:40:13.516541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-17T11:48:22.530568+0000","last_change":"2023-12-17T11:48:17.249856+0000","last_active":"2023-12-17T11:48:22.530568+0000","last_peered":"2023-12-17T11:48:22.530568+0000","last_clean":"2023-12-17T11:48:22.530568+0000","last_became_active":"2023-12-17T11:48:17.249564+0000","last_became_peered":"2023-12-17T11:48:17.249564+0000","last_unstale":"2023-12-17T11:48:22.530568+0000","last_undegraded":"2023-12-17T11:48:22.530568+0000","last_fullsized":"2023-12-17T11:48:22.530568+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:16.193911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:16.193911+0000","last_clean_scrub_stamp":"2023-12-17T11:48:16.193911+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T15:07:38.737379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-17T11:48:23.467555+0000","last_change":"2023-12-17T11:48:22.541474+0000","last_active":"2023-12-17T11:48:23.467555+0000","last_peered":"2023-12-17T11:48:23.467555+0000","last_clean":"2023-12-17T11:48:23.467555+0000","last_became_active":"2023-12-17T11:48:22.541092+0000","last_became_peered":"2023-12-17T11:48:22.541092+0000","last_unstale":"2023-12-17T11:48:23.467555+0000","last_undegraded":"2023-12-17T11:48:23.467555+0000","last_fullsized":"2023-12-17T11:48:23.467555+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:21.473989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:21.473989+0000","last_clean_scrub_stamp":"2023-12-17T11:48:21.473989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T20:54:02.500358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-17T11:48:22.502585+0000","last_change":"2023-12-17T11:48:18.270544+0000","last_active":"2023-12-17T11:48:22.502585+0000","last_peered":"2023-12-17T11:48:22.502585+0000","last_clean":"2023-12-17T11:48:22.502585+0000","last_became_active":"2023-12-17T11:48:18.270216+0000","last_became_peered":"2023-12-17T11:48:18.270216+0000","last_unstale":"2023-12-17T11:48:22.502585+0000","last_undegraded":"2023-12-17T11:48:22.502585+0000","last_fullsized":"2023-12-17T11:48:22.502585+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_clean_scrub_stamp":"2023-12-17T11:48:17.199970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T14:39:11.433170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"24'1","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-17T11:48:23.109451+0000","last_change":"2023-12-17T11:48:17.239499+0000","last_active":"2023-12-17T11:48:23.109451+0000","last_peered":"2023-12-17T11:48:23.109451+0000","last_clean":"2023-12-17T11:48:23.109451+0000","last_became_active":"2023-12-17T11:48:17.239256+0000","last_became_peered":"2023-12-17T11:48:17.239256+0000","last_unstale":"2023-12-17T11:48:23.109451+0000","last_undegraded":"2023-12-17T11:48:23.109451+0000","last_fullsized":"2023-12-17T11:48:23.109451+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:16.193911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:16.193911+0000","last_clean_scrub_stamp":"2023-12-17T11:48:16.193911+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T19:10:09.191716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-17T11:48:24.562916+0000","last_change":"2023-12-17T11:48:22.538930+0000","last_active":"2023-12-17T11:48:24.562916+0000","last_peered":"2023-12-17T11:48:24.562916+0000","last_clean":"2023-12-17T11:48:24.562916+0000","last_became_active":"2023-12-17T11:48:22.538189+0000","last_became_peered":"2023-12-17T11:48:22.538189+0000","last_unstale":"2023-12-17T11:48:24.562916+0000","last_undegraded":"2023-12-17T11:48:24.562916+0000","last_fullsized":"2023-12-17T11:48:24.562916+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:21.473989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:21.473989+0000","last_clean_scrub_stamp":"2023-12-17T11:48:21.473989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T15:43:12.098532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-17T11:48:22.529901+0000","last_change":"2023-12-17T11:48:18.266039+0000","last_active":"2023-12-17T11:48:22.529901+0000","last_peered":"2023-12-17T11:48:22.529901+0000","last_clean":"2023-12-17T11:48:22.529901+0000","last_became_active":"2023-12-17T11:48:18.264294+0000","last_became_peered":"2023-12-17T11:48:18.264294+0000","last_unstale":"2023-12-17T11:48:22.529901+0000","last_undegraded":"2023-12-17T11:48:22.529901+0000","last_fullsized":"2023-12-17T11:48:22.529901+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_clean_scrub_stamp":"2023-12-17T11:48:17.199970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T23:46:39.140775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-17T11:48:22.538134+0000","last_change":"2023-12-17T11:48:17.255352+0000","last_active":"2023-12-17T11:48:22.538134+0000","last_peered":"2023-12-17T11:48:22.538134+0000","last_clean":"2023-12-17T11:48:22.538134+0000","last_became_active":"2023-12-17T11:48:17.254987+0000","last_became_peered":"2023-12-17T11:48:17.254987+0000","last_unstale":"2023-12-17T11:48:22.538134+0000","last_undegraded":"2023-12-17T11:48:22.538134+0000","last_fullsized":"2023-12-17T11:48:22.538134+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:16.193911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:16.193911+0000","last_clean_scrub_stamp":"2023-12-17T11:48:16.193911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T13:39:47.600568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-17T11:48:24.565796+0000","last_change":"2023-12-17T11:48:22.541369+0000","last_active":"2023-12-17T11:48:24.565796+0000","last_peered":"2023-12-17T11:48:24.565796+0000","last_clean":"2023-12-17T11:48:24.565796+0000","last_became_active":"2023-12-17T11:48:22.540908+0000","last_became_peered":"2023-12-17T11:48:22.540908+0000","last_unstale":"2023-12-17T11:48:24.565796+0000","last_undegraded":"2023-12-17T11:48:24.565796+0000","last_fullsized":"2023-12-17T11:48:24.565796+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:21.473989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:21.473989+0000","last_clean_scrub_stamp":"2023-12-17T11:48:21.473989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T19:44:20.727021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-17T11:48:22.523020+0000","last_change":"2023-12-17T11:48:18.281474+0000","last_active":"2023-12-17T11:48:22.523020+0000","last_peered":"2023-12-17T11:48:22.523020+0000","last_clean":"2023-12-17T11:48:22.523020+0000","last_became_active":"2023-12-17T11:48:18.281189+0000","last_became_peered":"2023-12-17T11:48:18.281189+0000","last_unstale":"2023-12-17T11:48:22.523020+0000","last_undegraded":"2023-12-17T11:48:22.523020+0000","last_fullsized":"2023-12-17T11:48:22.523020+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_clean_scrub_stamp":"2023-12-17T11:48:17.199970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T19:37:12.473709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-17T11:48:22.530125+0000","last_change":"2023-12-17T11:48:17.240666+0000","last_active":"2023-12-17T11:48:22.530125+0000","last_peered":"2023-12-17T11:48:22.530125+0000","last_clean":"2023-12-17T11:48:22.530125+0000","last_became_active":"2023-12-17T11:48:17.239901+0000","last_became_peered":"2023-12-17T11:48:17.239901+0000","last_unstale":"2023-12-17T11:48:22.530125+0000","last_undegraded":"2023-12-17T11:48:22.530125+0000","last_fullsized":"2023-12-17T11:48:22.530125+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:16.193911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:16.193911+0000","last_clean_scrub_stamp":"2023-12-17T11:48:16.193911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T23:35:00.926850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-17T11:48:24.568012+0000","last_change":"2023-12-17T11:48:22.534424+0000","last_active":"2023-12-17T11:48:24.568012+0000","last_peered":"2023-12-17T11:48:24.568012+0000","last_clean":"2023-12-17T11:48:24.568012+0000","last_became_active":"2023-12-17T11:48:22.533095+0000","last_became_peered":"2023-12-17T11:48:22.533095+0000","last_unstale":"2023-12-17T11:48:24.568012+0000","last_undegraded":"2023-12-17T11:48:24.568012+0000","last_fullsized":"2023-12-17T11:48:24.568012+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:21.473989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:21.473989+0000","last_clean_scrub_stamp":"2023-12-17T11:48:21.473989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T19:19:54.372270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-17T11:48:22.513971+0000","last_change":"2023-12-17T11:48:18.271892+0000","last_active":"2023-12-17T11:48:22.513971+0000","last_peered":"2023-12-17T11:48:22.513971+0000","last_clean":"2023-12-17T11:48:22.513971+0000","last_became_active":"2023-12-17T11:48:18.269149+0000","last_became_peered":"2023-12-17T11:48:18.269149+0000","last_unstale":"2023-12-17T11:48:22.513971+0000","last_undegraded":"2023-12-17T11:48:22.513971+0000","last_fullsized":"2023-12-17T11:48:22.513971+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_clean_scrub_stamp":"2023-12-17T11:48:17.199970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T23:05:27.950618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-17T11:48:22.519931+0000","last_change":"2023-12-17T11:48:17.256166+0000","last_active":"2023-12-17T11:48:22.519931+0000","last_peered":"2023-12-17T11:48:22.519931+0000","last_clean":"2023-12-17T11:48:22.519931+0000","last_became_active":"2023-12-17T11:48:17.255858+0000","last_became_peered":"2023-12-17T11:48:17.255858+0000","last_unstale":"2023-12-17T11:48:22.519931+0000","last_undegraded":"2023-12-17T11:48:22.519931+0000","last_fullsized":"2023-12-17T11:48:22.519931+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:16.193911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:16.193911+0000","last_clean_scrub_stamp":"2023-12-17T11:48:16.193911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T19:40:12.510482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-17T11:48:24.569042+0000","last_change":"2023-12-17T11:48:22.537931+0000","last_active":"2023-12-17T11:48:24.569042+0000","last_peered":"2023-12-17T11:48:24.569042+0000","last_clean":"2023-12-17T11:48:24.569042+0000","last_became_active":"2023-12-17T11:48:22.537530+0000","last_became_peered":"2023-12-17T11:48:22.537530+0000","last_unstale":"2023-12-17T11:48:24.569042+0000","last_undegraded":"2023-12-17T11:48:24.569042+0000","last_fullsized":"2023-12-17T11:48:24.569042+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:21.473989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:21.473989+0000","last_clean_scrub_stamp":"2023-12-17T11:48:21.473989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T14:46:35.413635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-17T11:48:22.524745+0000","last_change":"2023-12-17T11:48:18.264485+0000","last_active":"2023-12-17T11:48:22.524745+0000","last_peered":"2023-12-17T11:48:22.524745+0000","last_clean":"2023-12-17T11:48:22.524745+0000","last_became_active":"2023-12-17T11:48:18.264150+0000","last_became_peered":"2023-12-17T11:48:18.264150+0000","last_unstale":"2023-12-17T11:48:22.524745+0000","last_undegraded":"2023-12-17T11:48:22.524745+0000","last_fullsized":"2023-12-17T11:48:22.524745+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_clean_scrub_stamp":"2023-12-17T11:48:17.199970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T12:59:53.414167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-17T11:48:22.505049+0000","last_change":"2023-12-17T11:48:17.234956+0000","last_active":"2023-12-17T11:48:22.505049+0000","last_peered":"2023-12-17T11:48:22.505049+0000","last_clean":"2023-12-17T11:48:22.505049+0000","last_became_active":"2023-12-17T11:48:17.234640+0000","last_became_peered":"2023-12-17T11:48:17.234640+0000","last_unstale":"2023-12-17T11:48:22.505049+0000","last_undegraded":"2023-12-17T11:48:22.505049+0000","last_fullsized":"2023-12-17T11:48:22.505049+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:16.193911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:16.193911+0000","last_clean_scrub_stamp":"2023-12-17T11:48:16.193911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T19:54:11.544716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-17T11:48:24.570107+0000","last_change":"2023-12-17T11:48:22.535731+0000","last_active":"2023-12-17T11:48:24.570107+0000","last_peered":"2023-12-17T11:48:24.570107+0000","last_clean":"2023-12-17T11:48:24.570107+0000","last_became_active":"2023-12-17T11:48:22.529961+0000","last_became_peered":"2023-12-17T11:48:22.529961+0000","last_unstale":"2023-12-17T11:48:24.570107+0000","last_undegraded":"2023-12-17T11:48:24.570107+0000","last_fullsized":"2023-12-17T11:48:24.570107+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:21.473989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:21.473989+0000","last_clean_scrub_stamp":"2023-12-17T11:48:21.473989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T19:37:16.747727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-17T11:48:22.518013+0000","last_change":"2023-12-17T11:48:18.266746+0000","last_active":"2023-12-17T11:48:22.518013+0000","last_peered":"2023-12-17T11:48:22.518013+0000","last_clean":"2023-12-17T11:48:22.518013+0000","last_became_active":"2023-12-17T11:48:18.266331+0000","last_became_peered":"2023-12-17T11:48:18.266331+0000","last_unstale":"2023-12-17T11:48:22.518013+0000","last_undegraded":"2023-12-17T11:48:22.518013+0000","last_fullsized":"2023-12-17T11:48:22.518013+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_clean_scrub_stamp":"2023-12-17T11:48:17.199970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T19:10:10.197776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-17T11:48:22.537457+0000","last_change":"2023-12-17T11:48:17.253489+0000","last_active":"2023-12-17T11:48:22.537457+0000","last_peered":"2023-12-17T11:48:22.537457+0000","last_clean":"2023-12-17T11:48:22.537457+0000","last_became_active":"2023-12-17T11:48:17.253243+0000","last_became_peered":"2023-12-17T11:48:17.253243+0000","last_unstale":"2023-12-17T11:48:22.537457+0000","last_undegraded":"2023-12-17T11:48:22.537457+0000","last_fullsized":"2023-12-17T11:48:22.537457+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:16.193911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:16.193911+0000","last_clean_scrub_stamp":"2023-12-17T11:48:16.193911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T22:05:53.158992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-17T11:48:24.564814+0000","last_change":"2023-12-17T11:48:22.543885+0000","last_active":"2023-12-17T11:48:24.564814+0000","last_peered":"2023-12-17T11:48:24.564814+0000","last_clean":"2023-12-17T11:48:24.564814+0000","last_became_active":"2023-12-17T11:48:22.543458+0000","last_became_peered":"2023-12-17T11:48:22.543458+0000","last_unstale":"2023-12-17T11:48:24.564814+0000","last_undegraded":"2023-12-17T11:48:24.564814+0000","last_fullsized":"2023-12-17T11:48:24.564814+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:21.473989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:21.473989+0000","last_clean_scrub_stamp":"2023-12-17T11:48:21.473989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T21:28:14.069617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-17T11:48:22.497613+0000","last_change":"2023-12-17T11:48:18.286605+0000","last_active":"2023-12-17T11:48:22.497613+0000","last_peered":"2023-12-17T11:48:22.497613+0000","last_clean":"2023-12-17T11:48:22.497613+0000","last_became_active":"2023-12-17T11:48:18.286391+0000","last_became_peered":"2023-12-17T11:48:18.286391+0000","last_unstale":"2023-12-17T11:48:22.497613+0000","last_undegraded":"2023-12-17T11:48:22.497613+0000","last_fullsized":"2023-12-17T11:48:22.497613+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_clean_scrub_stamp":"2023-12-17T11:48:17.199970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T19:40:13.516541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-17T11:48:22.522726+0000","last_change":"2023-12-17T11:48:17.250745+0000","last_active":"2023-12-17T11:48:22.522726+0000","last_peered":"2023-12-17T11:48:22.522726+0000","last_clean":"2023-12-17T11:48:22.522726+0000","last_became_active":"2023-12-17T11:48:17.250462+0000","last_became_peered":"2023-12-17T11:48:17.250462+0000","last_unstale":"2023-12-17T11:48:22.522726+0000","last_undegraded":"2023-12-17T11:48:22.522726+0000","last_fullsized":"2023-12-17T11:48:22.522726+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:16.193911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:16.193911+0000","last_clean_scrub_stamp":"2023-12-17T11:48:16.193911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T19:10:09.191716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":169,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-17T11:48:22.537554+0000","last_change":"2023-12-17T11:48:07.952584+0000","last_active":"2023-12-17T11:48:22.537554+0000","last_peered":"2023-12-17T11:48:22.537554+0000","last_clean":"2023-12-17T11:48:22.537554+0000","last_became_active":"2023-12-17T11:48:07.950361+0000","last_became_peered":"2023-12-17T11:48:07.950361+0000","last_unstale":"2023-12-17T11:48:22.537554+0000","last_undegraded":"2023-12-17T11:48:22.537554+0000","last_fullsized":"2023-12-17T11:48:22.537554+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:06.728199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:06.728199+0000","last_clean_scrub_stamp":"2023-12-17T11:48:06.728199+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T12:47:55.048065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-17T11:48:23.469722+0000","last_change":"2023-12-17T11:48:22.546171+0000","last_active":"2023-12-17T11:48:23.469722+0000","last_peered":"2023-12-17T11:48:23.469722+0000","last_clean":"2023-12-17T11:48:23.469722+0000","last_became_active":"2023-12-17T11:48:22.545741+0000","last_became_peered":"2023-12-17T11:48:22.545741+0000","last_unstale":"2023-12-17T11:48:23.469722+0000","last_undegraded":"2023-12-17T11:48:23.469722+0000","last_fullsized":"2023-12-17T11:48:23.469722+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:21.473989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:21.473989+0000","last_clean_scrub_stamp":"2023-12-17T11:48:21.473989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T14:13:28.976491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-17T11:48:22.537982+0000","last_change":"2023-12-17T11:48:18.295996+0000","last_active":"2023-12-17T11:48:22.537982+0000","last_peered":"2023-12-17T11:48:22.537982+0000","last_clean":"2023-12-17T11:48:22.537982+0000","last_became_active":"2023-12-17T11:48:18.295731+0000","last_became_peered":"2023-12-17T11:48:18.295731+0000","last_unstale":"2023-12-17T11:48:22.537982+0000","last_undegraded":"2023-12-17T11:48:22.537982+0000","last_fullsized":"2023-12-17T11:48:22.537982+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_clean_scrub_stamp":"2023-12-17T11:48:17.199970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T12:06:33.791186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-17T11:48:22.508663+0000","last_change":"2023-12-17T11:48:17.248889+0000","last_active":"2023-12-17T11:48:22.508663+0000","last_peered":"2023-12-17T11:48:22.508663+0000","last_clean":"2023-12-17T11:48:22.508663+0000","last_became_active":"2023-12-17T11:48:17.248340+0000","last_became_peered":"2023-12-17T11:48:17.248340+0000","last_unstale":"2023-12-17T11:48:22.508663+0000","last_undegraded":"2023-12-17T11:48:22.508663+0000","last_fullsized":"2023-12-17T11:48:22.508663+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:16.193911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:16.193911+0000","last_clean_scrub_stamp":"2023-12-17T11:48:16.193911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T15:52:21.914780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-17T11:48:23.468537+0000","last_change":"2023-12-17T11:48:22.550329+0000","last_active":"2023-12-17T11:48:23.468537+0000","last_peered":"2023-12-17T11:48:23.468537+0000","last_clean":"2023-12-17T11:48:23.468537+0000","last_became_active":"2023-12-17T11:48:22.549902+0000","last_became_peered":"2023-12-17T11:48:22.549902+0000","last_unstale":"2023-12-17T11:48:23.468537+0000","last_undegraded":"2023-12-17T11:48:23.468537+0000","last_fullsized":"2023-12-17T11:48:23.468537+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:21.473989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:21.473989+0000","last_clean_scrub_stamp":"2023-12-17T11:48:21.473989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T14:35:42.104042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-17T11:48:22.521889+0000","last_change":"2023-12-17T11:48:18.280528+0000","last_active":"2023-12-17T11:48:22.521889+0000","last_peered":"2023-12-17T11:48:22.521889+0000","last_clean":"2023-12-17T11:48:22.521889+0000","last_became_active":"2023-12-17T11:48:18.279633+0000","last_became_peered":"2023-12-17T11:48:18.279633+0000","last_unstale":"2023-12-17T11:48:22.521889+0000","last_undegraded":"2023-12-17T11:48:22.521889+0000","last_fullsized":"2023-12-17T11:48:22.521889+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_clean_scrub_stamp":"2023-12-17T11:48:17.199970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T21:28:09.795599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-17T11:48:22.532812+0000","last_change":"2023-12-17T11:48:17.247687+0000","last_active":"2023-12-17T11:48:22.532812+0000","last_peered":"2023-12-17T11:48:22.532812+0000","last_clean":"2023-12-17T11:48:22.532812+0000","last_became_active":"2023-12-17T11:48:17.247332+0000","last_became_peered":"2023-12-17T11:48:17.247332+0000","last_unstale":"2023-12-17T11:48:22.532812+0000","last_undegraded":"2023-12-17T11:48:22.532812+0000","last_fullsized":"2023-12-17T11:48:22.532812+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:16.193911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:16.193911+0000","last_clean_scrub_stamp":"2023-12-17T11:48:16.193911+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T14:38:16.218634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-17T11:48:24.566096+0000","last_change":"2023-12-17T11:48:22.529299+0000","last_active":"2023-12-17T11:48:24.566096+0000","last_peered":"2023-12-17T11:48:24.566096+0000","last_clean":"2023-12-17T11:48:24.566096+0000","last_became_active":"2023-12-17T11:48:22.528363+0000","last_became_peered":"2023-12-17T11:48:22.528363+0000","last_unstale":"2023-12-17T11:48:24.566096+0000","last_undegraded":"2023-12-17T11:48:24.566096+0000","last_fullsized":"2023-12-17T11:48:24.566096+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:21.473989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:21.473989+0000","last_clean_scrub_stamp":"2023-12-17T11:48:21.473989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T19:47:39.333206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-17T11:48:22.541528+0000","last_change":"2023-12-17T11:48:18.282746+0000","last_active":"2023-12-17T11:48:22.541528+0000","last_peered":"2023-12-17T11:48:22.541528+0000","last_clean":"2023-12-17T11:48:22.541528+0000","last_became_active":"2023-12-17T11:48:18.282435+0000","last_became_peered":"2023-12-17T11:48:18.282435+0000","last_unstale":"2023-12-17T11:48:22.541528+0000","last_undegraded":"2023-12-17T11:48:22.541528+0000","last_fullsized":"2023-12-17T11:48:22.541528+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_clean_scrub_stamp":"2023-12-17T11:48:17.199970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T17:07:27.804112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-17T11:48:22.504269+0000","last_change":"2023-12-17T11:48:17.236101+0000","last_active":"2023-12-17T11:48:22.504269+0000","last_peered":"2023-12-17T11:48:22.504269+0000","last_clean":"2023-12-17T11:48:22.504269+0000","last_became_active":"2023-12-17T11:48:17.235810+0000","last_became_peered":"2023-12-17T11:48:17.235810+0000","last_unstale":"2023-12-17T11:48:22.504269+0000","last_undegraded":"2023-12-17T11:48:22.504269+0000","last_fullsized":"2023-12-17T11:48:22.504269+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:16.193911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:16.193911+0000","last_clean_scrub_stamp":"2023-12-17T11:48:16.193911+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T17:25:44.412598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-17T11:48:24.533865+0000","last_change":"2023-12-17T11:48:22.543015+0000","last_active":"2023-12-17T11:48:24.533865+0000","last_peered":"2023-12-17T11:48:24.533865+0000","last_clean":"2023-12-17T11:48:24.533865+0000","last_became_active":"2023-12-17T11:48:22.542625+0000","last_became_peered":"2023-12-17T11:48:22.542625+0000","last_unstale":"2023-12-17T11:48:24.533865+0000","last_undegraded":"2023-12-17T11:48:24.533865+0000","last_fullsized":"2023-12-17T11:48:24.533865+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:21.473989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:21.473989+0000","last_clean_scrub_stamp":"2023-12-17T11:48:21.473989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T19:02:34.642001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-17T11:48:22.538912+0000","last_change":"2023-12-17T11:48:18.286716+0000","last_active":"2023-12-17T11:48:22.538912+0000","last_peered":"2023-12-17T11:48:22.538912+0000","last_clean":"2023-12-17T11:48:22.538912+0000","last_became_active":"2023-12-17T11:48:18.286399+0000","last_became_peered":"2023-12-17T11:48:18.286399+0000","last_unstale":"2023-12-17T11:48:22.538912+0000","last_undegraded":"2023-12-17T11:48:22.538912+0000","last_fullsized":"2023-12-17T11:48:22.538912+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_clean_scrub_stamp":"2023-12-17T11:48:17.199970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T15:49:17.071958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-17T11:48:22.518272+0000","last_change":"2023-12-17T11:48:17.241745+0000","last_active":"2023-12-17T11:48:22.518272+0000","last_peered":"2023-12-17T11:48:22.518272+0000","last_clean":"2023-12-17T11:48:22.518272+0000","last_became_active":"2023-12-17T11:48:17.241424+0000","last_became_peered":"2023-12-17T11:48:17.241424+0000","last_unstale":"2023-12-17T11:48:22.518272+0000","last_undegraded":"2023-12-17T11:48:22.518272+0000","last_fullsized":"2023-12-17T11:48:22.518272+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:16.193911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:16.193911+0000","last_clean_scrub_stamp":"2023-12-17T11:48:16.193911+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T22:07:41.457520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-17T11:48:23.467268+0000","last_change":"2023-12-17T11:48:22.532344+0000","last_active":"2023-12-17T11:48:23.467268+0000","last_peered":"2023-12-17T11:48:23.467268+0000","last_clean":"2023-12-17T11:48:23.467268+0000","last_became_active":"2023-12-17T11:48:22.531938+0000","last_became_peered":"2023-12-17T11:48:22.531938+0000","last_unstale":"2023-12-17T11:48:23.467268+0000","last_undegraded":"2023-12-17T11:48:23.467268+0000","last_fullsized":"2023-12-17T11:48:23.467268+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:21.473989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:21.473989+0000","last_clean_scrub_stamp":"2023-12-17T11:48:21.473989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T16:14:52.997336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-17T11:48:22.537682+0000","last_change":"2023-12-17T11:48:18.283595+0000","last_active":"2023-12-17T11:48:22.537682+0000","last_peered":"2023-12-17T11:48:22.537682+0000","last_clean":"2023-12-17T11:48:22.537682+0000","last_became_active":"2023-12-17T11:48:18.283279+0000","last_became_peered":"2023-12-17T11:48:18.283279+0000","last_unstale":"2023-12-17T11:48:22.537682+0000","last_undegraded":"2023-12-17T11:48:22.537682+0000","last_fullsized":"2023-12-17T11:48:22.537682+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_clean_scrub_stamp":"2023-12-17T11:48:17.199970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T15:36:16.504476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-17T11:48:22.505421+0000","last_change":"2023-12-17T11:48:17.240169+0000","last_active":"2023-12-17T11:48:22.505421+0000","last_peered":"2023-12-17T11:48:22.505421+0000","last_clean":"2023-12-17T11:48:22.505421+0000","last_became_active":"2023-12-17T11:48:17.239871+0000","last_became_peered":"2023-12-17T11:48:17.239871+0000","last_unstale":"2023-12-17T11:48:22.505421+0000","last_undegraded":"2023-12-17T11:48:22.505421+0000","last_fullsized":"2023-12-17T11:48:22.505421+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:16.193911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:16.193911+0000","last_clean_scrub_stamp":"2023-12-17T11:48:16.193911+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T22:07:41.457520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-17T11:48:24.564852+0000","last_change":"2023-12-17T11:48:22.525953+0000","last_active":"2023-12-17T11:48:24.564852+0000","last_peered":"2023-12-17T11:48:24.564852+0000","last_clean":"2023-12-17T11:48:24.564852+0000","last_became_active":"2023-12-17T11:48:22.525562+0000","last_became_peered":"2023-12-17T11:48:22.525562+0000","last_unstale":"2023-12-17T11:48:24.564852+0000","last_undegraded":"2023-12-17T11:48:24.564852+0000","last_fullsized":"2023-12-17T11:48:24.564852+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:21.473989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:21.473989+0000","last_clean_scrub_stamp":"2023-12-17T11:48:21.473989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T19:37:16.747727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-17T11:48:22.528552+0000","last_change":"2023-12-17T11:48:18.266704+0000","last_active":"2023-12-17T11:48:22.528552+0000","last_peered":"2023-12-17T11:48:22.528552+0000","last_clean":"2023-12-17T11:48:22.528552+0000","last_became_active":"2023-12-17T11:48:18.266160+0000","last_became_peered":"2023-12-17T11:48:18.266160+0000","last_unstale":"2023-12-17T11:48:22.528552+0000","last_undegraded":"2023-12-17T11:48:22.528552+0000","last_fullsized":"2023-12-17T11:48:22.528552+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_clean_scrub_stamp":"2023-12-17T11:48:17.199970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T12:09:17.721558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-17T11:48:22.529180+0000","last_change":"2023-12-17T11:48:17.246492+0000","last_active":"2023-12-17T11:48:22.529180+0000","last_peered":"2023-12-17T11:48:22.529180+0000","last_clean":"2023-12-17T11:48:22.529180+0000","last_became_active":"2023-12-17T11:48:17.243482+0000","last_became_peered":"2023-12-17T11:48:17.243482+0000","last_unstale":"2023-12-17T11:48:22.529180+0000","last_undegraded":"2023-12-17T11:48:22.529180+0000","last_fullsized":"2023-12-17T11:48:22.529180+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:16.193911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:16.193911+0000","last_clean_scrub_stamp":"2023-12-17T11:48:16.193911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T23:35:00.926850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-17T11:48:24.566395+0000","last_change":"2023-12-17T11:48:22.533474+0000","last_active":"2023-12-17T11:48:24.566395+0000","last_peered":"2023-12-17T11:48:24.566395+0000","last_clean":"2023-12-17T11:48:24.566395+0000","last_became_active":"2023-12-17T11:48:22.533035+0000","last_became_peered":"2023-12-17T11:48:22.533035+0000","last_unstale":"2023-12-17T11:48:24.566395+0000","last_undegraded":"2023-12-17T11:48:24.566395+0000","last_fullsized":"2023-12-17T11:48:24.566395+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:21.473989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:21.473989+0000","last_clean_scrub_stamp":"2023-12-17T11:48:21.473989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T19:55:52.117357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-17T11:48:22.538223+0000","last_change":"2023-12-17T11:48:18.282530+0000","last_active":"2023-12-17T11:48:22.538223+0000","last_peered":"2023-12-17T11:48:22.538223+0000","last_clean":"2023-12-17T11:48:22.538223+0000","last_became_active":"2023-12-17T11:48:18.282201+0000","last_became_peered":"2023-12-17T11:48:18.282201+0000","last_unstale":"2023-12-17T11:48:22.538223+0000","last_undegraded":"2023-12-17T11:48:22.538223+0000","last_fullsized":"2023-12-17T11:48:22.538223+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_clean_scrub_stamp":"2023-12-17T11:48:17.199970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T13:22:09.491732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-17T11:48:22.519788+0000","last_change":"2023-12-17T11:48:17.255597+0000","last_active":"2023-12-17T11:48:22.519788+0000","last_peered":"2023-12-17T11:48:22.519788+0000","last_clean":"2023-12-17T11:48:22.519788+0000","last_became_active":"2023-12-17T11:48:17.255278+0000","last_became_peered":"2023-12-17T11:48:17.255278+0000","last_unstale":"2023-12-17T11:48:22.519788+0000","last_undegraded":"2023-12-17T11:48:22.519788+0000","last_fullsized":"2023-12-17T11:48:22.519788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:16.193911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:16.193911+0000","last_clean_scrub_stamp":"2023-12-17T11:48:16.193911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T19:01:45.429452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-17T11:48:24.565975+0000","last_change":"2023-12-17T11:48:22.547206+0000","last_active":"2023-12-17T11:48:24.565975+0000","last_peered":"2023-12-17T11:48:24.565975+0000","last_clean":"2023-12-17T11:48:24.565975+0000","last_became_active":"2023-12-17T11:48:22.539605+0000","last_became_peered":"2023-12-17T11:48:22.539605+0000","last_unstale":"2023-12-17T11:48:24.565975+0000","last_undegraded":"2023-12-17T11:48:24.565975+0000","last_fullsized":"2023-12-17T11:48:24.565975+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:21.473989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:21.473989+0000","last_clean_scrub_stamp":"2023-12-17T11:48:21.473989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T16:15:07.576617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-17T11:48:22.509553+0000","last_change":"2023-12-17T11:48:18.266780+0000","last_active":"2023-12-17T11:48:22.509553+0000","last_peered":"2023-12-17T11:48:22.509553+0000","last_clean":"2023-12-17T11:48:22.509553+0000","last_became_active":"2023-12-17T11:48:18.266437+0000","last_became_peered":"2023-12-17T11:48:18.266437+0000","last_unstale":"2023-12-17T11:48:22.509553+0000","last_undegraded":"2023-12-17T11:48:22.509553+0000","last_fullsized":"2023-12-17T11:48:22.509553+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_clean_scrub_stamp":"2023-12-17T11:48:17.199970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T15:10:04.983689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-17T11:48:22.517086+0000","last_change":"2023-12-17T11:48:17.237336+0000","last_active":"2023-12-17T11:48:22.517086+0000","last_peered":"2023-12-17T11:48:22.517086+0000","last_clean":"2023-12-17T11:48:22.517086+0000","last_became_active":"2023-12-17T11:48:17.237079+0000","last_became_peered":"2023-12-17T11:48:17.237079+0000","last_unstale":"2023-12-17T11:48:22.517086+0000","last_undegraded":"2023-12-17T11:48:22.517086+0000","last_fullsized":"2023-12-17T11:48:22.517086+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:16.193911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:16.193911+0000","last_clean_scrub_stamp":"2023-12-17T11:48:16.193911+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T23:05:26.944558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-17T11:48:24.534842+0000","last_change":"2023-12-17T11:48:22.531210+0000","last_active":"2023-12-17T11:48:24.534842+0000","last_peered":"2023-12-17T11:48:24.534842+0000","last_clean":"2023-12-17T11:48:24.534842+0000","last_became_active":"2023-12-17T11:48:22.530786+0000","last_became_peered":"2023-12-17T11:48:22.530786+0000","last_unstale":"2023-12-17T11:48:24.534842+0000","last_undegraded":"2023-12-17T11:48:24.534842+0000","last_fullsized":"2023-12-17T11:48:24.534842+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:21.473989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:21.473989+0000","last_clean_scrub_stamp":"2023-12-17T11:48:21.473989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T23:05:37.198518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-17T11:48:22.537940+0000","last_change":"2023-12-17T11:48:18.271847+0000","last_active":"2023-12-17T11:48:22.537940+0000","last_peered":"2023-12-17T11:48:22.537940+0000","last_clean":"2023-12-17T11:48:22.537940+0000","last_became_active":"2023-12-17T11:48:18.271609+0000","last_became_peered":"2023-12-17T11:48:18.271609+0000","last_unstale":"2023-12-17T11:48:22.537940+0000","last_undegraded":"2023-12-17T11:48:22.537940+0000","last_fullsized":"2023-12-17T11:48:22.537940+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_clean_scrub_stamp":"2023-12-17T11:48:17.199970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T14:01:37.582731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"25'10","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-17T11:48:37.784983+0000","last_change":"2023-12-17T11:48:17.241228+0000","last_active":"2023-12-17T11:48:37.784983+0000","last_peered":"2023-12-17T11:48:37.784983+0000","last_clean":"2023-12-17T11:48:37.784983+0000","last_became_active":"2023-12-17T11:48:17.240813+0000","last_became_peered":"2023-12-17T11:48:17.240813+0000","last_unstale":"2023-12-17T11:48:37.784983+0000","last_undegraded":"2023-12-17T11:48:37.784983+0000","last_fullsized":"2023-12-17T11:48:37.784983+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:16.193911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:16.193911+0000","last_clean_scrub_stamp":"2023-12-17T11:48:16.193911+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T21:33:08.409177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3840,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-17T11:48:24.568565+0000","last_change":"2023-12-17T11:48:22.541559+0000","last_active":"2023-12-17T11:48:24.568565+0000","last_peered":"2023-12-17T11:48:24.568565+0000","last_clean":"2023-12-17T11:48:24.568565+0000","last_became_active":"2023-12-17T11:48:22.537020+0000","last_became_peered":"2023-12-17T11:48:22.537020+0000","last_unstale":"2023-12-17T11:48:24.568565+0000","last_undegraded":"2023-12-17T11:48:24.568565+0000","last_fullsized":"2023-12-17T11:48:24.568565+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:21.473989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:21.473989+0000","last_clean_scrub_stamp":"2023-12-17T11:48:21.473989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T13:18:42.303550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-17T11:48:22.519017+0000","last_change":"2023-12-17T11:48:18.275481+0000","last_active":"2023-12-17T11:48:22.519017+0000","last_peered":"2023-12-17T11:48:22.519017+0000","last_clean":"2023-12-17T11:48:22.519017+0000","last_became_active":"2023-12-17T11:48:18.273155+0000","last_became_peered":"2023-12-17T11:48:18.273155+0000","last_unstale":"2023-12-17T11:48:22.519017+0000","last_undegraded":"2023-12-17T11:48:22.519017+0000","last_fullsized":"2023-12-17T11:48:22.519017+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_clean_scrub_stamp":"2023-12-17T11:48:17.199970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T12:41:34.675326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-17T11:48:22.530443+0000","last_change":"2023-12-17T11:48:17.255083+0000","last_active":"2023-12-17T11:48:22.530443+0000","last_peered":"2023-12-17T11:48:22.530443+0000","last_clean":"2023-12-17T11:48:22.530443+0000","last_became_active":"2023-12-17T11:48:17.254631+0000","last_became_peered":"2023-12-17T11:48:17.254631+0000","last_unstale":"2023-12-17T11:48:22.530443+0000","last_undegraded":"2023-12-17T11:48:22.530443+0000","last_fullsized":"2023-12-17T11:48:22.530443+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:16.193911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:16.193911+0000","last_clean_scrub_stamp":"2023-12-17T11:48:16.193911+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T23:05:26.944558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-17T11:48:23.468594+0000","last_change":"2023-12-17T11:48:22.532773+0000","last_active":"2023-12-17T11:48:23.468594+0000","last_peered":"2023-12-17T11:48:23.468594+0000","last_clean":"2023-12-17T11:48:23.468594+0000","last_became_active":"2023-12-17T11:48:22.531998+0000","last_became_peered":"2023-12-17T11:48:22.531998+0000","last_unstale":"2023-12-17T11:48:23.468594+0000","last_undegraded":"2023-12-17T11:48:23.468594+0000","last_fullsized":"2023-12-17T11:48:23.468594+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:21.473989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:21.473989+0000","last_clean_scrub_stamp":"2023-12-17T11:48:21.473989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T14:13:28.976491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-17T11:48:22.517736+0000","last_change":"2023-12-17T11:48:18.283970+0000","last_active":"2023-12-17T11:48:22.517736+0000","last_peered":"2023-12-17T11:48:22.517736+0000","last_clean":"2023-12-17T11:48:22.517736+0000","last_became_active":"2023-12-17T11:48:18.282081+0000","last_became_peered":"2023-12-17T11:48:18.282081+0000","last_unstale":"2023-12-17T11:48:22.517736+0000","last_undegraded":"2023-12-17T11:48:22.517736+0000","last_fullsized":"2023-12-17T11:48:22.517736+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_clean_scrub_stamp":"2023-12-17T11:48:17.199970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T22:33:29.994957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-17T11:48:22.524090+0000","last_change":"2023-12-17T11:48:17.251813+0000","last_active":"2023-12-17T11:48:22.524090+0000","last_peered":"2023-12-17T11:48:22.524090+0000","last_clean":"2023-12-17T11:48:22.524090+0000","last_became_active":"2023-12-17T11:48:17.251383+0000","last_became_peered":"2023-12-17T11:48:17.251383+0000","last_unstale":"2023-12-17T11:48:22.524090+0000","last_undegraded":"2023-12-17T11:48:22.524090+0000","last_fullsized":"2023-12-17T11:48:22.524090+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:16.193911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:16.193911+0000","last_clean_scrub_stamp":"2023-12-17T11:48:16.193911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T20:47:09.518146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-17T11:48:24.563175+0000","last_change":"2023-12-17T11:48:22.532023+0000","last_active":"2023-12-17T11:48:24.563175+0000","last_peered":"2023-12-17T11:48:24.563175+0000","last_clean":"2023-12-17T11:48:24.563175+0000","last_became_active":"2023-12-17T11:48:22.531600+0000","last_became_peered":"2023-12-17T11:48:22.531600+0000","last_unstale":"2023-12-17T11:48:24.563175+0000","last_undegraded":"2023-12-17T11:48:24.563175+0000","last_fullsized":"2023-12-17T11:48:24.563175+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:21.473989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:21.473989+0000","last_clean_scrub_stamp":"2023-12-17T11:48:21.473989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T11:48:26.447870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-17T11:48:22.524000+0000","last_change":"2023-12-17T11:48:18.284906+0000","last_active":"2023-12-17T11:48:22.524000+0000","last_peered":"2023-12-17T11:48:22.524000+0000","last_clean":"2023-12-17T11:48:22.524000+0000","last_became_active":"2023-12-17T11:48:18.280252+0000","last_became_peered":"2023-12-17T11:48:18.280252+0000","last_unstale":"2023-12-17T11:48:22.524000+0000","last_undegraded":"2023-12-17T11:48:22.524000+0000","last_fullsized":"2023-12-17T11:48:22.524000+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_clean_scrub_stamp":"2023-12-17T11:48:17.199970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T14:35:37.830024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-17T11:48:22.531506+0000","last_change":"2023-12-17T11:48:17.256841+0000","last_active":"2023-12-17T11:48:22.531506+0000","last_peered":"2023-12-17T11:48:22.531506+0000","last_clean":"2023-12-17T11:48:22.531506+0000","last_became_active":"2023-12-17T11:48:17.256528+0000","last_became_peered":"2023-12-17T11:48:17.256528+0000","last_unstale":"2023-12-17T11:48:22.531506+0000","last_undegraded":"2023-12-17T11:48:22.531506+0000","last_fullsized":"2023-12-17T11:48:22.531506+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:16.193911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:16.193911+0000","last_clean_scrub_stamp":"2023-12-17T11:48:16.193911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T23:05:26.944558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-17T11:48:24.564180+0000","last_change":"2023-12-17T11:48:22.536175+0000","last_active":"2023-12-17T11:48:24.564180+0000","last_peered":"2023-12-17T11:48:24.564180+0000","last_clean":"2023-12-17T11:48:24.564180+0000","last_became_active":"2023-12-17T11:48:22.535544+0000","last_became_peered":"2023-12-17T11:48:22.535544+0000","last_unstale":"2023-12-17T11:48:24.564180+0000","last_undegraded":"2023-12-17T11:48:24.564180+0000","last_fullsized":"2023-12-17T11:48:24.564180+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:21.473989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:21.473989+0000","last_clean_scrub_stamp":"2023-12-17T11:48:21.473989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T19:02:34.642001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-17T11:48:24.564459+0000","last_change":"2023-12-17T11:48:22.543719+0000","last_active":"2023-12-17T11:48:24.564459+0000","last_peered":"2023-12-17T11:48:24.564459+0000","last_clean":"2023-12-17T11:48:24.564459+0000","last_became_active":"2023-12-17T11:48:22.543315+0000","last_became_peered":"2023-12-17T11:48:22.543315+0000","last_unstale":"2023-12-17T11:48:24.564459+0000","last_undegraded":"2023-12-17T11:48:24.564459+0000","last_fullsized":"2023-12-17T11:48:24.564459+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:21.473989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:21.473989+0000","last_clean_scrub_stamp":"2023-12-17T11:48:21.473989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T14:46:35.413635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-17T11:48:22.525084+0000","last_change":"2023-12-17T11:48:18.273197+0000","last_active":"2023-12-17T11:48:22.525084+0000","last_peered":"2023-12-17T11:48:22.525084+0000","last_clean":"2023-12-17T11:48:22.525084+0000","last_became_active":"2023-12-17T11:48:18.272904+0000","last_became_peered":"2023-12-17T11:48:18.272904+0000","last_unstale":"2023-12-17T11:48:22.525084+0000","last_undegraded":"2023-12-17T11:48:22.525084+0000","last_fullsized":"2023-12-17T11:48:22.525084+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_clean_scrub_stamp":"2023-12-17T11:48:17.199970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T19:01:46.435511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-17T11:48:22.515616+0000","last_change":"2023-12-17T11:48:17.254838+0000","last_active":"2023-12-17T11:48:22.515616+0000","last_peered":"2023-12-17T11:48:22.515616+0000","last_clean":"2023-12-17T11:48:22.515616+0000","last_became_active":"2023-12-17T11:48:17.254549+0000","last_became_peered":"2023-12-17T11:48:17.254549+0000","last_unstale":"2023-12-17T11:48:22.515616+0000","last_undegraded":"2023-12-17T11:48:22.515616+0000","last_fullsized":"2023-12-17T11:48:22.515616+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:16.193911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:16.193911+0000","last_clean_scrub_stamp":"2023-12-17T11:48:16.193911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T15:10:03.977630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-17T11:48:23.467487+0000","last_change":"2023-12-17T11:48:22.544106+0000","last_active":"2023-12-17T11:48:23.467487+0000","last_peered":"2023-12-17T11:48:23.467487+0000","last_clean":"2023-12-17T11:48:23.467487+0000","last_became_active":"2023-12-17T11:48:22.543121+0000","last_became_peered":"2023-12-17T11:48:22.543121+0000","last_unstale":"2023-12-17T11:48:23.467487+0000","last_undegraded":"2023-12-17T11:48:23.467487+0000","last_fullsized":"2023-12-17T11:48:23.467487+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:21.473989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:21.473989+0000","last_clean_scrub_stamp":"2023-12-17T11:48:21.473989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T14:39:15.707189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-17T11:48:22.498074+0000","last_change":"2023-12-17T11:48:18.273173+0000","last_active":"2023-12-17T11:48:22.498074+0000","last_peered":"2023-12-17T11:48:22.498074+0000","last_clean":"2023-12-17T11:48:22.498074+0000","last_became_active":"2023-12-17T11:48:18.272646+0000","last_became_peered":"2023-12-17T11:48:18.272646+0000","last_unstale":"2023-12-17T11:48:22.498074+0000","last_undegraded":"2023-12-17T11:48:22.498074+0000","last_fullsized":"2023-12-17T11:48:22.498074+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_clean_scrub_stamp":"2023-12-17T11:48:17.199970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T12:59:53.414167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-17T11:48:22.498535+0000","last_change":"2023-12-17T11:48:17.242171+0000","last_active":"2023-12-17T11:48:22.498535+0000","last_peered":"2023-12-17T11:48:22.498535+0000","last_clean":"2023-12-17T11:48:22.498535+0000","last_became_active":"2023-12-17T11:48:17.241764+0000","last_became_peered":"2023-12-17T11:48:17.241764+0000","last_unstale":"2023-12-17T11:48:22.498535+0000","last_undegraded":"2023-12-17T11:48:22.498535+0000","last_fullsized":"2023-12-17T11:48:22.498535+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:16.193911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:16.193911+0000","last_clean_scrub_stamp":"2023-12-17T11:48:16.193911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T14:38:16.218634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-17T11:48:22.528584+0000","last_change":"2023-12-17T11:48:17.242535+0000","last_active":"2023-12-17T11:48:22.528584+0000","last_peered":"2023-12-17T11:48:22.528584+0000","last_clean":"2023-12-17T11:48:22.528584+0000","last_became_active":"2023-12-17T11:48:17.242250+0000","last_became_peered":"2023-12-17T11:48:17.242250+0000","last_unstale":"2023-12-17T11:48:22.528584+0000","last_undegraded":"2023-12-17T11:48:22.528584+0000","last_fullsized":"2023-12-17T11:48:22.528584+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:16.193911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:16.193911+0000","last_clean_scrub_stamp":"2023-12-17T11:48:16.193911+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T15:52:21.914780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-17T11:48:22.513125+0000","last_change":"2023-12-17T11:48:18.264311+0000","last_active":"2023-12-17T11:48:22.513125+0000","last_peered":"2023-12-17T11:48:22.513125+0000","last_clean":"2023-12-17T11:48:22.513125+0000","last_became_active":"2023-12-17T11:48:18.263005+0000","last_became_peered":"2023-12-17T11:48:18.263005+0000","last_unstale":"2023-12-17T11:48:22.513125+0000","last_undegraded":"2023-12-17T11:48:22.513125+0000","last_fullsized":"2023-12-17T11:48:22.513125+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_clean_scrub_stamp":"2023-12-17T11:48:17.199970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T20:47:10.524205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-17T11:48:23.465100+0000","last_change":"2023-12-17T11:48:22.536488+0000","last_active":"2023-12-17T11:48:23.465100+0000","last_peered":"2023-12-17T11:48:23.465100+0000","last_clean":"2023-12-17T11:48:23.465100+0000","last_became_active":"2023-12-17T11:48:22.536091+0000","last_became_peered":"2023-12-17T11:48:22.536091+0000","last_unstale":"2023-12-17T11:48:23.465100+0000","last_undegraded":"2023-12-17T11:48:23.465100+0000","last_fullsized":"2023-12-17T11:48:23.465100+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:21.473989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:21.473989+0000","last_clean_scrub_stamp":"2023-12-17T11:48:21.473989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T19:10:14.471794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-17T11:48:22.499106+0000","last_change":"2023-12-17T11:48:17.241269+0000","last_active":"2023-12-17T11:48:22.499106+0000","last_peered":"2023-12-17T11:48:22.499106+0000","last_clean":"2023-12-17T11:48:22.499106+0000","last_became_active":"2023-12-17T11:48:17.240984+0000","last_became_peered":"2023-12-17T11:48:17.240984+0000","last_unstale":"2023-12-17T11:48:22.499106+0000","last_undegraded":"2023-12-17T11:48:22.499106+0000","last_fullsized":"2023-12-17T11:48:22.499106+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:16.193911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:16.193911+0000","last_clean_scrub_stamp":"2023-12-17T11:48:16.193911+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T21:33:08.409177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-17T11:48:22.514122+0000","last_change":"2023-12-17T11:48:18.269242+0000","last_active":"2023-12-17T11:48:22.514122+0000","last_peered":"2023-12-17T11:48:22.514122+0000","last_clean":"2023-12-17T11:48:22.514122+0000","last_became_active":"2023-12-17T11:48:18.262805+0000","last_became_peered":"2023-12-17T11:48:18.262805+0000","last_unstale":"2023-12-17T11:48:22.514122+0000","last_undegraded":"2023-12-17T11:48:22.514122+0000","last_fullsized":"2023-12-17T11:48:22.514122+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_clean_scrub_stamp":"2023-12-17T11:48:17.199970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T17:25:45.418657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-17T11:48:24.565907+0000","last_change":"2023-12-17T11:48:22.528378+0000","last_active":"2023-12-17T11:48:24.565907+0000","last_peered":"2023-12-17T11:48:24.565907+0000","last_clean":"2023-12-17T11:48:24.565907+0000","last_became_active":"2023-12-17T11:48:22.527917+0000","last_became_peered":"2023-12-17T11:48:22.527917+0000","last_unstale":"2023-12-17T11:48:24.565907+0000","last_undegraded":"2023-12-17T11:48:24.565907+0000","last_fullsized":"2023-12-17T11:48:24.565907+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:21.473989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:21.473989+0000","last_clean_scrub_stamp":"2023-12-17T11:48:21.473989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T23:05:37.198518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-17T11:48:22.528435+0000","last_change":"2023-12-17T11:48:18.266478+0000","last_active":"2023-12-17T11:48:22.528435+0000","last_peered":"2023-12-17T11:48:22.528435+0000","last_clean":"2023-12-17T11:48:22.528435+0000","last_became_active":"2023-12-17T11:48:18.265774+0000","last_became_peered":"2023-12-17T11:48:18.265774+0000","last_unstale":"2023-12-17T11:48:22.528435+0000","last_undegraded":"2023-12-17T11:48:22.528435+0000","last_fullsized":"2023-12-17T11:48:22.528435+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_clean_scrub_stamp":"2023-12-17T11:48:17.199970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T15:10:04.983689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-17T11:48:22.504939+0000","last_change":"2023-12-17T11:48:18.282141+0000","last_active":"2023-12-17T11:48:22.504939+0000","last_peered":"2023-12-17T11:48:22.504939+0000","last_clean":"2023-12-17T11:48:22.504939+0000","last_became_active":"2023-12-17T11:48:18.281103+0000","last_became_peered":"2023-12-17T11:48:18.281103+0000","last_unstale":"2023-12-17T11:48:22.504939+0000","last_undegraded":"2023-12-17T11:48:22.504939+0000","last_fullsized":"2023-12-17T11:48:22.504939+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_clean_scrub_stamp":"2023-12-17T11:48:17.199970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T14:38:17.224694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-17T11:48:22.519670+0000","last_change":"2023-12-17T11:48:18.280946+0000","last_active":"2023-12-17T11:48:22.519670+0000","last_peered":"2023-12-17T11:48:22.519670+0000","last_clean":"2023-12-17T11:48:22.519670+0000","last_became_active":"2023-12-17T11:48:18.280193+0000","last_became_peered":"2023-12-17T11:48:18.280193+0000","last_unstale":"2023-12-17T11:48:22.519670+0000","last_undegraded":"2023-12-17T11:48:22.519670+0000","last_fullsized":"2023-12-17T11:48:22.519670+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_clean_scrub_stamp":"2023-12-17T11:48:17.199970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T14:39:11.433170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-17T11:48:22.512528+0000","last_change":"2023-12-17T11:48:18.271322+0000","last_active":"2023-12-17T11:48:22.512528+0000","last_peered":"2023-12-17T11:48:22.512528+0000","last_clean":"2023-12-17T11:48:22.512528+0000","last_became_active":"2023-12-17T11:48:18.271029+0000","last_became_peered":"2023-12-17T11:48:18.271029+0000","last_unstale":"2023-12-17T11:48:22.512528+0000","last_undegraded":"2023-12-17T11:48:22.512528+0000","last_fullsized":"2023-12-17T11:48:22.512528+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_clean_scrub_stamp":"2023-12-17T11:48:17.199970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T23:46:39.140775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-17T11:48:22.499687+0000","last_change":"2023-12-17T11:48:18.280759+0000","last_active":"2023-12-17T11:48:22.499687+0000","last_peered":"2023-12-17T11:48:22.499687+0000","last_clean":"2023-12-17T11:48:22.499687+0000","last_became_active":"2023-12-17T11:48:18.279419+0000","last_became_peered":"2023-12-17T11:48:18.279419+0000","last_unstale":"2023-12-17T11:48:22.499687+0000","last_undegraded":"2023-12-17T11:48:22.499687+0000","last_fullsized":"2023-12-17T11:48:22.499687+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_clean_scrub_stamp":"2023-12-17T11:48:17.199970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T14:35:37.830024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-17T11:48:22.529945+0000","last_change":"2023-12-17T11:48:18.275948+0000","last_active":"2023-12-17T11:48:22.529945+0000","last_peered":"2023-12-17T11:48:22.529945+0000","last_clean":"2023-12-17T11:48:22.529945+0000","last_became_active":"2023-12-17T11:48:18.275186+0000","last_became_peered":"2023-12-17T11:48:18.275186+0000","last_unstale":"2023-12-17T11:48:22.529945+0000","last_undegraded":"2023-12-17T11:48:22.529945+0000","last_fullsized":"2023-12-17T11:48:22.529945+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_clean_scrub_stamp":"2023-12-17T11:48:17.199970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T20:47:10.524205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-17T11:48:22.528941+0000","last_change":"2023-12-17T11:48:18.266168+0000","last_active":"2023-12-17T11:48:22.528941+0000","last_peered":"2023-12-17T11:48:22.528941+0000","last_clean":"2023-12-17T11:48:22.528941+0000","last_became_active":"2023-12-17T11:48:18.265873+0000","last_became_peered":"2023-12-17T11:48:18.265873+0000","last_unstale":"2023-12-17T11:48:22.528941+0000","last_undegraded":"2023-12-17T11:48:22.528941+0000","last_fullsized":"2023-12-17T11:48:22.528941+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_clean_scrub_stamp":"2023-12-17T11:48:17.199970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T19:40:13.516541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-17T11:48:22.502538+0000","last_change":"2023-12-17T11:48:18.276992+0000","last_active":"2023-12-17T11:48:22.502538+0000","last_peered":"2023-12-17T11:48:22.502538+0000","last_clean":"2023-12-17T11:48:22.502538+0000","last_became_active":"2023-12-17T11:48:18.276731+0000","last_became_peered":"2023-12-17T11:48:18.276731+0000","last_unstale":"2023-12-17T11:48:22.502538+0000","last_undegraded":"2023-12-17T11:48:22.502538+0000","last_fullsized":"2023-12-17T11:48:22.502538+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_clean_scrub_stamp":"2023-12-17T11:48:17.199970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T20:53:58.226339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-17T11:48:22.515412+0000","last_change":"2023-12-17T11:48:18.282302+0000","last_active":"2023-12-17T11:48:22.515412+0000","last_peered":"2023-12-17T11:48:22.515412+0000","last_clean":"2023-12-17T11:48:22.515412+0000","last_became_active":"2023-12-17T11:48:18.282033+0000","last_became_peered":"2023-12-17T11:48:18.282033+0000","last_unstale":"2023-12-17T11:48:22.515412+0000","last_undegraded":"2023-12-17T11:48:22.515412+0000","last_fullsized":"2023-12-17T11:48:22.515412+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_clean_scrub_stamp":"2023-12-17T11:48:17.199970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T19:19:50.098252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-17T11:48:22.498331+0000","last_change":"2023-12-17T11:48:18.278722+0000","last_active":"2023-12-17T11:48:22.498331+0000","last_peered":"2023-12-17T11:48:22.498331+0000","last_clean":"2023-12-17T11:48:22.498331+0000","last_became_active":"2023-12-17T11:48:18.278416+0000","last_became_peered":"2023-12-17T11:48:18.278416+0000","last_unstale":"2023-12-17T11:48:22.498331+0000","last_undegraded":"2023-12-17T11:48:22.498331+0000","last_fullsized":"2023-12-17T11:48:22.498331+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_clean_scrub_stamp":"2023-12-17T11:48:17.199970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T12:09:17.721558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-17T11:48:22.523002+0000","last_change":"2023-12-17T11:48:18.280465+0000","last_active":"2023-12-17T11:48:22.523002+0000","last_peered":"2023-12-17T11:48:22.523002+0000","last_clean":"2023-12-17T11:48:22.523002+0000","last_became_active":"2023-12-17T11:48:18.279834+0000","last_became_peered":"2023-12-17T11:48:18.279834+0000","last_unstale":"2023-12-17T11:48:22.523002+0000","last_undegraded":"2023-12-17T11:48:22.523002+0000","last_fullsized":"2023-12-17T11:48:22.523002+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_clean_scrub_stamp":"2023-12-17T11:48:17.199970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T20:53:58.226339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-17T11:48:22.512247+0000","last_change":"2023-12-17T11:48:18.265956+0000","last_active":"2023-12-17T11:48:22.512247+0000","last_peered":"2023-12-17T11:48:22.512247+0000","last_clean":"2023-12-17T11:48:22.512247+0000","last_became_active":"2023-12-17T11:48:18.264308+0000","last_became_peered":"2023-12-17T11:48:18.264308+0000","last_unstale":"2023-12-17T11:48:22.512247+0000","last_undegraded":"2023-12-17T11:48:22.512247+0000","last_fullsized":"2023-12-17T11:48:22.512247+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_clean_scrub_stamp":"2023-12-17T11:48:17.199970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T12:09:17.721558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-17T11:48:22.528941+0000","last_change":"2023-12-17T11:48:18.277893+0000","last_active":"2023-12-17T11:48:22.528941+0000","last_peered":"2023-12-17T11:48:22.528941+0000","last_clean":"2023-12-17T11:48:22.528941+0000","last_became_active":"2023-12-17T11:48:18.277557+0000","last_became_peered":"2023-12-17T11:48:18.277557+0000","last_unstale":"2023-12-17T11:48:22.528941+0000","last_undegraded":"2023-12-17T11:48:22.528941+0000","last_fullsized":"2023-12-17T11:48:22.528941+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_clean_scrub_stamp":"2023-12-17T11:48:17.199970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T23:46:39.140775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-17T11:48:22.538075+0000","last_change":"2023-12-17T11:48:18.274779+0000","last_active":"2023-12-17T11:48:22.538075+0000","last_peered":"2023-12-17T11:48:22.538075+0000","last_clean":"2023-12-17T11:48:22.538075+0000","last_became_active":"2023-12-17T11:48:18.274509+0000","last_became_peered":"2023-12-17T11:48:18.274509+0000","last_unstale":"2023-12-17T11:48:22.538075+0000","last_undegraded":"2023-12-17T11:48:22.538075+0000","last_fullsized":"2023-12-17T11:48:22.538075+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_clean_scrub_stamp":"2023-12-17T11:48:17.199970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T22:05:51.790351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-17T11:48:22.504169+0000","last_change":"2023-12-17T11:48:18.266606+0000","last_active":"2023-12-17T11:48:22.504169+0000","last_peered":"2023-12-17T11:48:22.504169+0000","last_clean":"2023-12-17T11:48:22.504169+0000","last_became_active":"2023-12-17T11:48:18.265428+0000","last_became_peered":"2023-12-17T11:48:18.265428+0000","last_unstale":"2023-12-17T11:48:22.504169+0000","last_undegraded":"2023-12-17T11:48:22.504169+0000","last_fullsized":"2023-12-17T11:48:22.504169+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_clean_scrub_stamp":"2023-12-17T11:48:17.199970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T23:05:27.950618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-17T11:48:22.522838+0000","last_change":"2023-12-17T11:48:18.284558+0000","last_active":"2023-12-17T11:48:22.522838+0000","last_peered":"2023-12-17T11:48:22.522838+0000","last_clean":"2023-12-17T11:48:22.522838+0000","last_became_active":"2023-12-17T11:48:18.284223+0000","last_became_peered":"2023-12-17T11:48:18.284223+0000","last_unstale":"2023-12-17T11:48:22.522838+0000","last_undegraded":"2023-12-17T11:48:22.522838+0000","last_fullsized":"2023-12-17T11:48:22.522838+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_clean_scrub_stamp":"2023-12-17T11:48:17.199970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T19:44:16.453002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-17T11:48:22.515217+0000","last_change":"2023-12-17T11:48:18.285584+0000","last_active":"2023-12-17T11:48:22.515217+0000","last_peered":"2023-12-17T11:48:22.515217+0000","last_clean":"2023-12-17T11:48:22.515217+0000","last_became_active":"2023-12-17T11:48:18.285361+0000","last_became_peered":"2023-12-17T11:48:18.285361+0000","last_unstale":"2023-12-17T11:48:22.515217+0000","last_undegraded":"2023-12-17T11:48:22.515217+0000","last_fullsized":"2023-12-17T11:48:22.515217+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_clean_scrub_stamp":"2023-12-17T11:48:17.199970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T16:14:48.723317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-17T11:48:22.529429+0000","last_change":"2023-12-17T11:48:18.279879+0000","last_active":"2023-12-17T11:48:22.529429+0000","last_peered":"2023-12-17T11:48:22.529429+0000","last_clean":"2023-12-17T11:48:22.529429+0000","last_became_active":"2023-12-17T11:48:18.279462+0000","last_became_peered":"2023-12-17T11:48:18.279462+0000","last_unstale":"2023-12-17T11:48:22.529429+0000","last_undegraded":"2023-12-17T11:48:22.529429+0000","last_fullsized":"2023-12-17T11:48:22.529429+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_clean_scrub_stamp":"2023-12-17T11:48:17.199970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T12:09:17.721558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-17T11:48:22.509512+0000","last_change":"2023-12-17T11:48:18.268736+0000","last_active":"2023-12-17T11:48:22.509512+0000","last_peered":"2023-12-17T11:48:22.509512+0000","last_clean":"2023-12-17T11:48:22.509512+0000","last_became_active":"2023-12-17T11:48:18.268299+0000","last_became_peered":"2023-12-17T11:48:18.268299+0000","last_unstale":"2023-12-17T11:48:22.509512+0000","last_undegraded":"2023-12-17T11:48:22.509512+0000","last_fullsized":"2023-12-17T11:48:22.509512+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_clean_scrub_stamp":"2023-12-17T11:48:17.199970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T12:59:53.414167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-17T11:48:22.498921+0000","last_change":"2023-12-17T11:48:18.270384+0000","last_active":"2023-12-17T11:48:22.498921+0000","last_peered":"2023-12-17T11:48:22.498921+0000","last_clean":"2023-12-17T11:48:22.498921+0000","last_became_active":"2023-12-17T11:48:18.270042+0000","last_became_peered":"2023-12-17T11:48:18.270042+0000","last_unstale":"2023-12-17T11:48:22.498921+0000","last_undegraded":"2023-12-17T11:48:22.498921+0000","last_fullsized":"2023-12-17T11:48:22.498921+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_clean_scrub_stamp":"2023-12-17T11:48:17.199970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T20:47:10.524205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-17T11:48:22.518885+0000","last_change":"2023-12-17T11:48:18.261294+0000","last_active":"2023-12-17T11:48:22.518885+0000","last_peered":"2023-12-17T11:48:22.518885+0000","last_clean":"2023-12-17T11:48:22.518885+0000","last_became_active":"2023-12-17T11:48:18.260956+0000","last_became_peered":"2023-12-17T11:48:18.260956+0000","last_unstale":"2023-12-17T11:48:22.518885+0000","last_undegraded":"2023-12-17T11:48:22.518885+0000","last_fullsized":"2023-12-17T11:48:22.518885+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_clean_scrub_stamp":"2023-12-17T11:48:17.199970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T14:38:17.224694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-17T11:48:22.531412+0000","last_change":"2023-12-17T11:48:18.288322+0000","last_active":"2023-12-17T11:48:22.531412+0000","last_peered":"2023-12-17T11:48:22.531412+0000","last_clean":"2023-12-17T11:48:22.531412+0000","last_became_active":"2023-12-17T11:48:18.288079+0000","last_became_peered":"2023-12-17T11:48:18.288079+0000","last_unstale":"2023-12-17T11:48:22.531412+0000","last_undegraded":"2023-12-17T11:48:22.531412+0000","last_fullsized":"2023-12-17T11:48:22.531412+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_clean_scrub_stamp":"2023-12-17T11:48:17.199970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T12:59:53.414167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-17T11:48:22.528855+0000","last_change":"2023-12-17T11:48:18.284571+0000","last_active":"2023-12-17T11:48:22.528855+0000","last_peered":"2023-12-17T11:48:22.528855+0000","last_clean":"2023-12-17T11:48:22.528855+0000","last_became_active":"2023-12-17T11:48:18.284293+0000","last_became_peered":"2023-12-17T11:48:18.284293+0000","last_unstale":"2023-12-17T11:48:22.528855+0000","last_undegraded":"2023-12-17T11:48:22.528855+0000","last_fullsized":"2023-12-17T11:48:22.528855+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_clean_scrub_stamp":"2023-12-17T11:48:17.199970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T20:47:10.524205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-17T11:48:22.539887+0000","last_change":"2023-12-17T11:48:18.291564+0000","last_active":"2023-12-17T11:48:22.539887+0000","last_peered":"2023-12-17T11:48:22.539887+0000","last_clean":"2023-12-17T11:48:22.539887+0000","last_became_active":"2023-12-17T11:48:18.289522+0000","last_became_peered":"2023-12-17T11:48:18.289522+0000","last_unstale":"2023-12-17T11:48:22.539887+0000","last_undegraded":"2023-12-17T11:48:22.539887+0000","last_fullsized":"2023-12-17T11:48:22.539887+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_clean_scrub_stamp":"2023-12-17T11:48:17.199970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T17:39:16.718281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-17T11:48:22.497188+0000","last_change":"2023-12-17T11:48:18.282696+0000","last_active":"2023-12-17T11:48:22.497188+0000","last_peered":"2023-12-17T11:48:22.497188+0000","last_clean":"2023-12-17T11:48:22.497188+0000","last_became_active":"2023-12-17T11:48:18.282388+0000","last_became_peered":"2023-12-17T11:48:18.282388+0000","last_unstale":"2023-12-17T11:48:22.497188+0000","last_undegraded":"2023-12-17T11:48:22.497188+0000","last_fullsized":"2023-12-17T11:48:22.497188+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_clean_scrub_stamp":"2023-12-17T11:48:17.199970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T19:01:46.435511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-17T11:48:22.537605+0000","last_change":"2023-12-17T11:48:18.279029+0000","last_active":"2023-12-17T11:48:22.537605+0000","last_peered":"2023-12-17T11:48:22.537605+0000","last_clean":"2023-12-17T11:48:22.537605+0000","last_became_active":"2023-12-17T11:48:18.278719+0000","last_became_peered":"2023-12-17T11:48:18.278719+0000","last_unstale":"2023-12-17T11:48:22.537605+0000","last_undegraded":"2023-12-17T11:48:22.537605+0000","last_fullsized":"2023-12-17T11:48:22.537605+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_clean_scrub_stamp":"2023-12-17T11:48:17.199970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T14:24:55.101826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-17T11:48:22.517795+0000","last_change":"2023-12-17T11:48:18.286319+0000","last_active":"2023-12-17T11:48:22.517795+0000","last_peered":"2023-12-17T11:48:22.517795+0000","last_clean":"2023-12-17T11:48:22.517795+0000","last_became_active":"2023-12-17T11:48:18.286027+0000","last_became_peered":"2023-12-17T11:48:18.286027+0000","last_unstale":"2023-12-17T11:48:22.517795+0000","last_undegraded":"2023-12-17T11:48:22.517795+0000","last_fullsized":"2023-12-17T11:48:22.517795+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_clean_scrub_stamp":"2023-12-17T11:48:17.199970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T22:33:29.994957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-17T11:48:22.538176+0000","last_change":"2023-12-17T11:48:18.268834+0000","last_active":"2023-12-17T11:48:22.538176+0000","last_peered":"2023-12-17T11:48:22.538176+0000","last_clean":"2023-12-17T11:48:22.538176+0000","last_became_active":"2023-12-17T11:48:18.268143+0000","last_became_peered":"2023-12-17T11:48:18.268143+0000","last_unstale":"2023-12-17T11:48:22.538176+0000","last_undegraded":"2023-12-17T11:48:22.538176+0000","last_fullsized":"2023-12-17T11:48:22.538176+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_clean_scrub_stamp":"2023-12-17T11:48:17.199970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T12:22:21.171846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-17T11:48:22.521713+0000","last_change":"2023-12-17T11:48:18.280307+0000","last_active":"2023-12-17T11:48:22.521713+0000","last_peered":"2023-12-17T11:48:22.521713+0000","last_clean":"2023-12-17T11:48:22.521713+0000","last_became_active":"2023-12-17T11:48:18.280015+0000","last_became_peered":"2023-12-17T11:48:18.280015+0000","last_unstale":"2023-12-17T11:48:22.521713+0000","last_undegraded":"2023-12-17T11:48:22.521713+0000","last_fullsized":"2023-12-17T11:48:22.521713+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_clean_scrub_stamp":"2023-12-17T11:48:17.199970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T14:13:24.702473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-17T11:48:22.517974+0000","last_change":"2023-12-17T11:48:18.268732+0000","last_active":"2023-12-17T11:48:22.517974+0000","last_peered":"2023-12-17T11:48:22.517974+0000","last_clean":"2023-12-17T11:48:22.517974+0000","last_became_active":"2023-12-17T11:48:18.268356+0000","last_became_peered":"2023-12-17T11:48:18.268356+0000","last_unstale":"2023-12-17T11:48:22.517974+0000","last_undegraded":"2023-12-17T11:48:22.517974+0000","last_fullsized":"2023-12-17T11:48:22.517974+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_clean_scrub_stamp":"2023-12-17T11:48:17.199970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T19:01:46.435511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-17T11:48:22.536284+0000","last_change":"2023-12-17T11:48:18.278820+0000","last_active":"2023-12-17T11:48:22.536284+0000","last_peered":"2023-12-17T11:48:22.536284+0000","last_clean":"2023-12-17T11:48:22.536284+0000","last_became_active":"2023-12-17T11:48:18.275659+0000","last_became_peered":"2023-12-17T11:48:18.275659+0000","last_unstale":"2023-12-17T11:48:22.536284+0000","last_undegraded":"2023-12-17T11:48:22.536284+0000","last_fullsized":"2023-12-17T11:48:22.536284+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_clean_scrub_stamp":"2023-12-17T11:48:17.199970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T19:40:13.516541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-17T11:48:22.539766+0000","last_change":"2023-12-17T11:48:18.263983+0000","last_active":"2023-12-17T11:48:22.539766+0000","last_peered":"2023-12-17T11:48:22.539766+0000","last_clean":"2023-12-17T11:48:22.539766+0000","last_became_active":"2023-12-17T11:48:18.263574+0000","last_became_peered":"2023-12-17T11:48:18.263574+0000","last_unstale":"2023-12-17T11:48:22.539766+0000","last_undegraded":"2023-12-17T11:48:22.539766+0000","last_fullsized":"2023-12-17T11:48:22.539766+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_clean_scrub_stamp":"2023-12-17T11:48:17.199970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T22:56:05.187224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4638,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9276,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":43,"ondisk_log_size":43,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542155,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27864,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343976,"statfs":{"total":96636764160,"available":96608231424,"internally_reserved":0,"allocated":860160,"data_stored":694037,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0029999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81399999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0389999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95099999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1759999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2470000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5569999999999999}]}]},{"osd":6,"up_from":14,"seq":60129542155,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":274432,"data_stored":106927,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68799999999999994}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4590000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75700000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.343}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2889999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4139999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1479999999999999}]}]},{"osd":5,"up_from":14,"seq":60129542154,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":266240,"data_stored":103177,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.879}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.99099999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.292}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3979999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.534}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.589}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7829999999999999}]}]},{"osd":4,"up_from":14,"seq":60129542155,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":274432,"data_stored":103213,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85099999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92500000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4890000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.429}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5469999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6559999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7030000000000001}]}]},{"osd":3,"up_from":14,"seq":60129542154,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":274432,"data_stored":106927,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47099999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34200000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64500000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86399999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82399999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76700000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78700000000000003}]}]},{"osd":2,"up_from":14,"seq":60129542155,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":262144,"data_stored":103087,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68400000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51900000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.026}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96999999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88300000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78700000000000003}]}]},{"osd":1,"up_from":14,"seq":60129542154,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":270336,"data_stored":103247,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4279999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65600000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.321}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.268}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3799999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5760000000000001}]}]},{"osd":0,"up_from":14,"seq":60129542154,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27868,"kb_used_data":848,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343972,"statfs":{"total":96636764160,"available":96608227328,"internally_reserved":0,"allocated":868352,"data_stored":694093,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76200000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89100000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2210000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.8009999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3859999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6419999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.0670000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-17T11:48:45.848 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-17T11:48:46.109 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:46.107+0000 7f6d5b59e640 1 Processor -- start 2023-12-17T11:48:46.109 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:46.107+0000 7f6d5b59e640 1 -- start start 2023-12-17T11:48:46.112 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:46.109+0000 7f6d5b59e640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6d5c0713b0 0x7f6d5c0ae1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:46.112 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:46.109+0000 7f6d5b59e640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f6d5c070750 0x7f6d5c0b27e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:46.112 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:46.109+0000 7f6d5b59e640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d5c070070 con 0x7f6d5c159fd0 2023-12-17T11:48:46.112 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:46.109+0000 7f6d5b59e640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d5c0705f0 con 0x7f6d5c070750 2023-12-17T11:48:46.112 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:46.109+0000 7f6d5b59e640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d5c070310 con 0x7f6d5c0713b0 2023-12-17T11:48:46.112 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:46.109+0000 7f6d5ad9d640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f6d5c070750 0x7f6d5c0b27e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:46.112 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:46.110+0000 7f6d5ad9d640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f6d5c070750 0x7f6d5c0b27e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:41426/0 (socket says 172.21.15.40:41426) 2023-12-17T11:48:46.112 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:46.110+0000 7f6d5ad9d640 1 -- 172.21.15.40:0/2436893794 learned_addr learned my addr 172.21.15.40:0/2436893794 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-17T11:48:46.112 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:46.110+0000 7f6d53fff640 1 --2- 172.21.15.40:0/2436893794 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6d5c0713b0 0x7f6d5c0ae1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:46.112 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:46.110+0000 7f6d5ad9d640 1 -- 172.21.15.40:0/2436893794 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6d5c0713b0 msgr2=0x7f6d5c0ae1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:48:46.112 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:46.110+0000 7f6d5ad9d640 1 --2- 172.21.15.40:0/2436893794 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6d5c0713b0 0x7f6d5c0ae1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:46.113 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:46.110+0000 7f6d5ad9d640 1 -- 172.21.15.40:0/2436893794 >> v1:172.21.15.159:6789/0 conn(0x7f6d5c159fd0 legacy=0x7f6d5c070ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:46.113 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:46.110+0000 7f6d5ad9d640 1 -- 172.21.15.40:0/2436893794 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d5c0b1d00 con 0x7f6d5c070750 2023-12-17T11:48:46.113 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:46.111+0000 7f6d5ad9d640 1 --2- 172.21.15.40:0/2436893794 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6d5c070750 0x7f6d5c0b27e0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f6d54009e50 tx=0x7f6d5402bff0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba8d10ea1c71afd5 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:48:46.113 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:46.111+0000 7f6d59d9b640 1 -- 172.21.15.40:0/2436893794 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d5402cb90 con 0x7f6d5c070750 2023-12-17T11:48:46.113 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:46.111+0000 7f6d59d9b640 1 -- 172.21.15.40:0/2436893794 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d5402ccf0 con 0x7f6d5c070750 2023-12-17T11:48:46.113 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:46.112+0000 7f6d59d9b640 1 -- 172.21.15.40:0/2436893794 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d54034610 con 0x7f6d5c070750 2023-12-17T11:48:46.114 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:46.112+0000 7f6d5b59e640 1 -- 172.21.15.40:0/2436893794 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6d5c070750 msgr2=0x7f6d5c0b27e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:46.114 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:46.112+0000 7f6d5b59e640 1 --2- 172.21.15.40:0/2436893794 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6d5c070750 0x7f6d5c0b27e0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f6d54009e50 tx=0x7f6d5402bff0 comp rx=0 tx=0).stop 2023-12-17T11:48:46.114 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:46.112+0000 7f6d5b59e640 1 -- 172.21.15.40:0/2436893794 shutdown_connections 2023-12-17T11:48:46.114 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:46.112+0000 7f6d5b59e640 1 --2- 172.21.15.40:0/2436893794 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6d5c070750 0x7f6d5c0b27e0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:46.114 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:46.112+0000 7f6d5b59e640 1 --2- 172.21.15.40:0/2436893794 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6d5c0713b0 0x7f6d5c0ae1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:46.115 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:46.112+0000 7f6d5b59e640 1 -- 172.21.15.40:0/2436893794 >> 172.21.15.40:0/2436893794 conn(0x7f6d5c0b0860 msgr2=0x7f6d5c0b0c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:48:46.115 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:46.112+0000 7f6d5b59e640 1 -- 172.21.15.40:0/2436893794 shutdown_connections 2023-12-17T11:48:46.115 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:46.112+0000 7f6d5b59e640 1 -- 172.21.15.40:0/2436893794 wait complete. 2023-12-17T11:48:46.116 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:46.114+0000 7f6d5b59e640 1 Processor -- start 2023-12-17T11:48:46.116 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:46.114+0000 7f6d5b59e640 1 -- start start 2023-12-17T11:48:46.117 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:46.115+0000 7f6d5b59e640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6d5c070750 0x7f6d5c15c0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:46.117 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:46.115+0000 7f6d5b59e640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6d5c0713b0 0x7f6d5c1585b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:46.117 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:46.115+0000 7f6d5b59e640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6d5c159fd0 0x7f6d5c158af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:46.117 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:46.115+0000 7f6d5b59e640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d5c15c610 con 0x7f6d5c0713b0 2023-12-17T11:48:46.117 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:46.115+0000 7f6d5b59e640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d5c14e3c0 con 0x7f6d5c070750 2023-12-17T11:48:46.117 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:46.115+0000 7f6d5b59e640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d5c14e6a0 con 0x7f6d5c159fd0 2023-12-17T11:48:46.118 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:46.115+0000 7f6d53fff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6d5c0713b0 0x7f6d5c1585b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:46.118 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:46.115+0000 7f6d53fff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6d5c0713b0 0x7f6d5c1585b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:41438/0 (socket says 172.21.15.40:41438) 2023-12-17T11:48:46.118 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:46.115+0000 7f6d53fff640 1 -- 172.21.15.40:0/1845195877 learned_addr learned my addr 172.21.15.40:0/1845195877 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-17T11:48:46.119 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:46.116+0000 7f6d5ad9d640 1 --2- 172.21.15.40:0/1845195877 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6d5c159fd0 0x7f6d5c158af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:46.119 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:46.116+0000 7f6d5a59c640 1 --2- 172.21.15.40:0/1845195877 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6d5c070750 0x7f6d5c15c0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:46.119 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:46.116+0000 7f6d53fff640 1 -- 172.21.15.40:0/1845195877 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6d5c159fd0 msgr2=0x7f6d5c158af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:46.119 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:46.116+0000 7f6d53fff640 1 --2- 172.21.15.40:0/1845195877 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6d5c159fd0 0x7f6d5c158af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:46.119 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:46.116+0000 7f6d53fff640 1 -- 172.21.15.40:0/1845195877 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6d5c070750 msgr2=0x7f6d5c15c0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:46.119 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:46.116+0000 7f6d53fff640 1 --2- 172.21.15.40:0/1845195877 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6d5c070750 0x7f6d5c15c0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:46.119 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:46.116+0000 7f6d53fff640 1 -- 172.21.15.40:0/1845195877 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d54009b30 con 0x7f6d5c0713b0 2023-12-17T11:48:46.119 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:46.116+0000 7f6d5a59c640 1 --2- 172.21.15.40:0/1845195877 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6d5c070750 0x7f6d5c15c0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-17T11:48:46.120 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:46.116+0000 7f6d53fff640 1 --2- 172.21.15.40:0/1845195877 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6d5c0713b0 0x7f6d5c1585b0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f6d4400e9b0 tx=0x7f6d4400ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:48:46.120 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:46.116+0000 7f6d52ffd640 1 -- 172.21.15.40:0/1845195877 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d44009670 con 0x7f6d5c0713b0 2023-12-17T11:48:46.120 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:46.116+0000 7f6d52ffd640 1 -- 172.21.15.40:0/1845195877 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d4400c9a0 con 0x7f6d5c0713b0 2023-12-17T11:48:46.120 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:46.116+0000 7f6d52ffd640 1 -- 172.21.15.40:0/1845195877 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d4400cd50 con 0x7f6d5c0713b0 2023-12-17T11:48:46.120 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:46.116+0000 7f6d5b59e640 1 -- 172.21.15.40:0/1845195877 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d5c14e980 con 0x7f6d5c0713b0 2023-12-17T11:48:46.120 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:46.117+0000 7f6d5b59e640 1 -- 172.21.15.40:0/1845195877 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d5c14ef40 con 0x7f6d5c0713b0 2023-12-17T11:48:46.120 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:46.118+0000 7f6d5b59e640 1 -- 172.21.15.40:0/1845195877 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d5c074450 con 0x7f6d5c0713b0 2023-12-17T11:48:46.120 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:46.118+0000 7f6d52ffd640 1 -- 172.21.15.40:0/1845195877 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f6d44013470 con 0x7f6d5c0713b0 2023-12-17T11:48:46.121 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:46.119+0000 7f6d52ffd640 1 --2- 172.21.15.40:0/1845195877 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f6d3c06ae40 0x7f6d3c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:46.121 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:46.119+0000 7f6d52ffd640 1 -- 172.21.15.40:0/1845195877 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f6d44089c50 con 0x7f6d5c0713b0 2023-12-17T11:48:46.122 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:46.120+0000 7f6d5a59c640 1 --2- 172.21.15.40:0/1845195877 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f6d3c06ae40 0x7f6d3c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:46.123 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:46.121+0000 7f6d5a59c640 1 --2- 172.21.15.40:0/1845195877 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f6d3c06ae40 0x7f6d3c06d300 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f6d4c000f60 tx=0x7f6d4c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:48:46.125 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:46.124+0000 7f6d52ffd640 1 -- 172.21.15.40:0/1845195877 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f6d44054970 con 0x7f6d5c0713b0 2023-12-17T11:48:46.312 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:46.310+0000 7f6d5b59e640 1 -- 172.21.15.40:0/1845195877 --> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f6d5c0b0140 con 0x7f6d3c06ae40 2023-12-17T11:48:46.339 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:46.337+0000 7f6d52ffd640 1 -- 172.21.15.40:0/1845195877 <== mgr.4105 v2:172.21.15.159:6832/479465803 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+345198 (secure 0 0 0) 0x7f6d5c0b0140 con 0x7f6d3c06ae40 2023-12-17T11:48:46.340 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T11:48:46.346 INFO:teuthology.orchestra.run.smithi040.stderr:dumped all 2023-12-17T11:48:46.347 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:46.344+0000 7f6d5b59e640 1 -- 172.21.15.40:0/1845195877 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f6d3c06ae40 msgr2=0x7f6d3c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:46.348 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:46.344+0000 7f6d5b59e640 1 --2- 172.21.15.40:0/1845195877 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f6d3c06ae40 0x7f6d3c06d300 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f6d4c000f60 tx=0x7f6d4c009040 comp rx=0 tx=0).stop 2023-12-17T11:48:46.348 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:46.344+0000 7f6d5b59e640 1 -- 172.21.15.40:0/1845195877 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6d5c0713b0 msgr2=0x7f6d5c1585b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:46.348 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:46.344+0000 7f6d5b59e640 1 --2- 172.21.15.40:0/1845195877 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6d5c0713b0 0x7f6d5c1585b0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f6d4400e9b0 tx=0x7f6d4400ee70 comp rx=0 tx=0).stop 2023-12-17T11:48:46.348 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:46.345+0000 7f6d5b59e640 1 -- 172.21.15.40:0/1845195877 shutdown_connections 2023-12-17T11:48:46.348 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:46.345+0000 7f6d5b59e640 1 --2- 172.21.15.40:0/1845195877 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f6d3c06ae40 0x7f6d3c06d300 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:46.348 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:46.345+0000 7f6d5b59e640 1 --2- 172.21.15.40:0/1845195877 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6d5c159fd0 0x7f6d5c158af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:46.348 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:46.345+0000 7f6d5b59e640 1 --2- 172.21.15.40:0/1845195877 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6d5c0713b0 0x7f6d5c1585b0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:46.348 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:46.345+0000 7f6d5b59e640 1 --2- 172.21.15.40:0/1845195877 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6d5c070750 0x7f6d5c15c0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:46.348 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:46.345+0000 7f6d5b59e640 1 -- 172.21.15.40:0/1845195877 >> 172.21.15.40:0/1845195877 conn(0x7f6d5c0b0860 msgr2=0x7f6d5c155d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:48:46.348 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:46.345+0000 7f6d5b59e640 1 -- 172.21.15.40:0/1845195877 shutdown_connections 2023-12-17T11:48:46.349 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:46.345+0000 7f6d5b59e640 1 -- 172.21.15.40:0/1845195877 wait complete. 2023-12-17T11:48:46.367 INFO:teuthology.orchestra.run.smithi040.stdout:{"pg_ready":true,"pg_map":{"version":37,"stamp":"2023-12-17T11:48:44.602457+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595006,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":208,"num_write_kb":2435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160,"ondisk_log_size":160,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219440,"kb_used_data":3272,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755280,"statfs":{"total":773094113280,"available":772869406720,"internally_reserved":0,"allocated":3350528,"data_stored":2014708,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":221236786},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1781,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005615"},"pg_stats":[{"pgid":"2.1f","version":"20'4","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-17T11:48:22.517845+0000","last_change":"2023-12-17T11:48:17.243309+0000","last_active":"2023-12-17T11:48:22.517845+0000","last_peered":"2023-12-17T11:48:22.517845+0000","last_clean":"2023-12-17T11:48:22.517845+0000","last_became_active":"2023-12-17T11:48:17.242970+0000","last_became_peered":"2023-12-17T11:48:17.242970+0000","last_unstale":"2023-12-17T11:48:22.517845+0000","last_undegraded":"2023-12-17T11:48:22.517845+0000","last_fullsized":"2023-12-17T11:48:22.517845+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:16.193911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:16.193911+0000","last_clean_scrub_stamp":"2023-12-17T11:48:16.193911+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T21:33:08.409177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-17T11:48:22.501333+0000","last_change":"2023-12-17T11:48:18.269881+0000","last_active":"2023-12-17T11:48:22.501333+0000","last_peered":"2023-12-17T11:48:22.501333+0000","last_clean":"2023-12-17T11:48:22.501333+0000","last_became_active":"2023-12-17T11:48:18.268658+0000","last_became_peered":"2023-12-17T11:48:18.268658+0000","last_unstale":"2023-12-17T11:48:22.501333+0000","last_undegraded":"2023-12-17T11:48:22.501333+0000","last_fullsized":"2023-12-17T11:48:22.501333+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_clean_scrub_stamp":"2023-12-17T11:48:17.199970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T22:33:29.994957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-17T11:48:24.563717+0000","last_change":"2023-12-17T11:48:22.536397+0000","last_active":"2023-12-17T11:48:24.563717+0000","last_peered":"2023-12-17T11:48:24.563717+0000","last_clean":"2023-12-17T11:48:24.563717+0000","last_became_active":"2023-12-17T11:48:22.535833+0000","last_became_peered":"2023-12-17T11:48:22.535833+0000","last_unstale":"2023-12-17T11:48:24.563717+0000","last_undegraded":"2023-12-17T11:48:24.563717+0000","last_fullsized":"2023-12-17T11:48:24.563717+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:21.473989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:21.473989+0000","last_clean_scrub_stamp":"2023-12-17T11:48:21.473989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T13:25:07.551873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-17T11:48:22.500677+0000","last_change":"2023-12-17T11:48:17.242548+0000","last_active":"2023-12-17T11:48:22.500677+0000","last_peered":"2023-12-17T11:48:22.500677+0000","last_clean":"2023-12-17T11:48:22.500677+0000","last_became_active":"2023-12-17T11:48:17.242261+0000","last_became_peered":"2023-12-17T11:48:17.242261+0000","last_unstale":"2023-12-17T11:48:22.500677+0000","last_undegraded":"2023-12-17T11:48:22.500677+0000","last_fullsized":"2023-12-17T11:48:22.500677+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:16.193911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:16.193911+0000","last_clean_scrub_stamp":"2023-12-17T11:48:16.193911+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T17:25:44.412598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-17T11:48:22.517637+0000","last_change":"2023-12-17T11:48:18.284502+0000","last_active":"2023-12-17T11:48:22.517637+0000","last_peered":"2023-12-17T11:48:22.517637+0000","last_clean":"2023-12-17T11:48:22.517637+0000","last_became_active":"2023-12-17T11:48:18.284224+0000","last_became_peered":"2023-12-17T11:48:18.284224+0000","last_unstale":"2023-12-17T11:48:22.517637+0000","last_undegraded":"2023-12-17T11:48:22.517637+0000","last_fullsized":"2023-12-17T11:48:22.517637+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_clean_scrub_stamp":"2023-12-17T11:48:17.199970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T16:14:48.723317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-17T11:48:23.467417+0000","last_change":"2023-12-17T11:48:22.534382+0000","last_active":"2023-12-17T11:48:23.467417+0000","last_peered":"2023-12-17T11:48:23.467417+0000","last_clean":"2023-12-17T11:48:23.467417+0000","last_became_active":"2023-12-17T11:48:22.533910+0000","last_became_peered":"2023-12-17T11:48:22.533910+0000","last_unstale":"2023-12-17T11:48:23.467417+0000","last_undegraded":"2023-12-17T11:48:23.467417+0000","last_fullsized":"2023-12-17T11:48:23.467417+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:21.473989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:21.473989+0000","last_clean_scrub_stamp":"2023-12-17T11:48:21.473989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T22:33:34.268975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-17T11:48:22.538051+0000","last_change":"2023-12-17T11:48:17.252782+0000","last_active":"2023-12-17T11:48:22.538051+0000","last_peered":"2023-12-17T11:48:22.538051+0000","last_clean":"2023-12-17T11:48:22.538051+0000","last_became_active":"2023-12-17T11:48:17.252501+0000","last_became_peered":"2023-12-17T11:48:17.252501+0000","last_unstale":"2023-12-17T11:48:22.538051+0000","last_undegraded":"2023-12-17T11:48:22.538051+0000","last_fullsized":"2023-12-17T11:48:22.538051+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:16.193911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:16.193911+0000","last_clean_scrub_stamp":"2023-12-17T11:48:16.193911+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T18:12:00.944371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-17T11:48:22.521803+0000","last_change":"2023-12-17T11:48:18.283410+0000","last_active":"2023-12-17T11:48:22.521803+0000","last_peered":"2023-12-17T11:48:22.521803+0000","last_clean":"2023-12-17T11:48:22.521803+0000","last_became_active":"2023-12-17T11:48:18.283129+0000","last_became_peered":"2023-12-17T11:48:18.283129+0000","last_unstale":"2023-12-17T11:48:22.521803+0000","last_undegraded":"2023-12-17T11:48:22.521803+0000","last_fullsized":"2023-12-17T11:48:22.521803+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_clean_scrub_stamp":"2023-12-17T11:48:17.199970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T13:18:38.029532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-17T11:48:23.468045+0000","last_change":"2023-12-17T11:48:22.532489+0000","last_active":"2023-12-17T11:48:23.468045+0000","last_peered":"2023-12-17T11:48:23.468045+0000","last_clean":"2023-12-17T11:48:23.468045+0000","last_became_active":"2023-12-17T11:48:22.531971+0000","last_became_peered":"2023-12-17T11:48:22.531971+0000","last_unstale":"2023-12-17T11:48:23.468045+0000","last_undegraded":"2023-12-17T11:48:23.468045+0000","last_fullsized":"2023-12-17T11:48:23.468045+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:21.473989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:21.473989+0000","last_clean_scrub_stamp":"2023-12-17T11:48:21.473989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T14:39:15.707189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-17T11:48:22.538470+0000","last_change":"2023-12-17T11:48:17.259412+0000","last_active":"2023-12-17T11:48:22.538470+0000","last_peered":"2023-12-17T11:48:22.538470+0000","last_clean":"2023-12-17T11:48:22.538470+0000","last_became_active":"2023-12-17T11:48:17.259092+0000","last_became_peered":"2023-12-17T11:48:17.259092+0000","last_unstale":"2023-12-17T11:48:22.538470+0000","last_undegraded":"2023-12-17T11:48:22.538470+0000","last_fullsized":"2023-12-17T11:48:22.538470+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:16.193911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:16.193911+0000","last_clean_scrub_stamp":"2023-12-17T11:48:16.193911+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T21:38:11.246682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-17T11:48:22.522929+0000","last_change":"2023-12-17T11:48:18.282884+0000","last_active":"2023-12-17T11:48:22.522929+0000","last_peered":"2023-12-17T11:48:22.522929+0000","last_clean":"2023-12-17T11:48:22.522929+0000","last_became_active":"2023-12-17T11:48:18.282589+0000","last_became_peered":"2023-12-17T11:48:18.282589+0000","last_unstale":"2023-12-17T11:48:22.522929+0000","last_undegraded":"2023-12-17T11:48:22.522929+0000","last_fullsized":"2023-12-17T11:48:22.522929+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_clean_scrub_stamp":"2023-12-17T11:48:17.199970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T14:46:31.139617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-17T11:48:23.468065+0000","last_change":"2023-12-17T11:48:22.524129+0000","last_active":"2023-12-17T11:48:23.468065+0000","last_peered":"2023-12-17T11:48:23.468065+0000","last_clean":"2023-12-17T11:48:23.468065+0000","last_became_active":"2023-12-17T11:48:22.523749+0000","last_became_peered":"2023-12-17T11:48:22.523749+0000","last_unstale":"2023-12-17T11:48:23.468065+0000","last_undegraded":"2023-12-17T11:48:23.468065+0000","last_fullsized":"2023-12-17T11:48:23.468065+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:21.473989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:21.473989+0000","last_clean_scrub_stamp":"2023-12-17T11:48:21.473989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T14:35:42.104042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-17T11:48:22.528476+0000","last_change":"2023-12-17T11:48:18.262498+0000","last_active":"2023-12-17T11:48:22.528476+0000","last_peered":"2023-12-17T11:48:22.528476+0000","last_clean":"2023-12-17T11:48:22.528476+0000","last_became_active":"2023-12-17T11:48:18.260747+0000","last_became_peered":"2023-12-17T11:48:18.260747+0000","last_unstale":"2023-12-17T11:48:22.528476+0000","last_undegraded":"2023-12-17T11:48:22.528476+0000","last_fullsized":"2023-12-17T11:48:22.528476+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_clean_scrub_stamp":"2023-12-17T11:48:17.199970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T19:01:46.435511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-17T11:48:22.538318+0000","last_change":"2023-12-17T11:48:17.254579+0000","last_active":"2023-12-17T11:48:22.538318+0000","last_peered":"2023-12-17T11:48:22.538318+0000","last_clean":"2023-12-17T11:48:22.538318+0000","last_became_active":"2023-12-17T11:48:17.254302+0000","last_became_peered":"2023-12-17T11:48:17.254302+0000","last_unstale":"2023-12-17T11:48:22.538318+0000","last_undegraded":"2023-12-17T11:48:22.538318+0000","last_fullsized":"2023-12-17T11:48:22.538318+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:16.193911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:16.193911+0000","last_clean_scrub_stamp":"2023-12-17T11:48:16.193911+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T22:46:18.442258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-17T11:48:23.469632+0000","last_change":"2023-12-17T11:48:22.541168+0000","last_active":"2023-12-17T11:48:23.469632+0000","last_peered":"2023-12-17T11:48:23.469632+0000","last_clean":"2023-12-17T11:48:23.469632+0000","last_became_active":"2023-12-17T11:48:22.539739+0000","last_became_peered":"2023-12-17T11:48:22.539739+0000","last_unstale":"2023-12-17T11:48:23.469632+0000","last_undegraded":"2023-12-17T11:48:23.469632+0000","last_fullsized":"2023-12-17T11:48:23.469632+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:21.473989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:21.473989+0000","last_clean_scrub_stamp":"2023-12-17T11:48:21.473989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T13:18:42.303550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-17T11:48:22.498917+0000","last_change":"2023-12-17T11:48:18.271462+0000","last_active":"2023-12-17T11:48:22.498917+0000","last_peered":"2023-12-17T11:48:22.498917+0000","last_clean":"2023-12-17T11:48:22.498917+0000","last_became_active":"2023-12-17T11:48:18.270639+0000","last_became_peered":"2023-12-17T11:48:18.270639+0000","last_unstale":"2023-12-17T11:48:22.498917+0000","last_undegraded":"2023-12-17T11:48:22.498917+0000","last_fullsized":"2023-12-17T11:48:22.498917+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_clean_scrub_stamp":"2023-12-17T11:48:17.199970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T16:14:48.723317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-17T11:48:22.528530+0000","last_change":"2023-12-17T11:48:17.243128+0000","last_active":"2023-12-17T11:48:22.528530+0000","last_peered":"2023-12-17T11:48:22.528530+0000","last_clean":"2023-12-17T11:48:22.528530+0000","last_became_active":"2023-12-17T11:48:17.242656+0000","last_became_peered":"2023-12-17T11:48:17.242656+0000","last_unstale":"2023-12-17T11:48:22.528530+0000","last_undegraded":"2023-12-17T11:48:22.528530+0000","last_fullsized":"2023-12-17T11:48:22.528530+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:16.193911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:16.193911+0000","last_clean_scrub_stamp":"2023-12-17T11:48:16.193911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T21:33:08.409177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-17T11:48:23.468866+0000","last_change":"2023-12-17T11:48:22.539973+0000","last_active":"2023-12-17T11:48:23.468866+0000","last_peered":"2023-12-17T11:48:23.468866+0000","last_clean":"2023-12-17T11:48:23.468866+0000","last_became_active":"2023-12-17T11:48:22.539592+0000","last_became_peered":"2023-12-17T11:48:22.539592+0000","last_unstale":"2023-12-17T11:48:23.468866+0000","last_undegraded":"2023-12-17T11:48:23.468866+0000","last_fullsized":"2023-12-17T11:48:23.468866+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:21.473989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:21.473989+0000","last_clean_scrub_stamp":"2023-12-17T11:48:21.473989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T19:19:54.372270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-17T11:48:22.498149+0000","last_change":"2023-12-17T11:48:18.272948+0000","last_active":"2023-12-17T11:48:22.498149+0000","last_peered":"2023-12-17T11:48:22.498149+0000","last_clean":"2023-12-17T11:48:22.498149+0000","last_became_active":"2023-12-17T11:48:18.272251+0000","last_became_peered":"2023-12-17T11:48:18.272251+0000","last_unstale":"2023-12-17T11:48:22.498149+0000","last_undegraded":"2023-12-17T11:48:22.498149+0000","last_fullsized":"2023-12-17T11:48:22.498149+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_clean_scrub_stamp":"2023-12-17T11:48:17.199970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T23:46:39.140775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-17T11:48:22.529348+0000","last_change":"2023-12-17T11:48:17.249233+0000","last_active":"2023-12-17T11:48:22.529348+0000","last_peered":"2023-12-17T11:48:22.529348+0000","last_clean":"2023-12-17T11:48:22.529348+0000","last_became_active":"2023-12-17T11:48:17.248693+0000","last_became_peered":"2023-12-17T11:48:17.248693+0000","last_unstale":"2023-12-17T11:48:22.529348+0000","last_undegraded":"2023-12-17T11:48:22.529348+0000","last_fullsized":"2023-12-17T11:48:22.529348+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:16.193911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:16.193911+0000","last_clean_scrub_stamp":"2023-12-17T11:48:16.193911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T15:52:21.914780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-17T11:48:24.569901+0000","last_change":"2023-12-17T11:48:22.546268+0000","last_active":"2023-12-17T11:48:24.569901+0000","last_peered":"2023-12-17T11:48:24.569901+0000","last_clean":"2023-12-17T11:48:24.569901+0000","last_became_active":"2023-12-17T11:48:22.545873+0000","last_became_peered":"2023-12-17T11:48:22.545873+0000","last_unstale":"2023-12-17T11:48:24.569901+0000","last_undegraded":"2023-12-17T11:48:24.569901+0000","last_fullsized":"2023-12-17T11:48:24.569901+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:21.473989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:21.473989+0000","last_clean_scrub_stamp":"2023-12-17T11:48:21.473989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T21:28:14.069617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-17T11:48:22.514153+0000","last_change":"2023-12-17T11:48:18.258783+0000","last_active":"2023-12-17T11:48:22.514153+0000","last_peered":"2023-12-17T11:48:22.514153+0000","last_clean":"2023-12-17T11:48:22.514153+0000","last_became_active":"2023-12-17T11:48:18.258068+0000","last_became_peered":"2023-12-17T11:48:18.258068+0000","last_unstale":"2023-12-17T11:48:22.514153+0000","last_undegraded":"2023-12-17T11:48:22.514153+0000","last_fullsized":"2023-12-17T11:48:22.514153+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_clean_scrub_stamp":"2023-12-17T11:48:17.199970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T15:07:39.743439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-17T11:48:22.537435+0000","last_change":"2023-12-17T11:48:17.253559+0000","last_active":"2023-12-17T11:48:22.537435+0000","last_peered":"2023-12-17T11:48:22.537435+0000","last_clean":"2023-12-17T11:48:22.537435+0000","last_became_active":"2023-12-17T11:48:17.253271+0000","last_became_peered":"2023-12-17T11:48:17.253271+0000","last_unstale":"2023-12-17T11:48:22.537435+0000","last_undegraded":"2023-12-17T11:48:22.537435+0000","last_fullsized":"2023-12-17T11:48:22.537435+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:16.193911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:16.193911+0000","last_clean_scrub_stamp":"2023-12-17T11:48:16.193911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T22:20:08.219855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-17T11:48:23.470614+0000","last_change":"2023-12-17T11:48:22.541511+0000","last_active":"2023-12-17T11:48:23.470614+0000","last_peered":"2023-12-17T11:48:23.470614+0000","last_clean":"2023-12-17T11:48:23.470614+0000","last_became_active":"2023-12-17T11:48:22.540975+0000","last_became_peered":"2023-12-17T11:48:22.540975+0000","last_unstale":"2023-12-17T11:48:23.470614+0000","last_undegraded":"2023-12-17T11:48:23.470614+0000","last_fullsized":"2023-12-17T11:48:23.470614+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:21.473989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:21.473989+0000","last_clean_scrub_stamp":"2023-12-17T11:48:21.473989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T14:46:35.413635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-17T11:48:22.517573+0000","last_change":"2023-12-17T11:48:18.270278+0000","last_active":"2023-12-17T11:48:22.517573+0000","last_peered":"2023-12-17T11:48:22.517573+0000","last_clean":"2023-12-17T11:48:22.517573+0000","last_became_active":"2023-12-17T11:48:18.269966+0000","last_became_peered":"2023-12-17T11:48:18.269966+0000","last_unstale":"2023-12-17T11:48:22.517573+0000","last_undegraded":"2023-12-17T11:48:22.517573+0000","last_fullsized":"2023-12-17T11:48:22.517573+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_clean_scrub_stamp":"2023-12-17T11:48:17.199970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T19:40:13.516541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-17T11:48:22.530568+0000","last_change":"2023-12-17T11:48:17.249856+0000","last_active":"2023-12-17T11:48:22.530568+0000","last_peered":"2023-12-17T11:48:22.530568+0000","last_clean":"2023-12-17T11:48:22.530568+0000","last_became_active":"2023-12-17T11:48:17.249564+0000","last_became_peered":"2023-12-17T11:48:17.249564+0000","last_unstale":"2023-12-17T11:48:22.530568+0000","last_undegraded":"2023-12-17T11:48:22.530568+0000","last_fullsized":"2023-12-17T11:48:22.530568+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:16.193911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:16.193911+0000","last_clean_scrub_stamp":"2023-12-17T11:48:16.193911+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T15:07:38.737379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-17T11:48:23.467555+0000","last_change":"2023-12-17T11:48:22.541474+0000","last_active":"2023-12-17T11:48:23.467555+0000","last_peered":"2023-12-17T11:48:23.467555+0000","last_clean":"2023-12-17T11:48:23.467555+0000","last_became_active":"2023-12-17T11:48:22.541092+0000","last_became_peered":"2023-12-17T11:48:22.541092+0000","last_unstale":"2023-12-17T11:48:23.467555+0000","last_undegraded":"2023-12-17T11:48:23.467555+0000","last_fullsized":"2023-12-17T11:48:23.467555+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:21.473989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:21.473989+0000","last_clean_scrub_stamp":"2023-12-17T11:48:21.473989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T20:54:02.500358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-17T11:48:22.502585+0000","last_change":"2023-12-17T11:48:18.270544+0000","last_active":"2023-12-17T11:48:22.502585+0000","last_peered":"2023-12-17T11:48:22.502585+0000","last_clean":"2023-12-17T11:48:22.502585+0000","last_became_active":"2023-12-17T11:48:18.270216+0000","last_became_peered":"2023-12-17T11:48:18.270216+0000","last_unstale":"2023-12-17T11:48:22.502585+0000","last_undegraded":"2023-12-17T11:48:22.502585+0000","last_fullsized":"2023-12-17T11:48:22.502585+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_clean_scrub_stamp":"2023-12-17T11:48:17.199970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T14:39:11.433170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"24'1","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-17T11:48:23.109451+0000","last_change":"2023-12-17T11:48:17.239499+0000","last_active":"2023-12-17T11:48:23.109451+0000","last_peered":"2023-12-17T11:48:23.109451+0000","last_clean":"2023-12-17T11:48:23.109451+0000","last_became_active":"2023-12-17T11:48:17.239256+0000","last_became_peered":"2023-12-17T11:48:17.239256+0000","last_unstale":"2023-12-17T11:48:23.109451+0000","last_undegraded":"2023-12-17T11:48:23.109451+0000","last_fullsized":"2023-12-17T11:48:23.109451+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:16.193911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:16.193911+0000","last_clean_scrub_stamp":"2023-12-17T11:48:16.193911+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T19:10:09.191716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-17T11:48:24.562916+0000","last_change":"2023-12-17T11:48:22.538930+0000","last_active":"2023-12-17T11:48:24.562916+0000","last_peered":"2023-12-17T11:48:24.562916+0000","last_clean":"2023-12-17T11:48:24.562916+0000","last_became_active":"2023-12-17T11:48:22.538189+0000","last_became_peered":"2023-12-17T11:48:22.538189+0000","last_unstale":"2023-12-17T11:48:24.562916+0000","last_undegraded":"2023-12-17T11:48:24.562916+0000","last_fullsized":"2023-12-17T11:48:24.562916+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:21.473989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:21.473989+0000","last_clean_scrub_stamp":"2023-12-17T11:48:21.473989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T15:43:12.098532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-17T11:48:22.529901+0000","last_change":"2023-12-17T11:48:18.266039+0000","last_active":"2023-12-17T11:48:22.529901+0000","last_peered":"2023-12-17T11:48:22.529901+0000","last_clean":"2023-12-17T11:48:22.529901+0000","last_became_active":"2023-12-17T11:48:18.264294+0000","last_became_peered":"2023-12-17T11:48:18.264294+0000","last_unstale":"2023-12-17T11:48:22.529901+0000","last_undegraded":"2023-12-17T11:48:22.529901+0000","last_fullsized":"2023-12-17T11:48:22.529901+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_clean_scrub_stamp":"2023-12-17T11:48:17.199970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T23:46:39.140775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-17T11:48:22.538134+0000","last_change":"2023-12-17T11:48:17.255352+0000","last_active":"2023-12-17T11:48:22.538134+0000","last_peered":"2023-12-17T11:48:22.538134+0000","last_clean":"2023-12-17T11:48:22.538134+0000","last_became_active":"2023-12-17T11:48:17.254987+0000","last_became_peered":"2023-12-17T11:48:17.254987+0000","last_unstale":"2023-12-17T11:48:22.538134+0000","last_undegraded":"2023-12-17T11:48:22.538134+0000","last_fullsized":"2023-12-17T11:48:22.538134+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:16.193911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:16.193911+0000","last_clean_scrub_stamp":"2023-12-17T11:48:16.193911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T13:39:47.600568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-17T11:48:24.565796+0000","last_change":"2023-12-17T11:48:22.541369+0000","last_active":"2023-12-17T11:48:24.565796+0000","last_peered":"2023-12-17T11:48:24.565796+0000","last_clean":"2023-12-17T11:48:24.565796+0000","last_became_active":"2023-12-17T11:48:22.540908+0000","last_became_peered":"2023-12-17T11:48:22.540908+0000","last_unstale":"2023-12-17T11:48:24.565796+0000","last_undegraded":"2023-12-17T11:48:24.565796+0000","last_fullsized":"2023-12-17T11:48:24.565796+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:21.473989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:21.473989+0000","last_clean_scrub_stamp":"2023-12-17T11:48:21.473989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T19:44:20.727021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-17T11:48:22.523020+0000","last_change":"2023-12-17T11:48:18.281474+0000","last_active":"2023-12-17T11:48:22.523020+0000","last_peered":"2023-12-17T11:48:22.523020+0000","last_clean":"2023-12-17T11:48:22.523020+0000","last_became_active":"2023-12-17T11:48:18.281189+0000","last_became_peered":"2023-12-17T11:48:18.281189+0000","last_unstale":"2023-12-17T11:48:22.523020+0000","last_undegraded":"2023-12-17T11:48:22.523020+0000","last_fullsized":"2023-12-17T11:48:22.523020+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_clean_scrub_stamp":"2023-12-17T11:48:17.199970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T19:37:12.473709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-17T11:48:22.530125+0000","last_change":"2023-12-17T11:48:17.240666+0000","last_active":"2023-12-17T11:48:22.530125+0000","last_peered":"2023-12-17T11:48:22.530125+0000","last_clean":"2023-12-17T11:48:22.530125+0000","last_became_active":"2023-12-17T11:48:17.239901+0000","last_became_peered":"2023-12-17T11:48:17.239901+0000","last_unstale":"2023-12-17T11:48:22.530125+0000","last_undegraded":"2023-12-17T11:48:22.530125+0000","last_fullsized":"2023-12-17T11:48:22.530125+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:16.193911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:16.193911+0000","last_clean_scrub_stamp":"2023-12-17T11:48:16.193911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T23:35:00.926850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-17T11:48:24.568012+0000","last_change":"2023-12-17T11:48:22.534424+0000","last_active":"2023-12-17T11:48:24.568012+0000","last_peered":"2023-12-17T11:48:24.568012+0000","last_clean":"2023-12-17T11:48:24.568012+0000","last_became_active":"2023-12-17T11:48:22.533095+0000","last_became_peered":"2023-12-17T11:48:22.533095+0000","last_unstale":"2023-12-17T11:48:24.568012+0000","last_undegraded":"2023-12-17T11:48:24.568012+0000","last_fullsized":"2023-12-17T11:48:24.568012+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:21.473989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:21.473989+0000","last_clean_scrub_stamp":"2023-12-17T11:48:21.473989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T19:19:54.372270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-17T11:48:22.513971+0000","last_change":"2023-12-17T11:48:18.271892+0000","last_active":"2023-12-17T11:48:22.513971+0000","last_peered":"2023-12-17T11:48:22.513971+0000","last_clean":"2023-12-17T11:48:22.513971+0000","last_became_active":"2023-12-17T11:48:18.269149+0000","last_became_peered":"2023-12-17T11:48:18.269149+0000","last_unstale":"2023-12-17T11:48:22.513971+0000","last_undegraded":"2023-12-17T11:48:22.513971+0000","last_fullsized":"2023-12-17T11:48:22.513971+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_clean_scrub_stamp":"2023-12-17T11:48:17.199970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T23:05:27.950618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-17T11:48:22.519931+0000","last_change":"2023-12-17T11:48:17.256166+0000","last_active":"2023-12-17T11:48:22.519931+0000","last_peered":"2023-12-17T11:48:22.519931+0000","last_clean":"2023-12-17T11:48:22.519931+0000","last_became_active":"2023-12-17T11:48:17.255858+0000","last_became_peered":"2023-12-17T11:48:17.255858+0000","last_unstale":"2023-12-17T11:48:22.519931+0000","last_undegraded":"2023-12-17T11:48:22.519931+0000","last_fullsized":"2023-12-17T11:48:22.519931+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:16.193911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:16.193911+0000","last_clean_scrub_stamp":"2023-12-17T11:48:16.193911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T19:40:12.510482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-17T11:48:24.569042+0000","last_change":"2023-12-17T11:48:22.537931+0000","last_active":"2023-12-17T11:48:24.569042+0000","last_peered":"2023-12-17T11:48:24.569042+0000","last_clean":"2023-12-17T11:48:24.569042+0000","last_became_active":"2023-12-17T11:48:22.537530+0000","last_became_peered":"2023-12-17T11:48:22.537530+0000","last_unstale":"2023-12-17T11:48:24.569042+0000","last_undegraded":"2023-12-17T11:48:24.569042+0000","last_fullsized":"2023-12-17T11:48:24.569042+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:21.473989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:21.473989+0000","last_clean_scrub_stamp":"2023-12-17T11:48:21.473989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T14:46:35.413635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-17T11:48:22.524745+0000","last_change":"2023-12-17T11:48:18.264485+0000","last_active":"2023-12-17T11:48:22.524745+0000","last_peered":"2023-12-17T11:48:22.524745+0000","last_clean":"2023-12-17T11:48:22.524745+0000","last_became_active":"2023-12-17T11:48:18.264150+0000","last_became_peered":"2023-12-17T11:48:18.264150+0000","last_unstale":"2023-12-17T11:48:22.524745+0000","last_undegraded":"2023-12-17T11:48:22.524745+0000","last_fullsized":"2023-12-17T11:48:22.524745+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_clean_scrub_stamp":"2023-12-17T11:48:17.199970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T12:59:53.414167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-17T11:48:22.505049+0000","last_change":"2023-12-17T11:48:17.234956+0000","last_active":"2023-12-17T11:48:22.505049+0000","last_peered":"2023-12-17T11:48:22.505049+0000","last_clean":"2023-12-17T11:48:22.505049+0000","last_became_active":"2023-12-17T11:48:17.234640+0000","last_became_peered":"2023-12-17T11:48:17.234640+0000","last_unstale":"2023-12-17T11:48:22.505049+0000","last_undegraded":"2023-12-17T11:48:22.505049+0000","last_fullsized":"2023-12-17T11:48:22.505049+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:16.193911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:16.193911+0000","last_clean_scrub_stamp":"2023-12-17T11:48:16.193911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T19:54:11.544716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-17T11:48:24.570107+0000","last_change":"2023-12-17T11:48:22.535731+0000","last_active":"2023-12-17T11:48:24.570107+0000","last_peered":"2023-12-17T11:48:24.570107+0000","last_clean":"2023-12-17T11:48:24.570107+0000","last_became_active":"2023-12-17T11:48:22.529961+0000","last_became_peered":"2023-12-17T11:48:22.529961+0000","last_unstale":"2023-12-17T11:48:24.570107+0000","last_undegraded":"2023-12-17T11:48:24.570107+0000","last_fullsized":"2023-12-17T11:48:24.570107+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:21.473989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:21.473989+0000","last_clean_scrub_stamp":"2023-12-17T11:48:21.473989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T19:37:16.747727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-17T11:48:22.518013+0000","last_change":"2023-12-17T11:48:18.266746+0000","last_active":"2023-12-17T11:48:22.518013+0000","last_peered":"2023-12-17T11:48:22.518013+0000","last_clean":"2023-12-17T11:48:22.518013+0000","last_became_active":"2023-12-17T11:48:18.266331+0000","last_became_peered":"2023-12-17T11:48:18.266331+0000","last_unstale":"2023-12-17T11:48:22.518013+0000","last_undegraded":"2023-12-17T11:48:22.518013+0000","last_fullsized":"2023-12-17T11:48:22.518013+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_clean_scrub_stamp":"2023-12-17T11:48:17.199970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T19:10:10.197776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-17T11:48:22.537457+0000","last_change":"2023-12-17T11:48:17.253489+0000","last_active":"2023-12-17T11:48:22.537457+0000","last_peered":"2023-12-17T11:48:22.537457+0000","last_clean":"2023-12-17T11:48:22.537457+0000","last_became_active":"2023-12-17T11:48:17.253243+0000","last_became_peered":"2023-12-17T11:48:17.253243+0000","last_unstale":"2023-12-17T11:48:22.537457+0000","last_undegraded":"2023-12-17T11:48:22.537457+0000","last_fullsized":"2023-12-17T11:48:22.537457+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:16.193911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:16.193911+0000","last_clean_scrub_stamp":"2023-12-17T11:48:16.193911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T22:05:53.158992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-17T11:48:24.564814+0000","last_change":"2023-12-17T11:48:22.543885+0000","last_active":"2023-12-17T11:48:24.564814+0000","last_peered":"2023-12-17T11:48:24.564814+0000","last_clean":"2023-12-17T11:48:24.564814+0000","last_became_active":"2023-12-17T11:48:22.543458+0000","last_became_peered":"2023-12-17T11:48:22.543458+0000","last_unstale":"2023-12-17T11:48:24.564814+0000","last_undegraded":"2023-12-17T11:48:24.564814+0000","last_fullsized":"2023-12-17T11:48:24.564814+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:21.473989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:21.473989+0000","last_clean_scrub_stamp":"2023-12-17T11:48:21.473989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T21:28:14.069617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-17T11:48:22.497613+0000","last_change":"2023-12-17T11:48:18.286605+0000","last_active":"2023-12-17T11:48:22.497613+0000","last_peered":"2023-12-17T11:48:22.497613+0000","last_clean":"2023-12-17T11:48:22.497613+0000","last_became_active":"2023-12-17T11:48:18.286391+0000","last_became_peered":"2023-12-17T11:48:18.286391+0000","last_unstale":"2023-12-17T11:48:22.497613+0000","last_undegraded":"2023-12-17T11:48:22.497613+0000","last_fullsized":"2023-12-17T11:48:22.497613+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_clean_scrub_stamp":"2023-12-17T11:48:17.199970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T19:40:13.516541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-17T11:48:22.522726+0000","last_change":"2023-12-17T11:48:17.250745+0000","last_active":"2023-12-17T11:48:22.522726+0000","last_peered":"2023-12-17T11:48:22.522726+0000","last_clean":"2023-12-17T11:48:22.522726+0000","last_became_active":"2023-12-17T11:48:17.250462+0000","last_became_peered":"2023-12-17T11:48:17.250462+0000","last_unstale":"2023-12-17T11:48:22.522726+0000","last_undegraded":"2023-12-17T11:48:22.522726+0000","last_fullsized":"2023-12-17T11:48:22.522726+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:16.193911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:16.193911+0000","last_clean_scrub_stamp":"2023-12-17T11:48:16.193911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T19:10:09.191716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":169,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-17T11:48:22.537554+0000","last_change":"2023-12-17T11:48:07.952584+0000","last_active":"2023-12-17T11:48:22.537554+0000","last_peered":"2023-12-17T11:48:22.537554+0000","last_clean":"2023-12-17T11:48:22.537554+0000","last_became_active":"2023-12-17T11:48:07.950361+0000","last_became_peered":"2023-12-17T11:48:07.950361+0000","last_unstale":"2023-12-17T11:48:22.537554+0000","last_undegraded":"2023-12-17T11:48:22.537554+0000","last_fullsized":"2023-12-17T11:48:22.537554+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:06.728199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:06.728199+0000","last_clean_scrub_stamp":"2023-12-17T11:48:06.728199+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T12:47:55.048065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-17T11:48:23.469722+0000","last_change":"2023-12-17T11:48:22.546171+0000","last_active":"2023-12-17T11:48:23.469722+0000","last_peered":"2023-12-17T11:48:23.469722+0000","last_clean":"2023-12-17T11:48:23.469722+0000","last_became_active":"2023-12-17T11:48:22.545741+0000","last_became_peered":"2023-12-17T11:48:22.545741+0000","last_unstale":"2023-12-17T11:48:23.469722+0000","last_undegraded":"2023-12-17T11:48:23.469722+0000","last_fullsized":"2023-12-17T11:48:23.469722+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:21.473989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:21.473989+0000","last_clean_scrub_stamp":"2023-12-17T11:48:21.473989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T14:13:28.976491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-17T11:48:22.537982+0000","last_change":"2023-12-17T11:48:18.295996+0000","last_active":"2023-12-17T11:48:22.537982+0000","last_peered":"2023-12-17T11:48:22.537982+0000","last_clean":"2023-12-17T11:48:22.537982+0000","last_became_active":"2023-12-17T11:48:18.295731+0000","last_became_peered":"2023-12-17T11:48:18.295731+0000","last_unstale":"2023-12-17T11:48:22.537982+0000","last_undegraded":"2023-12-17T11:48:22.537982+0000","last_fullsized":"2023-12-17T11:48:22.537982+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_clean_scrub_stamp":"2023-12-17T11:48:17.199970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T12:06:33.791186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-17T11:48:22.508663+0000","last_change":"2023-12-17T11:48:17.248889+0000","last_active":"2023-12-17T11:48:22.508663+0000","last_peered":"2023-12-17T11:48:22.508663+0000","last_clean":"2023-12-17T11:48:22.508663+0000","last_became_active":"2023-12-17T11:48:17.248340+0000","last_became_peered":"2023-12-17T11:48:17.248340+0000","last_unstale":"2023-12-17T11:48:22.508663+0000","last_undegraded":"2023-12-17T11:48:22.508663+0000","last_fullsized":"2023-12-17T11:48:22.508663+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:16.193911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:16.193911+0000","last_clean_scrub_stamp":"2023-12-17T11:48:16.193911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T15:52:21.914780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-17T11:48:23.468537+0000","last_change":"2023-12-17T11:48:22.550329+0000","last_active":"2023-12-17T11:48:23.468537+0000","last_peered":"2023-12-17T11:48:23.468537+0000","last_clean":"2023-12-17T11:48:23.468537+0000","last_became_active":"2023-12-17T11:48:22.549902+0000","last_became_peered":"2023-12-17T11:48:22.549902+0000","last_unstale":"2023-12-17T11:48:23.468537+0000","last_undegraded":"2023-12-17T11:48:23.468537+0000","last_fullsized":"2023-12-17T11:48:23.468537+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:21.473989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:21.473989+0000","last_clean_scrub_stamp":"2023-12-17T11:48:21.473989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T14:35:42.104042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-17T11:48:22.521889+0000","last_change":"2023-12-17T11:48:18.280528+0000","last_active":"2023-12-17T11:48:22.521889+0000","last_peered":"2023-12-17T11:48:22.521889+0000","last_clean":"2023-12-17T11:48:22.521889+0000","last_became_active":"2023-12-17T11:48:18.279633+0000","last_became_peered":"2023-12-17T11:48:18.279633+0000","last_unstale":"2023-12-17T11:48:22.521889+0000","last_undegraded":"2023-12-17T11:48:22.521889+0000","last_fullsized":"2023-12-17T11:48:22.521889+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_clean_scrub_stamp":"2023-12-17T11:48:17.199970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T21:28:09.795599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-17T11:48:22.532812+0000","last_change":"2023-12-17T11:48:17.247687+0000","last_active":"2023-12-17T11:48:22.532812+0000","last_peered":"2023-12-17T11:48:22.532812+0000","last_clean":"2023-12-17T11:48:22.532812+0000","last_became_active":"2023-12-17T11:48:17.247332+0000","last_became_peered":"2023-12-17T11:48:17.247332+0000","last_unstale":"2023-12-17T11:48:22.532812+0000","last_undegraded":"2023-12-17T11:48:22.532812+0000","last_fullsized":"2023-12-17T11:48:22.532812+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:16.193911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:16.193911+0000","last_clean_scrub_stamp":"2023-12-17T11:48:16.193911+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T14:38:16.218634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-17T11:48:24.566096+0000","last_change":"2023-12-17T11:48:22.529299+0000","last_active":"2023-12-17T11:48:24.566096+0000","last_peered":"2023-12-17T11:48:24.566096+0000","last_clean":"2023-12-17T11:48:24.566096+0000","last_became_active":"2023-12-17T11:48:22.528363+0000","last_became_peered":"2023-12-17T11:48:22.528363+0000","last_unstale":"2023-12-17T11:48:24.566096+0000","last_undegraded":"2023-12-17T11:48:24.566096+0000","last_fullsized":"2023-12-17T11:48:24.566096+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:21.473989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:21.473989+0000","last_clean_scrub_stamp":"2023-12-17T11:48:21.473989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T19:47:39.333206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-17T11:48:22.541528+0000","last_change":"2023-12-17T11:48:18.282746+0000","last_active":"2023-12-17T11:48:22.541528+0000","last_peered":"2023-12-17T11:48:22.541528+0000","last_clean":"2023-12-17T11:48:22.541528+0000","last_became_active":"2023-12-17T11:48:18.282435+0000","last_became_peered":"2023-12-17T11:48:18.282435+0000","last_unstale":"2023-12-17T11:48:22.541528+0000","last_undegraded":"2023-12-17T11:48:22.541528+0000","last_fullsized":"2023-12-17T11:48:22.541528+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_clean_scrub_stamp":"2023-12-17T11:48:17.199970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T17:07:27.804112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-17T11:48:22.504269+0000","last_change":"2023-12-17T11:48:17.236101+0000","last_active":"2023-12-17T11:48:22.504269+0000","last_peered":"2023-12-17T11:48:22.504269+0000","last_clean":"2023-12-17T11:48:22.504269+0000","last_became_active":"2023-12-17T11:48:17.235810+0000","last_became_peered":"2023-12-17T11:48:17.235810+0000","last_unstale":"2023-12-17T11:48:22.504269+0000","last_undegraded":"2023-12-17T11:48:22.504269+0000","last_fullsized":"2023-12-17T11:48:22.504269+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:16.193911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:16.193911+0000","last_clean_scrub_stamp":"2023-12-17T11:48:16.193911+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T17:25:44.412598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-17T11:48:24.533865+0000","last_change":"2023-12-17T11:48:22.543015+0000","last_active":"2023-12-17T11:48:24.533865+0000","last_peered":"2023-12-17T11:48:24.533865+0000","last_clean":"2023-12-17T11:48:24.533865+0000","last_became_active":"2023-12-17T11:48:22.542625+0000","last_became_peered":"2023-12-17T11:48:22.542625+0000","last_unstale":"2023-12-17T11:48:24.533865+0000","last_undegraded":"2023-12-17T11:48:24.533865+0000","last_fullsized":"2023-12-17T11:48:24.533865+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:21.473989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:21.473989+0000","last_clean_scrub_stamp":"2023-12-17T11:48:21.473989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T19:02:34.642001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-17T11:48:22.538912+0000","last_change":"2023-12-17T11:48:18.286716+0000","last_active":"2023-12-17T11:48:22.538912+0000","last_peered":"2023-12-17T11:48:22.538912+0000","last_clean":"2023-12-17T11:48:22.538912+0000","last_became_active":"2023-12-17T11:48:18.286399+0000","last_became_peered":"2023-12-17T11:48:18.286399+0000","last_unstale":"2023-12-17T11:48:22.538912+0000","last_undegraded":"2023-12-17T11:48:22.538912+0000","last_fullsized":"2023-12-17T11:48:22.538912+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_clean_scrub_stamp":"2023-12-17T11:48:17.199970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T15:49:17.071958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-17T11:48:22.518272+0000","last_change":"2023-12-17T11:48:17.241745+0000","last_active":"2023-12-17T11:48:22.518272+0000","last_peered":"2023-12-17T11:48:22.518272+0000","last_clean":"2023-12-17T11:48:22.518272+0000","last_became_active":"2023-12-17T11:48:17.241424+0000","last_became_peered":"2023-12-17T11:48:17.241424+0000","last_unstale":"2023-12-17T11:48:22.518272+0000","last_undegraded":"2023-12-17T11:48:22.518272+0000","last_fullsized":"2023-12-17T11:48:22.518272+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:16.193911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:16.193911+0000","last_clean_scrub_stamp":"2023-12-17T11:48:16.193911+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T22:07:41.457520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-17T11:48:23.467268+0000","last_change":"2023-12-17T11:48:22.532344+0000","last_active":"2023-12-17T11:48:23.467268+0000","last_peered":"2023-12-17T11:48:23.467268+0000","last_clean":"2023-12-17T11:48:23.467268+0000","last_became_active":"2023-12-17T11:48:22.531938+0000","last_became_peered":"2023-12-17T11:48:22.531938+0000","last_unstale":"2023-12-17T11:48:23.467268+0000","last_undegraded":"2023-12-17T11:48:23.467268+0000","last_fullsized":"2023-12-17T11:48:23.467268+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:21.473989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:21.473989+0000","last_clean_scrub_stamp":"2023-12-17T11:48:21.473989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T16:14:52.997336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-17T11:48:22.537682+0000","last_change":"2023-12-17T11:48:18.283595+0000","last_active":"2023-12-17T11:48:22.537682+0000","last_peered":"2023-12-17T11:48:22.537682+0000","last_clean":"2023-12-17T11:48:22.537682+0000","last_became_active":"2023-12-17T11:48:18.283279+0000","last_became_peered":"2023-12-17T11:48:18.283279+0000","last_unstale":"2023-12-17T11:48:22.537682+0000","last_undegraded":"2023-12-17T11:48:22.537682+0000","last_fullsized":"2023-12-17T11:48:22.537682+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_clean_scrub_stamp":"2023-12-17T11:48:17.199970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T15:36:16.504476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-17T11:48:22.505421+0000","last_change":"2023-12-17T11:48:17.240169+0000","last_active":"2023-12-17T11:48:22.505421+0000","last_peered":"2023-12-17T11:48:22.505421+0000","last_clean":"2023-12-17T11:48:22.505421+0000","last_became_active":"2023-12-17T11:48:17.239871+0000","last_became_peered":"2023-12-17T11:48:17.239871+0000","last_unstale":"2023-12-17T11:48:22.505421+0000","last_undegraded":"2023-12-17T11:48:22.505421+0000","last_fullsized":"2023-12-17T11:48:22.505421+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:16.193911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:16.193911+0000","last_clean_scrub_stamp":"2023-12-17T11:48:16.193911+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T22:07:41.457520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-17T11:48:24.564852+0000","last_change":"2023-12-17T11:48:22.525953+0000","last_active":"2023-12-17T11:48:24.564852+0000","last_peered":"2023-12-17T11:48:24.564852+0000","last_clean":"2023-12-17T11:48:24.564852+0000","last_became_active":"2023-12-17T11:48:22.525562+0000","last_became_peered":"2023-12-17T11:48:22.525562+0000","last_unstale":"2023-12-17T11:48:24.564852+0000","last_undegraded":"2023-12-17T11:48:24.564852+0000","last_fullsized":"2023-12-17T11:48:24.564852+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:21.473989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:21.473989+0000","last_clean_scrub_stamp":"2023-12-17T11:48:21.473989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T19:37:16.747727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-17T11:48:22.528552+0000","last_change":"2023-12-17T11:48:18.266704+0000","last_active":"2023-12-17T11:48:22.528552+0000","last_peered":"2023-12-17T11:48:22.528552+0000","last_clean":"2023-12-17T11:48:22.528552+0000","last_became_active":"2023-12-17T11:48:18.266160+0000","last_became_peered":"2023-12-17T11:48:18.266160+0000","last_unstale":"2023-12-17T11:48:22.528552+0000","last_undegraded":"2023-12-17T11:48:22.528552+0000","last_fullsized":"2023-12-17T11:48:22.528552+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_clean_scrub_stamp":"2023-12-17T11:48:17.199970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T12:09:17.721558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-17T11:48:22.529180+0000","last_change":"2023-12-17T11:48:17.246492+0000","last_active":"2023-12-17T11:48:22.529180+0000","last_peered":"2023-12-17T11:48:22.529180+0000","last_clean":"2023-12-17T11:48:22.529180+0000","last_became_active":"2023-12-17T11:48:17.243482+0000","last_became_peered":"2023-12-17T11:48:17.243482+0000","last_unstale":"2023-12-17T11:48:22.529180+0000","last_undegraded":"2023-12-17T11:48:22.529180+0000","last_fullsized":"2023-12-17T11:48:22.529180+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:16.193911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:16.193911+0000","last_clean_scrub_stamp":"2023-12-17T11:48:16.193911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T23:35:00.926850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-17T11:48:24.566395+0000","last_change":"2023-12-17T11:48:22.533474+0000","last_active":"2023-12-17T11:48:24.566395+0000","last_peered":"2023-12-17T11:48:24.566395+0000","last_clean":"2023-12-17T11:48:24.566395+0000","last_became_active":"2023-12-17T11:48:22.533035+0000","last_became_peered":"2023-12-17T11:48:22.533035+0000","last_unstale":"2023-12-17T11:48:24.566395+0000","last_undegraded":"2023-12-17T11:48:24.566395+0000","last_fullsized":"2023-12-17T11:48:24.566395+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:21.473989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:21.473989+0000","last_clean_scrub_stamp":"2023-12-17T11:48:21.473989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T19:55:52.117357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-17T11:48:22.538223+0000","last_change":"2023-12-17T11:48:18.282530+0000","last_active":"2023-12-17T11:48:22.538223+0000","last_peered":"2023-12-17T11:48:22.538223+0000","last_clean":"2023-12-17T11:48:22.538223+0000","last_became_active":"2023-12-17T11:48:18.282201+0000","last_became_peered":"2023-12-17T11:48:18.282201+0000","last_unstale":"2023-12-17T11:48:22.538223+0000","last_undegraded":"2023-12-17T11:48:22.538223+0000","last_fullsized":"2023-12-17T11:48:22.538223+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_clean_scrub_stamp":"2023-12-17T11:48:17.199970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T13:22:09.491732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-17T11:48:22.519788+0000","last_change":"2023-12-17T11:48:17.255597+0000","last_active":"2023-12-17T11:48:22.519788+0000","last_peered":"2023-12-17T11:48:22.519788+0000","last_clean":"2023-12-17T11:48:22.519788+0000","last_became_active":"2023-12-17T11:48:17.255278+0000","last_became_peered":"2023-12-17T11:48:17.255278+0000","last_unstale":"2023-12-17T11:48:22.519788+0000","last_undegraded":"2023-12-17T11:48:22.519788+0000","last_fullsized":"2023-12-17T11:48:22.519788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:16.193911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:16.193911+0000","last_clean_scrub_stamp":"2023-12-17T11:48:16.193911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T19:01:45.429452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-17T11:48:24.565975+0000","last_change":"2023-12-17T11:48:22.547206+0000","last_active":"2023-12-17T11:48:24.565975+0000","last_peered":"2023-12-17T11:48:24.565975+0000","last_clean":"2023-12-17T11:48:24.565975+0000","last_became_active":"2023-12-17T11:48:22.539605+0000","last_became_peered":"2023-12-17T11:48:22.539605+0000","last_unstale":"2023-12-17T11:48:24.565975+0000","last_undegraded":"2023-12-17T11:48:24.565975+0000","last_fullsized":"2023-12-17T11:48:24.565975+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:21.473989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:21.473989+0000","last_clean_scrub_stamp":"2023-12-17T11:48:21.473989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T16:15:07.576617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-17T11:48:22.509553+0000","last_change":"2023-12-17T11:48:18.266780+0000","last_active":"2023-12-17T11:48:22.509553+0000","last_peered":"2023-12-17T11:48:22.509553+0000","last_clean":"2023-12-17T11:48:22.509553+0000","last_became_active":"2023-12-17T11:48:18.266437+0000","last_became_peered":"2023-12-17T11:48:18.266437+0000","last_unstale":"2023-12-17T11:48:22.509553+0000","last_undegraded":"2023-12-17T11:48:22.509553+0000","last_fullsized":"2023-12-17T11:48:22.509553+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_clean_scrub_stamp":"2023-12-17T11:48:17.199970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T15:10:04.983689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-17T11:48:22.517086+0000","last_change":"2023-12-17T11:48:17.237336+0000","last_active":"2023-12-17T11:48:22.517086+0000","last_peered":"2023-12-17T11:48:22.517086+0000","last_clean":"2023-12-17T11:48:22.517086+0000","last_became_active":"2023-12-17T11:48:17.237079+0000","last_became_peered":"2023-12-17T11:48:17.237079+0000","last_unstale":"2023-12-17T11:48:22.517086+0000","last_undegraded":"2023-12-17T11:48:22.517086+0000","last_fullsized":"2023-12-17T11:48:22.517086+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:16.193911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:16.193911+0000","last_clean_scrub_stamp":"2023-12-17T11:48:16.193911+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T23:05:26.944558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-17T11:48:24.534842+0000","last_change":"2023-12-17T11:48:22.531210+0000","last_active":"2023-12-17T11:48:24.534842+0000","last_peered":"2023-12-17T11:48:24.534842+0000","last_clean":"2023-12-17T11:48:24.534842+0000","last_became_active":"2023-12-17T11:48:22.530786+0000","last_became_peered":"2023-12-17T11:48:22.530786+0000","last_unstale":"2023-12-17T11:48:24.534842+0000","last_undegraded":"2023-12-17T11:48:24.534842+0000","last_fullsized":"2023-12-17T11:48:24.534842+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:21.473989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:21.473989+0000","last_clean_scrub_stamp":"2023-12-17T11:48:21.473989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T23:05:37.198518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-17T11:48:22.537940+0000","last_change":"2023-12-17T11:48:18.271847+0000","last_active":"2023-12-17T11:48:22.537940+0000","last_peered":"2023-12-17T11:48:22.537940+0000","last_clean":"2023-12-17T11:48:22.537940+0000","last_became_active":"2023-12-17T11:48:18.271609+0000","last_became_peered":"2023-12-17T11:48:18.271609+0000","last_unstale":"2023-12-17T11:48:22.537940+0000","last_undegraded":"2023-12-17T11:48:22.537940+0000","last_fullsized":"2023-12-17T11:48:22.537940+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_clean_scrub_stamp":"2023-12-17T11:48:17.199970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T14:01:37.582731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"25'10","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-17T11:48:37.784983+0000","last_change":"2023-12-17T11:48:17.241228+0000","last_active":"2023-12-17T11:48:37.784983+0000","last_peered":"2023-12-17T11:48:37.784983+0000","last_clean":"2023-12-17T11:48:37.784983+0000","last_became_active":"2023-12-17T11:48:17.240813+0000","last_became_peered":"2023-12-17T11:48:17.240813+0000","last_unstale":"2023-12-17T11:48:37.784983+0000","last_undegraded":"2023-12-17T11:48:37.784983+0000","last_fullsized":"2023-12-17T11:48:37.784983+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:16.193911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:16.193911+0000","last_clean_scrub_stamp":"2023-12-17T11:48:16.193911+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T21:33:08.409177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3840,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-17T11:48:24.568565+0000","last_change":"2023-12-17T11:48:22.541559+0000","last_active":"2023-12-17T11:48:24.568565+0000","last_peered":"2023-12-17T11:48:24.568565+0000","last_clean":"2023-12-17T11:48:24.568565+0000","last_became_active":"2023-12-17T11:48:22.537020+0000","last_became_peered":"2023-12-17T11:48:22.537020+0000","last_unstale":"2023-12-17T11:48:24.568565+0000","last_undegraded":"2023-12-17T11:48:24.568565+0000","last_fullsized":"2023-12-17T11:48:24.568565+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:21.473989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:21.473989+0000","last_clean_scrub_stamp":"2023-12-17T11:48:21.473989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T13:18:42.303550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-17T11:48:22.519017+0000","last_change":"2023-12-17T11:48:18.275481+0000","last_active":"2023-12-17T11:48:22.519017+0000","last_peered":"2023-12-17T11:48:22.519017+0000","last_clean":"2023-12-17T11:48:22.519017+0000","last_became_active":"2023-12-17T11:48:18.273155+0000","last_became_peered":"2023-12-17T11:48:18.273155+0000","last_unstale":"2023-12-17T11:48:22.519017+0000","last_undegraded":"2023-12-17T11:48:22.519017+0000","last_fullsized":"2023-12-17T11:48:22.519017+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_clean_scrub_stamp":"2023-12-17T11:48:17.199970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T12:41:34.675326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-17T11:48:22.530443+0000","last_change":"2023-12-17T11:48:17.255083+0000","last_active":"2023-12-17T11:48:22.530443+0000","last_peered":"2023-12-17T11:48:22.530443+0000","last_clean":"2023-12-17T11:48:22.530443+0000","last_became_active":"2023-12-17T11:48:17.254631+0000","last_became_peered":"2023-12-17T11:48:17.254631+0000","last_unstale":"2023-12-17T11:48:22.530443+0000","last_undegraded":"2023-12-17T11:48:22.530443+0000","last_fullsized":"2023-12-17T11:48:22.530443+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:16.193911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:16.193911+0000","last_clean_scrub_stamp":"2023-12-17T11:48:16.193911+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T23:05:26.944558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-17T11:48:23.468594+0000","last_change":"2023-12-17T11:48:22.532773+0000","last_active":"2023-12-17T11:48:23.468594+0000","last_peered":"2023-12-17T11:48:23.468594+0000","last_clean":"2023-12-17T11:48:23.468594+0000","last_became_active":"2023-12-17T11:48:22.531998+0000","last_became_peered":"2023-12-17T11:48:22.531998+0000","last_unstale":"2023-12-17T11:48:23.468594+0000","last_undegraded":"2023-12-17T11:48:23.468594+0000","last_fullsized":"2023-12-17T11:48:23.468594+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:21.473989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:21.473989+0000","last_clean_scrub_stamp":"2023-12-17T11:48:21.473989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T14:13:28.976491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-17T11:48:22.517736+0000","last_change":"2023-12-17T11:48:18.283970+0000","last_active":"2023-12-17T11:48:22.517736+0000","last_peered":"2023-12-17T11:48:22.517736+0000","last_clean":"2023-12-17T11:48:22.517736+0000","last_became_active":"2023-12-17T11:48:18.282081+0000","last_became_peered":"2023-12-17T11:48:18.282081+0000","last_unstale":"2023-12-17T11:48:22.517736+0000","last_undegraded":"2023-12-17T11:48:22.517736+0000","last_fullsized":"2023-12-17T11:48:22.517736+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_clean_scrub_stamp":"2023-12-17T11:48:17.199970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T22:33:29.994957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-17T11:48:22.524090+0000","last_change":"2023-12-17T11:48:17.251813+0000","last_active":"2023-12-17T11:48:22.524090+0000","last_peered":"2023-12-17T11:48:22.524090+0000","last_clean":"2023-12-17T11:48:22.524090+0000","last_became_active":"2023-12-17T11:48:17.251383+0000","last_became_peered":"2023-12-17T11:48:17.251383+0000","last_unstale":"2023-12-17T11:48:22.524090+0000","last_undegraded":"2023-12-17T11:48:22.524090+0000","last_fullsized":"2023-12-17T11:48:22.524090+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:16.193911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:16.193911+0000","last_clean_scrub_stamp":"2023-12-17T11:48:16.193911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T20:47:09.518146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-17T11:48:24.563175+0000","last_change":"2023-12-17T11:48:22.532023+0000","last_active":"2023-12-17T11:48:24.563175+0000","last_peered":"2023-12-17T11:48:24.563175+0000","last_clean":"2023-12-17T11:48:24.563175+0000","last_became_active":"2023-12-17T11:48:22.531600+0000","last_became_peered":"2023-12-17T11:48:22.531600+0000","last_unstale":"2023-12-17T11:48:24.563175+0000","last_undegraded":"2023-12-17T11:48:24.563175+0000","last_fullsized":"2023-12-17T11:48:24.563175+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:21.473989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:21.473989+0000","last_clean_scrub_stamp":"2023-12-17T11:48:21.473989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T11:48:26.447870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-17T11:48:22.524000+0000","last_change":"2023-12-17T11:48:18.284906+0000","last_active":"2023-12-17T11:48:22.524000+0000","last_peered":"2023-12-17T11:48:22.524000+0000","last_clean":"2023-12-17T11:48:22.524000+0000","last_became_active":"2023-12-17T11:48:18.280252+0000","last_became_peered":"2023-12-17T11:48:18.280252+0000","last_unstale":"2023-12-17T11:48:22.524000+0000","last_undegraded":"2023-12-17T11:48:22.524000+0000","last_fullsized":"2023-12-17T11:48:22.524000+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_clean_scrub_stamp":"2023-12-17T11:48:17.199970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T14:35:37.830024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-17T11:48:22.531506+0000","last_change":"2023-12-17T11:48:17.256841+0000","last_active":"2023-12-17T11:48:22.531506+0000","last_peered":"2023-12-17T11:48:22.531506+0000","last_clean":"2023-12-17T11:48:22.531506+0000","last_became_active":"2023-12-17T11:48:17.256528+0000","last_became_peered":"2023-12-17T11:48:17.256528+0000","last_unstale":"2023-12-17T11:48:22.531506+0000","last_undegraded":"2023-12-17T11:48:22.531506+0000","last_fullsized":"2023-12-17T11:48:22.531506+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:16.193911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:16.193911+0000","last_clean_scrub_stamp":"2023-12-17T11:48:16.193911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T23:05:26.944558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-17T11:48:24.564180+0000","last_change":"2023-12-17T11:48:22.536175+0000","last_active":"2023-12-17T11:48:24.564180+0000","last_peered":"2023-12-17T11:48:24.564180+0000","last_clean":"2023-12-17T11:48:24.564180+0000","last_became_active":"2023-12-17T11:48:22.535544+0000","last_became_peered":"2023-12-17T11:48:22.535544+0000","last_unstale":"2023-12-17T11:48:24.564180+0000","last_undegraded":"2023-12-17T11:48:24.564180+0000","last_fullsized":"2023-12-17T11:48:24.564180+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:21.473989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:21.473989+0000","last_clean_scrub_stamp":"2023-12-17T11:48:21.473989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T19:02:34.642001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-17T11:48:24.564459+0000","last_change":"2023-12-17T11:48:22.543719+0000","last_active":"2023-12-17T11:48:24.564459+0000","last_peered":"2023-12-17T11:48:24.564459+0000","last_clean":"2023-12-17T11:48:24.564459+0000","last_became_active":"2023-12-17T11:48:22.543315+0000","last_became_peered":"2023-12-17T11:48:22.543315+0000","last_unstale":"2023-12-17T11:48:24.564459+0000","last_undegraded":"2023-12-17T11:48:24.564459+0000","last_fullsized":"2023-12-17T11:48:24.564459+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:21.473989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:21.473989+0000","last_clean_scrub_stamp":"2023-12-17T11:48:21.473989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T14:46:35.413635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-17T11:48:22.525084+0000","last_change":"2023-12-17T11:48:18.273197+0000","last_active":"2023-12-17T11:48:22.525084+0000","last_peered":"2023-12-17T11:48:22.525084+0000","last_clean":"2023-12-17T11:48:22.525084+0000","last_became_active":"2023-12-17T11:48:18.272904+0000","last_became_peered":"2023-12-17T11:48:18.272904+0000","last_unstale":"2023-12-17T11:48:22.525084+0000","last_undegraded":"2023-12-17T11:48:22.525084+0000","last_fullsized":"2023-12-17T11:48:22.525084+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_clean_scrub_stamp":"2023-12-17T11:48:17.199970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T19:01:46.435511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-17T11:48:22.515616+0000","last_change":"2023-12-17T11:48:17.254838+0000","last_active":"2023-12-17T11:48:22.515616+0000","last_peered":"2023-12-17T11:48:22.515616+0000","last_clean":"2023-12-17T11:48:22.515616+0000","last_became_active":"2023-12-17T11:48:17.254549+0000","last_became_peered":"2023-12-17T11:48:17.254549+0000","last_unstale":"2023-12-17T11:48:22.515616+0000","last_undegraded":"2023-12-17T11:48:22.515616+0000","last_fullsized":"2023-12-17T11:48:22.515616+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:16.193911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:16.193911+0000","last_clean_scrub_stamp":"2023-12-17T11:48:16.193911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T15:10:03.977630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-17T11:48:23.467487+0000","last_change":"2023-12-17T11:48:22.544106+0000","last_active":"2023-12-17T11:48:23.467487+0000","last_peered":"2023-12-17T11:48:23.467487+0000","last_clean":"2023-12-17T11:48:23.467487+0000","last_became_active":"2023-12-17T11:48:22.543121+0000","last_became_peered":"2023-12-17T11:48:22.543121+0000","last_unstale":"2023-12-17T11:48:23.467487+0000","last_undegraded":"2023-12-17T11:48:23.467487+0000","last_fullsized":"2023-12-17T11:48:23.467487+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:21.473989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:21.473989+0000","last_clean_scrub_stamp":"2023-12-17T11:48:21.473989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T14:39:15.707189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-17T11:48:22.498074+0000","last_change":"2023-12-17T11:48:18.273173+0000","last_active":"2023-12-17T11:48:22.498074+0000","last_peered":"2023-12-17T11:48:22.498074+0000","last_clean":"2023-12-17T11:48:22.498074+0000","last_became_active":"2023-12-17T11:48:18.272646+0000","last_became_peered":"2023-12-17T11:48:18.272646+0000","last_unstale":"2023-12-17T11:48:22.498074+0000","last_undegraded":"2023-12-17T11:48:22.498074+0000","last_fullsized":"2023-12-17T11:48:22.498074+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_clean_scrub_stamp":"2023-12-17T11:48:17.199970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T12:59:53.414167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-17T11:48:22.498535+0000","last_change":"2023-12-17T11:48:17.242171+0000","last_active":"2023-12-17T11:48:22.498535+0000","last_peered":"2023-12-17T11:48:22.498535+0000","last_clean":"2023-12-17T11:48:22.498535+0000","last_became_active":"2023-12-17T11:48:17.241764+0000","last_became_peered":"2023-12-17T11:48:17.241764+0000","last_unstale":"2023-12-17T11:48:22.498535+0000","last_undegraded":"2023-12-17T11:48:22.498535+0000","last_fullsized":"2023-12-17T11:48:22.498535+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:16.193911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:16.193911+0000","last_clean_scrub_stamp":"2023-12-17T11:48:16.193911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T14:38:16.218634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-17T11:48:22.528584+0000","last_change":"2023-12-17T11:48:17.242535+0000","last_active":"2023-12-17T11:48:22.528584+0000","last_peered":"2023-12-17T11:48:22.528584+0000","last_clean":"2023-12-17T11:48:22.528584+0000","last_became_active":"2023-12-17T11:48:17.242250+0000","last_became_peered":"2023-12-17T11:48:17.242250+0000","last_unstale":"2023-12-17T11:48:22.528584+0000","last_undegraded":"2023-12-17T11:48:22.528584+0000","last_fullsized":"2023-12-17T11:48:22.528584+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:16.193911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:16.193911+0000","last_clean_scrub_stamp":"2023-12-17T11:48:16.193911+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T15:52:21.914780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-17T11:48:22.513125+0000","last_change":"2023-12-17T11:48:18.264311+0000","last_active":"2023-12-17T11:48:22.513125+0000","last_peered":"2023-12-17T11:48:22.513125+0000","last_clean":"2023-12-17T11:48:22.513125+0000","last_became_active":"2023-12-17T11:48:18.263005+0000","last_became_peered":"2023-12-17T11:48:18.263005+0000","last_unstale":"2023-12-17T11:48:22.513125+0000","last_undegraded":"2023-12-17T11:48:22.513125+0000","last_fullsized":"2023-12-17T11:48:22.513125+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_clean_scrub_stamp":"2023-12-17T11:48:17.199970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T20:47:10.524205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-17T11:48:23.465100+0000","last_change":"2023-12-17T11:48:22.536488+0000","last_active":"2023-12-17T11:48:23.465100+0000","last_peered":"2023-12-17T11:48:23.465100+0000","last_clean":"2023-12-17T11:48:23.465100+0000","last_became_active":"2023-12-17T11:48:22.536091+0000","last_became_peered":"2023-12-17T11:48:22.536091+0000","last_unstale":"2023-12-17T11:48:23.465100+0000","last_undegraded":"2023-12-17T11:48:23.465100+0000","last_fullsized":"2023-12-17T11:48:23.465100+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:21.473989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:21.473989+0000","last_clean_scrub_stamp":"2023-12-17T11:48:21.473989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T19:10:14.471794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-17T11:48:22.499106+0000","last_change":"2023-12-17T11:48:17.241269+0000","last_active":"2023-12-17T11:48:22.499106+0000","last_peered":"2023-12-17T11:48:22.499106+0000","last_clean":"2023-12-17T11:48:22.499106+0000","last_became_active":"2023-12-17T11:48:17.240984+0000","last_became_peered":"2023-12-17T11:48:17.240984+0000","last_unstale":"2023-12-17T11:48:22.499106+0000","last_undegraded":"2023-12-17T11:48:22.499106+0000","last_fullsized":"2023-12-17T11:48:22.499106+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:16.193911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:16.193911+0000","last_clean_scrub_stamp":"2023-12-17T11:48:16.193911+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T21:33:08.409177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-17T11:48:22.514122+0000","last_change":"2023-12-17T11:48:18.269242+0000","last_active":"2023-12-17T11:48:22.514122+0000","last_peered":"2023-12-17T11:48:22.514122+0000","last_clean":"2023-12-17T11:48:22.514122+0000","last_became_active":"2023-12-17T11:48:18.262805+0000","last_became_peered":"2023-12-17T11:48:18.262805+0000","last_unstale":"2023-12-17T11:48:22.514122+0000","last_undegraded":"2023-12-17T11:48:22.514122+0000","last_fullsized":"2023-12-17T11:48:22.514122+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_clean_scrub_stamp":"2023-12-17T11:48:17.199970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T17:25:45.418657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-17T11:48:24.565907+0000","last_change":"2023-12-17T11:48:22.528378+0000","last_active":"2023-12-17T11:48:24.565907+0000","last_peered":"2023-12-17T11:48:24.565907+0000","last_clean":"2023-12-17T11:48:24.565907+0000","last_became_active":"2023-12-17T11:48:22.527917+0000","last_became_peered":"2023-12-17T11:48:22.527917+0000","last_unstale":"2023-12-17T11:48:24.565907+0000","last_undegraded":"2023-12-17T11:48:24.565907+0000","last_fullsized":"2023-12-17T11:48:24.565907+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:21.473989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:21.473989+0000","last_clean_scrub_stamp":"2023-12-17T11:48:21.473989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T23:05:37.198518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-17T11:48:22.528435+0000","last_change":"2023-12-17T11:48:18.266478+0000","last_active":"2023-12-17T11:48:22.528435+0000","last_peered":"2023-12-17T11:48:22.528435+0000","last_clean":"2023-12-17T11:48:22.528435+0000","last_became_active":"2023-12-17T11:48:18.265774+0000","last_became_peered":"2023-12-17T11:48:18.265774+0000","last_unstale":"2023-12-17T11:48:22.528435+0000","last_undegraded":"2023-12-17T11:48:22.528435+0000","last_fullsized":"2023-12-17T11:48:22.528435+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_clean_scrub_stamp":"2023-12-17T11:48:17.199970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T15:10:04.983689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-17T11:48:22.504939+0000","last_change":"2023-12-17T11:48:18.282141+0000","last_active":"2023-12-17T11:48:22.504939+0000","last_peered":"2023-12-17T11:48:22.504939+0000","last_clean":"2023-12-17T11:48:22.504939+0000","last_became_active":"2023-12-17T11:48:18.281103+0000","last_became_peered":"2023-12-17T11:48:18.281103+0000","last_unstale":"2023-12-17T11:48:22.504939+0000","last_undegraded":"2023-12-17T11:48:22.504939+0000","last_fullsized":"2023-12-17T11:48:22.504939+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_clean_scrub_stamp":"2023-12-17T11:48:17.199970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T14:38:17.224694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-17T11:48:22.519670+0000","last_change":"2023-12-17T11:48:18.280946+0000","last_active":"2023-12-17T11:48:22.519670+0000","last_peered":"2023-12-17T11:48:22.519670+0000","last_clean":"2023-12-17T11:48:22.519670+0000","last_became_active":"2023-12-17T11:48:18.280193+0000","last_became_peered":"2023-12-17T11:48:18.280193+0000","last_unstale":"2023-12-17T11:48:22.519670+0000","last_undegraded":"2023-12-17T11:48:22.519670+0000","last_fullsized":"2023-12-17T11:48:22.519670+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_clean_scrub_stamp":"2023-12-17T11:48:17.199970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T14:39:11.433170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-17T11:48:22.512528+0000","last_change":"2023-12-17T11:48:18.271322+0000","last_active":"2023-12-17T11:48:22.512528+0000","last_peered":"2023-12-17T11:48:22.512528+0000","last_clean":"2023-12-17T11:48:22.512528+0000","last_became_active":"2023-12-17T11:48:18.271029+0000","last_became_peered":"2023-12-17T11:48:18.271029+0000","last_unstale":"2023-12-17T11:48:22.512528+0000","last_undegraded":"2023-12-17T11:48:22.512528+0000","last_fullsized":"2023-12-17T11:48:22.512528+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_clean_scrub_stamp":"2023-12-17T11:48:17.199970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T23:46:39.140775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-17T11:48:22.499687+0000","last_change":"2023-12-17T11:48:18.280759+0000","last_active":"2023-12-17T11:48:22.499687+0000","last_peered":"2023-12-17T11:48:22.499687+0000","last_clean":"2023-12-17T11:48:22.499687+0000","last_became_active":"2023-12-17T11:48:18.279419+0000","last_became_peered":"2023-12-17T11:48:18.279419+0000","last_unstale":"2023-12-17T11:48:22.499687+0000","last_undegraded":"2023-12-17T11:48:22.499687+0000","last_fullsized":"2023-12-17T11:48:22.499687+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_clean_scrub_stamp":"2023-12-17T11:48:17.199970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T14:35:37.830024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-17T11:48:22.529945+0000","last_change":"2023-12-17T11:48:18.275948+0000","last_active":"2023-12-17T11:48:22.529945+0000","last_peered":"2023-12-17T11:48:22.529945+0000","last_clean":"2023-12-17T11:48:22.529945+0000","last_became_active":"2023-12-17T11:48:18.275186+0000","last_became_peered":"2023-12-17T11:48:18.275186+0000","last_unstale":"2023-12-17T11:48:22.529945+0000","last_undegraded":"2023-12-17T11:48:22.529945+0000","last_fullsized":"2023-12-17T11:48:22.529945+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_clean_scrub_stamp":"2023-12-17T11:48:17.199970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T20:47:10.524205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-17T11:48:22.528941+0000","last_change":"2023-12-17T11:48:18.266168+0000","last_active":"2023-12-17T11:48:22.528941+0000","last_peered":"2023-12-17T11:48:22.528941+0000","last_clean":"2023-12-17T11:48:22.528941+0000","last_became_active":"2023-12-17T11:48:18.265873+0000","last_became_peered":"2023-12-17T11:48:18.265873+0000","last_unstale":"2023-12-17T11:48:22.528941+0000","last_undegraded":"2023-12-17T11:48:22.528941+0000","last_fullsized":"2023-12-17T11:48:22.528941+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_clean_scrub_stamp":"2023-12-17T11:48:17.199970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T19:40:13.516541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-17T11:48:22.502538+0000","last_change":"2023-12-17T11:48:18.276992+0000","last_active":"2023-12-17T11:48:22.502538+0000","last_peered":"2023-12-17T11:48:22.502538+0000","last_clean":"2023-12-17T11:48:22.502538+0000","last_became_active":"2023-12-17T11:48:18.276731+0000","last_became_peered":"2023-12-17T11:48:18.276731+0000","last_unstale":"2023-12-17T11:48:22.502538+0000","last_undegraded":"2023-12-17T11:48:22.502538+0000","last_fullsized":"2023-12-17T11:48:22.502538+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_clean_scrub_stamp":"2023-12-17T11:48:17.199970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T20:53:58.226339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-17T11:48:22.515412+0000","last_change":"2023-12-17T11:48:18.282302+0000","last_active":"2023-12-17T11:48:22.515412+0000","last_peered":"2023-12-17T11:48:22.515412+0000","last_clean":"2023-12-17T11:48:22.515412+0000","last_became_active":"2023-12-17T11:48:18.282033+0000","last_became_peered":"2023-12-17T11:48:18.282033+0000","last_unstale":"2023-12-17T11:48:22.515412+0000","last_undegraded":"2023-12-17T11:48:22.515412+0000","last_fullsized":"2023-12-17T11:48:22.515412+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_clean_scrub_stamp":"2023-12-17T11:48:17.199970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T19:19:50.098252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-17T11:48:22.498331+0000","last_change":"2023-12-17T11:48:18.278722+0000","last_active":"2023-12-17T11:48:22.498331+0000","last_peered":"2023-12-17T11:48:22.498331+0000","last_clean":"2023-12-17T11:48:22.498331+0000","last_became_active":"2023-12-17T11:48:18.278416+0000","last_became_peered":"2023-12-17T11:48:18.278416+0000","last_unstale":"2023-12-17T11:48:22.498331+0000","last_undegraded":"2023-12-17T11:48:22.498331+0000","last_fullsized":"2023-12-17T11:48:22.498331+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_clean_scrub_stamp":"2023-12-17T11:48:17.199970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T12:09:17.721558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-17T11:48:22.523002+0000","last_change":"2023-12-17T11:48:18.280465+0000","last_active":"2023-12-17T11:48:22.523002+0000","last_peered":"2023-12-17T11:48:22.523002+0000","last_clean":"2023-12-17T11:48:22.523002+0000","last_became_active":"2023-12-17T11:48:18.279834+0000","last_became_peered":"2023-12-17T11:48:18.279834+0000","last_unstale":"2023-12-17T11:48:22.523002+0000","last_undegraded":"2023-12-17T11:48:22.523002+0000","last_fullsized":"2023-12-17T11:48:22.523002+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_clean_scrub_stamp":"2023-12-17T11:48:17.199970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T20:53:58.226339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-17T11:48:22.512247+0000","last_change":"2023-12-17T11:48:18.265956+0000","last_active":"2023-12-17T11:48:22.512247+0000","last_peered":"2023-12-17T11:48:22.512247+0000","last_clean":"2023-12-17T11:48:22.512247+0000","last_became_active":"2023-12-17T11:48:18.264308+0000","last_became_peered":"2023-12-17T11:48:18.264308+0000","last_unstale":"2023-12-17T11:48:22.512247+0000","last_undegraded":"2023-12-17T11:48:22.512247+0000","last_fullsized":"2023-12-17T11:48:22.512247+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_clean_scrub_stamp":"2023-12-17T11:48:17.199970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T12:09:17.721558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-17T11:48:22.528941+0000","last_change":"2023-12-17T11:48:18.277893+0000","last_active":"2023-12-17T11:48:22.528941+0000","last_peered":"2023-12-17T11:48:22.528941+0000","last_clean":"2023-12-17T11:48:22.528941+0000","last_became_active":"2023-12-17T11:48:18.277557+0000","last_became_peered":"2023-12-17T11:48:18.277557+0000","last_unstale":"2023-12-17T11:48:22.528941+0000","last_undegraded":"2023-12-17T11:48:22.528941+0000","last_fullsized":"2023-12-17T11:48:22.528941+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_clean_scrub_stamp":"2023-12-17T11:48:17.199970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T23:46:39.140775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-17T11:48:22.538075+0000","last_change":"2023-12-17T11:48:18.274779+0000","last_active":"2023-12-17T11:48:22.538075+0000","last_peered":"2023-12-17T11:48:22.538075+0000","last_clean":"2023-12-17T11:48:22.538075+0000","last_became_active":"2023-12-17T11:48:18.274509+0000","last_became_peered":"2023-12-17T11:48:18.274509+0000","last_unstale":"2023-12-17T11:48:22.538075+0000","last_undegraded":"2023-12-17T11:48:22.538075+0000","last_fullsized":"2023-12-17T11:48:22.538075+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_clean_scrub_stamp":"2023-12-17T11:48:17.199970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T22:05:51.790351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-17T11:48:22.504169+0000","last_change":"2023-12-17T11:48:18.266606+0000","last_active":"2023-12-17T11:48:22.504169+0000","last_peered":"2023-12-17T11:48:22.504169+0000","last_clean":"2023-12-17T11:48:22.504169+0000","last_became_active":"2023-12-17T11:48:18.265428+0000","last_became_peered":"2023-12-17T11:48:18.265428+0000","last_unstale":"2023-12-17T11:48:22.504169+0000","last_undegraded":"2023-12-17T11:48:22.504169+0000","last_fullsized":"2023-12-17T11:48:22.504169+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_clean_scrub_stamp":"2023-12-17T11:48:17.199970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T23:05:27.950618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-17T11:48:22.522838+0000","last_change":"2023-12-17T11:48:18.284558+0000","last_active":"2023-12-17T11:48:22.522838+0000","last_peered":"2023-12-17T11:48:22.522838+0000","last_clean":"2023-12-17T11:48:22.522838+0000","last_became_active":"2023-12-17T11:48:18.284223+0000","last_became_peered":"2023-12-17T11:48:18.284223+0000","last_unstale":"2023-12-17T11:48:22.522838+0000","last_undegraded":"2023-12-17T11:48:22.522838+0000","last_fullsized":"2023-12-17T11:48:22.522838+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_clean_scrub_stamp":"2023-12-17T11:48:17.199970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T19:44:16.453002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-17T11:48:22.515217+0000","last_change":"2023-12-17T11:48:18.285584+0000","last_active":"2023-12-17T11:48:22.515217+0000","last_peered":"2023-12-17T11:48:22.515217+0000","last_clean":"2023-12-17T11:48:22.515217+0000","last_became_active":"2023-12-17T11:48:18.285361+0000","last_became_peered":"2023-12-17T11:48:18.285361+0000","last_unstale":"2023-12-17T11:48:22.515217+0000","last_undegraded":"2023-12-17T11:48:22.515217+0000","last_fullsized":"2023-12-17T11:48:22.515217+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_clean_scrub_stamp":"2023-12-17T11:48:17.199970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T16:14:48.723317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-17T11:48:22.529429+0000","last_change":"2023-12-17T11:48:18.279879+0000","last_active":"2023-12-17T11:48:22.529429+0000","last_peered":"2023-12-17T11:48:22.529429+0000","last_clean":"2023-12-17T11:48:22.529429+0000","last_became_active":"2023-12-17T11:48:18.279462+0000","last_became_peered":"2023-12-17T11:48:18.279462+0000","last_unstale":"2023-12-17T11:48:22.529429+0000","last_undegraded":"2023-12-17T11:48:22.529429+0000","last_fullsized":"2023-12-17T11:48:22.529429+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_clean_scrub_stamp":"2023-12-17T11:48:17.199970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T12:09:17.721558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-17T11:48:22.509512+0000","last_change":"2023-12-17T11:48:18.268736+0000","last_active":"2023-12-17T11:48:22.509512+0000","last_peered":"2023-12-17T11:48:22.509512+0000","last_clean":"2023-12-17T11:48:22.509512+0000","last_became_active":"2023-12-17T11:48:18.268299+0000","last_became_peered":"2023-12-17T11:48:18.268299+0000","last_unstale":"2023-12-17T11:48:22.509512+0000","last_undegraded":"2023-12-17T11:48:22.509512+0000","last_fullsized":"2023-12-17T11:48:22.509512+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_clean_scrub_stamp":"2023-12-17T11:48:17.199970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T12:59:53.414167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-17T11:48:22.498921+0000","last_change":"2023-12-17T11:48:18.270384+0000","last_active":"2023-12-17T11:48:22.498921+0000","last_peered":"2023-12-17T11:48:22.498921+0000","last_clean":"2023-12-17T11:48:22.498921+0000","last_became_active":"2023-12-17T11:48:18.270042+0000","last_became_peered":"2023-12-17T11:48:18.270042+0000","last_unstale":"2023-12-17T11:48:22.498921+0000","last_undegraded":"2023-12-17T11:48:22.498921+0000","last_fullsized":"2023-12-17T11:48:22.498921+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_clean_scrub_stamp":"2023-12-17T11:48:17.199970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T20:47:10.524205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-17T11:48:22.518885+0000","last_change":"2023-12-17T11:48:18.261294+0000","last_active":"2023-12-17T11:48:22.518885+0000","last_peered":"2023-12-17T11:48:22.518885+0000","last_clean":"2023-12-17T11:48:22.518885+0000","last_became_active":"2023-12-17T11:48:18.260956+0000","last_became_peered":"2023-12-17T11:48:18.260956+0000","last_unstale":"2023-12-17T11:48:22.518885+0000","last_undegraded":"2023-12-17T11:48:22.518885+0000","last_fullsized":"2023-12-17T11:48:22.518885+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_clean_scrub_stamp":"2023-12-17T11:48:17.199970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T14:38:17.224694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-17T11:48:22.531412+0000","last_change":"2023-12-17T11:48:18.288322+0000","last_active":"2023-12-17T11:48:22.531412+0000","last_peered":"2023-12-17T11:48:22.531412+0000","last_clean":"2023-12-17T11:48:22.531412+0000","last_became_active":"2023-12-17T11:48:18.288079+0000","last_became_peered":"2023-12-17T11:48:18.288079+0000","last_unstale":"2023-12-17T11:48:22.531412+0000","last_undegraded":"2023-12-17T11:48:22.531412+0000","last_fullsized":"2023-12-17T11:48:22.531412+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_clean_scrub_stamp":"2023-12-17T11:48:17.199970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T12:59:53.414167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-17T11:48:22.528855+0000","last_change":"2023-12-17T11:48:18.284571+0000","last_active":"2023-12-17T11:48:22.528855+0000","last_peered":"2023-12-17T11:48:22.528855+0000","last_clean":"2023-12-17T11:48:22.528855+0000","last_became_active":"2023-12-17T11:48:18.284293+0000","last_became_peered":"2023-12-17T11:48:18.284293+0000","last_unstale":"2023-12-17T11:48:22.528855+0000","last_undegraded":"2023-12-17T11:48:22.528855+0000","last_fullsized":"2023-12-17T11:48:22.528855+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_clean_scrub_stamp":"2023-12-17T11:48:17.199970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T20:47:10.524205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-17T11:48:22.539887+0000","last_change":"2023-12-17T11:48:18.291564+0000","last_active":"2023-12-17T11:48:22.539887+0000","last_peered":"2023-12-17T11:48:22.539887+0000","last_clean":"2023-12-17T11:48:22.539887+0000","last_became_active":"2023-12-17T11:48:18.289522+0000","last_became_peered":"2023-12-17T11:48:18.289522+0000","last_unstale":"2023-12-17T11:48:22.539887+0000","last_undegraded":"2023-12-17T11:48:22.539887+0000","last_fullsized":"2023-12-17T11:48:22.539887+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_clean_scrub_stamp":"2023-12-17T11:48:17.199970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T17:39:16.718281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-17T11:48:22.497188+0000","last_change":"2023-12-17T11:48:18.282696+0000","last_active":"2023-12-17T11:48:22.497188+0000","last_peered":"2023-12-17T11:48:22.497188+0000","last_clean":"2023-12-17T11:48:22.497188+0000","last_became_active":"2023-12-17T11:48:18.282388+0000","last_became_peered":"2023-12-17T11:48:18.282388+0000","last_unstale":"2023-12-17T11:48:22.497188+0000","last_undegraded":"2023-12-17T11:48:22.497188+0000","last_fullsized":"2023-12-17T11:48:22.497188+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_clean_scrub_stamp":"2023-12-17T11:48:17.199970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T19:01:46.435511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-17T11:48:22.537605+0000","last_change":"2023-12-17T11:48:18.279029+0000","last_active":"2023-12-17T11:48:22.537605+0000","last_peered":"2023-12-17T11:48:22.537605+0000","last_clean":"2023-12-17T11:48:22.537605+0000","last_became_active":"2023-12-17T11:48:18.278719+0000","last_became_peered":"2023-12-17T11:48:18.278719+0000","last_unstale":"2023-12-17T11:48:22.537605+0000","last_undegraded":"2023-12-17T11:48:22.537605+0000","last_fullsized":"2023-12-17T11:48:22.537605+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_clean_scrub_stamp":"2023-12-17T11:48:17.199970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T14:24:55.101826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-17T11:48:22.517795+0000","last_change":"2023-12-17T11:48:18.286319+0000","last_active":"2023-12-17T11:48:22.517795+0000","last_peered":"2023-12-17T11:48:22.517795+0000","last_clean":"2023-12-17T11:48:22.517795+0000","last_became_active":"2023-12-17T11:48:18.286027+0000","last_became_peered":"2023-12-17T11:48:18.286027+0000","last_unstale":"2023-12-17T11:48:22.517795+0000","last_undegraded":"2023-12-17T11:48:22.517795+0000","last_fullsized":"2023-12-17T11:48:22.517795+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_clean_scrub_stamp":"2023-12-17T11:48:17.199970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T22:33:29.994957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-17T11:48:22.538176+0000","last_change":"2023-12-17T11:48:18.268834+0000","last_active":"2023-12-17T11:48:22.538176+0000","last_peered":"2023-12-17T11:48:22.538176+0000","last_clean":"2023-12-17T11:48:22.538176+0000","last_became_active":"2023-12-17T11:48:18.268143+0000","last_became_peered":"2023-12-17T11:48:18.268143+0000","last_unstale":"2023-12-17T11:48:22.538176+0000","last_undegraded":"2023-12-17T11:48:22.538176+0000","last_fullsized":"2023-12-17T11:48:22.538176+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_clean_scrub_stamp":"2023-12-17T11:48:17.199970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T12:22:21.171846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-17T11:48:22.521713+0000","last_change":"2023-12-17T11:48:18.280307+0000","last_active":"2023-12-17T11:48:22.521713+0000","last_peered":"2023-12-17T11:48:22.521713+0000","last_clean":"2023-12-17T11:48:22.521713+0000","last_became_active":"2023-12-17T11:48:18.280015+0000","last_became_peered":"2023-12-17T11:48:18.280015+0000","last_unstale":"2023-12-17T11:48:22.521713+0000","last_undegraded":"2023-12-17T11:48:22.521713+0000","last_fullsized":"2023-12-17T11:48:22.521713+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_clean_scrub_stamp":"2023-12-17T11:48:17.199970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T14:13:24.702473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-17T11:48:22.517974+0000","last_change":"2023-12-17T11:48:18.268732+0000","last_active":"2023-12-17T11:48:22.517974+0000","last_peered":"2023-12-17T11:48:22.517974+0000","last_clean":"2023-12-17T11:48:22.517974+0000","last_became_active":"2023-12-17T11:48:18.268356+0000","last_became_peered":"2023-12-17T11:48:18.268356+0000","last_unstale":"2023-12-17T11:48:22.517974+0000","last_undegraded":"2023-12-17T11:48:22.517974+0000","last_fullsized":"2023-12-17T11:48:22.517974+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_clean_scrub_stamp":"2023-12-17T11:48:17.199970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T19:01:46.435511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-17T11:48:22.536284+0000","last_change":"2023-12-17T11:48:18.278820+0000","last_active":"2023-12-17T11:48:22.536284+0000","last_peered":"2023-12-17T11:48:22.536284+0000","last_clean":"2023-12-17T11:48:22.536284+0000","last_became_active":"2023-12-17T11:48:18.275659+0000","last_became_peered":"2023-12-17T11:48:18.275659+0000","last_unstale":"2023-12-17T11:48:22.536284+0000","last_undegraded":"2023-12-17T11:48:22.536284+0000","last_fullsized":"2023-12-17T11:48:22.536284+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_clean_scrub_stamp":"2023-12-17T11:48:17.199970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T19:40:13.516541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-17T11:48:22.539766+0000","last_change":"2023-12-17T11:48:18.263983+0000","last_active":"2023-12-17T11:48:22.539766+0000","last_peered":"2023-12-17T11:48:22.539766+0000","last_clean":"2023-12-17T11:48:22.539766+0000","last_became_active":"2023-12-17T11:48:18.263574+0000","last_became_peered":"2023-12-17T11:48:18.263574+0000","last_unstale":"2023-12-17T11:48:22.539766+0000","last_undegraded":"2023-12-17T11:48:22.539766+0000","last_fullsized":"2023-12-17T11:48:22.539766+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:17.199970+0000","last_clean_scrub_stamp":"2023-12-17T11:48:17.199970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T22:56:05.187224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4638,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9276,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":43,"ondisk_log_size":43,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542155,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27864,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343976,"statfs":{"total":96636764160,"available":96608231424,"internally_reserved":0,"allocated":860160,"data_stored":694037,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0029999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81399999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0389999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95099999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1759999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2470000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5569999999999999}]}]},{"osd":6,"up_from":14,"seq":60129542155,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":274432,"data_stored":106927,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68799999999999994}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4590000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75700000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.343}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2889999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4139999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1479999999999999}]}]},{"osd":5,"up_from":14,"seq":60129542154,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":266240,"data_stored":103177,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.879}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.99099999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.292}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3979999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.534}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.589}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7829999999999999}]}]},{"osd":4,"up_from":14,"seq":60129542155,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":274432,"data_stored":103213,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85099999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92500000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4890000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.429}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5469999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6559999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7030000000000001}]}]},{"osd":3,"up_from":14,"seq":60129542154,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":274432,"data_stored":106927,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47099999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34200000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64500000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86399999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82399999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76700000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78700000000000003}]}]},{"osd":2,"up_from":14,"seq":60129542155,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":262144,"data_stored":103087,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68400000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51900000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.026}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96999999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88300000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78700000000000003}]}]},{"osd":1,"up_from":14,"seq":60129542154,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":270336,"data_stored":103247,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4279999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65600000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.321}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.268}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3799999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5760000000000001}]}]},{"osd":0,"up_from":14,"seq":60129542154,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27868,"kb_used_data":848,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343972,"statfs":{"total":96636764160,"available":96608227328,"internally_reserved":0,"allocated":868352,"data_stored":694093,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76200000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89100000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2210000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.8009999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3859999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6419999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.0670000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-17T11:48:46.372 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-12-17T11:48:46.373 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2023-12-17T11:48:46.373 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2023-12-17T11:48:46.373 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-12-17T11:48:46.640 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:46.638+0000 7fbbce24b640 1 Processor -- start 2023-12-17T11:48:46.640 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:46.638+0000 7fbbce24b640 1 -- start start 2023-12-17T11:48:46.642 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:46.640+0000 7fbbce24b640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fbbc80c4210 0x7fbbc80ce400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:46.642 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:46.640+0000 7fbbce24b640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fbbc80cb480 0x7fbbc80cb8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:46.643 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:46.640+0000 7fbbce24b640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbbc80cbdf0 con 0x7fbbc815d610 2023-12-17T11:48:46.643 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:46.640+0000 7fbbce24b640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbbc80c45f0 con 0x7fbbc80cb480 2023-12-17T11:48:46.643 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:46.640+0000 7fbbce24b640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbbc815ddd0 con 0x7fbbc80c4210 2023-12-17T11:48:46.643 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:46.640+0000 7fbbcda4a640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fbbc80cb480 0x7fbbc80cb8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:46.643 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:46.640+0000 7fbbcca48640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fbbc815d610 0x7fbbc806c4c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:57496/0 (socket says 172.21.15.40:57496) 2023-12-17T11:48:46.643 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:46.640+0000 7fbbcca48640 1 -- 172.21.15.40:0/2451577172 learned_addr learned my addr 172.21.15.40:0/2451577172 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-12-17T11:48:46.643 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:46.640+0000 7fbbcda4a640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fbbc80cb480 0x7fbbc80cb8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:41448/0 (socket says 172.21.15.40:41448) 2023-12-17T11:48:46.643 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:46.640+0000 7fbbcd249640 1 --2- 172.21.15.40:0/2451577172 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fbbc80c4210 0x7fbbc80ce400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:46.643 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:46.641+0000 7fbbcda4a640 1 -- 172.21.15.40:0/2451577172 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fbbc80c4210 msgr2=0x7fbbc80ce400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:48:46.643 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:46.641+0000 7fbbcda4a640 1 --2- 172.21.15.40:0/2451577172 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fbbc80c4210 0x7fbbc80ce400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:46.643 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:46.641+0000 7fbbcda4a640 1 -- 172.21.15.40:0/2451577172 >> v1:172.21.15.40:6789/0 conn(0x7fbbc815d610 legacy=0x7fbbc806c4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:46.643 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:46.641+0000 7fbbcda4a640 1 -- 172.21.15.40:0/2451577172 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbc815e0b0 con 0x7fbbc80cb480 2023-12-17T11:48:46.644 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:46.642+0000 7fbbcda4a640 1 --2- 172.21.15.40:0/2451577172 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbbc80cb480 0x7fbbc80cb8b0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fbbc0009d90 tx=0x7fbbc002bf30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f599197fd651ad0f server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:48:46.644 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:46.642+0000 7fbbbffff640 1 -- 172.21.15.40:0/2451577172 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbc002cce0 con 0x7fbbc80cb480 2023-12-17T11:48:46.644 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:46.642+0000 7fbbbffff640 1 -- 172.21.15.40:0/2451577172 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbc002ce40 con 0x7fbbc80cb480 2023-12-17T11:48:46.644 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:46.642+0000 7fbbbffff640 1 -- 172.21.15.40:0/2451577172 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbc0034660 con 0x7fbbc80cb480 2023-12-17T11:48:46.645 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:46.643+0000 7fbbce24b640 1 -- 172.21.15.40:0/2451577172 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbbc80cb480 msgr2=0x7fbbc80cb8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:46.645 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:46.643+0000 7fbbce24b640 1 --2- 172.21.15.40:0/2451577172 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbbc80cb480 0x7fbbc80cb8b0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fbbc0009d90 tx=0x7fbbc002bf30 comp rx=0 tx=0).stop 2023-12-17T11:48:46.645 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:46.643+0000 7fbbce24b640 1 -- 172.21.15.40:0/2451577172 shutdown_connections 2023-12-17T11:48:46.645 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:46.643+0000 7fbbce24b640 1 --2- 172.21.15.40:0/2451577172 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbbc80cb480 0x7fbbc80cb8b0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:46.645 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:46.643+0000 7fbbce24b640 1 --2- 172.21.15.40:0/2451577172 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fbbc80c4210 0x7fbbc80ce400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:46.645 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:46.643+0000 7fbbce24b640 1 -- 172.21.15.40:0/2451577172 >> 172.21.15.40:0/2451577172 conn(0x7fbbc80b06c0 msgr2=0x7fbbc80b0aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:48:46.645 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:46.643+0000 7fbbce24b640 1 -- 172.21.15.40:0/2451577172 shutdown_connections 2023-12-17T11:48:46.646 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:46.643+0000 7fbbce24b640 1 -- 172.21.15.40:0/2451577172 wait complete. 2023-12-17T11:48:46.646 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:46.645+0000 7fbbce24b640 1 Processor -- start 2023-12-17T11:48:46.647 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:46.645+0000 7fbbce24b640 1 -- start start 2023-12-17T11:48:46.649 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:46.646+0000 7fbbce24b640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fbbc80c4210 0x7fbbc80b4690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:46.649 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:46.646+0000 7fbbce24b640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbbc80cb480 0x7fbbc8070ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:46.649 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:46.646+0000 7fbbce24b640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbbc815d610 0x7fbbc8071420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:46.649 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:46.646+0000 7fbbce24b640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbc814a550 con 0x7fbbc80cb480 2023-12-17T11:48:46.650 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:46.646+0000 7fbbce24b640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbc814db00 con 0x7fbbc815d610 2023-12-17T11:48:46.650 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:46.646+0000 7fbbce24b640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbbc814a0c0 con 0x7fbbc80c4210 2023-12-17T11:48:46.650 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:46.646+0000 7fbbcca48640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbbc80cb480 0x7fbbc8070ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:46.650 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:46.646+0000 7fbbcca48640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbbc80cb480 0x7fbbc8070ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:41456/0 (socket says 172.21.15.40:41456) 2023-12-17T11:48:46.650 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:46.646+0000 7fbbcca48640 1 -- 172.21.15.40:0/3664657404 learned_addr learned my addr 172.21.15.40:0/3664657404 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-17T11:48:46.650 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:46.646+0000 7fbbcd249640 1 --2- 172.21.15.40:0/3664657404 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fbbc80c4210 0x7fbbc80b4690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:46.650 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:46.647+0000 7fbbcda4a640 1 --2- 172.21.15.40:0/3664657404 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbbc815d610 0x7fbbc8071420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:46.650 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:46.647+0000 7fbbcca48640 1 -- 172.21.15.40:0/3664657404 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fbbc80c4210 msgr2=0x7fbbc80b4690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:46.650 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:46.647+0000 7fbbcca48640 1 --2- 172.21.15.40:0/3664657404 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fbbc80c4210 0x7fbbc80b4690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:46.650 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:46.647+0000 7fbbcca48640 1 -- 172.21.15.40:0/3664657404 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbbc815d610 msgr2=0x7fbbc8071420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:46.650 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:46.647+0000 7fbbcca48640 1 --2- 172.21.15.40:0/3664657404 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbbc815d610 0x7fbbc8071420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:46.650 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:46.647+0000 7fbbcca48640 1 -- 172.21.15.40:0/3664657404 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbc0009a70 con 0x7fbbc80cb480 2023-12-17T11:48:46.651 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:46.647+0000 7fbbcd249640 1 --2- 172.21.15.40:0/3664657404 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fbbc80c4210 0x7fbbc80b4690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-17T11:48:46.651 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:46.647+0000 7fbbcca48640 1 --2- 172.21.15.40:0/3664657404 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbbc80cb480 0x7fbbc8070ee0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fbbb800c480 tx=0x7fbbb800c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:48:46.651 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:46.647+0000 7fbbbdffb640 1 -- 172.21.15.40:0/3664657404 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbb8005ce0 con 0x7fbbc80cb480 2023-12-17T11:48:46.651 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:46.647+0000 7fbbbdffb640 1 -- 172.21.15.40:0/3664657404 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbb8005e40 con 0x7fbbc80cb480 2023-12-17T11:48:46.651 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:46.647+0000 7fbbbdffb640 1 -- 172.21.15.40:0/3664657404 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbb80072b0 con 0x7fbbc80cb480 2023-12-17T11:48:46.651 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:46.647+0000 7fbbce24b640 1 -- 172.21.15.40:0/3664657404 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbbc80b4bd0 con 0x7fbbc80cb480 2023-12-17T11:48:46.651 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:46.648+0000 7fbbce24b640 1 -- 172.21.15.40:0/3664657404 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbbc8149a70 con 0x7fbbc80cb480 2023-12-17T11:48:46.651 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:46.649+0000 7fbbce24b640 1 -- 172.21.15.40:0/3664657404 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbbc815d200 con 0x7fbbc80cb480 2023-12-17T11:48:46.652 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:46.650+0000 7fbbbdffb640 1 -- 172.21.15.40:0/3664657404 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fbbb8007410 con 0x7fbbc80cb480 2023-12-17T11:48:46.652 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:46.650+0000 7fbbbdffb640 1 --2- 172.21.15.40:0/3664657404 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7fbbac06ae40 0x7fbbac06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:46.652 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:46.651+0000 7fbbbdffb640 1 -- 172.21.15.40:0/3664657404 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fbbb8088e80 con 0x7fbbc80cb480 2023-12-17T11:48:46.653 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:46.651+0000 7fbbcd249640 1 --2- 172.21.15.40:0/3664657404 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7fbbac06ae40 0x7fbbac06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:46.654 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:46.652+0000 7fbbcd249640 1 --2- 172.21.15.40:0/3664657404 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7fbbac06ae40 0x7fbbac06d300 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fbbc80cd840 tx=0x7fbbc4008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:48:46.657 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:46.655+0000 7fbbbdffb640 1 -- 172.21.15.40:0/3664657404 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fbbb8053c30 con 0x7fbbc80cb480 2023-12-17T11:48:46.893 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:46.891+0000 7fbbce24b640 1 -- 172.21.15.40:0/3664657404 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fbbc8074450 con 0x7fbbc80cb480 2023-12-17T11:48:46.893 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:46.891+0000 7fbbbdffb640 1 -- 172.21.15.40:0/3664657404 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7fbbb8017080 con 0x7fbbc80cb480 2023-12-17T11:48:46.894 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T11:48:46.894 INFO:teuthology.orchestra.run.smithi040.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-12-17T11:48:46.897 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:46.894+0000 7fbbce24b640 1 -- 172.21.15.40:0/3664657404 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7fbbac06ae40 msgr2=0x7fbbac06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:46.897 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:46.894+0000 7fbbce24b640 1 --2- 172.21.15.40:0/3664657404 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7fbbac06ae40 0x7fbbac06d300 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fbbc80cd840 tx=0x7fbbc4008040 comp rx=0 tx=0).stop 2023-12-17T11:48:46.897 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:46.894+0000 7fbbce24b640 1 -- 172.21.15.40:0/3664657404 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbbc80cb480 msgr2=0x7fbbc8070ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:46.897 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:46.894+0000 7fbbce24b640 1 --2- 172.21.15.40:0/3664657404 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbbc80cb480 0x7fbbc8070ee0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fbbb800c480 tx=0x7fbbb800c940 comp rx=0 tx=0).stop 2023-12-17T11:48:46.897 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:46.894+0000 7fbbce24b640 1 -- 172.21.15.40:0/3664657404 shutdown_connections 2023-12-17T11:48:46.897 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:46.894+0000 7fbbce24b640 1 --2- 172.21.15.40:0/3664657404 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7fbbac06ae40 0x7fbbac06d300 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:46.897 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:46.894+0000 7fbbce24b640 1 --2- 172.21.15.40:0/3664657404 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbbc815d610 0x7fbbc8071420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:46.897 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:46.894+0000 7fbbce24b640 1 --2- 172.21.15.40:0/3664657404 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbbc80cb480 0x7fbbc8070ee0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:46.897 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:46.894+0000 7fbbce24b640 1 --2- 172.21.15.40:0/3664657404 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fbbc80c4210 0x7fbbc80b4690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:46.898 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:46.894+0000 7fbbce24b640 1 -- 172.21.15.40:0/3664657404 >> 172.21.15.40:0/3664657404 conn(0x7fbbc80b06c0 msgr2=0x7fbbc806c4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:48:46.898 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:46.895+0000 7fbbce24b640 1 -- 172.21.15.40:0/3664657404 shutdown_connections 2023-12-17T11:48:46.898 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:46.895+0000 7fbbce24b640 1 -- 172.21.15.40:0/3664657404 wait complete. 2023-12-17T11:48:46.916 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2023-12-17T11:48:46.917 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-17T11:48:47.133 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:47.130+0000 7f7819edc640 1 Processor -- start 2023-12-17T11:48:47.133 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:47.131+0000 7f7819edc640 1 -- start start 2023-12-17T11:48:47.134 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:47.132+0000 7f7819edc640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f781415e5d0 0x7f781406bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:47.134 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:47.132+0000 7f7819edc640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f7814071260 0x7f78140cded0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:47.134 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:47.132+0000 7f7819edc640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7814071f90 con 0x7f78140ae200 2023-12-17T11:48:47.134 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:47.132+0000 7f7819edc640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7814072270 con 0x7f7814071260 2023-12-17T11:48:47.135 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:47.132+0000 7f7819edc640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7814070070 con 0x7f781415e5d0 2023-12-17T11:48:47.135 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:47.133+0000 7f7813fff640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f78140ae200 0x7f7814070b50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:57506/0 (socket says 172.21.15.40:57506) 2023-12-17T11:48:47.135 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:47.133+0000 7f7813fff640 1 -- 172.21.15.40:0/1088862061 learned_addr learned my addr 172.21.15.40:0/1088862061 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-12-17T11:48:47.136 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:47.133+0000 7f7818eda640 1 --2- 172.21.15.40:0/1088862061 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f781415e5d0 0x7f781406bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:47.136 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:47.133+0000 7f78137fe640 1 -- 172.21.15.40:0/1088862061 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2595821366 0 0) 0x7f7814071f90 con 0x7f78140ae200 2023-12-17T11:48:47.136 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:47.133+0000 7f78137fe640 1 -- 172.21.15.40:0/1088862061 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7800003520 con 0x7f78140ae200 2023-12-17T11:48:47.136 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:47.133+0000 7f78196db640 1 --2- 172.21.15.40:0/1088862061 >> v2:172.21.15.159:3300/0 conn(0x7f7814071260 0x7f78140cded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:47.136 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:47.133+0000 7f78137fe640 1 -- 172.21.15.40:0/1088862061 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2137496429 0 0) 0x7f7800003520 con 0x7f78140ae200 2023-12-17T11:48:47.137 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:47.133+0000 7f78137fe640 1 -- 172.21.15.40:0/1088862061 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f781415e5d0 msgr2=0x7f781406bdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:48:47.137 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:47.133+0000 7f78137fe640 1 --2- 172.21.15.40:0/1088862061 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f781415e5d0 0x7f781406bdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:47.137 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:47.133+0000 7f78137fe640 1 -- 172.21.15.40:0/1088862061 >> v2:172.21.15.159:3300/0 conn(0x7f7814071260 msgr2=0x7f78140cded0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:48:47.137 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:47.133+0000 7f78137fe640 1 --2- 172.21.15.40:0/1088862061 >> v2:172.21.15.159:3300/0 conn(0x7f7814071260 0x7f78140cded0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:47.137 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:47.133+0000 7f78137fe640 1 -- 172.21.15.40:0/1088862061 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7814070350 con 0x7f78140ae200 2023-12-17T11:48:47.137 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:47.133+0000 7f78137fe640 1 -- 172.21.15.40:0/1088862061 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2643242555 0 0) 0x7f78040019f0 con 0x7f78140ae200 2023-12-17T11:48:47.137 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:47.134+0000 7f78137fe640 1 -- 172.21.15.40:0/1088862061 >> v1:172.21.15.40:6789/0 conn(0x7f78140ae200 legacy=0x7f7814070b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:47.137 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:47.134+0000 7f78137fe640 1 --2- 172.21.15.40:0/1088862061 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7800003970 0x7f7800003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:47.137 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:47.134+0000 7f78137fe640 1 --2- 172.21.15.40:0/1088862061 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f781415e5d0 0x7f78000047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:47.137 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:47.134+0000 7f78137fe640 1 --2- 172.21.15.40:0/1088862061 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7800004d00 0x7f7800005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:47.138 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:47.134+0000 7f78137fe640 1 -- 172.21.15.40:0/1088862061 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7814072270 con 0x7f7800003970 2023-12-17T11:48:47.138 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:47.134+0000 7f78137fe640 1 -- 172.21.15.40:0/1088862061 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7814070070 con 0x7f7800004d00 2023-12-17T11:48:47.138 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:47.134+0000 7f78137fe640 1 -- 172.21.15.40:0/1088862061 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f780000bae0 con 0x7f781415e5d0 2023-12-17T11:48:47.138 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:47.134+0000 7f7818eda640 1 --2- 172.21.15.40:0/1088862061 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7800003970 0x7f7800003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:47.138 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:47.134+0000 7f7813fff640 1 --2- 172.21.15.40:0/1088862061 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f781415e5d0 0x7f78000047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:47.138 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:47.134+0000 7f78196db640 1 --2- 172.21.15.40:0/1088862061 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7800004d00 0x7f7800005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:47.138 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:47.134+0000 7f7818eda640 1 -- 172.21.15.40:0/1088862061 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f781415e5d0 msgr2=0x7f78000047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:48:47.138 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:47.134+0000 7f7818eda640 1 --2- 172.21.15.40:0/1088862061 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f781415e5d0 0x7f78000047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:47.138 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:47.134+0000 7f7818eda640 1 -- 172.21.15.40:0/1088862061 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7800004d00 msgr2=0x7f7800005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:48:47.138 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:47.134+0000 7f7818eda640 1 --2- 172.21.15.40:0/1088862061 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7800004d00 0x7f7800005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:47.138 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:47.134+0000 7f7818eda640 1 -- 172.21.15.40:0/1088862061 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7800003520 con 0x7f7800003970 2023-12-17T11:48:47.139 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:47.136+0000 7f7818eda640 1 --2- 172.21.15.40:0/1088862061 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7800003970 0x7f7800003d90 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f77fc00ba30 tx=0x7f78000057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e24c33fa68a3ae86 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:48:47.139 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:47.136+0000 7f78137fe640 1 -- 172.21.15.40:0/1088862061 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77fc032640 con 0x7f7800003970 2023-12-17T11:48:47.140 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:47.136+0000 7f78137fe640 1 -- 172.21.15.40:0/1088862061 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77fc0327a0 con 0x7f7800003970 2023-12-17T11:48:47.140 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:47.136+0000 7f78137fe640 1 -- 172.21.15.40:0/1088862061 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77fc032b30 con 0x7f7800003970 2023-12-17T11:48:47.140 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:47.136+0000 7f7819edc640 1 -- 172.21.15.40:0/1088862061 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7800003970 msgr2=0x7f7800003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:47.140 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:47.136+0000 7f7819edc640 1 --2- 172.21.15.40:0/1088862061 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7800003970 0x7f7800003d90 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f77fc00ba30 tx=0x7f78000057f0 comp rx=0 tx=0).stop 2023-12-17T11:48:47.140 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:47.136+0000 7f78196db640 1 -- 172.21.15.40:0/1088862061 reap_dead start 2023-12-17T11:48:47.140 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:47.137+0000 7f7819edc640 1 -- 172.21.15.40:0/1088862061 shutdown_connections 2023-12-17T11:48:47.140 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:47.137+0000 7f7819edc640 1 -- 172.21.15.40:0/1088862061 >> 172.21.15.40:0/1088862061 conn(0x7f78140b0860 msgr2=0x7f78140b0c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:48:47.140 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:47.137+0000 7f7819edc640 1 -- 172.21.15.40:0/1088862061 shutdown_connections 2023-12-17T11:48:47.140 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:47.137+0000 7f7819edc640 1 -- 172.21.15.40:0/1088862061 wait complete. 2023-12-17T11:48:47.140 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:47.139+0000 7f7819edc640 1 Processor -- start 2023-12-17T11:48:47.141 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:47.139+0000 7f7819edc640 1 -- start start 2023-12-17T11:48:47.142 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:47.140+0000 7f7819edc640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7800003970 0x7f78141f01c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:47.142 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:47.140+0000 7f7819edc640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f781414fcc0 0x7f781409ba90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:47.143 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:47.140+0000 7f7819edc640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f7814153240 0x7f781414e7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:47.143 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:47.140+0000 7f7819edc640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78141501a0 con 0x7f781414fcc0 2023-12-17T11:48:47.143 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:47.140+0000 7f7819edc640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7814150480 con 0x7f7800003970 2023-12-17T11:48:47.143 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:47.140+0000 7f7819edc640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7814150760 con 0x7f7814153240 2023-12-17T11:48:47.143 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:47.140+0000 7f7813fff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f781414fcc0 0x7f781409ba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:47.143 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:47.140+0000 7f7813fff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f781414fcc0 0x7f781409ba90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:41482/0 (socket says 172.21.15.40:41482) 2023-12-17T11:48:47.143 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:47.140+0000 7f7813fff640 1 -- 172.21.15.40:0/2445158543 learned_addr learned my addr 172.21.15.40:0/2445158543 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-17T11:48:47.143 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:47.140+0000 7f7818eda640 1 --2- 172.21.15.40:0/2445158543 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7800003970 0x7f78141f01c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:47.143 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:47.140+0000 7f78196db640 1 --2- 172.21.15.40:0/2445158543 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f7814153240 0x7f781414e7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:47.143 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:47.140+0000 7f7813fff640 1 -- 172.21.15.40:0/2445158543 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f7814153240 msgr2=0x7f781414e7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:47.143 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:47.140+0000 7f7813fff640 1 --2- 172.21.15.40:0/2445158543 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f7814153240 0x7f781414e7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:47.143 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:47.140+0000 7f7813fff640 1 -- 172.21.15.40:0/2445158543 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7800003970 msgr2=0x7f78141f01c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:47.143 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:47.140+0000 7f7813fff640 1 --2- 172.21.15.40:0/2445158543 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7800003970 0x7f78141f01c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:47.143 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:47.140+0000 7f7813fff640 1 -- 172.21.15.40:0/2445158543 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7814150a40 con 0x7f781414fcc0 2023-12-17T11:48:47.144 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:47.141+0000 7f7813fff640 1 --2- 172.21.15.40:0/2445158543 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f781414fcc0 0x7f781409ba90 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f7804007b00 tx=0x7f780400e530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:48:47.145 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:47.141+0000 7f78117fa640 1 -- 172.21.15.40:0/2445158543 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f780400ee90 con 0x7f781414fcc0 2023-12-17T11:48:47.145 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:47.141+0000 7f78117fa640 1 -- 172.21.15.40:0/2445158543 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7804013420 con 0x7f781414fcc0 2023-12-17T11:48:47.145 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:47.141+0000 7f78117fa640 1 -- 172.21.15.40:0/2445158543 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78040137d0 con 0x7f781414fcc0 2023-12-17T11:48:47.145 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:47.141+0000 7f7819edc640 1 -- 172.21.15.40:0/2445158543 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7814150d20 con 0x7f781414fcc0 2023-12-17T11:48:47.145 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:47.141+0000 7f7819edc640 1 -- 172.21.15.40:0/2445158543 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f781409bfd0 con 0x7f781414fcc0 2023-12-17T11:48:47.145 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:47.142+0000 7f7819edc640 1 -- 172.21.15.40:0/2445158543 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7814150f60 con 0x7f781414fcc0 2023-12-17T11:48:47.145 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:47.143+0000 7f78117fa640 1 -- 172.21.15.40:0/2445158543 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f7804013930 con 0x7f781414fcc0 2023-12-17T11:48:47.146 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:47.144+0000 7f78117fa640 1 --2- 172.21.15.40:0/2445158543 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f77f406ae40 0x7f77f406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:47.146 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:47.144+0000 7f78117fa640 1 -- 172.21.15.40:0/2445158543 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f780408a160 con 0x7f781414fcc0 2023-12-17T11:48:47.146 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:47.145+0000 7f7818eda640 1 --2- 172.21.15.40:0/2445158543 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f77f406ae40 0x7f77f406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:47.148 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:47.146+0000 7f7818eda640 1 --2- 172.21.15.40:0/2445158543 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f77f406ae40 0x7f77f406d300 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f77fc00ba00 tx=0x7f77fc03d040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:48:47.150 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:47.149+0000 7f78117fa640 1 -- 172.21.15.40:0/2445158543 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f7814150f60 con 0x7f781414fcc0 2023-12-17T11:48:47.345 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:47.343+0000 7f7819edc640 1 -- 172.21.15.40:0/2445158543 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7814150f60 con 0x7f781414fcc0 2023-12-17T11:48:47.347 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:47.346+0000 7f78117fa640 1 -- 172.21.15.40:0/2445158543 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18322 (secure 0 0 0) 0x7f7814150f60 con 0x7f781414fcc0 2023-12-17T11:48:47.348 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T11:48:47.348 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":25,"fsid":"099cd35d-80d9-4ca4-8424-de13b3b03ac7","created":"2023-12-17T11:47:53.450097+0000","modified":"2023-12-17T11:48:22.971195+0000","last_up_change":"2023-12-17T11:48:05.724195+0000","last_in_change":"2023-12-17T11:47:56.956499+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-17T11:48:06.668943+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-17T11:48:16.151444+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-17T11:48:16.717726+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-17T11:48:20.534819+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a88bfd46-63b8-48b1-9c0e-5c9cdc31bd38","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":555204741},{"type":"v1","addr":"172.21.15.40:6802","nonce":555204741}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":555204741},{"type":"v1","addr":"172.21.15.40:6807","nonce":555204741}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":555204741},{"type":"v1","addr":"172.21.15.40:6815","nonce":555204741}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6809","nonce":555204741},{"type":"v1","addr":"172.21.15.40:6812","nonce":555204741}]},"public_addr":"172.21.15.40:6802/555204741","cluster_addr":"172.21.15.40:6807/555204741","heartbeat_back_addr":"172.21.15.40:6815/555204741","heartbeat_front_addr":"172.21.15.40:6812/555204741","state":["exists","up"]},{"osd":1,"uuid":"c5d628ae-36f4-4866-802c-b162f0e90add","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6801","nonce":1221318112},{"type":"v1","addr":"172.21.15.40:6803","nonce":1221318112}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6805","nonce":1221318112},{"type":"v1","addr":"172.21.15.40:6806","nonce":1221318112}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6811","nonce":1221318112},{"type":"v1","addr":"172.21.15.40:6813","nonce":1221318112}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":1221318112},{"type":"v1","addr":"172.21.15.40:6810","nonce":1221318112}]},"public_addr":"172.21.15.40:6803/1221318112","cluster_addr":"172.21.15.40:6806/1221318112","heartbeat_back_addr":"172.21.15.40:6813/1221318112","heartbeat_front_addr":"172.21.15.40:6810/1221318112","state":["exists","up"]},{"osd":2,"uuid":"d986ad6a-af2f-47fc-9c3b-fbda27b82b73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":1959000265},{"type":"v1","addr":"172.21.15.40:6817","nonce":1959000265}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6818","nonce":1959000265},{"type":"v1","addr":"172.21.15.40:6819","nonce":1959000265}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":1959000265},{"type":"v1","addr":"172.21.15.40:6827","nonce":1959000265}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":1959000265},{"type":"v1","addr":"172.21.15.40:6822","nonce":1959000265}]},"public_addr":"172.21.15.40:6817/1959000265","cluster_addr":"172.21.15.40:6819/1959000265","heartbeat_back_addr":"172.21.15.40:6827/1959000265","heartbeat_front_addr":"172.21.15.40:6822/1959000265","state":["exists","up"]},{"osd":3,"uuid":"d79d22b7-be05-41b2-b95d-697db677fd02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6821","nonce":974040287},{"type":"v1","addr":"172.21.15.40:6823","nonce":974040287}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6825","nonce":974040287},{"type":"v1","addr":"172.21.15.40:6826","nonce":974040287}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":974040287},{"type":"v1","addr":"172.21.15.40:6831","nonce":974040287}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":974040287},{"type":"v1","addr":"172.21.15.40:6829","nonce":974040287}]},"public_addr":"172.21.15.40:6823/974040287","cluster_addr":"172.21.15.40:6826/974040287","heartbeat_back_addr":"172.21.15.40:6831/974040287","heartbeat_front_addr":"172.21.15.40:6829/974040287","state":["exists","up"]},{"osd":4,"uuid":"62a7a233-d3ea-40be-91de-180c0208d639","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6808","nonce":3937787733},{"type":"v1","addr":"172.21.15.159:6809","nonce":3937787733}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6810","nonce":3937787733},{"type":"v1","addr":"172.21.15.159:6811","nonce":3937787733}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6814","nonce":3937787733},{"type":"v1","addr":"172.21.15.159:6815","nonce":3937787733}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6812","nonce":3937787733},{"type":"v1","addr":"172.21.15.159:6813","nonce":3937787733}]},"public_addr":"172.21.15.159:6809/3937787733","cluster_addr":"172.21.15.159:6811/3937787733","heartbeat_back_addr":"172.21.15.159:6815/3937787733","heartbeat_front_addr":"172.21.15.159:6813/3937787733","state":["exists","up"]},{"osd":5,"uuid":"84629cea-dc0e-4b5e-b203-5ea963839281","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6816","nonce":3032505240},{"type":"v1","addr":"172.21.15.159:6817","nonce":3032505240}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6818","nonce":3032505240},{"type":"v1","addr":"172.21.15.159:6819","nonce":3032505240}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6822","nonce":3032505240},{"type":"v1","addr":"172.21.15.159:6823","nonce":3032505240}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6820","nonce":3032505240},{"type":"v1","addr":"172.21.15.159:6821","nonce":3032505240}]},"public_addr":"172.21.15.159:6817/3032505240","cluster_addr":"172.21.15.159:6819/3032505240","heartbeat_back_addr":"172.21.15.159:6823/3032505240","heartbeat_front_addr":"172.21.15.159:6821/3032505240","state":["exists","up"]},{"osd":6,"uuid":"4ae3af3a-1743-4070-a91d-8be5c31cdb04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6800","nonce":2411788597},{"type":"v1","addr":"172.21.15.159:6801","nonce":2411788597}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6802","nonce":2411788597},{"type":"v1","addr":"172.21.15.159:6803","nonce":2411788597}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6806","nonce":2411788597},{"type":"v1","addr":"172.21.15.159:6807","nonce":2411788597}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6804","nonce":2411788597},{"type":"v1","addr":"172.21.15.159:6805","nonce":2411788597}]},"public_addr":"172.21.15.159:6801/2411788597","cluster_addr":"172.21.15.159:6803/2411788597","heartbeat_back_addr":"172.21.15.159:6807/2411788597","heartbeat_front_addr":"172.21.15.159:6805/2411788597","state":["exists","up"]},{"osd":7,"uuid":"c1f4c7f2-8f75-4f95-bc63-a332773e3b8e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6824","nonce":478953349},{"type":"v1","addr":"172.21.15.159:6825","nonce":478953349}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6826","nonce":478953349},{"type":"v1","addr":"172.21.15.159:6827","nonce":478953349}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6830","nonce":478953349},{"type":"v1","addr":"172.21.15.159:6831","nonce":478953349}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6828","nonce":478953349},{"type":"v1","addr":"172.21.15.159:6829","nonce":478953349}]},"public_addr":"172.21.15.159:6825/478953349","cluster_addr":"172.21.15.159:6827/478953349","heartbeat_back_addr":"172.21.15.159:6831/478953349","heartbeat_front_addr":"172.21.15.159:6829/478953349","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T11:48:02.023567+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T11:48:02.278216+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T11:48:02.311843+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T11:48:01.773372+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T11:48:02.618910+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T11:48:02.361559+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T11:48:02.223997+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T11:48:02.604403+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-17T11:48:47.350 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:47.348+0000 7f7819edc640 1 -- 172.21.15.40:0/2445158543 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f77f406ae40 msgr2=0x7f77f406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:47.350 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:47.348+0000 7f7819edc640 1 --2- 172.21.15.40:0/2445158543 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f77f406ae40 0x7f77f406d300 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f77fc00ba00 tx=0x7f77fc03d040 comp rx=0 tx=0).stop 2023-12-17T11:48:47.351 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:47.348+0000 7f7819edc640 1 -- 172.21.15.40:0/2445158543 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f781414fcc0 msgr2=0x7f781409ba90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:47.351 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:47.348+0000 7f7819edc640 1 --2- 172.21.15.40:0/2445158543 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f781414fcc0 0x7f781409ba90 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f7804007b00 tx=0x7f780400e530 comp rx=0 tx=0).stop 2023-12-17T11:48:47.351 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:47.348+0000 7f7819edc640 1 -- 172.21.15.40:0/2445158543 shutdown_connections 2023-12-17T11:48:47.351 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:47.348+0000 7f7819edc640 1 --2- 172.21.15.40:0/2445158543 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f77f406ae40 0x7f77f406d300 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:47.351 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:47.348+0000 7f7819edc640 1 --2- 172.21.15.40:0/2445158543 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f7814153240 0x7f781414e7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:47.351 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:47.348+0000 7f7819edc640 1 --2- 172.21.15.40:0/2445158543 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f781414fcc0 0x7f781409ba90 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:47.351 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:47.348+0000 7f7819edc640 1 --2- 172.21.15.40:0/2445158543 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7800003970 0x7f78141f01c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:47.351 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:47.348+0000 7f7819edc640 1 -- 172.21.15.40:0/2445158543 >> 172.21.15.40:0/2445158543 conn(0x7f78140b0860 msgr2=0x7f78140cdcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:48:47.351 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:47.348+0000 7f7819edc640 1 -- 172.21.15.40:0/2445158543 shutdown_connections 2023-12-17T11:48:47.351 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:47.349+0000 7f7819edc640 1 -- 172.21.15.40:0/2445158543 wait complete. 2023-12-17T11:48:47.371 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-17T11:48:06.668943+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-17T11:48:16.151444+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-17T11:48:16.717726+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-12-17T11:48:20.534819+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-12-17T11:48:47.371 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-17T11:48:47.600 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:47.597+0000 7f9896e78640 1 Processor -- start 2023-12-17T11:48:47.600 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:47.597+0000 7f9896e78640 1 -- start start 2023-12-17T11:48:47.601 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:47.599+0000 7f9896e78640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f98900b3350 0x7f98900b3ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:47.601 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:47.599+0000 7f9896e78640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98900c6b80 con 0x7f98900b3730 2023-12-17T11:48:47.601 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:47.599+0000 7f9896e78640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98900d3bf0 con 0x7f98900cfe70 2023-12-17T11:48:47.601 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:47.599+0000 7f9896e78640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98900d3ed0 con 0x7f98900b3350 2023-12-17T11:48:47.601 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:47.599+0000 7f9895675640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f98900b3730 0x7f98900cf760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:57514/0 (socket says 172.21.15.40:57514) 2023-12-17T11:48:47.601 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:47.599+0000 7f9895675640 1 -- 172.21.15.40:0/1481098258 learned_addr learned my addr 172.21.15.40:0/1481098258 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-12-17T11:48:47.603 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:47.599+0000 7f9895e76640 1 --2- 172.21.15.40:0/1481098258 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f98900b3350 0x7f98900b3ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:47.603 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:47.600+0000 7f9894e74640 1 -- 172.21.15.40:0/1481098258 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2431513566 0 0) 0x7f98900c6b80 con 0x7f98900b3730 2023-12-17T11:48:47.603 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:47.600+0000 7f9894e74640 1 -- 172.21.15.40:0/1481098258 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f987c003520 con 0x7f98900b3730 2023-12-17T11:48:47.603 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:47.600+0000 7f9894e74640 1 -- 172.21.15.40:0/1481098258 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3947805319 0 0) 0x7f987c003520 con 0x7f98900b3730 2023-12-17T11:48:47.603 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:47.600+0000 7f9894e74640 1 -- 172.21.15.40:0/1481098258 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f98900b3350 msgr2=0x7f98900b3ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:48:47.603 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:47.600+0000 7f9894e74640 1 --2- 172.21.15.40:0/1481098258 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f98900b3350 0x7f98900b3ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:47.604 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:47.600+0000 7f9894e74640 1 -- 172.21.15.40:0/1481098258 >> v1:172.21.15.159:6789/0 conn(0x7f98900cfe70 legacy=0x7f98900cdef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:47.604 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:47.600+0000 7f9894e74640 1 -- 172.21.15.40:0/1481098258 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98900d18c0 con 0x7f98900b3730 2023-12-17T11:48:47.604 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:47.600+0000 7f9894e74640 1 -- 172.21.15.40:0/1481098258 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2643242555 0 0) 0x7f9880001670 con 0x7f98900b3730 2023-12-17T11:48:47.604 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:47.600+0000 7f9894e74640 1 -- 172.21.15.40:0/1481098258 >> v1:172.21.15.40:6789/0 conn(0x7f98900b3730 legacy=0x7f98900cf760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:47.604 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:47.600+0000 7f9894e74640 1 --2- 172.21.15.40:0/1481098258 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f987c0039a0 0x7f987c003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:47.604 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:47.600+0000 7f9894e74640 1 --2- 172.21.15.40:0/1481098258 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f98900b3350 0x7f987c0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:47.604 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:47.600+0000 7f9894e74640 1 --2- 172.21.15.40:0/1481098258 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f987c004d00 0x7f987c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:47.604 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:47.600+0000 7f9894e74640 1 -- 172.21.15.40:0/1481098258 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98900d3ed0 con 0x7f987c0039a0 2023-12-17T11:48:47.604 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:47.600+0000 7f9894e74640 1 -- 172.21.15.40:0/1481098258 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f987c00ba60 con 0x7f987c004d00 2023-12-17T11:48:47.604 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:47.600+0000 7f9894e74640 1 -- 172.21.15.40:0/1481098258 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f987c00bc20 con 0x7f98900b3350 2023-12-17T11:48:47.604 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:47.601+0000 7f9895e76640 1 --2- 172.21.15.40:0/1481098258 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f987c0039a0 0x7f987c003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:47.604 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:47.601+0000 7f9895675640 1 --2- 172.21.15.40:0/1481098258 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f98900b3350 0x7f987c0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:47.604 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:47.601+0000 7f9896677640 1 --2- 172.21.15.40:0/1481098258 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f987c004d00 0x7f987c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:47.605 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:47.601+0000 7f9895e76640 1 -- 172.21.15.40:0/1481098258 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f98900b3350 msgr2=0x7f987c0047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:48:47.605 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:47.601+0000 7f9895e76640 1 --2- 172.21.15.40:0/1481098258 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f98900b3350 0x7f987c0047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:47.605 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:47.601+0000 7f9895e76640 1 -- 172.21.15.40:0/1481098258 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f987c004d00 msgr2=0x7f987c005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:48:47.605 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:47.601+0000 7f9895e76640 1 --2- 172.21.15.40:0/1481098258 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f987c004d00 0x7f987c005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:47.605 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:47.601+0000 7f9895e76640 1 -- 172.21.15.40:0/1481098258 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f987c003520 con 0x7f987c0039a0 2023-12-17T11:48:47.605 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:47.601+0000 7f9896677640 1 --2- 172.21.15.40:0/1481098258 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f987c004d00 0x7f987c005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-17T11:48:47.606 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:47.602+0000 7f9895e76640 1 --2- 172.21.15.40:0/1481098258 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f987c0039a0 0x7f987c003dc0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f988c009a90 tx=0x7f987c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ba46cf5414a947a server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:48:47.606 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:47.602+0000 7f9894e74640 1 -- 172.21.15.40:0/1481098258 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f988c02c680 con 0x7f987c0039a0 2023-12-17T11:48:47.606 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:47.602+0000 7f9894e74640 1 -- 172.21.15.40:0/1481098258 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f988c02c7e0 con 0x7f987c0039a0 2023-12-17T11:48:47.606 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:47.603+0000 7f9894e74640 1 -- 172.21.15.40:0/1481098258 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f988c02cb70 con 0x7f987c0039a0 2023-12-17T11:48:47.606 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:47.603+0000 7f9896e78640 1 -- 172.21.15.40:0/1481098258 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f987c0039a0 msgr2=0x7f987c003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:47.606 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:47.603+0000 7f9896e78640 1 --2- 172.21.15.40:0/1481098258 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f987c0039a0 0x7f987c003dc0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f988c009a90 tx=0x7f987c0057f0 comp rx=0 tx=0).stop 2023-12-17T11:48:47.606 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:47.603+0000 7f9896677640 1 -- 172.21.15.40:0/1481098258 reap_dead start 2023-12-17T11:48:47.607 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:47.603+0000 7f9896e78640 1 -- 172.21.15.40:0/1481098258 shutdown_connections 2023-12-17T11:48:47.607 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:47.603+0000 7f9896e78640 1 -- 172.21.15.40:0/1481098258 >> 172.21.15.40:0/1481098258 conn(0x7f98900d3030 msgr2=0x7f98900d3440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:48:47.607 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:47.603+0000 7f9896e78640 1 -- 172.21.15.40:0/1481098258 shutdown_connections 2023-12-17T11:48:47.607 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:47.604+0000 7f9896e78640 1 -- 172.21.15.40:0/1481098258 wait complete. 2023-12-17T11:48:47.607 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:47.605+0000 7f9896e78640 1 Processor -- start 2023-12-17T11:48:47.607 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:47.605+0000 7f9896e78640 1 -- start start 2023-12-17T11:48:47.610 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:47.606+0000 7f9896e78640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f987c0039a0 0x7f9890156500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:47.610 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:47.606+0000 7f9896e78640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f98901582a0 0x7f9890158720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:47.610 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:47.606+0000 7f9896e78640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f98900b6c60 0x7f98900b70e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:47.610 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:47.606+0000 7f9896e78640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98900b7620 con 0x7f98901582a0 2023-12-17T11:48:47.610 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:47.606+0000 7f9896e78640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98900b5c50 con 0x7f98900b6c60 2023-12-17T11:48:47.610 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:47.606+0000 7f9896e78640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98900b5ea0 con 0x7f987c0039a0 2023-12-17T11:48:47.610 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:47.607+0000 7f9895675640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f98901582a0 0x7f9890158720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:47.610 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:47.607+0000 7f9895675640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f98901582a0 0x7f9890158720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:41496/0 (socket says 172.21.15.40:41496) 2023-12-17T11:48:47.610 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:47.607+0000 7f9895675640 1 -- 172.21.15.40:0/4139020914 learned_addr learned my addr 172.21.15.40:0/4139020914 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-17T11:48:47.610 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:47.607+0000 7f9895e76640 1 --2- 172.21.15.40:0/4139020914 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f987c0039a0 0x7f9890156500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:47.610 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:47.607+0000 7f9896677640 1 --2- 172.21.15.40:0/4139020914 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f98900b6c60 0x7f98900b70e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:47.610 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:47.607+0000 7f9895675640 1 -- 172.21.15.40:0/4139020914 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f987c0039a0 msgr2=0x7f9890156500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:47.611 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:47.607+0000 7f9895675640 1 --2- 172.21.15.40:0/4139020914 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f987c0039a0 0x7f9890156500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:47.611 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:47.607+0000 7f9895675640 1 -- 172.21.15.40:0/4139020914 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f98900b6c60 msgr2=0x7f98900b70e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:47.611 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:47.607+0000 7f9895675640 1 --2- 172.21.15.40:0/4139020914 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f98900b6c60 0x7f98900b70e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:47.611 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:47.607+0000 7f9895675640 1 -- 172.21.15.40:0/4139020914 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98900b48a0 con 0x7f98901582a0 2023-12-17T11:48:47.611 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:47.607+0000 7f9895675640 1 --2- 172.21.15.40:0/4139020914 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f98901582a0 0x7f9890158720 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f988000e7f0 tx=0x7f988000ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:48:47.611 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:47.608+0000 7f98867fc640 1 -- 172.21.15.40:0/4139020914 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f988000eea0 con 0x7f98901582a0 2023-12-17T11:48:47.611 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:47.608+0000 7f98867fc640 1 -- 172.21.15.40:0/4139020914 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f988000c870 con 0x7f98901582a0 2023-12-17T11:48:47.611 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:47.608+0000 7f9896e78640 1 -- 172.21.15.40:0/4139020914 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98900b6180 con 0x7f98901582a0 2023-12-17T11:48:47.611 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:47.608+0000 7f98867fc640 1 -- 172.21.15.40:0/4139020914 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f988000cc20 con 0x7f98901582a0 2023-12-17T11:48:47.611 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:47.608+0000 7f9896e78640 1 -- 172.21.15.40:0/4139020914 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98900b6740 con 0x7f98901582a0 2023-12-17T11:48:47.611 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:47.609+0000 7f9896e78640 1 -- 172.21.15.40:0/4139020914 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9890074450 con 0x7f98901582a0 2023-12-17T11:48:47.612 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:47.610+0000 7f98867fc640 1 -- 172.21.15.40:0/4139020914 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f988001d460 con 0x7f98901582a0 2023-12-17T11:48:47.613 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:47.611+0000 7f98867fc640 1 --2- 172.21.15.40:0/4139020914 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f987406ae40 0x7f987406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:47.613 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:47.611+0000 7f98867fc640 1 -- 172.21.15.40:0/4139020914 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f9880089910 con 0x7f98901582a0 2023-12-17T11:48:47.614 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:47.612+0000 7f9895e76640 1 --2- 172.21.15.40:0/4139020914 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f987406ae40 0x7f987406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:47.615 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:47.613+0000 7f9895e76640 1 --2- 172.21.15.40:0/4139020914 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f987406ae40 0x7f987406d300 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f988c036000 tx=0x7f988c030000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:48:47.618 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:47.616+0000 7f98867fc640 1 -- 172.21.15.40:0/4139020914 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f98800546c0 con 0x7f98901582a0 2023-12-17T11:48:47.812 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:47.809+0000 7f9896e78640 1 -- 172.21.15.40:0/4139020914 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f9890072830 con 0x7f98901582a0 2023-12-17T11:48:47.812 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:47.810+0000 7f98867fc640 1 -- 172.21.15.40:0/4139020914 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) v1 ==== 93+0+10 (secure 0 0 0) 0x7f9880057ce0 con 0x7f98901582a0 2023-12-17T11:48:47.812 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 1 2023-12-17T11:48:47.815 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:47.812+0000 7f9896e78640 1 -- 172.21.15.40:0/4139020914 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f987406ae40 msgr2=0x7f987406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:47.815 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:47.812+0000 7f9896e78640 1 --2- 172.21.15.40:0/4139020914 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f987406ae40 0x7f987406d300 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f988c036000 tx=0x7f988c030000 comp rx=0 tx=0).stop 2023-12-17T11:48:47.815 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:47.812+0000 7f9896e78640 1 -- 172.21.15.40:0/4139020914 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f98901582a0 msgr2=0x7f9890158720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:47.815 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:47.812+0000 7f9896e78640 1 --2- 172.21.15.40:0/4139020914 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f98901582a0 0x7f9890158720 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f988000e7f0 tx=0x7f988000ecb0 comp rx=0 tx=0).stop 2023-12-17T11:48:47.815 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:47.813+0000 7f9896e78640 1 -- 172.21.15.40:0/4139020914 shutdown_connections 2023-12-17T11:48:47.815 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:47.813+0000 7f9896e78640 1 --2- 172.21.15.40:0/4139020914 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f987406ae40 0x7f987406d300 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:47.816 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:47.813+0000 7f9896e78640 1 --2- 172.21.15.40:0/4139020914 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f98900b6c60 0x7f98900b70e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:47.816 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:47.813+0000 7f9896e78640 1 --2- 172.21.15.40:0/4139020914 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f98901582a0 0x7f9890158720 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:47.816 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:47.813+0000 7f9896e78640 1 --2- 172.21.15.40:0/4139020914 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f987c0039a0 0x7f9890156500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:47.816 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:47.813+0000 7f9896e78640 1 -- 172.21.15.40:0/4139020914 >> 172.21.15.40:0/4139020914 conn(0x7f98900d3030 msgr2=0x7f989006c430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:48:47.816 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:47.813+0000 7f9896e78640 1 -- 172.21.15.40:0/4139020914 shutdown_connections 2023-12-17T11:48:47.816 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:47.813+0000 7f9896e78640 1 -- 172.21.15.40:0/4139020914 wait complete. 2023-12-17T11:48:47.833 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-17T11:48:48.065 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:48.062+0000 7f1e5ac64640 1 Processor -- start 2023-12-17T11:48:48.065 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:48.062+0000 7f1e5ac64640 1 -- start start 2023-12-17T11:48:48.066 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:48.064+0000 7f1e5ac64640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f1e54143810 0x7f1e540ada80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:48.066 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:48.064+0000 7f1e5ac64640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e54143bf0 con 0x7f1e5406dc10 2023-12-17T11:48:48.067 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:48.064+0000 7f1e5ac64640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e540ae520 con 0x7f1e540cd7d0 2023-12-17T11:48:48.067 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:48.064+0000 7f1e5ac64640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e540ae800 con 0x7f1e54143810 2023-12-17T11:48:48.067 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:48.065+0000 7f1e59201640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f1e5406dc10 0x7f1e54160f40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:57518/0 (socket says 172.21.15.40:57518) 2023-12-17T11:48:48.067 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:48.065+0000 7f1e59201640 1 -- 172.21.15.40:0/4013940477 learned_addr learned my addr 172.21.15.40:0/4013940477 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-12-17T11:48:48.069 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:48.065+0000 7f1e58a00640 1 --2- 172.21.15.40:0/4013940477 >> v2:172.21.15.159:3300/0 conn(0x7f1e54143810 0x7f1e540ada80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:48.069 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:48.065+0000 7f1e537fe640 1 -- 172.21.15.40:0/4013940477 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2695286033 0 0) 0x7f1e54143bf0 con 0x7f1e5406dc10 2023-12-17T11:48:48.069 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:48.065+0000 7f1e537fe640 1 -- 172.21.15.40:0/4013940477 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1e44003520 con 0x7f1e5406dc10 2023-12-17T11:48:48.069 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:48.065+0000 7f1e537fe640 1 -- 172.21.15.40:0/4013940477 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2616134986 0 0) 0x7f1e44003520 con 0x7f1e5406dc10 2023-12-17T11:48:48.069 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:48.065+0000 7f1e537fe640 1 -- 172.21.15.40:0/4013940477 >> v2:172.21.15.159:3300/0 conn(0x7f1e54143810 msgr2=0x7f1e540ada80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:48:48.069 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:48.065+0000 7f1e537fe640 1 --2- 172.21.15.40:0/4013940477 >> v2:172.21.15.159:3300/0 conn(0x7f1e54143810 0x7f1e540ada80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:48.069 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:48.066+0000 7f1e537fe640 1 -- 172.21.15.40:0/4013940477 >> v1:172.21.15.159:6789/0 conn(0x7f1e540cd7d0 legacy=0x7f1e5406d500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:48.069 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:48.066+0000 7f1e537fe640 1 -- 172.21.15.40:0/4013940477 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e540cccf0 con 0x7f1e5406dc10 2023-12-17T11:48:48.069 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:48.066+0000 7f1e537fe640 1 -- 172.21.15.40:0/4013940477 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2643242555 0 0) 0x7f1e4c0019f0 con 0x7f1e5406dc10 2023-12-17T11:48:48.069 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:48.066+0000 7f1e537fe640 1 -- 172.21.15.40:0/4013940477 >> v1:172.21.15.40:6789/0 conn(0x7f1e5406dc10 legacy=0x7f1e54160f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:48.070 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:48.066+0000 7f1e537fe640 1 --2- 172.21.15.40:0/4013940477 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1e440039c0 0x7f1e44003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:48.070 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:48.066+0000 7f1e537fe640 1 --2- 172.21.15.40:0/4013940477 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1e440047c0 0x7f1e44004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:48.070 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:48.066+0000 7f1e537fe640 1 --2- 172.21.15.40:0/4013940477 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1e44005180 0x7f1e4400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:48.070 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:48.066+0000 7f1e537fe640 1 -- 172.21.15.40:0/4013940477 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e540ae800 con 0x7f1e440039c0 2023-12-17T11:48:48.070 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:48.066+0000 7f1e537fe640 1 -- 172.21.15.40:0/4013940477 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e4400c080 con 0x7f1e44005180 2023-12-17T11:48:48.070 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:48.066+0000 7f1e537fe640 1 -- 172.21.15.40:0/4013940477 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e4400c240 con 0x7f1e440047c0 2023-12-17T11:48:48.070 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:48.066+0000 7f1e58a00640 1 --2- 172.21.15.40:0/4013940477 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1e440039c0 0x7f1e44003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:48.070 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:48.066+0000 7f1e59201640 1 --2- 172.21.15.40:0/4013940477 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1e44005180 0x7f1e4400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:48.070 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:48.066+0000 7f1e58a00640 1 -- 172.21.15.40:0/4013940477 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1e440047c0 msgr2=0x7f1e44004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:48:48.070 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:48.066+0000 7f1e58a00640 1 --2- 172.21.15.40:0/4013940477 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1e440047c0 0x7f1e44004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:48.070 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:48.066+0000 7f1e58a00640 1 -- 172.21.15.40:0/4013940477 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1e44005180 msgr2=0x7f1e4400b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:48:48.070 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:48.066+0000 7f1e58a00640 1 --2- 172.21.15.40:0/4013940477 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1e44005180 0x7f1e4400b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:48.070 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:48.066+0000 7f1e58a00640 1 -- 172.21.15.40:0/4013940477 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e44003520 con 0x7f1e440039c0 2023-12-17T11:48:48.070 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:48.066+0000 7f1e59201640 1 -- 172.21.15.40:0/4013940477 reap_dead start 2023-12-17T11:48:48.071 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:48.068+0000 7f1e58a00640 1 --2- 172.21.15.40:0/4013940477 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1e440039c0 0x7f1e44003de0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f1e48009ac0 tx=0x7f1e440057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33350de073709c38 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:48:48.072 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:48.068+0000 7f1e537fe640 1 -- 172.21.15.40:0/4013940477 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e4802c6b0 con 0x7f1e440039c0 2023-12-17T11:48:48.072 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:48.068+0000 7f1e537fe640 1 -- 172.21.15.40:0/4013940477 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e4802c810 con 0x7f1e440039c0 2023-12-17T11:48:48.072 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:48.068+0000 7f1e537fe640 1 -- 172.21.15.40:0/4013940477 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e4802cba0 con 0x7f1e440039c0 2023-12-17T11:48:48.072 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:48.068+0000 7f1e5ac64640 1 -- 172.21.15.40:0/4013940477 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1e440039c0 msgr2=0x7f1e44003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:48.072 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:48.068+0000 7f1e5ac64640 1 --2- 172.21.15.40:0/4013940477 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1e440039c0 0x7f1e44003de0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f1e48009ac0 tx=0x7f1e440057f0 comp rx=0 tx=0).stop 2023-12-17T11:48:48.072 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:48.069+0000 7f1e5ac64640 1 -- 172.21.15.40:0/4013940477 shutdown_connections 2023-12-17T11:48:48.072 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:48.069+0000 7f1e5ac64640 1 --2- 172.21.15.40:0/4013940477 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1e440039c0 0x7f1e44003de0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:48.072 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:48.069+0000 7f1e5ac64640 1 -- 172.21.15.40:0/4013940477 >> 172.21.15.40:0/4013940477 conn(0x7f1e540cb850 msgr2=0x7f1e540cbc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:48:48.072 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:48.069+0000 7f1e5ac64640 1 -- 172.21.15.40:0/4013940477 shutdown_connections 2023-12-17T11:48:48.072 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:48.069+0000 7f1e5ac64640 1 -- 172.21.15.40:0/4013940477 wait complete. 2023-12-17T11:48:48.073 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:48.070+0000 7f1e5ac64640 1 Processor -- start 2023-12-17T11:48:48.073 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:48.071+0000 7f1e5ac64640 1 -- start start 2023-12-17T11:48:48.074 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:48.071+0000 7f1e5ac64640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1e440039c0 0x7f1e5415c3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:48.074 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:48.071+0000 7f1e5ac64640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1e54141050 0x7f1e54141f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:48.074 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:48.072+0000 7f1e5ac64640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1e54071530 0x7f1e540719e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:48.074 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:48.072+0000 7f1e5ac64640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e54071f20 con 0x7f1e54071530 2023-12-17T11:48:48.074 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:48.072+0000 7f1e5ac64640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e5415c920 con 0x7f1e54141050 2023-12-17T11:48:48.074 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:48.072+0000 7f1e5ac64640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e540b3590 con 0x7f1e440039c0 2023-12-17T11:48:48.074 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:48.072+0000 7f1e59201640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1e54071530 0x7f1e540719e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:48.074 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:48.072+0000 7f1e59201640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1e54071530 0x7f1e540719e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:41514/0 (socket says 172.21.15.40:41514) 2023-12-17T11:48:48.074 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:48.072+0000 7f1e59201640 1 -- 172.21.15.40:0/275853717 learned_addr learned my addr 172.21.15.40:0/275853717 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-17T11:48:48.075 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:48.072+0000 7f1e58a00640 1 --2- 172.21.15.40:0/275853717 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1e440039c0 0x7f1e5415c3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:48.076 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:48.072+0000 7f1e53fff640 1 --2- 172.21.15.40:0/275853717 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1e54141050 0x7f1e54141f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:48.076 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:48.072+0000 7f1e59201640 1 -- 172.21.15.40:0/275853717 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1e440039c0 msgr2=0x7f1e5415c3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:48.076 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:48.072+0000 7f1e59201640 1 --2- 172.21.15.40:0/275853717 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1e440039c0 0x7f1e5415c3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:48.076 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:48.072+0000 7f1e59201640 1 -- 172.21.15.40:0/275853717 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1e54141050 msgr2=0x7f1e54141f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:48.076 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:48.072+0000 7f1e59201640 1 --2- 172.21.15.40:0/275853717 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1e54141050 0x7f1e54141f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:48.076 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:48.072+0000 7f1e59201640 1 -- 172.21.15.40:0/275853717 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e540b3830 con 0x7f1e54071530 2023-12-17T11:48:48.076 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:48.072+0000 7f1e53fff640 1 --2- 172.21.15.40:0/275853717 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1e54141050 0x7f1e54141f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-17T11:48:48.076 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:48.073+0000 7f1e59201640 1 --2- 172.21.15.40:0/275853717 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1e54071530 0x7f1e540719e0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f1e5406e4f0 tx=0x7f1e4c007bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:48:48.076 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:48.073+0000 7f1e517fa640 1 -- 172.21.15.40:0/275853717 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e4c00eaa0 con 0x7f1e54071530 2023-12-17T11:48:48.076 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:48.073+0000 7f1e517fa640 1 -- 172.21.15.40:0/275853717 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e4c00ec00 con 0x7f1e54071530 2023-12-17T11:48:48.076 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:48.073+0000 7f1e517fa640 1 -- 172.21.15.40:0/275853717 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e4c013420 con 0x7f1e54071530 2023-12-17T11:48:48.076 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:48.073+0000 7f1e5ac64640 1 -- 172.21.15.40:0/275853717 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e540b3b10 con 0x7f1e54071530 2023-12-17T11:48:48.076 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:48.073+0000 7f1e5ac64640 1 -- 172.21.15.40:0/275853717 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e540b40d0 con 0x7f1e54071530 2023-12-17T11:48:48.077 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:48.075+0000 7f1e5ac64640 1 -- 172.21.15.40:0/275853717 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e540b4290 con 0x7f1e54071530 2023-12-17T11:48:48.077 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:48.076+0000 7f1e517fa640 1 -- 172.21.15.40:0/275853717 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f1e4c013580 con 0x7f1e54071530 2023-12-17T11:48:48.078 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:48.076+0000 7f1e517fa640 1 --2- 172.21.15.40:0/275853717 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f1e3806ae70 0x7f1e3806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:48.078 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:48.077+0000 7f1e517fa640 1 -- 172.21.15.40:0/275853717 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f1e4c089bc0 con 0x7f1e54071530 2023-12-17T11:48:48.079 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:48.077+0000 7f1e58a00640 1 --2- 172.21.15.40:0/275853717 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f1e3806ae70 0x7f1e3806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:48.080 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:48.078+0000 7f1e58a00640 1 --2- 172.21.15.40:0/275853717 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f1e3806ae70 0x7f1e3806d330 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f1e48036000 tx=0x7f1e48030000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:48:48.083 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:48.081+0000 7f1e517fa640 1 -- 172.21.15.40:0/275853717 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f1e4c054a10 con 0x7f1e54071530 2023-12-17T11:48:48.277 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:48.275+0000 7f1e5ac64640 1 -- 172.21.15.40:0/275853717 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f1e54143370 con 0x7f1e54071530 2023-12-17T11:48:48.278 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:48.276+0000 7f1e517fa640 1 -- 172.21.15.40:0/275853717 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) v1 ==== 104+0+11 (secure 0 0 0) 0x7f1e4c058030 con 0x7f1e54071530 2023-12-17T11:48:48.278 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 32 2023-12-17T11:48:48.281 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:48.278+0000 7f1e5ac64640 1 -- 172.21.15.40:0/275853717 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f1e3806ae70 msgr2=0x7f1e3806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:48.281 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:48.278+0000 7f1e5ac64640 1 --2- 172.21.15.40:0/275853717 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f1e3806ae70 0x7f1e3806d330 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f1e48036000 tx=0x7f1e48030000 comp rx=0 tx=0).stop 2023-12-17T11:48:48.281 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:48.278+0000 7f1e5ac64640 1 -- 172.21.15.40:0/275853717 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1e54071530 msgr2=0x7f1e540719e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:48.281 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:48.278+0000 7f1e5ac64640 1 --2- 172.21.15.40:0/275853717 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1e54071530 0x7f1e540719e0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f1e5406e4f0 tx=0x7f1e4c007bc0 comp rx=0 tx=0).stop 2023-12-17T11:48:48.281 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:48.279+0000 7f1e5ac64640 1 -- 172.21.15.40:0/275853717 shutdown_connections 2023-12-17T11:48:48.281 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:48.279+0000 7f1e5ac64640 1 --2- 172.21.15.40:0/275853717 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f1e3806ae70 0x7f1e3806d330 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:48.281 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:48.279+0000 7f1e5ac64640 1 --2- 172.21.15.40:0/275853717 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1e54071530 0x7f1e540719e0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:48.281 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:48.279+0000 7f1e5ac64640 1 --2- 172.21.15.40:0/275853717 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1e54141050 0x7f1e54141f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:48.281 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:48.279+0000 7f1e5ac64640 1 --2- 172.21.15.40:0/275853717 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1e440039c0 0x7f1e5415c3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:48.281 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:48.279+0000 7f1e5ac64640 1 -- 172.21.15.40:0/275853717 >> 172.21.15.40:0/275853717 conn(0x7f1e540cb850 msgr2=0x7f1e5413fbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:48:48.282 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:48.279+0000 7f1e5ac64640 1 -- 172.21.15.40:0/275853717 shutdown_connections 2023-12-17T11:48:48.282 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:48.279+0000 7f1e5ac64640 1 -- 172.21.15.40:0/275853717 wait complete. 2023-12-17T11:48:48.302 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-17T11:48:48.531 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:48.529+0000 7f2df3fff640 1 Processor -- start 2023-12-17T11:48:48.531 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:48.529+0000 7f2df3fff640 1 -- start start 2023-12-17T11:48:48.534 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:48.531+0000 7f2df3fff640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2df4162440 0x7f2df40cedf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:48.534 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:48.531+0000 7f2df3fff640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f2df40cf330 0x7f2df40abd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:48.534 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:48.531+0000 7f2df3fff640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2df40cf780 con 0x7f2df415eec0 2023-12-17T11:48:48.535 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:48.531+0000 7f2df3fff640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2df406bdf0 con 0x7f2df40cf330 2023-12-17T11:48:48.535 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:48.531+0000 7f2df3fff640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2df4070430 con 0x7f2df4162440 2023-12-17T11:48:48.535 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:48.532+0000 7f2df37fe640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f2df40cf330 0x7f2df40abd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:48.535 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:48.532+0000 7f2df37fe640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f2df40cf330 0x7f2df40abd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:41518/0 (socket says 172.21.15.40:41518) 2023-12-17T11:48:48.535 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:48.532+0000 7f2df37fe640 1 -- 172.21.15.40:0/1949027842 learned_addr learned my addr 172.21.15.40:0/1949027842 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-17T11:48:48.535 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:48.532+0000 7f2dea7fc640 1 --2- 172.21.15.40:0/1949027842 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2df4162440 0x7f2df40cedf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:48.535 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:48.532+0000 7f2df37fe640 1 -- 172.21.15.40:0/1949027842 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2df4162440 msgr2=0x7f2df40cedf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:48:48.535 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:48.532+0000 7f2df37fe640 1 --2- 172.21.15.40:0/1949027842 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2df4162440 0x7f2df40cedf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:48.535 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:48.532+0000 7f2df37fe640 1 -- 172.21.15.40:0/1949027842 >> v1:172.21.15.159:6789/0 conn(0x7f2df415eec0 legacy=0x7f2df406c8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:48.535 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:48.532+0000 7f2df37fe640 1 -- 172.21.15.40:0/1949027842 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2df4070710 con 0x7f2df40cf330 2023-12-17T11:48:48.536 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:48.534+0000 7f2df37fe640 1 --2- 172.21.15.40:0/1949027842 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2df40cf330 0x7f2df40abd20 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f2dec009870 tx=0x7f2dec02b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e0126d803368556 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:48:48.536 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:48.534+0000 7f2df27fc640 1 -- 172.21.15.40:0/1949027842 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dec030840 con 0x7f2df40cf330 2023-12-17T11:48:48.536 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:48.534+0000 7f2df27fc640 1 -- 172.21.15.40:0/1949027842 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2dec0309a0 con 0x7f2df40cf330 2023-12-17T11:48:48.536 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:48.534+0000 7f2df27fc640 1 -- 172.21.15.40:0/1949027842 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dec030d30 con 0x7f2df40cf330 2023-12-17T11:48:48.537 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:48.535+0000 7f2df3fff640 1 -- 172.21.15.40:0/1949027842 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2df40cf330 msgr2=0x7f2df40abd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:48.537 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:48.535+0000 7f2df3fff640 1 --2- 172.21.15.40:0/1949027842 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2df40cf330 0x7f2df40abd20 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f2dec009870 tx=0x7f2dec02b980 comp rx=0 tx=0).stop 2023-12-17T11:48:48.537 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:48.535+0000 7f2df3fff640 1 -- 172.21.15.40:0/1949027842 shutdown_connections 2023-12-17T11:48:48.537 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:48.535+0000 7f2df3fff640 1 --2- 172.21.15.40:0/1949027842 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2df40cf330 0x7f2df40abd20 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:48.537 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:48.535+0000 7f2df3fff640 1 --2- 172.21.15.40:0/1949027842 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2df4162440 0x7f2df40cedf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:48.537 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:48.535+0000 7f2df3fff640 1 -- 172.21.15.40:0/1949027842 >> 172.21.15.40:0/1949027842 conn(0x7f2df406a640 msgr2=0x7f2df406aa50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:48:48.538 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:48.535+0000 7f2df3fff640 1 -- 172.21.15.40:0/1949027842 shutdown_connections 2023-12-17T11:48:48.538 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:48.535+0000 7f2df3fff640 1 -- 172.21.15.40:0/1949027842 wait complete. 2023-12-17T11:48:48.539 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:48.537+0000 7f2df3fff640 1 Processor -- start 2023-12-17T11:48:48.539 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:48.537+0000 7f2df3fff640 1 -- start start 2023-12-17T11:48:48.540 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:48.538+0000 7f2df3fff640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2df40cf330 0x7f2df40999f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:48.540 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:48.538+0000 7f2df3fff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2df415eec0 0x7f2df41654b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:48.540 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:48.538+0000 7f2df3fff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2df4162440 0x7f2df414fd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:48.540 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:48.538+0000 7f2df3fff640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2df409cb90 con 0x7f2df4162440 2023-12-17T11:48:48.541 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:48.538+0000 7f2df3fff640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2df41659f0 con 0x7f2df415eec0 2023-12-17T11:48:48.541 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:48.538+0000 7f2df3fff640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2df409a0d0 con 0x7f2df40cf330 2023-12-17T11:48:48.541 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:48.538+0000 7f2df37fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2df4162440 0x7f2df414fd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:48.541 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:48.538+0000 7f2df37fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2df4162440 0x7f2df414fd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:41532/0 (socket says 172.21.15.40:41532) 2023-12-17T11:48:48.541 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:48.538+0000 7f2df37fe640 1 -- 172.21.15.40:0/2025132497 learned_addr learned my addr 172.21.15.40:0/2025132497 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-17T11:48:48.541 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:48.539+0000 7f2df2ffd640 1 --2- 172.21.15.40:0/2025132497 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2df40cf330 0x7f2df40999f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:48.543 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:48.539+0000 7f2dea7fc640 1 --2- 172.21.15.40:0/2025132497 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2df415eec0 0x7f2df41654b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:48.543 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:48.539+0000 7f2df37fe640 1 -- 172.21.15.40:0/2025132497 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2df40cf330 msgr2=0x7f2df40999f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:48.543 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:48.539+0000 7f2df37fe640 1 --2- 172.21.15.40:0/2025132497 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2df40cf330 0x7f2df40999f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:48.543 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:48.539+0000 7f2df37fe640 1 -- 172.21.15.40:0/2025132497 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2df415eec0 msgr2=0x7f2df41654b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:48.543 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:48.539+0000 7f2df37fe640 1 --2- 172.21.15.40:0/2025132497 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2df415eec0 0x7f2df41654b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:48.543 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:48.539+0000 7f2df37fe640 1 -- 172.21.15.40:0/2025132497 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2dec0094d0 con 0x7f2df4162440 2023-12-17T11:48:48.543 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:48.539+0000 7f2df37fe640 1 --2- 172.21.15.40:0/2025132497 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2df4162440 0x7f2df414fd30 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f2dec02b9c0 tx=0x7f2dec004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:48:48.543 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:48.539+0000 7f2df0ff9640 1 -- 172.21.15.40:0/2025132497 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dec039c90 con 0x7f2df4162440 2023-12-17T11:48:48.543 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:48.540+0000 7f2df0ff9640 1 -- 172.21.15.40:0/2025132497 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2dec039e10 con 0x7f2df4162440 2023-12-17T11:48:48.543 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:48.540+0000 7f2df0ff9640 1 -- 172.21.15.40:0/2025132497 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dec0446c0 con 0x7f2df4162440 2023-12-17T11:48:48.543 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:48.540+0000 7f2df3fff640 1 -- 172.21.15.40:0/2025132497 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2df409c260 con 0x7f2df4162440 2023-12-17T11:48:48.544 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:48.540+0000 7f2df3fff640 1 -- 172.21.15.40:0/2025132497 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2df409c820 con 0x7f2df4162440 2023-12-17T11:48:48.544 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:48.541+0000 7f2df3fff640 1 -- 172.21.15.40:0/2025132497 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2df409cd40 con 0x7f2df4162440 2023-12-17T11:48:48.544 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:48.542+0000 7f2df0ff9640 1 -- 172.21.15.40:0/2025132497 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f2dec04d3b0 con 0x7f2df4162440 2023-12-17T11:48:48.545 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:48.543+0000 7f2df0ff9640 1 --2- 172.21.15.40:0/2025132497 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f2dd406ae40 0x7f2dd406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:48.545 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:48.543+0000 7f2df0ff9640 1 -- 172.21.15.40:0/2025132497 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f2dec03e070 con 0x7f2df4162440 2023-12-17T11:48:48.545 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:48.544+0000 7f2df2ffd640 1 --2- 172.21.15.40:0/2025132497 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f2dd406ae40 0x7f2dd406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:48.546 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:48.545+0000 7f2df2ffd640 1 --2- 172.21.15.40:0/2025132497 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f2dd406ae40 0x7f2dd406d300 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f2de40012e0 tx=0x7f2de4009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:48:48.550 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:48.548+0000 7f2df0ff9640 1 -- 172.21.15.40:0/2025132497 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f2df409cd40 con 0x7f2df4162440 2023-12-17T11:48:48.787 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:48.785+0000 7f2df3fff640 1 -- 172.21.15.40:0/2025132497 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f2df409cd40 con 0x7f2df4162440 2023-12-17T11:48:48.787 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:48.786+0000 7f2df0ff9640 1 -- 172.21.15.40:0/2025132497 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) v1 ==== 100+0+11 (secure 0 0 0) 0x7f2df409cd40 con 0x7f2df4162440 2023-12-17T11:48:48.788 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 64 2023-12-17T11:48:48.791 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:48.789+0000 7f2df3fff640 1 -- 172.21.15.40:0/2025132497 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f2dd406ae40 msgr2=0x7f2dd406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:48.791 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:48.789+0000 7f2df3fff640 1 --2- 172.21.15.40:0/2025132497 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f2dd406ae40 0x7f2dd406d300 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f2de40012e0 tx=0x7f2de4009040 comp rx=0 tx=0).stop 2023-12-17T11:48:48.791 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:48.789+0000 7f2df3fff640 1 -- 172.21.15.40:0/2025132497 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2df4162440 msgr2=0x7f2df414fd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:48.791 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:48.789+0000 7f2df3fff640 1 --2- 172.21.15.40:0/2025132497 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2df4162440 0x7f2df414fd30 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f2dec02b9c0 tx=0x7f2dec004730 comp rx=0 tx=0).stop 2023-12-17T11:48:48.791 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:48.789+0000 7f2df3fff640 1 -- 172.21.15.40:0/2025132497 shutdown_connections 2023-12-17T11:48:48.791 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:48.789+0000 7f2df3fff640 1 --2- 172.21.15.40:0/2025132497 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f2dd406ae40 0x7f2dd406d300 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:48.792 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:48.789+0000 7f2df3fff640 1 --2- 172.21.15.40:0/2025132497 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2df4162440 0x7f2df414fd30 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:48.792 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:48.789+0000 7f2df3fff640 1 --2- 172.21.15.40:0/2025132497 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2df415eec0 0x7f2df41654b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:48.792 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:48.789+0000 7f2df3fff640 1 --2- 172.21.15.40:0/2025132497 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2df40cf330 0x7f2df40999f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:48.792 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:48.789+0000 7f2df3fff640 1 -- 172.21.15.40:0/2025132497 >> 172.21.15.40:0/2025132497 conn(0x7f2df406a640 msgr2=0x7f2df40b3940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:48:48.792 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:48.789+0000 7f2df3fff640 1 -- 172.21.15.40:0/2025132497 shutdown_connections 2023-12-17T11:48:48.792 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:48.789+0000 7f2df3fff640 1 -- 172.21.15.40:0/2025132497 wait complete. 2023-12-17T11:48:48.809 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-12-17T11:48:49.032 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:49.030+0000 7fd0c90ff640 1 Processor -- start 2023-12-17T11:48:49.033 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:49.031+0000 7fd0c90ff640 1 -- start start 2023-12-17T11:48:49.034 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:49.032+0000 7fd0c90ff640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd0c415ba90 0x7fd0c406d370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:49.034 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:49.032+0000 7fd0c90ff640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0c406d950 con 0x7fd0c40b2aa0 2023-12-17T11:48:49.034 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:49.032+0000 7fd0c90ff640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0c40cc720 con 0x7fd0c40cc2f0 2023-12-17T11:48:49.035 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:49.032+0000 7fd0c90ff640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0c40b3fe0 con 0x7fd0c415ba90 2023-12-17T11:48:49.035 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:49.033+0000 7fd0bbfff640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fd0c40b2aa0 0x7fd0c40cbbe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:57524/0 (socket says 172.21.15.40:57524) 2023-12-17T11:48:49.035 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:49.033+0000 7fd0bbfff640 1 -- 172.21.15.40:0/274059555 learned_addr learned my addr 172.21.15.40:0/274059555 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-12-17T11:48:49.035 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:49.033+0000 7fd0c3fff640 1 --2- 172.21.15.40:0/274059555 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd0c415ba90 0x7fd0c406d370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:49.036 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:49.033+0000 7fd0c37fe640 1 -- 172.21.15.40:0/274059555 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2251588565 0 0) 0x7fd0c406d950 con 0x7fd0c40b2aa0 2023-12-17T11:48:49.036 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:49.033+0000 7fd0c37fe640 1 -- 172.21.15.40:0/274059555 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd0b0003520 con 0x7fd0c40b2aa0 2023-12-17T11:48:49.036 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:49.033+0000 7fd0c3fff640 1 -- 172.21.15.40:0/274059555 >> v1:172.21.15.159:6789/0 conn(0x7fd0c40cc2f0 legacy=0x7fd0c4161a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:49.036 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:49.033+0000 7fd0c3fff640 1 -- 172.21.15.40:0/274059555 >> v1:172.21.15.40:6789/0 conn(0x7fd0c40b2aa0 legacy=0x7fd0c40cbbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:49.036 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:49.033+0000 7fd0c37fe640 1 -- 172.21.15.40:0/274059555 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 525759309 0 0) 0x7fd0b0003520 con 0x7fd0c40b2aa0 2023-12-17T11:48:49.036 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:49.033+0000 7fd0c3fff640 1 -- 172.21.15.40:0/274059555 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0c406c0b0 con 0x7fd0c415ba90 2023-12-17T11:48:49.036 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:49.035+0000 7fd0c3fff640 1 --2- 172.21.15.40:0/274059555 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd0c415ba90 0x7fd0c406d370 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fd0b40097d0 tx=0x7fd0b402b770 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4be67636df1da55a server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:48:49.037 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:49.035+0000 7fd0c37fe640 1 -- 172.21.15.40:0/274059555 <== mon.2 v2:172.21.15.159:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0ac001670 con 0x7fd0c415ba90 2023-12-17T11:48:49.037 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:49.035+0000 7fd0c37fe640 1 -- 172.21.15.40:0/274059555 <== mon.2 v2:172.21.15.159:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0b402e050 con 0x7fd0c415ba90 2023-12-17T11:48:49.037 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:49.035+0000 7fd0c37fe640 1 -- 172.21.15.40:0/274059555 <== mon.2 v2:172.21.15.159:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0b4030710 con 0x7fd0c415ba90 2023-12-17T11:48:49.038 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:49.036+0000 7fd0c90ff640 1 -- 172.21.15.40:0/274059555 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd0c415ba90 msgr2=0x7fd0c406d370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:49.038 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:49.036+0000 7fd0c90ff640 1 --2- 172.21.15.40:0/274059555 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd0c415ba90 0x7fd0c406d370 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fd0b40097d0 tx=0x7fd0b402b770 comp rx=0 tx=0).stop 2023-12-17T11:48:49.038 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:49.036+0000 7fd0c90ff640 1 -- 172.21.15.40:0/274059555 shutdown_connections 2023-12-17T11:48:49.038 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:49.036+0000 7fd0c90ff640 1 --2- 172.21.15.40:0/274059555 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd0c415ba90 0x7fd0c406d370 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:49.038 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:49.036+0000 7fd0c90ff640 1 -- 172.21.15.40:0/274059555 >> 172.21.15.40:0/274059555 conn(0x7fd0c40b0940 msgr2=0x7fd0c40b0d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:48:49.038 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:49.036+0000 7fd0c90ff640 1 -- 172.21.15.40:0/274059555 shutdown_connections 2023-12-17T11:48:49.039 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:49.036+0000 7fd0c90ff640 1 -- 172.21.15.40:0/274059555 wait complete. 2023-12-17T11:48:49.040 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:49.038+0000 7fd0c90ff640 1 Processor -- start 2023-12-17T11:48:49.040 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:49.038+0000 7fd0c90ff640 1 -- start start 2023-12-17T11:48:49.042 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:49.039+0000 7fd0c90ff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd0c40b2aa0 0x7fd0c41f7970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:49.042 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:49.039+0000 7fd0c90ff640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd0c40cc2f0 0x7fd0c409af50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:49.042 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:49.039+0000 7fd0c90ff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd0c415ba90 0x7fd0c409b490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:49.042 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:49.039+0000 7fd0c90ff640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0c414bf10 con 0x7fd0c40b2aa0 2023-12-17T11:48:49.042 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:49.039+0000 7fd0c90ff640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0c409aac0 con 0x7fd0c415ba90 2023-12-17T11:48:49.042 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:49.039+0000 7fd0c90ff640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0c41f7eb0 con 0x7fd0c40cc2f0 2023-12-17T11:48:49.042 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:49.039+0000 7fd0c3fff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd0c40b2aa0 0x7fd0c41f7970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:49.042 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:49.039+0000 7fd0c3fff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd0c40b2aa0 0x7fd0c41f7970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:41546/0 (socket says 172.21.15.40:41546) 2023-12-17T11:48:49.042 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:49.039+0000 7fd0c3fff640 1 -- 172.21.15.40:0/1766886192 learned_addr learned my addr 172.21.15.40:0/1766886192 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-17T11:48:49.043 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:49.040+0000 7fd0bbfff640 1 --2- 172.21.15.40:0/1766886192 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd0c40cc2f0 0x7fd0c409af50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:49.043 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:49.040+0000 7fd0c88fe640 1 --2- 172.21.15.40:0/1766886192 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd0c415ba90 0x7fd0c409b490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:49.043 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:49.040+0000 7fd0c3fff640 1 -- 172.21.15.40:0/1766886192 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd0c40cc2f0 msgr2=0x7fd0c409af50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:49.043 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:49.040+0000 7fd0c3fff640 1 --2- 172.21.15.40:0/1766886192 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd0c40cc2f0 0x7fd0c409af50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:49.043 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:49.040+0000 7fd0c3fff640 1 -- 172.21.15.40:0/1766886192 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd0c415ba90 msgr2=0x7fd0c409b490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:49.043 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:49.040+0000 7fd0c3fff640 1 --2- 172.21.15.40:0/1766886192 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd0c415ba90 0x7fd0c409b490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:49.043 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:49.040+0000 7fd0c3fff640 1 -- 172.21.15.40:0/1766886192 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0b4009400 con 0x7fd0c40b2aa0 2023-12-17T11:48:49.043 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:49.040+0000 7fd0bbfff640 1 --2- 172.21.15.40:0/1766886192 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd0c40cc2f0 0x7fd0c409af50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-17T11:48:49.043 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:49.040+0000 7fd0c88fe640 1 --2- 172.21.15.40:0/1766886192 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd0c415ba90 0x7fd0c409b490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-17T11:48:49.043 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:49.040+0000 7fd0c3fff640 1 --2- 172.21.15.40:0/1766886192 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd0c40b2aa0 0x7fd0c41f7970 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fd0b40098f0 tx=0x7fd0b40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:48:49.044 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:49.040+0000 7fd0c17fa640 1 -- 172.21.15.40:0/1766886192 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0b4003c50 con 0x7fd0c40b2aa0 2023-12-17T11:48:49.044 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:49.040+0000 7fd0c17fa640 1 -- 172.21.15.40:0/1766886192 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0b4003db0 con 0x7fd0c40b2aa0 2023-12-17T11:48:49.044 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:49.040+0000 7fd0c90ff640 1 -- 172.21.15.40:0/1766886192 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0c4099eb0 con 0x7fd0c40b2aa0 2023-12-17T11:48:49.044 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:49.041+0000 7fd0c17fa640 1 -- 172.21.15.40:0/1766886192 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0b4030710 con 0x7fd0c40b2aa0 2023-12-17T11:48:49.044 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:49.041+0000 7fd0c90ff640 1 -- 172.21.15.40:0/1766886192 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0c409a470 con 0x7fd0c40b2aa0 2023-12-17T11:48:49.044 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:49.042+0000 7fd0c90ff640 1 -- 172.21.15.40:0/1766886192 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0c4067910 con 0x7fd0c40b2aa0 2023-12-17T11:48:49.045 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:49.043+0000 7fd0c17fa640 1 -- 172.21.15.40:0/1766886192 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fd0b4030870 con 0x7fd0c40b2aa0 2023-12-17T11:48:49.045 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:49.044+0000 7fd0c17fa640 1 --2- 172.21.15.40:0/1766886192 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7fd0a406ae40 0x7fd0a406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:49.045 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:49.044+0000 7fd0c17fa640 1 -- 172.21.15.40:0/1766886192 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fd0b40ab610 con 0x7fd0c40b2aa0 2023-12-17T11:48:49.046 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:49.044+0000 7fd0bbfff640 1 --2- 172.21.15.40:0/1766886192 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7fd0a406ae40 0x7fd0a406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:49.047 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:49.045+0000 7fd0bbfff640 1 --2- 172.21.15.40:0/1766886192 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7fd0a406ae40 0x7fd0a406d300 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fd0ac0011e0 tx=0x7fd0ac009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:48:49.050 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:49.048+0000 7fd0c17fa640 1 -- 172.21.15.40:0/1766886192 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fd0b40763d0 con 0x7fd0c40b2aa0 2023-12-17T11:48:49.249 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:49.247+0000 7fd0c90ff640 1 -- 172.21.15.40:0/1766886192 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fd0c4074450 con 0x7fd0c40b2aa0 2023-12-17T11:48:49.250 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:49.248+0000 7fd0c17fa640 1 -- 172.21.15.40:0/1766886192 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v25) v1 ==== 103+0+11 (secure 0 0 0) 0x7fd0b40799f0 con 0x7fd0c40b2aa0 2023-12-17T11:48:49.250 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 32 2023-12-17T11:48:49.253 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:49.251+0000 7fd0c90ff640 1 -- 172.21.15.40:0/1766886192 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7fd0a406ae40 msgr2=0x7fd0a406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:49.253 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:49.251+0000 7fd0c90ff640 1 --2- 172.21.15.40:0/1766886192 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7fd0a406ae40 0x7fd0a406d300 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fd0ac0011e0 tx=0x7fd0ac009040 comp rx=0 tx=0).stop 2023-12-17T11:48:49.254 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:49.251+0000 7fd0c90ff640 1 -- 172.21.15.40:0/1766886192 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd0c40b2aa0 msgr2=0x7fd0c41f7970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:49.254 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:49.251+0000 7fd0c90ff640 1 --2- 172.21.15.40:0/1766886192 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd0c40b2aa0 0x7fd0c41f7970 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fd0b40098f0 tx=0x7fd0b40046c0 comp rx=0 tx=0).stop 2023-12-17T11:48:49.254 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:49.251+0000 7fd0c90ff640 1 -- 172.21.15.40:0/1766886192 shutdown_connections 2023-12-17T11:48:49.254 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:49.251+0000 7fd0c90ff640 1 --2- 172.21.15.40:0/1766886192 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7fd0a406ae40 0x7fd0a406d300 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:49.254 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:49.251+0000 7fd0c90ff640 1 --2- 172.21.15.40:0/1766886192 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd0c415ba90 0x7fd0c409b490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:49.254 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:49.251+0000 7fd0c90ff640 1 --2- 172.21.15.40:0/1766886192 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd0c40cc2f0 0x7fd0c409af50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:49.254 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:49.251+0000 7fd0c90ff640 1 --2- 172.21.15.40:0/1766886192 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd0c40b2aa0 0x7fd0c41f7970 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:49.254 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:49.251+0000 7fd0c90ff640 1 -- 172.21.15.40:0/1766886192 >> 172.21.15.40:0/1766886192 conn(0x7fd0c40b0940 msgr2=0x7fd0c4159f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:48:49.254 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:49.251+0000 7fd0c90ff640 1 -- 172.21.15.40:0/1766886192 shutdown_connections 2023-12-17T11:48:49.254 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:49.251+0000 7fd0c90ff640 1 -- 172.21.15.40:0/1766886192 wait complete. 2023-12-17T11:48:49.275 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-17T11:48:49.498 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:49.496+0000 7f3c9bfff640 1 Processor -- start 2023-12-17T11:48:49.499 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:49.497+0000 7f3c9bfff640 1 -- start start 2023-12-17T11:48:49.501 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:49.499+0000 7f3c9bfff640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f3c9c070780 0x7f3c9c071ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:49.501 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:49.499+0000 7f3c9bfff640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f3c9c06dd00 0x7f3c9c06c690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:49.501 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:49.499+0000 7f3c9bfff640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c9c0abd20 con 0x7f3c9c15d150 2023-12-17T11:48:49.501 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:49.499+0000 7f3c9bfff640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c9c15d530 con 0x7f3c9c06dd00 2023-12-17T11:48:49.501 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:49.499+0000 7f3c9bfff640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c9c0b2950 con 0x7f3c9c070780 2023-12-17T11:48:49.501 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:49.499+0000 7f3c9affd640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f3c9c15d150 0x7f3c9c070070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:57532/0 (socket says 172.21.15.40:57532) 2023-12-17T11:48:49.501 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:49.499+0000 7f3c9affd640 1 -- 172.21.15.40:0/1596958443 learned_addr learned my addr 172.21.15.40:0/1596958443 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-12-17T11:48:49.502 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:49.499+0000 7f3c9b7fe640 1 --2- 172.21.15.40:0/1596958443 >> v2:172.21.15.40:3300/0 conn(0x7f3c9c06dd00 0x7f3c9c06c690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:49.502 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:49.500+0000 7f3c93fff640 1 --2- 172.21.15.40:0/1596958443 >> v2:172.21.15.159:3300/0 conn(0x7f3c9c070780 0x7f3c9c071ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:49.502 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:49.500+0000 7f3c9a7fc640 1 -- 172.21.15.40:0/1596958443 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 836044542 0 0) 0x7f3c9c0abd20 con 0x7f3c9c15d150 2023-12-17T11:48:49.502 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:49.500+0000 7f3c9a7fc640 1 -- 172.21.15.40:0/1596958443 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3c88003520 con 0x7f3c9c15d150 2023-12-17T11:48:49.502 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:49.500+0000 7f3c9b7fe640 1 -- 172.21.15.40:0/1596958443 >> v2:172.21.15.159:3300/0 conn(0x7f3c9c070780 msgr2=0x7f3c9c071ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:48:49.503 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:49.500+0000 7f3c9b7fe640 1 --2- 172.21.15.40:0/1596958443 >> v2:172.21.15.159:3300/0 conn(0x7f3c9c070780 0x7f3c9c071ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:49.503 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:49.500+0000 7f3c9b7fe640 1 -- 172.21.15.40:0/1596958443 >> v1:172.21.15.40:6789/0 conn(0x7f3c9c15d150 legacy=0x7f3c9c070070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:49.503 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:49.500+0000 7f3c9b7fe640 1 -- 172.21.15.40:0/1596958443 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c9c0b2c30 con 0x7f3c9c06dd00 2023-12-17T11:48:49.504 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:49.501+0000 7f3c9b7fe640 1 --2- 172.21.15.40:0/1596958443 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3c9c06dd00 0x7f3c9c06c690 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f3c9c06bb80 tx=0x7f3c9402bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0360d779887d393 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:48:49.504 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:49.501+0000 7f3c9a7fc640 1 -- 172.21.15.40:0/1596958443 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c9402cc80 con 0x7f3c9c06dd00 2023-12-17T11:48:49.504 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:49.501+0000 7f3c9a7fc640 1 -- 172.21.15.40:0/1596958443 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c9402cde0 con 0x7f3c9c06dd00 2023-12-17T11:48:49.504 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:49.501+0000 7f3c9a7fc640 1 -- 172.21.15.40:0/1596958443 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c94034660 con 0x7f3c9c06dd00 2023-12-17T11:48:49.504 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:49.502+0000 7f3c9bfff640 1 -- 172.21.15.40:0/1596958443 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3c9c06dd00 msgr2=0x7f3c9c06c690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:49.504 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:49.502+0000 7f3c9bfff640 1 --2- 172.21.15.40:0/1596958443 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3c9c06dd00 0x7f3c9c06c690 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f3c9c06bb80 tx=0x7f3c9402bed0 comp rx=0 tx=0).stop 2023-12-17T11:48:49.504 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:49.502+0000 7f3c9bfff640 1 -- 172.21.15.40:0/1596958443 shutdown_connections 2023-12-17T11:48:49.504 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:49.502+0000 7f3c9bfff640 1 --2- 172.21.15.40:0/1596958443 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3c9c06dd00 0x7f3c9c06c690 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:49.505 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:49.502+0000 7f3c9bfff640 1 --2- 172.21.15.40:0/1596958443 >> v2:172.21.15.159:3300/0 conn(0x7f3c9c070780 0x7f3c9c071ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:49.505 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:49.502+0000 7f3c9bfff640 1 -- 172.21.15.40:0/1596958443 >> 172.21.15.40:0/1596958443 conn(0x7f3c9c0b0860 msgr2=0x7f3c9c0b0c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:48:49.505 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:49.502+0000 7f3c9bfff640 1 -- 172.21.15.40:0/1596958443 shutdown_connections 2023-12-17T11:48:49.505 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:49.502+0000 7f3c9bfff640 1 -- 172.21.15.40:0/1596958443 wait complete. 2023-12-17T11:48:49.505 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:49.504+0000 7f3c9bfff640 1 Processor -- start 2023-12-17T11:48:49.506 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:49.504+0000 7f3c9bfff640 1 -- start start 2023-12-17T11:48:49.507 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:49.505+0000 7f3c9bfff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3c9c06dd00 0x7f3c9c15d670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:49.507 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:49.505+0000 7f3c9bfff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3c9c070780 0x7f3c9c1f20b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:49.507 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:49.505+0000 7f3c9bfff640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f3c9c15d150 0x7f3c9c1474f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:49.507 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:49.505+0000 7f3c9bfff640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c9c14b820 con 0x7f3c9c06dd00 2023-12-17T11:48:49.507 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:49.505+0000 7f3c9bfff640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c9c0ae420 con 0x7f3c9c070780 2023-12-17T11:48:49.507 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:49.505+0000 7f3c9bfff640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c9c15fd80 con 0x7f3c9c15d150 2023-12-17T11:48:49.507 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:49.505+0000 7f3c9affd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3c9c06dd00 0x7f3c9c15d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:49.507 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:49.505+0000 7f3c9affd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3c9c06dd00 0x7f3c9c15d670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:41570/0 (socket says 172.21.15.40:41570) 2023-12-17T11:48:49.507 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:49.505+0000 7f3c9affd640 1 -- 172.21.15.40:0/2264834407 learned_addr learned my addr 172.21.15.40:0/2264834407 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-17T11:48:49.509 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:49.505+0000 7f3c93fff640 1 --2- 172.21.15.40:0/2264834407 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3c9c070780 0x7f3c9c1f20b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:49.509 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:49.505+0000 7f3c9b7fe640 1 --2- 172.21.15.40:0/2264834407 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f3c9c15d150 0x7f3c9c1474f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:49.509 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:49.506+0000 7f3c9affd640 1 -- 172.21.15.40:0/2264834407 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f3c9c15d150 msgr2=0x7f3c9c1474f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:49.509 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:49.506+0000 7f3c9affd640 1 --2- 172.21.15.40:0/2264834407 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f3c9c15d150 0x7f3c9c1474f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:49.509 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:49.506+0000 7f3c9affd640 1 -- 172.21.15.40:0/2264834407 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3c9c070780 msgr2=0x7f3c9c1f20b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:49.509 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:49.506+0000 7f3c9affd640 1 --2- 172.21.15.40:0/2264834407 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3c9c070780 0x7f3c9c1f20b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:49.509 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:49.506+0000 7f3c9affd640 1 -- 172.21.15.40:0/2264834407 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c94009a70 con 0x7f3c9c06dd00 2023-12-17T11:48:49.509 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:49.506+0000 7f3c93fff640 1 --2- 172.21.15.40:0/2264834407 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3c9c070780 0x7f3c9c1f20b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-17T11:48:49.509 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:49.506+0000 7f3c9b7fe640 1 --2- 172.21.15.40:0/2264834407 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f3c9c15d150 0x7f3c9c1474f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-17T11:48:49.509 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:49.506+0000 7f3c9affd640 1 --2- 172.21.15.40:0/2264834407 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3c9c06dd00 0x7f3c9c15d670 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f3c8c00c500 tx=0x7f3c8c00c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:48:49.509 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:49.506+0000 7f3c98ff9640 1 -- 172.21.15.40:0/2264834407 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c8c005ce0 con 0x7f3c9c06dd00 2023-12-17T11:48:49.510 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:49.506+0000 7f3c98ff9640 1 -- 172.21.15.40:0/2264834407 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c8c005e40 con 0x7f3c9c06dd00 2023-12-17T11:48:49.510 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:49.506+0000 7f3c98ff9640 1 -- 172.21.15.40:0/2264834407 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c8c007330 con 0x7f3c9c06dd00 2023-12-17T11:48:49.510 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:49.506+0000 7f3c9bfff640 1 -- 172.21.15.40:0/2264834407 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c9c160060 con 0x7f3c9c06dd00 2023-12-17T11:48:49.510 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:49.506+0000 7f3c9bfff640 1 -- 172.21.15.40:0/2264834407 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c9c0ae690 con 0x7f3c9c06dd00 2023-12-17T11:48:49.510 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:49.508+0000 7f3c9bfff640 1 -- 172.21.15.40:0/2264834407 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c9c06e110 con 0x7f3c9c06dd00 2023-12-17T11:48:49.510 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:49.509+0000 7f3c98ff9640 1 -- 172.21.15.40:0/2264834407 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f3c8c007550 con 0x7f3c9c06dd00 2023-12-17T11:48:49.511 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:49.509+0000 7f3c98ff9640 1 --2- 172.21.15.40:0/2264834407 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f3c7c06ae90 0x7f3c7c06d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:49.511 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:49.510+0000 7f3c98ff9640 1 -- 172.21.15.40:0/2264834407 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f3c8c088f80 con 0x7f3c9c06dd00 2023-12-17T11:48:49.512 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:49.510+0000 7f3c93fff640 1 --2- 172.21.15.40:0/2264834407 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f3c7c06ae90 0x7f3c7c06d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:49.513 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:49.511+0000 7f3c93fff640 1 --2- 172.21.15.40:0/2264834407 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f3c7c06ae90 0x7f3c7c06d350 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f3c9c0b3250 tx=0x7f3c84008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:48:49.516 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:49.514+0000 7f3c98ff9640 1 -- 172.21.15.40:0/2264834407 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f3c8c053e70 con 0x7f3c9c06dd00 2023-12-17T11:48:49.749 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:49.747+0000 7f3c9bfff640 1 -- 172.21.15.40:0/2264834407 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3c9c074450 con 0x7f3c9c06dd00 2023-12-17T11:48:49.750 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:49.748+0000 7f3c98ff9640 1 -- 172.21.15.40:0/2264834407 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4915 (secure 0 0 0) 0x7f3c8c017020 con 0x7f3c9c06dd00 2023-12-17T11:48:49.750 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T11:48:49.750 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/3337931457","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":3337931457},{"type":"v1","addr":"172.21.15.40:6835","nonce":3337931457}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4257,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6833/1874601964","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6832","nonce":1874601964},{"type":"v1","addr":"172.21.15.40:6833","nonce":1874601964}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4267,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6836/3645037845","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6834","nonce":3645037845},{"type":"v1","addr":"172.21.15.159:6836","nonce":3645037845}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-17T11:48:17.696113+0000","modified":"2023-12-17T11:48:40.061005+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4270},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4270":{"gid":4270,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.159:6837/1288849778","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6835","nonce":1288849778},{"type":"v1","addr":"172.21.15.159:6837","nonce":1288849778}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-12-17T11:48:49.750 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 8 2023-12-17T11:48:49.753 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:49.750+0000 7f3c9bfff640 1 -- 172.21.15.40:0/2264834407 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f3c7c06ae90 msgr2=0x7f3c7c06d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:49.753 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:49.750+0000 7f3c9bfff640 1 --2- 172.21.15.40:0/2264834407 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f3c7c06ae90 0x7f3c7c06d350 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f3c9c0b3250 tx=0x7f3c84008040 comp rx=0 tx=0).stop 2023-12-17T11:48:49.753 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:49.750+0000 7f3c9bfff640 1 -- 172.21.15.40:0/2264834407 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3c9c06dd00 msgr2=0x7f3c9c15d670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:49.753 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:49.750+0000 7f3c9bfff640 1 --2- 172.21.15.40:0/2264834407 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3c9c06dd00 0x7f3c9c15d670 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f3c8c00c500 tx=0x7f3c8c00c9c0 comp rx=0 tx=0).stop 2023-12-17T11:48:49.753 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:49.751+0000 7f3c9bfff640 1 -- 172.21.15.40:0/2264834407 shutdown_connections 2023-12-17T11:48:49.753 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:49.751+0000 7f3c9bfff640 1 --2- 172.21.15.40:0/2264834407 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f3c7c06ae90 0x7f3c7c06d350 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:49.753 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:49.751+0000 7f3c9bfff640 1 --2- 172.21.15.40:0/2264834407 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f3c9c15d150 0x7f3c9c1474f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:49.754 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:49.751+0000 7f3c9bfff640 1 --2- 172.21.15.40:0/2264834407 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3c9c070780 0x7f3c9c1f20b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:49.754 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:49.751+0000 7f3c9bfff640 1 --2- 172.21.15.40:0/2264834407 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3c9c06dd00 0x7f3c9c15d670 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:49.754 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:49.751+0000 7f3c9bfff640 1 -- 172.21.15.40:0/2264834407 >> 172.21.15.40:0/2264834407 conn(0x7f3c9c0b0860 msgr2=0x7f3c9c070070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:48:49.754 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:49.751+0000 7f3c9bfff640 1 -- 172.21.15.40:0/2264834407 shutdown_connections 2023-12-17T11:48:49.754 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:49.751+0000 7f3c9bfff640 1 -- 172.21.15.40:0/2264834407 wait complete. 2023-12-17T11:48:49.773 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-17T11:48:50.001 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:49.999+0000 7f2aa3fdc640 1 Processor -- start 2023-12-17T11:48:50.001 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:49.999+0000 7f2aa3fdc640 1 -- start start 2023-12-17T11:48:50.002 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:50.000+0000 7f2aa3fdc640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2a9c15d580 0x7f2a9c0adc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:50.002 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:50.000+0000 7f2aa3fdc640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f2a9c0cfc50 0x7f2a9c0d00b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:50.003 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:50.001+0000 7f2aa3fdc640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a9c0b07f0 con 0x7f2a9c06bf80 2023-12-17T11:48:50.003 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:50.001+0000 7f2aa3fdc640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a9c15d960 con 0x7f2a9c0cfc50 2023-12-17T11:48:50.003 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:50.001+0000 7f2aa3fdc640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a9c0d05f0 con 0x7f2a9c15d580 2023-12-17T11:48:50.004 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:50.001+0000 7f2aa1577640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f2a9c0cfc50 0x7f2a9c0d00b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:50.004 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:50.001+0000 7f2aa1577640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f2a9c0cfc50 0x7f2a9c0d00b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:41572/0 (socket says 172.21.15.40:41572) 2023-12-17T11:48:50.004 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:50.001+0000 7f2aa1577640 1 -- 172.21.15.40:0/1084668174 learned_addr learned my addr 172.21.15.40:0/1084668174 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-17T11:48:50.004 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:50.001+0000 7f2aa1d78640 1 --2- 172.21.15.40:0/1084668174 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2a9c15d580 0x7f2a9c0adc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:50.004 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:50.002+0000 7f2aa1577640 1 -- 172.21.15.40:0/1084668174 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2a9c15d580 msgr2=0x7f2a9c0adc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:48:50.004 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:50.002+0000 7f2aa1577640 1 --2- 172.21.15.40:0/1084668174 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2a9c15d580 0x7f2a9c0adc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:50.004 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:50.002+0000 7f2aa1577640 1 -- 172.21.15.40:0/1084668174 >> v1:172.21.15.159:6789/0 conn(0x7f2a9c06bf80 legacy=0x7f2a9c0b1ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:50.004 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:50.002+0000 7f2aa1577640 1 -- 172.21.15.40:0/1084668174 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a9c0b0a40 con 0x7f2a9c0cfc50 2023-12-17T11:48:50.004 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:50.003+0000 7f2aa1577640 1 --2- 172.21.15.40:0/1084668174 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2a9c0cfc50 0x7f2a9c0d00b0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f2a8c009870 tx=0x7f2a8c02b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5fc5d7d9eccf63a server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:48:50.005 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:50.003+0000 7f2aa0d76640 1 -- 172.21.15.40:0/1084668174 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a8c030840 con 0x7f2a9c0cfc50 2023-12-17T11:48:50.005 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:50.003+0000 7f2aa0d76640 1 -- 172.21.15.40:0/1084668174 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a8c0309a0 con 0x7f2a9c0cfc50 2023-12-17T11:48:50.005 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:50.003+0000 7f2aa0d76640 1 -- 172.21.15.40:0/1084668174 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a8c030d30 con 0x7f2a9c0cfc50 2023-12-17T11:48:50.006 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:50.004+0000 7f2aa3fdc640 1 -- 172.21.15.40:0/1084668174 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2a9c0cfc50 msgr2=0x7f2a9c0d00b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:50.006 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:50.004+0000 7f2aa3fdc640 1 --2- 172.21.15.40:0/1084668174 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2a9c0cfc50 0x7f2a9c0d00b0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f2a8c009870 tx=0x7f2a8c02b980 comp rx=0 tx=0).stop 2023-12-17T11:48:50.006 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:50.004+0000 7f2aa3fdc640 1 -- 172.21.15.40:0/1084668174 shutdown_connections 2023-12-17T11:48:50.006 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:50.004+0000 7f2aa3fdc640 1 --2- 172.21.15.40:0/1084668174 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2a9c0cfc50 0x7f2a9c0d00b0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:50.006 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:50.004+0000 7f2aa3fdc640 1 --2- 172.21.15.40:0/1084668174 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2a9c15d580 0x7f2a9c0adc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:50.006 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:50.004+0000 7f2aa3fdc640 1 -- 172.21.15.40:0/1084668174 >> 172.21.15.40:0/1084668174 conn(0x7f2a9c0d0e90 msgr2=0x7f2a9c0d12a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:48:50.006 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:50.004+0000 7f2aa3fdc640 1 -- 172.21.15.40:0/1084668174 shutdown_connections 2023-12-17T11:48:50.007 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:50.004+0000 7f2aa3fdc640 1 -- 172.21.15.40:0/1084668174 wait complete. 2023-12-17T11:48:50.007 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:50.006+0000 7f2aa3fdc640 1 Processor -- start 2023-12-17T11:48:50.007 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:50.006+0000 7f2aa3fdc640 1 -- start start 2023-12-17T11:48:50.009 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:50.007+0000 7f2aa3fdc640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2a9c06bf80 0x7f2a9c1587a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:50.009 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:50.007+0000 7f2aa3fdc640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2a9c0cfc50 0x7f2a9c0c5020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:50.009 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:50.007+0000 7f2aa3fdc640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2a9c15d580 0x7f2a9c0c5560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:50.009 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:50.007+0000 7f2aa3fdc640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a9c0b4ef0 con 0x7f2a9c0cfc50 2023-12-17T11:48:50.009 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:50.007+0000 7f2aa3fdc640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a9c0b54b0 con 0x7f2a9c15d580 2023-12-17T11:48:50.009 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:50.007+0000 7f2aa3fdc640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a9c0c7640 con 0x7f2a9c06bf80 2023-12-17T11:48:50.009 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:50.007+0000 7f2aa1577640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2a9c0cfc50 0x7f2a9c0c5020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:50.010 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:50.007+0000 7f2aa1577640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2a9c0cfc50 0x7f2a9c0c5020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:41576/0 (socket says 172.21.15.40:41576) 2023-12-17T11:48:50.010 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:50.007+0000 7f2aa1577640 1 -- 172.21.15.40:0/1623258266 learned_addr learned my addr 172.21.15.40:0/1623258266 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-17T11:48:50.010 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:50.007+0000 7f2aa2579640 1 --2- 172.21.15.40:0/1623258266 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2a9c15d580 0x7f2a9c0c5560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:50.010 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:50.007+0000 7f2aa1d78640 1 --2- 172.21.15.40:0/1623258266 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2a9c06bf80 0x7f2a9c1587a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:50.011 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:50.008+0000 7f2aa1577640 1 -- 172.21.15.40:0/1623258266 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2a9c06bf80 msgr2=0x7f2a9c1587a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:50.011 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:50.008+0000 7f2aa1577640 1 --2- 172.21.15.40:0/1623258266 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2a9c06bf80 0x7f2a9c1587a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:50.011 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:50.008+0000 7f2aa1577640 1 -- 172.21.15.40:0/1623258266 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2a9c15d580 msgr2=0x7f2a9c0c5560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:50.011 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:50.008+0000 7f2aa1577640 1 --2- 172.21.15.40:0/1623258266 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2a9c15d580 0x7f2a9c0c5560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:50.011 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:50.008+0000 7f2aa1577640 1 -- 172.21.15.40:0/1623258266 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a8c0094d0 con 0x7f2a9c0cfc50 2023-12-17T11:48:50.011 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:50.008+0000 7f2aa2579640 1 --2- 172.21.15.40:0/1623258266 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2a9c15d580 0x7f2a9c0c5560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-17T11:48:50.011 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:50.008+0000 7f2aa1577640 1 --2- 172.21.15.40:0/1623258266 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2a9c0cfc50 0x7f2a9c0c5020 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f2a8c02b9c0 tx=0x7f2a8c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:48:50.011 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:50.008+0000 7f2a927fc640 1 -- 172.21.15.40:0/1623258266 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a8c039c90 con 0x7f2a9c0cfc50 2023-12-17T11:48:50.011 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:50.008+0000 7f2a927fc640 1 -- 172.21.15.40:0/1623258266 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a8c039df0 con 0x7f2a9c0cfc50 2023-12-17T11:48:50.011 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:50.008+0000 7f2a927fc640 1 -- 172.21.15.40:0/1623258266 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a8c0446c0 con 0x7f2a9c0cfc50 2023-12-17T11:48:50.011 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:50.008+0000 7f2aa3fdc640 1 -- 172.21.15.40:0/1623258266 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a9c160340 con 0x7f2a9c0cfc50 2023-12-17T11:48:50.012 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:50.009+0000 7f2aa3fdc640 1 -- 172.21.15.40:0/1623258266 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a9c0b5140 con 0x7f2a9c0cfc50 2023-12-17T11:48:50.012 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:50.010+0000 7f2aa3fdc640 1 -- 172.21.15.40:0/1623258266 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a9c0b52d0 con 0x7f2a9c0cfc50 2023-12-17T11:48:50.012 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:50.010+0000 7f2a927fc640 1 -- 172.21.15.40:0/1623258266 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f2a8c02f390 con 0x7f2a9c0cfc50 2023-12-17T11:48:50.013 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:50.011+0000 7f2a927fc640 1 --2- 172.21.15.40:0/1623258266 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f2a8006ae70 0x7f2a8006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:50.014 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:50.012+0000 7f2a927fc640 1 -- 172.21.15.40:0/1623258266 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f2a8c03e070 con 0x7f2a9c0cfc50 2023-12-17T11:48:50.014 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:50.012+0000 7f2aa1d78640 1 --2- 172.21.15.40:0/1623258266 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f2a8006ae70 0x7f2a8006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:50.015 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:50.013+0000 7f2aa1d78640 1 --2- 172.21.15.40:0/1623258266 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f2a8006ae70 0x7f2a8006d330 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f2a980074a0 tx=0x7f2a9800b040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:48:50.018 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:50.016+0000 7f2a927fc640 1 -- 172.21.15.40:0/1623258266 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f2a8c076f60 con 0x7f2a9c0cfc50 2023-12-17T11:48:50.222 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:50.220+0000 7f2aa3fdc640 1 -- 172.21.15.40:0/1623258266 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2a9c0745d0 con 0x7f2a9c0cfc50 2023-12-17T11:48:50.224 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:50.223+0000 7f2a927fc640 1 -- 172.21.15.40:0/1623258266 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18322 (secure 0 0 0) 0x7f2a8c034090 con 0x7f2a9c0cfc50 2023-12-17T11:48:50.225 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T11:48:50.225 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":25,"fsid":"099cd35d-80d9-4ca4-8424-de13b3b03ac7","created":"2023-12-17T11:47:53.450097+0000","modified":"2023-12-17T11:48:22.971195+0000","last_up_change":"2023-12-17T11:48:05.724195+0000","last_in_change":"2023-12-17T11:47:56.956499+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-17T11:48:06.668943+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-17T11:48:16.151444+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-17T11:48:16.717726+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-17T11:48:20.534819+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a88bfd46-63b8-48b1-9c0e-5c9cdc31bd38","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":555204741},{"type":"v1","addr":"172.21.15.40:6802","nonce":555204741}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":555204741},{"type":"v1","addr":"172.21.15.40:6807","nonce":555204741}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":555204741},{"type":"v1","addr":"172.21.15.40:6815","nonce":555204741}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6809","nonce":555204741},{"type":"v1","addr":"172.21.15.40:6812","nonce":555204741}]},"public_addr":"172.21.15.40:6802/555204741","cluster_addr":"172.21.15.40:6807/555204741","heartbeat_back_addr":"172.21.15.40:6815/555204741","heartbeat_front_addr":"172.21.15.40:6812/555204741","state":["exists","up"]},{"osd":1,"uuid":"c5d628ae-36f4-4866-802c-b162f0e90add","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6801","nonce":1221318112},{"type":"v1","addr":"172.21.15.40:6803","nonce":1221318112}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6805","nonce":1221318112},{"type":"v1","addr":"172.21.15.40:6806","nonce":1221318112}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6811","nonce":1221318112},{"type":"v1","addr":"172.21.15.40:6813","nonce":1221318112}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":1221318112},{"type":"v1","addr":"172.21.15.40:6810","nonce":1221318112}]},"public_addr":"172.21.15.40:6803/1221318112","cluster_addr":"172.21.15.40:6806/1221318112","heartbeat_back_addr":"172.21.15.40:6813/1221318112","heartbeat_front_addr":"172.21.15.40:6810/1221318112","state":["exists","up"]},{"osd":2,"uuid":"d986ad6a-af2f-47fc-9c3b-fbda27b82b73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":1959000265},{"type":"v1","addr":"172.21.15.40:6817","nonce":1959000265}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6818","nonce":1959000265},{"type":"v1","addr":"172.21.15.40:6819","nonce":1959000265}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":1959000265},{"type":"v1","addr":"172.21.15.40:6827","nonce":1959000265}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":1959000265},{"type":"v1","addr":"172.21.15.40:6822","nonce":1959000265}]},"public_addr":"172.21.15.40:6817/1959000265","cluster_addr":"172.21.15.40:6819/1959000265","heartbeat_back_addr":"172.21.15.40:6827/1959000265","heartbeat_front_addr":"172.21.15.40:6822/1959000265","state":["exists","up"]},{"osd":3,"uuid":"d79d22b7-be05-41b2-b95d-697db677fd02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6821","nonce":974040287},{"type":"v1","addr":"172.21.15.40:6823","nonce":974040287}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6825","nonce":974040287},{"type":"v1","addr":"172.21.15.40:6826","nonce":974040287}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":974040287},{"type":"v1","addr":"172.21.15.40:6831","nonce":974040287}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":974040287},{"type":"v1","addr":"172.21.15.40:6829","nonce":974040287}]},"public_addr":"172.21.15.40:6823/974040287","cluster_addr":"172.21.15.40:6826/974040287","heartbeat_back_addr":"172.21.15.40:6831/974040287","heartbeat_front_addr":"172.21.15.40:6829/974040287","state":["exists","up"]},{"osd":4,"uuid":"62a7a233-d3ea-40be-91de-180c0208d639","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6808","nonce":3937787733},{"type":"v1","addr":"172.21.15.159:6809","nonce":3937787733}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6810","nonce":3937787733},{"type":"v1","addr":"172.21.15.159:6811","nonce":3937787733}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6814","nonce":3937787733},{"type":"v1","addr":"172.21.15.159:6815","nonce":3937787733}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6812","nonce":3937787733},{"type":"v1","addr":"172.21.15.159:6813","nonce":3937787733}]},"public_addr":"172.21.15.159:6809/3937787733","cluster_addr":"172.21.15.159:6811/3937787733","heartbeat_back_addr":"172.21.15.159:6815/3937787733","heartbeat_front_addr":"172.21.15.159:6813/3937787733","state":["exists","up"]},{"osd":5,"uuid":"84629cea-dc0e-4b5e-b203-5ea963839281","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6816","nonce":3032505240},{"type":"v1","addr":"172.21.15.159:6817","nonce":3032505240}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6818","nonce":3032505240},{"type":"v1","addr":"172.21.15.159:6819","nonce":3032505240}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6822","nonce":3032505240},{"type":"v1","addr":"172.21.15.159:6823","nonce":3032505240}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6820","nonce":3032505240},{"type":"v1","addr":"172.21.15.159:6821","nonce":3032505240}]},"public_addr":"172.21.15.159:6817/3032505240","cluster_addr":"172.21.15.159:6819/3032505240","heartbeat_back_addr":"172.21.15.159:6823/3032505240","heartbeat_front_addr":"172.21.15.159:6821/3032505240","state":["exists","up"]},{"osd":6,"uuid":"4ae3af3a-1743-4070-a91d-8be5c31cdb04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6800","nonce":2411788597},{"type":"v1","addr":"172.21.15.159:6801","nonce":2411788597}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6802","nonce":2411788597},{"type":"v1","addr":"172.21.15.159:6803","nonce":2411788597}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6806","nonce":2411788597},{"type":"v1","addr":"172.21.15.159:6807","nonce":2411788597}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6804","nonce":2411788597},{"type":"v1","addr":"172.21.15.159:6805","nonce":2411788597}]},"public_addr":"172.21.15.159:6801/2411788597","cluster_addr":"172.21.15.159:6803/2411788597","heartbeat_back_addr":"172.21.15.159:6807/2411788597","heartbeat_front_addr":"172.21.15.159:6805/2411788597","state":["exists","up"]},{"osd":7,"uuid":"c1f4c7f2-8f75-4f95-bc63-a332773e3b8e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6824","nonce":478953349},{"type":"v1","addr":"172.21.15.159:6825","nonce":478953349}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6826","nonce":478953349},{"type":"v1","addr":"172.21.15.159:6827","nonce":478953349}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6830","nonce":478953349},{"type":"v1","addr":"172.21.15.159:6831","nonce":478953349}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6828","nonce":478953349},{"type":"v1","addr":"172.21.15.159:6829","nonce":478953349}]},"public_addr":"172.21.15.159:6825/478953349","cluster_addr":"172.21.15.159:6827/478953349","heartbeat_back_addr":"172.21.15.159:6831/478953349","heartbeat_front_addr":"172.21.15.159:6829/478953349","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T11:48:02.023567+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T11:48:02.278216+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T11:48:02.311843+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T11:48:01.773372+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T11:48:02.618910+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T11:48:02.361559+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T11:48:02.223997+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T11:48:02.604403+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-17T11:48:50.228 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:50.225+0000 7f2aa3fdc640 1 -- 172.21.15.40:0/1623258266 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f2a8006ae70 msgr2=0x7f2a8006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:50.228 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:50.225+0000 7f2aa3fdc640 1 --2- 172.21.15.40:0/1623258266 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f2a8006ae70 0x7f2a8006d330 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f2a980074a0 tx=0x7f2a9800b040 comp rx=0 tx=0).stop 2023-12-17T11:48:50.228 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:50.225+0000 7f2aa3fdc640 1 -- 172.21.15.40:0/1623258266 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2a9c0cfc50 msgr2=0x7f2a9c0c5020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:50.228 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:50.225+0000 7f2aa3fdc640 1 --2- 172.21.15.40:0/1623258266 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2a9c0cfc50 0x7f2a9c0c5020 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f2a8c02b9c0 tx=0x7f2a8c004730 comp rx=0 tx=0).stop 2023-12-17T11:48:50.228 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:50.225+0000 7f2aa3fdc640 1 -- 172.21.15.40:0/1623258266 shutdown_connections 2023-12-17T11:48:50.228 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:50.225+0000 7f2aa3fdc640 1 --2- 172.21.15.40:0/1623258266 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f2a8006ae70 0x7f2a8006d330 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:50.228 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:50.225+0000 7f2aa3fdc640 1 --2- 172.21.15.40:0/1623258266 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2a9c15d580 0x7f2a9c0c5560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:50.228 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:50.226+0000 7f2aa3fdc640 1 --2- 172.21.15.40:0/1623258266 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2a9c0cfc50 0x7f2a9c0c5020 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:50.229 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:50.226+0000 7f2aa3fdc640 1 --2- 172.21.15.40:0/1623258266 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2a9c06bf80 0x7f2a9c1587a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:50.229 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:50.226+0000 7f2aa3fdc640 1 -- 172.21.15.40:0/1623258266 >> 172.21.15.40:0/1623258266 conn(0x7f2a9c0d0e90 msgr2=0x7f2a9c0afc70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:48:50.229 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:50.226+0000 7f2aa3fdc640 1 -- 172.21.15.40:0/1623258266 shutdown_connections 2023-12-17T11:48:50.229 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:50.226+0000 7f2aa3fdc640 1 -- 172.21.15.40:0/1623258266 wait complete. 2023-12-17T11:48:50.247 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-17T11:48:06.668943+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-17T11:48:16.151444+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-17T11:48:16.717726+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-12-17T11:48:20.534819+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-12-17T11:48:50.247 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-17T11:48:50.484 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:50.481+0000 7fd5209c9640 1 Processor -- start 2023-12-17T11:48:50.484 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:50.481+0000 7fd5209c9640 1 -- start start 2023-12-17T11:48:50.484 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:50.483+0000 7fd5209c9640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd51c06a460 0x7fd51c06a8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:50.485 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:50.483+0000 7fd5209c9640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd51c071cd0 con 0x7fd51c15af50 2023-12-17T11:48:50.487 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:50.483+0000 7fd5209c9640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd51c0719f0 con 0x7fd51c0ce7e0 2023-12-17T11:48:50.487 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:50.483+0000 7fd5209c9640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd51c06ae30 con 0x7fd51c06a460 2023-12-17T11:48:50.487 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:50.483+0000 7fd51a59c640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fd51c15af50 0x7fd51c06c170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:57544/0 (socket says 172.21.15.40:57544) 2023-12-17T11:48:50.487 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:50.483+0000 7fd51a59c640 1 -- 172.21.15.40:0/618865277 learned_addr learned my addr 172.21.15.40:0/618865277 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-12-17T11:48:50.487 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:50.483+0000 7fd51ad9d640 1 --2- 172.21.15.40:0/618865277 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd51c06a460 0x7fd51c06a8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:50.487 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:50.483+0000 7fd519d9b640 1 -- 172.21.15.40:0/618865277 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2577344545 0 0) 0x7fd51c071cd0 con 0x7fd51c15af50 2023-12-17T11:48:50.487 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:50.484+0000 7fd519d9b640 1 -- 172.21.15.40:0/618865277 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd508003520 con 0x7fd51c15af50 2023-12-17T11:48:50.487 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:50.484+0000 7fd519d9b640 1 -- 172.21.15.40:0/618865277 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1989276109 0 0) 0x7fd508003520 con 0x7fd51c15af50 2023-12-17T11:48:50.487 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:50.484+0000 7fd519d9b640 1 -- 172.21.15.40:0/618865277 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd51c06a460 msgr2=0x7fd51c06a8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:48:50.488 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:50.484+0000 7fd519d9b640 1 --2- 172.21.15.40:0/618865277 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd51c06a460 0x7fd51c06a8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:50.488 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:50.484+0000 7fd519d9b640 1 -- 172.21.15.40:0/618865277 >> v1:172.21.15.159:6789/0 conn(0x7fd51c0ce7e0 legacy=0x7fd51c15ec00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:50.488 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:50.484+0000 7fd519d9b640 1 -- 172.21.15.40:0/618865277 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd51c071ff0 con 0x7fd51c15af50 2023-12-17T11:48:50.488 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:50.484+0000 7fd519d9b640 1 -- 172.21.15.40:0/618865277 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2643242555 0 0) 0x7fd50c001670 con 0x7fd51c15af50 2023-12-17T11:48:50.488 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:50.484+0000 7fd519d9b640 1 -- 172.21.15.40:0/618865277 >> v1:172.21.15.40:6789/0 conn(0x7fd51c15af50 legacy=0x7fd51c06c170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:50.488 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:50.484+0000 7fd519d9b640 1 --2- 172.21.15.40:0/618865277 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd51c06a460 0x7fd5080039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:50.488 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:50.484+0000 7fd519d9b640 1 --2- 172.21.15.40:0/618865277 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd508003f70 0x7fd5080047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:50.488 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:50.484+0000 7fd519d9b640 1 --2- 172.21.15.40:0/618865277 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd508004d00 0x7fd508005160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:50.488 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:50.484+0000 7fd519d9b640 1 -- 172.21.15.40:0/618865277 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd51c06ae30 con 0x7fd508003f70 2023-12-17T11:48:50.488 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:50.484+0000 7fd519d9b640 1 -- 172.21.15.40:0/618865277 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd50800bc10 con 0x7fd508004d00 2023-12-17T11:48:50.488 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:50.484+0000 7fd519d9b640 1 -- 172.21.15.40:0/618865277 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd50800bdd0 con 0x7fd51c06a460 2023-12-17T11:48:50.488 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:50.484+0000 7fd513fff640 1 --2- 172.21.15.40:0/618865277 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd508003f70 0x7fd5080047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:50.488 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:50.485+0000 7fd51ad9d640 1 --2- 172.21.15.40:0/618865277 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd508004d00 0x7fd508005160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:50.488 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:50.485+0000 7fd51a59c640 1 --2- 172.21.15.40:0/618865277 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd51c06a460 0x7fd5080039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:50.489 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:50.485+0000 7fd513fff640 1 -- 172.21.15.40:0/618865277 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd51c06a460 msgr2=0x7fd5080039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:48:50.489 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:50.485+0000 7fd513fff640 1 --2- 172.21.15.40:0/618865277 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd51c06a460 0x7fd5080039a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:50.489 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:50.485+0000 7fd513fff640 1 -- 172.21.15.40:0/618865277 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd508004d00 msgr2=0x7fd508005160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:48:50.489 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:50.485+0000 7fd513fff640 1 --2- 172.21.15.40:0/618865277 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd508004d00 0x7fd508005160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:50.489 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:50.485+0000 7fd513fff640 1 -- 172.21.15.40:0/618865277 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd508003520 con 0x7fd508003f70 2023-12-17T11:48:50.490 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:50.486+0000 7fd513fff640 1 --2- 172.21.15.40:0/618865277 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd508003f70 0x7fd5080047c0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fd504001750 tx=0x7fd5080057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e75639a5fe705b6a server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:48:50.490 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:50.486+0000 7fd519d9b640 1 -- 172.21.15.40:0/618865277 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5040052d0 con 0x7fd508003f70 2023-12-17T11:48:50.490 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:50.486+0000 7fd519d9b640 1 -- 172.21.15.40:0/618865277 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd50402e050 con 0x7fd508003f70 2023-12-17T11:48:50.490 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:50.486+0000 7fd519d9b640 1 -- 172.21.15.40:0/618865277 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd504003830 con 0x7fd508003f70 2023-12-17T11:48:50.490 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:50.487+0000 7fd5209c9640 1 -- 172.21.15.40:0/618865277 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd508003f70 msgr2=0x7fd5080047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:50.490 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:50.487+0000 7fd5209c9640 1 --2- 172.21.15.40:0/618865277 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd508003f70 0x7fd5080047c0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fd504001750 tx=0x7fd5080057f0 comp rx=0 tx=0).stop 2023-12-17T11:48:50.490 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:50.487+0000 7fd51ad9d640 1 -- 172.21.15.40:0/618865277 reap_dead start 2023-12-17T11:48:50.490 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:50.487+0000 7fd5209c9640 1 -- 172.21.15.40:0/618865277 shutdown_connections 2023-12-17T11:48:50.490 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:50.487+0000 7fd5209c9640 1 -- 172.21.15.40:0/618865277 >> 172.21.15.40:0/618865277 conn(0x7fd51c0cee70 msgr2=0x7fd51c0cf280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:48:50.491 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:50.487+0000 7fd5209c9640 1 -- 172.21.15.40:0/618865277 shutdown_connections 2023-12-17T11:48:50.491 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:50.487+0000 7fd5209c9640 1 -- 172.21.15.40:0/618865277 wait complete. 2023-12-17T11:48:50.491 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:50.489+0000 7fd5209c9640 1 Processor -- start 2023-12-17T11:48:50.491 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:50.489+0000 7fd5209c9640 1 -- start start 2023-12-17T11:48:50.494 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:50.490+0000 7fd5209c9640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd508003f70 0x7fd51c15c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:50.494 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:50.490+0000 7fd5209c9640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd51c0b32e0 0x7fd51c154280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:50.494 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:50.490+0000 7fd5209c9640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd51c0b3830 0x7fd51c0b3cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:50.494 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:50.490+0000 7fd5209c9640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd51c0b41f0 con 0x7fd508003f70 2023-12-17T11:48:50.494 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:50.490+0000 7fd5209c9640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd51c0b1930 con 0x7fd51c0b32e0 2023-12-17T11:48:50.494 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:50.490+0000 7fd5209c9640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd51c0b1c10 con 0x7fd51c0b3830 2023-12-17T11:48:50.494 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:50.491+0000 7fd51a59c640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd508003f70 0x7fd51c15c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:50.494 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:50.491+0000 7fd51a59c640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd508003f70 0x7fd51c15c5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:41584/0 (socket says 172.21.15.40:41584) 2023-12-17T11:48:50.494 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:50.491+0000 7fd51a59c640 1 -- 172.21.15.40:0/3937103404 learned_addr learned my addr 172.21.15.40:0/3937103404 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-17T11:48:50.494 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:50.491+0000 7fd513fff640 1 --2- 172.21.15.40:0/3937103404 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd51c0b32e0 0x7fd51c154280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:50.494 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:50.491+0000 7fd51ad9d640 1 --2- 172.21.15.40:0/3937103404 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd51c0b3830 0x7fd51c0b3cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:50.495 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:50.491+0000 7fd51a59c640 1 -- 172.21.15.40:0/3937103404 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd51c0b3830 msgr2=0x7fd51c0b3cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:50.495 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:50.491+0000 7fd51a59c640 1 --2- 172.21.15.40:0/3937103404 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd51c0b3830 0x7fd51c0b3cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:50.495 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:50.491+0000 7fd51a59c640 1 -- 172.21.15.40:0/3937103404 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd51c0b32e0 msgr2=0x7fd51c154280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:50.495 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:50.491+0000 7fd51a59c640 1 --2- 172.21.15.40:0/3937103404 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd51c0b32e0 0x7fd51c154280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:50.495 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:50.491+0000 7fd51a59c640 1 -- 172.21.15.40:0/3937103404 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd51c09b770 con 0x7fd508003f70 2023-12-17T11:48:50.495 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:50.491+0000 7fd51ad9d640 1 --2- 172.21.15.40:0/3937103404 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd51c0b3830 0x7fd51c0b3cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-17T11:48:50.495 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:50.491+0000 7fd51a59c640 1 --2- 172.21.15.40:0/3937103404 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd508003f70 0x7fd51c15c5d0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fd50c00e860 tx=0x7fd50c00ed20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:48:50.495 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:50.492+0000 7fd512ffd640 1 -- 172.21.15.40:0/3937103404 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd50c00ee50 con 0x7fd508003f70 2023-12-17T11:48:50.495 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:50.492+0000 7fd512ffd640 1 -- 172.21.15.40:0/3937103404 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd50c00c870 con 0x7fd508003f70 2023-12-17T11:48:50.495 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:50.492+0000 7fd512ffd640 1 -- 172.21.15.40:0/3937103404 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd50c00cc20 con 0x7fd508003f70 2023-12-17T11:48:50.495 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:50.492+0000 7fd5209c9640 1 -- 172.21.15.40:0/3937103404 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd51c09ba50 con 0x7fd508003f70 2023-12-17T11:48:50.495 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:50.492+0000 7fd5209c9640 1 -- 172.21.15.40:0/3937103404 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd51c1547c0 con 0x7fd508003f70 2023-12-17T11:48:50.496 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:50.493+0000 7fd5209c9640 1 -- 172.21.15.40:0/3937103404 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd51c074450 con 0x7fd508003f70 2023-12-17T11:48:50.496 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:50.494+0000 7fd512ffd640 1 -- 172.21.15.40:0/3937103404 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fd50c01d460 con 0x7fd508003f70 2023-12-17T11:48:50.497 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:50.495+0000 7fd512ffd640 1 --2- 172.21.15.40:0/3937103404 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7fd4fc06ae40 0x7fd4fc06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:50.497 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:50.495+0000 7fd512ffd640 1 -- 172.21.15.40:0/3937103404 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fd50c089890 con 0x7fd508003f70 2023-12-17T11:48:50.497 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:50.496+0000 7fd513fff640 1 --2- 172.21.15.40:0/3937103404 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7fd4fc06ae40 0x7fd4fc06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:50.499 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:50.497+0000 7fd513fff640 1 --2- 172.21.15.40:0/3937103404 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7fd4fc06ae40 0x7fd4fc06d300 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fd504033000 tx=0x7fd504009030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:48:50.501 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:50.499+0000 7fd512ffd640 1 -- 172.21.15.40:0/3937103404 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fd50c0545b0 con 0x7fd508003f70 2023-12-17T11:48:50.696 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:50.694+0000 7fd5209c9640 1 -- 172.21.15.40:0/3937103404 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fd51c159750 con 0x7fd508003f70 2023-12-17T11:48:50.697 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:50.695+0000 7fd512ffd640 1 -- 172.21.15.40:0/3937103404 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) v1 ==== 93+0+10 (secure 0 0 0) 0x7fd50c057bd0 con 0x7fd508003f70 2023-12-17T11:48:50.697 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 1 2023-12-17T11:48:50.700 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:50.698+0000 7fd5209c9640 1 -- 172.21.15.40:0/3937103404 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7fd4fc06ae40 msgr2=0x7fd4fc06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:50.700 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:50.698+0000 7fd5209c9640 1 --2- 172.21.15.40:0/3937103404 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7fd4fc06ae40 0x7fd4fc06d300 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fd504033000 tx=0x7fd504009030 comp rx=0 tx=0).stop 2023-12-17T11:48:50.701 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:50.698+0000 7fd5209c9640 1 -- 172.21.15.40:0/3937103404 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd508003f70 msgr2=0x7fd51c15c5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:50.701 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:50.698+0000 7fd5209c9640 1 --2- 172.21.15.40:0/3937103404 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd508003f70 0x7fd51c15c5d0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fd50c00e860 tx=0x7fd50c00ed20 comp rx=0 tx=0).stop 2023-12-17T11:48:50.701 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:50.698+0000 7fd5209c9640 1 -- 172.21.15.40:0/3937103404 shutdown_connections 2023-12-17T11:48:50.701 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:50.698+0000 7fd5209c9640 1 --2- 172.21.15.40:0/3937103404 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7fd4fc06ae40 0x7fd4fc06d300 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:50.701 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:50.698+0000 7fd5209c9640 1 --2- 172.21.15.40:0/3937103404 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd51c0b3830 0x7fd51c0b3cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:50.701 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:50.698+0000 7fd5209c9640 1 --2- 172.21.15.40:0/3937103404 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd51c0b32e0 0x7fd51c154280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:50.702 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:50.698+0000 7fd5209c9640 1 --2- 172.21.15.40:0/3937103404 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd508003f70 0x7fd51c15c5d0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:50.702 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:50.698+0000 7fd5209c9640 1 -- 172.21.15.40:0/3937103404 >> 172.21.15.40:0/3937103404 conn(0x7fd51c0cee70 msgr2=0x7fd51c0ccb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:48:50.702 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:50.698+0000 7fd5209c9640 1 -- 172.21.15.40:0/3937103404 shutdown_connections 2023-12-17T11:48:50.702 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:50.698+0000 7fd5209c9640 1 -- 172.21.15.40:0/3937103404 wait complete. 2023-12-17T11:48:50.719 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-17T11:48:50.935 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:50.932+0000 7f65b8f0c640 1 Processor -- start 2023-12-17T11:48:50.935 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:50.933+0000 7f65b8f0c640 1 -- start start 2023-12-17T11:48:50.937 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:50.934+0000 7f65b8f0c640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f65b406d770 0x7f65b40b1e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:50.937 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:50.934+0000 7f65b8f0c640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f65b406db50 0x7f65b4141250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:50.937 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:50.934+0000 7f65b8f0c640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f65b4141790 0x7f65b415ed70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:50.937 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:50.934+0000 7f65b8f0c640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65b4141c20 con 0x7f65b4141790 2023-12-17T11:48:50.937 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:50.934+0000 7f65b8f0c640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65b415b780 con 0x7f65b406d770 2023-12-17T11:48:50.937 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:50.934+0000 7f65b8f0c640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65b415b9d0 con 0x7f65b406db50 2023-12-17T11:48:50.938 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:50.935+0000 7f65b2d9d640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f65b4141790 0x7f65b415ed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:50.938 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:50.935+0000 7f65b2d9d640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f65b4141790 0x7f65b415ed70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:41592/0 (socket says 172.21.15.40:41592) 2023-12-17T11:48:50.938 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:50.935+0000 7f65b2d9d640 1 -- 172.21.15.40:0/1063069364 learned_addr learned my addr 172.21.15.40:0/1063069364 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-17T11:48:50.938 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:50.935+0000 7f65b1d9b640 1 --2- 172.21.15.40:0/1063069364 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f65b406db50 0x7f65b4141250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:50.938 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:50.935+0000 7f65b259c640 1 --2- 172.21.15.40:0/1063069364 >> v2:172.21.15.159:3300/0 conn(0x7f65b406d770 0x7f65b40b1e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:50.938 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:50.935+0000 7f65b2d9d640 1 -- 172.21.15.40:0/1063069364 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f65b406db50 msgr2=0x7f65b4141250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:48:50.938 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:50.935+0000 7f65b2d9d640 1 --2- 172.21.15.40:0/1063069364 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f65b406db50 0x7f65b4141250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:50.938 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:50.935+0000 7f65b2d9d640 1 -- 172.21.15.40:0/1063069364 >> v2:172.21.15.159:3300/0 conn(0x7f65b406d770 msgr2=0x7f65b40b1e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:48:50.938 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:50.935+0000 7f65b2d9d640 1 --2- 172.21.15.40:0/1063069364 >> v2:172.21.15.159:3300/0 conn(0x7f65b406d770 0x7f65b40b1e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:50.938 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:50.935+0000 7f65b2d9d640 1 -- 172.21.15.40:0/1063069364 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65b415bcb0 con 0x7f65b4141790 2023-12-17T11:48:50.939 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:50.936+0000 7f65b2d9d640 1 --2- 172.21.15.40:0/1063069364 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f65b4141790 0x7f65b415ed70 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f65b40b1aa0 tx=0x7f65ac02bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49751683a65f1e75 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:48:50.939 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:50.937+0000 7f65b159a640 1 -- 172.21.15.40:0/1063069364 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65ac02ca80 con 0x7f65b4141790 2023-12-17T11:48:50.939 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:50.937+0000 7f65b159a640 1 -- 172.21.15.40:0/1063069364 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65ac02cbe0 con 0x7f65b4141790 2023-12-17T11:48:50.939 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:50.937+0000 7f65b159a640 1 -- 172.21.15.40:0/1063069364 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65ac0343f0 con 0x7f65b4141790 2023-12-17T11:48:50.940 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:50.937+0000 7f65b8f0c640 1 -- 172.21.15.40:0/1063069364 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f65b4141790 msgr2=0x7f65b415ed70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:50.940 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:50.937+0000 7f65b8f0c640 1 --2- 172.21.15.40:0/1063069364 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f65b4141790 0x7f65b415ed70 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f65b40b1aa0 tx=0x7f65ac02bee0 comp rx=0 tx=0).stop 2023-12-17T11:48:50.940 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:50.938+0000 7f65b8f0c640 1 -- 172.21.15.40:0/1063069364 shutdown_connections 2023-12-17T11:48:50.940 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:50.938+0000 7f65b8f0c640 1 --2- 172.21.15.40:0/1063069364 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f65b4141790 0x7f65b415ed70 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:50.940 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:50.938+0000 7f65b8f0c640 1 --2- 172.21.15.40:0/1063069364 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f65b406db50 0x7f65b4141250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:50.940 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:50.938+0000 7f65b8f0c640 1 --2- 172.21.15.40:0/1063069364 >> v2:172.21.15.159:3300/0 conn(0x7f65b406d770 0x7f65b40b1e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:50.940 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:50.938+0000 7f65b8f0c640 1 -- 172.21.15.40:0/1063069364 >> 172.21.15.40:0/1063069364 conn(0x7f65b40cb850 msgr2=0x7f65b40cbc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:48:50.940 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:50.938+0000 7f65b8f0c640 1 -- 172.21.15.40:0/1063069364 shutdown_connections 2023-12-17T11:48:50.940 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:50.938+0000 7f65b8f0c640 1 -- 172.21.15.40:0/1063069364 wait complete. 2023-12-17T11:48:50.942 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:50.940+0000 7f65b8f0c640 1 Processor -- start 2023-12-17T11:48:50.942 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:50.940+0000 7f65b8f0c640 1 -- start start 2023-12-17T11:48:50.944 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:50.941+0000 7f65b8f0c640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f65b406d770 0x7f65b413e630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:50.944 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:50.941+0000 7f65b8f0c640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f65b406db50 0x7f65b415ebb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:50.944 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:50.942+0000 7f65b8f0c640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f65b4141790 0x7f65b4158e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:50.944 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:50.942+0000 7f65b8f0c640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65b4157c80 con 0x7f65b406db50 2023-12-17T11:48:50.944 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:50.942+0000 7f65b8f0c640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65b413eb70 con 0x7f65b406d770 2023-12-17T11:48:50.945 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:50.942+0000 7f65b8f0c640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65b4157ed0 con 0x7f65b4141790 2023-12-17T11:48:50.945 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:50.942+0000 7f65b1d9b640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f65b406db50 0x7f65b415ebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:50.945 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:50.942+0000 7f65b1d9b640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f65b406db50 0x7f65b415ebb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:41602/0 (socket says 172.21.15.40:41602) 2023-12-17T11:48:50.945 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:50.942+0000 7f65b1d9b640 1 -- 172.21.15.40:0/1695821482 learned_addr learned my addr 172.21.15.40:0/1695821482 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-17T11:48:50.945 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:50.942+0000 7f65b2d9d640 1 --2- 172.21.15.40:0/1695821482 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f65b4141790 0x7f65b4158e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:50.945 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:50.942+0000 7f65b259c640 1 --2- 172.21.15.40:0/1695821482 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f65b406d770 0x7f65b413e630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:50.945 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:50.942+0000 7f65b1d9b640 1 -- 172.21.15.40:0/1695821482 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f65b4141790 msgr2=0x7f65b4158e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:50.945 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:50.942+0000 7f65b1d9b640 1 --2- 172.21.15.40:0/1695821482 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f65b4141790 0x7f65b4158e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:50.945 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:50.942+0000 7f65b1d9b640 1 -- 172.21.15.40:0/1695821482 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f65b406d770 msgr2=0x7f65b413e630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:50.946 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:50.942+0000 7f65b1d9b640 1 --2- 172.21.15.40:0/1695821482 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f65b406d770 0x7f65b413e630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:50.946 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:50.942+0000 7f65b1d9b640 1 -- 172.21.15.40:0/1695821482 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65ac009b30 con 0x7f65b406db50 2023-12-17T11:48:50.946 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:50.943+0000 7f65b1d9b640 1 --2- 172.21.15.40:0/1695821482 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f65b406db50 0x7f65b415ebb0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f65a800d830 tx=0x7f65a800dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:48:50.947 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:50.943+0000 7f65a2ffd640 1 -- 172.21.15.40:0/1695821482 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65a800b6c0 con 0x7f65b406db50 2023-12-17T11:48:50.947 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:50.943+0000 7f65a2ffd640 1 -- 172.21.15.40:0/1695821482 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65a800b820 con 0x7f65b406db50 2023-12-17T11:48:50.947 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:50.943+0000 7f65a2ffd640 1 -- 172.21.15.40:0/1695821482 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65a800bbb0 con 0x7f65b406db50 2023-12-17T11:48:50.947 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:50.943+0000 7f65b8f0c640 1 -- 172.21.15.40:0/1695821482 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65b41581b0 con 0x7f65b406db50 2023-12-17T11:48:50.947 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:50.943+0000 7f65b8f0c640 1 -- 172.21.15.40:0/1695821482 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65b4158770 con 0x7f65b406db50 2023-12-17T11:48:50.947 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:50.944+0000 7f65b8f0c640 1 -- 172.21.15.40:0/1695821482 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65b40745d0 con 0x7f65b406db50 2023-12-17T11:48:50.947 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:50.945+0000 7f65a2ffd640 1 -- 172.21.15.40:0/1695821482 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f65a800bd10 con 0x7f65b406db50 2023-12-17T11:48:50.949 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:50.947+0000 7f65a2ffd640 1 --2- 172.21.15.40:0/1695821482 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f659406ae40 0x7f659406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:50.949 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:50.947+0000 7f65a2ffd640 1 -- 172.21.15.40:0/1695821482 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f65a8089ea0 con 0x7f65b406db50 2023-12-17T11:48:50.949 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:50.947+0000 7f65b259c640 1 --2- 172.21.15.40:0/1695821482 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f659406ae40 0x7f659406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:50.950 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:50.949+0000 7f65b259c640 1 --2- 172.21.15.40:0/1695821482 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f659406ae40 0x7f659406d300 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f65a4006fd0 tx=0x7f65a4008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:48:50.953 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:50.951+0000 7f65a2ffd640 1 -- 172.21.15.40:0/1695821482 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f65a8054c50 con 0x7f65b406db50 2023-12-17T11:48:51.151 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:51.149+0000 7f65b8f0c640 1 -- 172.21.15.40:0/1695821482 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f65b415c8c0 con 0x7f65b406db50 2023-12-17T11:48:51.152 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:51.150+0000 7f65a2ffd640 1 -- 172.21.15.40:0/1695821482 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) v1 ==== 104+0+11 (secure 0 0 0) 0x7f65a8058270 con 0x7f65b406db50 2023-12-17T11:48:51.152 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 32 2023-12-17T11:48:51.155 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:51.152+0000 7f65b8f0c640 1 -- 172.21.15.40:0/1695821482 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f659406ae40 msgr2=0x7f659406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:51.155 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:51.152+0000 7f65b8f0c640 1 --2- 172.21.15.40:0/1695821482 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f659406ae40 0x7f659406d300 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f65a4006fd0 tx=0x7f65a4008040 comp rx=0 tx=0).stop 2023-12-17T11:48:51.155 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:51.152+0000 7f65b8f0c640 1 -- 172.21.15.40:0/1695821482 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f65b406db50 msgr2=0x7f65b415ebb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:51.155 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:51.152+0000 7f65b8f0c640 1 --2- 172.21.15.40:0/1695821482 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f65b406db50 0x7f65b415ebb0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f65a800d830 tx=0x7f65a800dcf0 comp rx=0 tx=0).stop 2023-12-17T11:48:51.155 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:51.152+0000 7f65b8f0c640 1 -- 172.21.15.40:0/1695821482 shutdown_connections 2023-12-17T11:48:51.155 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:51.152+0000 7f65b8f0c640 1 --2- 172.21.15.40:0/1695821482 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f659406ae40 0x7f659406d300 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:51.155 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:51.152+0000 7f65b8f0c640 1 --2- 172.21.15.40:0/1695821482 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f65b4141790 0x7f65b4158e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:51.155 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:51.152+0000 7f65b8f0c640 1 --2- 172.21.15.40:0/1695821482 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f65b406db50 0x7f65b415ebb0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:51.155 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:51.152+0000 7f65b8f0c640 1 --2- 172.21.15.40:0/1695821482 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f65b406d770 0x7f65b413e630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:51.155 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:51.152+0000 7f65b8f0c640 1 -- 172.21.15.40:0/1695821482 >> 172.21.15.40:0/1695821482 conn(0x7f65b40cb850 msgr2=0x7f65b40ac860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:48:51.155 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:51.153+0000 7f65b8f0c640 1 -- 172.21.15.40:0/1695821482 shutdown_connections 2023-12-17T11:48:51.155 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:51.153+0000 7f65b8f0c640 1 -- 172.21.15.40:0/1695821482 wait complete. 2023-12-17T11:48:51.172 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-17T11:48:51.402 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:51.400+0000 7f58d4c1a640 1 Processor -- start 2023-12-17T11:48:51.402 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:51.400+0000 7f58d4c1a640 1 -- start start 2023-12-17T11:48:51.404 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:51.401+0000 7f58d4c1a640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f58d015ac00 0x7f58d00cd6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:51.404 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:51.401+0000 7f58d4c1a640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f58d015e410 0x7f58d00d0cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:51.404 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:51.401+0000 7f58d4c1a640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f58d00d1230 0x7f58d00cc4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:51.404 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:51.401+0000 7f58d4c1a640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58d00d16e0 con 0x7f58d015e410 2023-12-17T11:48:51.404 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:51.401+0000 7f58d4c1a640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58d00cf320 con 0x7f58d015ac00 2023-12-17T11:48:51.405 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:51.401+0000 7f58d4c1a640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58d00cdfb0 con 0x7f58d00d1230 2023-12-17T11:48:51.405 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:51.402+0000 7f58c7fff640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f58d015e410 0x7f58d00d0cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:51.405 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:51.402+0000 7f58c7fff640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f58d015e410 0x7f58d00d0cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:41616/0 (socket says 172.21.15.40:41616) 2023-12-17T11:48:51.405 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:51.402+0000 7f58c7fff640 1 -- 172.21.15.40:0/1631906720 learned_addr learned my addr 172.21.15.40:0/1631906720 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-17T11:48:51.405 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:51.402+0000 7f58cf7fe640 1 --2- 172.21.15.40:0/1631906720 >> v2:172.21.15.159:3300/0 conn(0x7f58d015ac00 0x7f58d00cd6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:51.405 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:51.402+0000 7f58cffff640 1 --2- 172.21.15.40:0/1631906720 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f58d00d1230 0x7f58d00cc4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:51.405 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:51.402+0000 7f58c7fff640 1 -- 172.21.15.40:0/1631906720 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f58d00d1230 msgr2=0x7f58d00cc4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:48:51.405 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:51.402+0000 7f58c7fff640 1 --2- 172.21.15.40:0/1631906720 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f58d00d1230 0x7f58d00cc4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:51.405 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:51.402+0000 7f58c7fff640 1 -- 172.21.15.40:0/1631906720 >> v2:172.21.15.159:3300/0 conn(0x7f58d015ac00 msgr2=0x7f58d00cd6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:48:51.405 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:51.402+0000 7f58c7fff640 1 --2- 172.21.15.40:0/1631906720 >> v2:172.21.15.159:3300/0 conn(0x7f58d015ac00 0x7f58d00cd6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:51.405 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:51.402+0000 7f58c7fff640 1 -- 172.21.15.40:0/1631906720 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58d00ce290 con 0x7f58d015e410 2023-12-17T11:48:51.405 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:51.402+0000 7f58cf7fe640 1 --2- 172.21.15.40:0/1631906720 >> v2:172.21.15.159:3300/0 conn(0x7f58d015ac00 0x7f58d00cd6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-17T11:48:51.406 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:51.404+0000 7f58c7fff640 1 --2- 172.21.15.40:0/1631906720 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f58d015e410 0x7f58d00d0cf0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f58d00d1a10 tx=0x7f58b802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3ff37fbe16f8cca server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:48:51.406 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:51.404+0000 7f58ceffd640 1 -- 172.21.15.40:0/1631906720 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58b8031870 con 0x7f58d015e410 2023-12-17T11:48:51.406 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:51.404+0000 7f58ceffd640 1 -- 172.21.15.40:0/1631906720 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58b80319d0 con 0x7f58d015e410 2023-12-17T11:48:51.406 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:51.404+0000 7f58ceffd640 1 -- 172.21.15.40:0/1631906720 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58b8031d60 con 0x7f58d015e410 2023-12-17T11:48:51.407 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:51.405+0000 7f58d4c1a640 1 -- 172.21.15.40:0/1631906720 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f58d015e410 msgr2=0x7f58d00d0cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:51.407 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:51.405+0000 7f58d4c1a640 1 --2- 172.21.15.40:0/1631906720 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f58d015e410 0x7f58d00d0cf0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f58d00d1a10 tx=0x7f58b802b910 comp rx=0 tx=0).stop 2023-12-17T11:48:51.407 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:51.405+0000 7f58d4c1a640 1 -- 172.21.15.40:0/1631906720 shutdown_connections 2023-12-17T11:48:51.407 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:51.405+0000 7f58d4c1a640 1 --2- 172.21.15.40:0/1631906720 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f58d00d1230 0x7f58d00cc4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:51.407 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:51.405+0000 7f58d4c1a640 1 --2- 172.21.15.40:0/1631906720 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f58d015e410 0x7f58d00d0cf0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:51.407 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:51.405+0000 7f58d4c1a640 1 --2- 172.21.15.40:0/1631906720 >> v2:172.21.15.159:3300/0 conn(0x7f58d015ac00 0x7f58d00cd6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:51.408 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:51.405+0000 7f58d4c1a640 1 -- 172.21.15.40:0/1631906720 >> 172.21.15.40:0/1631906720 conn(0x7f58d00999f0 msgr2=0x7f58d0099e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:48:51.408 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:51.405+0000 7f58d4c1a640 1 -- 172.21.15.40:0/1631906720 shutdown_connections 2023-12-17T11:48:51.408 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:51.405+0000 7f58d4c1a640 1 -- 172.21.15.40:0/1631906720 wait complete. 2023-12-17T11:48:51.409 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:51.407+0000 7f58d4c1a640 1 Processor -- start 2023-12-17T11:48:51.409 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:51.407+0000 7f58d4c1a640 1 -- start start 2023-12-17T11:48:51.410 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:51.408+0000 7f58d4c1a640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f58d00d1230 0x7f58d01f6d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:51.410 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:51.408+0000 7f58d4c1a640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f58d015ac00 0x7f58d00c65e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:51.410 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:51.408+0000 7f58d4c1a640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f58d015e410 0x7f58d00ca670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:51.410 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:51.408+0000 7f58d4c1a640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58d00c85b0 con 0x7f58d015e410 2023-12-17T11:48:51.410 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:51.408+0000 7f58d4c1a640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58d00c7710 con 0x7f58d00d1230 2023-12-17T11:48:51.411 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:51.408+0000 7f58d4c1a640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58d01f72d0 con 0x7f58d015ac00 2023-12-17T11:48:51.411 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:51.408+0000 7f58cffff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f58d015e410 0x7f58d00ca670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:51.411 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:51.408+0000 7f58cffff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f58d015e410 0x7f58d00ca670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:41620/0 (socket says 172.21.15.40:41620) 2023-12-17T11:48:51.411 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:51.408+0000 7f58cffff640 1 -- 172.21.15.40:0/1483962542 learned_addr learned my addr 172.21.15.40:0/1483962542 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-17T11:48:51.412 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:51.409+0000 7f58c7fff640 1 --2- 172.21.15.40:0/1483962542 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f58d015ac00 0x7f58d00c65e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:51.412 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:51.409+0000 7f58cf7fe640 1 --2- 172.21.15.40:0/1483962542 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f58d00d1230 0x7f58d01f6d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:51.412 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:51.409+0000 7f58cffff640 1 -- 172.21.15.40:0/1483962542 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f58d015ac00 msgr2=0x7f58d00c65e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:51.412 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:51.409+0000 7f58cffff640 1 --2- 172.21.15.40:0/1483962542 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f58d015ac00 0x7f58d00c65e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:51.412 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:51.409+0000 7f58cffff640 1 -- 172.21.15.40:0/1483962542 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f58d00d1230 msgr2=0x7f58d01f6d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:51.413 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:51.409+0000 7f58cffff640 1 --2- 172.21.15.40:0/1483962542 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f58d00d1230 0x7f58d01f6d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:51.413 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:51.409+0000 7f58cffff640 1 -- 172.21.15.40:0/1483962542 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58b80094d0 con 0x7f58d015e410 2023-12-17T11:48:51.413 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:51.409+0000 7f58c7fff640 1 --2- 172.21.15.40:0/1483962542 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f58d015ac00 0x7f58d00c65e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-17T11:48:51.413 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:51.409+0000 7f58cffff640 1 --2- 172.21.15.40:0/1483962542 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f58d015e410 0x7f58d00ca670 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f58c8007d80 tx=0x7f58c800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:48:51.413 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:51.410+0000 7f58ccff9640 1 -- 172.21.15.40:0/1483962542 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58c8014420 con 0x7f58d015e410 2023-12-17T11:48:51.413 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:51.410+0000 7f58ccff9640 1 -- 172.21.15.40:0/1483962542 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58c80145a0 con 0x7f58d015e410 2023-12-17T11:48:51.413 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:51.410+0000 7f58d4c1a640 1 -- 172.21.15.40:0/1483962542 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58d00c7430 con 0x7f58d015e410 2023-12-17T11:48:51.413 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:51.410+0000 7f58ccff9640 1 -- 172.21.15.40:0/1483962542 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58c8014950 con 0x7f58d015e410 2023-12-17T11:48:51.413 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:51.410+0000 7f58d4c1a640 1 -- 172.21.15.40:0/1483962542 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58d00c8240 con 0x7f58d015e410 2023-12-17T11:48:51.414 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:51.411+0000 7f58d4c1a640 1 -- 172.21.15.40:0/1483962542 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58d00ca350 con 0x7f58d015e410 2023-12-17T11:48:51.414 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:51.412+0000 7f58ccff9640 1 -- 172.21.15.40:0/1483962542 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f58c8014ab0 con 0x7f58d015e410 2023-12-17T11:48:51.414 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:51.413+0000 7f58ccff9640 1 --2- 172.21.15.40:0/1483962542 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f58b006ae40 0x7f58b006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:51.414 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:51.413+0000 7f58ccff9640 1 -- 172.21.15.40:0/1483962542 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f58c808a120 con 0x7f58d015e410 2023-12-17T11:48:51.415 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:51.413+0000 7f58cf7fe640 1 --2- 172.21.15.40:0/1483962542 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f58b006ae40 0x7f58b006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:51.416 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:51.414+0000 7f58cf7fe640 1 --2- 172.21.15.40:0/1483962542 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f58b006ae40 0x7f58b006d300 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f58d00b6df0 tx=0x7f58c0008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:48:51.419 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:51.417+0000 7f58ccff9640 1 -- 172.21.15.40:0/1483962542 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f58c8054f70 con 0x7f58d015e410 2023-12-17T11:48:51.614 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:51.612+0000 7f58d4c1a640 1 -- 172.21.15.40:0/1483962542 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f58d00673f0 con 0x7f58d015e410 2023-12-17T11:48:51.615 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:51.613+0000 7f58ccff9640 1 -- 172.21.15.40:0/1483962542 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) v1 ==== 100+0+11 (secure 0 0 0) 0x7f58c8058590 con 0x7f58d015e410 2023-12-17T11:48:51.616 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 64 2023-12-17T11:48:51.618 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:51.616+0000 7f58d4c1a640 1 -- 172.21.15.40:0/1483962542 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f58b006ae40 msgr2=0x7f58b006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:51.618 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:51.616+0000 7f58d4c1a640 1 --2- 172.21.15.40:0/1483962542 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f58b006ae40 0x7f58b006d300 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f58d00b6df0 tx=0x7f58c0008040 comp rx=0 tx=0).stop 2023-12-17T11:48:51.618 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:51.616+0000 7f58d4c1a640 1 -- 172.21.15.40:0/1483962542 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f58d015e410 msgr2=0x7f58d00ca670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:51.618 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:51.616+0000 7f58d4c1a640 1 --2- 172.21.15.40:0/1483962542 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f58d015e410 0x7f58d00ca670 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f58c8007d80 tx=0x7f58c800e4b0 comp rx=0 tx=0).stop 2023-12-17T11:48:51.618 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:51.616+0000 7f58d4c1a640 1 -- 172.21.15.40:0/1483962542 shutdown_connections 2023-12-17T11:48:51.618 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:51.616+0000 7f58d4c1a640 1 --2- 172.21.15.40:0/1483962542 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f58b006ae40 0x7f58b006d300 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:51.618 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:51.616+0000 7f58d4c1a640 1 --2- 172.21.15.40:0/1483962542 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f58d015e410 0x7f58d00ca670 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:51.619 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:51.616+0000 7f58d4c1a640 1 --2- 172.21.15.40:0/1483962542 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f58d015ac00 0x7f58d00c65e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:51.619 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:51.616+0000 7f58d4c1a640 1 --2- 172.21.15.40:0/1483962542 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f58d00d1230 0x7f58d01f6d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:51.619 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:51.616+0000 7f58d4c1a640 1 -- 172.21.15.40:0/1483962542 >> 172.21.15.40:0/1483962542 conn(0x7f58d00999f0 msgr2=0x7f58d0099dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:48:51.619 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:51.616+0000 7f58d4c1a640 1 -- 172.21.15.40:0/1483962542 shutdown_connections 2023-12-17T11:48:51.619 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:51.616+0000 7f58d4c1a640 1 -- 172.21.15.40:0/1483962542 wait complete. 2023-12-17T11:48:51.638 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-12-17T11:48:51.866 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:51.864+0000 7f336383d640 1 Processor -- start 2023-12-17T11:48:51.866 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:51.864+0000 7f336383d640 1 -- start start 2023-12-17T11:48:51.868 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:51.866+0000 7f336383d640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f335c06db50 0x7f335c141250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:51.868 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:51.866+0000 7f336383d640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f335c141790 0x7f335c0cce00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:51.868 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:51.866+0000 7f336383d640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f335c15b780 con 0x7f335c06d770 2023-12-17T11:48:51.868 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:51.866+0000 7f336383d640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f335c141c20 con 0x7f335c06db50 2023-12-17T11:48:51.868 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:51.866+0000 7f336383d640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f335c0b2510 con 0x7f335c141790 2023-12-17T11:48:51.869 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:51.866+0000 7f3360dd8640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f335c06db50 0x7f335c141250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:51.869 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:51.866+0000 7f3360dd8640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f335c06db50 0x7f335c141250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:41630/0 (socket says 172.21.15.40:41630) 2023-12-17T11:48:51.869 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:51.866+0000 7f3360dd8640 1 -- 172.21.15.40:0/4289127131 learned_addr learned my addr 172.21.15.40:0/4289127131 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-17T11:48:51.869 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:51.867+0000 7f3361dda640 1 --2- 172.21.15.40:0/4289127131 >> v2:172.21.15.159:3300/0 conn(0x7f335c141790 0x7f335c0cce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:51.869 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:51.867+0000 7f3360dd8640 1 -- 172.21.15.40:0/4289127131 >> v2:172.21.15.159:3300/0 conn(0x7f335c141790 msgr2=0x7f335c0cce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:48:51.869 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:51.867+0000 7f3360dd8640 1 --2- 172.21.15.40:0/4289127131 >> v2:172.21.15.159:3300/0 conn(0x7f335c141790 0x7f335c0cce00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:51.870 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:51.867+0000 7f3360dd8640 1 -- 172.21.15.40:0/4289127131 >> v1:172.21.15.40:6789/0 conn(0x7f335c06d770 legacy=0x7f335c0b1e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:51.870 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:51.867+0000 7f3360dd8640 1 -- 172.21.15.40:0/4289127131 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f335c15b9d0 con 0x7f335c06db50 2023-12-17T11:48:51.870 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:51.867+0000 7f3353fff640 1 -- 172.21.15.40:0/4289127131 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1728657360 0 0) 0x7f335c15b780 con 0x7f335c06d770 2023-12-17T11:48:51.870 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:51.868+0000 7f3360dd8640 1 --2- 172.21.15.40:0/4289127131 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f335c06db50 0x7f335c141250 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f335c0b45e0 tx=0x7f334c02b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67f1ca02c6455f16 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:48:51.871 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:51.869+0000 7f3353fff640 1 -- 172.21.15.40:0/4289127131 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f334c030860 con 0x7f335c06db50 2023-12-17T11:48:51.871 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:51.869+0000 7f3353fff640 1 -- 172.21.15.40:0/4289127131 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f334c0309c0 con 0x7f335c06db50 2023-12-17T11:48:51.871 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:51.869+0000 7f3353fff640 1 -- 172.21.15.40:0/4289127131 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f334c030d50 con 0x7f335c06db50 2023-12-17T11:48:51.872 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:51.870+0000 7f336383d640 1 -- 172.21.15.40:0/4289127131 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f335c06db50 msgr2=0x7f335c141250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:51.872 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:51.870+0000 7f336383d640 1 --2- 172.21.15.40:0/4289127131 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f335c06db50 0x7f335c141250 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f335c0b45e0 tx=0x7f334c02b9a0 comp rx=0 tx=0).stop 2023-12-17T11:48:51.872 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:51.870+0000 7f336383d640 1 -- 172.21.15.40:0/4289127131 shutdown_connections 2023-12-17T11:48:51.872 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:51.870+0000 7f336383d640 1 --2- 172.21.15.40:0/4289127131 >> v2:172.21.15.159:3300/0 conn(0x7f335c141790 0x7f335c0cce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:51.872 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:51.870+0000 7f336383d640 1 --2- 172.21.15.40:0/4289127131 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f335c06db50 0x7f335c141250 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:51.872 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:51.870+0000 7f336383d640 1 -- 172.21.15.40:0/4289127131 >> 172.21.15.40:0/4289127131 conn(0x7f335c0cb850 msgr2=0x7f335c0cbc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:48:51.872 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:51.870+0000 7f336383d640 1 -- 172.21.15.40:0/4289127131 shutdown_connections 2023-12-17T11:48:51.872 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:51.870+0000 7f336383d640 1 -- 172.21.15.40:0/4289127131 wait complete. 2023-12-17T11:48:51.875 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:51.872+0000 7f336383d640 1 Processor -- start 2023-12-17T11:48:51.875 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:51.873+0000 7f336383d640 1 -- start start 2023-12-17T11:48:51.876 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:51.874+0000 7f336383d640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f335c06d770 0x7f335c15abb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:51.876 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:51.874+0000 7f336383d640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f335c06db50 0x7f335c15daa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:51.876 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:51.874+0000 7f336383d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f335c141790 0x7f335c070bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:51.876 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:51.874+0000 7f336383d640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f335c15e560 con 0x7f335c141790 2023-12-17T11:48:51.876 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:51.874+0000 7f336383d640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f335c15e840 con 0x7f335c06db50 2023-12-17T11:48:51.877 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:51.874+0000 7f336383d640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f335c15eb20 con 0x7f335c06d770 2023-12-17T11:48:51.877 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:51.874+0000 7f3361dda640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f335c141790 0x7f335c070bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:51.877 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:51.874+0000 7f3361dda640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f335c141790 0x7f335c070bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:41632/0 (socket says 172.21.15.40:41632) 2023-12-17T11:48:51.877 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:51.874+0000 7f3361dda640 1 -- 172.21.15.40:0/3720069181 learned_addr learned my addr 172.21.15.40:0/3720069181 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-17T11:48:51.877 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:51.874+0000 7f33615d9640 1 --2- 172.21.15.40:0/3720069181 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f335c06d770 0x7f335c15abb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:51.877 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:51.874+0000 7f3360dd8640 1 --2- 172.21.15.40:0/3720069181 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f335c06db50 0x7f335c15daa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:51.878 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:51.875+0000 7f3361dda640 1 -- 172.21.15.40:0/3720069181 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f335c06d770 msgr2=0x7f335c15abb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:51.878 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:51.875+0000 7f3361dda640 1 --2- 172.21.15.40:0/3720069181 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f335c06d770 0x7f335c15abb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:51.878 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:51.875+0000 7f3361dda640 1 -- 172.21.15.40:0/3720069181 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f335c06db50 msgr2=0x7f335c15daa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:51.878 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:51.875+0000 7f3361dda640 1 --2- 172.21.15.40:0/3720069181 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f335c06db50 0x7f335c15daa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:51.878 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:51.875+0000 7f3361dda640 1 -- 172.21.15.40:0/3720069181 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f334c0094d0 con 0x7f335c141790 2023-12-17T11:48:51.878 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:51.875+0000 7f3361dda640 1 --2- 172.21.15.40:0/3720069181 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f335c141790 0x7f335c070bf0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f3354007e60 tx=0x7f335400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:48:51.879 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:51.875+0000 7f3351ffb640 1 -- 172.21.15.40:0/3720069181 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3354014420 con 0x7f335c141790 2023-12-17T11:48:51.879 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:51.875+0000 7f3351ffb640 1 -- 172.21.15.40:0/3720069181 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33540145a0 con 0x7f335c141790 2023-12-17T11:48:51.879 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:51.875+0000 7f3351ffb640 1 -- 172.21.15.40:0/3720069181 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3354014950 con 0x7f335c141790 2023-12-17T11:48:51.879 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:51.875+0000 7f336383d640 1 -- 172.21.15.40:0/3720069181 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f335c15ee00 con 0x7f335c141790 2023-12-17T11:48:51.879 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:51.876+0000 7f336383d640 1 -- 172.21.15.40:0/3720069181 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f335c13dde0 con 0x7f335c141790 2023-12-17T11:48:51.879 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:51.877+0000 7f336383d640 1 -- 172.21.15.40:0/3720069181 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f335c0745d0 con 0x7f335c141790 2023-12-17T11:48:51.880 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:51.878+0000 7f3351ffb640 1 -- 172.21.15.40:0/3720069181 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f3354014ab0 con 0x7f335c141790 2023-12-17T11:48:51.881 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:51.879+0000 7f3351ffb640 1 --2- 172.21.15.40:0/3720069181 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f334006ae40 0x7f334006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:51.881 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:51.879+0000 7f3351ffb640 1 -- 172.21.15.40:0/3720069181 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f335408a380 con 0x7f335c141790 2023-12-17T11:48:51.881 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:51.879+0000 7f33615d9640 1 --2- 172.21.15.40:0/3720069181 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f334006ae40 0x7f334006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:51.882 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:51.881+0000 7f33615d9640 1 --2- 172.21.15.40:0/3720069181 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f334006ae40 0x7f334006d300 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f3358000f60 tx=0x7f3358009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:48:51.885 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:51.883+0000 7f3351ffb640 1 -- 172.21.15.40:0/3720069181 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f3354055010 con 0x7f335c141790 2023-12-17T11:48:52.077 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:52.075+0000 7f336383d640 1 -- 172.21.15.40:0/3720069181 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f335c15f320 con 0x7f335c141790 2023-12-17T11:48:52.078 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:52.076+0000 7f3351ffb640 1 -- 172.21.15.40:0/3720069181 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v25) v1 ==== 103+0+11 (secure 0 0 0) 0x7f335c15f320 con 0x7f335c141790 2023-12-17T11:48:52.078 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 32 2023-12-17T11:48:52.080 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:52.078+0000 7f336383d640 1 -- 172.21.15.40:0/3720069181 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f334006ae40 msgr2=0x7f334006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:52.080 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:52.078+0000 7f336383d640 1 --2- 172.21.15.40:0/3720069181 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f334006ae40 0x7f334006d300 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f3358000f60 tx=0x7f3358009040 comp rx=0 tx=0).stop 2023-12-17T11:48:52.080 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:52.078+0000 7f336383d640 1 -- 172.21.15.40:0/3720069181 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f335c141790 msgr2=0x7f335c070bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:52.080 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:52.078+0000 7f336383d640 1 --2- 172.21.15.40:0/3720069181 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f335c141790 0x7f335c070bf0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f3354007e60 tx=0x7f335400e4b0 comp rx=0 tx=0).stop 2023-12-17T11:48:52.080 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:52.078+0000 7f336383d640 1 -- 172.21.15.40:0/3720069181 shutdown_connections 2023-12-17T11:48:52.081 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:52.078+0000 7f336383d640 1 --2- 172.21.15.40:0/3720069181 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f334006ae40 0x7f334006d300 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:52.081 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:52.078+0000 7f336383d640 1 --2- 172.21.15.40:0/3720069181 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f335c141790 0x7f335c070bf0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:52.081 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:52.078+0000 7f336383d640 1 --2- 172.21.15.40:0/3720069181 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f335c06db50 0x7f335c15daa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:52.081 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:52.078+0000 7f336383d640 1 --2- 172.21.15.40:0/3720069181 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f335c06d770 0x7f335c15abb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:52.081 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:52.078+0000 7f336383d640 1 -- 172.21.15.40:0/3720069181 >> 172.21.15.40:0/3720069181 conn(0x7f335c0cb850 msgr2=0x7f335c142320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:48:52.081 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:52.078+0000 7f336383d640 1 -- 172.21.15.40:0/3720069181 shutdown_connections 2023-12-17T11:48:52.081 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:52.078+0000 7f336383d640 1 -- 172.21.15.40:0/3720069181 wait complete. 2023-12-17T11:48:52.100 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-17T11:48:52.314 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:52.312+0000 7fafe518a640 1 Processor -- start 2023-12-17T11:48:52.314 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:52.312+0000 7fafe518a640 1 -- start start 2023-12-17T11:48:52.316 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:52.314+0000 7fafe518a640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7fafe015e5d0 0x7fafe006bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:52.316 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:52.314+0000 7fafe518a640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fafe0071260 0x7fafe00cded0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:52.316 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:52.314+0000 7fafe518a640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fafe0071f90 con 0x7fafe00ae200 2023-12-17T11:48:52.316 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:52.314+0000 7fafe518a640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fafe0072270 con 0x7fafe0071260 2023-12-17T11:48:52.316 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:52.314+0000 7fafe518a640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fafe0070070 con 0x7fafe015e5d0 2023-12-17T11:48:52.317 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:52.314+0000 7fafe4989640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fafe0071260 0x7fafe00cded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:52.318 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:52.315+0000 7fafe4989640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fafe0071260 0x7fafe00cded0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:41642/0 (socket says 172.21.15.40:41642) 2023-12-17T11:48:52.318 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:52.315+0000 7fafe4989640 1 -- 172.21.15.40:0/89819924 learned_addr learned my addr 172.21.15.40:0/89819924 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-17T11:48:52.318 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:52.315+0000 7fafdffff640 1 --2- 172.21.15.40:0/89819924 >> v2:172.21.15.159:3300/0 conn(0x7fafe015e5d0 0x7fafe006bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:52.318 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:52.315+0000 7fafe4989640 1 -- 172.21.15.40:0/89819924 >> v2:172.21.15.159:3300/0 conn(0x7fafe015e5d0 msgr2=0x7fafe006bdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:48:52.318 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:52.315+0000 7fafe4989640 1 --2- 172.21.15.40:0/89819924 >> v2:172.21.15.159:3300/0 conn(0x7fafe015e5d0 0x7fafe006bdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:52.318 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:52.315+0000 7fafe4989640 1 -- 172.21.15.40:0/89819924 >> v1:172.21.15.159:6789/0 conn(0x7fafe00ae200 legacy=0x7fafe0070b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:48:52.318 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:52.315+0000 7fafe4989640 1 -- 172.21.15.40:0/89819924 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafe0070350 con 0x7fafe0071260 2023-12-17T11:48:52.320 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:52.317+0000 7fafe4989640 1 --2- 172.21.15.40:0/89819924 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fafe0071260 0x7fafe00cded0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fafe006bb50 tx=0x7fafd802be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d83cdd1ea6c23642 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:48:52.320 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:52.317+0000 7fafdf7fe640 1 -- 172.21.15.40:0/89819924 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafd802c9f0 con 0x7fafe0071260 2023-12-17T11:48:52.320 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:52.317+0000 7fafdf7fe640 1 -- 172.21.15.40:0/89819924 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafd802cb50 con 0x7fafe0071260 2023-12-17T11:48:52.320 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:52.317+0000 7fafdf7fe640 1 -- 172.21.15.40:0/89819924 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafd80343f0 con 0x7fafe0071260 2023-12-17T11:48:52.321 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:52.318+0000 7fafe518a640 1 -- 172.21.15.40:0/89819924 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fafe0071260 msgr2=0x7fafe00cded0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:52.322 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:52.318+0000 7fafe518a640 1 --2- 172.21.15.40:0/89819924 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fafe0071260 0x7fafe00cded0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fafe006bb50 tx=0x7fafd802be50 comp rx=0 tx=0).stop 2023-12-17T11:48:52.322 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:52.318+0000 7fafe518a640 1 -- 172.21.15.40:0/89819924 shutdown_connections 2023-12-17T11:48:52.322 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:52.318+0000 7fafe518a640 1 --2- 172.21.15.40:0/89819924 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fafe0071260 0x7fafe00cded0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:52.322 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:52.318+0000 7fafe518a640 1 --2- 172.21.15.40:0/89819924 >> v2:172.21.15.159:3300/0 conn(0x7fafe015e5d0 0x7fafe006bdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:52.322 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:52.318+0000 7fafe518a640 1 -- 172.21.15.40:0/89819924 >> 172.21.15.40:0/89819924 conn(0x7fafe00b0860 msgr2=0x7fafe00b0c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:48:52.322 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:52.318+0000 7fafe518a640 1 -- 172.21.15.40:0/89819924 shutdown_connections 2023-12-17T11:48:52.322 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:52.318+0000 7fafe518a640 1 -- 172.21.15.40:0/89819924 wait complete. 2023-12-17T11:48:52.322 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:52.319+0000 7fafe518a640 1 Processor -- start 2023-12-17T11:48:52.322 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:52.320+0000 7fafe518a640 1 -- start start 2023-12-17T11:48:52.324 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:52.320+0000 7fafe518a640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fafe0071260 0x7fafe0156160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:52.324 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:52.320+0000 7fafe518a640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fafe00ae200 0x7fafe014fd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:52.324 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:52.320+0000 7fafe518a640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fafe015e5d0 0x7fafe0157920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:52.324 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:52.321+0000 7fafe518a640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafe01566a0 con 0x7fafe0071260 2023-12-17T11:48:52.324 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:52.321+0000 7fafe518a640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafe01550c0 con 0x7fafe00ae200 2023-12-17T11:48:52.324 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:52.321+0000 7fafe518a640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fafe01553a0 con 0x7fafe015e5d0 2023-12-17T11:48:52.324 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:52.321+0000 7fafdffff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fafe0071260 0x7fafe0156160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:52.325 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:52.321+0000 7fafdffff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fafe0071260 0x7fafe0156160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:41654/0 (socket says 172.21.15.40:41654) 2023-12-17T11:48:52.325 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:52.321+0000 7fafdffff640 1 -- 172.21.15.40:0/1842429476 learned_addr learned my addr 172.21.15.40:0/1842429476 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-17T11:48:52.325 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:52.321+0000 7fafe4989640 1 --2- 172.21.15.40:0/1842429476 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fafe015e5d0 0x7fafe0157920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:52.325 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:52.321+0000 7fafd7fff640 1 --2- 172.21.15.40:0/1842429476 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fafe00ae200 0x7fafe014fd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:52.325 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:52.321+0000 7fafdffff640 1 -- 172.21.15.40:0/1842429476 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fafe015e5d0 msgr2=0x7fafe0157920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:52.325 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:52.321+0000 7fafdffff640 1 --2- 172.21.15.40:0/1842429476 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fafe015e5d0 0x7fafe0157920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:52.325 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:52.321+0000 7fafdffff640 1 -- 172.21.15.40:0/1842429476 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fafe00ae200 msgr2=0x7fafe014fd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:52.325 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:52.321+0000 7fafdffff640 1 --2- 172.21.15.40:0/1842429476 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fafe00ae200 0x7fafe014fd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:52.325 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:52.321+0000 7fafdffff640 1 -- 172.21.15.40:0/1842429476 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafd8009b30 con 0x7fafe0071260 2023-12-17T11:48:52.325 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:52.321+0000 7fafd7fff640 1 --2- 172.21.15.40:0/1842429476 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fafe00ae200 0x7fafe014fd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-17T11:48:52.325 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:52.322+0000 7fafdffff640 1 --2- 172.21.15.40:0/1842429476 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fafe0071260 0x7fafe0156160 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fafd000d5f0 tx=0x7fafd000dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:48:52.325 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:52.322+0000 7fafdd7fa640 1 -- 172.21.15.40:0/1842429476 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafd00125f0 con 0x7fafe0071260 2023-12-17T11:48:52.325 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:52.322+0000 7fafdd7fa640 1 -- 172.21.15.40:0/1842429476 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafd0012750 con 0x7fafe0071260 2023-12-17T11:48:52.326 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:52.322+0000 7fafdd7fa640 1 -- 172.21.15.40:0/1842429476 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafd0012b00 con 0x7fafe0071260 2023-12-17T11:48:52.326 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:52.322+0000 7fafe518a640 1 -- 172.21.15.40:0/1842429476 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fafe0155680 con 0x7fafe0071260 2023-12-17T11:48:52.326 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:52.322+0000 7fafe518a640 1 -- 172.21.15.40:0/1842429476 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fafe0155c40 con 0x7fafe0071260 2023-12-17T11:48:52.326 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:52.323+0000 7fafe518a640 1 -- 172.21.15.40:0/1842429476 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fafe0074450 con 0x7fafe0071260 2023-12-17T11:48:52.326 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:52.324+0000 7fafdd7fa640 1 -- 172.21.15.40:0/1842429476 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fafd0012c60 con 0x7fafe0071260 2023-12-17T11:48:52.327 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:52.325+0000 7fafdd7fa640 1 --2- 172.21.15.40:0/1842429476 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7fafc006ae40 0x7fafc006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:52.327 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:52.325+0000 7fafdd7fa640 1 -- 172.21.15.40:0/1842429476 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fafd0089e40 con 0x7fafe0071260 2023-12-17T11:48:52.327 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:52.325+0000 7fafd7fff640 1 --2- 172.21.15.40:0/1842429476 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7fafc006ae40 0x7fafc006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:52.328 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:52.326+0000 7fafd7fff640 1 --2- 172.21.15.40:0/1842429476 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7fafc006ae40 0x7fafc006d300 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fafe01f6800 tx=0x7fafc8009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:48:52.331 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:52.330+0000 7fafdd7fa640 1 -- 172.21.15.40:0/1842429476 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fafd0054b60 con 0x7fafe0071260 2023-12-17T11:48:52.565 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:52.563+0000 7fafe518a640 1 -- 172.21.15.40:0/1842429476 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fafe00718f0 con 0x7fafe0071260 2023-12-17T11:48:52.566 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:52.564+0000 7fafdd7fa640 1 -- 172.21.15.40:0/1842429476 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4915 (secure 0 0 0) 0x7fafd0058180 con 0x7fafe0071260 2023-12-17T11:48:52.566 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T11:48:52.566 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/3337931457","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":3337931457},{"type":"v1","addr":"172.21.15.40:6835","nonce":3337931457}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4257,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6833/1874601964","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6832","nonce":1874601964},{"type":"v1","addr":"172.21.15.40:6833","nonce":1874601964}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4267,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6836/3645037845","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6834","nonce":3645037845},{"type":"v1","addr":"172.21.15.159:6836","nonce":3645037845}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-17T11:48:17.696113+0000","modified":"2023-12-17T11:48:40.061005+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4270},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4270":{"gid":4270,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.159:6837/1288849778","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6835","nonce":1288849778},{"type":"v1","addr":"172.21.15.159:6837","nonce":1288849778}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-12-17T11:48:52.567 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 8 2023-12-17T11:48:52.569 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:52.567+0000 7fafe518a640 1 -- 172.21.15.40:0/1842429476 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7fafc006ae40 msgr2=0x7fafc006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:52.569 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:52.567+0000 7fafe518a640 1 --2- 172.21.15.40:0/1842429476 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7fafc006ae40 0x7fafc006d300 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fafe01f6800 tx=0x7fafc8009040 comp rx=0 tx=0).stop 2023-12-17T11:48:52.569 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:52.567+0000 7fafe518a640 1 -- 172.21.15.40:0/1842429476 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fafe0071260 msgr2=0x7fafe0156160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:52.569 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:52.567+0000 7fafe518a640 1 --2- 172.21.15.40:0/1842429476 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fafe0071260 0x7fafe0156160 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fafd000d5f0 tx=0x7fafd000dab0 comp rx=0 tx=0).stop 2023-12-17T11:48:52.570 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:52.567+0000 7fafe518a640 1 -- 172.21.15.40:0/1842429476 shutdown_connections 2023-12-17T11:48:52.570 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:52.567+0000 7fafe518a640 1 --2- 172.21.15.40:0/1842429476 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7fafc006ae40 0x7fafc006d300 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:52.570 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:52.567+0000 7fafe518a640 1 --2- 172.21.15.40:0/1842429476 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fafe015e5d0 0x7fafe0157920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:52.570 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:52.567+0000 7fafe518a640 1 --2- 172.21.15.40:0/1842429476 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fafe00ae200 0x7fafe014fd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:52.570 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:52.567+0000 7fafe518a640 1 --2- 172.21.15.40:0/1842429476 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fafe0071260 0x7fafe0156160 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:52.570 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:52.567+0000 7fafe518a640 1 -- 172.21.15.40:0/1842429476 >> 172.21.15.40:0/1842429476 conn(0x7fafe00b0860 msgr2=0x7fafe006ce40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:48:52.570 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:52.568+0000 7fafe518a640 1 -- 172.21.15.40:0/1842429476 shutdown_connections 2023-12-17T11:48:52.570 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:52.568+0000 7fafe518a640 1 -- 172.21.15.40:0/1842429476 wait complete. 2023-12-17T11:48:52.588 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-17T11:48:52.806 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:52.804+0000 7f376f59e640 1 Processor -- start 2023-12-17T11:48:52.806 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:52.804+0000 7f376f59e640 1 -- start start 2023-12-17T11:48:52.809 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:52.806+0000 7f376f59e640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f377015e5d0 0x7f377006bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:52.809 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:52.806+0000 7f376f59e640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f37700ae200 0x7f3770070b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:52.809 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:52.806+0000 7f376f59e640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3770071f90 con 0x7f377006c330 2023-12-17T11:48:52.809 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:52.806+0000 7f376f59e640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3770072270 con 0x7f37700ae200 2023-12-17T11:48:52.809 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:52.806+0000 7f376f59e640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3770070070 con 0x7f377015e5d0 2023-12-17T11:48:52.809 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:52.806+0000 7f3765d9b640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f37700ae200 0x7f3770070b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:52.809 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:52.806+0000 7f3765d9b640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f37700ae200 0x7f3770070b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:41662/0 (socket says 172.21.15.40:41662) 2023-12-17T11:48:52.809 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:52.806+0000 7f3765d9b640 1 -- 172.21.15.40:0/2358198756 learned_addr learned my addr 172.21.15.40:0/2358198756 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-17T11:48:52.809 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:52.807+0000 7f376e59c640 1 --2- 172.21.15.40:0/2358198756 >> v2:172.21.15.159:3300/0 conn(0x7f377015e5d0 0x7f377006bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:52.809 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:52.807+0000 7f3765d9b640 1 -- 172.21.15.40:0/2358198756 >> v2:172.21.15.159:3300/0 conn(0x7f377015e5d0 msgr2=0x7f377006bdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:48:52.810 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:52.807+0000 7f3765d9b640 1 --2- 172.21.15.40:0/2358198756 >> v2:172.21.15.159:3300/0 conn(0x7f377015e5d0 0x7f377006bdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:52.810 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:52.807+0000 7f3765d9b640 1 -- 172.21.15.40:0/2358198756 >> v1:172.21.15.159:6789/0 conn(0x7f377006c330 legacy=0x7f37700cded0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:48:52.810 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:52.807+0000 7f3765d9b640 1 -- 172.21.15.40:0/2358198756 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3770070350 con 0x7f37700ae200 2023-12-17T11:48:52.810 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:52.807+0000 7f376e59c640 1 --2- 172.21.15.40:0/2358198756 >> v2:172.21.15.159:3300/0 conn(0x7f377015e5d0 0x7f377006bdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-17T11:48:52.811 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:52.808+0000 7f3765d9b640 1 --2- 172.21.15.40:0/2358198756 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f37700ae200 0x7f3770070b50 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f377006bb50 tx=0x7f375802b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=635bb010a39b046e server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:48:52.811 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:52.808+0000 7f376dd9b640 1 -- 172.21.15.40:0/2358198756 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37580317e0 con 0x7f37700ae200 2023-12-17T11:48:52.811 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:52.808+0000 7f376dd9b640 1 -- 172.21.15.40:0/2358198756 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3758031940 con 0x7f37700ae200 2023-12-17T11:48:52.811 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:52.808+0000 7f376dd9b640 1 -- 172.21.15.40:0/2358198756 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3758031cd0 con 0x7f37700ae200 2023-12-17T11:48:52.811 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:52.809+0000 7f376f59e640 1 -- 172.21.15.40:0/2358198756 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f37700ae200 msgr2=0x7f3770070b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:52.811 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:52.809+0000 7f376f59e640 1 --2- 172.21.15.40:0/2358198756 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f37700ae200 0x7f3770070b50 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f377006bb50 tx=0x7f375802b880 comp rx=0 tx=0).stop 2023-12-17T11:48:52.811 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:52.809+0000 7f376f59e640 1 -- 172.21.15.40:0/2358198756 shutdown_connections 2023-12-17T11:48:52.811 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:52.809+0000 7f376f59e640 1 --2- 172.21.15.40:0/2358198756 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f37700ae200 0x7f3770070b50 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:52.811 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:52.809+0000 7f376f59e640 1 --2- 172.21.15.40:0/2358198756 >> v2:172.21.15.159:3300/0 conn(0x7f377015e5d0 0x7f377006bdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:52.811 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:52.809+0000 7f376f59e640 1 -- 172.21.15.40:0/2358198756 >> 172.21.15.40:0/2358198756 conn(0x7f37700b0860 msgr2=0x7f37700b0c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:48:52.812 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:52.809+0000 7f376f59e640 1 -- 172.21.15.40:0/2358198756 shutdown_connections 2023-12-17T11:48:52.812 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:52.809+0000 7f376f59e640 1 -- 172.21.15.40:0/2358198756 wait complete. 2023-12-17T11:48:52.812 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:52.811+0000 7f376f59e640 1 Processor -- start 2023-12-17T11:48:52.813 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:52.811+0000 7f376f59e640 1 -- start start 2023-12-17T11:48:52.815 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:52.812+0000 7f376f59e640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f377006c330 0x7f377014b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:52.815 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:52.812+0000 7f376f59e640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f37700ae200 0x7f37701f6480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:52.815 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:52.812+0000 7f376f59e640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f377015e5d0 0x7f377009a400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:52.815 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:52.812+0000 7f376f59e640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f377014b490 con 0x7f37700ae200 2023-12-17T11:48:52.815 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:52.812+0000 7f376f59e640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f377014bdf0 con 0x7f377006c330 2023-12-17T11:48:52.815 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:52.812+0000 7f376f59e640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f377014a570 con 0x7f377015e5d0 2023-12-17T11:48:52.816 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:52.812+0000 7f3765d9b640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f37700ae200 0x7f37701f6480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:52.816 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:52.812+0000 7f3765d9b640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f37700ae200 0x7f37701f6480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:41674/0 (socket says 172.21.15.40:41674) 2023-12-17T11:48:52.816 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:52.812+0000 7f3765d9b640 1 -- 172.21.15.40:0/2681846384 learned_addr learned my addr 172.21.15.40:0/2681846384 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-17T11:48:52.816 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:52.812+0000 7f3765d9b640 1 -- 172.21.15.40:0/2681846384 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f377015e5d0 msgr2=0x7f377009a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:52.816 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:52.812+0000 7f376ed9d640 1 --2- 172.21.15.40:0/2681846384 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f377015e5d0 0x7f377009a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:52.816 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:52.812+0000 7f376e59c640 1 --2- 172.21.15.40:0/2681846384 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f377006c330 0x7f377014b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:52.816 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:52.813+0000 7f3765d9b640 1 --2- 172.21.15.40:0/2681846384 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f377015e5d0 0x7f377009a400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:52.816 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:52.813+0000 7f3765d9b640 1 -- 172.21.15.40:0/2681846384 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f377006c330 msgr2=0x7f377014b8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:52.816 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:52.813+0000 7f3765d9b640 1 --2- 172.21.15.40:0/2681846384 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f377006c330 0x7f377014b8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:52.816 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:52.813+0000 7f3765d9b640 1 -- 172.21.15.40:0/2681846384 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37580094d0 con 0x7f37700ae200 2023-12-17T11:48:52.816 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:52.813+0000 7f376ed9d640 1 --2- 172.21.15.40:0/2681846384 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f377015e5d0 0x7f377009a400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-17T11:48:52.816 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:52.813+0000 7f376e59c640 1 --2- 172.21.15.40:0/2681846384 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f377006c330 0x7f377014b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-17T11:48:52.816 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:52.813+0000 7f3765d9b640 1 --2- 172.21.15.40:0/2681846384 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f37700ae200 0x7f37701f6480 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f375802b8c0 tx=0x7f37580046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:48:52.817 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:52.813+0000 7f37677fe640 1 -- 172.21.15.40:0/2681846384 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37580329c0 con 0x7f37700ae200 2023-12-17T11:48:52.817 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:52.813+0000 7f37677fe640 1 -- 172.21.15.40:0/2681846384 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3758032b40 con 0x7f37700ae200 2023-12-17T11:48:52.817 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:52.813+0000 7f37677fe640 1 -- 172.21.15.40:0/2681846384 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37580453f0 con 0x7f37700ae200 2023-12-17T11:48:52.817 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:52.813+0000 7f376f59e640 1 -- 172.21.15.40:0/2681846384 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f377014a810 con 0x7f37700ae200 2023-12-17T11:48:52.817 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:52.813+0000 7f376f59e640 1 -- 172.21.15.40:0/2681846384 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f377014add0 con 0x7f37700ae200 2023-12-17T11:48:52.817 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:52.814+0000 7f376f59e640 1 -- 172.21.15.40:0/2681846384 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f377014b5d0 con 0x7f37700ae200 2023-12-17T11:48:52.817 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:52.815+0000 7f37677fe640 1 -- 172.21.15.40:0/2681846384 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f375804d3f0 con 0x7f37700ae200 2023-12-17T11:48:52.818 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:52.816+0000 7f37677fe640 1 --2- 172.21.15.40:0/2681846384 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f375006ae40 0x7f375006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:52.818 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:52.816+0000 7f37677fe640 1 -- 172.21.15.40:0/2681846384 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f37580ab830 con 0x7f37700ae200 2023-12-17T11:48:52.818 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:52.817+0000 7f376e59c640 1 --2- 172.21.15.40:0/2681846384 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f375006ae40 0x7f375006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:52.819 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:52.818+0000 7f376e59c640 1 --2- 172.21.15.40:0/2681846384 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f375006ae40 0x7f375006d300 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f377015fac0 tx=0x7f37600074a0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:48:52.822 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:52.820+0000 7f37677fe640 1 -- 172.21.15.40:0/2681846384 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f377014b5d0 con 0x7f37700ae200 2023-12-17T11:48:53.012 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:53.010+0000 7f376f59e640 1 -- 172.21.15.40:0/2681846384 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f377014b5d0 con 0x7f37700ae200 2023-12-17T11:48:53.013 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:53.011+0000 7f37677fe640 1 -- 172.21.15.40:0/2681846384 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18322 (secure 0 0 0) 0x7f377014b5d0 con 0x7f37700ae200 2023-12-17T11:48:53.014 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T11:48:53.014 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":25,"fsid":"099cd35d-80d9-4ca4-8424-de13b3b03ac7","created":"2023-12-17T11:47:53.450097+0000","modified":"2023-12-17T11:48:22.971195+0000","last_up_change":"2023-12-17T11:48:05.724195+0000","last_in_change":"2023-12-17T11:47:56.956499+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-17T11:48:06.668943+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-17T11:48:16.151444+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-17T11:48:16.717726+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-17T11:48:20.534819+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a88bfd46-63b8-48b1-9c0e-5c9cdc31bd38","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":555204741},{"type":"v1","addr":"172.21.15.40:6802","nonce":555204741}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":555204741},{"type":"v1","addr":"172.21.15.40:6807","nonce":555204741}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":555204741},{"type":"v1","addr":"172.21.15.40:6815","nonce":555204741}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6809","nonce":555204741},{"type":"v1","addr":"172.21.15.40:6812","nonce":555204741}]},"public_addr":"172.21.15.40:6802/555204741","cluster_addr":"172.21.15.40:6807/555204741","heartbeat_back_addr":"172.21.15.40:6815/555204741","heartbeat_front_addr":"172.21.15.40:6812/555204741","state":["exists","up"]},{"osd":1,"uuid":"c5d628ae-36f4-4866-802c-b162f0e90add","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6801","nonce":1221318112},{"type":"v1","addr":"172.21.15.40:6803","nonce":1221318112}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6805","nonce":1221318112},{"type":"v1","addr":"172.21.15.40:6806","nonce":1221318112}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6811","nonce":1221318112},{"type":"v1","addr":"172.21.15.40:6813","nonce":1221318112}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":1221318112},{"type":"v1","addr":"172.21.15.40:6810","nonce":1221318112}]},"public_addr":"172.21.15.40:6803/1221318112","cluster_addr":"172.21.15.40:6806/1221318112","heartbeat_back_addr":"172.21.15.40:6813/1221318112","heartbeat_front_addr":"172.21.15.40:6810/1221318112","state":["exists","up"]},{"osd":2,"uuid":"d986ad6a-af2f-47fc-9c3b-fbda27b82b73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":1959000265},{"type":"v1","addr":"172.21.15.40:6817","nonce":1959000265}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6818","nonce":1959000265},{"type":"v1","addr":"172.21.15.40:6819","nonce":1959000265}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":1959000265},{"type":"v1","addr":"172.21.15.40:6827","nonce":1959000265}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":1959000265},{"type":"v1","addr":"172.21.15.40:6822","nonce":1959000265}]},"public_addr":"172.21.15.40:6817/1959000265","cluster_addr":"172.21.15.40:6819/1959000265","heartbeat_back_addr":"172.21.15.40:6827/1959000265","heartbeat_front_addr":"172.21.15.40:6822/1959000265","state":["exists","up"]},{"osd":3,"uuid":"d79d22b7-be05-41b2-b95d-697db677fd02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6821","nonce":974040287},{"type":"v1","addr":"172.21.15.40:6823","nonce":974040287}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6825","nonce":974040287},{"type":"v1","addr":"172.21.15.40:6826","nonce":974040287}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":974040287},{"type":"v1","addr":"172.21.15.40:6831","nonce":974040287}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":974040287},{"type":"v1","addr":"172.21.15.40:6829","nonce":974040287}]},"public_addr":"172.21.15.40:6823/974040287","cluster_addr":"172.21.15.40:6826/974040287","heartbeat_back_addr":"172.21.15.40:6831/974040287","heartbeat_front_addr":"172.21.15.40:6829/974040287","state":["exists","up"]},{"osd":4,"uuid":"62a7a233-d3ea-40be-91de-180c0208d639","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6808","nonce":3937787733},{"type":"v1","addr":"172.21.15.159:6809","nonce":3937787733}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6810","nonce":3937787733},{"type":"v1","addr":"172.21.15.159:6811","nonce":3937787733}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6814","nonce":3937787733},{"type":"v1","addr":"172.21.15.159:6815","nonce":3937787733}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6812","nonce":3937787733},{"type":"v1","addr":"172.21.15.159:6813","nonce":3937787733}]},"public_addr":"172.21.15.159:6809/3937787733","cluster_addr":"172.21.15.159:6811/3937787733","heartbeat_back_addr":"172.21.15.159:6815/3937787733","heartbeat_front_addr":"172.21.15.159:6813/3937787733","state":["exists","up"]},{"osd":5,"uuid":"84629cea-dc0e-4b5e-b203-5ea963839281","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6816","nonce":3032505240},{"type":"v1","addr":"172.21.15.159:6817","nonce":3032505240}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6818","nonce":3032505240},{"type":"v1","addr":"172.21.15.159:6819","nonce":3032505240}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6822","nonce":3032505240},{"type":"v1","addr":"172.21.15.159:6823","nonce":3032505240}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6820","nonce":3032505240},{"type":"v1","addr":"172.21.15.159:6821","nonce":3032505240}]},"public_addr":"172.21.15.159:6817/3032505240","cluster_addr":"172.21.15.159:6819/3032505240","heartbeat_back_addr":"172.21.15.159:6823/3032505240","heartbeat_front_addr":"172.21.15.159:6821/3032505240","state":["exists","up"]},{"osd":6,"uuid":"4ae3af3a-1743-4070-a91d-8be5c31cdb04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6800","nonce":2411788597},{"type":"v1","addr":"172.21.15.159:6801","nonce":2411788597}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6802","nonce":2411788597},{"type":"v1","addr":"172.21.15.159:6803","nonce":2411788597}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6806","nonce":2411788597},{"type":"v1","addr":"172.21.15.159:6807","nonce":2411788597}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6804","nonce":2411788597},{"type":"v1","addr":"172.21.15.159:6805","nonce":2411788597}]},"public_addr":"172.21.15.159:6801/2411788597","cluster_addr":"172.21.15.159:6803/2411788597","heartbeat_back_addr":"172.21.15.159:6807/2411788597","heartbeat_front_addr":"172.21.15.159:6805/2411788597","state":["exists","up"]},{"osd":7,"uuid":"c1f4c7f2-8f75-4f95-bc63-a332773e3b8e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6824","nonce":478953349},{"type":"v1","addr":"172.21.15.159:6825","nonce":478953349}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6826","nonce":478953349},{"type":"v1","addr":"172.21.15.159:6827","nonce":478953349}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6830","nonce":478953349},{"type":"v1","addr":"172.21.15.159:6831","nonce":478953349}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6828","nonce":478953349},{"type":"v1","addr":"172.21.15.159:6829","nonce":478953349}]},"public_addr":"172.21.15.159:6825/478953349","cluster_addr":"172.21.15.159:6827/478953349","heartbeat_back_addr":"172.21.15.159:6831/478953349","heartbeat_front_addr":"172.21.15.159:6829/478953349","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T11:48:02.023567+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T11:48:02.278216+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T11:48:02.311843+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T11:48:01.773372+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T11:48:02.618910+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T11:48:02.361559+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T11:48:02.223997+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T11:48:02.604403+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-17T11:48:53.016 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:53.014+0000 7f376f59e640 1 -- 172.21.15.40:0/2681846384 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f375006ae40 msgr2=0x7f375006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:53.016 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:53.014+0000 7f376f59e640 1 --2- 172.21.15.40:0/2681846384 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f375006ae40 0x7f375006d300 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f377015fac0 tx=0x7f37600074a0 comp rx=0 tx=0).stop 2023-12-17T11:48:53.016 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:53.014+0000 7f376f59e640 1 -- 172.21.15.40:0/2681846384 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f37700ae200 msgr2=0x7f37701f6480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:53.016 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:53.014+0000 7f376f59e640 1 --2- 172.21.15.40:0/2681846384 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f37700ae200 0x7f37701f6480 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f375802b8c0 tx=0x7f37580046c0 comp rx=0 tx=0).stop 2023-12-17T11:48:53.016 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:53.014+0000 7f376f59e640 1 -- 172.21.15.40:0/2681846384 shutdown_connections 2023-12-17T11:48:53.017 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:53.014+0000 7f376f59e640 1 --2- 172.21.15.40:0/2681846384 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f375006ae40 0x7f375006d300 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:53.017 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:53.014+0000 7f376f59e640 1 --2- 172.21.15.40:0/2681846384 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f377015e5d0 0x7f377009a400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:53.017 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:53.014+0000 7f376f59e640 1 --2- 172.21.15.40:0/2681846384 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f37700ae200 0x7f37701f6480 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:53.017 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:53.014+0000 7f376f59e640 1 --2- 172.21.15.40:0/2681846384 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f377006c330 0x7f377014b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:53.017 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:53.014+0000 7f376f59e640 1 -- 172.21.15.40:0/2681846384 >> 172.21.15.40:0/2681846384 conn(0x7f37700b0860 msgr2=0x7f377015ea40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:48:53.017 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:53.014+0000 7f376f59e640 1 -- 172.21.15.40:0/2681846384 shutdown_connections 2023-12-17T11:48:53.017 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:53.014+0000 7f376f59e640 1 -- 172.21.15.40:0/2681846384 wait complete. 2023-12-17T11:48:53.036 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-17T11:48:53.262 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:53.260+0000 7f64af59e640 1 Processor -- start 2023-12-17T11:48:53.262 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:53.260+0000 7f64af59e640 1 -- start start 2023-12-17T11:48:53.264 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:53.262+0000 7f64af59e640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f64b006a460 0x7f64b006a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:53.264 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:53.262+0000 7f64af59e640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64b006ae00 con 0x7f64b00cf780 2023-12-17T11:48:53.264 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:53.262+0000 7f64af59e640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64b00cf2f0 con 0x7f64b01448f0 2023-12-17T11:48:53.264 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:53.262+0000 7f64af59e640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64b006ec00 con 0x7f64b006a460 2023-12-17T11:48:53.264 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:53.262+0000 7f64aed9d640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f64b00cf780 0x7f64b00cfc10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:57572/0 (socket says 172.21.15.40:57572) 2023-12-17T11:48:53.264 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:53.262+0000 7f64aed9d640 1 -- 172.21.15.40:0/2746220443 learned_addr learned my addr 172.21.15.40:0/2746220443 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-12-17T11:48:53.266 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:53.262+0000 7f64add9b640 1 --2- 172.21.15.40:0/2746220443 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f64b006a460 0x7f64b006a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:53.266 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:53.263+0000 7f64ad59a640 1 -- 172.21.15.40:0/2746220443 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 240854302 0 0) 0x7f64b006ae00 con 0x7f64b00cf780 2023-12-17T11:48:53.266 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:53.263+0000 7f64ad59a640 1 -- 172.21.15.40:0/2746220443 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6498003520 con 0x7f64b00cf780 2023-12-17T11:48:53.266 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:53.263+0000 7f64ad59a640 1 -- 172.21.15.40:0/2746220443 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3196790501 0 0) 0x7f6498003520 con 0x7f64b00cf780 2023-12-17T11:48:53.266 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:53.263+0000 7f64ad59a640 1 -- 172.21.15.40:0/2746220443 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f64b006a460 msgr2=0x7f64b006a8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:48:53.266 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:53.263+0000 7f64ad59a640 1 --2- 172.21.15.40:0/2746220443 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f64b006a460 0x7f64b006a8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:53.266 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:53.263+0000 7f64ad59a640 1 -- 172.21.15.40:0/2746220443 >> v1:172.21.15.159:6789/0 conn(0x7f64b01448f0 legacy=0x7f64b006db60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:53.266 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:53.263+0000 7f64ad59a640 1 -- 172.21.15.40:0/2746220443 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64b00ce6e0 con 0x7f64b00cf780 2023-12-17T11:48:53.266 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:53.263+0000 7f64ad59a640 1 -- 172.21.15.40:0/2746220443 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2643242555 0 0) 0x7f64a80019f0 con 0x7f64b00cf780 2023-12-17T11:48:53.267 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:53.263+0000 7f64ad59a640 1 -- 172.21.15.40:0/2746220443 >> v1:172.21.15.40:6789/0 conn(0x7f64b00cf780 legacy=0x7f64b00cfc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:53.267 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:53.263+0000 7f64ad59a640 1 --2- 172.21.15.40:0/2746220443 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f64980039a0 0x7f6498003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:53.267 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:53.263+0000 7f64ad59a640 1 --2- 172.21.15.40:0/2746220443 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f64980047c0 0x7f6498004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:53.267 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:53.263+0000 7f64ad59a640 1 --2- 172.21.15.40:0/2746220443 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6498005180 0x7f649800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:53.267 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:53.263+0000 7f64ad59a640 1 -- 172.21.15.40:0/2746220443 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64b006ec00 con 0x7f6498005180 2023-12-17T11:48:53.267 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:53.263+0000 7f64ad59a640 1 -- 172.21.15.40:0/2746220443 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f649800bfa0 con 0x7f64980039a0 2023-12-17T11:48:53.267 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:53.263+0000 7f64ad59a640 1 -- 172.21.15.40:0/2746220443 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f649800c160 con 0x7f64980047c0 2023-12-17T11:48:53.267 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:53.263+0000 7f64add9b640 1 --2- 172.21.15.40:0/2746220443 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f64b006a460 0x7f64b006a8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-17T11:48:53.267 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:53.263+0000 7f64aed9d640 1 --2- 172.21.15.40:0/2746220443 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6498005180 0x7f649800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:53.267 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:53.264+0000 7f64ae59c640 1 --2- 172.21.15.40:0/2746220443 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f64980039a0 0x7f6498003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:53.267 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:53.264+0000 7f64add9b640 1 --2- 172.21.15.40:0/2746220443 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f64980047c0 0x7f6498004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:53.267 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:53.264+0000 7f64aed9d640 1 -- 172.21.15.40:0/2746220443 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f64980047c0 msgr2=0x7f6498004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:48:53.267 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:53.264+0000 7f64aed9d640 1 --2- 172.21.15.40:0/2746220443 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f64980047c0 0x7f6498004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:53.267 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:53.264+0000 7f64aed9d640 1 -- 172.21.15.40:0/2746220443 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f64980039a0 msgr2=0x7f6498003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:48:53.268 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:53.264+0000 7f64aed9d640 1 --2- 172.21.15.40:0/2746220443 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f64980039a0 0x7f6498003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:53.268 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:53.264+0000 7f64aed9d640 1 -- 172.21.15.40:0/2746220443 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6498003520 con 0x7f6498005180 2023-12-17T11:48:53.269 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:53.265+0000 7f64aed9d640 1 --2- 172.21.15.40:0/2746220443 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6498005180 0x7f649800b980 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f64a800a800 tx=0x7f64980057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9996bab0071c6ff6 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:48:53.269 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:53.265+0000 7f64ad59a640 1 -- 172.21.15.40:0/2746220443 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64a80072d0 con 0x7f6498005180 2023-12-17T11:48:53.269 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:53.265+0000 7f64ad59a640 1 -- 172.21.15.40:0/2746220443 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64a802f070 con 0x7f6498005180 2023-12-17T11:48:53.269 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:53.265+0000 7f64ad59a640 1 -- 172.21.15.40:0/2746220443 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64a80076b0 con 0x7f6498005180 2023-12-17T11:48:53.269 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:53.266+0000 7f64af59e640 1 -- 172.21.15.40:0/2746220443 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6498005180 msgr2=0x7f649800b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:53.269 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:53.266+0000 7f64af59e640 1 --2- 172.21.15.40:0/2746220443 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6498005180 0x7f649800b980 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f64a800a800 tx=0x7f64980057f0 comp rx=0 tx=0).stop 2023-12-17T11:48:53.269 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:53.266+0000 7f64aed9d640 1 -- 172.21.15.40:0/2746220443 reap_dead start 2023-12-17T11:48:53.269 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:53.266+0000 7f64af59e640 1 -- 172.21.15.40:0/2746220443 shutdown_connections 2023-12-17T11:48:53.269 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:53.266+0000 7f64af59e640 1 -- 172.21.15.40:0/2746220443 >> 172.21.15.40:0/2746220443 conn(0x7f64b00b1840 msgr2=0x7f64b00b1c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:48:53.269 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:53.266+0000 7f64af59e640 1 -- 172.21.15.40:0/2746220443 shutdown_connections 2023-12-17T11:48:53.269 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:53.266+0000 7f64af59e640 1 -- 172.21.15.40:0/2746220443 wait complete. 2023-12-17T11:48:53.270 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:53.268+0000 7f64af59e640 1 Processor -- start 2023-12-17T11:48:53.270 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:53.268+0000 7f64af59e640 1 -- start start 2023-12-17T11:48:53.271 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:53.269+0000 7f64af59e640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6498005180 0x7f64b013c010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:53.271 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:53.269+0000 7f64af59e640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f64b01f3730 0x7f64b015a780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:53.271 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:53.269+0000 7f64af59e640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f64b0139f60 0x7f64b013a3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:53.271 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:53.269+0000 7f64af59e640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64b013c960 con 0x7f64b0139f60 2023-12-17T11:48:53.271 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:53.269+0000 7f64af59e640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64b00b3430 con 0x7f6498005180 2023-12-17T11:48:53.271 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:53.269+0000 7f64af59e640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64b013a930 con 0x7f64b01f3730 2023-12-17T11:48:53.271 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:53.269+0000 7f64aed9d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f64b0139f60 0x7f64b013a3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:53.271 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:53.269+0000 7f64aed9d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f64b0139f60 0x7f64b013a3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:41696/0 (socket says 172.21.15.40:41696) 2023-12-17T11:48:53.272 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:53.269+0000 7f64aed9d640 1 -- 172.21.15.40:0/2925655758 learned_addr learned my addr 172.21.15.40:0/2925655758 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-17T11:48:53.272 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:53.269+0000 7f64ae59c640 1 --2- 172.21.15.40:0/2925655758 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6498005180 0x7f64b013c010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:53.272 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:53.269+0000 7f64add9b640 1 --2- 172.21.15.40:0/2925655758 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f64b01f3730 0x7f64b015a780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:53.273 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:53.270+0000 7f64aed9d640 1 -- 172.21.15.40:0/2925655758 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f64b01f3730 msgr2=0x7f64b015a780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:53.273 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:53.270+0000 7f64aed9d640 1 --2- 172.21.15.40:0/2925655758 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f64b01f3730 0x7f64b015a780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:53.273 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:53.270+0000 7f64aed9d640 1 -- 172.21.15.40:0/2925655758 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6498005180 msgr2=0x7f64b013c010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:53.273 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:53.270+0000 7f64aed9d640 1 --2- 172.21.15.40:0/2925655758 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6498005180 0x7f64b013c010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:53.273 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:53.270+0000 7f64aed9d640 1 -- 172.21.15.40:0/2925655758 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64b015acc0 con 0x7f64b0139f60 2023-12-17T11:48:53.273 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:53.270+0000 7f64aed9d640 1 --2- 172.21.15.40:0/2925655758 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f64b0139f60 0x7f64b013a3f0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f64a800a800 tx=0x7f64a8001d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:48:53.273 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:53.270+0000 7f649effd640 1 -- 172.21.15.40:0/2925655758 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64a80074e0 con 0x7f64b0139f60 2023-12-17T11:48:53.273 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:53.270+0000 7f649effd640 1 -- 172.21.15.40:0/2925655758 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64a802ce90 con 0x7f64b0139f60 2023-12-17T11:48:53.273 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:53.270+0000 7f64af59e640 1 -- 172.21.15.40:0/2925655758 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64b013c680 con 0x7f64b0139f60 2023-12-17T11:48:53.274 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:53.270+0000 7f649effd640 1 -- 172.21.15.40:0/2925655758 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64a8007890 con 0x7f64b0139f60 2023-12-17T11:48:53.274 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:53.270+0000 7f64af59e640 1 -- 172.21.15.40:0/2925655758 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64b00b30c0 con 0x7f64b0139f60 2023-12-17T11:48:53.274 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:53.272+0000 7f64af59e640 1 -- 172.21.15.40:0/2925655758 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f64b00b2c40 con 0x7f64b0139f60 2023-12-17T11:48:53.274 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:53.272+0000 7f649effd640 1 -- 172.21.15.40:0/2925655758 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f64a8031030 con 0x7f64b0139f60 2023-12-17T11:48:53.275 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:53.273+0000 7f649effd640 1 --2- 172.21.15.40:0/2925655758 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f649006aec0 0x7f649006d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:53.275 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:53.273+0000 7f649effd640 1 -- 172.21.15.40:0/2925655758 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f64a80aaed0 con 0x7f64b0139f60 2023-12-17T11:48:53.276 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:53.274+0000 7f64ae59c640 1 --2- 172.21.15.40:0/2925655758 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f649006aec0 0x7f649006d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:53.277 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:53.275+0000 7f64ae59c640 1 --2- 172.21.15.40:0/2925655758 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f649006aec0 0x7f649006d380 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f64b006a970 tx=0x7f64a0009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:48:53.279 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:53.277+0000 7f649effd640 1 -- 172.21.15.40:0/2925655758 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f64b00b2c40 con 0x7f64b0139f60 2023-12-17T11:48:53.515 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:53.513+0000 7f64af59e640 1 -- 172.21.15.40:0/2925655758 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f64b00b2c40 con 0x7f64b0139f60 2023-12-17T11:48:53.516 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:53.514+0000 7f649effd640 1 -- 172.21.15.40:0/2925655758 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4915 (secure 0 0 0) 0x7f64b00b2c40 con 0x7f64b0139f60 2023-12-17T11:48:53.516 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T11:48:53.516 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/3337931457","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":3337931457},{"type":"v1","addr":"172.21.15.40:6835","nonce":3337931457}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4257,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6833/1874601964","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6832","nonce":1874601964},{"type":"v1","addr":"172.21.15.40:6833","nonce":1874601964}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4267,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6836/3645037845","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6834","nonce":3645037845},{"type":"v1","addr":"172.21.15.159:6836","nonce":3645037845}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-17T11:48:17.696113+0000","modified":"2023-12-17T11:48:40.061005+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4270},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4270":{"gid":4270,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.159:6837/1288849778","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6835","nonce":1288849778},{"type":"v1","addr":"172.21.15.159:6837","nonce":1288849778}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-12-17T11:48:53.517 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 8 2023-12-17T11:48:53.519 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:53.517+0000 7f64af59e640 1 -- 172.21.15.40:0/2925655758 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f649006aec0 msgr2=0x7f649006d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:53.519 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:53.517+0000 7f64af59e640 1 --2- 172.21.15.40:0/2925655758 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f649006aec0 0x7f649006d380 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f64b006a970 tx=0x7f64a0009040 comp rx=0 tx=0).stop 2023-12-17T11:48:53.519 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:53.517+0000 7f64af59e640 1 -- 172.21.15.40:0/2925655758 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f64b0139f60 msgr2=0x7f64b013a3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:53.519 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:53.517+0000 7f64af59e640 1 --2- 172.21.15.40:0/2925655758 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f64b0139f60 0x7f64b013a3f0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f64a800a800 tx=0x7f64a8001d80 comp rx=0 tx=0).stop 2023-12-17T11:48:53.519 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:53.517+0000 7f64af59e640 1 -- 172.21.15.40:0/2925655758 shutdown_connections 2023-12-17T11:48:53.519 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:53.517+0000 7f64af59e640 1 --2- 172.21.15.40:0/2925655758 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f649006aec0 0x7f649006d380 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:53.519 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:53.517+0000 7f64af59e640 1 --2- 172.21.15.40:0/2925655758 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f64b0139f60 0x7f64b013a3f0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:53.519 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:53.517+0000 7f64af59e640 1 --2- 172.21.15.40:0/2925655758 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f64b01f3730 0x7f64b015a780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:53.519 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:53.517+0000 7f64af59e640 1 --2- 172.21.15.40:0/2925655758 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6498005180 0x7f64b013c010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:53.520 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:53.517+0000 7f64af59e640 1 -- 172.21.15.40:0/2925655758 >> 172.21.15.40:0/2925655758 conn(0x7f64b00b1840 msgr2=0x7f64b015c360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:48:53.520 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:53.517+0000 7f64af59e640 1 -- 172.21.15.40:0/2925655758 shutdown_connections 2023-12-17T11:48:53.520 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:53.517+0000 7f64af59e640 1 -- 172.21.15.40:0/2925655758 wait complete. 2023-12-17T11:48:53.942 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 8, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-12-17T11:48:17.696113+0000', 'modified': '2023-12-17T11:48:40.061005+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4270}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4270': {'gid': 4270, 'name': 'd', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.159:6837/1288849778', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.159:6835', 'nonce': 1288849778}, {'type': 'v1', 'addr': '172.21.15.159:6837', 'nonce': 1288849778}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-12-17T11:48:53.943 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-12-17T11:48:53.943 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2023-12-17T11:48:54.177 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:54.175+0000 7f1fabfff640 1 Processor -- start 2023-12-17T11:48:54.178 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:54.175+0000 7f1fabfff640 1 -- start start 2023-12-17T11:48:54.179 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:54.177+0000 7f1fabfff640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f1fac0d1b20 0x7f1fac0b1cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:54.179 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:54.177+0000 7f1fabfff640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1fac15d770 con 0x7f1fac15d390 2023-12-17T11:48:54.180 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:54.177+0000 7f1fabfff640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1fac0b1840 con 0x7f1fac0d0c10 2023-12-17T11:48:54.180 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:54.177+0000 7f1fabfff640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1fac0ceea0 con 0x7f1fac0d1b20 2023-12-17T11:48:54.180 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:54.178+0000 7f1faaffd640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f1fac15d390 0x7f1fac0d1410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:57588/0 (socket says 172.21.15.40:57588) 2023-12-17T11:48:54.180 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:54.178+0000 7f1faaffd640 1 -- 172.21.15.40:0/3456557640 learned_addr learned my addr 172.21.15.40:0/3456557640 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-12-17T11:48:54.180 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:54.178+0000 7f1fa3fff640 1 --2- 172.21.15.40:0/3456557640 >> v2:172.21.15.40:3300/0 conn(0x7f1fac0d1b20 0x7f1fac0b1cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:54.181 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:54.178+0000 7f1faa7fc640 1 -- 172.21.15.40:0/3456557640 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1730327460 0 0) 0x7f1f9c001110 con 0x7f1fac15d390 2023-12-17T11:48:54.181 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:54.178+0000 7f1faa7fc640 1 -- 172.21.15.40:0/3456557640 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1f98003520 con 0x7f1fac15d390 2023-12-17T11:48:54.181 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:54.178+0000 7f1fa3fff640 1 -- 172.21.15.40:0/3456557640 >> v1:172.21.15.159:6789/0 conn(0x7f1fac0d0c10 legacy=0x7f1fac0b5d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:48:54.181 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:54.178+0000 7f1fa3fff640 1 -- 172.21.15.40:0/3456557640 >> v1:172.21.15.40:6789/0 conn(0x7f1fac15d390 legacy=0x7f1fac0d1410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:54.181 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:54.178+0000 7f1fa3fff640 1 -- 172.21.15.40:0/3456557640 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fac0b0c30 con 0x7f1fac0d1b20 2023-12-17T11:48:54.181 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:54.180+0000 7f1fa3fff640 1 --2- 172.21.15.40:0/3456557640 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1fac0d1b20 0x7f1fac0b1cd0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f1f940097a0 tx=0x7f1f9402b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8dc52c42e0e4bb5 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:48:54.182 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:54.180+0000 7f1faa7fc640 1 -- 172.21.15.40:0/3456557640 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f9402e070 con 0x7f1fac0d1b20 2023-12-17T11:48:54.182 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:54.180+0000 7f1faa7fc640 1 -- 172.21.15.40:0/3456557640 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f940315a0 con 0x7f1fac0d1b20 2023-12-17T11:48:54.182 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:54.180+0000 7f1faa7fc640 1 -- 172.21.15.40:0/3456557640 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f94031930 con 0x7f1fac0d1b20 2023-12-17T11:48:54.183 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:54.180+0000 7f1fabfff640 1 -- 172.21.15.40:0/3456557640 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1fac0d1b20 msgr2=0x7f1fac0b1cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:54.183 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:54.180+0000 7f1fabfff640 1 --2- 172.21.15.40:0/3456557640 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1fac0d1b20 0x7f1fac0b1cd0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f1f940097a0 tx=0x7f1f9402b840 comp rx=0 tx=0).stop 2023-12-17T11:48:54.183 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:54.181+0000 7f1fabfff640 1 -- 172.21.15.40:0/3456557640 shutdown_connections 2023-12-17T11:48:54.183 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:54.181+0000 7f1fabfff640 1 --2- 172.21.15.40:0/3456557640 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1fac0d1b20 0x7f1fac0b1cd0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:54.183 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:54.181+0000 7f1fabfff640 1 -- 172.21.15.40:0/3456557640 >> 172.21.15.40:0/3456557640 conn(0x7f1fac0d2ec0 msgr2=0x7f1fac0d32d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:48:54.183 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:54.181+0000 7f1fabfff640 1 -- 172.21.15.40:0/3456557640 shutdown_connections 2023-12-17T11:48:54.183 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:54.181+0000 7f1fabfff640 1 -- 172.21.15.40:0/3456557640 wait complete. 2023-12-17T11:48:54.184 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:54.183+0000 7f1fabfff640 1 Processor -- start 2023-12-17T11:48:54.185 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:54.183+0000 7f1fabfff640 1 -- start start 2023-12-17T11:48:54.186 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:54.184+0000 7f1fabfff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1fac0d0c10 0x7f1fac0c8c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:54.186 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:54.184+0000 7f1fabfff640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1fac0d1b20 0x7f1fac1e28c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:54.186 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:54.184+0000 7f1fabfff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1fac15d390 0x7f1fac149bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:54.186 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:54.184+0000 7f1fabfff640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fac159af0 con 0x7f1fac0d0c10 2023-12-17T11:48:54.186 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:54.184+0000 7f1fabfff640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fac1e2e00 con 0x7f1fac15d390 2023-12-17T11:48:54.186 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:54.184+0000 7f1fabfff640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1fac1e3730 con 0x7f1fac0d1b20 2023-12-17T11:48:54.187 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:54.184+0000 7f1faaffd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1fac0d0c10 0x7f1fac0c8c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:54.187 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:54.184+0000 7f1faaffd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1fac0d0c10 0x7f1fac0c8c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:41712/0 (socket says 172.21.15.40:41712) 2023-12-17T11:48:54.187 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:54.184+0000 7f1faaffd640 1 -- 172.21.15.40:0/361246515 learned_addr learned my addr 172.21.15.40:0/361246515 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-17T11:48:54.187 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:54.184+0000 7f1fa3fff640 1 --2- 172.21.15.40:0/361246515 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1fac0d1b20 0x7f1fac1e28c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:54.187 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:54.184+0000 7f1fab7fe640 1 --2- 172.21.15.40:0/361246515 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1fac15d390 0x7f1fac149bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:54.188 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:54.185+0000 7f1faaffd640 1 -- 172.21.15.40:0/361246515 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1fac0d1b20 msgr2=0x7f1fac1e28c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:54.188 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:54.185+0000 7f1faaffd640 1 --2- 172.21.15.40:0/361246515 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1fac0d1b20 0x7f1fac1e28c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:54.188 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:54.185+0000 7f1faaffd640 1 -- 172.21.15.40:0/361246515 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1fac15d390 msgr2=0x7f1fac149bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:54.188 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:54.185+0000 7f1faaffd640 1 --2- 172.21.15.40:0/361246515 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1fac15d390 0x7f1fac149bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:54.188 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:54.185+0000 7f1faaffd640 1 -- 172.21.15.40:0/361246515 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f94009400 con 0x7f1fac0d0c10 2023-12-17T11:48:54.188 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:54.185+0000 7f1faaffd640 1 --2- 172.21.15.40:0/361246515 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1fac0d0c10 0x7f1fac0c8c20 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f1f9c00c420 tx=0x7f1f9c00c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:48:54.188 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:54.185+0000 7f1fa8ff9640 1 -- 172.21.15.40:0/361246515 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f9c005ce0 con 0x7f1fac0d0c10 2023-12-17T11:48:54.189 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:54.185+0000 7f1fa8ff9640 1 -- 172.21.15.40:0/361246515 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f9c005e40 con 0x7f1fac0d0c10 2023-12-17T11:48:54.189 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:54.185+0000 7f1fa8ff9640 1 -- 172.21.15.40:0/361246515 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f9c0072f0 con 0x7f1fac0d0c10 2023-12-17T11:48:54.189 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:54.185+0000 7f1fabfff640 1 -- 172.21.15.40:0/361246515 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1fac1e3a10 con 0x7f1fac0d0c10 2023-12-17T11:48:54.189 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:54.186+0000 7f1fabfff640 1 -- 172.21.15.40:0/361246515 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1fac1e3fd0 con 0x7f1fac0d0c10 2023-12-17T11:48:54.189 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:54.188+0000 7f1fa8ff9640 1 -- 172.21.15.40:0/361246515 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f1f9c007510 con 0x7f1fac0d0c10 2023-12-17T11:48:54.190 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:54.189+0000 7f1fa8ff9640 1 --2- 172.21.15.40:0/361246515 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f1f8c06ae40 0x7f1f8c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:54.191 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:54.189+0000 7f1fa8ff9640 1 -- 172.21.15.40:0/361246515 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f1f9c088ea0 con 0x7f1fac0d0c10 2023-12-17T11:48:54.191 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:54.189+0000 7f1fa3fff640 1 --2- 172.21.15.40:0/361246515 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f1f8c06ae40 0x7f1f8c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:54.191 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:54.189+0000 7f1fb43df740 1 Processor -- start 2023-12-17T11:48:54.191 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:54.190+0000 7f1fb43df740 1 -- start start 2023-12-17T11:48:54.194 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:54.191+0000 7f1fa3fff640 1 --2- 172.21.15.40:0/361246515 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f1f8c06ae40 0x7f1f8c06d300 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f1f94036000 tx=0x7f1f9403d040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:48:54.194 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:54.191+0000 7f1fb43df740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x563364bf71e0 0x563364bf75c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:54.194 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:54.191+0000 7f1fb43df740 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x563364bc7490 0x563364bf4450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:54.194 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:54.191+0000 7f1fb43df740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x563364bcad60 0x563364bf4990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:54.194 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:54.191+0000 7f1fb43df740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x563364b39f40 con 0x563364bcad60 2023-12-17T11:48:54.194 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:54.191+0000 7f1fb43df740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x563364b37630 con 0x563364bf71e0 2023-12-17T11:48:54.194 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:54.191+0000 7f1fb43df740 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x563364b32f20 con 0x563364bc7490 2023-12-17T11:48:54.194 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:54.191+0000 7f1fab7fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x563364bcad60 0x563364bf4990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:54.194 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:54.191+0000 7f1fab7fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x563364bcad60 0x563364bf4990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:41722/0 (socket says 172.21.15.40:41722) 2023-12-17T11:48:54.194 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:54.191+0000 7f1fab7fe640 1 -- 172.21.15.40:0/3334505443 learned_addr learned my addr 172.21.15.40:0/3334505443 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-17T11:48:54.195 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:54.191+0000 7f1faaffd640 1 --2- 172.21.15.40:0/3334505443 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x563364bf71e0 0x563364bf75c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:54.195 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:54.191+0000 7f1fa3fff640 1 --2- 172.21.15.40:0/3334505443 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x563364bc7490 0x563364bf4450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:54.195 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:54.191+0000 7f1fab7fe640 1 -- 172.21.15.40:0/3334505443 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x563364bc7490 msgr2=0x563364bf4450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:48:54.195 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:54.191+0000 7f1fab7fe640 1 --2- 172.21.15.40:0/3334505443 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x563364bc7490 0x563364bf4450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:54.195 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:54.191+0000 7f1fab7fe640 1 -- 172.21.15.40:0/3334505443 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x563364bf71e0 msgr2=0x563364bf75c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:48:54.195 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:54.191+0000 7f1fab7fe640 1 --2- 172.21.15.40:0/3334505443 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x563364bf71e0 0x563364bf75c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:54.195 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:54.191+0000 7f1fab7fe640 1 -- 172.21.15.40:0/3334505443 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563364af5910 con 0x563364bcad60 2023-12-17T11:48:54.195 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:54.191+0000 7f1fa3fff640 1 --2- 172.21.15.40:0/3334505443 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x563364bc7490 0x563364bf4450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-17T11:48:54.195 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:54.192+0000 7f1fab7fe640 1 --2- 172.21.15.40:0/3334505443 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x563364bcad60 0x563364bf4990 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f1fa40053d0 tx=0x7f1fa4005890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92c64b2de5cca765 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:48:54.195 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:54.192+0000 7f1fa17fa640 1 -- 172.21.15.40:0/3334505443 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fa4006d60 con 0x563364bcad60 2023-12-17T11:48:54.195 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:54.192+0000 7f1fa17fa640 1 -- 172.21.15.40:0/3334505443 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fa400e860 con 0x563364bcad60 2023-12-17T11:48:54.195 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:54.192+0000 7f1fa17fa640 1 -- 172.21.15.40:0/3334505443 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fa400ec10 con 0x563364bcad60 2023-12-17T11:48:54.199 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:54.193+0000 7f1fb43df740 1 -- 172.21.15.40:0/3334505443 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x563364bcad60 msgr2=0x563364bf4990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:54.199 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:54.193+0000 7f1fb43df740 1 --2- 172.21.15.40:0/3334505443 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x563364bcad60 0x563364bf4990 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f1fa40053d0 tx=0x7f1fa4005890 comp rx=0 tx=0).stop 2023-12-17T11:48:54.199 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:54.193+0000 7f1fb43df740 1 -- 172.21.15.40:0/3334505443 shutdown_connections 2023-12-17T11:48:54.199 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:54.193+0000 7f1fb43df740 1 --2- 172.21.15.40:0/3334505443 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x563364bcad60 0x563364bf4990 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:54.199 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:54.193+0000 7f1fb43df740 1 --2- 172.21.15.40:0/3334505443 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x563364bc7490 0x563364bf4450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:54.199 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:54.193+0000 7f1fb43df740 1 --2- 172.21.15.40:0/3334505443 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x563364bf71e0 0x563364bf75c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:54.199 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:54.193+0000 7f1fb43df740 1 -- 172.21.15.40:0/3334505443 >> 172.21.15.40:0/3334505443 conn(0x563364bc9700 msgr2=0x563364c11ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:48:54.199 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:54.193+0000 7f1fb43df740 1 -- 172.21.15.40:0/3334505443 shutdown_connections 2023-12-17T11:48:54.199 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:54.193+0000 7f1fb43df740 1 -- 172.21.15.40:0/3334505443 wait complete. 2023-12-17T11:48:54.200 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:54.194+0000 7f1fb43df740 1 -- start start 2023-12-17T11:48:54.200 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:54.194+0000 7f1fb43df740 1 Processor -- start 2023-12-17T11:48:54.200 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:54.195+0000 7f1fb43df740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x563364bcad60 0x563364be2260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:54.200 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:54.195+0000 7f1fb43df740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x563364bf71e0 0x563364c08f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:54.200 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:54.195+0000 7f1fb43df740 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x563364c25170 0x563364bf85a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:54.200 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:54.195+0000 7f1fb43df740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x563364acf2f0 con 0x563364bcad60 2023-12-17T11:48:54.200 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:54.195+0000 7f1fb43df740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x563364aecc70 con 0x563364bf71e0 2023-12-17T11:48:54.200 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:54.195+0000 7f1fb43df740 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x563364895f20 con 0x563364c25170 2023-12-17T11:48:54.200 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:54.195+0000 7f1fb43df740 10 client.0 _ll_register_callbacks cb 0x563364af13b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-17T11:48:54.200 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:54.195+0000 7f1faaffd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x563364bcad60 0x563364be2260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:54.200 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:54.195+0000 7f1faaffd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x563364bcad60 0x563364be2260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:41736/0 (socket says 172.21.15.40:41736) 2023-12-17T11:48:54.200 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:54.195+0000 7f1faaffd640 1 -- 172.21.15.40:0/3016462452 learned_addr learned my addr 172.21.15.40:0/3016462452 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-17T11:48:54.200 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:54.196+0000 7f1fa3fff640 1 --2- 172.21.15.40:0/3016462452 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x563364bf71e0 0x563364c08f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:54.201 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:54.196+0000 7f1faaffd640 1 -- 172.21.15.40:0/3016462452 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x563364c25170 msgr2=0x563364bf85a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:48:54.201 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:54.196+0000 7f1faaffd640 1 --2- 172.21.15.40:0/3016462452 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x563364c25170 0x563364bf85a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:54.201 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:54.196+0000 7f1faaffd640 1 -- 172.21.15.40:0/3016462452 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x563364bf71e0 msgr2=0x563364c08f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:48:54.201 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:54.196+0000 7f1faaffd640 1 --2- 172.21.15.40:0/3016462452 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x563364bf71e0 0x563364c08f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:54.201 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:54.196+0000 7f1faaffd640 1 -- 172.21.15.40:0/3016462452 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1fa400f040 con 0x563364bcad60 2023-12-17T11:48:54.201 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:54.196+0000 7f1fa3fff640 1 --2- 172.21.15.40:0/3016462452 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x563364bf71e0 0x563364c08f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-17T11:48:54.201 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:54.196+0000 7f1faaffd640 1 --2- 172.21.15.40:0/3016462452 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x563364bcad60 0x563364be2260 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f1f9c00cde0 tx=0x7f1f9c0578b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91b6c21da42b9609 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:48:54.201 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:54.196+0000 7f1f8a7fc640 10 client.0 ms_handle_connect on v2:172.21.15.40:3300/0 2023-12-17T11:48:54.201 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:54.196+0000 7f1f8a7fc640 1 -- 172.21.15.40:0/3016462452 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f9c05f8f0 con 0x563364bcad60 2023-12-17T11:48:54.201 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:54.196+0000 7f1f8a7fc640 1 -- 172.21.15.40:0/3016462452 <== mon.0 v2:172.21.15.40:3300/0 2 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f1f9c06f170 con 0x563364bcad60 2023-12-17T11:48:54.201 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:54.196+0000 7f1fb43df740 1 -- 172.21.15.40:0/3016462452 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x563364b2bdb0 con 0x563364bcad60 2023-12-17T11:48:54.201 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:54.196+0000 7f1f8a7fc640 1 -- 172.21.15.40:0/3016462452 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1f9c058b20 con 0x563364bcad60 2023-12-17T11:48:54.201 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:54.196+0000 7f1fb43df740 10 client.4803 fetch_fsmap learned FSMap version 8 2023-12-17T11:48:54.201 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:54.196+0000 7f1fb43df740 1 -- 172.21.15.40:0/3016462452 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) v3 -- 0x563364b315a0 con 0x563364bcad60 2023-12-17T11:48:54.202 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:54.197+0000 7f1f8a7fc640 1 -- 172.21.15.40:0/3016462452 <== mon.0 v2:172.21.15.40:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x563364b2bdb0 con 0x563364bcad60 2023-12-17T11:48:54.202 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:54.197+0000 7f1f8a7fc640 1 -- 172.21.15.40:0/3016462452 <== mon.0 v2:172.21.15.40:3300/0 5 ==== fsmap(e 8) v1 ==== 3302+0+0 (secure 0 0 0) 0x7f1f9c058c80 con 0x563364bcad60 2023-12-17T11:48:54.202 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:54.197+0000 7f1fb43df740 10 client.4803 fetch_fsmap finished waiting for FSMap version 8 2023-12-17T11:48:54.202 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:54.197+0000 7f1fb43df740 10 client.4803 resolve_mds: resolved name 'd' to daemon mds.d 2023-12-17T11:48:54.202 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:54.197+0000 7f1fb43df740 20 client.4803 populate_metadata read hostname 'smithi040' 2023-12-17T11:48:54.202 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:54.197+0000 7f1fb43df740 1 --2- 172.21.15.40:0/3016462452 >> [v2:172.21.15.159:6835/1288849778,v1:172.21.15.159:6837/1288849778] conn(0x563364bf0f10 0x563364bfa890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:54.202 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:54.197+0000 7f1fb43df740 4 client.4803 mds_command: new command op to 4270 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-12-17T11:48:54.202 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:54.197+0000 7f1fb43df740 1 -- 172.21.15.40:0/3016462452 --> [v2:172.21.15.159:6835/1288849778,v1:172.21.15.159:6837/1288849778] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x563364b2bad0 con 0x563364bf0f10 2023-12-17T11:48:54.203 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:54.198+0000 7f1fa3fff640 1 --2- 172.21.15.40:0/3016462452 >> [v2:172.21.15.159:6835/1288849778,v1:172.21.15.159:6837/1288849778] conn(0x563364bf0f10 0x563364bfa890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:54.203 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:54.198+0000 7f1fa3fff640 1 --2- 172.21.15.40:0/3016462452 >> [v2:172.21.15.159:6835/1288849778,v1:172.21.15.159:6837/1288849778] conn(0x563364bf0f10 0x563364bfa890 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e4d23e583ab0ca49 server_cookie=47b7bbc2c0321de2 in_seq=0 out_seq=0 2023-12-17T11:48:54.204 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:54.199+0000 7f1f8a7fc640 10 client.4803 ms_handle_connect on v2:172.21.15.159:6835/1288849778 2023-12-17T11:48:54.204 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:54.201+0000 7f1f8a7fc640 1 -- 172.21.15.40:0/3016462452 <== mds.0 v2:172.21.15.159:6835/1288849778 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x563364b2bad0 con 0x563364bf0f10 2023-12-17T11:48:54.204 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:54.201+0000 7f1f8a7fc640 10 client.4803 handle_command_reply: tid=0 2023-12-17T11:48:54.204 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:54.201+0000 7f1fb43df740 1 client.4803 shutdown 2023-12-17T11:48:54.204 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:54.201+0000 7f1fb43df740 1 -- 172.21.15.40:0/3016462452 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x563364bcad60 msgr2=0x563364be2260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:54.204 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:54.201+0000 7f1fb43df740 1 --2- 172.21.15.40:0/3016462452 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x563364bcad60 0x563364be2260 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f1f9c00cde0 tx=0x7f1f9c0578b0 comp rx=0 tx=0).stop 2023-12-17T11:48:54.204 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:54.201+0000 7f1fb43df740 1 -- 172.21.15.40:0/3016462452 shutdown_connections 2023-12-17T11:48:54.204 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:54.201+0000 7f1fb43df740 1 --2- 172.21.15.40:0/3016462452 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x563364c25170 0x563364bf85a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:54.204 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:54.201+0000 7f1fb43df740 1 --2- 172.21.15.40:0/3016462452 >> [v2:172.21.15.159:6835/1288849778,v1:172.21.15.159:6837/1288849778] conn(0x563364bf0f10 0x563364bfa890 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:54.204 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:54.201+0000 7f1fb43df740 1 --2- 172.21.15.40:0/3016462452 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x563364bf71e0 0x563364c08f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:54.204 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:54.201+0000 7f1fb43df740 1 --2- 172.21.15.40:0/3016462452 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x563364bcad60 0x563364be2260 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:54.204 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:54.201+0000 7f1fb43df740 1 -- 172.21.15.40:0/3016462452 >> 172.21.15.40:0/3016462452 conn(0x563364bc7490 msgr2=0x563364c15500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:48:54.204 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:54.201+0000 7f1f8a7fc640 0 client.4803 ms_handle_reset on v2:172.21.15.159:6835/1288849778 2023-12-17T11:48:54.204 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:54.201+0000 7f1fb43df740 1 -- 172.21.15.40:0/3016462452 shutdown_connections 2023-12-17T11:48:54.205 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:54.201+0000 7f1fb43df740 1 -- 172.21.15.40:0/3016462452 wait complete. 2023-12-17T11:48:54.205 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:54.201+0000 7f1fb43df740 20 client.4803 trim_cache size 0 max 16384 2023-12-17T11:48:54.221 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:54.219+0000 7f1fb43df740 1 Processor -- start 2023-12-17T11:48:54.221 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:54.219+0000 7f1fb43df740 1 -- start start 2023-12-17T11:48:54.222 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:54.220+0000 7f1fb43df740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x563364bcad60 0x563364c12b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:54.222 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:54.220+0000 7f1fb43df740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x563364bf71e0 0x563364c15500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:54.222 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:54.220+0000 7f1fb43df740 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x563364c25170 0x563364c15a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:54.222 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:54.220+0000 7f1fb43df740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x563364bf1ac0 con 0x563364bf71e0 2023-12-17T11:48:54.222 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:54.220+0000 7f1fb43df740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x563364c13080 con 0x563364bcad60 2023-12-17T11:48:54.222 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:54.220+0000 7f1fb43df740 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x563364bf1400 con 0x563364c25170 2023-12-17T11:48:54.224 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:54.220+0000 7f1fa3fff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x563364bf71e0 0x563364c15500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:54.224 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:54.221+0000 7f1fa3fff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x563364bf71e0 0x563364c15500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:41746/0 (socket says 172.21.15.40:41746) 2023-12-17T11:48:54.224 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:54.221+0000 7f1fa3fff640 1 -- 172.21.15.40:0/905098458 learned_addr learned my addr 172.21.15.40:0/905098458 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-17T11:48:54.224 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:54.221+0000 7f1fab7fe640 1 --2- 172.21.15.40:0/905098458 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x563364c25170 0x563364c15a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:54.224 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:54.221+0000 7f1faaffd640 1 --2- 172.21.15.40:0/905098458 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x563364bcad60 0x563364c12b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:54.224 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:54.221+0000 7f1fa3fff640 1 -- 172.21.15.40:0/905098458 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x563364c25170 msgr2=0x563364c15a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:48:54.224 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:54.221+0000 7f1fa3fff640 1 --2- 172.21.15.40:0/905098458 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x563364c25170 0x563364c15a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:54.224 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:54.221+0000 7f1fa3fff640 1 -- 172.21.15.40:0/905098458 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x563364bcad60 msgr2=0x563364c12b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:48:54.224 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:54.221+0000 7f1fa3fff640 1 --2- 172.21.15.40:0/905098458 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x563364bcad60 0x563364c12b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:54.224 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:54.221+0000 7f1fa3fff640 1 -- 172.21.15.40:0/905098458 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563364aceb80 con 0x563364bf71e0 2023-12-17T11:48:54.224 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:54.221+0000 7f1faaffd640 1 --2- 172.21.15.40:0/905098458 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x563364bcad60 0x563364c12b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-17T11:48:54.224 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:54.221+0000 7f1fa3fff640 1 --2- 172.21.15.40:0/905098458 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x563364bf71e0 0x563364c15500 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f1f94000c00 tx=0x7f1f94008030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bac55e27fc3e7c55 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:48:54.225 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:54.222+0000 7f1fa1ffb640 1 -- 172.21.15.40:0/905098458 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f9404a030 con 0x563364bf71e0 2023-12-17T11:48:54.225 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:54.222+0000 7f1fa1ffb640 1 -- 172.21.15.40:0/905098458 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f9404b040 con 0x563364bf71e0 2023-12-17T11:48:54.225 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:54.222+0000 7f1fa1ffb640 1 -- 172.21.15.40:0/905098458 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f940532f0 con 0x563364bf71e0 2023-12-17T11:48:54.226 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:54.222+0000 7f1fb43df740 1 -- 172.21.15.40:0/905098458 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x563364bf71e0 msgr2=0x563364c15500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:54.226 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:54.222+0000 7f1fb43df740 1 --2- 172.21.15.40:0/905098458 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x563364bf71e0 0x563364c15500 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f1f94000c00 tx=0x7f1f94008030 comp rx=0 tx=0).stop 2023-12-17T11:48:54.226 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:54.222+0000 7f1fb43df740 1 -- 172.21.15.40:0/905098458 shutdown_connections 2023-12-17T11:48:54.226 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:54.222+0000 7f1fb43df740 1 --2- 172.21.15.40:0/905098458 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x563364c25170 0x563364c15a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:54.226 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:54.222+0000 7f1fb43df740 1 --2- 172.21.15.40:0/905098458 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x563364bf71e0 0x563364c15500 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:54.226 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:54.222+0000 7f1fb43df740 1 --2- 172.21.15.40:0/905098458 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x563364bcad60 0x563364c12b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:54.226 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:54.222+0000 7f1fb43df740 1 -- 172.21.15.40:0/905098458 >> 172.21.15.40:0/905098458 conn(0x563364bc7490 msgr2=0x563364be1ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:48:54.226 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:54.222+0000 7f1fb43df740 1 -- 172.21.15.40:0/905098458 shutdown_connections 2023-12-17T11:48:54.226 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:54.223+0000 7f1fb43df740 1 -- 172.21.15.40:0/905098458 wait complete. 2023-12-17T11:48:54.226 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:54.223+0000 7f1fb43df740 1 -- start start 2023-12-17T11:48:54.226 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:54.223+0000 7f1fb43df740 1 Processor -- start 2023-12-17T11:48:54.230 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:54.224+0000 7f1fb43df740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x563364bcad60 0x563364c2b070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:54.230 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:54.224+0000 7f1fb43df740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x563364bf71e0 0x563364bef500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:54.230 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:54.224+0000 7f1fb43df740 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x563364c25170 0x563364befa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:54.230 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:54.224+0000 7f1fb43df740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x563364c339e0 con 0x563364bcad60 2023-12-17T11:48:54.230 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:54.224+0000 7f1fb43df740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x563364c33b50 con 0x563364bf71e0 2023-12-17T11:48:54.230 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:54.224+0000 7f1fb43df740 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x563364bf4a40 con 0x563364c25170 2023-12-17T11:48:54.230 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:54.225+0000 7f1fb43df740 10 client.0 _ll_register_callbacks cb 0x7f1f9c0575c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-17T11:48:54.230 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:54.225+0000 7f1faaffd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x563364bcad60 0x563364c2b070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:54.230 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:54.225+0000 7f1faaffd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x563364bcad60 0x563364c2b070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:41760/0 (socket says 172.21.15.40:41760) 2023-12-17T11:48:54.230 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:54.225+0000 7f1faaffd640 1 -- 172.21.15.40:0/1377047941 learned_addr learned my addr 172.21.15.40:0/1377047941 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-17T11:48:54.230 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:54.225+0000 7f1fa3fff640 1 --2- 172.21.15.40:0/1377047941 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x563364bf71e0 0x563364bef500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:54.231 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:54.225+0000 7f1fab7fe640 1 --2- 172.21.15.40:0/1377047941 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x563364c25170 0x563364befa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:54.231 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:54.225+0000 7f1faaffd640 1 -- 172.21.15.40:0/1377047941 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x563364c25170 msgr2=0x563364befa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:48:54.231 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:54.225+0000 7f1faaffd640 1 --2- 172.21.15.40:0/1377047941 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x563364c25170 0x563364befa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:54.231 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:54.225+0000 7f1faaffd640 1 -- 172.21.15.40:0/1377047941 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x563364bf71e0 msgr2=0x563364bef500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:48:54.231 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:54.225+0000 7f1faaffd640 1 --2- 172.21.15.40:0/1377047941 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x563364bf71e0 0x563364bef500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:54.231 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:54.225+0000 7f1faaffd640 1 -- 172.21.15.40:0/1377047941 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1fac0b0c30 con 0x563364bcad60 2023-12-17T11:48:54.231 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:54.225+0000 7f1fab7fe640 1 --2- 172.21.15.40:0/1377047941 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x563364c25170 0x563364befa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-17T11:48:54.231 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:54.225+0000 7f1fa3fff640 1 --2- 172.21.15.40:0/1377047941 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x563364bf71e0 0x563364bef500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-17T11:48:54.231 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:54.225+0000 7f1faaffd640 1 --2- 172.21.15.40:0/1377047941 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x563364bcad60 0x563364c2b070 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f1f9c053cf0 tx=0x7f1f9c086f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb57876fd19ef844 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:48:54.231 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:54.225+0000 7f1f8a7fc640 10 client.0 ms_handle_connect on v2:172.21.15.40:3300/0 2023-12-17T11:48:54.231 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:54.226+0000 7f1f8a7fc640 1 -- 172.21.15.40:0/1377047941 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f9c00e040 con 0x563364bcad60 2023-12-17T11:48:54.231 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:54.226+0000 7f1f8a7fc640 1 -- 172.21.15.40:0/1377047941 <== mon.0 v2:172.21.15.40:3300/0 2 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f1f9c06f170 con 0x563364bcad60 2023-12-17T11:48:54.232 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:54.226+0000 7f1fb43df740 1 -- 172.21.15.40:0/1377047941 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f1fa400e860 con 0x563364bcad60 2023-12-17T11:48:54.232 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:54.226+0000 7f1f8a7fc640 1 -- 172.21.15.40:0/1377047941 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1f9c007dc0 con 0x563364bcad60 2023-12-17T11:48:54.232 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:54.226+0000 7f1fb43df740 10 client.4809 fetch_fsmap learned FSMap version 8 2023-12-17T11:48:54.232 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:54.226+0000 7f1fb43df740 1 -- 172.21.15.40:0/1377047941 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) v3 -- 0x563364af4170 con 0x563364bcad60 2023-12-17T11:48:54.232 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:54.226+0000 7f1f8a7fc640 1 -- 172.21.15.40:0/1377047941 <== mon.0 v2:172.21.15.40:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fa400e860 con 0x563364bcad60 2023-12-17T11:48:54.232 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:54.226+0000 7f1f8a7fc640 1 -- 172.21.15.40:0/1377047941 <== mon.0 v2:172.21.15.40:3300/0 5 ==== fsmap(e 8) v1 ==== 3302+0+0 (secure 0 0 0) 0x7f1f9c0537f0 con 0x563364bcad60 2023-12-17T11:48:54.232 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:54.226+0000 7f1fb43df740 10 client.4809 fetch_fsmap finished waiting for FSMap version 8 2023-12-17T11:48:54.232 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:54.226+0000 7f1fb43df740 10 client.4809 resolve_mds: resolved name 'd' to daemon mds.d 2023-12-17T11:48:54.232 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:54.226+0000 7f1fb43df740 20 client.4809 populate_metadata read hostname 'smithi040' 2023-12-17T11:48:54.232 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:54.226+0000 7f1fb43df740 1 --2- 172.21.15.40:0/1377047941 >> [v2:172.21.15.159:6835/1288849778,v1:172.21.15.159:6837/1288849778] conn(0x563364c7bc20 0x563364c7c000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:54.232 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:54.226+0000 7f1fb43df740 4 client.4809 mds_command: new command op to 4270 tid=0 multi_id=0 [{"prefix": "status"}] 2023-12-17T11:48:54.232 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:54.226+0000 7f1fb43df740 1 -- 172.21.15.40:0/1377047941 --> [v2:172.21.15.159:6835/1288849778,v1:172.21.15.159:6837/1288849778] -- command(tid 0: {"prefix": "status"}) v1 -- 0x5633648336c0 con 0x563364c7bc20 2023-12-17T11:48:54.232 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:54.227+0000 7f1fa3fff640 1 --2- 172.21.15.40:0/1377047941 >> [v2:172.21.15.159:6835/1288849778,v1:172.21.15.159:6837/1288849778] conn(0x563364c7bc20 0x563364c7c000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:54.232 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:54.228+0000 7f1fa3fff640 1 --2- 172.21.15.40:0/1377047941 >> [v2:172.21.15.159:6835/1288849778,v1:172.21.15.159:6837/1288849778] conn(0x563364c7bc20 0x563364c7c000 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8b266c4be2888c3f server_cookie=dc8e65e41f50d447 in_seq=0 out_seq=0 2023-12-17T11:48:54.232 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:54.228+0000 7f1f8a7fc640 10 client.4809 ms_handle_connect on v2:172.21.15.159:6835/1288849778 2023-12-17T11:48:54.234 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:54.229+0000 7f1f8a7fc640 1 -- 172.21.15.40:0/1377047941 <== mds.0 v2:172.21.15.159:6835/1288849778 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+330 (crc 0 0 0) 0x5633648336c0 con 0x563364c7bc20 2023-12-17T11:48:54.234 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:54.229+0000 7f1f8a7fc640 10 client.4809 handle_command_reply: tid=0 2023-12-17T11:48:54.234 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:54.229+0000 7f1fb43df740 1 client.4809 shutdown 2023-12-17T11:48:54.234 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:54.230+0000 7f1fb43df740 1 -- 172.21.15.40:0/1377047941 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x563364bcad60 msgr2=0x563364c2b070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:54.234 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:54.230+0000 7f1fb43df740 1 --2- 172.21.15.40:0/1377047941 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x563364bcad60 0x563364c2b070 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f1f9c053cf0 tx=0x7f1f9c086f10 comp rx=0 tx=0).stop 2023-12-17T11:48:54.235 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:54.230+0000 7f1fb43df740 1 -- 172.21.15.40:0/1377047941 shutdown_connections 2023-12-17T11:48:54.235 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:54.230+0000 7f1fb43df740 1 --2- 172.21.15.40:0/1377047941 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x563364c25170 0x563364befa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:54.235 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:54.230+0000 7f1fb43df740 1 --2- 172.21.15.40:0/1377047941 >> [v2:172.21.15.159:6835/1288849778,v1:172.21.15.159:6837/1288849778] conn(0x563364c7bc20 0x563364c7c000 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:54.235 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:54.230+0000 7f1fb43df740 1 --2- 172.21.15.40:0/1377047941 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x563364bf71e0 0x563364bef500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:54.235 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:54.230+0000 7f1fb43df740 1 --2- 172.21.15.40:0/1377047941 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x563364bcad60 0x563364c2b070 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:54.235 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:54.230+0000 7f1fb43df740 1 -- 172.21.15.40:0/1377047941 >> 172.21.15.40:0/1377047941 conn(0x563364bc7490 msgr2=0x563364be1c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:48:54.235 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:54.230+0000 7f1f8a7fc640 0 client.4809 ms_handle_reset on v2:172.21.15.159:6835/1288849778 2023-12-17T11:48:54.235 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:54.230+0000 7f1fb43df740 1 -- 172.21.15.40:0/1377047941 shutdown_connections 2023-12-17T11:48:54.235 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:54.230+0000 7f1fb43df740 1 -- 172.21.15.40:0/1377047941 wait complete. 2023-12-17T11:48:54.235 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:54.230+0000 7f1fb43df740 20 client.4809 trim_cache size 0 max 16384 2023-12-17T11:48:54.235 INFO:teuthology.orchestra.run.smithi040.stdout:{ 2023-12-17T11:48:54.236 INFO:teuthology.orchestra.run.smithi040.stdout: "cluster_fsid": "099cd35d-80d9-4ca4-8424-de13b3b03ac7", 2023-12-17T11:48:54.236 INFO:teuthology.orchestra.run.smithi040.stdout: "whoami": 0, 2023-12-17T11:48:54.236 INFO:teuthology.orchestra.run.smithi040.stdout: "id": 4270, 2023-12-17T11:48:54.236 INFO:teuthology.orchestra.run.smithi040.stdout: "want_state": "up:active", 2023-12-17T11:48:54.236 INFO:teuthology.orchestra.run.smithi040.stdout: "state": "up:active", 2023-12-17T11:48:54.236 INFO:teuthology.orchestra.run.smithi040.stdout: "fs_name": "cephfs", 2023-12-17T11:48:54.236 INFO:teuthology.orchestra.run.smithi040.stdout: "rank_uptime": 35.962604636000002, 2023-12-17T11:48:54.236 INFO:teuthology.orchestra.run.smithi040.stdout: "mdsmap_epoch": 8, 2023-12-17T11:48:54.236 INFO:teuthology.orchestra.run.smithi040.stdout: "osdmap_epoch": 25, 2023-12-17T11:48:54.236 INFO:teuthology.orchestra.run.smithi040.stdout: "osdmap_epoch_barrier": 25, 2023-12-17T11:48:54.236 INFO:teuthology.orchestra.run.smithi040.stdout: "uptime": 41.127845325000003 2023-12-17T11:48:54.236 INFO:teuthology.orchestra.run.smithi040.stdout:} 2023-12-17T11:48:54.237 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:54.231+0000 7f1fabfff640 1 -- 172.21.15.40:0/361246515 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f1f8c06ae40 msgr2=0x7f1f8c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:54.237 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:54.231+0000 7f1fabfff640 1 --2- 172.21.15.40:0/361246515 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f1f8c06ae40 0x7f1f8c06d300 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f1f94036000 tx=0x7f1f9403d040 comp rx=0 tx=0).stop 2023-12-17T11:48:54.238 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:54.231+0000 7f1fabfff640 1 -- 172.21.15.40:0/361246515 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1fac0d0c10 msgr2=0x7f1fac0c8c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:54.238 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:54.231+0000 7f1fabfff640 1 --2- 172.21.15.40:0/361246515 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1fac0d0c10 0x7f1fac0c8c20 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f1f9c00c420 tx=0x7f1f9c00c8e0 comp rx=0 tx=0).stop 2023-12-17T11:48:54.238 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:54.231+0000 7f1fabfff640 1 -- 172.21.15.40:0/361246515 shutdown_connections 2023-12-17T11:48:54.238 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:54.231+0000 7f1fabfff640 1 --2- 172.21.15.40:0/361246515 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f1f8c06ae40 0x7f1f8c06d300 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:54.238 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:54.231+0000 7f1fabfff640 1 --2- 172.21.15.40:0/361246515 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1fac15d390 0x7f1fac149bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:54.238 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:54.231+0000 7f1fabfff640 1 --2- 172.21.15.40:0/361246515 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1fac0d1b20 0x7f1fac1e28c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:54.238 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:54.231+0000 7f1fabfff640 1 --2- 172.21.15.40:0/361246515 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1fac0d0c10 0x7f1fac0c8c20 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:54.238 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:54.231+0000 7f1fabfff640 1 -- 172.21.15.40:0/361246515 >> 172.21.15.40:0/361246515 conn(0x7f1fac0d2ec0 msgr2=0x7f1fac0b8160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:48:54.238 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:54.231+0000 7f1fabfff640 1 -- 172.21.15.40:0/361246515 shutdown_connections 2023-12-17T11:48:54.238 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:54.231+0000 7f1fabfff640 1 -- 172.21.15.40:0/361246515 wait complete. 2023-12-17T11:48:54.253 INFO:teuthology.run_tasks:Running task kclient... 2023-12-17T11:48:54.267 INFO:tasks.kclient:Mounting kernel clients... 2023-12-17T11:48:54.267 INFO:tasks.kclient:config is {'client.0': {}, 'client.2': {}, 'client.1': {}, 'client.3': {}} 2023-12-17T11:48:54.267 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-17T11:48:54.267 DEBUG:teuthology.orchestra.run.smithi040:> ip netns list 2023-12-17T11:48:54.328 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-ns--home-ubuntu-cephtest-mnt.admin (id: 0) 2023-12-17T11:48:54.330 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-17T11:48:54.330 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-12-17T11:48:54.434 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-17T11:48:54.435 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip link delete ceph-brx 2023-12-17T11:48:54.591 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-17T11:48:54.591 DEBUG:teuthology.orchestra.run.smithi040:> ip netns list 2023-12-17T11:48:54.643 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-17T11:48:54.643 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip link delete ceph-brx 2023-12-17T11:48:54.788 INFO:teuthology.orchestra.run.smithi040.stderr:Cannot find device "ceph-brx" 2023-12-17T11:48:54.792 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-17T11:48:54.792 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-17T11:48:54.792 DEBUG:teuthology.orchestra.run.smithi159:> ip netns list 2023-12-17T11:48:54.852 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-17T11:48:54.852 DEBUG:teuthology.orchestra.run.smithi159:> sudo ip link delete ceph-brx 2023-12-17T11:48:54.956 INFO:teuthology.orchestra.run.smithi159.stderr:Cannot find device "ceph-brx" 2023-12-17T11:48:54.961 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-17T11:48:54.961 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-17T11:48:54.961 DEBUG:teuthology.orchestra.run.smithi159:> ip netns list 2023-12-17T11:48:55.015 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-17T11:48:55.015 DEBUG:teuthology.orchestra.run.smithi159:> sudo ip link delete ceph-brx 2023-12-17T11:48:55.118 INFO:teuthology.orchestra.run.smithi159.stderr:Cannot find device "ceph-brx" 2023-12-17T11:48:55.122 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-17T11:48:55.122 INFO:tasks.kclient:client.0 config is {'syntax': 'v1'} 2023-12-17T11:48:55.123 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-12-17T11:48:55.123 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-12-17T11:48:55.123 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-12-17T11:48:55.355 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:55.353+0000 7f1d03fff640 1 Processor -- start 2023-12-17T11:48:55.355 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:55.353+0000 7f1d03fff640 1 -- start start 2023-12-17T11:48:55.358 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:55.355+0000 7f1d03fff640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1d04159fd0 0x7f1d040ae1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:55.358 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:55.355+0000 7f1d03fff640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f1d04070750 0x7f1d04070ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:55.358 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:55.355+0000 7f1d03fff640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d04070070 con 0x7f1d040711e0 2023-12-17T11:48:55.358 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:55.355+0000 7f1d03fff640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d040705f0 con 0x7f1d04070750 2023-12-17T11:48:55.358 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:55.355+0000 7f1d03fff640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d04071650 con 0x7f1d04159fd0 2023-12-17T11:48:55.358 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:55.355+0000 7f1d037fe640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f1d040711e0 0x7f1d040ac700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:60580/0 (socket says 172.21.15.40:60580) 2023-12-17T11:48:55.358 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:55.355+0000 7f1d037fe640 1 -- 172.21.15.40:0/4045448285 learned_addr learned my addr 172.21.15.40:0/4045448285 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-12-17T11:48:55.358 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:55.356+0000 7f1d02ffd640 1 --2- 172.21.15.40:0/4045448285 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1d04159fd0 0x7f1d040ae1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:55.359 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:55.356+0000 7f1d027fc640 1 --2- 172.21.15.40:0/4045448285 >> v2:172.21.15.159:3300/0 conn(0x7f1d04070750 0x7f1d04070ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:55.359 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:55.356+0000 7f1d01ffb640 1 -- 172.21.15.40:0/4045448285 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2110259966 0 0) 0x7f1d04070070 con 0x7f1d040711e0 2023-12-17T11:48:55.359 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:55.356+0000 7f1d01ffb640 1 -- 172.21.15.40:0/4045448285 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1cec003520 con 0x7f1d040711e0 2023-12-17T11:48:55.361 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:55.356+0000 7f1d01ffb640 1 -- 172.21.15.40:0/4045448285 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3743996611 0 0) 0x7f1cec003520 con 0x7f1d040711e0 2023-12-17T11:48:55.361 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:55.356+0000 7f1d01ffb640 1 -- 172.21.15.40:0/4045448285 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1d04159fd0 msgr2=0x7f1d040ae1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:48:55.361 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:55.356+0000 7f1d01ffb640 1 --2- 172.21.15.40:0/4045448285 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1d04159fd0 0x7f1d040ae1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:55.361 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:55.356+0000 7f1d01ffb640 1 -- 172.21.15.40:0/4045448285 >> v2:172.21.15.159:3300/0 conn(0x7f1d04070750 msgr2=0x7f1d04070ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:48:55.361 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:55.356+0000 7f1d01ffb640 1 --2- 172.21.15.40:0/4045448285 >> v2:172.21.15.159:3300/0 conn(0x7f1d04070750 0x7f1d04070ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:55.361 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:55.356+0000 7f1d01ffb640 1 -- 172.21.15.40:0/4045448285 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d04070310 con 0x7f1d040711e0 2023-12-17T11:48:55.361 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:55.356+0000 7f1d01ffb640 1 -- 172.21.15.40:0/4045448285 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2643242555 0 0) 0x7f1cfc0019f0 con 0x7f1d040711e0 2023-12-17T11:48:55.361 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:55.357+0000 7f1d01ffb640 1 -- 172.21.15.40:0/4045448285 >> v1:172.21.15.40:6789/0 conn(0x7f1d040711e0 legacy=0x7f1d040ac700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:55.361 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:55.357+0000 7f1d01ffb640 1 --2- 172.21.15.40:0/4045448285 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1cec003970 0x7f1cec003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:55.362 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:55.357+0000 7f1d01ffb640 1 --2- 172.21.15.40:0/4045448285 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1d04159fd0 0x7f1cec0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:55.362 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:55.357+0000 7f1d01ffb640 1 --2- 172.21.15.40:0/4045448285 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1cec004d00 0x7f1cec005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:55.362 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:55.357+0000 7f1d01ffb640 1 -- 172.21.15.40:0/4045448285 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d040705f0 con 0x7f1cec004d00 2023-12-17T11:48:55.362 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:55.357+0000 7f1d01ffb640 1 -- 172.21.15.40:0/4045448285 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d04071650 con 0x7f1cec003970 2023-12-17T11:48:55.362 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:55.357+0000 7f1d01ffb640 1 -- 172.21.15.40:0/4045448285 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1cec00b980 con 0x7f1d04159fd0 2023-12-17T11:48:55.362 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:55.357+0000 7f1d037fe640 1 --2- 172.21.15.40:0/4045448285 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1cec004d00 0x7f1cec005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:55.362 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:55.357+0000 7f1d02ffd640 1 --2- 172.21.15.40:0/4045448285 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1cec003970 0x7f1cec003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:55.362 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:55.357+0000 7f1d027fc640 1 --2- 172.21.15.40:0/4045448285 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1d04159fd0 0x7f1cec0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:55.362 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:55.357+0000 7f1d037fe640 1 -- 172.21.15.40:0/4045448285 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1d04159fd0 msgr2=0x7f1cec0047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:48:55.362 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:55.357+0000 7f1d037fe640 1 --2- 172.21.15.40:0/4045448285 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1d04159fd0 0x7f1cec0047c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:55.362 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:55.357+0000 7f1d037fe640 1 -- 172.21.15.40:0/4045448285 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1cec003970 msgr2=0x7f1cec003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:48:55.362 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:55.357+0000 7f1d037fe640 1 --2- 172.21.15.40:0/4045448285 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1cec003970 0x7f1cec003d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:55.362 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:55.357+0000 7f1d037fe640 1 -- 172.21.15.40:0/4045448285 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cec003520 con 0x7f1cec004d00 2023-12-17T11:48:55.363 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:55.359+0000 7f1d037fe640 1 --2- 172.21.15.40:0/4045448285 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1cec004d00 0x7f1cec005180 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f1cfc00a8d0 tx=0x7f1cec0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c07c9a4366f8364c server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:48:55.363 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:55.359+0000 7f1d01ffb640 1 -- 172.21.15.40:0/4045448285 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cfc034630 con 0x7f1cec004d00 2023-12-17T11:48:55.363 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:55.359+0000 7f1d01ffb640 1 -- 172.21.15.40:0/4045448285 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1cfc02f070 con 0x7f1cec004d00 2023-12-17T11:48:55.363 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:55.359+0000 7f1d01ffb640 1 -- 172.21.15.40:0/4045448285 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cfc0349d0 con 0x7f1cec004d00 2023-12-17T11:48:55.364 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:55.359+0000 7f1d03fff640 1 -- 172.21.15.40:0/4045448285 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1cec004d00 msgr2=0x7f1cec005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:55.364 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:55.359+0000 7f1d03fff640 1 --2- 172.21.15.40:0/4045448285 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1cec004d00 0x7f1cec005180 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f1cfc00a8d0 tx=0x7f1cec0057f0 comp rx=0 tx=0).stop 2023-12-17T11:48:55.364 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:55.359+0000 7f1d037fe640 1 -- 172.21.15.40:0/4045448285 reap_dead start 2023-12-17T11:48:55.364 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:55.359+0000 7f1d03fff640 1 -- 172.21.15.40:0/4045448285 shutdown_connections 2023-12-17T11:48:55.364 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:55.359+0000 7f1d03fff640 1 -- 172.21.15.40:0/4045448285 >> 172.21.15.40:0/4045448285 conn(0x7f1d040b0860 msgr2=0x7f1d040b0c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:48:55.364 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:55.360+0000 7f1d03fff640 1 -- 172.21.15.40:0/4045448285 shutdown_connections 2023-12-17T11:48:55.364 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:55.360+0000 7f1d03fff640 1 -- 172.21.15.40:0/4045448285 wait complete. 2023-12-17T11:48:55.364 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:55.361+0000 7f1d03fff640 1 Processor -- start 2023-12-17T11:48:55.364 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:55.362+0000 7f1d03fff640 1 -- start start 2023-12-17T11:48:55.366 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:55.362+0000 7f1d03fff640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1cec004d00 0x7f1d04140a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:55.367 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:55.363+0000 7f1d03fff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1d04144730 0x7f1d04150600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:55.367 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:55.363+0000 7f1d03fff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1d04150b40 0x7f1d0415a660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:55.367 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:55.363+0000 7f1d03fff640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d04150ff0 con 0x7f1d04150b40 2023-12-17T11:48:55.367 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:55.363+0000 7f1d03fff640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d0414c030 con 0x7f1d04144730 2023-12-17T11:48:55.367 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:55.363+0000 7f1d03fff640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d04099b30 con 0x7f1cec004d00 2023-12-17T11:48:55.367 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:55.363+0000 7f1d037fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1d04150b40 0x7f1d0415a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:55.367 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:55.363+0000 7f1d037fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1d04150b40 0x7f1d0415a660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:33906/0 (socket says 172.21.15.40:33906) 2023-12-17T11:48:55.367 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:55.363+0000 7f1d037fe640 1 -- 172.21.15.40:0/633391934 learned_addr learned my addr 172.21.15.40:0/633391934 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-17T11:48:55.367 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:55.363+0000 7f1d02ffd640 1 --2- 172.21.15.40:0/633391934 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1cec004d00 0x7f1d04140a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:55.367 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:55.363+0000 7f1d027fc640 1 --2- 172.21.15.40:0/633391934 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1d04144730 0x7f1d04150600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:55.367 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:55.363+0000 7f1d037fe640 1 -- 172.21.15.40:0/633391934 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1cec004d00 msgr2=0x7f1d04140a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:55.368 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:55.363+0000 7f1d037fe640 1 --2- 172.21.15.40:0/633391934 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1cec004d00 0x7f1d04140a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:55.368 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:55.363+0000 7f1d037fe640 1 -- 172.21.15.40:0/633391934 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1d04144730 msgr2=0x7f1d04150600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:55.368 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:55.363+0000 7f1d037fe640 1 --2- 172.21.15.40:0/633391934 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1d04144730 0x7f1d04150600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:55.368 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:55.363+0000 7f1d037fe640 1 -- 172.21.15.40:0/633391934 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d04144ed0 con 0x7f1d04150b40 2023-12-17T11:48:55.368 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:55.363+0000 7f1d02ffd640 1 --2- 172.21.15.40:0/633391934 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1cec004d00 0x7f1d04140a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-17T11:48:55.368 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:55.364+0000 7f1d037fe640 1 --2- 172.21.15.40:0/633391934 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1d04150b40 0x7f1d0415a660 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f1cfc00a9f0 tx=0x7f1cfc001360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:48:55.368 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:55.364+0000 7f1ceb7fe640 1 -- 172.21.15.40:0/633391934 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cfc034840 con 0x7f1d04150b40 2023-12-17T11:48:55.368 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:55.364+0000 7f1ceb7fe640 1 -- 172.21.15.40:0/633391934 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1cfc0349c0 con 0x7f1d04150b40 2023-12-17T11:48:55.368 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:55.364+0000 7f1ceb7fe640 1 -- 172.21.15.40:0/633391934 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cfc034d70 con 0x7f1d04150b40 2023-12-17T11:48:55.368 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:55.364+0000 7f1d03fff640 1 -- 172.21.15.40:0/633391934 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d0414c280 con 0x7f1d04150b40 2023-12-17T11:48:55.368 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:55.364+0000 7f1d03fff640 1 -- 172.21.15.40:0/633391934 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d0414c840 con 0x7f1d04150b40 2023-12-17T11:48:55.369 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:55.365+0000 7f1d03fff640 1 -- 172.21.15.40:0/633391934 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d04074450 con 0x7f1d04150b40 2023-12-17T11:48:55.369 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:55.366+0000 7f1ceb7fe640 1 -- 172.21.15.40:0/633391934 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f1cfc031030 con 0x7f1d04150b40 2023-12-17T11:48:55.369 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:55.367+0000 7f1ceb7fe640 1 --2- 172.21.15.40:0/633391934 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f1cf006ae40 0x7f1cf006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:55.370 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:55.367+0000 7f1ceb7fe640 1 -- 172.21.15.40:0/633391934 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f1cfc0abd50 con 0x7f1d04150b40 2023-12-17T11:48:55.370 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:55.368+0000 7f1d02ffd640 1 --2- 172.21.15.40:0/633391934 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f1cf006ae40 0x7f1cf006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:55.371 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:55.369+0000 7f1d02ffd640 1 --2- 172.21.15.40:0/633391934 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f1cf006ae40 0x7f1cf006d300 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f1d040cf5e0 tx=0x7f1cf4008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:48:55.373 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:55.372+0000 7f1ceb7fe640 1 -- 172.21.15.40:0/633391934 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f1cfc076b90 con 0x7f1d04150b40 2023-12-17T11:48:55.608 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:55.606+0000 7f1d03fff640 1 -- 172.21.15.40:0/633391934 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f1d04074450 con 0x7f1d04150b40 2023-12-17T11:48:55.608 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:55.606+0000 7f1ceb7fe640 1 -- 172.21.15.40:0/633391934 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+88 (secure 0 0 0) 0x7f1cfc002000 con 0x7f1d04150b40 2023-12-17T11:48:55.609 INFO:teuthology.orchestra.run.smithi040.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-12-17T11:48:55.611 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:55.609+0000 7f1d03fff640 1 -- 172.21.15.40:0/633391934 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f1cf006ae40 msgr2=0x7f1cf006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:55.612 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:55.609+0000 7f1d03fff640 1 --2- 172.21.15.40:0/633391934 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f1cf006ae40 0x7f1cf006d300 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f1d040cf5e0 tx=0x7f1cf4008040 comp rx=0 tx=0).stop 2023-12-17T11:48:55.612 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:55.609+0000 7f1d03fff640 1 -- 172.21.15.40:0/633391934 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1d04150b40 msgr2=0x7f1d0415a660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:55.612 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:55.609+0000 7f1d03fff640 1 --2- 172.21.15.40:0/633391934 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1d04150b40 0x7f1d0415a660 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f1cfc00a9f0 tx=0x7f1cfc001360 comp rx=0 tx=0).stop 2023-12-17T11:48:55.612 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:55.609+0000 7f1d03fff640 1 -- 172.21.15.40:0/633391934 shutdown_connections 2023-12-17T11:48:55.612 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:55.609+0000 7f1d03fff640 1 --2- 172.21.15.40:0/633391934 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f1cf006ae40 0x7f1cf006d300 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:55.612 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:55.609+0000 7f1d03fff640 1 --2- 172.21.15.40:0/633391934 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1d04150b40 0x7f1d0415a660 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:55.612 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:55.609+0000 7f1d03fff640 1 --2- 172.21.15.40:0/633391934 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1d04144730 0x7f1d04150600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:55.612 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:55.609+0000 7f1d03fff640 1 --2- 172.21.15.40:0/633391934 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1cec004d00 0x7f1d04140a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:55.612 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:55.609+0000 7f1d03fff640 1 -- 172.21.15.40:0/633391934 >> 172.21.15.40:0/633391934 conn(0x7f1d040b0860 msgr2=0x7f1d04158620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:48:55.612 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:55.610+0000 7f1d03fff640 1 -- 172.21.15.40:0/633391934 shutdown_connections 2023-12-17T11:48:55.612 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:55.610+0000 7f1d03fff640 1 -- 172.21.15.40:0/633391934 wait complete. 2023-12-17T11:48:55.630 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-12-17T11:48:55.631 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-17T11:48:55.631 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi040.front.sepia.ceph.com 2023-12-17T11:48:55.631 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-12-17T11:48:55.631 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-12-17T11:48:55.631 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-12-17T11:48:55.631 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-12-17T11:48:55.631 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-12-17T11:48:55.631 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2023-12-17T11:48:55.631 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-17T11:48:55.631 DEBUG:teuthology.orchestra.run.smithi040:> ip addr 2023-12-17T11:48:55.682 INFO:teuthology.orchestra.run.smithi040.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-17T11:48:55.683 INFO:teuthology.orchestra.run.smithi040.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-17T11:48:55.683 INFO:teuthology.orchestra.run.smithi040.stdout: inet 127.0.0.1/8 scope host lo 2023-12-17T11:48:55.683 INFO:teuthology.orchestra.run.smithi040.stdout: valid_lft forever preferred_lft forever 2023-12-17T11:48:55.683 INFO:teuthology.orchestra.run.smithi040.stdout: inet6 ::1/128 scope host 2023-12-17T11:48:55.683 INFO:teuthology.orchestra.run.smithi040.stdout: valid_lft forever preferred_lft forever 2023-12-17T11:48:55.683 INFO:teuthology.orchestra.run.smithi040.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-17T11:48:55.683 INFO:teuthology.orchestra.run.smithi040.stdout: link/ether 0c:c4:7a:6b:fd:16 brd ff:ff:ff:ff:ff:ff 2023-12-17T11:48:55.683 INFO:teuthology.orchestra.run.smithi040.stdout: altname enp7s0f0 2023-12-17T11:48:55.683 INFO:teuthology.orchestra.run.smithi040.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-17T11:48:55.683 INFO:teuthology.orchestra.run.smithi040.stdout: link/ether 0c:c4:7a:6b:fd:17 brd ff:ff:ff:ff:ff:ff 2023-12-17T11:48:55.683 INFO:teuthology.orchestra.run.smithi040.stdout: altname enp7s0f1 2023-12-17T11:48:55.683 INFO:teuthology.orchestra.run.smithi040.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-17T11:48:55.683 INFO:teuthology.orchestra.run.smithi040.stdout: link/ether 0c:c4:7a:bd:12:cc brd ff:ff:ff:ff:ff:ff 2023-12-17T11:48:55.683 INFO:teuthology.orchestra.run.smithi040.stdout: altname enp1s0f0 2023-12-17T11:48:55.684 INFO:teuthology.orchestra.run.smithi040.stdout: inet 172.21.15.40/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-12-17T11:48:55.684 INFO:teuthology.orchestra.run.smithi040.stdout: valid_lft 42275sec preferred_lft 42275sec 2023-12-17T11:48:55.684 INFO:teuthology.orchestra.run.smithi040.stdout: inet6 fe80::ec4:7aff:febd:12cc/64 scope link noprefixroute 2023-12-17T11:48:55.684 INFO:teuthology.orchestra.run.smithi040.stdout: valid_lft forever preferred_lft forever 2023-12-17T11:48:55.684 INFO:teuthology.orchestra.run.smithi040.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-17T11:48:55.684 INFO:teuthology.orchestra.run.smithi040.stdout: link/ether 0c:c4:7a:bd:12:cd brd ff:ff:ff:ff:ff:ff 2023-12-17T11:48:55.684 INFO:teuthology.orchestra.run.smithi040.stdout: altname enp1s0f1 2023-12-17T11:48:55.684 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-12-17T11:48:55.684 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-17T11:48:55.684 DEBUG:teuthology.orchestra.run.smithi040:> (cd / && exec bash -c ' 2023-12-17T11:48:55.684 DEBUG:teuthology.orchestra.run.smithi040:> set -e 2023-12-17T11:48:55.685 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip link add name ceph-brx type bridge 2023-12-17T11:48:55.685 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip addr flush dev ceph-brx 2023-12-17T11:48:55.685 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip link set ceph-brx up 2023-12-17T11:48:55.685 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-12-17T11:48:55.685 DEBUG:teuthology.orchestra.run.smithi040:> ') 2023-12-17T11:48:55.920 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-17T11:48:55.920 DEBUG:teuthology.orchestra.run.smithi040:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-17T11:48:56.009 INFO:teuthology.orchestra.run.smithi040.stdout:1 2023-12-17T11:48:56.012 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-17T11:48:56.013 DEBUG:teuthology.orchestra.run.smithi040:> route 2023-12-17T11:48:56.064 INFO:teuthology.orchestra.run.smithi040.stdout:Kernel IP routing table 2023-12-17T11:48:56.064 INFO:teuthology.orchestra.run.smithi040.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-17T11:48:56.064 INFO:teuthology.orchestra.run.smithi040.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-12-17T11:48:56.064 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-12-17T11:48:56.064 INFO:teuthology.orchestra.run.smithi040.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-17T11:48:56.065 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-17T11:48:56.065 DEBUG:teuthology.orchestra.run.smithi040:> (cd / && exec bash -c ' 2023-12-17T11:48:56.065 DEBUG:teuthology.orchestra.run.smithi040:> set -e 2023-12-17T11:48:56.065 DEBUG:teuthology.orchestra.run.smithi040:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-12-17T11:48:56.065 DEBUG:teuthology.orchestra.run.smithi040:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-12-17T11:48:56.065 DEBUG:teuthology.orchestra.run.smithi040:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-12-17T11:48:56.065 DEBUG:teuthology.orchestra.run.smithi040:> ') 2023-12-17T11:48:56.267 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-17T11:48:56.267 DEBUG:teuthology.orchestra.run.smithi040:> ip netns list 2023-12-17T11:48:56.322 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-17T11:48:56.322 DEBUG:teuthology.orchestra.run.smithi040:> ip netns list-id 2023-12-17T11:48:56.379 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-17T11:48:56.380 DEBUG:teuthology.orchestra.run.smithi040:> (cd / && exec bash -c ' 2023-12-17T11:48:56.380 DEBUG:teuthology.orchestra.run.smithi040:> set -e 2023-12-17T11:48:56.380 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-17T11:48:56.380 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2023-12-17T11:48:56.380 DEBUG:teuthology.orchestra.run.smithi040:> ') 2023-12-17T11:48:56.535 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2023-12-17T11:48:56.535 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-17T11:48:56.535 DEBUG:teuthology.orchestra.run.smithi040:> (cd / && exec bash -c ' 2023-12-17T11:48:56.535 DEBUG:teuthology.orchestra.run.smithi040:> set -e 2023-12-17T11:48:56.535 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2023-12-17T11:48:56.536 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-12-17T11:48:56.536 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2023-12-17T11:48:56.536 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2023-12-17T11:48:56.536 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2023-12-17T11:48:56.536 DEBUG:teuthology.orchestra.run.smithi040:> ') 2023-12-17T11:48:56.814 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-17T11:48:56.814 DEBUG:teuthology.orchestra.run.smithi040:> (cd / && exec bash -c ' 2023-12-17T11:48:56.814 DEBUG:teuthology.orchestra.run.smithi040:> set -e 2023-12-17T11:48:56.814 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip link set brx.0 up 2023-12-17T11:48:56.814 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip link set dev brx.0 master ceph-brx 2023-12-17T11:48:56.814 DEBUG:teuthology.orchestra.run.smithi040:> ') 2023-12-17T11:48:56.978 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-17T11:48:56.979 DEBUG:teuthology.orchestra.run.smithi040:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-12-17T11:48:57.033 INFO:teuthology.orchestra.run.smithi040.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-12-17T11:48:57.034 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-17T11:48:57.034 DEBUG:teuthology.orchestra.run.smithi040:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-12-17T11:48:57.085 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-12-17T11:48:57.086 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-17T11:48:57.086 DEBUG:teuthology.orchestra.run.smithi040:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-12-17T11:48:57.225 INFO:teuthology.orchestra.run.smithi040.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-12-17T11:48:57.225 INFO:teuthology.orchestra.run.smithi040.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-12-17T11:48:57.225 INFO:teuthology.orchestra.run.smithi040.stdout:invalid new device string format 2023-12-17T11:48:57.699 INFO:teuthology.orchestra.run.smithi040.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-12-17T11:48:57.699 INFO:teuthology.orchestra.run.smithi040.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-12-17T11:48:57.700 INFO:teuthology.orchestra.run.smithi040.stdout:invalid new device string format 2023-12-17T11:48:57.700 INFO:teuthology.orchestra.run.smithi040.stdout:mount.ceph: resolved to: "172.21.15.40:3300,172.21.15.159:3300,172.21.15.159:3301" 2023-12-17T11:48:57.700 INFO:teuthology.orchestra.run.smithi040.stdout:mount.ceph: switching to using v1 address with old syntax 2023-12-17T11:48:57.732 INFO:teuthology.orchestra.run.smithi040.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-12-17T11:48:57.733 INFO:teuthology.orchestra.run.smithi040.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-12-17T11:48:57.733 INFO:teuthology.orchestra.run.smithi040.stdout:invalid new device string format 2023-12-17T11:48:57.733 INFO:teuthology.orchestra.run.smithi040.stdout:mount.ceph: resolved to: "172.21.15.40:3300,172.21.15.159:3300,172.21.15.159:3301" 2023-12-17T11:48:57.733 INFO:teuthology.orchestra.run.smithi040.stdout:mount.ceph: switching to using v1 address with old syntax 2023-12-17T11:48:57.733 INFO:teuthology.orchestra.run.smithi040.stdout:mount.ceph: resolved to: "172.21.15.40:6789,172.21.15.159:6789,172.21.15.159:6790" 2023-12-17T11:48:57.733 INFO:teuthology.orchestra.run.smithi040.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.40:6789,172.21.15.159:6789,172.21.15.159:6790:/ 2023-12-17T11:48:57.733 INFO:teuthology.orchestra.run.smithi040.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=099cd35d-80d9-4ca4-8424-de13b3b03ac7" will pass to kernel 2023-12-17T11:48:57.738 INFO:teuthology.orchestra.run.smithi040.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2023-12-17T11:48:57.738 INFO:teuthology.orchestra.run.smithi040.stdout: You just mounted a file system that supports labels which does not 2023-12-17T11:48:57.738 INFO:teuthology.orchestra.run.smithi040.stdout: contain labels, onto an SELinux box. It is likely that confined 2023-12-17T11:48:57.738 INFO:teuthology.orchestra.run.smithi040.stdout: applications will generate AVC messages and not be allowed access to 2023-12-17T11:48:57.738 INFO:teuthology.orchestra.run.smithi040.stdout: this file system. For more details see restorecon(8) and mount(8). 2023-12-17T11:48:57.741 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-12-17T11:48:57.742 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-17T11:48:57.742 DEBUG:teuthology.orchestra.run.smithi040:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-12-17T11:48:57.826 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-17T11:48:57.826 DEBUG:teuthology.orchestra.run.smithi040:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-17T11:48:57.875 INFO:teuthology.orchestra.run.smithi040.stdout:client4818 2023-12-17T11:48:57.875 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2023-12-17T11:48:57.876 DEBUG:teuthology.orchestra.run.smithi040:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-17T11:48:57.921 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-17T11:48:57.921 DEBUG:teuthology.orchestra.run.smithi040:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-17T11:48:58.025 INFO:teuthology.orchestra.run.smithi040.stdout:client4818 2023-12-17T11:48:58.025 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-17T11:48:58.025 DEBUG:teuthology.orchestra.run.smithi040:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-17T11:48:58.083 INFO:teuthology.orchestra.run.smithi040.stdout:client4818 2023-12-17T11:48:58.084 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-17T11:48:58.084 DEBUG:teuthology.orchestra.run.smithi040:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/099cd35d-80d9-4ca4-8424-de13b3b03ac7.client4818/status') 2023-12-17T11:48:58.173 INFO:teuthology.orchestra.run.smithi040.stdout:instance: client.4818 (3)192.168.0.1:0/2561797366 2023-12-17T11:48:58.173 INFO:teuthology.orchestra.run.smithi040.stdout:blocklisted: false 2023-12-17T11:48:58.173 INFO:teuthology.orchestra.run.smithi040.stderr:0+1 records in 2023-12-17T11:48:58.173 INFO:teuthology.orchestra.run.smithi040.stderr:0+1 records out 2023-12-17T11:48:58.173 INFO:teuthology.orchestra.run.smithi040.stderr:69 bytes copied, 7.0054e-05 s, 985 kB/s 2023-12-17T11:48:58.177 INFO:tasks.kclient:client.2 config is {'syntax': 'v1'} 2023-12-17T11:48:58.177 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-12-17T11:48:58.177 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2023-12-17T11:48:58.177 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-12-17T11:48:58.385 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:58.383+0000 7fa5c359e640 1 Processor -- start 2023-12-17T11:48:58.386 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:58.384+0000 7fa5c359e640 1 -- start start 2023-12-17T11:48:58.387 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:58.385+0000 7fa5c359e640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa5c40713b0 0x7fa5c40ae1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:58.387 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:58.385+0000 7fa5c359e640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7fa5c4070750 0x7fa5c40b27e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:58.387 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:58.385+0000 7fa5c359e640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5c4070070 con 0x7fa5c4159fd0 2023-12-17T11:48:58.387 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:58.385+0000 7fa5c359e640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5c40705f0 con 0x7fa5c4070750 2023-12-17T11:48:58.387 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:58.385+0000 7fa5c359e640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5c4070310 con 0x7fa5c40713b0 2023-12-17T11:48:58.388 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:58.386+0000 7fa5bbfff640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa5c40713b0 0x7fa5c40ae1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:58.388 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:58.386+0000 7fa5c2d9d640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7fa5c4070750 0x7fa5c40b27e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:58.388 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:58.386+0000 7fa5c259c640 1 --1- >> v1:172.21.15.159:6789/0 conn(0x7fa5c4159fd0 0x7fa5c4070ca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.159:6789/0 says I am v1:172.21.15.40:42140/0 (socket says 172.21.15.40:42140) 2023-12-17T11:48:58.388 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:58.386+0000 7fa5bbfff640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa5c40713b0 0x7fa5c40ae1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3301/0 says I am v2:172.21.15.40:34312/0 (socket says 172.21.15.40:34312) 2023-12-17T11:48:58.389 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:58.386+0000 7fa5c259c640 1 -- 172.21.15.40:0/3232922444 learned_addr learned my addr 172.21.15.40:0/3232922444 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-12-17T11:48:58.389 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:58.386+0000 7fa5bbfff640 1 -- 172.21.15.40:0/3232922444 >> v2:172.21.15.159:3300/0 conn(0x7fa5c4070750 msgr2=0x7fa5c40b27e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:48:58.389 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:58.386+0000 7fa5bbfff640 1 --2- 172.21.15.40:0/3232922444 >> v2:172.21.15.159:3300/0 conn(0x7fa5c4070750 0x7fa5c40b27e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:58.389 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:58.386+0000 7fa5bbfff640 1 -- 172.21.15.40:0/3232922444 >> v1:172.21.15.159:6789/0 conn(0x7fa5c4159fd0 legacy=0x7fa5c4070ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:58.389 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:58.386+0000 7fa5bbfff640 1 -- 172.21.15.40:0/3232922444 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5c40b1d00 con 0x7fa5c40713b0 2023-12-17T11:48:58.389 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:58.388+0000 7fa5bbfff640 1 --2- 172.21.15.40:0/3232922444 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa5c40713b0 0x7fa5c40ae1d0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fa5ac0097a0 tx=0x7fa5ac02db50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ac54675381485698 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:48:58.391 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:58.388+0000 7fa5c1d9b640 1 -- 172.21.15.40:0/3232922444 <== mon.2 v2:172.21.15.159:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5ac02f910 con 0x7fa5c40713b0 2023-12-17T11:48:58.391 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:58.388+0000 7fa5c1d9b640 1 -- 172.21.15.40:0/3232922444 <== mon.2 v2:172.21.15.159:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5ac02fa70 con 0x7fa5c40713b0 2023-12-17T11:48:58.391 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:58.388+0000 7fa5c1d9b640 1 -- 172.21.15.40:0/3232922444 <== mon.2 v2:172.21.15.159:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5ac02fe00 con 0x7fa5c40713b0 2023-12-17T11:48:58.391 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:58.389+0000 7fa5c359e640 1 -- 172.21.15.40:0/3232922444 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa5c40713b0 msgr2=0x7fa5c40ae1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:58.392 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:58.389+0000 7fa5c359e640 1 --2- 172.21.15.40:0/3232922444 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa5c40713b0 0x7fa5c40ae1d0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fa5ac0097a0 tx=0x7fa5ac02db50 comp rx=0 tx=0).stop 2023-12-17T11:48:58.392 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:58.389+0000 7fa5c359e640 1 -- 172.21.15.40:0/3232922444 shutdown_connections 2023-12-17T11:48:58.392 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:58.389+0000 7fa5c359e640 1 --2- 172.21.15.40:0/3232922444 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa5c40713b0 0x7fa5c40ae1d0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:58.392 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:58.389+0000 7fa5c359e640 1 --2- 172.21.15.40:0/3232922444 >> v2:172.21.15.159:3300/0 conn(0x7fa5c4070750 0x7fa5c40b27e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:58.392 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:58.389+0000 7fa5c359e640 1 -- 172.21.15.40:0/3232922444 >> 172.21.15.40:0/3232922444 conn(0x7fa5c40b0860 msgr2=0x7fa5c40b0c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:48:58.392 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:58.389+0000 7fa5c359e640 1 -- 172.21.15.40:0/3232922444 shutdown_connections 2023-12-17T11:48:58.393 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:58.389+0000 7fa5c359e640 1 -- 172.21.15.40:0/3232922444 wait complete. 2023-12-17T11:48:58.395 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:58.391+0000 7fa5c359e640 1 Processor -- start 2023-12-17T11:48:58.396 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:58.391+0000 7fa5c359e640 1 -- start start 2023-12-17T11:48:58.396 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:58.392+0000 7fa5c359e640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa5c4070750 0x7fa5c41507d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:58.396 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:58.392+0000 7fa5c359e640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa5c40713b0 0x7fa5c40c88a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:58.396 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:58.392+0000 7fa5c359e640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa5c4159fd0 0x7fa5c409bde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:58.396 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:58.392+0000 7fa5c359e640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5c4099e70 con 0x7fa5c4070750 2023-12-17T11:48:58.396 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:58.392+0000 7fa5c359e640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5c40cbce0 con 0x7fa5c40713b0 2023-12-17T11:48:58.397 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:58.392+0000 7fa5c359e640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5c40c9260 con 0x7fa5c4159fd0 2023-12-17T11:48:58.397 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:58.392+0000 7fa5c259c640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa5c4070750 0x7fa5c41507d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:58.397 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:58.392+0000 7fa5c259c640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa5c4070750 0x7fa5c41507d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:33916/0 (socket says 172.21.15.40:33916) 2023-12-17T11:48:58.397 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:58.392+0000 7fa5c259c640 1 -- 172.21.15.40:0/3427586704 learned_addr learned my addr 172.21.15.40:0/3427586704 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-17T11:48:58.397 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:58.392+0000 7fa5c2d9d640 1 --2- 172.21.15.40:0/3427586704 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa5c4159fd0 0x7fa5c409bde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:58.397 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:58.392+0000 7fa5bbfff640 1 --2- 172.21.15.40:0/3427586704 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa5c40713b0 0x7fa5c40c88a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:58.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:58.393+0000 7fa5c259c640 1 -- 172.21.15.40:0/3427586704 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa5c4159fd0 msgr2=0x7fa5c409bde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:58.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:58.393+0000 7fa5c259c640 1 --2- 172.21.15.40:0/3427586704 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa5c4159fd0 0x7fa5c409bde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:58.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:58.393+0000 7fa5c259c640 1 -- 172.21.15.40:0/3427586704 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa5c40713b0 msgr2=0x7fa5c40c88a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:58.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:58.393+0000 7fa5c259c640 1 --2- 172.21.15.40:0/3427586704 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa5c40713b0 0x7fa5c40c88a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:58.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:58.393+0000 7fa5c259c640 1 -- 172.21.15.40:0/3427586704 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5ac009400 con 0x7fa5c4070750 2023-12-17T11:48:58.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:58.393+0000 7fa5bbfff640 1 --2- 172.21.15.40:0/3427586704 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa5c40713b0 0x7fa5c40c88a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-17T11:48:58.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:58.393+0000 7fa5c259c640 1 --2- 172.21.15.40:0/3427586704 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa5c4070750 0x7fa5c41507d0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fa5b400c3c0 tx=0x7fa5b400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:48:58.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:58.393+0000 7fa5baffd640 1 -- 172.21.15.40:0/3427586704 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5b4005ce0 con 0x7fa5c4070750 2023-12-17T11:48:58.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:58.393+0000 7fa5baffd640 1 -- 172.21.15.40:0/3427586704 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5b4005e40 con 0x7fa5c4070750 2023-12-17T11:48:58.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:58.393+0000 7fa5baffd640 1 -- 172.21.15.40:0/3427586704 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5b40072f0 con 0x7fa5c4070750 2023-12-17T11:48:58.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:58.393+0000 7fa5c359e640 1 -- 172.21.15.40:0/3427586704 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5c40c9540 con 0x7fa5c4070750 2023-12-17T11:48:58.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:58.393+0000 7fa5c359e640 1 -- 172.21.15.40:0/3427586704 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5c40c9820 con 0x7fa5c4070750 2023-12-17T11:48:58.400 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:58.395+0000 7fa5c359e640 1 -- 172.21.15.40:0/3427586704 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5c4074450 con 0x7fa5c4070750 2023-12-17T11:48:58.400 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:58.396+0000 7fa5baffd640 1 -- 172.21.15.40:0/3427586704 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fa5b4007510 con 0x7fa5c4070750 2023-12-17T11:48:58.401 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:58.397+0000 7fa5baffd640 1 --2- 172.21.15.40:0/3427586704 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7fa5a406ae40 0x7fa5a406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:48:58.401 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:58.397+0000 7fa5baffd640 1 -- 172.21.15.40:0/3427586704 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fa5b4088f00 con 0x7fa5c4070750 2023-12-17T11:48:58.401 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:58.397+0000 7fa5bbfff640 1 --2- 172.21.15.40:0/3427586704 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7fa5a406ae40 0x7fa5a406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:48:58.401 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:58.398+0000 7fa5bbfff640 1 --2- 172.21.15.40:0/3427586704 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7fa5a406ae40 0x7fa5a406d300 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fa5ac038000 tx=0x7fa5ac008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:48:58.403 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:58.401+0000 7fa5baffd640 1 -- 172.21.15.40:0/3427586704 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fa5b4053c20 con 0x7fa5c4070750 2023-12-17T11:48:58.638 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:58.636+0000 7fa5c359e640 1 -- 172.21.15.40:0/3427586704 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fa5c406cd70 con 0x7fa5c4070750 2023-12-17T11:48:58.639 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:58.637+0000 7fa5baffd640 1 -- 172.21.15.40:0/3427586704 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+88 (secure 0 0 0) 0x7fa5b4017020 con 0x7fa5c4070750 2023-12-17T11:48:58.639 INFO:teuthology.orchestra.run.smithi040.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-12-17T11:48:58.641 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:58.639+0000 7fa5c359e640 1 -- 172.21.15.40:0/3427586704 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7fa5a406ae40 msgr2=0x7fa5a406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:58.641 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:58.639+0000 7fa5c359e640 1 --2- 172.21.15.40:0/3427586704 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7fa5a406ae40 0x7fa5a406d300 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fa5ac038000 tx=0x7fa5ac008030 comp rx=0 tx=0).stop 2023-12-17T11:48:58.641 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:58.639+0000 7fa5c359e640 1 -- 172.21.15.40:0/3427586704 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa5c4070750 msgr2=0x7fa5c41507d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:48:58.641 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:58.639+0000 7fa5c359e640 1 --2- 172.21.15.40:0/3427586704 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa5c4070750 0x7fa5c41507d0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fa5b400c3c0 tx=0x7fa5b400c880 comp rx=0 tx=0).stop 2023-12-17T11:48:58.642 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:58.639+0000 7fa5c359e640 1 -- 172.21.15.40:0/3427586704 shutdown_connections 2023-12-17T11:48:58.642 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:58.639+0000 7fa5c359e640 1 --2- 172.21.15.40:0/3427586704 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7fa5a406ae40 0x7fa5a406d300 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:58.642 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:58.639+0000 7fa5c359e640 1 --2- 172.21.15.40:0/3427586704 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa5c4159fd0 0x7fa5c409bde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:58.642 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:58.639+0000 7fa5c359e640 1 --2- 172.21.15.40:0/3427586704 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa5c40713b0 0x7fa5c40c88a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:58.642 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:58.639+0000 7fa5c359e640 1 --2- 172.21.15.40:0/3427586704 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa5c4070750 0x7fa5c41507d0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:48:58.642 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:58.640+0000 7fa5c359e640 1 -- 172.21.15.40:0/3427586704 >> 172.21.15.40:0/3427586704 conn(0x7fa5c40b0860 msgr2=0x7fa5c40ac870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:48:58.642 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:58.640+0000 7fa5c359e640 1 -- 172.21.15.40:0/3427586704 shutdown_connections 2023-12-17T11:48:58.642 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:48:58.640+0000 7fa5c359e640 1 -- 172.21.15.40:0/3427586704 wait complete. 2023-12-17T11:48:58.660 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-12-17T11:48:58.660 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-17T11:48:58.660 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi040.front.sepia.ceph.com 2023-12-17T11:48:58.660 INFO:tasks.cephfs.mount:self.client.name = client.2 2023-12-17T11:48:58.660 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2023-12-17T11:48:58.660 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-12-17T11:48:58.660 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-12-17T11:48:58.660 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-12-17T11:48:58.660 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2023-12-17T11:48:58.661 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-17T11:48:58.661 DEBUG:teuthology.orchestra.run.smithi040:> ip addr 2023-12-17T11:48:58.711 INFO:teuthology.orchestra.run.smithi040.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-17T11:48:58.712 INFO:teuthology.orchestra.run.smithi040.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-17T11:48:58.712 INFO:teuthology.orchestra.run.smithi040.stdout: inet 127.0.0.1/8 scope host lo 2023-12-17T11:48:58.712 INFO:teuthology.orchestra.run.smithi040.stdout: valid_lft forever preferred_lft forever 2023-12-17T11:48:58.712 INFO:teuthology.orchestra.run.smithi040.stdout: inet6 ::1/128 scope host 2023-12-17T11:48:58.712 INFO:teuthology.orchestra.run.smithi040.stdout: valid_lft forever preferred_lft forever 2023-12-17T11:48:58.712 INFO:teuthology.orchestra.run.smithi040.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-17T11:48:58.712 INFO:teuthology.orchestra.run.smithi040.stdout: link/ether 0c:c4:7a:6b:fd:16 brd ff:ff:ff:ff:ff:ff 2023-12-17T11:48:58.712 INFO:teuthology.orchestra.run.smithi040.stdout: altname enp7s0f0 2023-12-17T11:48:58.712 INFO:teuthology.orchestra.run.smithi040.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-17T11:48:58.712 INFO:teuthology.orchestra.run.smithi040.stdout: link/ether 0c:c4:7a:6b:fd:17 brd ff:ff:ff:ff:ff:ff 2023-12-17T11:48:58.712 INFO:teuthology.orchestra.run.smithi040.stdout: altname enp7s0f1 2023-12-17T11:48:58.712 INFO:teuthology.orchestra.run.smithi040.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-17T11:48:58.712 INFO:teuthology.orchestra.run.smithi040.stdout: link/ether 0c:c4:7a:bd:12:cc brd ff:ff:ff:ff:ff:ff 2023-12-17T11:48:58.712 INFO:teuthology.orchestra.run.smithi040.stdout: altname enp1s0f0 2023-12-17T11:48:58.713 INFO:teuthology.orchestra.run.smithi040.stdout: inet 172.21.15.40/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-12-17T11:48:58.713 INFO:teuthology.orchestra.run.smithi040.stdout: valid_lft 42272sec preferred_lft 42272sec 2023-12-17T11:48:58.713 INFO:teuthology.orchestra.run.smithi040.stdout: inet6 fe80::ec4:7aff:febd:12cc/64 scope link noprefixroute 2023-12-17T11:48:58.713 INFO:teuthology.orchestra.run.smithi040.stdout: valid_lft forever preferred_lft forever 2023-12-17T11:48:58.713 INFO:teuthology.orchestra.run.smithi040.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-17T11:48:58.713 INFO:teuthology.orchestra.run.smithi040.stdout: link/ether 0c:c4:7a:bd:12:cd brd ff:ff:ff:ff:ff:ff 2023-12-17T11:48:58.713 INFO:teuthology.orchestra.run.smithi040.stdout: altname enp1s0f1 2023-12-17T11:48:58.713 INFO:teuthology.orchestra.run.smithi040.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-12-17T11:48:58.713 INFO:teuthology.orchestra.run.smithi040.stdout: link/ether 02:bd:9f:94:fd:1a brd ff:ff:ff:ff:ff:ff 2023-12-17T11:48:58.713 INFO:teuthology.orchestra.run.smithi040.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-12-17T11:48:58.713 INFO:teuthology.orchestra.run.smithi040.stdout: valid_lft forever preferred_lft forever 2023-12-17T11:48:58.713 INFO:teuthology.orchestra.run.smithi040.stdout: inet6 fe80::10c7:cbff:fe6d:4f77/64 scope link 2023-12-17T11:48:58.713 INFO:teuthology.orchestra.run.smithi040.stdout: valid_lft forever preferred_lft forever 2023-12-17T11:48:58.714 INFO:teuthology.orchestra.run.smithi040.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-17T11:48:58.714 INFO:teuthology.orchestra.run.smithi040.stdout: link/ether 02:bd:9f:94:fd:1a brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-17T11:48:58.714 INFO:teuthology.orchestra.run.smithi040.stdout: inet6 fe80::bd:9fff:fe94:fd1a/64 scope link 2023-12-17T11:48:58.714 INFO:teuthology.orchestra.run.smithi040.stdout: valid_lft forever preferred_lft forever 2023-12-17T11:48:58.714 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-17T11:48:58.714 DEBUG:teuthology.orchestra.run.smithi040:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-17T11:48:58.793 INFO:teuthology.orchestra.run.smithi040.stdout:1 2023-12-17T11:48:58.797 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-17T11:48:58.798 DEBUG:teuthology.orchestra.run.smithi040:> route 2023-12-17T11:48:58.848 INFO:teuthology.orchestra.run.smithi040.stdout:Kernel IP routing table 2023-12-17T11:48:58.849 INFO:teuthology.orchestra.run.smithi040.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-17T11:48:58.849 INFO:teuthology.orchestra.run.smithi040.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-12-17T11:48:58.849 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-12-17T11:48:58.849 INFO:teuthology.orchestra.run.smithi040.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-17T11:48:58.849 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-17T11:48:58.849 DEBUG:teuthology.orchestra.run.smithi040:> (cd / && exec bash -c ' 2023-12-17T11:48:58.849 DEBUG:teuthology.orchestra.run.smithi040:> set -e 2023-12-17T11:48:58.850 DEBUG:teuthology.orchestra.run.smithi040:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-12-17T11:48:58.850 DEBUG:teuthology.orchestra.run.smithi040:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-12-17T11:48:58.850 DEBUG:teuthology.orchestra.run.smithi040:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-12-17T11:48:58.850 DEBUG:teuthology.orchestra.run.smithi040:> ') 2023-12-17T11:48:59.046 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-17T11:48:59.046 DEBUG:teuthology.orchestra.run.smithi040:> ip netns list 2023-12-17T11:48:59.101 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-12-17T11:48:59.101 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-17T11:48:59.102 DEBUG:teuthology.orchestra.run.smithi040:> ip netns list-id 2023-12-17T11:48:59.157 INFO:teuthology.orchestra.run.smithi040.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2023-12-17T11:48:59.158 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-17T11:48:59.158 DEBUG:teuthology.orchestra.run.smithi040:> (cd / && exec bash -c ' 2023-12-17T11:48:59.158 DEBUG:teuthology.orchestra.run.smithi040:> set -e 2023-12-17T11:48:59.158 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2023-12-17T11:48:59.159 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 1 2023-12-17T11:48:59.159 DEBUG:teuthology.orchestra.run.smithi040:> ') 2023-12-17T11:48:59.308 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-17T11:48:59.309 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2023-12-17T11:48:59.407 INFO:teuthology.orchestra.run.smithi040.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-17T11:48:59.407 INFO:teuthology.orchestra.run.smithi040.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-17T11:48:59.407 INFO:teuthology.orchestra.run.smithi040.stdout: inet 127.0.0.1/8 scope host lo 2023-12-17T11:48:59.407 INFO:teuthology.orchestra.run.smithi040.stdout: valid_lft forever preferred_lft forever 2023-12-17T11:48:59.407 INFO:teuthology.orchestra.run.smithi040.stdout: inet6 ::1/128 scope host 2023-12-17T11:48:59.407 INFO:teuthology.orchestra.run.smithi040.stdout: valid_lft forever preferred_lft forever 2023-12-17T11:48:59.407 INFO:teuthology.orchestra.run.smithi040.stdout:2: veth0@if9: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-12-17T11:48:59.407 INFO:teuthology.orchestra.run.smithi040.stdout: link/ether 16:d5:86:94:90:30 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-12-17T11:48:59.408 INFO:teuthology.orchestra.run.smithi040.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-12-17T11:48:59.408 INFO:teuthology.orchestra.run.smithi040.stdout: valid_lft forever preferred_lft forever 2023-12-17T11:48:59.408 INFO:teuthology.orchestra.run.smithi040.stdout: inet6 fe80::14d5:86ff:fe94:9030/64 scope link 2023-12-17T11:48:59.408 INFO:teuthology.orchestra.run.smithi040.stdout: valid_lft forever preferred_lft forever 2023-12-17T11:48:59.411 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-17T11:48:59.411 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2023-12-17T11:48:59.520 INFO:teuthology.orchestra.run.smithi040.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-17T11:48:59.520 INFO:teuthology.orchestra.run.smithi040.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-17T11:48:59.520 INFO:teuthology.orchestra.run.smithi040.stdout: inet 127.0.0.1/8 scope host lo 2023-12-17T11:48:59.520 INFO:teuthology.orchestra.run.smithi040.stdout: valid_lft forever preferred_lft forever 2023-12-17T11:48:59.521 INFO:teuthology.orchestra.run.smithi040.stdout: inet6 ::1/128 scope host 2023-12-17T11:48:59.521 INFO:teuthology.orchestra.run.smithi040.stdout: valid_lft forever preferred_lft forever 2023-12-17T11:48:59.521 INFO:teuthology.orchestra.run.smithi040.stdout:2: veth0@if9: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-12-17T11:48:59.521 INFO:teuthology.orchestra.run.smithi040.stdout: link/ether 16:d5:86:94:90:30 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-12-17T11:48:59.521 INFO:teuthology.orchestra.run.smithi040.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-12-17T11:48:59.521 INFO:teuthology.orchestra.run.smithi040.stdout: valid_lft forever preferred_lft forever 2023-12-17T11:48:59.521 INFO:teuthology.orchestra.run.smithi040.stdout: inet6 fe80::14d5:86ff:fe94:9030/64 scope link 2023-12-17T11:48:59.521 INFO:teuthology.orchestra.run.smithi040.stdout: valid_lft forever preferred_lft forever 2023-12-17T11:48:59.525 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.2/16 2023-12-17T11:48:59.525 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-17T11:48:59.525 DEBUG:teuthology.orchestra.run.smithi040:> (cd / && exec bash -c ' 2023-12-17T11:48:59.525 DEBUG:teuthology.orchestra.run.smithi040:> set -e 2023-12-17T11:48:59.525 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.1 2023-12-17T11:48:59.525 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2023-12-17T11:48:59.525 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2023-12-17T11:48:59.525 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2023-12-17T11:48:59.525 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2023-12-17T11:48:59.525 DEBUG:teuthology.orchestra.run.smithi040:> ') 2023-12-17T11:48:59.784 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-17T11:48:59.784 DEBUG:teuthology.orchestra.run.smithi040:> (cd / && exec bash -c ' 2023-12-17T11:48:59.785 DEBUG:teuthology.orchestra.run.smithi040:> set -e 2023-12-17T11:48:59.785 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip link set brx.1 up 2023-12-17T11:48:59.785 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip link set dev brx.1 master ceph-brx 2023-12-17T11:48:59.785 DEBUG:teuthology.orchestra.run.smithi040:> ') 2023-12-17T11:48:59.967 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-17T11:48:59.968 DEBUG:teuthology.orchestra.run.smithi040:> mkdir -p -v /home/ubuntu/cephtest/mnt.2 2023-12-17T11:49:00.018 INFO:teuthology.orchestra.run.smithi040.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.2' 2023-12-17T11:49:00.018 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-17T11:49:00.018 DEBUG:teuthology.orchestra.run.smithi040:> chmod 0000 /home/ubuntu/cephtest/mnt.2 2023-12-17T11:49:00.065 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-12-17T11:49:00.065 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-17T11:49:00.065 DEBUG:teuthology.orchestra.run.smithi040:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.2 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2023-12-17T11:49:00.263 INFO:teuthology.orchestra.run.smithi040.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2023-12-17T11:49:00.263 INFO:teuthology.orchestra.run.smithi040.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs". 2023-12-17T11:49:00.264 INFO:teuthology.orchestra.run.smithi040.stdout:invalid new device string format 2023-12-17T11:49:00.288 INFO:teuthology.orchestra.run.smithi040.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2023-12-17T11:49:00.288 INFO:teuthology.orchestra.run.smithi040.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs". 2023-12-17T11:49:00.288 INFO:teuthology.orchestra.run.smithi040.stdout:invalid new device string format 2023-12-17T11:49:00.288 INFO:teuthology.orchestra.run.smithi040.stdout:mount.ceph: resolved to: "172.21.15.40:3300,172.21.15.159:3300,172.21.15.159:3301" 2023-12-17T11:49:00.288 INFO:teuthology.orchestra.run.smithi040.stdout:mount.ceph: switching to using v1 address with old syntax 2023-12-17T11:49:00.317 INFO:teuthology.orchestra.run.smithi040.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2023-12-17T11:49:00.317 INFO:teuthology.orchestra.run.smithi040.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs". 2023-12-17T11:49:00.317 INFO:teuthology.orchestra.run.smithi040.stdout:invalid new device string format 2023-12-17T11:49:00.317 INFO:teuthology.orchestra.run.smithi040.stdout:mount.ceph: resolved to: "172.21.15.40:3300,172.21.15.159:3300,172.21.15.159:3301" 2023-12-17T11:49:00.317 INFO:teuthology.orchestra.run.smithi040.stdout:mount.ceph: switching to using v1 address with old syntax 2023-12-17T11:49:00.317 INFO:teuthology.orchestra.run.smithi040.stdout:mount.ceph: resolved to: "172.21.15.40:6789,172.21.15.159:6789,172.21.15.159:6790" 2023-12-17T11:49:00.317 INFO:teuthology.orchestra.run.smithi040.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.40:6789,172.21.15.159:6789,172.21.15.159:6790:/ 2023-12-17T11:49:00.317 INFO:teuthology.orchestra.run.smithi040.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs,key=2,fsid=099cd35d-80d9-4ca4-8424-de13b3b03ac7" will pass to kernel 2023-12-17T11:49:00.321 INFO:teuthology.orchestra.run.smithi040.stdout:mount: /home/ubuntu/cephtest/mnt.2 does not contain SELinux labels. 2023-12-17T11:49:00.322 INFO:teuthology.orchestra.run.smithi040.stdout: You just mounted a file system that supports labels which does not 2023-12-17T11:49:00.322 INFO:teuthology.orchestra.run.smithi040.stdout: contain labels, onto an SELinux box. It is likely that confined 2023-12-17T11:49:00.322 INFO:teuthology.orchestra.run.smithi040.stdout: applications will generate AVC messages and not be allowed access to 2023-12-17T11:49:00.322 INFO:teuthology.orchestra.run.smithi040.stdout: this file system. For more details see restorecon(8) and mount(8). 2023-12-17T11:49:00.326 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-12-17T11:49:00.326 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-17T11:49:00.326 DEBUG:teuthology.orchestra.run.smithi040:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.2 2023-12-17T11:49:00.430 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-17T11:49:00.430 DEBUG:teuthology.orchestra.run.smithi040:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-17T11:49:00.496 INFO:teuthology.orchestra.run.smithi040.stdout:client4824 2023-12-17T11:49:00.496 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2023-12-17T11:49:00.496 DEBUG:teuthology.orchestra.run.smithi040:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-17T11:49:00.549 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-17T11:49:00.550 DEBUG:teuthology.orchestra.run.smithi040:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-17T11:49:00.598 INFO:teuthology.orchestra.run.smithi040.stdout:client4824 2023-12-17T11:49:00.599 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-17T11:49:00.599 DEBUG:teuthology.orchestra.run.smithi040:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-17T11:49:00.653 INFO:teuthology.orchestra.run.smithi040.stdout:client4824 2023-12-17T11:49:00.653 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-17T11:49:00.653 DEBUG:teuthology.orchestra.run.smithi040:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/099cd35d-80d9-4ca4-8424-de13b3b03ac7.client4824/status') 2023-12-17T11:49:00.746 INFO:teuthology.orchestra.run.smithi040.stdout:instance: client.4824 (3)192.168.0.2:0/2805707960 2023-12-17T11:49:00.746 INFO:teuthology.orchestra.run.smithi040.stdout:blocklisted: false 2023-12-17T11:49:00.747 INFO:teuthology.orchestra.run.smithi040.stderr:0+1 records in 2023-12-17T11:49:00.747 INFO:teuthology.orchestra.run.smithi040.stderr:0+1 records out 2023-12-17T11:49:00.747 INFO:teuthology.orchestra.run.smithi040.stderr:69 bytes copied, 7.1364e-05 s, 967 kB/s 2023-12-17T11:49:00.751 INFO:tasks.kclient:client.1 config is {'syntax': 'v1'} 2023-12-17T11:49:00.751 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-12-17T11:49:00.751 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-12-17T11:49:00.751 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-12-17T11:49:00.972 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:00.970+0000 7f3c1bfff640 1 Processor -- start 2023-12-17T11:49:00.972 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:00.970+0000 7f3c1bfff640 1 -- start start 2023-12-17T11:49:00.974 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:00.972+0000 7f3c1bfff640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f3c1c15e5d0 0x7f3c1c06bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:00.974 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:00.972+0000 7f3c1bfff640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f3c1c071260 0x7f3c1c0cded0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:00.974 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:00.972+0000 7f3c1bfff640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c1c071f90 con 0x7f3c1c0ae200 2023-12-17T11:49:00.975 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:00.972+0000 7f3c1bfff640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c1c072270 con 0x7f3c1c15e5d0 2023-12-17T11:49:00.975 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:00.972+0000 7f3c1bfff640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c1c070070 con 0x7f3c1c071260 2023-12-17T11:49:00.976 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:00.973+0000 7f3c1affd640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f3c1c15e5d0 0x7f3c1c06bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:00.976 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:00.973+0000 7f3c127fc640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f3c1c0ae200 0x7f3c1c070b50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:60586/0 (socket says 172.21.15.40:60586) 2023-12-17T11:49:00.976 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:00.973+0000 7f3c127fc640 1 -- 172.21.15.40:0/4262477982 learned_addr learned my addr 172.21.15.40:0/4262477982 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-12-17T11:49:00.976 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:00.973+0000 7f3c1b7fe640 1 --2- 172.21.15.40:0/4262477982 >> v2:172.21.15.159:3300/0 conn(0x7f3c1c071260 0x7f3c1c0cded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:00.976 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:00.973+0000 7f3c1a7fc640 1 -- 172.21.15.40:0/4262477982 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1353210124 0 0) 0x7f3c1c071f90 con 0x7f3c1c0ae200 2023-12-17T11:49:00.976 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:00.973+0000 7f3c1a7fc640 1 -- 172.21.15.40:0/4262477982 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3c08003520 con 0x7f3c1c0ae200 2023-12-17T11:49:00.976 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:00.973+0000 7f3c1affd640 1 -- 172.21.15.40:0/4262477982 >> v2:172.21.15.159:3300/0 conn(0x7f3c1c071260 msgr2=0x7f3c1c0cded0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:49:00.976 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:00.973+0000 7f3c1affd640 1 --2- 172.21.15.40:0/4262477982 >> v2:172.21.15.159:3300/0 conn(0x7f3c1c071260 0x7f3c1c0cded0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:00.976 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:00.973+0000 7f3c1affd640 1 -- 172.21.15.40:0/4262477982 >> v1:172.21.15.40:6789/0 conn(0x7f3c1c0ae200 legacy=0x7f3c1c070b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:00.976 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:00.974+0000 7f3c1affd640 1 -- 172.21.15.40:0/4262477982 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c1c070350 con 0x7f3c1c15e5d0 2023-12-17T11:49:00.978 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:00.975+0000 7f3c1affd640 1 --2- 172.21.15.40:0/4262477982 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3c1c15e5d0 0x7f3c1c06bdf0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f3c1c0b3f90 tx=0x7f3c0c02b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44a4ea76bba7b6c3 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:49:00.978 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:00.975+0000 7f3c1a7fc640 1 -- 172.21.15.40:0/4262477982 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c0c02e070 con 0x7f3c1c15e5d0 2023-12-17T11:49:00.978 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:00.975+0000 7f3c1a7fc640 1 -- 172.21.15.40:0/4262477982 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c0c0315a0 con 0x7f3c1c15e5d0 2023-12-17T11:49:00.978 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:00.975+0000 7f3c1a7fc640 1 -- 172.21.15.40:0/4262477982 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c0c031930 con 0x7f3c1c15e5d0 2023-12-17T11:49:00.978 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:00.975+0000 7f3c1bfff640 1 -- 172.21.15.40:0/4262477982 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3c1c15e5d0 msgr2=0x7f3c1c06bdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:00.978 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:00.975+0000 7f3c1bfff640 1 --2- 172.21.15.40:0/4262477982 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3c1c15e5d0 0x7f3c1c06bdf0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f3c1c0b3f90 tx=0x7f3c0c02b840 comp rx=0 tx=0).stop 2023-12-17T11:49:00.978 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:00.976+0000 7f3c1bfff640 1 -- 172.21.15.40:0/4262477982 shutdown_connections 2023-12-17T11:49:00.978 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:00.976+0000 7f3c1bfff640 1 --2- 172.21.15.40:0/4262477982 >> v2:172.21.15.159:3300/0 conn(0x7f3c1c071260 0x7f3c1c0cded0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:00.978 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:00.976+0000 7f3c1bfff640 1 --2- 172.21.15.40:0/4262477982 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3c1c15e5d0 0x7f3c1c06bdf0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:00.979 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:00.976+0000 7f3c1bfff640 1 -- 172.21.15.40:0/4262477982 >> 172.21.15.40:0/4262477982 conn(0x7f3c1c0b0860 msgr2=0x7f3c1c0b0c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:49:00.979 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:00.976+0000 7f3c1bfff640 1 -- 172.21.15.40:0/4262477982 shutdown_connections 2023-12-17T11:49:00.979 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:00.976+0000 7f3c1bfff640 1 -- 172.21.15.40:0/4262477982 wait complete. 2023-12-17T11:49:00.979 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:00.978+0000 7f3c1bfff640 1 Processor -- start 2023-12-17T11:49:00.979 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:00.978+0000 7f3c1bfff640 1 -- start start 2023-12-17T11:49:00.982 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:00.979+0000 7f3c1bfff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3c1c071260 0x7f3c1c13f4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:00.982 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:00.979+0000 7f3c1bfff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3c1c0ae200 0x7f3c1c1425c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:00.982 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:00.979+0000 7f3c1bfff640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f3c1c15e5d0 0x7f3c1c155360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:00.982 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:00.979+0000 7f3c1bfff640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c1c158040 con 0x7f3c1c0ae200 2023-12-17T11:49:00.982 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:00.979+0000 7f3c1bfff640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c1c142b00 con 0x7f3c1c071260 2023-12-17T11:49:00.982 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:00.979+0000 7f3c1bfff640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c1c13ffc0 con 0x7f3c1c15e5d0 2023-12-17T11:49:00.982 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:00.979+0000 7f3c127fc640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3c1c0ae200 0x7f3c1c1425c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:00.982 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:00.979+0000 7f3c127fc640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3c1c0ae200 0x7f3c1c1425c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:33940/0 (socket says 172.21.15.40:33940) 2023-12-17T11:49:00.983 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:00.979+0000 7f3c127fc640 1 -- 172.21.15.40:0/4018116232 learned_addr learned my addr 172.21.15.40:0/4018116232 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-17T11:49:00.983 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:00.979+0000 7f3c1affd640 1 --2- 172.21.15.40:0/4018116232 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3c1c071260 0x7f3c1c13f4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:00.983 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:00.980+0000 7f3c1b7fe640 1 --2- 172.21.15.40:0/4018116232 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f3c1c15e5d0 0x7f3c1c155360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:00.983 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:00.980+0000 7f3c127fc640 1 -- 172.21.15.40:0/4018116232 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f3c1c15e5d0 msgr2=0x7f3c1c155360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:00.983 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:00.980+0000 7f3c127fc640 1 --2- 172.21.15.40:0/4018116232 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f3c1c15e5d0 0x7f3c1c155360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:00.983 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:00.980+0000 7f3c127fc640 1 -- 172.21.15.40:0/4018116232 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3c1c071260 msgr2=0x7f3c1c13f4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:00.983 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:00.980+0000 7f3c127fc640 1 --2- 172.21.15.40:0/4018116232 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3c1c071260 0x7f3c1c13f4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:00.983 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:00.980+0000 7f3c127fc640 1 -- 172.21.15.40:0/4018116232 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c0c009400 con 0x7f3c1c0ae200 2023-12-17T11:49:00.983 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:00.980+0000 7f3c127fc640 1 --2- 172.21.15.40:0/4018116232 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3c1c0ae200 0x7f3c1c1425c0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f3c0400c500 tx=0x7f3c0400c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:49:00.983 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:00.980+0000 7f3c13fff640 1 -- 172.21.15.40:0/4018116232 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c04005ce0 con 0x7f3c1c0ae200 2023-12-17T11:49:00.983 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:00.980+0000 7f3c13fff640 1 -- 172.21.15.40:0/4018116232 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c04005e40 con 0x7f3c1c0ae200 2023-12-17T11:49:00.983 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:00.980+0000 7f3c13fff640 1 -- 172.21.15.40:0/4018116232 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c04007330 con 0x7f3c1c0ae200 2023-12-17T11:49:00.983 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:00.980+0000 7f3c1bfff640 1 -- 172.21.15.40:0/4018116232 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c1c1402a0 con 0x7f3c1c0ae200 2023-12-17T11:49:00.984 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:00.980+0000 7f3c1bfff640 1 -- 172.21.15.40:0/4018116232 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c1c140860 con 0x7f3c1c0ae200 2023-12-17T11:49:00.984 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:00.982+0000 7f3c1bfff640 1 -- 172.21.15.40:0/4018116232 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c1c074450 con 0x7f3c1c0ae200 2023-12-17T11:49:00.984 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:00.983+0000 7f3c13fff640 1 -- 172.21.15.40:0/4018116232 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f3c04007550 con 0x7f3c1c0ae200 2023-12-17T11:49:00.986 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:00.984+0000 7f3c13fff640 1 --2- 172.21.15.40:0/4018116232 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f3bfc06ae40 0x7f3bfc06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:00.986 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:00.984+0000 7f3c13fff640 1 -- 172.21.15.40:0/4018116232 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f3c040890a0 con 0x7f3c1c0ae200 2023-12-17T11:49:00.987 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:00.985+0000 7f3c1affd640 1 --2- 172.21.15.40:0/4018116232 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f3bfc06ae40 0x7f3bfc06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:00.988 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:00.986+0000 7f3c1affd640 1 --2- 172.21.15.40:0/4018116232 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f3bfc06ae40 0x7f3bfc06d300 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f3c0c036000 tx=0x7f3c0c03d040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:49:00.991 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:00.989+0000 7f3c13fff640 1 -- 172.21.15.40:0/4018116232 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f3c04053e20 con 0x7f3c1c0ae200 2023-12-17T11:49:01.228 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:01.226+0000 7f3c1bfff640 1 -- 172.21.15.40:0/4018116232 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f3c1c0adfe0 con 0x7f3c1c0ae200 2023-12-17T11:49:01.229 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:01.227+0000 7f3c13fff640 1 -- 172.21.15.40:0/4018116232 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+88 (secure 0 0 0) 0x7f3c04017070 con 0x7f3c1c0ae200 2023-12-17T11:49:01.229 INFO:teuthology.orchestra.run.smithi040.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-12-17T11:49:01.232 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:01.230+0000 7f3c1bfff640 1 -- 172.21.15.40:0/4018116232 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f3bfc06ae40 msgr2=0x7f3bfc06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:01.232 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:01.230+0000 7f3c1bfff640 1 --2- 172.21.15.40:0/4018116232 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f3bfc06ae40 0x7f3bfc06d300 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f3c0c036000 tx=0x7f3c0c03d040 comp rx=0 tx=0).stop 2023-12-17T11:49:01.232 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:01.230+0000 7f3c1bfff640 1 -- 172.21.15.40:0/4018116232 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3c1c0ae200 msgr2=0x7f3c1c1425c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:01.232 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:01.230+0000 7f3c1bfff640 1 --2- 172.21.15.40:0/4018116232 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3c1c0ae200 0x7f3c1c1425c0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f3c0400c500 tx=0x7f3c0400c9c0 comp rx=0 tx=0).stop 2023-12-17T11:49:01.232 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:01.230+0000 7f3c1bfff640 1 -- 172.21.15.40:0/4018116232 shutdown_connections 2023-12-17T11:49:01.233 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:01.230+0000 7f3c1bfff640 1 --2- 172.21.15.40:0/4018116232 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f3bfc06ae40 0x7f3bfc06d300 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:01.233 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:01.230+0000 7f3c1bfff640 1 --2- 172.21.15.40:0/4018116232 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f3c1c15e5d0 0x7f3c1c155360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:01.233 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:01.230+0000 7f3c1bfff640 1 --2- 172.21.15.40:0/4018116232 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3c1c0ae200 0x7f3c1c1425c0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:01.233 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:01.230+0000 7f3c1bfff640 1 --2- 172.21.15.40:0/4018116232 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3c1c071260 0x7f3c1c13f4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:01.233 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:01.230+0000 7f3c1bfff640 1 -- 172.21.15.40:0/4018116232 >> 172.21.15.40:0/4018116232 conn(0x7f3c1c0b0860 msgr2=0x7f3c1c1548e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:49:01.233 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:01.230+0000 7f3c1bfff640 1 -- 172.21.15.40:0/4018116232 shutdown_connections 2023-12-17T11:49:01.233 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:01.230+0000 7f3c1bfff640 1 -- 172.21.15.40:0/4018116232 wait complete. 2023-12-17T11:49:01.252 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-12-17T11:49:01.252 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-17T11:49:01.252 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi159.front.sepia.ceph.com 2023-12-17T11:49:01.252 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-12-17T11:49:01.252 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-12-17T11:49:01.252 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-12-17T11:49:01.252 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-12-17T11:49:01.252 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-12-17T11:49:01.253 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2023-12-17T11:49:01.253 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-17T11:49:01.253 DEBUG:teuthology.orchestra.run.smithi159:> ip addr 2023-12-17T11:49:01.311 INFO:teuthology.orchestra.run.smithi159.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-17T11:49:01.311 INFO:teuthology.orchestra.run.smithi159.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-17T11:49:01.311 INFO:teuthology.orchestra.run.smithi159.stdout: inet 127.0.0.1/8 scope host lo 2023-12-17T11:49:01.312 INFO:teuthology.orchestra.run.smithi159.stdout: valid_lft forever preferred_lft forever 2023-12-17T11:49:01.312 INFO:teuthology.orchestra.run.smithi159.stdout: inet6 ::1/128 scope host 2023-12-17T11:49:01.312 INFO:teuthology.orchestra.run.smithi159.stdout: valid_lft forever preferred_lft forever 2023-12-17T11:49:01.312 INFO:teuthology.orchestra.run.smithi159.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-17T11:49:01.312 INFO:teuthology.orchestra.run.smithi159.stdout: link/ether 0c:c4:7a:d9:d8:c6 brd ff:ff:ff:ff:ff:ff 2023-12-17T11:49:01.312 INFO:teuthology.orchestra.run.smithi159.stdout: altname enp7s0f0 2023-12-17T11:49:01.312 INFO:teuthology.orchestra.run.smithi159.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-17T11:49:01.312 INFO:teuthology.orchestra.run.smithi159.stdout: link/ether 0c:c4:7a:d9:d8:c7 brd ff:ff:ff:ff:ff:ff 2023-12-17T11:49:01.312 INFO:teuthology.orchestra.run.smithi159.stdout: altname enp7s0f1 2023-12-17T11:49:01.312 INFO:teuthology.orchestra.run.smithi159.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-17T11:49:01.312 INFO:teuthology.orchestra.run.smithi159.stdout: link/ether 0c:c4:7a:88:72:4e brd ff:ff:ff:ff:ff:ff 2023-12-17T11:49:01.312 INFO:teuthology.orchestra.run.smithi159.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-17T11:49:01.312 INFO:teuthology.orchestra.run.smithi159.stdout: link/ether 0c:c4:7a:88:72:4f brd ff:ff:ff:ff:ff:ff 2023-12-17T11:49:01.312 INFO:teuthology.orchestra.run.smithi159.stdout: inet 172.21.15.159/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-12-17T11:49:01.313 INFO:teuthology.orchestra.run.smithi159.stdout: valid_lft 42322sec preferred_lft 42322sec 2023-12-17T11:49:01.313 INFO:teuthology.orchestra.run.smithi159.stdout: inet6 fe80::ec4:7aff:fe88:724f/64 scope link 2023-12-17T11:49:01.313 INFO:teuthology.orchestra.run.smithi159.stdout: valid_lft forever preferred_lft forever 2023-12-17T11:49:01.314 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-12-17T11:49:01.314 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-17T11:49:01.314 DEBUG:teuthology.orchestra.run.smithi159:> (cd / && exec bash -c ' 2023-12-17T11:49:01.314 DEBUG:teuthology.orchestra.run.smithi159:> set -e 2023-12-17T11:49:01.314 DEBUG:teuthology.orchestra.run.smithi159:> sudo ip link add name ceph-brx type bridge 2023-12-17T11:49:01.314 DEBUG:teuthology.orchestra.run.smithi159:> sudo ip addr flush dev ceph-brx 2023-12-17T11:49:01.314 DEBUG:teuthology.orchestra.run.smithi159:> sudo ip link set ceph-brx up 2023-12-17T11:49:01.314 DEBUG:teuthology.orchestra.run.smithi159:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-12-17T11:49:01.314 DEBUG:teuthology.orchestra.run.smithi159:> ') 2023-12-17T11:49:01.773 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-17T11:49:01.773 DEBUG:teuthology.orchestra.run.smithi159:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-17T11:49:01.850 INFO:teuthology.orchestra.run.smithi159.stdout:1 2023-12-17T11:49:01.854 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-17T11:49:01.854 DEBUG:teuthology.orchestra.run.smithi159:> route 2023-12-17T11:49:01.905 INFO:teuthology.orchestra.run.smithi159.stdout:Kernel IP routing table 2023-12-17T11:49:01.905 INFO:teuthology.orchestra.run.smithi159.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-17T11:49:01.906 INFO:teuthology.orchestra.run.smithi159.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-12-17T11:49:01.906 INFO:teuthology.orchestra.run.smithi159.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-12-17T11:49:01.906 INFO:teuthology.orchestra.run.smithi159.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-17T11:49:01.906 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-17T11:49:01.906 DEBUG:teuthology.orchestra.run.smithi159:> (cd / && exec bash -c ' 2023-12-17T11:49:01.906 DEBUG:teuthology.orchestra.run.smithi159:> set -e 2023-12-17T11:49:01.906 DEBUG:teuthology.orchestra.run.smithi159:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-12-17T11:49:01.907 DEBUG:teuthology.orchestra.run.smithi159:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-12-17T11:49:01.907 DEBUG:teuthology.orchestra.run.smithi159:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-12-17T11:49:01.907 DEBUG:teuthology.orchestra.run.smithi159:> ') 2023-12-17T11:49:02.669 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-17T11:49:02.669 DEBUG:teuthology.orchestra.run.smithi159:> ip netns list 2023-12-17T11:49:02.727 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-17T11:49:02.728 DEBUG:teuthology.orchestra.run.smithi159:> ip netns list-id 2023-12-17T11:49:02.777 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-17T11:49:02.778 DEBUG:teuthology.orchestra.run.smithi159:> (cd / && exec bash -c ' 2023-12-17T11:49:02.778 DEBUG:teuthology.orchestra.run.smithi159:> set -e 2023-12-17T11:49:02.778 DEBUG:teuthology.orchestra.run.smithi159:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2023-12-17T11:49:02.778 DEBUG:teuthology.orchestra.run.smithi159:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2023-12-17T11:49:02.778 DEBUG:teuthology.orchestra.run.smithi159:> ') 2023-12-17T11:49:02.915 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2023-12-17T11:49:02.915 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-17T11:49:02.915 DEBUG:teuthology.orchestra.run.smithi159:> (cd / && exec bash -c ' 2023-12-17T11:49:02.915 DEBUG:teuthology.orchestra.run.smithi159:> set -e 2023-12-17T11:49:02.915 DEBUG:teuthology.orchestra.run.smithi159:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2023-12-17T11:49:02.915 DEBUG:teuthology.orchestra.run.smithi159:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-12-17T11:49:02.915 DEBUG:teuthology.orchestra.run.smithi159:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2023-12-17T11:49:02.916 DEBUG:teuthology.orchestra.run.smithi159:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2023-12-17T11:49:02.916 DEBUG:teuthology.orchestra.run.smithi159:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2023-12-17T11:49:02.916 DEBUG:teuthology.orchestra.run.smithi159:> ') 2023-12-17T11:49:03.179 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-17T11:49:03.179 DEBUG:teuthology.orchestra.run.smithi159:> (cd / && exec bash -c ' 2023-12-17T11:49:03.179 DEBUG:teuthology.orchestra.run.smithi159:> set -e 2023-12-17T11:49:03.180 DEBUG:teuthology.orchestra.run.smithi159:> sudo ip link set brx.0 up 2023-12-17T11:49:03.180 DEBUG:teuthology.orchestra.run.smithi159:> sudo ip link set dev brx.0 master ceph-brx 2023-12-17T11:49:03.180 DEBUG:teuthology.orchestra.run.smithi159:> ') 2023-12-17T11:49:03.341 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-17T11:49:03.342 DEBUG:teuthology.orchestra.run.smithi159:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-12-17T11:49:03.390 INFO:teuthology.orchestra.run.smithi159.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-12-17T11:49:03.391 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-17T11:49:03.391 DEBUG:teuthology.orchestra.run.smithi159:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-12-17T11:49:03.489 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-12-17T11:49:03.490 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-17T11:49:03.490 DEBUG:teuthology.orchestra.run.smithi159:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-12-17T11:49:03.639 INFO:teuthology.orchestra.run.smithi159.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-12-17T11:49:03.639 INFO:teuthology.orchestra.run.smithi159.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-12-17T11:49:03.639 INFO:teuthology.orchestra.run.smithi159.stdout:invalid new device string format 2023-12-17T11:49:04.094 INFO:teuthology.orchestra.run.smithi159.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-12-17T11:49:04.094 INFO:teuthology.orchestra.run.smithi159.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-12-17T11:49:04.094 INFO:teuthology.orchestra.run.smithi159.stdout:invalid new device string format 2023-12-17T11:49:04.094 INFO:teuthology.orchestra.run.smithi159.stdout:mount.ceph: resolved to: "172.21.15.40:3300,172.21.15.159:3300,172.21.15.159:3301" 2023-12-17T11:49:04.094 INFO:teuthology.orchestra.run.smithi159.stdout:mount.ceph: switching to using v1 address with old syntax 2023-12-17T11:49:04.125 INFO:teuthology.orchestra.run.smithi159.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-12-17T11:49:04.125 INFO:teuthology.orchestra.run.smithi159.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-12-17T11:49:04.125 INFO:teuthology.orchestra.run.smithi159.stdout:invalid new device string format 2023-12-17T11:49:04.125 INFO:teuthology.orchestra.run.smithi159.stdout:mount.ceph: resolved to: "172.21.15.40:3300,172.21.15.159:3300,172.21.15.159:3301" 2023-12-17T11:49:04.126 INFO:teuthology.orchestra.run.smithi159.stdout:mount.ceph: switching to using v1 address with old syntax 2023-12-17T11:49:04.126 INFO:teuthology.orchestra.run.smithi159.stdout:mount.ceph: resolved to: "172.21.15.40:6789,172.21.15.159:6789,172.21.15.159:6790" 2023-12-17T11:49:04.126 INFO:teuthology.orchestra.run.smithi159.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.40:6789,172.21.15.159:6789,172.21.15.159:6790:/ 2023-12-17T11:49:04.126 INFO:teuthology.orchestra.run.smithi159.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs,key=1,fsid=099cd35d-80d9-4ca4-8424-de13b3b03ac7" will pass to kernel 2023-12-17T11:49:04.129 INFO:teuthology.orchestra.run.smithi159.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2023-12-17T11:49:04.130 INFO:teuthology.orchestra.run.smithi159.stdout: You just mounted a file system that supports labels which does not 2023-12-17T11:49:04.130 INFO:teuthology.orchestra.run.smithi159.stdout: contain labels, onto an SELinux box. It is likely that confined 2023-12-17T11:49:04.130 INFO:teuthology.orchestra.run.smithi159.stdout: applications will generate AVC messages and not be allowed access to 2023-12-17T11:49:04.130 INFO:teuthology.orchestra.run.smithi159.stdout: this file system. For more details see restorecon(8) and mount(8). 2023-12-17T11:49:04.135 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-12-17T11:49:04.135 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-17T11:49:04.135 DEBUG:teuthology.orchestra.run.smithi159:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-12-17T11:49:04.221 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-17T11:49:04.221 DEBUG:teuthology.orchestra.run.smithi159:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-17T11:49:04.279 INFO:teuthology.orchestra.run.smithi159.stdout:client4627 2023-12-17T11:49:04.279 DEBUG:teuthology.orchestra.run.smithi159:> set -ex 2023-12-17T11:49:04.280 DEBUG:teuthology.orchestra.run.smithi159:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-17T11:49:04.332 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-17T11:49:04.333 DEBUG:teuthology.orchestra.run.smithi159:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-17T11:49:04.388 INFO:teuthology.orchestra.run.smithi159.stdout:client4627 2023-12-17T11:49:04.388 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-17T11:49:04.388 DEBUG:teuthology.orchestra.run.smithi159:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-17T11:49:04.442 INFO:teuthology.orchestra.run.smithi159.stdout:client4627 2023-12-17T11:49:04.442 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-17T11:49:04.443 DEBUG:teuthology.orchestra.run.smithi159:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/099cd35d-80d9-4ca4-8424-de13b3b03ac7.client4627/status') 2023-12-17T11:49:04.533 INFO:teuthology.orchestra.run.smithi159.stdout:instance: client.4627 (3)192.168.0.1:0/2918133700 2023-12-17T11:49:04.533 INFO:teuthology.orchestra.run.smithi159.stdout:blocklisted: false 2023-12-17T11:49:04.533 INFO:teuthology.orchestra.run.smithi159.stderr:0+1 records in 2023-12-17T11:49:04.533 INFO:teuthology.orchestra.run.smithi159.stderr:0+1 records out 2023-12-17T11:49:04.534 INFO:teuthology.orchestra.run.smithi159.stderr:69 bytes copied, 6.6928e-05 s, 1.0 MB/s 2023-12-17T11:49:04.537 INFO:tasks.kclient:client.3 config is {'syntax': 'v1'} 2023-12-17T11:49:04.538 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-12-17T11:49:04.538 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2023-12-17T11:49:04.538 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-12-17T11:49:04.773 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:04.771+0000 7f154cc1e640 1 Processor -- start 2023-12-17T11:49:04.773 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:04.771+0000 7f154cc1e640 1 -- start start 2023-12-17T11:49:04.774 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:04.772+0000 7f154cc1e640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1548143e00 0x7f15480b4040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:04.774 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:04.772+0000 7f154cc1e640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15480b3bb0 con 0x7f154806c410 2023-12-17T11:49:04.774 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:04.772+0000 7f154cc1e640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15481441e0 con 0x7f1548072180 2023-12-17T11:49:04.774 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:04.772+0000 7f154cc1e640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1548072680 con 0x7f1548143e00 2023-12-17T11:49:04.774 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:04.773+0000 7f1546d9d640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f154806c410 0x7f154815ecb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:60598/0 (socket says 172.21.15.40:60598) 2023-12-17T11:49:04.775 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:04.773+0000 7f1546d9d640 1 -- 172.21.15.40:0/143789132 learned_addr learned my addr 172.21.15.40:0/143789132 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-12-17T11:49:04.776 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:04.773+0000 7f154659c640 1 --2- 172.21.15.40:0/143789132 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1548143e00 0x7f15480b4040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:04.776 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:04.773+0000 7f154559a640 1 -- 172.21.15.40:0/143789132 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3544749200 0 0) 0x7f15480b3bb0 con 0x7f154806c410 2023-12-17T11:49:04.776 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:04.773+0000 7f154559a640 1 -- 172.21.15.40:0/143789132 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1534003520 con 0x7f154806c410 2023-12-17T11:49:04.776 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:04.773+0000 7f154559a640 1 -- 172.21.15.40:0/143789132 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 572330194 0 0) 0x7f1534003520 con 0x7f154806c410 2023-12-17T11:49:04.777 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:04.773+0000 7f154559a640 1 -- 172.21.15.40:0/143789132 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1548143e00 msgr2=0x7f15480b4040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:49:04.777 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:04.773+0000 7f154559a640 1 --2- 172.21.15.40:0/143789132 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1548143e00 0x7f15480b4040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:04.777 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:04.773+0000 7f154559a640 1 -- 172.21.15.40:0/143789132 >> v1:172.21.15.159:6789/0 conn(0x7f1548072180 legacy=0x7f15480b4580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:04.777 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:04.773+0000 7f154559a640 1 -- 172.21.15.40:0/143789132 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15480b1e30 con 0x7f154806c410 2023-12-17T11:49:04.777 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:04.773+0000 7f154559a640 1 -- 172.21.15.40:0/143789132 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2643242555 0 0) 0x7f1540001670 con 0x7f154806c410 2023-12-17T11:49:04.777 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:04.773+0000 7f154559a640 1 -- 172.21.15.40:0/143789132 >> v1:172.21.15.40:6789/0 conn(0x7f154806c410 legacy=0x7f154815ecb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:04.777 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:04.774+0000 7f154559a640 1 --2- 172.21.15.40:0/143789132 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f15340039a0 0x7f1534003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:04.777 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:04.774+0000 7f154559a640 1 --2- 172.21.15.40:0/143789132 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f15340047c0 0x7f1534004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:04.777 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:04.774+0000 7f154559a640 1 --2- 172.21.15.40:0/143789132 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1548143e00 0x7f1534005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:04.777 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:04.774+0000 7f154559a640 1 -- 172.21.15.40:0/143789132 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1548072680 con 0x7f15340047c0 2023-12-17T11:49:04.777 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:04.774+0000 7f154559a640 1 -- 172.21.15.40:0/143789132 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f153400ba30 con 0x7f15340039a0 2023-12-17T11:49:04.777 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:04.774+0000 7f154559a640 1 -- 172.21.15.40:0/143789132 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f153400bbf0 con 0x7f1548143e00 2023-12-17T11:49:04.777 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:04.774+0000 7f1545d9b640 1 --2- 172.21.15.40:0/143789132 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f15340047c0 0x7f1534004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:04.778 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:04.774+0000 7f154659c640 1 --2- 172.21.15.40:0/143789132 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f15340039a0 0x7f1534003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:04.778 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:04.774+0000 7f1545d9b640 1 -- 172.21.15.40:0/143789132 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1548143e00 msgr2=0x7f1534005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:49:04.778 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:04.774+0000 7f1546d9d640 1 --2- 172.21.15.40:0/143789132 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1548143e00 0x7f1534005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:04.778 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:04.774+0000 7f1545d9b640 1 --2- 172.21.15.40:0/143789132 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1548143e00 0x7f1534005180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:04.778 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:04.774+0000 7f1545d9b640 1 -- 172.21.15.40:0/143789132 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f15340039a0 msgr2=0x7f1534003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:49:04.778 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:04.774+0000 7f1545d9b640 1 --2- 172.21.15.40:0/143789132 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f15340039a0 0x7f1534003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:04.778 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:04.774+0000 7f1545d9b640 1 -- 172.21.15.40:0/143789132 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1534003520 con 0x7f15340047c0 2023-12-17T11:49:04.779 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:04.776+0000 7f1545d9b640 1 --2- 172.21.15.40:0/143789132 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f15340047c0 0x7f1534004c40 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f1530001720 tx=0x7f15340057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d70866e3751d7b4 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:49:04.779 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:04.776+0000 7f154559a640 1 -- 172.21.15.40:0/143789132 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15300052d0 con 0x7f15340047c0 2023-12-17T11:49:04.779 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:04.776+0000 7f154559a640 1 -- 172.21.15.40:0/143789132 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f153002e050 con 0x7f15340047c0 2023-12-17T11:49:04.779 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:04.776+0000 7f154559a640 1 -- 172.21.15.40:0/143789132 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15300035f0 con 0x7f15340047c0 2023-12-17T11:49:04.779 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:04.776+0000 7f154cc1e640 1 -- 172.21.15.40:0/143789132 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f15340047c0 msgr2=0x7f1534004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:04.779 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:04.776+0000 7f154cc1e640 1 --2- 172.21.15.40:0/143789132 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f15340047c0 0x7f1534004c40 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f1530001720 tx=0x7f15340057f0 comp rx=0 tx=0).stop 2023-12-17T11:49:04.779 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:04.776+0000 7f1546d9d640 1 -- 172.21.15.40:0/143789132 reap_dead start 2023-12-17T11:49:04.780 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:04.777+0000 7f154cc1e640 1 -- 172.21.15.40:0/143789132 shutdown_connections 2023-12-17T11:49:04.780 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:04.777+0000 7f154cc1e640 1 -- 172.21.15.40:0/143789132 >> 172.21.15.40:0/143789132 conn(0x7f15480b0a90 msgr2=0x7f15480b0e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:49:04.780 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:04.777+0000 7f154cc1e640 1 -- 172.21.15.40:0/143789132 shutdown_connections 2023-12-17T11:49:04.780 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:04.777+0000 7f154cc1e640 1 -- 172.21.15.40:0/143789132 wait complete. 2023-12-17T11:49:04.780 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:04.778+0000 7f154cc1e640 1 Processor -- start 2023-12-17T11:49:04.780 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:04.779+0000 7f154cc1e640 1 -- start start 2023-12-17T11:49:04.782 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:04.780+0000 7f154cc1e640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f15340047c0 0x7f154815ad10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:04.782 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:04.780+0000 7f154cc1e640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f154815c7e0 0x7f15480b0280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:04.782 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:04.780+0000 7f154cc1e640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f15480ccb00 0x7f154813c310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:04.782 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:04.780+0000 7f154cc1e640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f154815c3c0 con 0x7f15480ccb00 2023-12-17T11:49:04.782 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:04.780+0000 7f154cc1e640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f154815cc20 con 0x7f154815c7e0 2023-12-17T11:49:04.782 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:04.780+0000 7f154cc1e640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15480b07c0 con 0x7f15340047c0 2023-12-17T11:49:04.782 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:04.780+0000 7f1546d9d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f15480ccb00 0x7f154813c310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:04.782 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:04.780+0000 7f1546d9d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f15480ccb00 0x7f154813c310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:33952/0 (socket says 172.21.15.40:33952) 2023-12-17T11:49:04.782 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:04.780+0000 7f1546d9d640 1 -- 172.21.15.40:0/3414788855 learned_addr learned my addr 172.21.15.40:0/3414788855 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-17T11:49:04.783 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:04.780+0000 7f1545d9b640 1 --2- 172.21.15.40:0/3414788855 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f154815c7e0 0x7f15480b0280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:04.784 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:04.780+0000 7f1546d9d640 1 -- 172.21.15.40:0/3414788855 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f15340047c0 msgr2=0x7f154815ad10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:04.784 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:04.780+0000 7f1546d9d640 1 --2- 172.21.15.40:0/3414788855 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f15340047c0 0x7f154815ad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:04.784 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:04.780+0000 7f1546d9d640 1 -- 172.21.15.40:0/3414788855 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f154815c7e0 msgr2=0x7f15480b0280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:04.784 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:04.780+0000 7f1546d9d640 1 --2- 172.21.15.40:0/3414788855 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f154815c7e0 0x7f15480b0280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:04.784 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:04.780+0000 7f1546d9d640 1 -- 172.21.15.40:0/3414788855 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f154815b740 con 0x7f15480ccb00 2023-12-17T11:49:04.784 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:04.780+0000 7f1545d9b640 1 --2- 172.21.15.40:0/3414788855 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f154815c7e0 0x7f15480b0280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-17T11:49:04.784 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:04.781+0000 7f1546d9d640 1 --2- 172.21.15.40:0/3414788855 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f15480ccb00 0x7f154813c310 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f1548072b60 tx=0x7f154000d9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:49:04.784 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:04.781+0000 7f153effd640 1 -- 172.21.15.40:0/3414788855 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15400074e0 con 0x7f15480ccb00 2023-12-17T11:49:04.784 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:04.781+0000 7f153effd640 1 -- 172.21.15.40:0/3414788855 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1540007640 con 0x7f15480ccb00 2023-12-17T11:49:04.784 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:04.781+0000 7f153effd640 1 -- 172.21.15.40:0/3414788855 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1540004a20 con 0x7f15480ccb00 2023-12-17T11:49:04.784 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:04.781+0000 7f154cc1e640 1 -- 172.21.15.40:0/3414788855 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f154815ba20 con 0x7f15480ccb00 2023-12-17T11:49:04.784 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:04.781+0000 7f154cc1e640 1 -- 172.21.15.40:0/3414788855 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f154815bfe0 con 0x7f15480ccb00 2023-12-17T11:49:04.785 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:04.783+0000 7f154cc1e640 1 -- 172.21.15.40:0/3414788855 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f154815c500 con 0x7f15480ccb00 2023-12-17T11:49:04.785 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:04.783+0000 7f153effd640 1 -- 172.21.15.40:0/3414788855 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f1540004b80 con 0x7f15480ccb00 2023-12-17T11:49:04.786 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:04.784+0000 7f153effd640 1 --2- 172.21.15.40:0/3414788855 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f152806aec0 0x7f152806d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:04.786 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:04.784+0000 7f153effd640 1 -- 172.21.15.40:0/3414788855 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f1540089470 con 0x7f15480ccb00 2023-12-17T11:49:04.787 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:04.785+0000 7f154659c640 1 --2- 172.21.15.40:0/3414788855 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f152806aec0 0x7f152806d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:04.788 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:04.786+0000 7f154659c640 1 --2- 172.21.15.40:0/3414788855 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f152806aec0 0x7f152806d380 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f1538009fd0 tx=0x7f1538009750 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:49:04.791 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:04.789+0000 7f153effd640 1 -- 172.21.15.40:0/3414788855 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f154815c500 con 0x7f15480ccb00 2023-12-17T11:49:05.022 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:05.020+0000 7f154cc1e640 1 -- 172.21.15.40:0/3414788855 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f154815c500 con 0x7f15480ccb00 2023-12-17T11:49:05.023 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:05.021+0000 7f153effd640 1 -- 172.21.15.40:0/3414788855 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+88 (secure 0 0 0) 0x7f154815c500 con 0x7f15480ccb00 2023-12-17T11:49:05.023 INFO:teuthology.orchestra.run.smithi040.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-12-17T11:49:05.025 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:05.023+0000 7f154cc1e640 1 -- 172.21.15.40:0/3414788855 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f152806aec0 msgr2=0x7f152806d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:05.025 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:05.023+0000 7f154cc1e640 1 --2- 172.21.15.40:0/3414788855 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f152806aec0 0x7f152806d380 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f1538009fd0 tx=0x7f1538009750 comp rx=0 tx=0).stop 2023-12-17T11:49:05.026 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:05.023+0000 7f154cc1e640 1 -- 172.21.15.40:0/3414788855 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f15480ccb00 msgr2=0x7f154813c310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:05.026 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:05.023+0000 7f154cc1e640 1 --2- 172.21.15.40:0/3414788855 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f15480ccb00 0x7f154813c310 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f1548072b60 tx=0x7f154000d9d0 comp rx=0 tx=0).stop 2023-12-17T11:49:05.026 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:05.023+0000 7f154cc1e640 1 -- 172.21.15.40:0/3414788855 shutdown_connections 2023-12-17T11:49:05.026 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:05.024+0000 7f154cc1e640 1 --2- 172.21.15.40:0/3414788855 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f152806aec0 0x7f152806d380 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:05.026 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:05.024+0000 7f154cc1e640 1 --2- 172.21.15.40:0/3414788855 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f15480ccb00 0x7f154813c310 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:05.026 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:05.024+0000 7f154cc1e640 1 --2- 172.21.15.40:0/3414788855 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f154815c7e0 0x7f15480b0280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:05.026 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:05.024+0000 7f154cc1e640 1 --2- 172.21.15.40:0/3414788855 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f15340047c0 0x7f154815ad10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:05.026 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:05.024+0000 7f154cc1e640 1 -- 172.21.15.40:0/3414788855 >> 172.21.15.40:0/3414788855 conn(0x7f15480b0a90 msgr2=0x7f1548070fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:49:05.026 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:05.024+0000 7f154cc1e640 1 -- 172.21.15.40:0/3414788855 shutdown_connections 2023-12-17T11:49:05.026 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:05.024+0000 7f154cc1e640 1 -- 172.21.15.40:0/3414788855 wait complete. 2023-12-17T11:49:05.045 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-12-17T11:49:05.049 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-17T11:49:05.049 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi159.front.sepia.ceph.com 2023-12-17T11:49:05.049 INFO:tasks.cephfs.mount:self.client.name = client.3 2023-12-17T11:49:05.049 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2023-12-17T11:49:05.049 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-12-17T11:49:05.050 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-12-17T11:49:05.050 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-12-17T11:49:05.050 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.3' 2023-12-17T11:49:05.050 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-17T11:49:05.050 DEBUG:teuthology.orchestra.run.smithi159:> ip addr 2023-12-17T11:49:05.114 INFO:teuthology.orchestra.run.smithi159.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-17T11:49:05.114 INFO:teuthology.orchestra.run.smithi159.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-17T11:49:05.114 INFO:teuthology.orchestra.run.smithi159.stdout: inet 127.0.0.1/8 scope host lo 2023-12-17T11:49:05.115 INFO:teuthology.orchestra.run.smithi159.stdout: valid_lft forever preferred_lft forever 2023-12-17T11:49:05.115 INFO:teuthology.orchestra.run.smithi159.stdout: inet6 ::1/128 scope host 2023-12-17T11:49:05.115 INFO:teuthology.orchestra.run.smithi159.stdout: valid_lft forever preferred_lft forever 2023-12-17T11:49:05.115 INFO:teuthology.orchestra.run.smithi159.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-17T11:49:05.115 INFO:teuthology.orchestra.run.smithi159.stdout: link/ether 0c:c4:7a:d9:d8:c6 brd ff:ff:ff:ff:ff:ff 2023-12-17T11:49:05.115 INFO:teuthology.orchestra.run.smithi159.stdout: altname enp7s0f0 2023-12-17T11:49:05.115 INFO:teuthology.orchestra.run.smithi159.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-17T11:49:05.115 INFO:teuthology.orchestra.run.smithi159.stdout: link/ether 0c:c4:7a:d9:d8:c7 brd ff:ff:ff:ff:ff:ff 2023-12-17T11:49:05.115 INFO:teuthology.orchestra.run.smithi159.stdout: altname enp7s0f1 2023-12-17T11:49:05.115 INFO:teuthology.orchestra.run.smithi159.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-17T11:49:05.115 INFO:teuthology.orchestra.run.smithi159.stdout: link/ether 0c:c4:7a:88:72:4e brd ff:ff:ff:ff:ff:ff 2023-12-17T11:49:05.115 INFO:teuthology.orchestra.run.smithi159.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-17T11:49:05.115 INFO:teuthology.orchestra.run.smithi159.stdout: link/ether 0c:c4:7a:88:72:4f brd ff:ff:ff:ff:ff:ff 2023-12-17T11:49:05.115 INFO:teuthology.orchestra.run.smithi159.stdout: inet 172.21.15.159/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-12-17T11:49:05.116 INFO:teuthology.orchestra.run.smithi159.stdout: valid_lft 42318sec preferred_lft 42318sec 2023-12-17T11:49:05.116 INFO:teuthology.orchestra.run.smithi159.stdout: inet6 fe80::ec4:7aff:fe88:724f/64 scope link 2023-12-17T11:49:05.116 INFO:teuthology.orchestra.run.smithi159.stdout: valid_lft forever preferred_lft forever 2023-12-17T11:49:05.116 INFO:teuthology.orchestra.run.smithi159.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-12-17T11:49:05.116 INFO:teuthology.orchestra.run.smithi159.stdout: link/ether 56:6d:1d:75:e9:51 brd ff:ff:ff:ff:ff:ff 2023-12-17T11:49:05.116 INFO:teuthology.orchestra.run.smithi159.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-12-17T11:49:05.116 INFO:teuthology.orchestra.run.smithi159.stdout: valid_lft forever preferred_lft forever 2023-12-17T11:49:05.116 INFO:teuthology.orchestra.run.smithi159.stdout: inet6 fe80::c8df:15ff:fe11:4673/64 scope link 2023-12-17T11:49:05.116 INFO:teuthology.orchestra.run.smithi159.stdout: valid_lft forever preferred_lft forever 2023-12-17T11:49:05.116 INFO:teuthology.orchestra.run.smithi159.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-17T11:49:05.116 INFO:teuthology.orchestra.run.smithi159.stdout: link/ether 56:6d:1d:75:e9:51 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-12-17T11:49:05.116 INFO:teuthology.orchestra.run.smithi159.stdout: inet6 fe80::546d:1dff:fe75:e951/64 scope link tentative 2023-12-17T11:49:05.116 INFO:teuthology.orchestra.run.smithi159.stdout: valid_lft forever preferred_lft forever 2023-12-17T11:49:05.117 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-17T11:49:05.117 DEBUG:teuthology.orchestra.run.smithi159:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-17T11:49:05.211 INFO:teuthology.orchestra.run.smithi159.stdout:1 2023-12-17T11:49:05.215 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-17T11:49:05.215 DEBUG:teuthology.orchestra.run.smithi159:> route 2023-12-17T11:49:05.270 INFO:teuthology.orchestra.run.smithi159.stdout:Kernel IP routing table 2023-12-17T11:49:05.271 INFO:teuthology.orchestra.run.smithi159.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-17T11:49:05.271 INFO:teuthology.orchestra.run.smithi159.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-12-17T11:49:05.271 INFO:teuthology.orchestra.run.smithi159.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-12-17T11:49:05.271 INFO:teuthology.orchestra.run.smithi159.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-17T11:49:05.271 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-17T11:49:05.271 DEBUG:teuthology.orchestra.run.smithi159:> (cd / && exec bash -c ' 2023-12-17T11:49:05.271 DEBUG:teuthology.orchestra.run.smithi159:> set -e 2023-12-17T11:49:05.271 DEBUG:teuthology.orchestra.run.smithi159:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-12-17T11:49:05.271 DEBUG:teuthology.orchestra.run.smithi159:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-12-17T11:49:05.271 DEBUG:teuthology.orchestra.run.smithi159:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-12-17T11:49:05.271 DEBUG:teuthology.orchestra.run.smithi159:> ') 2023-12-17T11:49:05.455 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-17T11:49:05.455 DEBUG:teuthology.orchestra.run.smithi159:> ip netns list 2023-12-17T11:49:05.507 INFO:teuthology.orchestra.run.smithi159.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-12-17T11:49:05.508 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-17T11:49:05.508 DEBUG:teuthology.orchestra.run.smithi159:> ip netns list-id 2023-12-17T11:49:05.558 INFO:teuthology.orchestra.run.smithi159.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2023-12-17T11:49:05.559 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-17T11:49:05.559 DEBUG:teuthology.orchestra.run.smithi159:> (cd / && exec bash -c ' 2023-12-17T11:49:05.559 DEBUG:teuthology.orchestra.run.smithi159:> set -e 2023-12-17T11:49:05.560 DEBUG:teuthology.orchestra.run.smithi159:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.3 2023-12-17T11:49:05.560 DEBUG:teuthology.orchestra.run.smithi159:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.3 1 2023-12-17T11:49:05.560 DEBUG:teuthology.orchestra.run.smithi159:> ') 2023-12-17T11:49:05.702 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-17T11:49:05.703 DEBUG:teuthology.orchestra.run.smithi159:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2023-12-17T11:49:05.787 INFO:teuthology.orchestra.run.smithi159.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-17T11:49:05.787 INFO:teuthology.orchestra.run.smithi159.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-17T11:49:05.787 INFO:teuthology.orchestra.run.smithi159.stdout: inet 127.0.0.1/8 scope host lo 2023-12-17T11:49:05.787 INFO:teuthology.orchestra.run.smithi159.stdout: valid_lft forever preferred_lft forever 2023-12-17T11:49:05.787 INFO:teuthology.orchestra.run.smithi159.stdout: inet6 ::1/128 scope host 2023-12-17T11:49:05.787 INFO:teuthology.orchestra.run.smithi159.stdout: valid_lft forever preferred_lft forever 2023-12-17T11:49:05.787 INFO:teuthology.orchestra.run.smithi159.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-12-17T11:49:05.788 INFO:teuthology.orchestra.run.smithi159.stdout: link/ether 62:23:9b:3a:67:52 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-12-17T11:49:05.788 INFO:teuthology.orchestra.run.smithi159.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-12-17T11:49:05.788 INFO:teuthology.orchestra.run.smithi159.stdout: valid_lft forever preferred_lft forever 2023-12-17T11:49:05.788 INFO:teuthology.orchestra.run.smithi159.stdout: inet6 fe80::6023:9bff:fe3a:6752/64 scope link 2023-12-17T11:49:05.788 INFO:teuthology.orchestra.run.smithi159.stdout: valid_lft forever preferred_lft forever 2023-12-17T11:49:05.790 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-17T11:49:05.791 DEBUG:teuthology.orchestra.run.smithi159:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2023-12-17T11:49:05.879 INFO:teuthology.orchestra.run.smithi159.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-17T11:49:05.880 INFO:teuthology.orchestra.run.smithi159.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-17T11:49:05.880 INFO:teuthology.orchestra.run.smithi159.stdout: inet 127.0.0.1/8 scope host lo 2023-12-17T11:49:05.880 INFO:teuthology.orchestra.run.smithi159.stdout: valid_lft forever preferred_lft forever 2023-12-17T11:49:05.880 INFO:teuthology.orchestra.run.smithi159.stdout: inet6 ::1/128 scope host 2023-12-17T11:49:05.880 INFO:teuthology.orchestra.run.smithi159.stdout: valid_lft forever preferred_lft forever 2023-12-17T11:49:05.880 INFO:teuthology.orchestra.run.smithi159.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-12-17T11:49:05.880 INFO:teuthology.orchestra.run.smithi159.stdout: link/ether 62:23:9b:3a:67:52 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-12-17T11:49:05.880 INFO:teuthology.orchestra.run.smithi159.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-12-17T11:49:05.880 INFO:teuthology.orchestra.run.smithi159.stdout: valid_lft forever preferred_lft forever 2023-12-17T11:49:05.880 INFO:teuthology.orchestra.run.smithi159.stdout: inet6 fe80::6023:9bff:fe3a:6752/64 scope link 2023-12-17T11:49:05.880 INFO:teuthology.orchestra.run.smithi159.stdout: valid_lft forever preferred_lft forever 2023-12-17T11:49:05.882 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.3' with 192.168.0.2/16 2023-12-17T11:49:05.883 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-17T11:49:05.883 DEBUG:teuthology.orchestra.run.smithi159:> (cd / && exec bash -c ' 2023-12-17T11:49:05.883 DEBUG:teuthology.orchestra.run.smithi159:> set -e 2023-12-17T11:49:05.883 DEBUG:teuthology.orchestra.run.smithi159:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.3 type veth peer name brx.1 2023-12-17T11:49:05.883 DEBUG:teuthology.orchestra.run.smithi159:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2023-12-17T11:49:05.883 DEBUG:teuthology.orchestra.run.smithi159:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set veth0 up 2023-12-17T11:49:05.883 DEBUG:teuthology.orchestra.run.smithi159:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set lo up 2023-12-17T11:49:05.883 DEBUG:teuthology.orchestra.run.smithi159:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip route add default via 192.168.255.254 2023-12-17T11:49:05.883 DEBUG:teuthology.orchestra.run.smithi159:> ') 2023-12-17T11:49:06.152 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-17T11:49:06.153 DEBUG:teuthology.orchestra.run.smithi159:> (cd / && exec bash -c ' 2023-12-17T11:49:06.153 DEBUG:teuthology.orchestra.run.smithi159:> set -e 2023-12-17T11:49:06.153 DEBUG:teuthology.orchestra.run.smithi159:> sudo ip link set brx.1 up 2023-12-17T11:49:06.153 DEBUG:teuthology.orchestra.run.smithi159:> sudo ip link set dev brx.1 master ceph-brx 2023-12-17T11:49:06.153 DEBUG:teuthology.orchestra.run.smithi159:> ') 2023-12-17T11:49:06.325 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-17T11:49:06.325 DEBUG:teuthology.orchestra.run.smithi159:> mkdir -p -v /home/ubuntu/cephtest/mnt.3 2023-12-17T11:49:06.374 INFO:teuthology.orchestra.run.smithi159.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.3' 2023-12-17T11:49:06.374 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-17T11:49:06.374 DEBUG:teuthology.orchestra.run.smithi159:> chmod 0000 /home/ubuntu/cephtest/mnt.3 2023-12-17T11:49:06.423 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-12-17T11:49:06.423 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-17T11:49:06.423 DEBUG:teuthology.orchestra.run.smithi159:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.3 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2023-12-17T11:49:06.563 INFO:teuthology.orchestra.run.smithi159.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2023-12-17T11:49:06.563 INFO:teuthology.orchestra.run.smithi159.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs". 2023-12-17T11:49:06.563 INFO:teuthology.orchestra.run.smithi159.stdout:invalid new device string format 2023-12-17T11:49:06.584 INFO:teuthology.orchestra.run.smithi159.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2023-12-17T11:49:06.585 INFO:teuthology.orchestra.run.smithi159.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs". 2023-12-17T11:49:06.585 INFO:teuthology.orchestra.run.smithi159.stdout:invalid new device string format 2023-12-17T11:49:06.585 INFO:teuthology.orchestra.run.smithi159.stdout:mount.ceph: resolved to: "172.21.15.40:3300,172.21.15.159:3300,172.21.15.159:3301" 2023-12-17T11:49:06.585 INFO:teuthology.orchestra.run.smithi159.stdout:mount.ceph: switching to using v1 address with old syntax 2023-12-17T11:49:06.611 INFO:teuthology.orchestra.run.smithi159.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2023-12-17T11:49:06.611 INFO:teuthology.orchestra.run.smithi159.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs". 2023-12-17T11:49:06.611 INFO:teuthology.orchestra.run.smithi159.stdout:invalid new device string format 2023-12-17T11:49:06.611 INFO:teuthology.orchestra.run.smithi159.stdout:mount.ceph: resolved to: "172.21.15.40:3300,172.21.15.159:3300,172.21.15.159:3301" 2023-12-17T11:49:06.612 INFO:teuthology.orchestra.run.smithi159.stdout:mount.ceph: switching to using v1 address with old syntax 2023-12-17T11:49:06.612 INFO:teuthology.orchestra.run.smithi159.stdout:mount.ceph: resolved to: "172.21.15.40:6789,172.21.15.159:6789,172.21.15.159:6790" 2023-12-17T11:49:06.612 INFO:teuthology.orchestra.run.smithi159.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.40:6789,172.21.15.159:6789,172.21.15.159:6790:/ 2023-12-17T11:49:06.612 INFO:teuthology.orchestra.run.smithi159.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs,key=3,fsid=099cd35d-80d9-4ca4-8424-de13b3b03ac7" will pass to kernel 2023-12-17T11:49:06.614 INFO:teuthology.orchestra.run.smithi159.stdout:mount: /home/ubuntu/cephtest/mnt.3 does not contain SELinux labels. 2023-12-17T11:49:06.614 INFO:teuthology.orchestra.run.smithi159.stdout: You just mounted a file system that supports labels which does not 2023-12-17T11:49:06.614 INFO:teuthology.orchestra.run.smithi159.stdout: contain labels, onto an SELinux box. It is likely that confined 2023-12-17T11:49:06.614 INFO:teuthology.orchestra.run.smithi159.stdout: applications will generate AVC messages and not be allowed access to 2023-12-17T11:49:06.614 INFO:teuthology.orchestra.run.smithi159.stdout: this file system. For more details see restorecon(8) and mount(8). 2023-12-17T11:49:06.619 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-12-17T11:49:06.620 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-17T11:49:06.620 DEBUG:teuthology.orchestra.run.smithi159:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.3 2023-12-17T11:49:06.712 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-17T11:49:06.712 DEBUG:teuthology.orchestra.run.smithi159:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-17T11:49:06.767 INFO:teuthology.orchestra.run.smithi159.stdout:client4633 2023-12-17T11:49:06.768 DEBUG:teuthology.orchestra.run.smithi159:> set -ex 2023-12-17T11:49:06.768 DEBUG:teuthology.orchestra.run.smithi159:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-17T11:49:06.821 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-17T11:49:06.822 DEBUG:teuthology.orchestra.run.smithi159:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-17T11:49:06.874 INFO:teuthology.orchestra.run.smithi159.stdout:client4633 2023-12-17T11:49:06.874 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-17T11:49:06.874 DEBUG:teuthology.orchestra.run.smithi159:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-17T11:49:06.928 INFO:teuthology.orchestra.run.smithi159.stdout:client4633 2023-12-17T11:49:06.928 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-17T11:49:06.928 DEBUG:teuthology.orchestra.run.smithi159:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/099cd35d-80d9-4ca4-8424-de13b3b03ac7.client4633/status') 2023-12-17T11:49:07.015 INFO:teuthology.orchestra.run.smithi159.stdout:instance: client.4633 (3)192.168.0.2:0/3102428961 2023-12-17T11:49:07.015 INFO:teuthology.orchestra.run.smithi159.stdout:blocklisted: false 2023-12-17T11:49:07.016 INFO:teuthology.orchestra.run.smithi159.stderr:0+1 records in 2023-12-17T11:49:07.016 INFO:teuthology.orchestra.run.smithi159.stderr:0+1 records out 2023-12-17T11:49:07.016 INFO:teuthology.orchestra.run.smithi159.stderr:69 bytes copied, 7.3108e-05 s, 944 kB/s 2023-12-17T11:49:07.019 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2023-12-17T11:49:07.035 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-17T11:49:07.150 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T11:49:07.158 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T11:49:07.270 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:07.268+0000 7f81147ec640 1 Processor -- start 2023-12-17T11:49:07.270 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:07.268+0000 7f81147ec640 1 -- start start 2023-12-17T11:49:07.272 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:07.270+0000 7f81147ec640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f810c1609b0 0x7f810c0d0ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:07.272 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:07.270+0000 7f81147ec640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f810c0d1220 0x7f810c0cfb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:07.272 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:07.270+0000 7f81147ec640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f810c15dd60 con 0x7f810c0d0060 2023-12-17T11:49:07.272 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:07.270+0000 7f81147ec640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f810c0d04f0 con 0x7f810c1609b0 2023-12-17T11:49:07.272 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:07.270+0000 7f81147ec640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f810c160d90 con 0x7f810c0d1220 2023-12-17T11:49:07.273 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:07.270+0000 7f8111d87640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f810c0d1220 0x7f810c0cfb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:07.273 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:07.270+0000 7f8111d87640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f810c0d1220 0x7f810c0cfb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3301/0 says I am v2:172.21.15.40:47800/0 (socket says 172.21.15.40:47800) 2023-12-17T11:49:07.273 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:07.270+0000 7f8111d87640 1 -- 172.21.15.40:0/1174104291 learned_addr learned my addr 172.21.15.40:0/1174104291 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-17T11:49:07.273 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:07.270+0000 7f8112588640 1 --2- 172.21.15.40:0/1174104291 >> v2:172.21.15.159:3300/0 conn(0x7f810c1609b0 0x7f810c0d0ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:07.273 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:07.271+0000 7f8111d87640 1 -- 172.21.15.40:0/1174104291 >> v2:172.21.15.159:3300/0 conn(0x7f810c1609b0 msgr2=0x7f810c0d0ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:49:07.273 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:07.271+0000 7f8111d87640 1 --2- 172.21.15.40:0/1174104291 >> v2:172.21.15.159:3300/0 conn(0x7f810c1609b0 0x7f810c0d0ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:07.273 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:07.271+0000 7f8111d87640 1 -- 172.21.15.40:0/1174104291 >> v1:172.21.15.159:6789/0 conn(0x7f810c0d0060 legacy=0x7f810c15cd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:49:07.273 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:07.271+0000 7f8111d87640 1 -- 172.21.15.40:0/1174104291 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f810c15e040 con 0x7f810c0d1220 2023-12-17T11:49:07.274 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:07.271+0000 7f8112588640 1 --2- 172.21.15.40:0/1174104291 >> v2:172.21.15.159:3300/0 conn(0x7f810c1609b0 0x7f810c0d0ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-17T11:49:07.274 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:07.272+0000 7f8111d87640 1 --2- 172.21.15.40:0/1174104291 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f810c0d1220 0x7f810c0cfb20 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f80fc009870 tx=0x7f80fc02b8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5afb3fd8de4de3a6 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:49:07.275 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:07.273+0000 7f8111586640 1 -- 172.21.15.40:0/1174104291 <== mon.2 v2:172.21.15.159:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80fc031640 con 0x7f810c0d1220 2023-12-17T11:49:07.275 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:07.273+0000 7f8111586640 1 -- 172.21.15.40:0/1174104291 <== mon.2 v2:172.21.15.159:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80fc0317a0 con 0x7f810c0d1220 2023-12-17T11:49:07.275 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:07.273+0000 7f8111586640 1 -- 172.21.15.40:0/1174104291 <== mon.2 v2:172.21.15.159:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80fc031b30 con 0x7f810c0d1220 2023-12-17T11:49:07.276 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:07.274+0000 7f81147ec640 1 -- 172.21.15.40:0/1174104291 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f810c0d1220 msgr2=0x7f810c0cfb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:07.276 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:07.274+0000 7f81147ec640 1 --2- 172.21.15.40:0/1174104291 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f810c0d1220 0x7f810c0cfb20 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f80fc009870 tx=0x7f80fc02b8f0 comp rx=0 tx=0).stop 2023-12-17T11:49:07.276 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:07.274+0000 7f81147ec640 1 -- 172.21.15.40:0/1174104291 shutdown_connections 2023-12-17T11:49:07.276 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:07.274+0000 7f81147ec640 1 --2- 172.21.15.40:0/1174104291 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f810c0d1220 0x7f810c0cfb20 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:07.276 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:07.274+0000 7f81147ec640 1 --2- 172.21.15.40:0/1174104291 >> v2:172.21.15.159:3300/0 conn(0x7f810c1609b0 0x7f810c0d0ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:07.276 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:07.274+0000 7f81147ec640 1 -- 172.21.15.40:0/1174104291 >> 172.21.15.40:0/1174104291 conn(0x7f810c09c450 msgr2=0x7f810c0d3110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:49:07.276 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:07.274+0000 7f81147ec640 1 -- 172.21.15.40:0/1174104291 shutdown_connections 2023-12-17T11:49:07.276 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:07.274+0000 7f81147ec640 1 -- 172.21.15.40:0/1174104291 wait complete. 2023-12-17T11:49:07.278 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:07.277+0000 7f81147ec640 1 Processor -- start 2023-12-17T11:49:07.279 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:07.277+0000 7f81147ec640 1 -- start start 2023-12-17T11:49:07.281 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:07.278+0000 7f81147ec640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f810c0d0060 0x7f810c0caba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:07.281 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:07.279+0000 7f81147ec640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f810c0d1220 0x7f810c0b8590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:07.281 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:07.279+0000 7f81147ec640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f810c1609b0 0x7f810c14a3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:07.281 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:07.279+0000 7f81147ec640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f810c0c6af0 con 0x7f810c1609b0 2023-12-17T11:49:07.281 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:07.279+0000 7f81147ec640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f810c0cb1d0 con 0x7f810c0d1220 2023-12-17T11:49:07.282 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:07.279+0000 7f81147ec640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f810c0cb4b0 con 0x7f810c0d0060 2023-12-17T11:49:07.282 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:07.279+0000 7f8112d89640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f810c1609b0 0x7f810c14a3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:07.282 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:07.279+0000 7f8112d89640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f810c1609b0 0x7f810c14a3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:41224/0 (socket says 172.21.15.40:41224) 2023-12-17T11:49:07.282 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:07.279+0000 7f8112d89640 1 -- 172.21.15.40:0/1150133893 learned_addr learned my addr 172.21.15.40:0/1150133893 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-17T11:49:07.282 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:07.279+0000 7f8112588640 1 --2- 172.21.15.40:0/1150133893 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f810c0d0060 0x7f810c0caba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:07.282 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:07.279+0000 7f8111d87640 1 --2- 172.21.15.40:0/1150133893 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f810c0d1220 0x7f810c0b8590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:07.283 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:07.280+0000 7f8112d89640 1 -- 172.21.15.40:0/1150133893 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f810c0d0060 msgr2=0x7f810c0caba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:07.283 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:07.280+0000 7f8112d89640 1 --2- 172.21.15.40:0/1150133893 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f810c0d0060 0x7f810c0caba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:07.284 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:07.280+0000 7f8112d89640 1 -- 172.21.15.40:0/1150133893 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f810c0d1220 msgr2=0x7f810c0b8590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:07.284 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:07.280+0000 7f8112d89640 1 --2- 172.21.15.40:0/1150133893 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f810c0d1220 0x7f810c0b8590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:07.284 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:07.280+0000 7f8112d89640 1 -- 172.21.15.40:0/1150133893 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80fc0094d0 con 0x7f810c1609b0 2023-12-17T11:49:07.284 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:07.280+0000 7f8112588640 1 --2- 172.21.15.40:0/1150133893 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f810c0d0060 0x7f810c0caba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-17T11:49:07.284 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:07.280+0000 7f8112d89640 1 --2- 172.21.15.40:0/1150133893 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f810c1609b0 0x7f810c14a3f0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f810400b410 tx=0x7f810400b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:49:07.284 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:07.280+0000 7f8102ffd640 1 -- 172.21.15.40:0/1150133893 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8104004020 con 0x7f810c1609b0 2023-12-17T11:49:07.284 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:07.280+0000 7f8102ffd640 1 -- 172.21.15.40:0/1150133893 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8104004180 con 0x7f810c1609b0 2023-12-17T11:49:07.284 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:07.280+0000 7f8102ffd640 1 -- 172.21.15.40:0/1150133893 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8104011630 con 0x7f810c1609b0 2023-12-17T11:49:07.284 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:07.280+0000 7f81147ec640 1 -- 172.21.15.40:0/1150133893 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f810c0cb790 con 0x7f810c1609b0 2023-12-17T11:49:07.284 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:07.281+0000 7f81147ec640 1 -- 172.21.15.40:0/1150133893 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f810c0cbd50 con 0x7f810c1609b0 2023-12-17T11:49:07.285 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:07.282+0000 7f81147ec640 1 -- 172.21.15.40:0/1150133893 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f810c0b8b90 con 0x7f810c1609b0 2023-12-17T11:49:07.285 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:07.283+0000 7f8102ffd640 1 -- 172.21.15.40:0/1150133893 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f8104011790 con 0x7f810c1609b0 2023-12-17T11:49:07.286 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:07.284+0000 7f8102ffd640 1 --2- 172.21.15.40:0/1150133893 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f80f006ae40 0x7f80f006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:07.286 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:07.284+0000 7f8102ffd640 1 -- 172.21.15.40:0/1150133893 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f81040895b0 con 0x7f810c1609b0 2023-12-17T11:49:07.286 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:07.285+0000 7f8112588640 1 --2- 172.21.15.40:0/1150133893 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f80f006ae40 0x7f80f006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:07.288 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:07.286+0000 7f8112588640 1 --2- 172.21.15.40:0/1150133893 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f80f006ae40 0x7f80f006d300 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f8108003f00 tx=0x7f8108009890 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:49:07.290 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:07.288+0000 7f8102ffd640 1 -- 172.21.15.40:0/1150133893 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f8104054330 con 0x7f810c1609b0 2023-12-17T11:49:07.486 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:07.484+0000 7f81147ec640 1 -- 172.21.15.40:0/1150133893 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f810c0d2480 con 0x7f810c1609b0 2023-12-17T11:49:07.488 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:07.486+0000 7f8102ffd640 1 -- 172.21.15.40:0/1150133893 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+18697 (secure 0 0 0) 0x7f8104057950 con 0x7f810c1609b0 2023-12-17T11:49:07.489 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T11:49:07.489 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":27,"fsid":"099cd35d-80d9-4ca4-8424-de13b3b03ac7","created":"2023-12-17T11:47:53.450097+0000","modified":"2023-12-17T11:49:00.483840+0000","last_up_change":"2023-12-17T11:48:05.724195+0000","last_in_change":"2023-12-17T11:47:56.956499+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-17T11:48:06.668943+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-17T11:48:16.151444+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-17T11:48:16.717726+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-17T11:48:20.534819+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a88bfd46-63b8-48b1-9c0e-5c9cdc31bd38","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":555204741},{"type":"v1","addr":"172.21.15.40:6802","nonce":555204741}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":555204741},{"type":"v1","addr":"172.21.15.40:6807","nonce":555204741}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":555204741},{"type":"v1","addr":"172.21.15.40:6815","nonce":555204741}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6809","nonce":555204741},{"type":"v1","addr":"172.21.15.40:6812","nonce":555204741}]},"public_addr":"172.21.15.40:6802/555204741","cluster_addr":"172.21.15.40:6807/555204741","heartbeat_back_addr":"172.21.15.40:6815/555204741","heartbeat_front_addr":"172.21.15.40:6812/555204741","state":["exists","up"]},{"osd":1,"uuid":"c5d628ae-36f4-4866-802c-b162f0e90add","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6801","nonce":1221318112},{"type":"v1","addr":"172.21.15.40:6803","nonce":1221318112}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6805","nonce":1221318112},{"type":"v1","addr":"172.21.15.40:6806","nonce":1221318112}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6811","nonce":1221318112},{"type":"v1","addr":"172.21.15.40:6813","nonce":1221318112}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":1221318112},{"type":"v1","addr":"172.21.15.40:6810","nonce":1221318112}]},"public_addr":"172.21.15.40:6803/1221318112","cluster_addr":"172.21.15.40:6806/1221318112","heartbeat_back_addr":"172.21.15.40:6813/1221318112","heartbeat_front_addr":"172.21.15.40:6810/1221318112","state":["exists","up"]},{"osd":2,"uuid":"d986ad6a-af2f-47fc-9c3b-fbda27b82b73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":1959000265},{"type":"v1","addr":"172.21.15.40:6817","nonce":1959000265}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6818","nonce":1959000265},{"type":"v1","addr":"172.21.15.40:6819","nonce":1959000265}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":1959000265},{"type":"v1","addr":"172.21.15.40:6827","nonce":1959000265}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":1959000265},{"type":"v1","addr":"172.21.15.40:6822","nonce":1959000265}]},"public_addr":"172.21.15.40:6817/1959000265","cluster_addr":"172.21.15.40:6819/1959000265","heartbeat_back_addr":"172.21.15.40:6827/1959000265","heartbeat_front_addr":"172.21.15.40:6822/1959000265","state":["exists","up"]},{"osd":3,"uuid":"d79d22b7-be05-41b2-b95d-697db677fd02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6821","nonce":974040287},{"type":"v1","addr":"172.21.15.40:6823","nonce":974040287}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6825","nonce":974040287},{"type":"v1","addr":"172.21.15.40:6826","nonce":974040287}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":974040287},{"type":"v1","addr":"172.21.15.40:6831","nonce":974040287}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":974040287},{"type":"v1","addr":"172.21.15.40:6829","nonce":974040287}]},"public_addr":"172.21.15.40:6823/974040287","cluster_addr":"172.21.15.40:6826/974040287","heartbeat_back_addr":"172.21.15.40:6831/974040287","heartbeat_front_addr":"172.21.15.40:6829/974040287","state":["exists","up"]},{"osd":4,"uuid":"62a7a233-d3ea-40be-91de-180c0208d639","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6808","nonce":3937787733},{"type":"v1","addr":"172.21.15.159:6809","nonce":3937787733}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6810","nonce":3937787733},{"type":"v1","addr":"172.21.15.159:6811","nonce":3937787733}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6814","nonce":3937787733},{"type":"v1","addr":"172.21.15.159:6815","nonce":3937787733}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6812","nonce":3937787733},{"type":"v1","addr":"172.21.15.159:6813","nonce":3937787733}]},"public_addr":"172.21.15.159:6809/3937787733","cluster_addr":"172.21.15.159:6811/3937787733","heartbeat_back_addr":"172.21.15.159:6815/3937787733","heartbeat_front_addr":"172.21.15.159:6813/3937787733","state":["exists","up"]},{"osd":5,"uuid":"84629cea-dc0e-4b5e-b203-5ea963839281","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6816","nonce":3032505240},{"type":"v1","addr":"172.21.15.159:6817","nonce":3032505240}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6818","nonce":3032505240},{"type":"v1","addr":"172.21.15.159:6819","nonce":3032505240}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6822","nonce":3032505240},{"type":"v1","addr":"172.21.15.159:6823","nonce":3032505240}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6820","nonce":3032505240},{"type":"v1","addr":"172.21.15.159:6821","nonce":3032505240}]},"public_addr":"172.21.15.159:6817/3032505240","cluster_addr":"172.21.15.159:6819/3032505240","heartbeat_back_addr":"172.21.15.159:6823/3032505240","heartbeat_front_addr":"172.21.15.159:6821/3032505240","state":["exists","up"]},{"osd":6,"uuid":"4ae3af3a-1743-4070-a91d-8be5c31cdb04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6800","nonce":2411788597},{"type":"v1","addr":"172.21.15.159:6801","nonce":2411788597}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6802","nonce":2411788597},{"type":"v1","addr":"172.21.15.159:6803","nonce":2411788597}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6806","nonce":2411788597},{"type":"v1","addr":"172.21.15.159:6807","nonce":2411788597}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6804","nonce":2411788597},{"type":"v1","addr":"172.21.15.159:6805","nonce":2411788597}]},"public_addr":"172.21.15.159:6801/2411788597","cluster_addr":"172.21.15.159:6803/2411788597","heartbeat_back_addr":"172.21.15.159:6807/2411788597","heartbeat_front_addr":"172.21.15.159:6805/2411788597","state":["exists","up"]},{"osd":7,"uuid":"c1f4c7f2-8f75-4f95-bc63-a332773e3b8e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6824","nonce":478953349},{"type":"v1","addr":"172.21.15.159:6825","nonce":478953349}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6826","nonce":478953349},{"type":"v1","addr":"172.21.15.159:6827","nonce":478953349}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6830","nonce":478953349},{"type":"v1","addr":"172.21.15.159:6831","nonce":478953349}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6828","nonce":478953349},{"type":"v1","addr":"172.21.15.159:6829","nonce":478953349}]},"public_addr":"172.21.15.159:6825/478953349","cluster_addr":"172.21.15.159:6827/478953349","heartbeat_back_addr":"172.21.15.159:6831/478953349","heartbeat_front_addr":"172.21.15.159:6829/478953349","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T11:48:02.023567+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T11:48:02.278216+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T11:48:02.311843+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T11:48:01.773372+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T11:48:02.618910+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T11:48:02.361559+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T11:48:02.223997+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T11:48:02.604403+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.2","mappings":[{"from":3,"to":2}]},{"pgid":"3.d","mappings":[{"from":5,"to":1}]},{"pgid":"3.13","mappings":[{"from":7,"to":2}]},{"pgid":"3.17","mappings":[{"from":0,"to":2}]},{"pgid":"3.38","mappings":[{"from":5,"to":1}]},{"pgid":"4.2","mappings":[{"from":1,"to":2}]},{"pgid":"4.10","mappings":[{"from":1,"to":2}]},{"pgid":"4.18","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-17T11:49:07.491 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:07.489+0000 7f81147ec640 1 -- 172.21.15.40:0/1150133893 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f80f006ae40 msgr2=0x7f80f006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:07.491 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:07.489+0000 7f81147ec640 1 --2- 172.21.15.40:0/1150133893 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f80f006ae40 0x7f80f006d300 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f8108003f00 tx=0x7f8108009890 comp rx=0 tx=0).stop 2023-12-17T11:49:07.492 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:07.489+0000 7f81147ec640 1 -- 172.21.15.40:0/1150133893 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f810c1609b0 msgr2=0x7f810c14a3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:07.492 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:07.489+0000 7f81147ec640 1 --2- 172.21.15.40:0/1150133893 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f810c1609b0 0x7f810c14a3f0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f810400b410 tx=0x7f810400b8d0 comp rx=0 tx=0).stop 2023-12-17T11:49:07.492 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:07.489+0000 7f81147ec640 1 -- 172.21.15.40:0/1150133893 shutdown_connections 2023-12-17T11:49:07.492 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:07.489+0000 7f81147ec640 1 --2- 172.21.15.40:0/1150133893 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f80f006ae40 0x7f80f006d300 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:07.492 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:07.489+0000 7f81147ec640 1 --2- 172.21.15.40:0/1150133893 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f810c1609b0 0x7f810c14a3f0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:07.492 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:07.489+0000 7f81147ec640 1 --2- 172.21.15.40:0/1150133893 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f810c0d1220 0x7f810c0b8590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:07.492 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:07.489+0000 7f81147ec640 1 --2- 172.21.15.40:0/1150133893 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f810c0d0060 0x7f810c0caba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:07.492 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:07.489+0000 7f81147ec640 1 -- 172.21.15.40:0/1150133893 >> 172.21.15.40:0/1150133893 conn(0x7f810c09c450 msgr2=0x7f810c0cec10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:49:07.492 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:07.489+0000 7f81147ec640 1 -- 172.21.15.40:0/1150133893 shutdown_connections 2023-12-17T11:49:07.492 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:07.489+0000 7f81147ec640 1 -- 172.21.15.40:0/1150133893 wait complete. 2023-12-17T11:49:07.510 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-17T11:48:06.668943+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-17T11:48:16.151444+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-17T11:48:16.717726+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-12-17T11:48:20.534819+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-12-17T11:49:07.511 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-17T11:49:07.788 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:07.786+0000 7fbe2d272640 1 Processor -- start 2023-12-17T11:49:07.789 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:07.786+0000 7fbe2d272640 1 -- start start 2023-12-17T11:49:07.791 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:07.788+0000 7fbe2d272640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fbe280ce150 0x7fbe280ce5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:07.791 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:07.788+0000 7fbe2d272640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fbe280cedf0 0x7fbe280cf280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:07.791 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:07.788+0000 7fbe2d272640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe2806c500 con 0x7fbe28155400 2023-12-17T11:49:07.791 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:07.788+0000 7fbe2d272640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe280cf7c0 con 0x7fbe280cedf0 2023-12-17T11:49:07.791 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:07.788+0000 7fbe2d272640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe2815b4a0 con 0x7fbe280ce150 2023-12-17T11:49:07.791 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:07.789+0000 7fbe2ca71640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fbe280cedf0 0x7fbe280cf280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:07.791 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:07.789+0000 7fbe2ca71640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fbe280cedf0 0x7fbe280cf280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:41240/0 (socket says 172.21.15.40:41240) 2023-12-17T11:49:07.791 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:07.789+0000 7fbe2ca71640 1 -- 172.21.15.40:0/396681051 learned_addr learned my addr 172.21.15.40:0/396681051 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-17T11:49:07.791 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:07.789+0000 7fbe1ffff640 1 --2- 172.21.15.40:0/396681051 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fbe280ce150 0x7fbe280ce5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:07.792 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:07.789+0000 7fbe2ca71640 1 -- 172.21.15.40:0/396681051 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fbe280ce150 msgr2=0x7fbe280ce5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:49:07.792 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:07.789+0000 7fbe2ca71640 1 --2- 172.21.15.40:0/396681051 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fbe280ce150 0x7fbe280ce5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:07.792 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:07.789+0000 7fbe2ca71640 1 -- 172.21.15.40:0/396681051 >> v1:172.21.15.40:6789/0 conn(0x7fbe28155400 legacy=0x7fbe2806bdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:07.792 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:07.789+0000 7fbe2ca71640 1 -- 172.21.15.40:0/396681051 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe280adbb0 con 0x7fbe280cedf0 2023-12-17T11:49:07.792 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:07.789+0000 7fbe1ffff640 1 --2- 172.21.15.40:0/396681051 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fbe280ce150 0x7fbe280ce5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-17T11:49:07.793 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:07.790+0000 7fbe2ca71640 1 --2- 172.21.15.40:0/396681051 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbe280cedf0 0x7fbe280cf280 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fbe20009e50 tx=0x7fbe2002bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1440616a4c75feb6 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:49:07.793 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:07.791+0000 7fbe277fe640 1 -- 172.21.15.40:0/396681051 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe2002cb00 con 0x7fbe280cedf0 2023-12-17T11:49:07.793 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:07.791+0000 7fbe277fe640 1 -- 172.21.15.40:0/396681051 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe2002cc60 con 0x7fbe280cedf0 2023-12-17T11:49:07.793 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:07.791+0000 7fbe277fe640 1 -- 172.21.15.40:0/396681051 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe200343f0 con 0x7fbe280cedf0 2023-12-17T11:49:07.794 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:07.791+0000 7fbe2d272640 1 -- 172.21.15.40:0/396681051 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbe280cedf0 msgr2=0x7fbe280cf280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:07.794 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:07.791+0000 7fbe2d272640 1 --2- 172.21.15.40:0/396681051 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbe280cedf0 0x7fbe280cf280 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fbe20009e50 tx=0x7fbe2002bf60 comp rx=0 tx=0).stop 2023-12-17T11:49:07.794 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:07.791+0000 7fbe2d272640 1 -- 172.21.15.40:0/396681051 shutdown_connections 2023-12-17T11:49:07.794 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:07.791+0000 7fbe2d272640 1 --2- 172.21.15.40:0/396681051 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbe280cedf0 0x7fbe280cf280 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:07.794 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:07.791+0000 7fbe2d272640 1 --2- 172.21.15.40:0/396681051 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fbe280ce150 0x7fbe280ce5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:07.794 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:07.791+0000 7fbe2d272640 1 -- 172.21.15.40:0/396681051 >> 172.21.15.40:0/396681051 conn(0x7fbe2806a640 msgr2=0x7fbe2806aa50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:49:07.794 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:07.791+0000 7fbe2d272640 1 -- 172.21.15.40:0/396681051 shutdown_connections 2023-12-17T11:49:07.794 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:07.792+0000 7fbe2d272640 1 -- 172.21.15.40:0/396681051 wait complete. 2023-12-17T11:49:07.795 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:07.793+0000 7fbe2d272640 1 Processor -- start 2023-12-17T11:49:07.795 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:07.793+0000 7fbe2d272640 1 -- start start 2023-12-17T11:49:07.796 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:07.794+0000 7fbe2d272640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbe280ce150 0x7fbe28140650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:07.796 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:07.794+0000 7fbe2d272640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbe280cedf0 0x7fbe280ae780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:07.796 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:07.794+0000 7fbe2d272640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fbe28155400 0x7fbe280b0d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:07.796 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:07.794+0000 7fbe2d272640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe280b0200 con 0x7fbe280cedf0 2023-12-17T11:49:07.796 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:07.794+0000 7fbe2d272640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe280af160 con 0x7fbe280ce150 2023-12-17T11:49:07.796 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:07.794+0000 7fbe2d272640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe280af440 con 0x7fbe28155400 2023-12-17T11:49:07.798 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:07.795+0000 7fbe1ffff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbe280cedf0 0x7fbe280ae780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:07.798 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:07.795+0000 7fbe1ffff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbe280cedf0 0x7fbe280ae780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:41246/0 (socket says 172.21.15.40:41246) 2023-12-17T11:49:07.798 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:07.795+0000 7fbe1ffff640 1 -- 172.21.15.40:0/3278456388 learned_addr learned my addr 172.21.15.40:0/3278456388 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-17T11:49:07.798 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:07.795+0000 7fbe2ca71640 1 --2- 172.21.15.40:0/3278456388 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fbe28155400 0x7fbe280b0d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:07.798 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:07.795+0000 7fbe27fff640 1 --2- 172.21.15.40:0/3278456388 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbe280ce150 0x7fbe28140650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:07.798 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:07.795+0000 7fbe1ffff640 1 -- 172.21.15.40:0/3278456388 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fbe28155400 msgr2=0x7fbe280b0d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:07.798 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:07.795+0000 7fbe1ffff640 1 --2- 172.21.15.40:0/3278456388 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fbe28155400 0x7fbe280b0d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:07.798 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:07.795+0000 7fbe1ffff640 1 -- 172.21.15.40:0/3278456388 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbe280ce150 msgr2=0x7fbe28140650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:07.798 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:07.795+0000 7fbe1ffff640 1 --2- 172.21.15.40:0/3278456388 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbe280ce150 0x7fbe28140650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:07.798 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:07.795+0000 7fbe1ffff640 1 -- 172.21.15.40:0/3278456388 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe20009b30 con 0x7fbe280cedf0 2023-12-17T11:49:07.799 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:07.796+0000 7fbe1ffff640 1 --2- 172.21.15.40:0/3278456388 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbe280cedf0 0x7fbe280ae780 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fbe1000e730 tx=0x7fbe1000ebf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:49:07.799 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:07.796+0000 7fbe257fa640 1 -- 172.21.15.40:0/3278456388 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe10004230 con 0x7fbe280cedf0 2023-12-17T11:49:07.799 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:07.796+0000 7fbe257fa640 1 -- 172.21.15.40:0/3278456388 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe10004390 con 0x7fbe280cedf0 2023-12-17T11:49:07.799 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:07.796+0000 7fbe257fa640 1 -- 172.21.15.40:0/3278456388 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe1000c8f0 con 0x7fbe280cedf0 2023-12-17T11:49:07.799 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:07.796+0000 7fbe2d272640 1 -- 172.21.15.40:0/3278456388 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe280af720 con 0x7fbe280cedf0 2023-12-17T11:49:07.799 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:07.796+0000 7fbe2d272640 1 -- 172.21.15.40:0/3278456388 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe280afce0 con 0x7fbe280cedf0 2023-12-17T11:49:07.799 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:07.797+0000 7fbe2d272640 1 -- 172.21.15.40:0/3278456388 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe28074450 con 0x7fbe280cedf0 2023-12-17T11:49:07.800 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:07.798+0000 7fbe257fa640 1 -- 172.21.15.40:0/3278456388 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fbe1000ca50 con 0x7fbe280cedf0 2023-12-17T11:49:07.801 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:07.799+0000 7fbe257fa640 1 --2- 172.21.15.40:0/3278456388 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7fbe0806ae90 0x7fbe0806d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:07.801 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:07.799+0000 7fbe257fa640 1 -- 172.21.15.40:0/3278456388 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6692+0+0 (secure 0 0 0) 0x7fbe100893d0 con 0x7fbe280cedf0 2023-12-17T11:49:07.801 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:07.800+0000 7fbe27fff640 1 --2- 172.21.15.40:0/3278456388 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7fbe0806ae90 0x7fbe0806d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:07.802 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:07.801+0000 7fbe27fff640 1 --2- 172.21.15.40:0/3278456388 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7fbe0806ae90 0x7fbe0806d350 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fbe2815b8f0 tx=0x7fbe18009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:49:07.805 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:07.803+0000 7fbe257fa640 1 -- 172.21.15.40:0/3278456388 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fbe100542c0 con 0x7fbe280cedf0 2023-12-17T11:49:08.000 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:07.998+0000 7fbe2d272640 1 -- 172.21.15.40:0/3278456388 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fbe2806d750 con 0x7fbe280cedf0 2023-12-17T11:49:08.001 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:07.999+0000 7fbe257fa640 1 -- 172.21.15.40:0/3278456388 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) v1 ==== 93+0+10 (secure 0 0 0) 0x7fbe100578e0 con 0x7fbe280cedf0 2023-12-17T11:49:08.001 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 1 2023-12-17T11:49:08.005 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:08.002+0000 7fbe2d272640 1 -- 172.21.15.40:0/3278456388 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7fbe0806ae90 msgr2=0x7fbe0806d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:08.005 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:08.002+0000 7fbe2d272640 1 --2- 172.21.15.40:0/3278456388 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7fbe0806ae90 0x7fbe0806d350 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fbe2815b8f0 tx=0x7fbe18009040 comp rx=0 tx=0).stop 2023-12-17T11:49:08.006 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:08.002+0000 7fbe2d272640 1 -- 172.21.15.40:0/3278456388 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbe280cedf0 msgr2=0x7fbe280ae780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:08.006 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:08.002+0000 7fbe2d272640 1 --2- 172.21.15.40:0/3278456388 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbe280cedf0 0x7fbe280ae780 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fbe1000e730 tx=0x7fbe1000ebf0 comp rx=0 tx=0).stop 2023-12-17T11:49:08.006 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:08.002+0000 7fbe2d272640 1 -- 172.21.15.40:0/3278456388 shutdown_connections 2023-12-17T11:49:08.006 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:08.002+0000 7fbe2d272640 1 --2- 172.21.15.40:0/3278456388 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7fbe0806ae90 0x7fbe0806d350 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:08.006 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:08.002+0000 7fbe2d272640 1 --2- 172.21.15.40:0/3278456388 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fbe28155400 0x7fbe280b0d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:08.006 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:08.002+0000 7fbe2d272640 1 --2- 172.21.15.40:0/3278456388 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbe280cedf0 0x7fbe280ae780 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:08.006 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:08.002+0000 7fbe2d272640 1 --2- 172.21.15.40:0/3278456388 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbe280ce150 0x7fbe28140650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:08.007 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:08.002+0000 7fbe2d272640 1 -- 172.21.15.40:0/3278456388 >> 172.21.15.40:0/3278456388 conn(0x7fbe2806a640 msgr2=0x7fbe28159f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:49:08.007 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:08.002+0000 7fbe2d272640 1 -- 172.21.15.40:0/3278456388 shutdown_connections 2023-12-17T11:49:08.007 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:08.002+0000 7fbe2d272640 1 -- 172.21.15.40:0/3278456388 wait complete. 2023-12-17T11:49:08.023 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-17T11:49:08.256 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:08.253+0000 7f231c911640 1 Processor -- start 2023-12-17T11:49:08.256 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:08.254+0000 7f231c911640 1 -- start start 2023-12-17T11:49:08.258 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:08.255+0000 7f231c911640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f23180cb5b0 0x7f231806c130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:08.258 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:08.255+0000 7f231c911640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f23180cb990 0x7f231815f510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:08.258 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:08.256+0000 7f231c911640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f231806c770 con 0x7f231815b250 2023-12-17T11:49:08.258 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:08.256+0000 7f231c911640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f231806ca50 con 0x7f23180cb5b0 2023-12-17T11:49:08.258 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:08.256+0000 7f231c911640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f231806cd30 con 0x7f23180cb990 2023-12-17T11:49:08.258 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:08.256+0000 7f23177fe640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f23180cb5b0 0x7f231806c130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:08.258 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:08.256+0000 7f23177fe640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f23180cb5b0 0x7f231806c130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:41254/0 (socket says 172.21.15.40:41254) 2023-12-17T11:49:08.258 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:08.256+0000 7f23177fe640 1 -- 172.21.15.40:0/3249908485 learned_addr learned my addr 172.21.15.40:0/3249908485 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-17T11:49:08.259 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:08.256+0000 7f2316ffd640 1 --2- 172.21.15.40:0/3249908485 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f23180cb990 0x7f231815f510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:08.259 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:08.256+0000 7f23177fe640 1 -- 172.21.15.40:0/3249908485 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f23180cb990 msgr2=0x7f231815f510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:49:08.259 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:08.256+0000 7f23177fe640 1 --2- 172.21.15.40:0/3249908485 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f23180cb990 0x7f231815f510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:08.259 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:08.256+0000 7f23177fe640 1 -- 172.21.15.40:0/3249908485 >> v1:172.21.15.159:6789/0 conn(0x7f231815b250 legacy=0x7f231815b6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:49:08.259 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:08.256+0000 7f23177fe640 1 -- 172.21.15.40:0/3249908485 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f231806d010 con 0x7f23180cb5b0 2023-12-17T11:49:08.260 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:08.258+0000 7f23177fe640 1 --2- 172.21.15.40:0/3249908485 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f23180cb5b0 0x7f231806c130 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f2308009870 tx=0x7f230802b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aabb7427c6a2863c server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:49:08.260 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:08.258+0000 7f23167fc640 1 -- 172.21.15.40:0/3249908485 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2308031640 con 0x7f23180cb5b0 2023-12-17T11:49:08.260 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:08.258+0000 7f23167fc640 1 -- 172.21.15.40:0/3249908485 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23080317a0 con 0x7f23180cb5b0 2023-12-17T11:49:08.260 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:08.258+0000 7f23167fc640 1 -- 172.21.15.40:0/3249908485 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2308031b30 con 0x7f23180cb5b0 2023-12-17T11:49:08.261 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:08.259+0000 7f231c911640 1 -- 172.21.15.40:0/3249908485 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f23180cb5b0 msgr2=0x7f231806c130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:08.261 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:08.259+0000 7f231c911640 1 --2- 172.21.15.40:0/3249908485 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f23180cb5b0 0x7f231806c130 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f2308009870 tx=0x7f230802b8f0 comp rx=0 tx=0).stop 2023-12-17T11:49:08.261 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:08.259+0000 7f231c911640 1 -- 172.21.15.40:0/3249908485 shutdown_connections 2023-12-17T11:49:08.261 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:08.259+0000 7f231c911640 1 --2- 172.21.15.40:0/3249908485 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f23180cb990 0x7f231815f510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:08.261 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:08.259+0000 7f231c911640 1 --2- 172.21.15.40:0/3249908485 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f23180cb5b0 0x7f231806c130 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:08.261 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:08.259+0000 7f231c911640 1 -- 172.21.15.40:0/3249908485 >> 172.21.15.40:0/3249908485 conn(0x7f23180b0940 msgr2=0x7f23180b0d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:49:08.262 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:08.259+0000 7f231c911640 1 -- 172.21.15.40:0/3249908485 shutdown_connections 2023-12-17T11:49:08.262 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:08.259+0000 7f231c911640 1 -- 172.21.15.40:0/3249908485 wait complete. 2023-12-17T11:49:08.263 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:08.261+0000 7f231c911640 1 Processor -- start 2023-12-17T11:49:08.263 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:08.261+0000 7f231c911640 1 -- start start 2023-12-17T11:49:08.266 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:08.262+0000 7f231c911640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f23180cb5b0 0x7f231809b8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:08.266 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:08.262+0000 7f231c911640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f23180cb990 0x7f2318156060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:08.266 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:08.262+0000 7f231c911640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f231815b250 0x7f23181e5fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:08.266 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:08.262+0000 7f231c911640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f231809b510 con 0x7f23180cb990 2023-12-17T11:49:08.266 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:08.262+0000 7f231c911640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2318156b60 con 0x7f231815b250 2023-12-17T11:49:08.266 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:08.262+0000 7f231c911640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f231809be30 con 0x7f23180cb5b0 2023-12-17T11:49:08.266 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:08.262+0000 7f2316ffd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f23180cb990 0x7f2318156060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:08.266 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:08.262+0000 7f2316ffd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f23180cb990 0x7f2318156060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:41260/0 (socket says 172.21.15.40:41260) 2023-12-17T11:49:08.266 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:08.263+0000 7f2316ffd640 1 -- 172.21.15.40:0/814251455 learned_addr learned my addr 172.21.15.40:0/814251455 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-17T11:49:08.267 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:08.263+0000 7f2317fff640 1 --2- 172.21.15.40:0/814251455 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f231815b250 0x7f23181e5fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:08.267 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:08.263+0000 7f23177fe640 1 --2- 172.21.15.40:0/814251455 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f23180cb5b0 0x7f231809b8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:08.267 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:08.263+0000 7f2316ffd640 1 -- 172.21.15.40:0/814251455 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f23180cb5b0 msgr2=0x7f231809b8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:08.267 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:08.263+0000 7f2316ffd640 1 --2- 172.21.15.40:0/814251455 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f23180cb5b0 0x7f231809b8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:08.267 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:08.263+0000 7f2316ffd640 1 -- 172.21.15.40:0/814251455 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f231815b250 msgr2=0x7f23181e5fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:08.267 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:08.263+0000 7f2316ffd640 1 --2- 172.21.15.40:0/814251455 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f231815b250 0x7f23181e5fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:08.267 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:08.263+0000 7f2316ffd640 1 -- 172.21.15.40:0/814251455 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23080094d0 con 0x7f23180cb990 2023-12-17T11:49:08.267 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:08.263+0000 7f2316ffd640 1 --2- 172.21.15.40:0/814251455 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f23180cb990 0x7f2318156060 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f230c00d800 tx=0x7f230c00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:49:08.267 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:08.264+0000 7f22fffff640 1 -- 172.21.15.40:0/814251455 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f230c018070 con 0x7f23180cb990 2023-12-17T11:49:08.267 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:08.264+0000 7f22fffff640 1 -- 172.21.15.40:0/814251455 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f230c004020 con 0x7f23180cb990 2023-12-17T11:49:08.267 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:08.264+0000 7f22fffff640 1 -- 172.21.15.40:0/814251455 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f230c0041b0 con 0x7f23180cb990 2023-12-17T11:49:08.267 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:08.264+0000 7f231c911640 1 -- 172.21.15.40:0/814251455 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f231809a890 con 0x7f23180cb990 2023-12-17T11:49:08.267 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:08.264+0000 7f231c911640 1 -- 172.21.15.40:0/814251455 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f231809ae50 con 0x7f23180cb990 2023-12-17T11:49:08.268 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:08.265+0000 7f231c911640 1 -- 172.21.15.40:0/814251455 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2318067910 con 0x7f23180cb990 2023-12-17T11:49:08.268 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:08.266+0000 7f22fffff640 1 -- 172.21.15.40:0/814251455 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f230c004310 con 0x7f23180cb990 2023-12-17T11:49:08.269 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:08.267+0000 7f22fffff640 1 --2- 172.21.15.40:0/814251455 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f230406ae40 0x7f230406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:08.269 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:08.267+0000 7f22fffff640 1 -- 172.21.15.40:0/814251455 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f230c089860 con 0x7f23180cb990 2023-12-17T11:49:08.269 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:08.268+0000 7f23177fe640 1 --2- 172.21.15.40:0/814251455 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f230406ae40 0x7f230406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:08.271 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:08.269+0000 7f23177fe640 1 --2- 172.21.15.40:0/814251455 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f230406ae40 0x7f230406d300 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f2308036000 tx=0x7f230803c040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:49:08.273 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:08.271+0000 7f22fffff640 1 -- 172.21.15.40:0/814251455 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f230c054520 con 0x7f23180cb990 2023-12-17T11:49:08.467 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:08.464+0000 7f231c911640 1 -- 172.21.15.40:0/814251455 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f2318156e80 con 0x7f23180cb990 2023-12-17T11:49:08.467 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:08.465+0000 7f22fffff640 1 -- 172.21.15.40:0/814251455 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) v1 ==== 104+0+11 (secure 0 0 0) 0x7f230c057b40 con 0x7f23180cb990 2023-12-17T11:49:08.467 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 32 2023-12-17T11:49:08.470 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:08.468+0000 7f231c911640 1 -- 172.21.15.40:0/814251455 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f230406ae40 msgr2=0x7f230406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:08.470 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:08.468+0000 7f231c911640 1 --2- 172.21.15.40:0/814251455 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f230406ae40 0x7f230406d300 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f2308036000 tx=0x7f230803c040 comp rx=0 tx=0).stop 2023-12-17T11:49:08.470 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:08.468+0000 7f231c911640 1 -- 172.21.15.40:0/814251455 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f23180cb990 msgr2=0x7f2318156060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:08.470 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:08.468+0000 7f231c911640 1 --2- 172.21.15.40:0/814251455 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f23180cb990 0x7f2318156060 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f230c00d800 tx=0x7f230c00dcc0 comp rx=0 tx=0).stop 2023-12-17T11:49:08.470 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:08.468+0000 7f231c911640 1 -- 172.21.15.40:0/814251455 shutdown_connections 2023-12-17T11:49:08.470 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:08.468+0000 7f231c911640 1 --2- 172.21.15.40:0/814251455 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f230406ae40 0x7f230406d300 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:08.470 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:08.468+0000 7f231c911640 1 --2- 172.21.15.40:0/814251455 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f231815b250 0x7f23181e5fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:08.471 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:08.468+0000 7f231c911640 1 --2- 172.21.15.40:0/814251455 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f23180cb990 0x7f2318156060 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:08.471 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:08.468+0000 7f231c911640 1 --2- 172.21.15.40:0/814251455 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f23180cb5b0 0x7f231809b8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:08.471 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:08.468+0000 7f231c911640 1 -- 172.21.15.40:0/814251455 >> 172.21.15.40:0/814251455 conn(0x7f23180b0940 msgr2=0x7f23180cec50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:49:08.471 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:08.468+0000 7f231c911640 1 -- 172.21.15.40:0/814251455 shutdown_connections 2023-12-17T11:49:08.471 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:08.468+0000 7f231c911640 1 -- 172.21.15.40:0/814251455 wait complete. 2023-12-17T11:49:08.491 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-17T11:49:08.711 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:08.708+0000 7f389ffff640 1 Processor -- start 2023-12-17T11:49:08.711 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:08.709+0000 7f389ffff640 1 -- start start 2023-12-17T11:49:08.712 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:08.710+0000 7f389ffff640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f38a0155400 0x7f38a006bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:08.713 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:08.711+0000 7f389ffff640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38a015b4a0 con 0x7f38a00ce150 2023-12-17T11:49:08.713 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:08.711+0000 7f389ffff640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38a00adbb0 con 0x7f38a00cf500 2023-12-17T11:49:08.713 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:08.711+0000 7f389ffff640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38a00ade90 con 0x7f38a0155400 2023-12-17T11:49:08.713 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:08.711+0000 7f389e7fc640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f38a00ce150 0x7f38a00cedf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:55216/0 (socket says 172.21.15.40:55216) 2023-12-17T11:49:08.713 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:08.711+0000 7f389e7fc640 1 -- 172.21.15.40:0/3128768441 learned_addr learned my addr 172.21.15.40:0/3128768441 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-12-17T11:49:08.715 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:08.711+0000 7f389effd640 1 --2- 172.21.15.40:0/3128768441 >> v2:172.21.15.159:3300/0 conn(0x7f38a0155400 0x7f38a006bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:08.715 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:08.711+0000 7f389dffb640 1 -- 172.21.15.40:0/3128768441 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3376794321 0 0) 0x7f38a015b4a0 con 0x7f38a00ce150 2023-12-17T11:49:08.715 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:08.711+0000 7f389dffb640 1 -- 172.21.15.40:0/3128768441 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f388c003520 con 0x7f38a00ce150 2023-12-17T11:49:08.715 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:08.712+0000 7f389dffb640 1 -- 172.21.15.40:0/3128768441 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 687151804 0 0) 0x7f388c003520 con 0x7f38a00ce150 2023-12-17T11:49:08.715 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:08.712+0000 7f389dffb640 1 -- 172.21.15.40:0/3128768441 >> v2:172.21.15.159:3300/0 conn(0x7f38a0155400 msgr2=0x7f38a006bdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:49:08.715 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:08.712+0000 7f389dffb640 1 --2- 172.21.15.40:0/3128768441 >> v2:172.21.15.159:3300/0 conn(0x7f38a0155400 0x7f38a006bdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:08.715 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:08.712+0000 7f389dffb640 1 -- 172.21.15.40:0/3128768441 >> v1:172.21.15.159:6789/0 conn(0x7f38a00cf500 legacy=0x7f38a015b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:08.715 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:08.712+0000 7f389dffb640 1 -- 172.21.15.40:0/3128768441 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38a00ae170 con 0x7f38a00ce150 2023-12-17T11:49:08.716 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:08.712+0000 7f389dffb640 1 -- 172.21.15.40:0/3128768441 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2643242555 0 0) 0x7f3888001670 con 0x7f38a00ce150 2023-12-17T11:49:08.716 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:08.712+0000 7f389dffb640 1 -- 172.21.15.40:0/3128768441 >> v1:172.21.15.40:6789/0 conn(0x7f38a00ce150 legacy=0x7f38a00cedf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:08.716 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:08.712+0000 7f389dffb640 1 --2- 172.21.15.40:0/3128768441 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f388c0039c0 0x7f388c003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:08.716 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:08.712+0000 7f389dffb640 1 --2- 172.21.15.40:0/3128768441 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f388c0047c0 0x7f388c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:08.716 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:08.712+0000 7f389dffb640 1 --2- 172.21.15.40:0/3128768441 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f388c005180 0x7f388c00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:08.716 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:08.712+0000 7f389dffb640 1 -- 172.21.15.40:0/3128768441 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38a00ade90 con 0x7f388c005180 2023-12-17T11:49:08.716 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:08.712+0000 7f389dffb640 1 -- 172.21.15.40:0/3128768441 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f388c00c080 con 0x7f388c0047c0 2023-12-17T11:49:08.716 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:08.712+0000 7f389dffb640 1 -- 172.21.15.40:0/3128768441 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f388c00c240 con 0x7f388c0039c0 2023-12-17T11:49:08.716 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:08.712+0000 7f389f7fe640 1 --2- 172.21.15.40:0/3128768441 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f388c005180 0x7f388c00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:08.716 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:08.713+0000 7f389e7fc640 1 --2- 172.21.15.40:0/3128768441 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f388c0047c0 0x7f388c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:08.716 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:08.713+0000 7f389f7fe640 1 -- 172.21.15.40:0/3128768441 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f388c0039c0 msgr2=0x7f388c003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:49:08.716 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:08.713+0000 7f389effd640 1 --2- 172.21.15.40:0/3128768441 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f388c0039c0 0x7f388c003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:08.716 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:08.713+0000 7f389f7fe640 1 --2- 172.21.15.40:0/3128768441 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f388c0039c0 0x7f388c003de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:08.716 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:08.713+0000 7f389f7fe640 1 -- 172.21.15.40:0/3128768441 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f388c0047c0 msgr2=0x7f388c004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:49:08.717 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:08.713+0000 7f389f7fe640 1 --2- 172.21.15.40:0/3128768441 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f388c0047c0 0x7f388c004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:08.717 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:08.713+0000 7f389f7fe640 1 -- 172.21.15.40:0/3128768441 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f388c003520 con 0x7f388c005180 2023-12-17T11:49:08.718 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:08.714+0000 7f389f7fe640 1 -- 172.21.15.40:0/3128768441 reap_dead start 2023-12-17T11:49:08.718 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:08.714+0000 7f389f7fe640 1 --2- 172.21.15.40:0/3128768441 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f388c005180 0x7f388c00b980 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f3898001750 tx=0x7f388c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f73bc60c0da33334 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:49:08.718 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:08.715+0000 7f389dffb640 1 -- 172.21.15.40:0/3128768441 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38980052d0 con 0x7f388c005180 2023-12-17T11:49:08.718 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:08.715+0000 7f389dffb640 1 -- 172.21.15.40:0/3128768441 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f389802e050 con 0x7f388c005180 2023-12-17T11:49:08.718 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:08.715+0000 7f389dffb640 1 -- 172.21.15.40:0/3128768441 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3898003830 con 0x7f388c005180 2023-12-17T11:49:08.718 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:08.716+0000 7f389ffff640 1 -- 172.21.15.40:0/3128768441 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f388c005180 msgr2=0x7f388c00b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:08.718 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:08.716+0000 7f389ffff640 1 --2- 172.21.15.40:0/3128768441 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f388c005180 0x7f388c00b980 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f3898001750 tx=0x7f388c0057f0 comp rx=0 tx=0).stop 2023-12-17T11:49:08.718 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:08.716+0000 7f389ffff640 1 -- 172.21.15.40:0/3128768441 shutdown_connections 2023-12-17T11:49:08.718 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:08.716+0000 7f389ffff640 1 --2- 172.21.15.40:0/3128768441 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f388c005180 0x7f388c00b980 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:08.719 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:08.716+0000 7f389ffff640 1 -- 172.21.15.40:0/3128768441 >> 172.21.15.40:0/3128768441 conn(0x7f38a006a640 msgr2=0x7f38a006aa50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:49:08.719 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:08.716+0000 7f389ffff640 1 -- 172.21.15.40:0/3128768441 shutdown_connections 2023-12-17T11:49:08.719 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:08.716+0000 7f389ffff640 1 -- 172.21.15.40:0/3128768441 wait complete. 2023-12-17T11:49:08.720 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:08.718+0000 7f389ffff640 1 Processor -- start 2023-12-17T11:49:08.720 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:08.718+0000 7f389ffff640 1 -- start start 2023-12-17T11:49:08.722 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:08.719+0000 7f389ffff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f388c005180 0x7f38a014d720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:08.722 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:08.719+0000 7f389ffff640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f38a0150d80 0x7f38a009bdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:08.723 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:08.719+0000 7f389ffff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f38a009c310 0x7f38a014efc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:08.723 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:08.719+0000 7f389ffff640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38a009c790 con 0x7f38a009c310 2023-12-17T11:49:08.723 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:08.719+0000 7f389ffff640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38a0150420 con 0x7f388c005180 2023-12-17T11:49:08.723 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:08.719+0000 7f389ffff640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38a00af5e0 con 0x7f38a0150d80 2023-12-17T11:49:08.723 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:08.719+0000 7f389f7fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f38a009c310 0x7f38a014efc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:08.723 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:08.719+0000 7f389f7fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f38a009c310 0x7f38a014efc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:41274/0 (socket says 172.21.15.40:41274) 2023-12-17T11:49:08.723 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:08.719+0000 7f389f7fe640 1 -- 172.21.15.40:0/766613656 learned_addr learned my addr 172.21.15.40:0/766613656 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-17T11:49:08.723 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:08.720+0000 7f389effd640 1 --2- 172.21.15.40:0/766613656 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f388c005180 0x7f38a014d720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:08.723 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:08.720+0000 7f389e7fc640 1 --2- 172.21.15.40:0/766613656 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f38a0150d80 0x7f38a009bdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:08.723 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:08.720+0000 7f389f7fe640 1 -- 172.21.15.40:0/766613656 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f38a0150d80 msgr2=0x7f38a009bdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:08.723 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:08.720+0000 7f389f7fe640 1 --2- 172.21.15.40:0/766613656 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f38a0150d80 0x7f38a009bdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:08.723 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:08.720+0000 7f389f7fe640 1 -- 172.21.15.40:0/766613656 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f388c005180 msgr2=0x7f38a014d720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:08.723 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:08.720+0000 7f389f7fe640 1 --2- 172.21.15.40:0/766613656 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f388c005180 0x7f38a014d720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:08.724 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:08.720+0000 7f389f7fe640 1 -- 172.21.15.40:0/766613656 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38a00af8c0 con 0x7f38a009c310 2023-12-17T11:49:08.724 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:08.720+0000 7f389e7fc640 1 --2- 172.21.15.40:0/766613656 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f38a0150d80 0x7f38a009bdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-17T11:49:08.724 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:08.720+0000 7f389effd640 1 --2- 172.21.15.40:0/766613656 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f388c005180 0x7f38a014d720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-17T11:49:08.724 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:08.720+0000 7f389f7fe640 1 --2- 172.21.15.40:0/766613656 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f38a009c310 0x7f38a014efc0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f3898001870 tx=0x7f3898001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:49:08.724 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:08.720+0000 7f3897fff640 1 -- 172.21.15.40:0/766613656 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3898039070 con 0x7f38a009c310 2023-12-17T11:49:08.724 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:08.721+0000 7f3897fff640 1 -- 172.21.15.40:0/766613656 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3898000ed0 con 0x7f38a009c310 2023-12-17T11:49:08.724 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:08.721+0000 7f3897fff640 1 -- 172.21.15.40:0/766613656 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3898007030 con 0x7f38a009c310 2023-12-17T11:49:08.724 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:08.721+0000 7f389ffff640 1 -- 172.21.15.40:0/766613656 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38a00afba0 con 0x7f38a009c310 2023-12-17T11:49:08.724 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:08.721+0000 7f389ffff640 1 -- 172.21.15.40:0/766613656 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38a01511e0 con 0x7f38a009c310 2023-12-17T11:49:08.724 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:08.722+0000 7f389ffff640 1 -- 172.21.15.40:0/766613656 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38a0074450 con 0x7f38a009c310 2023-12-17T11:49:08.725 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:08.723+0000 7f3897fff640 1 -- 172.21.15.40:0/766613656 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f389803c020 con 0x7f38a009c310 2023-12-17T11:49:08.725 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:08.724+0000 7f3897fff640 1 --2- 172.21.15.40:0/766613656 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f388006ae40 0x7f388006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:08.725 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:08.724+0000 7f3897fff640 1 -- 172.21.15.40:0/766613656 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f38980a9e10 con 0x7f38a009c310 2023-12-17T11:49:08.726 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:08.724+0000 7f389effd640 1 --2- 172.21.15.40:0/766613656 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f388006ae40 0x7f388006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:08.727 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:08.725+0000 7f389effd640 1 --2- 172.21.15.40:0/766613656 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f388006ae40 0x7f388006d300 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f38900074e0 tx=0x7f389000d040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:49:08.730 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:08.728+0000 7f3897fff640 1 -- 172.21.15.40:0/766613656 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f38980ad030 con 0x7f38a009c310 2023-12-17T11:49:08.923 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:08.921+0000 7f389ffff640 1 -- 172.21.15.40:0/766613656 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f38a014dd40 con 0x7f38a009c310 2023-12-17T11:49:08.924 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:08.922+0000 7f3897fff640 1 -- 172.21.15.40:0/766613656 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) v1 ==== 100+0+11 (secure 0 0 0) 0x7f38980440a0 con 0x7f38a009c310 2023-12-17T11:49:08.924 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 64 2023-12-17T11:49:08.927 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:08.925+0000 7f389ffff640 1 -- 172.21.15.40:0/766613656 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f388006ae40 msgr2=0x7f388006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:08.927 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:08.925+0000 7f389ffff640 1 --2- 172.21.15.40:0/766613656 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f388006ae40 0x7f388006d300 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f38900074e0 tx=0x7f389000d040 comp rx=0 tx=0).stop 2023-12-17T11:49:08.927 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:08.925+0000 7f389ffff640 1 -- 172.21.15.40:0/766613656 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f38a009c310 msgr2=0x7f38a014efc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:08.927 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:08.925+0000 7f389ffff640 1 --2- 172.21.15.40:0/766613656 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f38a009c310 0x7f38a014efc0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f3898001870 tx=0x7f3898001120 comp rx=0 tx=0).stop 2023-12-17T11:49:08.927 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:08.925+0000 7f389ffff640 1 -- 172.21.15.40:0/766613656 shutdown_connections 2023-12-17T11:49:08.927 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:08.925+0000 7f389ffff640 1 --2- 172.21.15.40:0/766613656 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f388006ae40 0x7f388006d300 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:08.927 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:08.925+0000 7f389ffff640 1 --2- 172.21.15.40:0/766613656 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f38a009c310 0x7f38a014efc0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:08.927 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:08.925+0000 7f389ffff640 1 --2- 172.21.15.40:0/766613656 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f38a0150d80 0x7f38a009bdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:08.928 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:08.925+0000 7f389ffff640 1 --2- 172.21.15.40:0/766613656 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f388c005180 0x7f38a014d720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:08.928 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:08.925+0000 7f389ffff640 1 -- 172.21.15.40:0/766613656 >> 172.21.15.40:0/766613656 conn(0x7f38a006a640 msgr2=0x7f38a0159ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:49:08.928 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:08.925+0000 7f389ffff640 1 -- 172.21.15.40:0/766613656 shutdown_connections 2023-12-17T11:49:08.928 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:08.925+0000 7f389ffff640 1 -- 172.21.15.40:0/766613656 wait complete. 2023-12-17T11:49:08.946 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-12-17T11:49:09.174 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:09.172+0000 7f33dcae1640 1 Processor -- start 2023-12-17T11:49:09.176 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:09.172+0000 7f33dcae1640 1 -- start start 2023-12-17T11:49:09.180 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:09.174+0000 7f33dcae1640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f33d806dce0 0x7f33d8072050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:09.180 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:09.174+0000 7f33dcae1640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33d80ae690 con 0x7f33d80b1430 2023-12-17T11:49:09.180 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:09.174+0000 7f33dcae1640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33d80ce950 con 0x7f33d8159590 2023-12-17T11:49:09.181 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:09.174+0000 7f33dcae1640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33d80ae0d0 con 0x7f33d806dce0 2023-12-17T11:49:09.181 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:09.174+0000 7f33cffff640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f33d80b1430 0x7f33d806d5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:55232/0 (socket says 172.21.15.40:55232) 2023-12-17T11:49:09.181 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:09.174+0000 7f33cffff640 1 -- 172.21.15.40:0/1010631436 learned_addr learned my addr 172.21.15.40:0/1010631436 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-12-17T11:49:09.181 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:09.174+0000 7f33d7fff640 1 --2- 172.21.15.40:0/1010631436 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f33d806dce0 0x7f33d8072050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:09.181 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:09.174+0000 7f33d6ffd640 1 -- 172.21.15.40:0/1010631436 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3562844520 0 0) 0x7f33d80ae690 con 0x7f33d80b1430 2023-12-17T11:49:09.181 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:09.175+0000 7f33d6ffd640 1 -- 172.21.15.40:0/1010631436 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f33c4003520 con 0x7f33d80b1430 2023-12-17T11:49:09.181 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:09.175+0000 7f33d6ffd640 1 -- 172.21.15.40:0/1010631436 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3632287327 0 0) 0x7f33c4003520 con 0x7f33d80b1430 2023-12-17T11:49:09.181 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:09.175+0000 7f33d6ffd640 1 -- 172.21.15.40:0/1010631436 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f33d806dce0 msgr2=0x7f33d8072050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:49:09.181 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:09.175+0000 7f33d6ffd640 1 --2- 172.21.15.40:0/1010631436 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f33d806dce0 0x7f33d8072050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:09.181 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:09.175+0000 7f33d6ffd640 1 -- 172.21.15.40:0/1010631436 >> v1:172.21.15.159:6789/0 conn(0x7f33d8159590 legacy=0x7f33d80cca90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:09.181 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:09.175+0000 7f33d6ffd640 1 -- 172.21.15.40:0/1010631436 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33d80ae3b0 con 0x7f33d80b1430 2023-12-17T11:49:09.181 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:09.175+0000 7f33d6ffd640 1 -- 172.21.15.40:0/1010631436 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2643242555 0 0) 0x7f33c0001690 con 0x7f33d80b1430 2023-12-17T11:49:09.181 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:09.175+0000 7f33d6ffd640 1 -- 172.21.15.40:0/1010631436 >> v1:172.21.15.40:6789/0 conn(0x7f33d80b1430 legacy=0x7f33d806d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:09.181 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:09.175+0000 7f33d6ffd640 1 --2- 172.21.15.40:0/1010631436 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f33c40039a0 0x7f33c4003d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:09.182 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:09.175+0000 7f33d6ffd640 1 --2- 172.21.15.40:0/1010631436 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f33c40047c0 0x7f33c4004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:09.182 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:09.175+0000 7f33d6ffd640 1 --2- 172.21.15.40:0/1010631436 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f33d806dce0 0x7f33c4005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:09.182 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:09.175+0000 7f33d6ffd640 1 -- 172.21.15.40:0/1010631436 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33d80ae0d0 con 0x7f33c40039a0 2023-12-17T11:49:09.182 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:09.175+0000 7f33d6ffd640 1 -- 172.21.15.40:0/1010631436 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33c400ba30 con 0x7f33c40047c0 2023-12-17T11:49:09.182 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:09.175+0000 7f33d6ffd640 1 -- 172.21.15.40:0/1010631436 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33c400ddd0 con 0x7f33d806dce0 2023-12-17T11:49:09.182 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:09.175+0000 7f33d77fe640 1 --2- 172.21.15.40:0/1010631436 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f33c40039a0 0x7f33c4003d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:09.182 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:09.176+0000 7f33cffff640 1 --2- 172.21.15.40:0/1010631436 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f33c40047c0 0x7f33c4004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:09.182 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:09.176+0000 7f33d7fff640 1 --2- 172.21.15.40:0/1010631436 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f33d806dce0 0x7f33c4005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:09.182 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:09.176+0000 7f33d77fe640 1 -- 172.21.15.40:0/1010631436 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f33d806dce0 msgr2=0x7f33c4005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:49:09.182 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:09.176+0000 7f33d77fe640 1 --2- 172.21.15.40:0/1010631436 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f33d806dce0 0x7f33c4005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:09.182 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:09.176+0000 7f33d77fe640 1 -- 172.21.15.40:0/1010631436 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f33c40047c0 msgr2=0x7f33c4004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:49:09.182 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:09.176+0000 7f33d77fe640 1 --2- 172.21.15.40:0/1010631436 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f33c40047c0 0x7f33c4004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:09.182 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:09.176+0000 7f33d77fe640 1 -- 172.21.15.40:0/1010631436 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33c4003520 con 0x7f33c40039a0 2023-12-17T11:49:09.182 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:09.176+0000 7f33d7fff640 1 --2- 172.21.15.40:0/1010631436 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f33d806dce0 0x7f33c4005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-17T11:49:09.183 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:09.177+0000 7f33d77fe640 1 --2- 172.21.15.40:0/1010631436 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f33c40039a0 0x7f33c4003d80 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f33c8001830 tx=0x7f33c40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57cc89bc8b9ca6a5 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:49:09.183 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:09.177+0000 7f33d6ffd640 1 -- 172.21.15.40:0/1010631436 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33c802f050 con 0x7f33c40039a0 2023-12-17T11:49:09.183 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:09.177+0000 7f33d6ffd640 1 -- 172.21.15.40:0/1010631436 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33c8033610 con 0x7f33c40039a0 2023-12-17T11:49:09.183 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:09.178+0000 7f33d6ffd640 1 -- 172.21.15.40:0/1010631436 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33c80339c0 con 0x7f33c40039a0 2023-12-17T11:49:09.183 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:09.178+0000 7f33dcae1640 1 -- 172.21.15.40:0/1010631436 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f33c40039a0 msgr2=0x7f33c4003d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:09.183 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:09.178+0000 7f33dcae1640 1 --2- 172.21.15.40:0/1010631436 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f33c40039a0 0x7f33c4003d80 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f33c8001830 tx=0x7f33c40057f0 comp rx=0 tx=0).stop 2023-12-17T11:49:09.183 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:09.178+0000 7f33d7fff640 1 -- 172.21.15.40:0/1010631436 reap_dead start 2023-12-17T11:49:09.183 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:09.178+0000 7f33dcae1640 1 -- 172.21.15.40:0/1010631436 shutdown_connections 2023-12-17T11:49:09.183 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:09.178+0000 7f33dcae1640 1 -- 172.21.15.40:0/1010631436 >> 172.21.15.40:0/1010631436 conn(0x7f33d80b0940 msgr2=0x7f33d80b0d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:49:09.183 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:09.178+0000 7f33dcae1640 1 -- 172.21.15.40:0/1010631436 shutdown_connections 2023-12-17T11:49:09.183 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:09.178+0000 7f33dcae1640 1 -- 172.21.15.40:0/1010631436 wait complete. 2023-12-17T11:49:09.185 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:09.180+0000 7f33dcae1640 1 Processor -- start 2023-12-17T11:49:09.185 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:09.180+0000 7f33dcae1640 1 -- start start 2023-12-17T11:49:09.185 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:09.181+0000 7f33dcae1640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f33c40039a0 0x7f33d80ac880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:09.185 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:09.181+0000 7f33dcae1640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f33d8154730 0x7f33d8152500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:09.186 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:09.181+0000 7f33dcae1640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f33d8157f70 0x7f33d81583f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:09.186 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:09.181+0000 7f33dcae1640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33d8158930 con 0x7f33d8154730 2023-12-17T11:49:09.186 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:09.181+0000 7f33dcae1640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33d8155e20 con 0x7f33d8157f70 2023-12-17T11:49:09.186 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:09.181+0000 7f33dcae1640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33d8152a40 con 0x7f33c40039a0 2023-12-17T11:49:09.186 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:09.182+0000 7f33cffff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f33d8154730 0x7f33d8152500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:09.186 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:09.182+0000 7f33cffff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f33d8154730 0x7f33d8152500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:41296/0 (socket says 172.21.15.40:41296) 2023-12-17T11:49:09.186 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:09.182+0000 7f33cffff640 1 -- 172.21.15.40:0/661421666 learned_addr learned my addr 172.21.15.40:0/661421666 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-17T11:49:09.186 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:09.182+0000 7f33d7fff640 1 --2- 172.21.15.40:0/661421666 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f33d8157f70 0x7f33d81583f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:09.186 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:09.182+0000 7f33d77fe640 1 --2- 172.21.15.40:0/661421666 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f33c40039a0 0x7f33d80ac880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:09.186 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:09.182+0000 7f33cffff640 1 -- 172.21.15.40:0/661421666 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f33c40039a0 msgr2=0x7f33d80ac880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:09.186 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:09.182+0000 7f33cffff640 1 --2- 172.21.15.40:0/661421666 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f33c40039a0 0x7f33d80ac880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:09.186 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:09.182+0000 7f33cffff640 1 -- 172.21.15.40:0/661421666 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f33d8157f70 msgr2=0x7f33d81583f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:09.186 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:09.182+0000 7f33cffff640 1 --2- 172.21.15.40:0/661421666 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f33d8157f70 0x7f33d81583f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:09.186 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:09.182+0000 7f33cffff640 1 -- 172.21.15.40:0/661421666 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33d81532b0 con 0x7f33d8154730 2023-12-17T11:49:09.187 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:09.182+0000 7f33d7fff640 1 --2- 172.21.15.40:0/661421666 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f33d8157f70 0x7f33d81583f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-17T11:49:09.187 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:09.182+0000 7f33d77fe640 1 --2- 172.21.15.40:0/661421666 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f33c40039a0 0x7f33d80ac880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-17T11:49:09.187 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:09.182+0000 7f33cffff640 1 --2- 172.21.15.40:0/661421666 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f33d8154730 0x7f33d8152500 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f33c000e730 tx=0x7f33c000ebf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:49:09.187 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:09.183+0000 7f33d4ff9640 1 -- 172.21.15.40:0/661421666 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33c000c660 con 0x7f33d8154730 2023-12-17T11:49:09.187 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:09.183+0000 7f33d4ff9640 1 -- 172.21.15.40:0/661421666 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33c000c7c0 con 0x7f33d8154730 2023-12-17T11:49:09.187 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:09.183+0000 7f33d4ff9640 1 -- 172.21.15.40:0/661421666 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33c000cb70 con 0x7f33d8154730 2023-12-17T11:49:09.187 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:09.183+0000 7f33dcae1640 1 -- 172.21.15.40:0/661421666 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33d8156050 con 0x7f33d8154730 2023-12-17T11:49:09.187 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:09.183+0000 7f33dcae1640 1 -- 172.21.15.40:0/661421666 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33d8152fd0 con 0x7f33d8154730 2023-12-17T11:49:09.188 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:09.184+0000 7f33dcae1640 1 -- 172.21.15.40:0/661421666 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f33d8067910 con 0x7f33d8154730 2023-12-17T11:49:09.188 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:09.185+0000 7f33d4ff9640 1 -- 172.21.15.40:0/661421666 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f33c000ccd0 con 0x7f33d8154730 2023-12-17T11:49:09.188 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:09.186+0000 7f33d4ff9640 1 --2- 172.21.15.40:0/661421666 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f33b806ae70 0x7f33b806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:09.188 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:09.187+0000 7f33d4ff9640 1 -- 172.21.15.40:0/661421666 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f33c0089810 con 0x7f33d8154730 2023-12-17T11:49:09.189 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:09.187+0000 7f33d77fe640 1 --2- 172.21.15.40:0/661421666 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f33b806ae70 0x7f33b806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:09.190 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:09.188+0000 7f33d77fe640 1 --2- 172.21.15.40:0/661421666 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f33b806ae70 0x7f33b806d330 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f33c8036000 tx=0x7f33c8031000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:49:09.193 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:09.191+0000 7f33d4ff9640 1 -- 172.21.15.40:0/661421666 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f33c00544d0 con 0x7f33d8154730 2023-12-17T11:49:09.382 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:09.376+0000 7f33dcae1640 1 -- 172.21.15.40:0/661421666 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f33d8074450 con 0x7f33d8154730 2023-12-17T11:49:09.382 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:09.377+0000 7f33d4ff9640 1 -- 172.21.15.40:0/661421666 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) v1 ==== 103+0+11 (secure 0 0 0) 0x7f33c0057af0 con 0x7f33d8154730 2023-12-17T11:49:09.382 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 32 2023-12-17T11:49:09.384 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:09.379+0000 7f33dcae1640 1 -- 172.21.15.40:0/661421666 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f33b806ae70 msgr2=0x7f33b806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:09.384 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:09.379+0000 7f33dcae1640 1 --2- 172.21.15.40:0/661421666 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f33b806ae70 0x7f33b806d330 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f33c8036000 tx=0x7f33c8031000 comp rx=0 tx=0).stop 2023-12-17T11:49:09.384 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:09.380+0000 7f33dcae1640 1 -- 172.21.15.40:0/661421666 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f33d8154730 msgr2=0x7f33d8152500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:09.384 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:09.380+0000 7f33dcae1640 1 --2- 172.21.15.40:0/661421666 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f33d8154730 0x7f33d8152500 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f33c000e730 tx=0x7f33c000ebf0 comp rx=0 tx=0).stop 2023-12-17T11:49:09.384 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:09.380+0000 7f33dcae1640 1 -- 172.21.15.40:0/661421666 shutdown_connections 2023-12-17T11:49:09.384 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:09.380+0000 7f33dcae1640 1 --2- 172.21.15.40:0/661421666 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f33b806ae70 0x7f33b806d330 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:09.384 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:09.380+0000 7f33dcae1640 1 --2- 172.21.15.40:0/661421666 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f33d8157f70 0x7f33d81583f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:09.384 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:09.380+0000 7f33dcae1640 1 --2- 172.21.15.40:0/661421666 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f33d8154730 0x7f33d8152500 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:09.384 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:09.380+0000 7f33dcae1640 1 --2- 172.21.15.40:0/661421666 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f33c40039a0 0x7f33d80ac880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:09.384 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:09.380+0000 7f33dcae1640 1 -- 172.21.15.40:0/661421666 >> 172.21.15.40:0/661421666 conn(0x7f33d80b0940 msgr2=0x7f33d8153b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:49:09.384 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:09.380+0000 7f33dcae1640 1 -- 172.21.15.40:0/661421666 shutdown_connections 2023-12-17T11:49:09.384 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:09.380+0000 7f33dcae1640 1 -- 172.21.15.40:0/661421666 wait complete. 2023-12-17T11:49:09.400 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-17T11:49:09.617 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:09.615+0000 7f370b51d640 1 Processor -- start 2023-12-17T11:49:09.617 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:09.615+0000 7f370b51d640 1 -- start start 2023-12-17T11:49:09.618 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:09.616+0000 7f370b51d640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f37041609b0 0x7f37040d0ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:09.618 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:09.616+0000 7f370b51d640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f37040d0230 0x7f370415cd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:09.618 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:09.616+0000 7f370b51d640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f370415dd60 con 0x7f37040d1220 2023-12-17T11:49:09.619 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:09.616+0000 7f370b51d640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3704160d90 con 0x7f37041609b0 2023-12-17T11:49:09.619 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:09.616+0000 7f370b51d640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f370415e040 con 0x7f37040d0230 2023-12-17T11:49:09.620 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:09.617+0000 7f3708ab8640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f37040d1220 0x7f37040cfb20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:55244/0 (socket says 172.21.15.40:55244) 2023-12-17T11:49:09.621 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:09.617+0000 7f3708ab8640 1 -- 172.21.15.40:0/1223735626 learned_addr learned my addr 172.21.15.40:0/1223735626 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-12-17T11:49:09.621 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:09.617+0000 7f37092b9640 1 --2- 172.21.15.40:0/1223735626 >> v2:172.21.15.159:3300/0 conn(0x7f37041609b0 0x7f37040d0ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:09.621 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:09.617+0000 7f3709aba640 1 --2- 172.21.15.40:0/1223735626 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f37040d0230 0x7f370415cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:09.621 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:09.617+0000 7f36fbfff640 1 -- 172.21.15.40:0/1223735626 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2076080331 0 0) 0x7f370415dd60 con 0x7f37040d1220 2023-12-17T11:49:09.621 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:09.617+0000 7f36fbfff640 1 -- 172.21.15.40:0/1223735626 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f36f0003520 con 0x7f37040d1220 2023-12-17T11:49:09.621 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:09.618+0000 7f36fbfff640 1 -- 172.21.15.40:0/1223735626 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 516203927 0 0) 0x7f36f0003520 con 0x7f37040d1220 2023-12-17T11:49:09.621 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:09.618+0000 7f36fbfff640 1 -- 172.21.15.40:0/1223735626 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f37040d0230 msgr2=0x7f370415cd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:49:09.621 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:09.618+0000 7f36fbfff640 1 --2- 172.21.15.40:0/1223735626 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f37040d0230 0x7f370415cd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:09.621 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:09.618+0000 7f36fbfff640 1 -- 172.21.15.40:0/1223735626 >> v2:172.21.15.159:3300/0 conn(0x7f37041609b0 msgr2=0x7f37040d0ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:49:09.621 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:09.618+0000 7f36fbfff640 1 --2- 172.21.15.40:0/1223735626 >> v2:172.21.15.159:3300/0 conn(0x7f37041609b0 0x7f37040d0ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:09.621 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:09.618+0000 7f36fbfff640 1 -- 172.21.15.40:0/1223735626 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f370415e320 con 0x7f37040d1220 2023-12-17T11:49:09.621 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:09.618+0000 7f36fbfff640 1 -- 172.21.15.40:0/1223735626 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2643242555 0 0) 0x7f36f4001670 con 0x7f37040d1220 2023-12-17T11:49:09.622 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:09.618+0000 7f36fbfff640 1 -- 172.21.15.40:0/1223735626 >> v1:172.21.15.40:6789/0 conn(0x7f37040d1220 legacy=0x7f37040cfb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:09.622 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:09.618+0000 7f36fbfff640 1 --2- 172.21.15.40:0/1223735626 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f36f0003970 0x7f36f0003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:09.622 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:09.618+0000 7f36fbfff640 1 --2- 172.21.15.40:0/1223735626 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f36f00047c0 0x7f36f0004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:09.622 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:09.618+0000 7f36fbfff640 1 --2- 172.21.15.40:0/1223735626 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f37040d0230 0x7f36f0005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:09.622 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:09.618+0000 7f36fbfff640 1 -- 172.21.15.40:0/1223735626 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3704160d90 con 0x7f36f00047c0 2023-12-17T11:49:09.622 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:09.618+0000 7f36fbfff640 1 -- 172.21.15.40:0/1223735626 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f370415e040 con 0x7f36f0003970 2023-12-17T11:49:09.622 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:09.618+0000 7f36fbfff640 1 -- 172.21.15.40:0/1223735626 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36f000b980 con 0x7f37040d0230 2023-12-17T11:49:09.622 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:09.618+0000 7f3708ab8640 1 --2- 172.21.15.40:0/1223735626 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f36f00047c0 0x7f36f0004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:09.622 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:09.619+0000 7f37092b9640 1 --2- 172.21.15.40:0/1223735626 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f36f0003970 0x7f36f0003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:09.622 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:09.619+0000 7f3709aba640 1 --2- 172.21.15.40:0/1223735626 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f37040d0230 0x7f36f0005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:09.622 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:09.619+0000 7f3708ab8640 1 -- 172.21.15.40:0/1223735626 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f37040d0230 msgr2=0x7f36f0005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:49:09.622 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:09.619+0000 7f3708ab8640 1 --2- 172.21.15.40:0/1223735626 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f37040d0230 0x7f36f0005180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:09.622 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:09.619+0000 7f3708ab8640 1 -- 172.21.15.40:0/1223735626 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f36f0003970 msgr2=0x7f36f0003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:49:09.622 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:09.619+0000 7f3708ab8640 1 --2- 172.21.15.40:0/1223735626 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f36f0003970 0x7f36f0003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:09.623 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:09.619+0000 7f3708ab8640 1 -- 172.21.15.40:0/1223735626 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36f0003520 con 0x7f36f00047c0 2023-12-17T11:49:09.624 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:09.620+0000 7f3708ab8640 1 --2- 172.21.15.40:0/1223735626 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f36f00047c0 0x7f36f0004c40 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f36f400c240 tx=0x7f36f00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2569764248009ec0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:49:09.624 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:09.620+0000 7f36fbfff640 1 -- 172.21.15.40:0/1223735626 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36f402cb00 con 0x7f36f00047c0 2023-12-17T11:49:09.624 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:09.620+0000 7f36fbfff640 1 -- 172.21.15.40:0/1223735626 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36f402cc60 con 0x7f36f00047c0 2023-12-17T11:49:09.624 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:09.620+0000 7f36fbfff640 1 -- 172.21.15.40:0/1223735626 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36f40058d0 con 0x7f36f00047c0 2023-12-17T11:49:09.624 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:09.621+0000 7f370b51d640 1 -- 172.21.15.40:0/1223735626 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f36f00047c0 msgr2=0x7f36f0004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:09.624 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:09.621+0000 7f370b51d640 1 --2- 172.21.15.40:0/1223735626 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f36f00047c0 0x7f36f0004c40 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f36f400c240 tx=0x7f36f00057f0 comp rx=0 tx=0).stop 2023-12-17T11:49:09.624 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:09.621+0000 7f3709aba640 1 -- 172.21.15.40:0/1223735626 reap_dead start 2023-12-17T11:49:09.624 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:09.621+0000 7f370b51d640 1 -- 172.21.15.40:0/1223735626 shutdown_connections 2023-12-17T11:49:09.624 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:09.621+0000 7f370b51d640 1 -- 172.21.15.40:0/1223735626 >> 172.21.15.40:0/1223735626 conn(0x7f370409c450 msgr2=0x7f37040d3110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:49:09.624 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:09.621+0000 7f370b51d640 1 -- 172.21.15.40:0/1223735626 shutdown_connections 2023-12-17T11:49:09.624 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:09.621+0000 7f370b51d640 1 -- 172.21.15.40:0/1223735626 wait complete. 2023-12-17T11:49:09.625 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:09.623+0000 7f370b51d640 1 Processor -- start 2023-12-17T11:49:09.625 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:09.623+0000 7f370b51d640 1 -- start start 2023-12-17T11:49:09.627 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:09.624+0000 7f370b51d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f36f00047c0 0x7f370415f710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:09.627 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:09.624+0000 7f370b51d640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f37041588c0 0x7f37041577a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:09.627 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:09.624+0000 7f370b51d640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3704158370 0x7f3704157ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:09.627 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:09.624+0000 7f370b51d640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37040c7da0 con 0x7f36f00047c0 2023-12-17T11:49:09.627 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:09.624+0000 7f370b51d640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37040c8080 con 0x7f3704158370 2023-12-17T11:49:09.627 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:09.624+0000 7f370b51d640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37040c8360 con 0x7f37041588c0 2023-12-17T11:49:09.627 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:09.624+0000 7f37092b9640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f36f00047c0 0x7f370415f710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:09.627 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:09.624+0000 7f37092b9640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f36f00047c0 0x7f370415f710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:41308/0 (socket says 172.21.15.40:41308) 2023-12-17T11:49:09.627 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:09.624+0000 7f37092b9640 1 -- 172.21.15.40:0/830638452 learned_addr learned my addr 172.21.15.40:0/830638452 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-17T11:49:09.627 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:09.625+0000 7f3709aba640 1 --2- 172.21.15.40:0/830638452 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3704158370 0x7f3704157ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:09.627 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:09.625+0000 7f37092b9640 1 -- 172.21.15.40:0/830638452 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f37041588c0 msgr2=0x7f37041577a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:09.628 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:09.625+0000 7f37092b9640 1 --2- 172.21.15.40:0/830638452 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f37041588c0 0x7f37041577a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:09.628 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:09.625+0000 7f37092b9640 1 -- 172.21.15.40:0/830638452 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3704158370 msgr2=0x7f3704157ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:09.628 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:09.625+0000 7f37092b9640 1 --2- 172.21.15.40:0/830638452 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3704158370 0x7f3704157ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:09.628 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:09.625+0000 7f37092b9640 1 -- 172.21.15.40:0/830638452 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37040c8640 con 0x7f36f00047c0 2023-12-17T11:49:09.628 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:09.625+0000 7f3709aba640 1 --2- 172.21.15.40:0/830638452 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3704158370 0x7f3704157ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-17T11:49:09.628 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:09.625+0000 7f37092b9640 1 --2- 172.21.15.40:0/830638452 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f36f00047c0 0x7f370415f710 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f3700011600 tx=0x7f3700011ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:49:09.629 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:09.625+0000 7f36f9ffb640 1 -- 172.21.15.40:0/830638452 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f370000f920 con 0x7f36f00047c0 2023-12-17T11:49:09.629 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:09.625+0000 7f36f9ffb640 1 -- 172.21.15.40:0/830638452 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f370000fa80 con 0x7f36f00047c0 2023-12-17T11:49:09.629 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:09.625+0000 7f36f9ffb640 1 -- 172.21.15.40:0/830638452 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f370000fdf0 con 0x7f36f00047c0 2023-12-17T11:49:09.629 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:09.625+0000 7f370b51d640 1 -- 172.21.15.40:0/830638452 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37040c8920 con 0x7f36f00047c0 2023-12-17T11:49:09.629 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:09.626+0000 7f370b51d640 1 -- 172.21.15.40:0/830638452 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37040c8e40 con 0x7f36f00047c0 2023-12-17T11:49:09.629 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:09.627+0000 7f370b51d640 1 -- 172.21.15.40:0/830638452 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37040c8ab0 con 0x7f36f00047c0 2023-12-17T11:49:09.629 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:09.628+0000 7f36f9ffb640 1 -- 172.21.15.40:0/830638452 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f3700015460 con 0x7f36f00047c0 2023-12-17T11:49:09.630 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:09.628+0000 7f36f9ffb640 1 --2- 172.21.15.40:0/830638452 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f36e806ae40 0x7f36e806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:09.630 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:09.629+0000 7f36f9ffb640 1 -- 172.21.15.40:0/830638452 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f3700089ed0 con 0x7f36f00047c0 2023-12-17T11:49:09.631 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:09.629+0000 7f3708ab8640 1 --2- 172.21.15.40:0/830638452 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f36e806ae40 0x7f36e806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:09.632 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:09.630+0000 7f3708ab8640 1 --2- 172.21.15.40:0/830638452 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f36e806ae40 0x7f36e806d300 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f36f4034000 tx=0x7f36f402e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:49:09.634 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:09.633+0000 7f36f9ffb640 1 -- 172.21.15.40:0/830638452 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f3700054ba0 con 0x7f36f00047c0 2023-12-17T11:49:09.832 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:09.830+0000 7f370b51d640 1 -- 172.21.15.40:0/830638452 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f37040745d0 con 0x7f36f00047c0 2023-12-17T11:49:09.834 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:09.832+0000 7f36f9ffb640 1 -- 172.21.15.40:0/830638452 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+18697 (secure 0 0 0) 0x7f3700022090 con 0x7f36f00047c0 2023-12-17T11:49:09.835 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T11:49:09.835 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":27,"fsid":"099cd35d-80d9-4ca4-8424-de13b3b03ac7","created":"2023-12-17T11:47:53.450097+0000","modified":"2023-12-17T11:49:00.483840+0000","last_up_change":"2023-12-17T11:48:05.724195+0000","last_in_change":"2023-12-17T11:47:56.956499+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-17T11:48:06.668943+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-17T11:48:16.151444+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-17T11:48:16.717726+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-17T11:48:20.534819+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a88bfd46-63b8-48b1-9c0e-5c9cdc31bd38","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":555204741},{"type":"v1","addr":"172.21.15.40:6802","nonce":555204741}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":555204741},{"type":"v1","addr":"172.21.15.40:6807","nonce":555204741}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":555204741},{"type":"v1","addr":"172.21.15.40:6815","nonce":555204741}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6809","nonce":555204741},{"type":"v1","addr":"172.21.15.40:6812","nonce":555204741}]},"public_addr":"172.21.15.40:6802/555204741","cluster_addr":"172.21.15.40:6807/555204741","heartbeat_back_addr":"172.21.15.40:6815/555204741","heartbeat_front_addr":"172.21.15.40:6812/555204741","state":["exists","up"]},{"osd":1,"uuid":"c5d628ae-36f4-4866-802c-b162f0e90add","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6801","nonce":1221318112},{"type":"v1","addr":"172.21.15.40:6803","nonce":1221318112}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6805","nonce":1221318112},{"type":"v1","addr":"172.21.15.40:6806","nonce":1221318112}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6811","nonce":1221318112},{"type":"v1","addr":"172.21.15.40:6813","nonce":1221318112}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":1221318112},{"type":"v1","addr":"172.21.15.40:6810","nonce":1221318112}]},"public_addr":"172.21.15.40:6803/1221318112","cluster_addr":"172.21.15.40:6806/1221318112","heartbeat_back_addr":"172.21.15.40:6813/1221318112","heartbeat_front_addr":"172.21.15.40:6810/1221318112","state":["exists","up"]},{"osd":2,"uuid":"d986ad6a-af2f-47fc-9c3b-fbda27b82b73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":1959000265},{"type":"v1","addr":"172.21.15.40:6817","nonce":1959000265}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6818","nonce":1959000265},{"type":"v1","addr":"172.21.15.40:6819","nonce":1959000265}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":1959000265},{"type":"v1","addr":"172.21.15.40:6827","nonce":1959000265}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":1959000265},{"type":"v1","addr":"172.21.15.40:6822","nonce":1959000265}]},"public_addr":"172.21.15.40:6817/1959000265","cluster_addr":"172.21.15.40:6819/1959000265","heartbeat_back_addr":"172.21.15.40:6827/1959000265","heartbeat_front_addr":"172.21.15.40:6822/1959000265","state":["exists","up"]},{"osd":3,"uuid":"d79d22b7-be05-41b2-b95d-697db677fd02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6821","nonce":974040287},{"type":"v1","addr":"172.21.15.40:6823","nonce":974040287}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6825","nonce":974040287},{"type":"v1","addr":"172.21.15.40:6826","nonce":974040287}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":974040287},{"type":"v1","addr":"172.21.15.40:6831","nonce":974040287}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":974040287},{"type":"v1","addr":"172.21.15.40:6829","nonce":974040287}]},"public_addr":"172.21.15.40:6823/974040287","cluster_addr":"172.21.15.40:6826/974040287","heartbeat_back_addr":"172.21.15.40:6831/974040287","heartbeat_front_addr":"172.21.15.40:6829/974040287","state":["exists","up"]},{"osd":4,"uuid":"62a7a233-d3ea-40be-91de-180c0208d639","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6808","nonce":3937787733},{"type":"v1","addr":"172.21.15.159:6809","nonce":3937787733}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6810","nonce":3937787733},{"type":"v1","addr":"172.21.15.159:6811","nonce":3937787733}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6814","nonce":3937787733},{"type":"v1","addr":"172.21.15.159:6815","nonce":3937787733}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6812","nonce":3937787733},{"type":"v1","addr":"172.21.15.159:6813","nonce":3937787733}]},"public_addr":"172.21.15.159:6809/3937787733","cluster_addr":"172.21.15.159:6811/3937787733","heartbeat_back_addr":"172.21.15.159:6815/3937787733","heartbeat_front_addr":"172.21.15.159:6813/3937787733","state":["exists","up"]},{"osd":5,"uuid":"84629cea-dc0e-4b5e-b203-5ea963839281","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6816","nonce":3032505240},{"type":"v1","addr":"172.21.15.159:6817","nonce":3032505240}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6818","nonce":3032505240},{"type":"v1","addr":"172.21.15.159:6819","nonce":3032505240}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6822","nonce":3032505240},{"type":"v1","addr":"172.21.15.159:6823","nonce":3032505240}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6820","nonce":3032505240},{"type":"v1","addr":"172.21.15.159:6821","nonce":3032505240}]},"public_addr":"172.21.15.159:6817/3032505240","cluster_addr":"172.21.15.159:6819/3032505240","heartbeat_back_addr":"172.21.15.159:6823/3032505240","heartbeat_front_addr":"172.21.15.159:6821/3032505240","state":["exists","up"]},{"osd":6,"uuid":"4ae3af3a-1743-4070-a91d-8be5c31cdb04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6800","nonce":2411788597},{"type":"v1","addr":"172.21.15.159:6801","nonce":2411788597}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6802","nonce":2411788597},{"type":"v1","addr":"172.21.15.159:6803","nonce":2411788597}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6806","nonce":2411788597},{"type":"v1","addr":"172.21.15.159:6807","nonce":2411788597}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6804","nonce":2411788597},{"type":"v1","addr":"172.21.15.159:6805","nonce":2411788597}]},"public_addr":"172.21.15.159:6801/2411788597","cluster_addr":"172.21.15.159:6803/2411788597","heartbeat_back_addr":"172.21.15.159:6807/2411788597","heartbeat_front_addr":"172.21.15.159:6805/2411788597","state":["exists","up"]},{"osd":7,"uuid":"c1f4c7f2-8f75-4f95-bc63-a332773e3b8e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6824","nonce":478953349},{"type":"v1","addr":"172.21.15.159:6825","nonce":478953349}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6826","nonce":478953349},{"type":"v1","addr":"172.21.15.159:6827","nonce":478953349}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6830","nonce":478953349},{"type":"v1","addr":"172.21.15.159:6831","nonce":478953349}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6828","nonce":478953349},{"type":"v1","addr":"172.21.15.159:6829","nonce":478953349}]},"public_addr":"172.21.15.159:6825/478953349","cluster_addr":"172.21.15.159:6827/478953349","heartbeat_back_addr":"172.21.15.159:6831/478953349","heartbeat_front_addr":"172.21.15.159:6829/478953349","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T11:48:02.023567+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T11:48:02.278216+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T11:48:02.311843+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T11:48:01.773372+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T11:48:02.618910+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T11:48:02.361559+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T11:48:02.223997+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T11:48:02.604403+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.2","mappings":[{"from":3,"to":2}]},{"pgid":"3.d","mappings":[{"from":5,"to":1}]},{"pgid":"3.13","mappings":[{"from":7,"to":2}]},{"pgid":"3.17","mappings":[{"from":0,"to":2}]},{"pgid":"3.38","mappings":[{"from":5,"to":1}]},{"pgid":"4.2","mappings":[{"from":1,"to":2}]},{"pgid":"4.10","mappings":[{"from":1,"to":2}]},{"pgid":"4.18","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-17T11:49:09.837 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:09.835+0000 7f370b51d640 1 -- 172.21.15.40:0/830638452 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f36e806ae40 msgr2=0x7f36e806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:09.838 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:09.835+0000 7f370b51d640 1 --2- 172.21.15.40:0/830638452 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f36e806ae40 0x7f36e806d300 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f36f4034000 tx=0x7f36f402e000 comp rx=0 tx=0).stop 2023-12-17T11:49:09.838 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:09.835+0000 7f370b51d640 1 -- 172.21.15.40:0/830638452 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f36f00047c0 msgr2=0x7f370415f710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:09.838 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:09.835+0000 7f370b51d640 1 --2- 172.21.15.40:0/830638452 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f36f00047c0 0x7f370415f710 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f3700011600 tx=0x7f3700011ac0 comp rx=0 tx=0).stop 2023-12-17T11:49:09.838 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:09.835+0000 7f370b51d640 1 -- 172.21.15.40:0/830638452 shutdown_connections 2023-12-17T11:49:09.838 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:09.835+0000 7f370b51d640 1 --2- 172.21.15.40:0/830638452 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f36e806ae40 0x7f36e806d300 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:09.838 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:09.835+0000 7f370b51d640 1 --2- 172.21.15.40:0/830638452 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3704158370 0x7f3704157ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:09.838 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:09.835+0000 7f370b51d640 1 --2- 172.21.15.40:0/830638452 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f37041588c0 0x7f37041577a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:09.838 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:09.835+0000 7f370b51d640 1 --2- 172.21.15.40:0/830638452 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f36f00047c0 0x7f370415f710 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:09.838 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:09.835+0000 7f370b51d640 1 -- 172.21.15.40:0/830638452 >> 172.21.15.40:0/830638452 conn(0x7f370409c450 msgr2=0x7f37040ce910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:49:09.838 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:09.835+0000 7f370b51d640 1 -- 172.21.15.40:0/830638452 shutdown_connections 2023-12-17T11:49:09.838 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:09.835+0000 7f370b51d640 1 -- 172.21.15.40:0/830638452 wait complete. 2023-12-17T11:49:09.857 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-17T11:48:06.668943+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-17T11:48:16.151444+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-17T11:48:16.717726+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-12-17T11:48:20.534819+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-12-17T11:49:09.857 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-17T11:49:10.085 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:10.083+0000 7f36ae1db640 1 Processor -- start 2023-12-17T11:49:10.085 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:10.083+0000 7f36ae1db640 1 -- start start 2023-12-17T11:49:10.086 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:10.084+0000 7f36ae1db640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f36a80cfe70 0x7f36a8168530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:10.086 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:10.084+0000 7f36ae1db640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36a80c6b80 con 0x7f36a80b3350 2023-12-17T11:49:10.086 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:10.084+0000 7f36ae1db640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36a80d3bf0 con 0x7f36a80b3730 2023-12-17T11:49:10.086 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:10.084+0000 7f36ae1db640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36a80d3ed0 con 0x7f36a80cfe70 2023-12-17T11:49:10.086 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:10.084+0000 7f36ad1d9640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f36a80b3350 0x7f36a80b3ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:55258/0 (socket says 172.21.15.40:55258) 2023-12-17T11:49:10.087 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:10.084+0000 7f36ad1d9640 1 -- 172.21.15.40:0/2738068116 learned_addr learned my addr 172.21.15.40:0/2738068116 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-12-17T11:49:10.088 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:10.085+0000 7f36a7fff640 1 -- 172.21.15.40:0/2738068116 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 45462507 0 0) 0x7f36a80c6b80 con 0x7f36a80b3350 2023-12-17T11:49:10.088 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:10.085+0000 7f36ad9da640 1 --2- 172.21.15.40:0/2738068116 >> v2:172.21.15.159:3300/0 conn(0x7f36a80cfe70 0x7f36a8168530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:10.089 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:10.085+0000 7f36a7fff640 1 -- 172.21.15.40:0/2738068116 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3690003520 con 0x7f36a80b3350 2023-12-17T11:49:10.089 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:10.085+0000 7f36a7fff640 1 -- 172.21.15.40:0/2738068116 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1285656044 0 0) 0x7f3690003520 con 0x7f36a80b3350 2023-12-17T11:49:10.089 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:10.085+0000 7f36a7fff640 1 -- 172.21.15.40:0/2738068116 >> v2:172.21.15.159:3300/0 conn(0x7f36a80cfe70 msgr2=0x7f36a8168530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:49:10.089 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:10.085+0000 7f36a7fff640 1 --2- 172.21.15.40:0/2738068116 >> v2:172.21.15.159:3300/0 conn(0x7f36a80cfe70 0x7f36a8168530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:10.089 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:10.085+0000 7f36a7fff640 1 -- 172.21.15.40:0/2738068116 >> v1:172.21.15.159:6789/0 conn(0x7f36a80b3730 legacy=0x7f36a80cf760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:49:10.089 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:10.085+0000 7f36a7fff640 1 -- 172.21.15.40:0/2738068116 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36a80d18c0 con 0x7f36a80b3350 2023-12-17T11:49:10.089 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:10.085+0000 7f36a7fff640 1 -- 172.21.15.40:0/2738068116 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2643242555 0 0) 0x7f36980019f0 con 0x7f36a80b3350 2023-12-17T11:49:10.089 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:10.085+0000 7f36a7fff640 1 -- 172.21.15.40:0/2738068116 >> v1:172.21.15.40:6789/0 conn(0x7f36a80b3350 legacy=0x7f36a80b3ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:10.089 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:10.085+0000 7f36a7fff640 1 --2- 172.21.15.40:0/2738068116 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f36900039c0 0x7f3690003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:10.089 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:10.085+0000 7f36a7fff640 1 --2- 172.21.15.40:0/2738068116 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f36900047c0 0x7f3690004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:10.089 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:10.085+0000 7f36a7fff640 1 --2- 172.21.15.40:0/2738068116 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f36900051d0 0x7f369000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:10.089 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:10.085+0000 7f36a7fff640 1 -- 172.21.15.40:0/2738068116 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36a80d3ed0 con 0x7f36900051d0 2023-12-17T11:49:10.090 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:10.086+0000 7f36a7fff640 1 -- 172.21.15.40:0/2738068116 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f369000c100 con 0x7f36900039c0 2023-12-17T11:49:10.090 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:10.086+0000 7f36a7fff640 1 -- 172.21.15.40:0/2738068116 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f369000c2c0 con 0x7f36900047c0 2023-12-17T11:49:10.090 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:10.086+0000 7f36ad9da640 1 --2- 172.21.15.40:0/2738068116 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f36900051d0 0x7f369000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:10.090 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:10.086+0000 7f36ad1d9640 1 --2- 172.21.15.40:0/2738068116 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f36900039c0 0x7f3690003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:10.090 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:10.086+0000 7f36ac9d8640 1 --2- 172.21.15.40:0/2738068116 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f36900047c0 0x7f3690004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:10.090 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:10.086+0000 7f36ad9da640 1 -- 172.21.15.40:0/2738068116 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f36900047c0 msgr2=0x7f3690004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:49:10.090 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:10.086+0000 7f36ad9da640 1 --2- 172.21.15.40:0/2738068116 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f36900047c0 0x7f3690004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:10.090 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:10.086+0000 7f36ad9da640 1 -- 172.21.15.40:0/2738068116 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f36900039c0 msgr2=0x7f3690003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:49:10.090 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:10.086+0000 7f36ad9da640 1 --2- 172.21.15.40:0/2738068116 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f36900039c0 0x7f3690003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:10.090 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:10.086+0000 7f36ad9da640 1 -- 172.21.15.40:0/2738068116 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3690003520 con 0x7f36900051d0 2023-12-17T11:49:10.090 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:10.086+0000 7f36ac9d8640 1 --2- 172.21.15.40:0/2738068116 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f36900047c0 0x7f3690004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-17T11:49:10.091 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:10.087+0000 7f36ad9da640 1 -- 172.21.15.40:0/2738068116 reap_dead start 2023-12-17T11:49:10.092 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:10.087+0000 7f36ad9da640 1 --2- 172.21.15.40:0/2738068116 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f36900051d0 0x7f369000b980 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f36a808c450 tx=0x7f36900057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5607693728fd2f63 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:49:10.092 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:10.088+0000 7f36a7fff640 1 -- 172.21.15.40:0/2738068116 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36a0032630 con 0x7f36900051d0 2023-12-17T11:49:10.092 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:10.088+0000 7f36a7fff640 1 -- 172.21.15.40:0/2738068116 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36a0032790 con 0x7f36900051d0 2023-12-17T11:49:10.092 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:10.088+0000 7f36a7fff640 1 -- 172.21.15.40:0/2738068116 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36a0032b20 con 0x7f36900051d0 2023-12-17T11:49:10.092 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:10.088+0000 7f36ae1db640 1 -- 172.21.15.40:0/2738068116 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f36900051d0 msgr2=0x7f369000b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:10.092 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:10.088+0000 7f36ae1db640 1 --2- 172.21.15.40:0/2738068116 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f36900051d0 0x7f369000b980 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f36a808c450 tx=0x7f36900057f0 comp rx=0 tx=0).stop 2023-12-17T11:49:10.092 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:10.088+0000 7f36ae1db640 1 -- 172.21.15.40:0/2738068116 shutdown_connections 2023-12-17T11:49:10.092 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:10.088+0000 7f36ae1db640 1 --2- 172.21.15.40:0/2738068116 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f36900051d0 0x7f369000b980 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:10.092 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:10.088+0000 7f36ae1db640 1 -- 172.21.15.40:0/2738068116 >> 172.21.15.40:0/2738068116 conn(0x7f36a80d3030 msgr2=0x7f36a80d3440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:49:10.093 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:10.088+0000 7f36ae1db640 1 -- 172.21.15.40:0/2738068116 shutdown_connections 2023-12-17T11:49:10.093 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:10.088+0000 7f36ae1db640 1 -- 172.21.15.40:0/2738068116 wait complete. 2023-12-17T11:49:10.094 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:10.090+0000 7f36ae1db640 1 Processor -- start 2023-12-17T11:49:10.094 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:10.090+0000 7f36ae1db640 1 -- start start 2023-12-17T11:49:10.094 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:10.091+0000 7f36ae1db640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f36900051d0 0x7f36a80cb1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:10.094 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:10.091+0000 7f36ae1db640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f36a815bba0 0x7f36a80b83c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:10.094 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:10.091+0000 7f36ae1db640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f36a80b8900 0x7f36a81e3d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:10.094 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:10.091+0000 7f36ae1db640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36a80cad80 con 0x7f36900051d0 2023-12-17T11:49:10.094 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:10.091+0000 7f36ae1db640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36a80ca100 con 0x7f36a80b8900 2023-12-17T11:49:10.094 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:10.091+0000 7f36ae1db640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36a80ca3e0 con 0x7f36a815bba0 2023-12-17T11:49:10.094 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:10.092+0000 7f36ad1d9640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f36900051d0 0x7f36a80cb1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:10.095 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:10.092+0000 7f36ad1d9640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f36900051d0 0x7f36a80cb1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:41318/0 (socket says 172.21.15.40:41318) 2023-12-17T11:49:10.095 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:10.092+0000 7f36ad1d9640 1 -- 172.21.15.40:0/3158770152 learned_addr learned my addr 172.21.15.40:0/3158770152 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-17T11:49:10.095 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:10.092+0000 7f36ad1d9640 1 -- 172.21.15.40:0/3158770152 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f36a815bba0 msgr2=0x7f36a80b83c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:10.095 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:10.092+0000 7f36ad1d9640 1 --2- 172.21.15.40:0/3158770152 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f36a815bba0 0x7f36a80b83c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:10.095 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:10.092+0000 7f36ad1d9640 1 -- 172.21.15.40:0/3158770152 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f36a80b8900 msgr2=0x7f36a81e3d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:10.095 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:10.092+0000 7f36ad1d9640 1 --2- 172.21.15.40:0/3158770152 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f36a80b8900 0x7f36a81e3d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:10.095 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:10.092+0000 7f36ad1d9640 1 -- 172.21.15.40:0/3158770152 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36a80b48a0 con 0x7f36900051d0 2023-12-17T11:49:10.095 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:10.092+0000 7f36ad1d9640 1 --2- 172.21.15.40:0/3158770152 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f36900051d0 0x7f36a80cb1a0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f3698007a10 tx=0x7f369800e530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:49:10.096 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:10.092+0000 7f36a5ffb640 1 -- 172.21.15.40:0/3158770152 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36980019d0 con 0x7f36900051d0 2023-12-17T11:49:10.096 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:10.093+0000 7f36a5ffb640 1 -- 172.21.15.40:0/3158770152 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f369800ee50 con 0x7f36900051d0 2023-12-17T11:49:10.096 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:10.093+0000 7f36a5ffb640 1 -- 172.21.15.40:0/3158770152 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3698013620 con 0x7f36900051d0 2023-12-17T11:49:10.096 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:10.093+0000 7f36ae1db640 1 -- 172.21.15.40:0/3158770152 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36a80ca6c0 con 0x7f36900051d0 2023-12-17T11:49:10.096 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:10.093+0000 7f36ae1db640 1 -- 172.21.15.40:0/3158770152 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36a815c020 con 0x7f36900051d0 2023-12-17T11:49:10.096 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:10.094+0000 7f36ae1db640 1 -- 172.21.15.40:0/3158770152 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36a8074450 con 0x7f36900051d0 2023-12-17T11:49:10.097 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:10.095+0000 7f36a5ffb640 1 -- 172.21.15.40:0/3158770152 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f3698013780 con 0x7f36900051d0 2023-12-17T11:49:10.097 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:10.096+0000 7f36a5ffb640 1 --2- 172.21.15.40:0/3158770152 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f369406ae70 0x7f369406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:10.097 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:10.096+0000 7f36a5ffb640 1 -- 172.21.15.40:0/3158770152 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f369808a0d0 con 0x7f36900051d0 2023-12-17T11:49:10.098 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:10.096+0000 7f36ac9d8640 1 --2- 172.21.15.40:0/3158770152 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f369406ae70 0x7f369406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:10.099 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:10.097+0000 7f36ac9d8640 1 --2- 172.21.15.40:0/3158770152 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f369406ae70 0x7f369406d330 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f36a81e4900 tx=0x7f369c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:49:10.102 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:10.100+0000 7f36a5ffb640 1 -- 172.21.15.40:0/3158770152 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f3698054d00 con 0x7f36900051d0 2023-12-17T11:49:10.296 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:10.294+0000 7f36ae1db640 1 -- 172.21.15.40:0/3158770152 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f36a80c8330 con 0x7f36900051d0 2023-12-17T11:49:10.297 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:10.295+0000 7f36a5ffb640 1 -- 172.21.15.40:0/3158770152 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) v1 ==== 93+0+10 (secure 0 0 0) 0x7f3698058320 con 0x7f36900051d0 2023-12-17T11:49:10.297 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 1 2023-12-17T11:49:10.300 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:10.298+0000 7f36ae1db640 1 -- 172.21.15.40:0/3158770152 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f369406ae70 msgr2=0x7f369406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:10.301 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:10.298+0000 7f36ae1db640 1 --2- 172.21.15.40:0/3158770152 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f369406ae70 0x7f369406d330 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f36a81e4900 tx=0x7f369c009040 comp rx=0 tx=0).stop 2023-12-17T11:49:10.301 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:10.298+0000 7f36ae1db640 1 -- 172.21.15.40:0/3158770152 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f36900051d0 msgr2=0x7f36a80cb1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:10.301 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:10.298+0000 7f36ae1db640 1 --2- 172.21.15.40:0/3158770152 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f36900051d0 0x7f36a80cb1a0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f3698007a10 tx=0x7f369800e530 comp rx=0 tx=0).stop 2023-12-17T11:49:10.301 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:10.298+0000 7f36ae1db640 1 -- 172.21.15.40:0/3158770152 shutdown_connections 2023-12-17T11:49:10.301 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:10.298+0000 7f36ae1db640 1 --2- 172.21.15.40:0/3158770152 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f369406ae70 0x7f369406d330 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:10.301 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:10.298+0000 7f36ae1db640 1 --2- 172.21.15.40:0/3158770152 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f36a80b8900 0x7f36a81e3d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:10.301 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:10.298+0000 7f36ae1db640 1 --2- 172.21.15.40:0/3158770152 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f36a815bba0 0x7f36a80b83c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:10.301 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:10.298+0000 7f36ae1db640 1 --2- 172.21.15.40:0/3158770152 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f36900051d0 0x7f36a80cb1a0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:10.301 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:10.298+0000 7f36ae1db640 1 -- 172.21.15.40:0/3158770152 >> 172.21.15.40:0/3158770152 conn(0x7f36a80d3030 msgr2=0x7f36a815d5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:49:10.301 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:10.299+0000 7f36ae1db640 1 -- 172.21.15.40:0/3158770152 shutdown_connections 2023-12-17T11:49:10.301 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:10.299+0000 7f36ae1db640 1 -- 172.21.15.40:0/3158770152 wait complete. 2023-12-17T11:49:10.320 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-17T11:49:10.547 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:10.545+0000 7f415687c640 1 Processor -- start 2023-12-17T11:49:10.548 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:10.545+0000 7f415687c640 1 -- start start 2023-12-17T11:49:10.554 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:10.547+0000 7f415687c640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f415006db50 0x7f4150141250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:10.555 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:10.547+0000 7f415687c640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f415015b780 con 0x7f415006d770 2023-12-17T11:49:10.555 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:10.547+0000 7f415687c640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41500b2510 con 0x7f4150141790 2023-12-17T11:49:10.555 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:10.547+0000 7f415687c640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4150141c20 con 0x7f415006db50 2023-12-17T11:49:10.555 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:10.547+0000 7f414ffff640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f415006d770 0x7f41500b1e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:55272/0 (socket says 172.21.15.40:55272) 2023-12-17T11:49:10.555 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:10.547+0000 7f414ffff640 1 -- 172.21.15.40:0/300748730 learned_addr learned my addr 172.21.15.40:0/300748730 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-12-17T11:49:10.556 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:10.548+0000 7f41477fe640 1 --2- 172.21.15.40:0/300748730 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f415006db50 0x7f4150141250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:10.556 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:10.548+0000 7f414f7fe640 1 -- 172.21.15.40:0/300748730 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1176904105 0 0) 0x7f415015b780 con 0x7f415006d770 2023-12-17T11:49:10.556 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:10.548+0000 7f414f7fe640 1 -- 172.21.15.40:0/300748730 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f413c003520 con 0x7f415006d770 2023-12-17T11:49:10.556 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:10.548+0000 7f414f7fe640 1 -- 172.21.15.40:0/300748730 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3740299656 0 0) 0x7f413c003520 con 0x7f415006d770 2023-12-17T11:49:10.556 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:10.548+0000 7f414f7fe640 1 -- 172.21.15.40:0/300748730 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f415006db50 msgr2=0x7f4150141250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:49:10.556 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:10.548+0000 7f414f7fe640 1 --2- 172.21.15.40:0/300748730 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f415006db50 0x7f4150141250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:10.556 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:10.548+0000 7f414f7fe640 1 -- 172.21.15.40:0/300748730 >> v1:172.21.15.159:6789/0 conn(0x7f4150141790 legacy=0x7f41500cce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:10.556 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:10.548+0000 7f414f7fe640 1 -- 172.21.15.40:0/300748730 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f415015b9d0 con 0x7f415006d770 2023-12-17T11:49:10.556 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:10.548+0000 7f414f7fe640 1 -- 172.21.15.40:0/300748730 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2643242555 0 0) 0x7f4140001670 con 0x7f415006d770 2023-12-17T11:49:10.556 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:10.548+0000 7f414f7fe640 1 -- 172.21.15.40:0/300748730 >> v1:172.21.15.40:6789/0 conn(0x7f415006d770 legacy=0x7f41500b1e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:10.557 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:10.548+0000 7f414f7fe640 1 --2- 172.21.15.40:0/300748730 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f415006db50 0x7f413c0039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:10.557 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:10.548+0000 7f414f7fe640 1 --2- 172.21.15.40:0/300748730 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f413c003fd0 0x7f413c0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:10.557 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:10.548+0000 7f414f7fe640 1 --2- 172.21.15.40:0/300748730 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f413c004d00 0x7f413c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:10.557 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:10.549+0000 7f414f7fe640 1 -- 172.21.15.40:0/300748730 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4150141c20 con 0x7f413c004d00 2023-12-17T11:49:10.557 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:10.549+0000 7f414f7fe640 1 -- 172.21.15.40:0/300748730 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f413c00ff50 con 0x7f413c003fd0 2023-12-17T11:49:10.557 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:10.549+0000 7f414f7fe640 1 -- 172.21.15.40:0/300748730 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f413c010110 con 0x7f415006db50 2023-12-17T11:49:10.557 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:10.549+0000 7f4154e19640 1 --2- 172.21.15.40:0/300748730 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f413c004d00 0x7f413c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:10.558 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:10.549+0000 7f41477fe640 1 --2- 172.21.15.40:0/300748730 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f413c003fd0 0x7f413c0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:10.558 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:10.549+0000 7f414ffff640 1 --2- 172.21.15.40:0/300748730 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f415006db50 0x7f413c0039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:10.558 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:10.549+0000 7f4154e19640 1 -- 172.21.15.40:0/300748730 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f415006db50 msgr2=0x7f413c0039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:49:10.558 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:10.549+0000 7f4154e19640 1 --2- 172.21.15.40:0/300748730 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f415006db50 0x7f413c0039a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:10.558 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:10.549+0000 7f4154e19640 1 -- 172.21.15.40:0/300748730 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f413c003fd0 msgr2=0x7f413c0047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:49:10.558 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:10.549+0000 7f4154e19640 1 --2- 172.21.15.40:0/300748730 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f413c003fd0 0x7f413c0047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:10.558 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:10.549+0000 7f4154e19640 1 -- 172.21.15.40:0/300748730 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f413c003520 con 0x7f413c004d00 2023-12-17T11:49:10.558 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:10.550+0000 7f4154e19640 1 --2- 172.21.15.40:0/300748730 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f413c004d00 0x7f413c005180 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f4148001e50 tx=0x7f413c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80bacc00cc65893b server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:49:10.558 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:10.551+0000 7f414f7fe640 1 -- 172.21.15.40:0/300748730 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4148003b70 con 0x7f413c004d00 2023-12-17T11:49:10.559 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:10.551+0000 7f414f7fe640 1 -- 172.21.15.40:0/300748730 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4148003cd0 con 0x7f413c004d00 2023-12-17T11:49:10.559 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:10.551+0000 7f414f7fe640 1 -- 172.21.15.40:0/300748730 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4148005310 con 0x7f413c004d00 2023-12-17T11:49:10.559 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:10.551+0000 7f415687c640 1 -- 172.21.15.40:0/300748730 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f413c004d00 msgr2=0x7f413c005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:10.559 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:10.551+0000 7f415687c640 1 --2- 172.21.15.40:0/300748730 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f413c004d00 0x7f413c005180 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f4148001e50 tx=0x7f413c0057f0 comp rx=0 tx=0).stop 2023-12-17T11:49:10.559 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:10.551+0000 7f4154e19640 1 -- 172.21.15.40:0/300748730 reap_dead start 2023-12-17T11:49:10.559 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:10.551+0000 7f415687c640 1 -- 172.21.15.40:0/300748730 shutdown_connections 2023-12-17T11:49:10.559 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:10.551+0000 7f415687c640 1 -- 172.21.15.40:0/300748730 >> 172.21.15.40:0/300748730 conn(0x7f41500cb850 msgr2=0x7f41500cbc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:49:10.559 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:10.552+0000 7f415687c640 1 -- 172.21.15.40:0/300748730 shutdown_connections 2023-12-17T11:49:10.560 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:10.552+0000 7f415687c640 1 -- 172.21.15.40:0/300748730 wait complete. 2023-12-17T11:49:10.564 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:10.553+0000 7f415687c640 1 Processor -- start 2023-12-17T11:49:10.564 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:10.553+0000 7f415687c640 1 -- start start 2023-12-17T11:49:10.564 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:10.554+0000 7f415687c640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f413c004d00 0x7f415013bc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:10.564 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:10.554+0000 7f415687c640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f415015a4a0 0x7f415013d590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:10.564 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:10.554+0000 7f415687c640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f415013eda0 0x7f415015ea90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:10.564 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:10.555+0000 7f415687c640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f415015ad20 con 0x7f415013eda0 2023-12-17T11:49:10.564 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:10.555+0000 7f415687c640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f415013dad0 con 0x7f413c004d00 2023-12-17T11:49:10.564 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:10.555+0000 7f415687c640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f415013e910 con 0x7f415015a4a0 2023-12-17T11:49:10.564 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:10.555+0000 7f4154e19640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f415013eda0 0x7f415015ea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:10.565 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:10.555+0000 7f4154e19640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f415013eda0 0x7f415015ea90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:41326/0 (socket says 172.21.15.40:41326) 2023-12-17T11:49:10.565 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:10.555+0000 7f4154e19640 1 -- 172.21.15.40:0/1020793119 learned_addr learned my addr 172.21.15.40:0/1020793119 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-17T11:49:10.565 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:10.555+0000 7f414ffff640 1 --2- 172.21.15.40:0/1020793119 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f413c004d00 0x7f415013bc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:10.565 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:10.555+0000 7f4154e19640 1 -- 172.21.15.40:0/1020793119 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f415015a4a0 msgr2=0x7f415013d590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:10.565 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:10.555+0000 7f4154e19640 1 --2- 172.21.15.40:0/1020793119 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f415015a4a0 0x7f415013d590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:10.565 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:10.555+0000 7f4154e19640 1 -- 172.21.15.40:0/1020793119 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f413c004d00 msgr2=0x7f415013bc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:10.565 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:10.555+0000 7f4154e19640 1 --2- 172.21.15.40:0/1020793119 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f413c004d00 0x7f415013bc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:10.565 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:10.555+0000 7f4154e19640 1 -- 172.21.15.40:0/1020793119 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f415013dd00 con 0x7f415013eda0 2023-12-17T11:49:10.565 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:10.555+0000 7f414ffff640 1 --2- 172.21.15.40:0/1020793119 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f413c004d00 0x7f415013bc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-17T11:49:10.565 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:10.556+0000 7f4154e19640 1 --2- 172.21.15.40:0/1020793119 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f415013eda0 0x7f415015ea90 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f414802c060 tx=0x7f41480014a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:49:10.565 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:10.556+0000 7f414d7fa640 1 -- 172.21.15.40:0/1020793119 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f414803e070 con 0x7f415013eda0 2023-12-17T11:49:10.565 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:10.556+0000 7f414d7fa640 1 -- 172.21.15.40:0/1020793119 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4148003e40 con 0x7f415013eda0 2023-12-17T11:49:10.565 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:10.556+0000 7f415687c640 1 -- 172.21.15.40:0/1020793119 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f415013dfe0 con 0x7f415013eda0 2023-12-17T11:49:10.565 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:10.556+0000 7f414d7fa640 1 -- 172.21.15.40:0/1020793119 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4148006d90 con 0x7f415013eda0 2023-12-17T11:49:10.566 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:10.556+0000 7f415687c640 1 -- 172.21.15.40:0/1020793119 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f415013e5a0 con 0x7f415013eda0 2023-12-17T11:49:10.566 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:10.557+0000 7f415687c640 1 -- 172.21.15.40:0/1020793119 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f415013e760 con 0x7f415013eda0 2023-12-17T11:49:10.566 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:10.558+0000 7f414d7fa640 1 -- 172.21.15.40:0/1020793119 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f4148007030 con 0x7f415013eda0 2023-12-17T11:49:10.566 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:10.559+0000 7f414d7fa640 1 --2- 172.21.15.40:0/1020793119 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f413006ae70 0x7f413006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:10.566 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:10.559+0000 7f414d7fa640 1 -- 172.21.15.40:0/1020793119 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f41480aad00 con 0x7f415013eda0 2023-12-17T11:49:10.566 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:10.559+0000 7f414ffff640 1 --2- 172.21.15.40:0/1020793119 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f413006ae70 0x7f413006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:10.566 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:10.561+0000 7f414ffff640 1 --2- 172.21.15.40:0/1020793119 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f413006ae70 0x7f413006d330 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f41400017a0 tx=0x7f4140009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:49:10.566 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:10.563+0000 7f414d7fa640 1 -- 172.21.15.40:0/1020793119 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f4148075930 con 0x7f415013eda0 2023-12-17T11:49:10.760 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:10.758+0000 7f415687c640 1 -- 172.21.15.40:0/1020793119 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f41500745d0 con 0x7f415013eda0 2023-12-17T11:49:10.761 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:10.759+0000 7f414d7fa640 1 -- 172.21.15.40:0/1020793119 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) v1 ==== 104+0+11 (secure 0 0 0) 0x7f4148048020 con 0x7f415013eda0 2023-12-17T11:49:10.761 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 32 2023-12-17T11:49:10.764 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:10.762+0000 7f415687c640 1 -- 172.21.15.40:0/1020793119 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f413006ae70 msgr2=0x7f413006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:10.764 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:10.762+0000 7f415687c640 1 --2- 172.21.15.40:0/1020793119 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f413006ae70 0x7f413006d330 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f41400017a0 tx=0x7f4140009040 comp rx=0 tx=0).stop 2023-12-17T11:49:10.764 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:10.762+0000 7f415687c640 1 -- 172.21.15.40:0/1020793119 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f415013eda0 msgr2=0x7f415015ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:10.764 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:10.762+0000 7f415687c640 1 --2- 172.21.15.40:0/1020793119 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f415013eda0 0x7f415015ea90 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f414802c060 tx=0x7f41480014a0 comp rx=0 tx=0).stop 2023-12-17T11:49:10.764 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:10.762+0000 7f415687c640 1 -- 172.21.15.40:0/1020793119 shutdown_connections 2023-12-17T11:49:10.764 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:10.762+0000 7f415687c640 1 --2- 172.21.15.40:0/1020793119 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f413006ae70 0x7f413006d330 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:10.765 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:10.762+0000 7f415687c640 1 --2- 172.21.15.40:0/1020793119 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f415013eda0 0x7f415015ea90 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:10.765 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:10.762+0000 7f415687c640 1 --2- 172.21.15.40:0/1020793119 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f415015a4a0 0x7f415013d590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:10.765 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:10.762+0000 7f415687c640 1 --2- 172.21.15.40:0/1020793119 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f413c004d00 0x7f415013bc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:10.765 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:10.762+0000 7f415687c640 1 -- 172.21.15.40:0/1020793119 >> 172.21.15.40:0/1020793119 conn(0x7f41500cb850 msgr2=0x7f4150143d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:49:10.765 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:10.762+0000 7f415687c640 1 -- 172.21.15.40:0/1020793119 shutdown_connections 2023-12-17T11:49:10.765 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:10.762+0000 7f415687c640 1 -- 172.21.15.40:0/1020793119 wait complete. 2023-12-17T11:49:10.784 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-17T11:49:11.016 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:11.014+0000 7f2a685e3640 1 Processor -- start 2023-12-17T11:49:11.016 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:11.014+0000 7f2a685e3640 1 -- start start 2023-12-17T11:49:11.018 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:11.016+0000 7f2a685e3640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2a6015af50 0x7f2a6006c170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:11.018 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:11.016+0000 7f2a685e3640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f2a6006a460 0x7f2a6006a8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:11.018 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:11.016+0000 7f2a685e3640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a60071cd0 con 0x7f2a600ce7e0 2023-12-17T11:49:11.018 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:11.016+0000 7f2a685e3640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a6006ae30 con 0x7f2a6006a460 2023-12-17T11:49:11.018 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:11.016+0000 7f2a685e3640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a600717e0 con 0x7f2a6015af50 2023-12-17T11:49:11.018 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:11.016+0000 7f2a66b80640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f2a6006a460 0x7f2a6006a8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:11.018 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:11.016+0000 7f2a66b80640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f2a6006a460 0x7f2a6006a8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:41330/0 (socket says 172.21.15.40:41330) 2023-12-17T11:49:11.018 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:11.016+0000 7f2a66b80640 1 -- 172.21.15.40:0/2595918769 learned_addr learned my addr 172.21.15.40:0/2595918769 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-17T11:49:11.019 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:11.016+0000 7f2a6637f640 1 --2- 172.21.15.40:0/2595918769 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2a6015af50 0x7f2a6006c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:11.019 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:11.017+0000 7f2a66b80640 1 -- 172.21.15.40:0/2595918769 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2a6015af50 msgr2=0x7f2a6006c170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:49:11.019 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:11.017+0000 7f2a66b80640 1 --2- 172.21.15.40:0/2595918769 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2a6015af50 0x7f2a6006c170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:11.019 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:11.017+0000 7f2a66b80640 1 -- 172.21.15.40:0/2595918769 >> v1:172.21.15.159:6789/0 conn(0x7f2a600ce7e0 legacy=0x7f2a6015ec00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:49:11.019 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:11.017+0000 7f2a66b80640 1 -- 172.21.15.40:0/2595918769 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a6006c6b0 con 0x7f2a6006a460 2023-12-17T11:49:11.020 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:11.018+0000 7f2a66b80640 1 --2- 172.21.15.40:0/2595918769 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2a6006a460 0x7f2a6006a8f0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f2a58009e50 tx=0x7f2a5802bdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea5f08b4e0f0e5dd server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:49:11.021 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:11.019+0000 7f2a6537d640 1 -- 172.21.15.40:0/2595918769 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a5802c950 con 0x7f2a6006a460 2023-12-17T11:49:11.021 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:11.019+0000 7f2a6537d640 1 -- 172.21.15.40:0/2595918769 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a5802cab0 con 0x7f2a6006a460 2023-12-17T11:49:11.021 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:11.019+0000 7f2a6537d640 1 -- 172.21.15.40:0/2595918769 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a5802ce40 con 0x7f2a6006a460 2023-12-17T11:49:11.021 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:11.019+0000 7f2a685e3640 1 -- 172.21.15.40:0/2595918769 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2a6006a460 msgr2=0x7f2a6006a8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:11.021 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:11.019+0000 7f2a685e3640 1 --2- 172.21.15.40:0/2595918769 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2a6006a460 0x7f2a6006a8f0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f2a58009e50 tx=0x7f2a5802bdb0 comp rx=0 tx=0).stop 2023-12-17T11:49:11.022 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:11.020+0000 7f2a685e3640 1 -- 172.21.15.40:0/2595918769 shutdown_connections 2023-12-17T11:49:11.022 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:11.020+0000 7f2a685e3640 1 --2- 172.21.15.40:0/2595918769 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2a6006a460 0x7f2a6006a8f0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:11.022 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:11.020+0000 7f2a685e3640 1 --2- 172.21.15.40:0/2595918769 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2a6015af50 0x7f2a6006c170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:11.022 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:11.020+0000 7f2a685e3640 1 -- 172.21.15.40:0/2595918769 >> 172.21.15.40:0/2595918769 conn(0x7f2a600cee70 msgr2=0x7f2a600cf280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:49:11.022 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:11.020+0000 7f2a685e3640 1 -- 172.21.15.40:0/2595918769 shutdown_connections 2023-12-17T11:49:11.022 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:11.020+0000 7f2a685e3640 1 -- 172.21.15.40:0/2595918769 wait complete. 2023-12-17T11:49:11.024 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:11.022+0000 7f2a685e3640 1 Processor -- start 2023-12-17T11:49:11.024 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:11.022+0000 7f2a685e3640 1 -- start start 2023-12-17T11:49:11.026 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:11.024+0000 7f2a685e3640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2a6006a460 0x7f2a601f2f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:11.026 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:11.024+0000 7f2a685e3640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2a600ce7e0 0x7f2a601510c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:11.026 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:11.024+0000 7f2a685e3640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2a6015af50 0x7f2a600cac40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:11.026 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:11.024+0000 7f2a685e3640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a601596e0 con 0x7f2a600ce7e0 2023-12-17T11:49:11.026 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:11.024+0000 7f2a685e3640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a600c6730 con 0x7f2a6006a460 2023-12-17T11:49:11.026 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:11.024+0000 7f2a685e3640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a600c6a10 con 0x7f2a6015af50 2023-12-17T11:49:11.027 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:11.024+0000 7f2a65b7e640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2a600ce7e0 0x7f2a601510c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:11.027 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:11.024+0000 7f2a65b7e640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2a600ce7e0 0x7f2a601510c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:41346/0 (socket says 172.21.15.40:41346) 2023-12-17T11:49:11.027 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:11.024+0000 7f2a65b7e640 1 -- 172.21.15.40:0/3383495927 learned_addr learned my addr 172.21.15.40:0/3383495927 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-17T11:49:11.028 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:11.024+0000 7f2a66b80640 1 --2- 172.21.15.40:0/3383495927 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2a6015af50 0x7f2a600cac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:11.028 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:11.024+0000 7f2a6637f640 1 --2- 172.21.15.40:0/3383495927 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2a6006a460 0x7f2a601f2f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:11.028 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:11.025+0000 7f2a65b7e640 1 -- 172.21.15.40:0/3383495927 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2a6015af50 msgr2=0x7f2a600cac40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:11.028 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:11.025+0000 7f2a65b7e640 1 --2- 172.21.15.40:0/3383495927 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2a6015af50 0x7f2a600cac40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:11.029 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:11.025+0000 7f2a65b7e640 1 -- 172.21.15.40:0/3383495927 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2a6006a460 msgr2=0x7f2a601f2f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:11.029 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:11.025+0000 7f2a65b7e640 1 --2- 172.21.15.40:0/3383495927 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2a6006a460 0x7f2a601f2f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:11.029 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:11.025+0000 7f2a65b7e640 1 -- 172.21.15.40:0/3383495927 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a58009b30 con 0x7f2a600ce7e0 2023-12-17T11:49:11.029 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:11.025+0000 7f2a66b80640 1 --2- 172.21.15.40:0/3383495927 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2a6015af50 0x7f2a600cac40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-17T11:49:11.029 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:11.025+0000 7f2a6637f640 1 --2- 172.21.15.40:0/3383495927 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2a6006a460 0x7f2a601f2f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-17T11:49:11.029 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:11.025+0000 7f2a65b7e640 1 --2- 172.21.15.40:0/3383495927 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2a600ce7e0 0x7f2a601510c0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f2a5000b3f0 tx=0x7f2a5000b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:49:11.029 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:11.025+0000 7f2a56ffd640 1 -- 172.21.15.40:0/3383495927 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a50011830 con 0x7f2a600ce7e0 2023-12-17T11:49:11.029 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:11.025+0000 7f2a56ffd640 1 -- 172.21.15.40:0/3383495927 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a50011990 con 0x7f2a600ce7e0 2023-12-17T11:49:11.029 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:11.025+0000 7f2a56ffd640 1 -- 172.21.15.40:0/3383495927 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a50011d40 con 0x7f2a600ce7e0 2023-12-17T11:49:11.029 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:11.025+0000 7f2a685e3640 1 -- 172.21.15.40:0/3383495927 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a600c6cf0 con 0x7f2a600ce7e0 2023-12-17T11:49:11.029 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:11.026+0000 7f2a685e3640 1 -- 172.21.15.40:0/3383495927 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a600c72b0 con 0x7f2a600ce7e0 2023-12-17T11:49:11.029 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:11.027+0000 7f2a685e3640 1 -- 172.21.15.40:0/3383495927 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a600c74d0 con 0x7f2a600ce7e0 2023-12-17T11:49:11.030 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:11.027+0000 7f2a56ffd640 1 -- 172.21.15.40:0/3383495927 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f2a5001a400 con 0x7f2a600ce7e0 2023-12-17T11:49:11.030 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:11.028+0000 7f2a56ffd640 1 --2- 172.21.15.40:0/3383495927 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f2a4406ae40 0x7f2a4406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:11.030 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:11.029+0000 7f2a56ffd640 1 -- 172.21.15.40:0/3383495927 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f2a500898d0 con 0x7f2a600ce7e0 2023-12-17T11:49:11.031 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:11.029+0000 7f2a6637f640 1 --2- 172.21.15.40:0/3383495927 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f2a4406ae40 0x7f2a4406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:11.032 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:11.030+0000 7f2a6637f640 1 --2- 172.21.15.40:0/3383495927 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f2a4406ae40 0x7f2a4406d300 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f2a5c006fd0 tx=0x7f2a5c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:49:11.034 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:11.033+0000 7f2a56ffd640 1 -- 172.21.15.40:0/3383495927 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f2a50054500 con 0x7f2a600ce7e0 2023-12-17T11:49:11.228 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:11.226+0000 7f2a685e3640 1 -- 172.21.15.40:0/3383495927 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f2a60074450 con 0x7f2a600ce7e0 2023-12-17T11:49:11.229 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:11.227+0000 7f2a56ffd640 1 -- 172.21.15.40:0/3383495927 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) v1 ==== 100+0+11 (secure 0 0 0) 0x7f2a50057b20 con 0x7f2a600ce7e0 2023-12-17T11:49:11.229 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 64 2023-12-17T11:49:11.232 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:11.229+0000 7f2a685e3640 1 -- 172.21.15.40:0/3383495927 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f2a4406ae40 msgr2=0x7f2a4406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:11.232 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:11.229+0000 7f2a685e3640 1 --2- 172.21.15.40:0/3383495927 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f2a4406ae40 0x7f2a4406d300 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f2a5c006fd0 tx=0x7f2a5c008040 comp rx=0 tx=0).stop 2023-12-17T11:49:11.232 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:11.230+0000 7f2a685e3640 1 -- 172.21.15.40:0/3383495927 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2a600ce7e0 msgr2=0x7f2a601510c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:11.232 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:11.230+0000 7f2a685e3640 1 --2- 172.21.15.40:0/3383495927 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2a600ce7e0 0x7f2a601510c0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f2a5000b3f0 tx=0x7f2a5000b8b0 comp rx=0 tx=0).stop 2023-12-17T11:49:11.232 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:11.230+0000 7f2a685e3640 1 -- 172.21.15.40:0/3383495927 shutdown_connections 2023-12-17T11:49:11.232 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:11.230+0000 7f2a685e3640 1 --2- 172.21.15.40:0/3383495927 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f2a4406ae40 0x7f2a4406d300 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:11.232 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:11.230+0000 7f2a685e3640 1 --2- 172.21.15.40:0/3383495927 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2a6015af50 0x7f2a600cac40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:11.233 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:11.230+0000 7f2a685e3640 1 --2- 172.21.15.40:0/3383495927 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2a600ce7e0 0x7f2a601510c0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:11.233 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:11.230+0000 7f2a685e3640 1 --2- 172.21.15.40:0/3383495927 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2a6006a460 0x7f2a601f2f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:11.233 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:11.230+0000 7f2a685e3640 1 -- 172.21.15.40:0/3383495927 >> 172.21.15.40:0/3383495927 conn(0x7f2a600cee70 msgr2=0x7f2a6015c890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:49:11.233 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:11.230+0000 7f2a685e3640 1 -- 172.21.15.40:0/3383495927 shutdown_connections 2023-12-17T11:49:11.233 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:11.230+0000 7f2a685e3640 1 -- 172.21.15.40:0/3383495927 wait complete. 2023-12-17T11:49:11.252 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-12-17T11:49:11.480 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:11.477+0000 7ffbde4ad640 1 Processor -- start 2023-12-17T11:49:11.480 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:11.478+0000 7ffbde4ad640 1 -- start start 2023-12-17T11:49:11.481 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:11.479+0000 7ffbde4ad640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7ffbd815d360 0x7ffbd80d3660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:11.481 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:11.479+0000 7ffbde4ad640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ffbd80cece0 0x7ffbd80d1530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:11.481 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:11.479+0000 7ffbde4ad640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffbd80cdf20 con 0x7ffbd80d1a70 2023-12-17T11:49:11.482 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:11.479+0000 7ffbde4ad640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffbd80d1f00 con 0x7ffbd815d360 2023-12-17T11:49:11.482 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:11.479+0000 7ffbde4ad640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffbd80ce200 con 0x7ffbd80cece0 2023-12-17T11:49:11.482 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:11.480+0000 7ffbdd4ab640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7ffbd815d360 0x7ffbd80d3660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:11.482 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:11.480+0000 7ffbdccaa640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ffbd80cece0 0x7ffbd80d1530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:11.482 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:11.480+0000 7ffbdd4ab640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7ffbd815d360 0x7ffbd80d3660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.40:42576/0 (socket says 172.21.15.40:42576) 2023-12-17T11:49:11.482 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:11.480+0000 7ffbdd4ab640 1 -- 172.21.15.40:0/2024628526 learned_addr learned my addr 172.21.15.40:0/2024628526 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-17T11:49:11.483 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:11.481+0000 7ffbdccaa640 1 -- 172.21.15.40:0/2024628526 >> v2:172.21.15.159:3300/0 conn(0x7ffbd815d360 msgr2=0x7ffbd80d3660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:49:11.483 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:11.481+0000 7ffbdccaa640 1 --2- 172.21.15.40:0/2024628526 >> v2:172.21.15.159:3300/0 conn(0x7ffbd815d360 0x7ffbd80d3660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:11.483 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:11.481+0000 7ffbdccaa640 1 -- 172.21.15.40:0/2024628526 >> v1:172.21.15.159:6789/0 conn(0x7ffbd80d1a70 legacy=0x7ffbd8160f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:11.483 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:11.481+0000 7ffbdccaa640 1 -- 172.21.15.40:0/2024628526 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffbd80ce4e0 con 0x7ffbd80cece0 2023-12-17T11:49:11.483 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:11.481+0000 7ffbdd4ab640 1 --2- 172.21.15.40:0/2024628526 >> v2:172.21.15.159:3300/0 conn(0x7ffbd815d360 0x7ffbd80d3660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-17T11:49:11.483 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:11.481+0000 7ffbcffff640 1 -- 172.21.15.40:0/2024628526 <== mon.1 v1:172.21.15.159:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2419240798 0 0) 0x7ffbd80cdf20 con 0x7ffbd80d1a70 2023-12-17T11:49:11.484 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:11.483+0000 7ffbdccaa640 1 --2- 172.21.15.40:0/2024628526 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ffbd80cece0 0x7ffbd80d1530 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7ffbc80097a0 tx=0x7ffbc802b940 comp rx=0 tx=0).ready entity=mon.2 client_cookie=83bd76df889b0dc8 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:49:11.485 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:11.483+0000 7ffbcffff640 1 -- 172.21.15.40:0/2024628526 <== mon.2 v2:172.21.15.159:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbc8030800 con 0x7ffbd80cece0 2023-12-17T11:49:11.485 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:11.483+0000 7ffbcffff640 1 -- 172.21.15.40:0/2024628526 <== mon.2 v2:172.21.15.159:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffbc8030960 con 0x7ffbd80cece0 2023-12-17T11:49:11.485 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:11.483+0000 7ffbcffff640 1 -- 172.21.15.40:0/2024628526 <== mon.2 v2:172.21.15.159:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbc8030cf0 con 0x7ffbd80cece0 2023-12-17T11:49:11.486 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:11.484+0000 7ffbde4ad640 1 -- 172.21.15.40:0/2024628526 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ffbd80cece0 msgr2=0x7ffbd80d1530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:11.486 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:11.484+0000 7ffbde4ad640 1 --2- 172.21.15.40:0/2024628526 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ffbd80cece0 0x7ffbd80d1530 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7ffbc80097a0 tx=0x7ffbc802b940 comp rx=0 tx=0).stop 2023-12-17T11:49:11.486 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:11.484+0000 7ffbde4ad640 1 -- 172.21.15.40:0/2024628526 shutdown_connections 2023-12-17T11:49:11.486 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:11.484+0000 7ffbde4ad640 1 --2- 172.21.15.40:0/2024628526 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ffbd80cece0 0x7ffbd80d1530 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:11.486 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:11.484+0000 7ffbde4ad640 1 --2- 172.21.15.40:0/2024628526 >> v2:172.21.15.159:3300/0 conn(0x7ffbd815d360 0x7ffbd80d3660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:11.486 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:11.484+0000 7ffbde4ad640 1 -- 172.21.15.40:0/2024628526 >> 172.21.15.40:0/2024628526 conn(0x7ffbd809c230 msgr2=0x7ffbd80d2f50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:49:11.486 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:11.484+0000 7ffbde4ad640 1 -- 172.21.15.40:0/2024628526 shutdown_connections 2023-12-17T11:49:11.486 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:11.484+0000 7ffbde4ad640 1 -- 172.21.15.40:0/2024628526 wait complete. 2023-12-17T11:49:11.487 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:11.486+0000 7ffbde4ad640 1 Processor -- start 2023-12-17T11:49:11.488 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:11.486+0000 7ffbde4ad640 1 -- start start 2023-12-17T11:49:11.489 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:11.487+0000 7ffbde4ad640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ffbd80cece0 0x7ffbd80b8010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:11.489 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:11.487+0000 7ffbde4ad640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ffbd80d1a70 0x7ffbd80ca020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:11.489 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:11.487+0000 7ffbde4ad640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffbd815d360 0x7ffbd80ca560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:11.489 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:11.487+0000 7ffbde4ad640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbd81f32a0 con 0x7ffbd815d360 2023-12-17T11:49:11.489 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:11.487+0000 7ffbde4ad640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbd8161590 con 0x7ffbd80d1a70 2023-12-17T11:49:11.489 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:11.487+0000 7ffbde4ad640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffbd8160cf0 con 0x7ffbd80cece0 2023-12-17T11:49:11.489 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:11.487+0000 7ffbddcac640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffbd815d360 0x7ffbd80ca560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:11.489 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:11.487+0000 7ffbddcac640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffbd815d360 0x7ffbd80ca560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:41354/0 (socket says 172.21.15.40:41354) 2023-12-17T11:49:11.490 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:11.487+0000 7ffbddcac640 1 -- 172.21.15.40:0/3698938823 learned_addr learned my addr 172.21.15.40:0/3698938823 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-17T11:49:11.491 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:11.487+0000 7ffbdd4ab640 1 --2- 172.21.15.40:0/3698938823 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ffbd80cece0 0x7ffbd80b8010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:11.491 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:11.487+0000 7ffbddcac640 1 -- 172.21.15.40:0/3698938823 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ffbd80cece0 msgr2=0x7ffbd80b8010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:11.491 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:11.487+0000 7ffbdccaa640 1 --2- 172.21.15.40:0/3698938823 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ffbd80d1a70 0x7ffbd80ca020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:11.491 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:11.488+0000 7ffbddcac640 1 --2- 172.21.15.40:0/3698938823 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ffbd80cece0 0x7ffbd80b8010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:11.491 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:11.488+0000 7ffbddcac640 1 -- 172.21.15.40:0/3698938823 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ffbd80d1a70 msgr2=0x7ffbd80ca020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:11.491 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:11.488+0000 7ffbddcac640 1 --2- 172.21.15.40:0/3698938823 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ffbd80d1a70 0x7ffbd80ca020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:11.491 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:11.488+0000 7ffbddcac640 1 -- 172.21.15.40:0/3698938823 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffbd4009b30 con 0x7ffbd815d360 2023-12-17T11:49:11.491 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:11.488+0000 7ffbdd4ab640 1 --2- 172.21.15.40:0/3698938823 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ffbd80cece0 0x7ffbd80b8010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-17T11:49:11.491 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:11.488+0000 7ffbddcac640 1 --2- 172.21.15.40:0/3698938823 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffbd815d360 0x7ffbd80ca560 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7ffbd000c410 tx=0x7ffbd000c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:49:11.491 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:11.488+0000 7ffbcdffb640 1 -- 172.21.15.40:0/3698938823 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbd00035f0 con 0x7ffbd815d360 2023-12-17T11:49:11.491 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:11.488+0000 7ffbcdffb640 1 -- 172.21.15.40:0/3698938823 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffbd0003750 con 0x7ffbd815d360 2023-12-17T11:49:11.492 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:11.488+0000 7ffbde4ad640 1 -- 172.21.15.40:0/3698938823 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffbc8009400 con 0x7ffbd815d360 2023-12-17T11:49:11.492 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:11.488+0000 7ffbcdffb640 1 -- 172.21.15.40:0/3698938823 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbd0003b00 con 0x7ffbd815d360 2023-12-17T11:49:11.492 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:11.488+0000 7ffbde4ad640 1 -- 172.21.15.40:0/3698938823 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffbd80cbcd0 con 0x7ffbd815d360 2023-12-17T11:49:11.492 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:11.489+0000 7ffbde4ad640 1 -- 172.21.15.40:0/3698938823 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffbd81610f0 con 0x7ffbd815d360 2023-12-17T11:49:11.492 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:11.490+0000 7ffbcdffb640 1 -- 172.21.15.40:0/3698938823 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ffbd0003c60 con 0x7ffbd815d360 2023-12-17T11:49:11.493 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:11.491+0000 7ffbcdffb640 1 --2- 172.21.15.40:0/3698938823 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7ffbbc06ae40 0x7ffbbc06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:11.493 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:11.492+0000 7ffbcdffb640 1 -- 172.21.15.40:0/3698938823 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6692+0+0 (secure 0 0 0) 0x7ffbd0088ec0 con 0x7ffbd815d360 2023-12-17T11:49:11.494 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:11.492+0000 7ffbdd4ab640 1 --2- 172.21.15.40:0/3698938823 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7ffbbc06ae40 0x7ffbbc06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:11.495 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:11.493+0000 7ffbdd4ab640 1 --2- 172.21.15.40:0/3698938823 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7ffbbc06ae40 0x7ffbbc06d300 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7ffbd4009fd0 tx=0x7ffbd400b040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:49:11.497 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:11.496+0000 7ffbcdffb640 1 -- 172.21.15.40:0/3698938823 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7ffbd0053b80 con 0x7ffbd815d360 2023-12-17T11:49:11.689 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:11.687+0000 7ffbde4ad640 1 -- 172.21.15.40:0/3698938823 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7ffbd80678e0 con 0x7ffbd815d360 2023-12-17T11:49:11.690 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:11.688+0000 7ffbcdffb640 1 -- 172.21.15.40:0/3698938823 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) v1 ==== 103+0+11 (secure 0 0 0) 0x7ffbd0017020 con 0x7ffbd815d360 2023-12-17T11:49:11.690 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 32 2023-12-17T11:49:11.693 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:11.691+0000 7ffbde4ad640 1 -- 172.21.15.40:0/3698938823 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7ffbbc06ae40 msgr2=0x7ffbbc06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:11.693 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:11.691+0000 7ffbde4ad640 1 --2- 172.21.15.40:0/3698938823 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7ffbbc06ae40 0x7ffbbc06d300 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7ffbd4009fd0 tx=0x7ffbd400b040 comp rx=0 tx=0).stop 2023-12-17T11:49:11.693 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:11.691+0000 7ffbde4ad640 1 -- 172.21.15.40:0/3698938823 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffbd815d360 msgr2=0x7ffbd80ca560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:11.694 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:11.691+0000 7ffbde4ad640 1 --2- 172.21.15.40:0/3698938823 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffbd815d360 0x7ffbd80ca560 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7ffbd000c410 tx=0x7ffbd000c8d0 comp rx=0 tx=0).stop 2023-12-17T11:49:11.694 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:11.691+0000 7ffbde4ad640 1 -- 172.21.15.40:0/3698938823 shutdown_connections 2023-12-17T11:49:11.694 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:11.691+0000 7ffbde4ad640 1 --2- 172.21.15.40:0/3698938823 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7ffbbc06ae40 0x7ffbbc06d300 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:11.694 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:11.691+0000 7ffbde4ad640 1 --2- 172.21.15.40:0/3698938823 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffbd815d360 0x7ffbd80ca560 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:11.694 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:11.691+0000 7ffbde4ad640 1 --2- 172.21.15.40:0/3698938823 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ffbd80d1a70 0x7ffbd80ca020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:11.694 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:11.691+0000 7ffbde4ad640 1 --2- 172.21.15.40:0/3698938823 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ffbd80cece0 0x7ffbd80b8010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:11.694 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:11.691+0000 7ffbde4ad640 1 -- 172.21.15.40:0/3698938823 >> 172.21.15.40:0/3698938823 conn(0x7ffbd809c230 msgr2=0x7ffbd80b28b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:49:11.694 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:11.691+0000 7ffbde4ad640 1 -- 172.21.15.40:0/3698938823 shutdown_connections 2023-12-17T11:49:11.694 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:11.692+0000 7ffbde4ad640 1 -- 172.21.15.40:0/3698938823 wait complete. 2023-12-17T11:49:11.714 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-17T11:49:11.943 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:11.941+0000 7f58124bb640 1 Processor -- start 2023-12-17T11:49:11.943 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:11.941+0000 7f58124bb640 1 -- start start 2023-12-17T11:49:11.946 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:11.943+0000 7f58124bb640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f580c143e00 0x7f580c0b4040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:11.946 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:11.943+0000 7f58124bb640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f580c072180 0x7f580c0b4580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:11.946 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:11.943+0000 7f58124bb640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f580c06c410 0x7f580c0b4ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:11.946 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:11.943+0000 7f58124bb640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f580c0b3bb0 con 0x7f580c143e00 2023-12-17T11:49:11.946 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:11.943+0000 7f58124bb640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f580c1441e0 con 0x7f580c072180 2023-12-17T11:49:11.946 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:11.943+0000 7f58124bb640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f580c072680 con 0x7f580c06c410 2023-12-17T11:49:11.946 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:11.943+0000 7f580bfff640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f580c143e00 0x7f580c0b4040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:11.946 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:11.943+0000 7f580bfff640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f580c143e00 0x7f580c0b4040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:41368/0 (socket says 172.21.15.40:41368) 2023-12-17T11:49:11.946 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:11.943+0000 7f580bfff640 1 -- 172.21.15.40:0/46538337 learned_addr learned my addr 172.21.15.40:0/46538337 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-17T11:49:11.946 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:11.944+0000 7f580bfff640 1 -- 172.21.15.40:0/46538337 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f580c06c410 msgr2=0x7f580c0b4ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:49:11.946 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:11.944+0000 7f580bfff640 1 --2- 172.21.15.40:0/46538337 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f580c06c410 0x7f580c0b4ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:11.947 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:11.944+0000 7f580bfff640 1 -- 172.21.15.40:0/46538337 >> v2:172.21.15.159:3300/0 conn(0x7f580c072180 msgr2=0x7f580c0b4580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:49:11.947 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:11.944+0000 7f580b7fe640 1 --2- 172.21.15.40:0/46538337 >> v2:172.21.15.159:3300/0 conn(0x7f580c072180 0x7f580c0b4580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:11.947 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:11.944+0000 7f580bfff640 1 --2- 172.21.15.40:0/46538337 >> v2:172.21.15.159:3300/0 conn(0x7f580c072180 0x7f580c0b4580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:11.947 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:11.944+0000 7f580bfff640 1 -- 172.21.15.40:0/46538337 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f580c0b1e30 con 0x7f580c143e00 2023-12-17T11:49:11.947 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:11.944+0000 7f580b7fe640 1 --2- 172.21.15.40:0/46538337 >> v2:172.21.15.159:3300/0 conn(0x7f580c072180 0x7f580c0b4580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-17T11:49:11.948 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:11.945+0000 7f580bfff640 1 --2- 172.21.15.40:0/46538337 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f580c143e00 0x7f580c0b4040 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f580c067da0 tx=0x7f57fc02b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=509bd6828bd22281 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:49:11.948 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:11.945+0000 7f580affd640 1 -- 172.21.15.40:0/46538337 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57fc031870 con 0x7f580c143e00 2023-12-17T11:49:11.948 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:11.945+0000 7f580affd640 1 -- 172.21.15.40:0/46538337 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57fc0319d0 con 0x7f580c143e00 2023-12-17T11:49:11.948 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:11.945+0000 7f580affd640 1 -- 172.21.15.40:0/46538337 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57fc031d60 con 0x7f580c143e00 2023-12-17T11:49:11.948 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:11.946+0000 7f58124bb640 1 -- 172.21.15.40:0/46538337 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f580c143e00 msgr2=0x7f580c0b4040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:11.948 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:11.946+0000 7f58124bb640 1 --2- 172.21.15.40:0/46538337 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f580c143e00 0x7f580c0b4040 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f580c067da0 tx=0x7f57fc02b910 comp rx=0 tx=0).stop 2023-12-17T11:49:11.948 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:11.946+0000 7f58124bb640 1 -- 172.21.15.40:0/46538337 shutdown_connections 2023-12-17T11:49:11.948 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:11.946+0000 7f58124bb640 1 --2- 172.21.15.40:0/46538337 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f580c06c410 0x7f580c0b4ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:11.948 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:11.946+0000 7f58124bb640 1 --2- 172.21.15.40:0/46538337 >> v2:172.21.15.159:3300/0 conn(0x7f580c072180 0x7f580c0b4580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:11.949 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:11.946+0000 7f58124bb640 1 --2- 172.21.15.40:0/46538337 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f580c143e00 0x7f580c0b4040 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:11.949 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:11.946+0000 7f58124bb640 1 -- 172.21.15.40:0/46538337 >> 172.21.15.40:0/46538337 conn(0x7f580c0b0a90 msgr2=0x7f580c0b0e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:49:11.949 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:11.946+0000 7f58124bb640 1 -- 172.21.15.40:0/46538337 shutdown_connections 2023-12-17T11:49:11.949 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:11.946+0000 7f58124bb640 1 -- 172.21.15.40:0/46538337 wait complete. 2023-12-17T11:49:11.950 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:11.949+0000 7f58124bb640 1 Processor -- start 2023-12-17T11:49:11.951 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:11.949+0000 7f58124bb640 1 -- start start 2023-12-17T11:49:11.952 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:11.950+0000 7f58124bb640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f580c06c410 0x7f580c15a160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:11.952 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:11.950+0000 7f58124bb640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f580c072180 0x7f580c13e210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:11.952 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:11.950+0000 7f58124bb640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f580c143e00 0x7f580c137e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:11.952 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:11.950+0000 7f58124bb640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f580c13ecf0 con 0x7f580c06c410 2023-12-17T11:49:11.952 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:11.950+0000 7f58124bb640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f580c13efd0 con 0x7f580c072180 2023-12-17T11:49:11.952 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:11.950+0000 7f58124bb640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f580c13f2b0 con 0x7f580c143e00 2023-12-17T11:49:11.953 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:11.950+0000 7f580bfff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f580c06c410 0x7f580c15a160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:11.953 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:11.950+0000 7f580bfff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f580c06c410 0x7f580c15a160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:41382/0 (socket says 172.21.15.40:41382) 2023-12-17T11:49:11.953 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:11.950+0000 7f580bfff640 1 -- 172.21.15.40:0/1314464849 learned_addr learned my addr 172.21.15.40:0/1314464849 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-17T11:49:11.954 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:11.951+0000 7f580b7fe640 1 --2- 172.21.15.40:0/1314464849 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f580c072180 0x7f580c13e210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:11.954 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:11.951+0000 7f5810a58640 1 --2- 172.21.15.40:0/1314464849 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f580c143e00 0x7f580c137e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:11.954 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:11.951+0000 7f580bfff640 1 -- 172.21.15.40:0/1314464849 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f580c143e00 msgr2=0x7f580c137e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:11.954 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:11.951+0000 7f580bfff640 1 --2- 172.21.15.40:0/1314464849 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f580c143e00 0x7f580c137e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:11.954 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:11.951+0000 7f580bfff640 1 -- 172.21.15.40:0/1314464849 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f580c072180 msgr2=0x7f580c13e210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:11.954 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:11.951+0000 7f580bfff640 1 --2- 172.21.15.40:0/1314464849 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f580c072180 0x7f580c13e210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:11.954 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:11.951+0000 7f580bfff640 1 -- 172.21.15.40:0/1314464849 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57fc0094d0 con 0x7f580c06c410 2023-12-17T11:49:11.954 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:11.951+0000 7f580bfff640 1 --2- 172.21.15.40:0/1314464849 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f580c06c410 0x7f580c15a160 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f57fc0090b0 tx=0x7f57fc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:49:11.954 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:11.952+0000 7f5808ff9640 1 -- 172.21.15.40:0/1314464849 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57fc03adf0 con 0x7f580c06c410 2023-12-17T11:49:11.955 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:11.952+0000 7f5808ff9640 1 -- 172.21.15.40:0/1314464849 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57fc0443f0 con 0x7f580c06c410 2023-12-17T11:49:11.955 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:11.952+0000 7f5808ff9640 1 -- 172.21.15.40:0/1314464849 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57fc0447a0 con 0x7f580c06c410 2023-12-17T11:49:11.955 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:11.952+0000 7f58124bb640 1 -- 172.21.15.40:0/1314464849 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f580c1362b0 con 0x7f580c06c410 2023-12-17T11:49:11.955 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:11.952+0000 7f58124bb640 1 -- 172.21.15.40:0/1314464849 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f580c15ac30 con 0x7f580c06c410 2023-12-17T11:49:11.955 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:11.953+0000 7f58124bb640 1 -- 172.21.15.40:0/1314464849 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f580c15ae20 con 0x7f580c06c410 2023-12-17T11:49:11.956 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:11.954+0000 7f5808ff9640 1 -- 172.21.15.40:0/1314464849 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f57fc04d450 con 0x7f580c06c410 2023-12-17T11:49:11.957 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:11.955+0000 7f5808ff9640 1 --2- 172.21.15.40:0/1314464849 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f57f806ae70 0x7f57f806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:11.957 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:11.955+0000 7f5808ff9640 1 -- 172.21.15.40:0/1314464849 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f57fc02d040 con 0x7f580c06c410 2023-12-17T11:49:11.957 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:11.956+0000 7f580b7fe640 1 --2- 172.21.15.40:0/1314464849 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f57f806ae70 0x7f57f806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:11.959 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:11.957+0000 7f580b7fe640 1 --2- 172.21.15.40:0/1314464849 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f57f806ae70 0x7f57f806d330 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f580c15ee50 tx=0x7f5800008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:49:11.962 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:11.960+0000 7f5808ff9640 1 -- 172.21.15.40:0/1314464849 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f580c15ae20 con 0x7f580c06c410 2023-12-17T11:49:12.161 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:12.159+0000 7f58124bb640 1 -- 172.21.15.40:0/1314464849 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f580c15ae20 con 0x7f580c06c410 2023-12-17T11:49:12.163 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:12.161+0000 7f5808ff9640 1 -- 172.21.15.40:0/1314464849 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+18697 (secure 0 0 0) 0x7f580c15ae20 con 0x7f580c06c410 2023-12-17T11:49:12.164 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T11:49:12.164 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":27,"fsid":"099cd35d-80d9-4ca4-8424-de13b3b03ac7","created":"2023-12-17T11:47:53.450097+0000","modified":"2023-12-17T11:49:00.483840+0000","last_up_change":"2023-12-17T11:48:05.724195+0000","last_in_change":"2023-12-17T11:47:56.956499+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-17T11:48:06.668943+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-17T11:48:16.151444+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-17T11:48:16.717726+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-17T11:48:20.534819+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a88bfd46-63b8-48b1-9c0e-5c9cdc31bd38","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":555204741},{"type":"v1","addr":"172.21.15.40:6802","nonce":555204741}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":555204741},{"type":"v1","addr":"172.21.15.40:6807","nonce":555204741}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":555204741},{"type":"v1","addr":"172.21.15.40:6815","nonce":555204741}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6809","nonce":555204741},{"type":"v1","addr":"172.21.15.40:6812","nonce":555204741}]},"public_addr":"172.21.15.40:6802/555204741","cluster_addr":"172.21.15.40:6807/555204741","heartbeat_back_addr":"172.21.15.40:6815/555204741","heartbeat_front_addr":"172.21.15.40:6812/555204741","state":["exists","up"]},{"osd":1,"uuid":"c5d628ae-36f4-4866-802c-b162f0e90add","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6801","nonce":1221318112},{"type":"v1","addr":"172.21.15.40:6803","nonce":1221318112}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6805","nonce":1221318112},{"type":"v1","addr":"172.21.15.40:6806","nonce":1221318112}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6811","nonce":1221318112},{"type":"v1","addr":"172.21.15.40:6813","nonce":1221318112}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":1221318112},{"type":"v1","addr":"172.21.15.40:6810","nonce":1221318112}]},"public_addr":"172.21.15.40:6803/1221318112","cluster_addr":"172.21.15.40:6806/1221318112","heartbeat_back_addr":"172.21.15.40:6813/1221318112","heartbeat_front_addr":"172.21.15.40:6810/1221318112","state":["exists","up"]},{"osd":2,"uuid":"d986ad6a-af2f-47fc-9c3b-fbda27b82b73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":1959000265},{"type":"v1","addr":"172.21.15.40:6817","nonce":1959000265}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6818","nonce":1959000265},{"type":"v1","addr":"172.21.15.40:6819","nonce":1959000265}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":1959000265},{"type":"v1","addr":"172.21.15.40:6827","nonce":1959000265}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":1959000265},{"type":"v1","addr":"172.21.15.40:6822","nonce":1959000265}]},"public_addr":"172.21.15.40:6817/1959000265","cluster_addr":"172.21.15.40:6819/1959000265","heartbeat_back_addr":"172.21.15.40:6827/1959000265","heartbeat_front_addr":"172.21.15.40:6822/1959000265","state":["exists","up"]},{"osd":3,"uuid":"d79d22b7-be05-41b2-b95d-697db677fd02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6821","nonce":974040287},{"type":"v1","addr":"172.21.15.40:6823","nonce":974040287}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6825","nonce":974040287},{"type":"v1","addr":"172.21.15.40:6826","nonce":974040287}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":974040287},{"type":"v1","addr":"172.21.15.40:6831","nonce":974040287}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":974040287},{"type":"v1","addr":"172.21.15.40:6829","nonce":974040287}]},"public_addr":"172.21.15.40:6823/974040287","cluster_addr":"172.21.15.40:6826/974040287","heartbeat_back_addr":"172.21.15.40:6831/974040287","heartbeat_front_addr":"172.21.15.40:6829/974040287","state":["exists","up"]},{"osd":4,"uuid":"62a7a233-d3ea-40be-91de-180c0208d639","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6808","nonce":3937787733},{"type":"v1","addr":"172.21.15.159:6809","nonce":3937787733}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6810","nonce":3937787733},{"type":"v1","addr":"172.21.15.159:6811","nonce":3937787733}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6814","nonce":3937787733},{"type":"v1","addr":"172.21.15.159:6815","nonce":3937787733}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6812","nonce":3937787733},{"type":"v1","addr":"172.21.15.159:6813","nonce":3937787733}]},"public_addr":"172.21.15.159:6809/3937787733","cluster_addr":"172.21.15.159:6811/3937787733","heartbeat_back_addr":"172.21.15.159:6815/3937787733","heartbeat_front_addr":"172.21.15.159:6813/3937787733","state":["exists","up"]},{"osd":5,"uuid":"84629cea-dc0e-4b5e-b203-5ea963839281","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6816","nonce":3032505240},{"type":"v1","addr":"172.21.15.159:6817","nonce":3032505240}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6818","nonce":3032505240},{"type":"v1","addr":"172.21.15.159:6819","nonce":3032505240}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6822","nonce":3032505240},{"type":"v1","addr":"172.21.15.159:6823","nonce":3032505240}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6820","nonce":3032505240},{"type":"v1","addr":"172.21.15.159:6821","nonce":3032505240}]},"public_addr":"172.21.15.159:6817/3032505240","cluster_addr":"172.21.15.159:6819/3032505240","heartbeat_back_addr":"172.21.15.159:6823/3032505240","heartbeat_front_addr":"172.21.15.159:6821/3032505240","state":["exists","up"]},{"osd":6,"uuid":"4ae3af3a-1743-4070-a91d-8be5c31cdb04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6800","nonce":2411788597},{"type":"v1","addr":"172.21.15.159:6801","nonce":2411788597}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6802","nonce":2411788597},{"type":"v1","addr":"172.21.15.159:6803","nonce":2411788597}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6806","nonce":2411788597},{"type":"v1","addr":"172.21.15.159:6807","nonce":2411788597}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6804","nonce":2411788597},{"type":"v1","addr":"172.21.15.159:6805","nonce":2411788597}]},"public_addr":"172.21.15.159:6801/2411788597","cluster_addr":"172.21.15.159:6803/2411788597","heartbeat_back_addr":"172.21.15.159:6807/2411788597","heartbeat_front_addr":"172.21.15.159:6805/2411788597","state":["exists","up"]},{"osd":7,"uuid":"c1f4c7f2-8f75-4f95-bc63-a332773e3b8e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6824","nonce":478953349},{"type":"v1","addr":"172.21.15.159:6825","nonce":478953349}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6826","nonce":478953349},{"type":"v1","addr":"172.21.15.159:6827","nonce":478953349}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6830","nonce":478953349},{"type":"v1","addr":"172.21.15.159:6831","nonce":478953349}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6828","nonce":478953349},{"type":"v1","addr":"172.21.15.159:6829","nonce":478953349}]},"public_addr":"172.21.15.159:6825/478953349","cluster_addr":"172.21.15.159:6827/478953349","heartbeat_back_addr":"172.21.15.159:6831/478953349","heartbeat_front_addr":"172.21.15.159:6829/478953349","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T11:48:02.023567+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T11:48:02.278216+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T11:48:02.311843+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T11:48:01.773372+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T11:48:02.618910+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T11:48:02.361559+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T11:48:02.223997+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T11:48:02.604403+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.2","mappings":[{"from":3,"to":2}]},{"pgid":"3.d","mappings":[{"from":5,"to":1}]},{"pgid":"3.13","mappings":[{"from":7,"to":2}]},{"pgid":"3.17","mappings":[{"from":0,"to":2}]},{"pgid":"3.38","mappings":[{"from":5,"to":1}]},{"pgid":"4.2","mappings":[{"from":1,"to":2}]},{"pgid":"4.10","mappings":[{"from":1,"to":2}]},{"pgid":"4.18","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-17T11:49:12.167 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:12.164+0000 7f58124bb640 1 -- 172.21.15.40:0/1314464849 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f57f806ae70 msgr2=0x7f57f806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:12.167 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:12.164+0000 7f58124bb640 1 --2- 172.21.15.40:0/1314464849 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f57f806ae70 0x7f57f806d330 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f580c15ee50 tx=0x7f5800008040 comp rx=0 tx=0).stop 2023-12-17T11:49:12.167 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:12.164+0000 7f58124bb640 1 -- 172.21.15.40:0/1314464849 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f580c06c410 msgr2=0x7f580c15a160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:12.167 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:12.164+0000 7f58124bb640 1 --2- 172.21.15.40:0/1314464849 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f580c06c410 0x7f580c15a160 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f57fc0090b0 tx=0x7f57fc0046c0 comp rx=0 tx=0).stop 2023-12-17T11:49:12.167 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:12.164+0000 7f58124bb640 1 -- 172.21.15.40:0/1314464849 shutdown_connections 2023-12-17T11:49:12.167 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:12.164+0000 7f58124bb640 1 --2- 172.21.15.40:0/1314464849 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f57f806ae70 0x7f57f806d330 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:12.168 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:12.164+0000 7f58124bb640 1 --2- 172.21.15.40:0/1314464849 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f580c143e00 0x7f580c137e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:12.168 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:12.164+0000 7f58124bb640 1 --2- 172.21.15.40:0/1314464849 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f580c072180 0x7f580c13e210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:12.168 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:12.164+0000 7f58124bb640 1 --2- 172.21.15.40:0/1314464849 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f580c06c410 0x7f580c15a160 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:12.168 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:12.164+0000 7f58124bb640 1 -- 172.21.15.40:0/1314464849 >> 172.21.15.40:0/1314464849 conn(0x7f580c0b0a90 msgr2=0x7f580c0af270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:49:12.168 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:12.164+0000 7f58124bb640 1 -- 172.21.15.40:0/1314464849 shutdown_connections 2023-12-17T11:49:12.168 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:12.164+0000 7f58124bb640 1 -- 172.21.15.40:0/1314464849 wait complete. 2023-12-17T11:49:12.187 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-17T11:48:06.668943+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-17T11:48:16.151444+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-17T11:48:16.717726+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-12-17T11:48:20.534819+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-12-17T11:49:12.187 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-17T11:49:12.419 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:12.417+0000 7f5a7099a640 1 Processor -- start 2023-12-17T11:49:12.419 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:12.417+0000 7f5a7099a640 1 -- start start 2023-12-17T11:49:12.421 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:12.419+0000 7f5a7099a640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f5a6c15ab30 0x7f5a6c071d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:12.421 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:12.419+0000 7f5a7099a640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5a6c0b3c00 0x7f5a6c15e050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:12.421 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:12.419+0000 7f5a7099a640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a6c0701f0 con 0x7f5a6c0cedf0 2023-12-17T11:49:12.421 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:12.419+0000 7f5a7099a640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a6c15e590 con 0x7f5a6c15ab30 2023-12-17T11:49:12.421 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:12.419+0000 7f5a7099a640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a6c0b37b0 con 0x7f5a6c0b3c00 2023-12-17T11:49:12.422 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:12.420+0000 7f5a62ffd640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5a6c0b3c00 0x7f5a6c15e050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:12.422 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:12.420+0000 7f5a6b7fe640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f5a6c15ab30 0x7f5a6c071d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:12.422 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:12.420+0000 7f5a62ffd640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5a6c0b3c00 0x7f5a6c15e050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3301/0 says I am v2:172.21.15.40:48008/0 (socket says 172.21.15.40:48008) 2023-12-17T11:49:12.422 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:12.420+0000 7f5a62ffd640 1 -- 172.21.15.40:0/2600494599 learned_addr learned my addr 172.21.15.40:0/2600494599 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-17T11:49:12.423 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:12.420+0000 7f5a6b7fe640 1 -- 172.21.15.40:0/2600494599 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5a6c0b3c00 msgr2=0x7f5a6c15e050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:49:12.423 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:12.420+0000 7f5a6b7fe640 1 --2- 172.21.15.40:0/2600494599 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5a6c0b3c00 0x7f5a6c15e050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:12.423 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:12.420+0000 7f5a6b7fe640 1 -- 172.21.15.40:0/2600494599 >> v1:172.21.15.159:6789/0 conn(0x7f5a6c0cedf0 legacy=0x7f5a6c160bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:12.423 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:12.420+0000 7f5a6b7fe640 1 -- 172.21.15.40:0/2600494599 --> v2:172.21.15.159:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a6c0704d0 con 0x7f5a6c15ab30 2023-12-17T11:49:12.424 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:12.422+0000 7f5a6b7fe640 1 --2- 172.21.15.40:0/2600494599 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5a6c15ab30 0x7f5a6c071d30 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f5a5c009d90 tx=0x7f5a5c02be10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1aa5f2b09f291727 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:49:12.424 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:12.422+0000 7f5a6affd640 1 -- 172.21.15.40:0/2600494599 <== mon.1 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a5c02cbc0 con 0x7f5a6c15ab30 2023-12-17T11:49:12.424 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:12.422+0000 7f5a6affd640 1 -- 172.21.15.40:0/2600494599 <== mon.1 v2:172.21.15.159:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a5c02cd20 con 0x7f5a6c15ab30 2023-12-17T11:49:12.424 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:12.423+0000 7f5a6affd640 1 -- 172.21.15.40:0/2600494599 <== mon.1 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a5c034660 con 0x7f5a6c15ab30 2023-12-17T11:49:12.425 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:12.423+0000 7f5a7099a640 1 -- 172.21.15.40:0/2600494599 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5a6c15ab30 msgr2=0x7f5a6c071d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:12.425 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:12.423+0000 7f5a7099a640 1 --2- 172.21.15.40:0/2600494599 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5a6c15ab30 0x7f5a6c071d30 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f5a5c009d90 tx=0x7f5a5c02be10 comp rx=0 tx=0).stop 2023-12-17T11:49:12.425 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:12.423+0000 7f5a7099a640 1 -- 172.21.15.40:0/2600494599 shutdown_connections 2023-12-17T11:49:12.426 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:12.423+0000 7f5a7099a640 1 --2- 172.21.15.40:0/2600494599 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5a6c0b3c00 0x7f5a6c15e050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:12.426 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:12.423+0000 7f5a7099a640 1 --2- 172.21.15.40:0/2600494599 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5a6c15ab30 0x7f5a6c071d30 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:12.426 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:12.423+0000 7f5a7099a640 1 -- 172.21.15.40:0/2600494599 >> 172.21.15.40:0/2600494599 conn(0x7f5a6c06a640 msgr2=0x7f5a6c06aa50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:49:12.426 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:12.423+0000 7f5a7099a640 1 -- 172.21.15.40:0/2600494599 shutdown_connections 2023-12-17T11:49:12.426 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:12.423+0000 7f5a7099a640 1 -- 172.21.15.40:0/2600494599 wait complete. 2023-12-17T11:49:12.427 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:12.425+0000 7f5a7099a640 1 Processor -- start 2023-12-17T11:49:12.427 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:12.425+0000 7f5a7099a640 1 -- start start 2023-12-17T11:49:12.430 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:12.427+0000 7f5a7099a640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5a6c0b3c00 0x7f5a6c149670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:12.430 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:12.427+0000 7f5a7099a640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5a6c0cedf0 0x7f5a6c0acd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:12.430 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:12.427+0000 7f5a7099a640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5a6c15ab30 0x7f5a6c0ad2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:12.430 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:12.427+0000 7f5a7099a640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a6c1f7210 con 0x7f5a6c0cedf0 2023-12-17T11:49:12.430 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:12.427+0000 7f5a7099a640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a6c1f7630 con 0x7f5a6c15ab30 2023-12-17T11:49:12.430 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:12.427+0000 7f5a7099a640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a6c1f3130 con 0x7f5a6c0b3c00 2023-12-17T11:49:12.430 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:12.427+0000 7f5a62ffd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5a6c0cedf0 0x7f5a6c0acd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:12.430 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:12.427+0000 7f5a62ffd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5a6c0cedf0 0x7f5a6c0acd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:41394/0 (socket says 172.21.15.40:41394) 2023-12-17T11:49:12.430 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:12.427+0000 7f5a62ffd640 1 -- 172.21.15.40:0/749390882 learned_addr learned my addr 172.21.15.40:0/749390882 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-17T11:49:12.430 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:12.427+0000 7f5a6b7fe640 1 --2- 172.21.15.40:0/749390882 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5a6c0b3c00 0x7f5a6c149670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:12.430 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:12.427+0000 7f5a6bfff640 1 --2- 172.21.15.40:0/749390882 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5a6c15ab30 0x7f5a6c0ad2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:12.431 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:12.428+0000 7f5a62ffd640 1 -- 172.21.15.40:0/749390882 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5a6c0b3c00 msgr2=0x7f5a6c149670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:12.431 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:12.428+0000 7f5a62ffd640 1 --2- 172.21.15.40:0/749390882 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5a6c0b3c00 0x7f5a6c149670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:12.431 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:12.428+0000 7f5a62ffd640 1 -- 172.21.15.40:0/749390882 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5a6c15ab30 msgr2=0x7f5a6c0ad2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:12.431 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:12.428+0000 7f5a62ffd640 1 --2- 172.21.15.40:0/749390882 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5a6c15ab30 0x7f5a6c0ad2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:12.431 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:12.428+0000 7f5a62ffd640 1 -- 172.21.15.40:0/749390882 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a5c009a70 con 0x7f5a6c0cedf0 2023-12-17T11:49:12.431 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:12.428+0000 7f5a6bfff640 1 --2- 172.21.15.40:0/749390882 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5a6c15ab30 0x7f5a6c0ad2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-17T11:49:12.431 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:12.428+0000 7f5a62ffd640 1 --2- 172.21.15.40:0/749390882 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5a6c0cedf0 0x7f5a6c0acd70 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f5a5400e8e0 tx=0x7f5a5400eda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:49:12.432 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:12.428+0000 7f5a68ff9640 1 -- 172.21.15.40:0/749390882 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a5400c940 con 0x7f5a6c0cedf0 2023-12-17T11:49:12.432 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:12.428+0000 7f5a68ff9640 1 -- 172.21.15.40:0/749390882 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a5400caa0 con 0x7f5a6c0cedf0 2023-12-17T11:49:12.432 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:12.428+0000 7f5a68ff9640 1 -- 172.21.15.40:0/749390882 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a5400ce50 con 0x7f5a6c0cedf0 2023-12-17T11:49:12.432 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:12.428+0000 7f5a7099a640 1 -- 172.21.15.40:0/749390882 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a6c1f6870 con 0x7f5a6c0cedf0 2023-12-17T11:49:12.432 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:12.428+0000 7f5a7099a640 1 -- 172.21.15.40:0/749390882 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a6c1f6e30 con 0x7f5a6c0cedf0 2023-12-17T11:49:12.432 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:12.430+0000 7f5a7099a640 1 -- 172.21.15.40:0/749390882 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a6c074450 con 0x7f5a6c0cedf0 2023-12-17T11:49:12.432 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:12.430+0000 7f5a68ff9640 1 -- 172.21.15.40:0/749390882 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f5a54013470 con 0x7f5a6c0cedf0 2023-12-17T11:49:12.433 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:12.431+0000 7f5a68ff9640 1 --2- 172.21.15.40:0/749390882 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f5a4c06ae40 0x7f5a4c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:12.433 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:12.432+0000 7f5a68ff9640 1 -- 172.21.15.40:0/749390882 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f5a54089c00 con 0x7f5a6c0cedf0 2023-12-17T11:49:12.434 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:12.432+0000 7f5a6b7fe640 1 --2- 172.21.15.40:0/749390882 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f5a4c06ae40 0x7f5a4c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:12.435 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:12.433+0000 7f5a6b7fe640 1 --2- 172.21.15.40:0/749390882 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f5a4c06ae40 0x7f5a4c06d300 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f5a5c036000 tx=0x7f5a5c030000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:49:12.437 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:12.436+0000 7f5a68ff9640 1 -- 172.21.15.40:0/749390882 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f5a540548c0 con 0x7f5a6c0cedf0 2023-12-17T11:49:12.634 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:12.632+0000 7f5a7099a640 1 -- 172.21.15.40:0/749390882 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f5a6c157220 con 0x7f5a6c0cedf0 2023-12-17T11:49:12.634 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:12.632+0000 7f5a68ff9640 1 -- 172.21.15.40:0/749390882 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) v1 ==== 93+0+10 (secure 0 0 0) 0x7f5a540170a0 con 0x7f5a6c0cedf0 2023-12-17T11:49:12.635 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 1 2023-12-17T11:49:12.637 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:12.635+0000 7f5a7099a640 1 -- 172.21.15.40:0/749390882 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f5a4c06ae40 msgr2=0x7f5a4c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:12.637 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:12.635+0000 7f5a7099a640 1 --2- 172.21.15.40:0/749390882 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f5a4c06ae40 0x7f5a4c06d300 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f5a5c036000 tx=0x7f5a5c030000 comp rx=0 tx=0).stop 2023-12-17T11:49:12.637 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:12.635+0000 7f5a7099a640 1 -- 172.21.15.40:0/749390882 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5a6c0cedf0 msgr2=0x7f5a6c0acd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:12.638 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:12.635+0000 7f5a7099a640 1 --2- 172.21.15.40:0/749390882 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5a6c0cedf0 0x7f5a6c0acd70 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f5a5400e8e0 tx=0x7f5a5400eda0 comp rx=0 tx=0).stop 2023-12-17T11:49:12.638 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:12.635+0000 7f5a7099a640 1 -- 172.21.15.40:0/749390882 shutdown_connections 2023-12-17T11:49:12.638 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:12.635+0000 7f5a7099a640 1 --2- 172.21.15.40:0/749390882 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f5a4c06ae40 0x7f5a4c06d300 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:12.638 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:12.635+0000 7f5a7099a640 1 --2- 172.21.15.40:0/749390882 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5a6c15ab30 0x7f5a6c0ad2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:12.638 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:12.635+0000 7f5a7099a640 1 --2- 172.21.15.40:0/749390882 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5a6c0cedf0 0x7f5a6c0acd70 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:12.638 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:12.635+0000 7f5a7099a640 1 --2- 172.21.15.40:0/749390882 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5a6c0b3c00 0x7f5a6c149670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:12.638 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:12.635+0000 7f5a7099a640 1 -- 172.21.15.40:0/749390882 >> 172.21.15.40:0/749390882 conn(0x7f5a6c06a640 msgr2=0x7f5a6c070ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:49:12.638 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:12.635+0000 7f5a7099a640 1 -- 172.21.15.40:0/749390882 shutdown_connections 2023-12-17T11:49:12.638 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:12.635+0000 7f5a7099a640 1 -- 172.21.15.40:0/749390882 wait complete. 2023-12-17T11:49:12.657 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-17T11:49:12.880 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:12.878+0000 7fe624c91640 1 Processor -- start 2023-12-17T11:49:12.881 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:12.879+0000 7fe624c91640 1 -- start start 2023-12-17T11:49:12.883 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:12.880+0000 7fe624c91640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fe6200d3b80 0x7fe6200d0dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:12.883 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:12.880+0000 7fe624c91640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6200b3dc0 con 0x7fe6200d3670 2023-12-17T11:49:12.883 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:12.880+0000 7fe624c91640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6200b4050 con 0x7fe6201607f0 2023-12-17T11:49:12.883 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:12.880+0000 7fe624c91640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6200ce7e0 con 0x7fe6200d3b80 2023-12-17T11:49:12.883 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:12.881+0000 7fe617fff640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fe6200d3b80 0x7fe6200d0dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:12.883 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:12.881+0000 7fe61ffff640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fe6200d3670 0x7fe6200d1310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:55282/0 (socket says 172.21.15.40:55282) 2023-12-17T11:49:12.883 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:12.881+0000 7fe61ffff640 1 -- 172.21.15.40:0/1742639306 learned_addr learned my addr 172.21.15.40:0/1742639306 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-12-17T11:49:12.884 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:12.881+0000 7fe617fff640 1 -- 172.21.15.40:0/1742639306 >> v1:172.21.15.159:6789/0 conn(0x7fe6201607f0 legacy=0x7fe6200cf930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:49:12.884 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:12.881+0000 7fe617fff640 1 -- 172.21.15.40:0/1742639306 >> v1:172.21.15.40:6789/0 conn(0x7fe6200d3670 legacy=0x7fe6200d1310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:12.884 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:12.881+0000 7fe617fff640 1 -- 172.21.15.40:0/1742639306 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6200ceac0 con 0x7fe6200d3b80 2023-12-17T11:49:12.884 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:12.881+0000 7fe61effd640 1 -- 172.21.15.40:0/1742639306 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3434382967 0 0) 0x7fe6200b3dc0 con 0x7fe6200d3670 2023-12-17T11:49:12.884 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:12.882+0000 7fe617fff640 1 --2- 172.21.15.40:0/1742639306 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe6200d3b80 0x7fe6200d0dd0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fe6080097a0 tx=0x7fe60802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf54a3c21e46af2c server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:49:12.886 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:12.883+0000 7fe61effd640 1 -- 172.21.15.40:0/1742639306 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe608031830 con 0x7fe6200d3b80 2023-12-17T11:49:12.886 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:12.883+0000 7fe61effd640 1 -- 172.21.15.40:0/1742639306 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe608031990 con 0x7fe6200d3b80 2023-12-17T11:49:12.886 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:12.883+0000 7fe61effd640 1 -- 172.21.15.40:0/1742639306 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe608031d20 con 0x7fe6200d3b80 2023-12-17T11:49:12.886 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:12.883+0000 7fe624c91640 1 -- 172.21.15.40:0/1742639306 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe6200d3b80 msgr2=0x7fe6200d0dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:12.886 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:12.883+0000 7fe624c91640 1 --2- 172.21.15.40:0/1742639306 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe6200d3b80 0x7fe6200d0dd0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fe6080097a0 tx=0x7fe60802b8d0 comp rx=0 tx=0).stop 2023-12-17T11:49:12.886 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:12.884+0000 7fe624c91640 1 -- 172.21.15.40:0/1742639306 shutdown_connections 2023-12-17T11:49:12.886 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:12.884+0000 7fe624c91640 1 --2- 172.21.15.40:0/1742639306 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe6200d3b80 0x7fe6200d0dd0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:12.886 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:12.884+0000 7fe624c91640 1 -- 172.21.15.40:0/1742639306 >> 172.21.15.40:0/1742639306 conn(0x7fe62009c230 msgr2=0x7fe6200d2f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:49:12.886 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:12.884+0000 7fe624c91640 1 -- 172.21.15.40:0/1742639306 shutdown_connections 2023-12-17T11:49:12.886 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:12.884+0000 7fe624c91640 1 -- 172.21.15.40:0/1742639306 wait complete. 2023-12-17T11:49:12.887 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:12.885+0000 7fe624c91640 1 Processor -- start 2023-12-17T11:49:12.887 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:12.886+0000 7fe624c91640 1 -- start start 2023-12-17T11:49:12.889 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:12.887+0000 7fe624c91640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe6200d3670 0x7fe6200c6a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:12.890 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:12.887+0000 7fe624c91640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe6200d3b80 0x7fe6201536b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:12.890 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:12.887+0000 7fe624c91640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe6201607f0 0x7fe620153d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:12.890 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:12.887+0000 7fe624c91640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6200ccf00 con 0x7fe6200d3b80 2023-12-17T11:49:12.890 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:12.887+0000 7fe624c91640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe62015a780 con 0x7fe6201607f0 2023-12-17T11:49:12.890 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:12.887+0000 7fe624c91640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6200cc980 con 0x7fe6200d3670 2023-12-17T11:49:12.890 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:12.887+0000 7fe617fff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe6200d3b80 0x7fe6201536b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:12.890 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:12.887+0000 7fe617fff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe6200d3b80 0x7fe6201536b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:41412/0 (socket says 172.21.15.40:41412) 2023-12-17T11:49:12.890 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:12.887+0000 7fe617fff640 1 -- 172.21.15.40:0/1602510638 learned_addr learned my addr 172.21.15.40:0/1602510638 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-17T11:49:12.890 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:12.887+0000 7fe61ffff640 1 --2- 172.21.15.40:0/1602510638 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe6201607f0 0x7fe620153d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:12.890 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:12.887+0000 7fe617fff640 1 -- 172.21.15.40:0/1602510638 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe6200d3670 msgr2=0x7fe6200c6a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:12.890 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:12.887+0000 7fe617fff640 1 --2- 172.21.15.40:0/1602510638 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe6200d3670 0x7fe6200c6a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:12.890 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:12.887+0000 7fe617fff640 1 -- 172.21.15.40:0/1602510638 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe6201607f0 msgr2=0x7fe620153d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:12.890 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:12.887+0000 7fe617fff640 1 --2- 172.21.15.40:0/1602510638 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe6201607f0 0x7fe620153d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:12.890 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:12.887+0000 7fe617fff640 1 -- 172.21.15.40:0/1602510638 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe608009400 con 0x7fe6200d3b80 2023-12-17T11:49:12.891 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:12.887+0000 7fe61ffff640 1 --2- 172.21.15.40:0/1602510638 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe6201607f0 0x7fe620153d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-17T11:49:12.891 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:12.888+0000 7fe617fff640 1 --2- 172.21.15.40:0/1602510638 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe6200d3b80 0x7fe6201536b0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fe6080098c0 tx=0x7fe6080046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:49:12.892 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:12.888+0000 7fe61cff9640 1 -- 172.21.15.40:0/1602510638 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe60803ba70 con 0x7fe6200d3b80 2023-12-17T11:49:12.892 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:12.888+0000 7fe61cff9640 1 -- 172.21.15.40:0/1602510638 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe60803bbf0 con 0x7fe6200d3b80 2023-12-17T11:49:12.892 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:12.888+0000 7fe624c91640 1 -- 172.21.15.40:0/1602510638 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6200ca800 con 0x7fe6200d3b80 2023-12-17T11:49:12.892 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:12.888+0000 7fe61cff9640 1 -- 172.21.15.40:0/1602510638 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6080453f0 con 0x7fe6200d3b80 2023-12-17T11:49:12.892 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:12.888+0000 7fe624c91640 1 -- 172.21.15.40:0/1602510638 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe62015a130 con 0x7fe6200d3b80 2023-12-17T11:49:12.892 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:12.889+0000 7fe624c91640 1 -- 172.21.15.40:0/1602510638 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe620074450 con 0x7fe6200d3b80 2023-12-17T11:49:12.892 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:12.890+0000 7fe61cff9640 1 -- 172.21.15.40:0/1602510638 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fe608045550 con 0x7fe6200d3b80 2023-12-17T11:49:12.893 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:12.891+0000 7fe61cff9640 1 --2- 172.21.15.40:0/1602510638 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7fe60006ae40 0x7fe60006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:12.893 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:12.891+0000 7fe61cff9640 1 -- 172.21.15.40:0/1602510638 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6692+0+0 (secure 0 0 0) 0x7fe6080abdc0 con 0x7fe6200d3b80 2023-12-17T11:49:12.893 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:12.892+0000 7fe61f7fe640 1 --2- 172.21.15.40:0/1602510638 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7fe60006ae40 0x7fe60006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:12.895 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:12.893+0000 7fe61f7fe640 1 --2- 172.21.15.40:0/1602510638 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7fe60006ae40 0x7fe60006d300 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fe610006fd0 tx=0x7fe610006bc0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:49:12.898 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:12.896+0000 7fe61cff9640 1 -- 172.21.15.40:0/1602510638 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fe608076ba0 con 0x7fe6200d3b80 2023-12-17T11:49:13.083 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:13.081+0000 7fe624c91640 1 -- 172.21.15.40:0/1602510638 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fe62015a910 con 0x7fe6200d3b80 2023-12-17T11:49:13.083 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:13.082+0000 7fe61cff9640 1 -- 172.21.15.40:0/1602510638 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) v1 ==== 104+0+11 (secure 0 0 0) 0x7fe60807a1c0 con 0x7fe6200d3b80 2023-12-17T11:49:13.084 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 32 2023-12-17T11:49:13.086 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:13.084+0000 7fe624c91640 1 -- 172.21.15.40:0/1602510638 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7fe60006ae40 msgr2=0x7fe60006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:13.086 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:13.084+0000 7fe624c91640 1 --2- 172.21.15.40:0/1602510638 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7fe60006ae40 0x7fe60006d300 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fe610006fd0 tx=0x7fe610006bc0 comp rx=0 tx=0).stop 2023-12-17T11:49:13.086 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:13.084+0000 7fe624c91640 1 -- 172.21.15.40:0/1602510638 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe6200d3b80 msgr2=0x7fe6201536b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:13.087 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:13.084+0000 7fe624c91640 1 --2- 172.21.15.40:0/1602510638 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe6200d3b80 0x7fe6201536b0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fe6080098c0 tx=0x7fe6080046c0 comp rx=0 tx=0).stop 2023-12-17T11:49:13.087 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:13.084+0000 7fe624c91640 1 -- 172.21.15.40:0/1602510638 shutdown_connections 2023-12-17T11:49:13.087 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:13.084+0000 7fe624c91640 1 --2- 172.21.15.40:0/1602510638 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7fe60006ae40 0x7fe60006d300 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:13.087 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:13.084+0000 7fe624c91640 1 --2- 172.21.15.40:0/1602510638 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe6201607f0 0x7fe620153d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:13.087 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:13.084+0000 7fe624c91640 1 --2- 172.21.15.40:0/1602510638 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe6200d3b80 0x7fe6201536b0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:13.087 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:13.084+0000 7fe624c91640 1 --2- 172.21.15.40:0/1602510638 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe6200d3670 0x7fe6200c6a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:13.087 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:13.084+0000 7fe624c91640 1 -- 172.21.15.40:0/1602510638 >> 172.21.15.40:0/1602510638 conn(0x7fe62009c230 msgr2=0x7fe62006af50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:49:13.087 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:13.084+0000 7fe624c91640 1 -- 172.21.15.40:0/1602510638 shutdown_connections 2023-12-17T11:49:13.087 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:13.084+0000 7fe624c91640 1 -- 172.21.15.40:0/1602510638 wait complete. 2023-12-17T11:49:13.105 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-17T11:49:13.324 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:13.322+0000 7f8a04b5c640 1 Processor -- start 2023-12-17T11:49:13.325 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:13.322+0000 7f8a04b5c640 1 -- start start 2023-12-17T11:49:13.326 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:13.324+0000 7f8a04b5c640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8a0015ab30 0x7f8a00071d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:13.326 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:13.324+0000 7f8a04b5c640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f8a000b3c00 0x7f8a0015e050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:13.326 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:13.324+0000 7f8a04b5c640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a000701f0 con 0x7f8a000cedf0 2023-12-17T11:49:13.326 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:13.324+0000 7f8a04b5c640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a0015e590 con 0x7f8a000b3c00 2023-12-17T11:49:13.326 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:13.324+0000 7f8a04b5c640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a000b37b0 con 0x7f8a0015ab30 2023-12-17T11:49:13.326 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:13.324+0000 7f89f7fff640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f8a000b3c00 0x7f8a0015e050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:13.326 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:13.324+0000 7f89f7fff640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f8a000b3c00 0x7f8a0015e050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:41418/0 (socket says 172.21.15.40:41418) 2023-12-17T11:49:13.326 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:13.324+0000 7f89f7fff640 1 -- 172.21.15.40:0/3674797128 learned_addr learned my addr 172.21.15.40:0/3674797128 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-17T11:49:13.327 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:13.325+0000 7f89ff7fe640 1 --2- 172.21.15.40:0/3674797128 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8a0015ab30 0x7f8a00071d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:13.327 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:13.325+0000 7f89f7fff640 1 -- 172.21.15.40:0/3674797128 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8a0015ab30 msgr2=0x7f8a00071d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:49:13.327 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:13.325+0000 7f89f7fff640 1 --2- 172.21.15.40:0/3674797128 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8a0015ab30 0x7f8a00071d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:13.328 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:13.325+0000 7f89f7fff640 1 -- 172.21.15.40:0/3674797128 >> v1:172.21.15.159:6789/0 conn(0x7f8a000cedf0 legacy=0x7f8a00160bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:49:13.328 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:13.325+0000 7f89f7fff640 1 -- 172.21.15.40:0/3674797128 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a000704d0 con 0x7f8a000b3c00 2023-12-17T11:49:13.328 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:13.325+0000 7f89ff7fe640 1 --2- 172.21.15.40:0/3674797128 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8a0015ab30 0x7f8a00071d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-17T11:49:13.329 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:13.326+0000 7f89f7fff640 1 --2- 172.21.15.40:0/3674797128 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8a000b3c00 0x7f8a0015e050 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f89e8009870 tx=0x7f89e802b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32f2fbb8110ca2bf server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:49:13.329 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:13.326+0000 7f89feffd640 1 -- 172.21.15.40:0/3674797128 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89e80317c0 con 0x7f8a000b3c00 2023-12-17T11:49:13.329 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:13.326+0000 7f89feffd640 1 -- 172.21.15.40:0/3674797128 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89e8031920 con 0x7f8a000b3c00 2023-12-17T11:49:13.329 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:13.326+0000 7f89feffd640 1 -- 172.21.15.40:0/3674797128 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89e8031cb0 con 0x7f8a000b3c00 2023-12-17T11:49:13.329 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:13.327+0000 7f8a04b5c640 1 -- 172.21.15.40:0/3674797128 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8a000b3c00 msgr2=0x7f8a0015e050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:13.329 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:13.327+0000 7f8a04b5c640 1 --2- 172.21.15.40:0/3674797128 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8a000b3c00 0x7f8a0015e050 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f89e8009870 tx=0x7f89e802b860 comp rx=0 tx=0).stop 2023-12-17T11:49:13.329 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:13.327+0000 7f8a04b5c640 1 -- 172.21.15.40:0/3674797128 shutdown_connections 2023-12-17T11:49:13.329 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:13.327+0000 7f8a04b5c640 1 --2- 172.21.15.40:0/3674797128 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8a000b3c00 0x7f8a0015e050 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:13.329 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:13.327+0000 7f8a04b5c640 1 --2- 172.21.15.40:0/3674797128 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8a0015ab30 0x7f8a00071d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:13.330 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:13.327+0000 7f8a04b5c640 1 -- 172.21.15.40:0/3674797128 >> 172.21.15.40:0/3674797128 conn(0x7f8a0006a640 msgr2=0x7f8a0006aa50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:49:13.330 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:13.327+0000 7f8a04b5c640 1 -- 172.21.15.40:0/3674797128 shutdown_connections 2023-12-17T11:49:13.330 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:13.327+0000 7f8a04b5c640 1 -- 172.21.15.40:0/3674797128 wait complete. 2023-12-17T11:49:13.330 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:13.328+0000 7f8a04b5c640 1 Processor -- start 2023-12-17T11:49:13.330 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:13.329+0000 7f8a04b5c640 1 -- start start 2023-12-17T11:49:13.332 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:13.330+0000 7f8a04b5c640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8a000b3c00 0x7f8a0013a2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:13.332 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:13.330+0000 7f8a04b5c640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8a000cedf0 0x7f8a0015e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:13.332 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:13.330+0000 7f8a04b5c640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8a0015ab30 0x7f8a00151570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:13.332 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:13.330+0000 7f8a04b5c640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a0015f210 con 0x7f8a0015ab30 2023-12-17T11:49:13.333 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:13.330+0000 7f8a04b5c640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a0015f4f0 con 0x7f8a000cedf0 2023-12-17T11:49:13.333 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:13.330+0000 7f8a04b5c640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a0015f7d0 con 0x7f8a000b3c00 2023-12-17T11:49:13.333 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:13.330+0000 7f89fffff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8a0015ab30 0x7f8a00151570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:13.333 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:13.330+0000 7f89fffff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8a0015ab30 0x7f8a00151570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:41434/0 (socket says 172.21.15.40:41434) 2023-12-17T11:49:13.333 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:13.330+0000 7f89fffff640 1 -- 172.21.15.40:0/3419146618 learned_addr learned my addr 172.21.15.40:0/3419146618 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-17T11:49:13.333 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:13.330+0000 7f89f7fff640 1 --2- 172.21.15.40:0/3419146618 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8a000cedf0 0x7f8a0015e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:13.333 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:13.330+0000 7f89fffff640 1 -- 172.21.15.40:0/3419146618 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8a000b3c00 msgr2=0x7f8a0013a2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:13.333 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:13.330+0000 7f89fffff640 1 --2- 172.21.15.40:0/3419146618 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8a000b3c00 0x7f8a0013a2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:13.333 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:13.330+0000 7f89fffff640 1 -- 172.21.15.40:0/3419146618 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8a000cedf0 msgr2=0x7f8a0015e770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:13.333 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:13.330+0000 7f89fffff640 1 --2- 172.21.15.40:0/3419146618 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8a000cedf0 0x7f8a0015e770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:13.333 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:13.330+0000 7f89fffff640 1 -- 172.21.15.40:0/3419146618 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89e80094d0 con 0x7f8a0015ab30 2023-12-17T11:49:13.333 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:13.330+0000 7f89f7fff640 1 --2- 172.21.15.40:0/3419146618 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8a000cedf0 0x7f8a0015e770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-17T11:49:13.334 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:13.331+0000 7f89fffff640 1 --2- 172.21.15.40:0/3419146618 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8a0015ab30 0x7f8a00151570 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f89f800c780 tx=0x7f89f800cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:49:13.334 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:13.331+0000 7f89fcff9640 1 -- 172.21.15.40:0/3419146618 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89f8004b60 con 0x7f8a0015ab30 2023-12-17T11:49:13.334 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:13.331+0000 7f89fcff9640 1 -- 172.21.15.40:0/3419146618 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89f800ce90 con 0x7f8a0015ab30 2023-12-17T11:49:13.335 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:13.331+0000 7f8a04b5c640 1 -- 172.21.15.40:0/3419146618 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a0015fab0 con 0x7f8a0015ab30 2023-12-17T11:49:13.335 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:13.331+0000 7f89fcff9640 1 -- 172.21.15.40:0/3419146618 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89f800a850 con 0x7f8a0015ab30 2023-12-17T11:49:13.335 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:13.331+0000 7f8a04b5c640 1 -- 172.21.15.40:0/3419146618 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a001602b0 con 0x7f8a0015ab30 2023-12-17T11:49:13.335 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:13.332+0000 7f8a04b5c640 1 -- 172.21.15.40:0/3419146618 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a0015ffd0 con 0x7f8a0015ab30 2023-12-17T11:49:13.335 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:13.333+0000 7f89fcff9640 1 -- 172.21.15.40:0/3419146618 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f89f800a9b0 con 0x7f8a0015ab30 2023-12-17T11:49:13.336 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:13.334+0000 7f89fcff9640 1 --2- 172.21.15.40:0/3419146618 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f89e006ae90 0x7f89e006d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:13.336 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:13.334+0000 7f89fcff9640 1 -- 172.21.15.40:0/3419146618 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f89f8089b90 con 0x7f8a0015ab30 2023-12-17T11:49:13.336 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:13.335+0000 7f89ff7fe640 1 --2- 172.21.15.40:0/3419146618 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f89e006ae90 0x7f89e006d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:13.337 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:13.336+0000 7f89ff7fe640 1 --2- 172.21.15.40:0/3419146618 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f89e006ae90 0x7f89e006d350 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f89f0006fd0 tx=0x7f89f0008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:49:13.340 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:13.338+0000 7f89fcff9640 1 -- 172.21.15.40:0/3419146618 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f89f8054840 con 0x7f8a0015ab30 2023-12-17T11:49:13.533 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:13.531+0000 7f8a04b5c640 1 -- 172.21.15.40:0/3419146618 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f8a00074450 con 0x7f8a0015ab30 2023-12-17T11:49:13.533 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:13.532+0000 7f89fcff9640 1 -- 172.21.15.40:0/3419146618 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) v1 ==== 100+0+11 (secure 0 0 0) 0x7f89f8057e60 con 0x7f8a0015ab30 2023-12-17T11:49:13.534 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 64 2023-12-17T11:49:13.536 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:13.534+0000 7f8a04b5c640 1 -- 172.21.15.40:0/3419146618 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f89e006ae90 msgr2=0x7f89e006d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:13.536 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:13.534+0000 7f8a04b5c640 1 --2- 172.21.15.40:0/3419146618 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f89e006ae90 0x7f89e006d350 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f89f0006fd0 tx=0x7f89f0008040 comp rx=0 tx=0).stop 2023-12-17T11:49:13.536 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:13.534+0000 7f8a04b5c640 1 -- 172.21.15.40:0/3419146618 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8a0015ab30 msgr2=0x7f8a00151570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:13.537 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:13.534+0000 7f8a04b5c640 1 --2- 172.21.15.40:0/3419146618 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8a0015ab30 0x7f8a00151570 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f89f800c780 tx=0x7f89f800cc40 comp rx=0 tx=0).stop 2023-12-17T11:49:13.537 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:13.534+0000 7f8a04b5c640 1 -- 172.21.15.40:0/3419146618 shutdown_connections 2023-12-17T11:49:13.537 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:13.534+0000 7f8a04b5c640 1 --2- 172.21.15.40:0/3419146618 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f89e006ae90 0x7f89e006d350 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:13.537 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:13.534+0000 7f8a04b5c640 1 --2- 172.21.15.40:0/3419146618 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8a0015ab30 0x7f8a00151570 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:13.537 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:13.534+0000 7f8a04b5c640 1 --2- 172.21.15.40:0/3419146618 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8a000cedf0 0x7f8a0015e770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:13.537 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:13.534+0000 7f8a04b5c640 1 --2- 172.21.15.40:0/3419146618 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8a000b3c00 0x7f8a0013a2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:13.537 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:13.534+0000 7f8a04b5c640 1 -- 172.21.15.40:0/3419146618 >> 172.21.15.40:0/3419146618 conn(0x7f8a0006a640 msgr2=0x7f8a000ce150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:49:13.537 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:13.534+0000 7f8a04b5c640 1 -- 172.21.15.40:0/3419146618 shutdown_connections 2023-12-17T11:49:13.537 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:13.534+0000 7f8a04b5c640 1 -- 172.21.15.40:0/3419146618 wait complete. 2023-12-17T11:49:13.556 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-12-17T11:49:13.786 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:13.784+0000 7f42cffff640 1 Processor -- start 2023-12-17T11:49:13.786 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:13.784+0000 7f42cffff640 1 -- start start 2023-12-17T11:49:13.788 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:13.786+0000 7f42cffff640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f42d00cb5b0 0x7f42d006c130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:13.788 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:13.786+0000 7f42cffff640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f42d0070c60 0x7f42d0071110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:13.788 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:13.786+0000 7f42cffff640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42d006c770 con 0x7f42d00cb990 2023-12-17T11:49:13.789 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:13.786+0000 7f42cffff640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42d006ca50 con 0x7f42d0070c60 2023-12-17T11:49:13.789 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:13.786+0000 7f42cffff640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42d006cd30 con 0x7f42d00cb5b0 2023-12-17T11:49:13.789 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:13.786+0000 7f42cf7fe640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f42d0070c60 0x7f42d0071110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:13.789 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:13.786+0000 7f42ce7fc640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f42d00cb990 0x7f42d015f510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:55286/0 (socket says 172.21.15.40:55286) 2023-12-17T11:49:13.789 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:13.786+0000 7f42ce7fc640 1 -- 172.21.15.40:0/2352765459 learned_addr learned my addr 172.21.15.40:0/2352765459 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-12-17T11:49:13.790 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:13.787+0000 7f42ceffd640 1 --2- 172.21.15.40:0/2352765459 >> v2:172.21.15.159:3300/0 conn(0x7f42d00cb5b0 0x7f42d006c130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:13.790 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:13.787+0000 7f42cf7fe640 1 -- 172.21.15.40:0/2352765459 >> v2:172.21.15.159:3300/0 conn(0x7f42d00cb5b0 msgr2=0x7f42d006c130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:49:13.790 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:13.787+0000 7f42cf7fe640 1 --2- 172.21.15.40:0/2352765459 >> v2:172.21.15.159:3300/0 conn(0x7f42d00cb5b0 0x7f42d006c130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:13.790 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:13.787+0000 7f42cf7fe640 1 -- 172.21.15.40:0/2352765459 >> v1:172.21.15.40:6789/0 conn(0x7f42d00cb990 legacy=0x7f42d015f510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:13.790 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:13.787+0000 7f42cf7fe640 1 -- 172.21.15.40:0/2352765459 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42d006d010 con 0x7f42d0070c60 2023-12-17T11:49:13.790 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:13.787+0000 7f42cdffb640 1 -- 172.21.15.40:0/2352765459 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1496290974 0 0) 0x7f42d006c770 con 0x7f42d00cb990 2023-12-17T11:49:13.790 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:13.788+0000 7f42cf7fe640 1 --2- 172.21.15.40:0/2352765459 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f42d0070c60 0x7f42d0071110 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f42d00cfba0 tx=0x7f42c802bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8aaef7411f1c1596 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:49:13.791 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:13.788+0000 7f42cdffb640 1 -- 172.21.15.40:0/2352765459 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42c802cc80 con 0x7f42d0070c60 2023-12-17T11:49:13.791 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:13.788+0000 7f42cdffb640 1 -- 172.21.15.40:0/2352765459 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42c802cde0 con 0x7f42d0070c60 2023-12-17T11:49:13.791 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:13.788+0000 7f42cdffb640 1 -- 172.21.15.40:0/2352765459 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42c8034660 con 0x7f42d0070c60 2023-12-17T11:49:13.791 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:13.789+0000 7f42cffff640 1 -- 172.21.15.40:0/2352765459 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f42d0070c60 msgr2=0x7f42d0071110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:13.791 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:13.789+0000 7f42cffff640 1 --2- 172.21.15.40:0/2352765459 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f42d0070c60 0x7f42d0071110 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f42d00cfba0 tx=0x7f42c802bed0 comp rx=0 tx=0).stop 2023-12-17T11:49:13.792 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:13.789+0000 7f42cffff640 1 -- 172.21.15.40:0/2352765459 shutdown_connections 2023-12-17T11:49:13.792 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:13.789+0000 7f42cffff640 1 --2- 172.21.15.40:0/2352765459 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f42d0070c60 0x7f42d0071110 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:13.792 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:13.789+0000 7f42cffff640 1 --2- 172.21.15.40:0/2352765459 >> v2:172.21.15.159:3300/0 conn(0x7f42d00cb5b0 0x7f42d006c130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:13.792 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:13.789+0000 7f42cffff640 1 -- 172.21.15.40:0/2352765459 >> 172.21.15.40:0/2352765459 conn(0x7f42d00b0940 msgr2=0x7f42d00b0d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:49:13.792 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:13.789+0000 7f42cffff640 1 -- 172.21.15.40:0/2352765459 shutdown_connections 2023-12-17T11:49:13.792 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:13.789+0000 7f42cffff640 1 -- 172.21.15.40:0/2352765459 wait complete. 2023-12-17T11:49:13.794 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:13.791+0000 7f42cffff640 1 Processor -- start 2023-12-17T11:49:13.794 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:13.792+0000 7f42cffff640 1 -- start start 2023-12-17T11:49:13.796 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:13.793+0000 7f42cffff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f42d0070c60 0x7f42d014c6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:13.796 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:13.793+0000 7f42cffff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f42d00cb5b0 0x7f42d00b1f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:13.796 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:13.793+0000 7f42cffff640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f42d00cb990 0x7f42d014cf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:13.796 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:13.793+0000 7f42cffff640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42d014cbf0 con 0x7f42d0070c60 2023-12-17T11:49:13.796 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:13.793+0000 7f42cffff640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42d014d970 con 0x7f42d00cb5b0 2023-12-17T11:49:13.796 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:13.793+0000 7f42cffff640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42d014dc50 con 0x7f42d00cb990 2023-12-17T11:49:13.796 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:13.793+0000 7f42ceffd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f42d0070c60 0x7f42d014c6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:13.796 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:13.793+0000 7f42ceffd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f42d0070c60 0x7f42d014c6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:41450/0 (socket says 172.21.15.40:41450) 2023-12-17T11:49:13.796 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:13.793+0000 7f42ceffd640 1 -- 172.21.15.40:0/779451550 learned_addr learned my addr 172.21.15.40:0/779451550 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-17T11:49:13.796 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:13.794+0000 7f42cf7fe640 1 --2- 172.21.15.40:0/779451550 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f42d00cb990 0x7f42d014cf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:13.796 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:13.794+0000 7f42ce7fc640 1 --2- 172.21.15.40:0/779451550 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f42d00cb5b0 0x7f42d00b1f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:13.796 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:13.794+0000 7f42ceffd640 1 -- 172.21.15.40:0/779451550 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f42d00cb990 msgr2=0x7f42d014cf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:13.796 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:13.794+0000 7f42ceffd640 1 --2- 172.21.15.40:0/779451550 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f42d00cb990 0x7f42d014cf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:13.797 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:13.794+0000 7f42ceffd640 1 -- 172.21.15.40:0/779451550 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f42d00cb5b0 msgr2=0x7f42d00b1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:13.797 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:13.794+0000 7f42ceffd640 1 --2- 172.21.15.40:0/779451550 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f42d00cb5b0 0x7f42d00b1f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:13.797 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:13.794+0000 7f42ceffd640 1 -- 172.21.15.40:0/779451550 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42c8009a70 con 0x7f42d0070c60 2023-12-17T11:49:13.797 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:13.794+0000 7f42ceffd640 1 --2- 172.21.15.40:0/779451550 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f42d0070c60 0x7f42d014c6b0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f42c000d800 tx=0x7f42c000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:49:13.798 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:13.794+0000 7f42b7fff640 1 -- 172.21.15.40:0/779451550 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42c000b6c0 con 0x7f42d0070c60 2023-12-17T11:49:13.798 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:13.795+0000 7f42b7fff640 1 -- 172.21.15.40:0/779451550 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42c000b820 con 0x7f42d0070c60 2023-12-17T11:49:13.798 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:13.795+0000 7f42b7fff640 1 -- 172.21.15.40:0/779451550 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42c000bbb0 con 0x7f42d0070c60 2023-12-17T11:49:13.798 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:13.795+0000 7f42cffff640 1 -- 172.21.15.40:0/779451550 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42d014df30 con 0x7f42d0070c60 2023-12-17T11:49:13.798 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:13.795+0000 7f42cffff640 1 -- 172.21.15.40:0/779451550 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42d0153d00 con 0x7f42d0070c60 2023-12-17T11:49:13.798 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:13.796+0000 7f42cffff640 1 -- 172.21.15.40:0/779451550 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42d0067910 con 0x7f42d0070c60 2023-12-17T11:49:13.798 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:13.797+0000 7f42b7fff640 1 -- 172.21.15.40:0/779451550 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f42c000bd10 con 0x7f42d0070c60 2023-12-17T11:49:13.800 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:13.798+0000 7f42b7fff640 1 --2- 172.21.15.40:0/779451550 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f42bc06ae40 0x7f42bc06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:13.800 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:13.798+0000 7f42b7fff640 1 -- 172.21.15.40:0/779451550 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f42c0089ff0 con 0x7f42d0070c60 2023-12-17T11:49:13.800 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:13.798+0000 7f42ce7fc640 1 --2- 172.21.15.40:0/779451550 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f42bc06ae40 0x7f42bc06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:13.801 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:13.800+0000 7f42ce7fc640 1 --2- 172.21.15.40:0/779451550 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f42bc06ae40 0x7f42bc06d300 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f42d009c7d0 tx=0x7f42c4007b70 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:49:13.805 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:13.804+0000 7f42b7fff640 1 -- 172.21.15.40:0/779451550 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f42c00bce90 con 0x7f42d0070c60 2023-12-17T11:49:14.001 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:13.999+0000 7f42cffff640 1 -- 172.21.15.40:0/779451550 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f42d00cc4e0 con 0x7f42d0070c60 2023-12-17T11:49:14.002 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:14.000+0000 7f42b7fff640 1 -- 172.21.15.40:0/779451550 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) v1 ==== 103+0+11 (secure 0 0 0) 0x7f42c0054c40 con 0x7f42d0070c60 2023-12-17T11:49:14.003 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 32 2023-12-17T11:49:14.006 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:14.003+0000 7f42cffff640 1 -- 172.21.15.40:0/779451550 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f42bc06ae40 msgr2=0x7f42bc06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:14.006 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:14.003+0000 7f42cffff640 1 --2- 172.21.15.40:0/779451550 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f42bc06ae40 0x7f42bc06d300 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f42d009c7d0 tx=0x7f42c4007b70 comp rx=0 tx=0).stop 2023-12-17T11:49:14.006 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:14.003+0000 7f42cffff640 1 -- 172.21.15.40:0/779451550 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f42d0070c60 msgr2=0x7f42d014c6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:14.006 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:14.003+0000 7f42cffff640 1 --2- 172.21.15.40:0/779451550 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f42d0070c60 0x7f42d014c6b0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f42c000d800 tx=0x7f42c000dcc0 comp rx=0 tx=0).stop 2023-12-17T11:49:14.006 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:14.003+0000 7f42cffff640 1 -- 172.21.15.40:0/779451550 shutdown_connections 2023-12-17T11:49:14.006 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:14.003+0000 7f42cffff640 1 --2- 172.21.15.40:0/779451550 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f42bc06ae40 0x7f42bc06d300 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:14.006 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:14.003+0000 7f42cffff640 1 --2- 172.21.15.40:0/779451550 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f42d00cb990 0x7f42d014cf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:14.006 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:14.003+0000 7f42cffff640 1 --2- 172.21.15.40:0/779451550 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f42d00cb5b0 0x7f42d00b1f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:14.006 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:14.003+0000 7f42cffff640 1 --2- 172.21.15.40:0/779451550 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f42d0070c60 0x7f42d014c6b0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:14.006 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:14.003+0000 7f42cffff640 1 -- 172.21.15.40:0/779451550 >> 172.21.15.40:0/779451550 conn(0x7f42d00b0940 msgr2=0x7f42d015c5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:49:14.006 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:14.004+0000 7f42cffff640 1 -- 172.21.15.40:0/779451550 shutdown_connections 2023-12-17T11:49:14.007 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:14.004+0000 7f42cffff640 1 -- 172.21.15.40:0/779451550 wait complete. 2023-12-17T11:49:14.027 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-17T11:49:14.253 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:14.251+0000 7f2b4bd3c640 1 Processor -- start 2023-12-17T11:49:14.253 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:14.251+0000 7f2b4bd3c640 1 -- start start 2023-12-17T11:49:14.255 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:14.252+0000 7f2b4bd3c640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f2b44143e00 0x7f2b440b4040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:14.255 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:14.253+0000 7f2b4bd3c640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f2b4406c410 0x7f2b4415ecb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:14.255 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:14.253+0000 7f2b4bd3c640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b440b3bb0 con 0x7f2b44072180 2023-12-17T11:49:14.255 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:14.253+0000 7f2b4bd3c640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b441441e0 con 0x7f2b44143e00 2023-12-17T11:49:14.255 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:14.253+0000 7f2b4bd3c640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b44072680 con 0x7f2b4406c410 2023-12-17T11:49:14.255 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:14.253+0000 7f2b49ad8640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f2b44143e00 0x7f2b440b4040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:14.255 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:14.253+0000 7f2b49ad8640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f2b44143e00 0x7f2b440b4040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:41458/0 (socket says 172.21.15.40:41458) 2023-12-17T11:49:14.255 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:14.253+0000 7f2b49ad8640 1 -- 172.21.15.40:0/1706290941 learned_addr learned my addr 172.21.15.40:0/1706290941 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-17T11:49:14.256 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:14.253+0000 7f2b4a2d9640 1 --2- 172.21.15.40:0/1706290941 >> v2:172.21.15.159:3300/0 conn(0x7f2b4406c410 0x7f2b4415ecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:14.256 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:14.253+0000 7f2b49ad8640 1 -- 172.21.15.40:0/1706290941 >> v2:172.21.15.159:3300/0 conn(0x7f2b4406c410 msgr2=0x7f2b4415ecb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:49:14.256 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:14.253+0000 7f2b49ad8640 1 --2- 172.21.15.40:0/1706290941 >> v2:172.21.15.159:3300/0 conn(0x7f2b4406c410 0x7f2b4415ecb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:14.256 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:14.253+0000 7f2b49ad8640 1 -- 172.21.15.40:0/1706290941 >> v1:172.21.15.159:6789/0 conn(0x7f2b44072180 legacy=0x7f2b440b4580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:49:14.256 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:14.253+0000 7f2b49ad8640 1 -- 172.21.15.40:0/1706290941 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b440b1e30 con 0x7f2b44143e00 2023-12-17T11:49:14.257 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:14.255+0000 7f2b49ad8640 1 --2- 172.21.15.40:0/1706290941 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2b44143e00 0x7f2b440b4040 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f2b44072b60 tx=0x7f2b4002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a617f9f847ee5e9 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:49:14.257 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:14.255+0000 7f2b48ad6640 1 -- 172.21.15.40:0/1706290941 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b40031870 con 0x7f2b44143e00 2023-12-17T11:49:14.257 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:14.255+0000 7f2b48ad6640 1 -- 172.21.15.40:0/1706290941 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b400319d0 con 0x7f2b44143e00 2023-12-17T11:49:14.257 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:14.255+0000 7f2b48ad6640 1 -- 172.21.15.40:0/1706290941 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b40031d60 con 0x7f2b44143e00 2023-12-17T11:49:14.258 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:14.256+0000 7f2b4bd3c640 1 -- 172.21.15.40:0/1706290941 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2b44143e00 msgr2=0x7f2b440b4040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:14.258 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:14.256+0000 7f2b4bd3c640 1 --2- 172.21.15.40:0/1706290941 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2b44143e00 0x7f2b440b4040 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f2b44072b60 tx=0x7f2b4002b910 comp rx=0 tx=0).stop 2023-12-17T11:49:14.258 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:14.256+0000 7f2b4bd3c640 1 -- 172.21.15.40:0/1706290941 shutdown_connections 2023-12-17T11:49:14.258 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:14.256+0000 7f2b4bd3c640 1 --2- 172.21.15.40:0/1706290941 >> v2:172.21.15.159:3300/0 conn(0x7f2b4406c410 0x7f2b4415ecb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:14.258 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:14.256+0000 7f2b4bd3c640 1 --2- 172.21.15.40:0/1706290941 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2b44143e00 0x7f2b440b4040 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:14.258 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:14.256+0000 7f2b4bd3c640 1 -- 172.21.15.40:0/1706290941 >> 172.21.15.40:0/1706290941 conn(0x7f2b440b0a90 msgr2=0x7f2b440b0e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:49:14.258 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:14.256+0000 7f2b4bd3c640 1 -- 172.21.15.40:0/1706290941 shutdown_connections 2023-12-17T11:49:14.258 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:14.256+0000 7f2b4bd3c640 1 -- 172.21.15.40:0/1706290941 wait complete. 2023-12-17T11:49:14.260 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:14.258+0000 7f2b4bd3c640 1 Processor -- start 2023-12-17T11:49:14.260 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:14.258+0000 7f2b4bd3c640 1 -- start start 2023-12-17T11:49:14.262 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:14.259+0000 7f2b4bd3c640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2b4406c410 0x7f2b44136de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:14.262 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:14.259+0000 7f2b4bd3c640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2b44072180 0x7f2b44141d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:14.262 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:14.259+0000 7f2b4bd3c640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2b44143e00 0x7f2b44142250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:14.262 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:14.259+0000 7f2b4bd3c640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b44138d50 con 0x7f2b4406c410 2023-12-17T11:49:14.262 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:14.259+0000 7f2b4bd3c640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b4413e060 con 0x7f2b44072180 2023-12-17T11:49:14.262 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:14.259+0000 7f2b4bd3c640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b44142880 con 0x7f2b44143e00 2023-12-17T11:49:14.262 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:14.259+0000 7f2b49ad8640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2b4406c410 0x7f2b44136de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:14.262 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:14.259+0000 7f2b49ad8640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2b4406c410 0x7f2b44136de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:41460/0 (socket says 172.21.15.40:41460) 2023-12-17T11:49:14.262 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:14.259+0000 7f2b49ad8640 1 -- 172.21.15.40:0/4221857222 learned_addr learned my addr 172.21.15.40:0/4221857222 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-17T11:49:14.262 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:14.260+0000 7f2b492d7640 1 --2- 172.21.15.40:0/4221857222 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2b44072180 0x7f2b44141d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:14.262 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:14.260+0000 7f2b49ad8640 1 -- 172.21.15.40:0/4221857222 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2b44143e00 msgr2=0x7f2b44142250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:14.262 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:14.260+0000 7f2b49ad8640 1 --2- 172.21.15.40:0/4221857222 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2b44143e00 0x7f2b44142250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:14.263 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:14.260+0000 7f2b49ad8640 1 -- 172.21.15.40:0/4221857222 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2b44072180 msgr2=0x7f2b44141d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:14.263 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:14.260+0000 7f2b49ad8640 1 --2- 172.21.15.40:0/4221857222 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2b44072180 0x7f2b44141d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:14.263 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:14.260+0000 7f2b49ad8640 1 -- 172.21.15.40:0/4221857222 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b400094d0 con 0x7f2b4406c410 2023-12-17T11:49:14.263 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:14.260+0000 7f2b492d7640 1 --2- 172.21.15.40:0/4221857222 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2b44072180 0x7f2b44141d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-17T11:49:14.263 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:14.260+0000 7f2b49ad8640 1 --2- 172.21.15.40:0/4221857222 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2b4406c410 0x7f2b44136de0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f2b40000c00 tx=0x7f2b400046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:49:14.264 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:14.260+0000 7f2b3a7fc640 1 -- 172.21.15.40:0/4221857222 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b40031840 con 0x7f2b4406c410 2023-12-17T11:49:14.264 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:14.260+0000 7f2b3a7fc640 1 -- 172.21.15.40:0/4221857222 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b400443f0 con 0x7f2b4406c410 2023-12-17T11:49:14.264 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:14.260+0000 7f2b3a7fc640 1 -- 172.21.15.40:0/4221857222 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b400447a0 con 0x7f2b4406c410 2023-12-17T11:49:14.264 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:14.260+0000 7f2b4bd3c640 1 -- 172.21.15.40:0/4221857222 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b44142b60 con 0x7f2b4406c410 2023-12-17T11:49:14.264 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:14.261+0000 7f2b4bd3c640 1 -- 172.21.15.40:0/4221857222 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b44138970 con 0x7f2b4406c410 2023-12-17T11:49:14.264 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:14.262+0000 7f2b4bd3c640 1 -- 172.21.15.40:0/4221857222 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b44138e90 con 0x7f2b4406c410 2023-12-17T11:49:14.264 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:14.263+0000 7f2b3a7fc640 1 -- 172.21.15.40:0/4221857222 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f2b4004d450 con 0x7f2b4406c410 2023-12-17T11:49:14.265 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:14.264+0000 7f2b3a7fc640 1 --2- 172.21.15.40:0/4221857222 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f2b2806ae40 0x7f2b2806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:14.265 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:14.264+0000 7f2b3a7fc640 1 -- 172.21.15.40:0/4221857222 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f2b4002d040 con 0x7f2b4406c410 2023-12-17T11:49:14.266 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:14.264+0000 7f2b492d7640 1 --2- 172.21.15.40:0/4221857222 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f2b2806ae40 0x7f2b2806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:14.267 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:14.266+0000 7f2b492d7640 1 --2- 172.21.15.40:0/4221857222 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f2b2806ae40 0x7f2b2806d300 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f2b34007fd0 tx=0x7f2b34009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:49:14.270 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:14.268+0000 7f2b3a7fc640 1 -- 172.21.15.40:0/4221857222 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f2b44138e90 con 0x7f2b4406c410 2023-12-17T11:49:14.467 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:14.465+0000 7f2b4bd3c640 1 -- 172.21.15.40:0/4221857222 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2b44138e90 con 0x7f2b4406c410 2023-12-17T11:49:14.469 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:14.467+0000 7f2b3a7fc640 1 -- 172.21.15.40:0/4221857222 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+18697 (secure 0 0 0) 0x7f2b40076e30 con 0x7f2b4406c410 2023-12-17T11:49:14.470 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T11:49:14.470 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":27,"fsid":"099cd35d-80d9-4ca4-8424-de13b3b03ac7","created":"2023-12-17T11:47:53.450097+0000","modified":"2023-12-17T11:49:00.483840+0000","last_up_change":"2023-12-17T11:48:05.724195+0000","last_in_change":"2023-12-17T11:47:56.956499+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-17T11:48:06.668943+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-17T11:48:16.151444+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-17T11:48:16.717726+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-17T11:48:20.534819+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a88bfd46-63b8-48b1-9c0e-5c9cdc31bd38","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":555204741},{"type":"v1","addr":"172.21.15.40:6802","nonce":555204741}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":555204741},{"type":"v1","addr":"172.21.15.40:6807","nonce":555204741}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":555204741},{"type":"v1","addr":"172.21.15.40:6815","nonce":555204741}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6809","nonce":555204741},{"type":"v1","addr":"172.21.15.40:6812","nonce":555204741}]},"public_addr":"172.21.15.40:6802/555204741","cluster_addr":"172.21.15.40:6807/555204741","heartbeat_back_addr":"172.21.15.40:6815/555204741","heartbeat_front_addr":"172.21.15.40:6812/555204741","state":["exists","up"]},{"osd":1,"uuid":"c5d628ae-36f4-4866-802c-b162f0e90add","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6801","nonce":1221318112},{"type":"v1","addr":"172.21.15.40:6803","nonce":1221318112}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6805","nonce":1221318112},{"type":"v1","addr":"172.21.15.40:6806","nonce":1221318112}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6811","nonce":1221318112},{"type":"v1","addr":"172.21.15.40:6813","nonce":1221318112}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":1221318112},{"type":"v1","addr":"172.21.15.40:6810","nonce":1221318112}]},"public_addr":"172.21.15.40:6803/1221318112","cluster_addr":"172.21.15.40:6806/1221318112","heartbeat_back_addr":"172.21.15.40:6813/1221318112","heartbeat_front_addr":"172.21.15.40:6810/1221318112","state":["exists","up"]},{"osd":2,"uuid":"d986ad6a-af2f-47fc-9c3b-fbda27b82b73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":1959000265},{"type":"v1","addr":"172.21.15.40:6817","nonce":1959000265}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6818","nonce":1959000265},{"type":"v1","addr":"172.21.15.40:6819","nonce":1959000265}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":1959000265},{"type":"v1","addr":"172.21.15.40:6827","nonce":1959000265}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":1959000265},{"type":"v1","addr":"172.21.15.40:6822","nonce":1959000265}]},"public_addr":"172.21.15.40:6817/1959000265","cluster_addr":"172.21.15.40:6819/1959000265","heartbeat_back_addr":"172.21.15.40:6827/1959000265","heartbeat_front_addr":"172.21.15.40:6822/1959000265","state":["exists","up"]},{"osd":3,"uuid":"d79d22b7-be05-41b2-b95d-697db677fd02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6821","nonce":974040287},{"type":"v1","addr":"172.21.15.40:6823","nonce":974040287}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6825","nonce":974040287},{"type":"v1","addr":"172.21.15.40:6826","nonce":974040287}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":974040287},{"type":"v1","addr":"172.21.15.40:6831","nonce":974040287}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":974040287},{"type":"v1","addr":"172.21.15.40:6829","nonce":974040287}]},"public_addr":"172.21.15.40:6823/974040287","cluster_addr":"172.21.15.40:6826/974040287","heartbeat_back_addr":"172.21.15.40:6831/974040287","heartbeat_front_addr":"172.21.15.40:6829/974040287","state":["exists","up"]},{"osd":4,"uuid":"62a7a233-d3ea-40be-91de-180c0208d639","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6808","nonce":3937787733},{"type":"v1","addr":"172.21.15.159:6809","nonce":3937787733}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6810","nonce":3937787733},{"type":"v1","addr":"172.21.15.159:6811","nonce":3937787733}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6814","nonce":3937787733},{"type":"v1","addr":"172.21.15.159:6815","nonce":3937787733}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6812","nonce":3937787733},{"type":"v1","addr":"172.21.15.159:6813","nonce":3937787733}]},"public_addr":"172.21.15.159:6809/3937787733","cluster_addr":"172.21.15.159:6811/3937787733","heartbeat_back_addr":"172.21.15.159:6815/3937787733","heartbeat_front_addr":"172.21.15.159:6813/3937787733","state":["exists","up"]},{"osd":5,"uuid":"84629cea-dc0e-4b5e-b203-5ea963839281","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6816","nonce":3032505240},{"type":"v1","addr":"172.21.15.159:6817","nonce":3032505240}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6818","nonce":3032505240},{"type":"v1","addr":"172.21.15.159:6819","nonce":3032505240}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6822","nonce":3032505240},{"type":"v1","addr":"172.21.15.159:6823","nonce":3032505240}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6820","nonce":3032505240},{"type":"v1","addr":"172.21.15.159:6821","nonce":3032505240}]},"public_addr":"172.21.15.159:6817/3032505240","cluster_addr":"172.21.15.159:6819/3032505240","heartbeat_back_addr":"172.21.15.159:6823/3032505240","heartbeat_front_addr":"172.21.15.159:6821/3032505240","state":["exists","up"]},{"osd":6,"uuid":"4ae3af3a-1743-4070-a91d-8be5c31cdb04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6800","nonce":2411788597},{"type":"v1","addr":"172.21.15.159:6801","nonce":2411788597}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6802","nonce":2411788597},{"type":"v1","addr":"172.21.15.159:6803","nonce":2411788597}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6806","nonce":2411788597},{"type":"v1","addr":"172.21.15.159:6807","nonce":2411788597}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6804","nonce":2411788597},{"type":"v1","addr":"172.21.15.159:6805","nonce":2411788597}]},"public_addr":"172.21.15.159:6801/2411788597","cluster_addr":"172.21.15.159:6803/2411788597","heartbeat_back_addr":"172.21.15.159:6807/2411788597","heartbeat_front_addr":"172.21.15.159:6805/2411788597","state":["exists","up"]},{"osd":7,"uuid":"c1f4c7f2-8f75-4f95-bc63-a332773e3b8e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6824","nonce":478953349},{"type":"v1","addr":"172.21.15.159:6825","nonce":478953349}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6826","nonce":478953349},{"type":"v1","addr":"172.21.15.159:6827","nonce":478953349}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6830","nonce":478953349},{"type":"v1","addr":"172.21.15.159:6831","nonce":478953349}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6828","nonce":478953349},{"type":"v1","addr":"172.21.15.159:6829","nonce":478953349}]},"public_addr":"172.21.15.159:6825/478953349","cluster_addr":"172.21.15.159:6827/478953349","heartbeat_back_addr":"172.21.15.159:6831/478953349","heartbeat_front_addr":"172.21.15.159:6829/478953349","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T11:48:02.023567+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T11:48:02.278216+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T11:48:02.311843+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T11:48:01.773372+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T11:48:02.618910+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T11:48:02.361559+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T11:48:02.223997+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T11:48:02.604403+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.2","mappings":[{"from":3,"to":2}]},{"pgid":"3.d","mappings":[{"from":5,"to":1}]},{"pgid":"3.13","mappings":[{"from":7,"to":2}]},{"pgid":"3.17","mappings":[{"from":0,"to":2}]},{"pgid":"3.38","mappings":[{"from":5,"to":1}]},{"pgid":"4.2","mappings":[{"from":1,"to":2}]},{"pgid":"4.10","mappings":[{"from":1,"to":2}]},{"pgid":"4.18","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-17T11:49:14.472 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:14.470+0000 7f2b4bd3c640 1 -- 172.21.15.40:0/4221857222 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f2b2806ae40 msgr2=0x7f2b2806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:14.472 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:14.470+0000 7f2b4bd3c640 1 --2- 172.21.15.40:0/4221857222 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f2b2806ae40 0x7f2b2806d300 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f2b34007fd0 tx=0x7f2b34009040 comp rx=0 tx=0).stop 2023-12-17T11:49:14.472 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:14.470+0000 7f2b4bd3c640 1 -- 172.21.15.40:0/4221857222 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2b4406c410 msgr2=0x7f2b44136de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:14.472 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:14.470+0000 7f2b4bd3c640 1 --2- 172.21.15.40:0/4221857222 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2b4406c410 0x7f2b44136de0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f2b40000c00 tx=0x7f2b400046c0 comp rx=0 tx=0).stop 2023-12-17T11:49:14.472 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:14.470+0000 7f2b4bd3c640 1 -- 172.21.15.40:0/4221857222 shutdown_connections 2023-12-17T11:49:14.473 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:14.470+0000 7f2b4bd3c640 1 --2- 172.21.15.40:0/4221857222 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f2b2806ae40 0x7f2b2806d300 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:14.473 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:14.470+0000 7f2b4bd3c640 1 --2- 172.21.15.40:0/4221857222 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2b44143e00 0x7f2b44142250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:14.473 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:14.470+0000 7f2b4bd3c640 1 --2- 172.21.15.40:0/4221857222 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2b44072180 0x7f2b44141d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:14.473 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:14.470+0000 7f2b4bd3c640 1 --2- 172.21.15.40:0/4221857222 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2b4406c410 0x7f2b44136de0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:14.473 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:14.470+0000 7f2b4bd3c640 1 -- 172.21.15.40:0/4221857222 >> 172.21.15.40:0/4221857222 conn(0x7f2b440b0a90 msgr2=0x7f2b440af790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:49:14.473 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:14.470+0000 7f2b4bd3c640 1 -- 172.21.15.40:0/4221857222 shutdown_connections 2023-12-17T11:49:14.473 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:14.470+0000 7f2b4bd3c640 1 -- 172.21.15.40:0/4221857222 wait complete. 2023-12-17T11:49:14.490 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-17T11:48:06.668943+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-17T11:48:16.151444+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-17T11:48:16.717726+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-12-17T11:48:20.534819+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-12-17T11:49:14.490 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-17T11:49:14.713 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:14.709+0000 7fe72759e640 1 Processor -- start 2023-12-17T11:49:14.713 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:14.709+0000 7fe72759e640 1 -- start start 2023-12-17T11:49:14.713 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:14.711+0000 7fe72759e640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe7280cfe70 0x7fe728168530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:14.714 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:14.711+0000 7fe72759e640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7280c6b80 con 0x7fe7280b3350 2023-12-17T11:49:14.714 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:14.711+0000 7fe72759e640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7280d3bf0 con 0x7fe7280b3730 2023-12-17T11:49:14.714 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:14.711+0000 7fe72759e640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7280d3ed0 con 0x7fe7280cfe70 2023-12-17T11:49:14.714 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:14.711+0000 7fe72659c640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fe7280b3350 0x7fe7280b3ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:55294/0 (socket says 172.21.15.40:55294) 2023-12-17T11:49:14.714 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:14.711+0000 7fe72659c640 1 -- 172.21.15.40:0/516968113 learned_addr learned my addr 172.21.15.40:0/516968113 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-12-17T11:49:14.716 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:14.712+0000 7fe726d9d640 1 --2- 172.21.15.40:0/516968113 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe7280cfe70 0x7fe728168530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:14.716 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:14.712+0000 7fe72559a640 1 -- 172.21.15.40:0/516968113 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3337561977 0 0) 0x7fe7280c6b80 con 0x7fe7280b3350 2023-12-17T11:49:14.716 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:14.712+0000 7fe72559a640 1 -- 172.21.15.40:0/516968113 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe714003520 con 0x7fe7280b3350 2023-12-17T11:49:14.716 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:14.712+0000 7fe72559a640 1 -- 172.21.15.40:0/516968113 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2637497747 0 0) 0x7fe714003520 con 0x7fe7280b3350 2023-12-17T11:49:14.716 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:14.712+0000 7fe72559a640 1 -- 172.21.15.40:0/516968113 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe7280cfe70 msgr2=0x7fe728168530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:49:14.716 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:14.712+0000 7fe72559a640 1 --2- 172.21.15.40:0/516968113 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe7280cfe70 0x7fe728168530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:14.716 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:14.712+0000 7fe72559a640 1 -- 172.21.15.40:0/516968113 >> v1:172.21.15.159:6789/0 conn(0x7fe7280b3730 legacy=0x7fe7280cf760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:14.716 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:14.712+0000 7fe72559a640 1 -- 172.21.15.40:0/516968113 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7280d18c0 con 0x7fe7280b3350 2023-12-17T11:49:14.716 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:14.712+0000 7fe72559a640 1 -- 172.21.15.40:0/516968113 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2643242555 0 0) 0x7fe7180019f0 con 0x7fe7280b3350 2023-12-17T11:49:14.716 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:14.712+0000 7fe72559a640 1 -- 172.21.15.40:0/516968113 >> v1:172.21.15.40:6789/0 conn(0x7fe7280b3350 legacy=0x7fe7280b3ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:14.716 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:14.712+0000 7fe72559a640 1 --2- 172.21.15.40:0/516968113 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe7140039a0 0x7fe714003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:14.717 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:14.712+0000 7fe72559a640 1 --2- 172.21.15.40:0/516968113 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe7140047c0 0x7fe714004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:14.717 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:14.712+0000 7fe72559a640 1 --2- 172.21.15.40:0/516968113 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe714005180 0x7fe71400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:14.717 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:14.712+0000 7fe72559a640 1 -- 172.21.15.40:0/516968113 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7280d3ed0 con 0x7fe7140047c0 2023-12-17T11:49:14.717 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:14.712+0000 7fe72559a640 1 -- 172.21.15.40:0/516968113 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe71400c080 con 0x7fe714005180 2023-12-17T11:49:14.717 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:14.713+0000 7fe72559a640 1 -- 172.21.15.40:0/516968113 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe71400c240 con 0x7fe7140039a0 2023-12-17T11:49:14.717 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:14.713+0000 7fe725d9b640 1 --2- 172.21.15.40:0/516968113 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe7140047c0 0x7fe714004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:14.717 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:14.713+0000 7fe726d9d640 1 --2- 172.21.15.40:0/516968113 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe714005180 0x7fe71400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:14.717 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:14.713+0000 7fe72659c640 1 --2- 172.21.15.40:0/516968113 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe7140039a0 0x7fe714003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:14.717 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:14.713+0000 7fe725d9b640 1 -- 172.21.15.40:0/516968113 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe7140039a0 msgr2=0x7fe714003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:49:14.717 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:14.713+0000 7fe725d9b640 1 --2- 172.21.15.40:0/516968113 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe7140039a0 0x7fe714003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:14.717 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:14.713+0000 7fe725d9b640 1 -- 172.21.15.40:0/516968113 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe714005180 msgr2=0x7fe71400b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:49:14.718 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:14.713+0000 7fe725d9b640 1 --2- 172.21.15.40:0/516968113 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe714005180 0x7fe71400b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:14.718 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:14.713+0000 7fe725d9b640 1 -- 172.21.15.40:0/516968113 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe714003520 con 0x7fe7140047c0 2023-12-17T11:49:14.718 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:14.713+0000 7fe72659c640 1 --2- 172.21.15.40:0/516968113 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe7140039a0 0x7fe714003dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-17T11:49:14.719 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:14.714+0000 7fe725d9b640 1 --2- 172.21.15.40:0/516968113 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe7140047c0 0x7fe714004c40 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fe710001750 tx=0x7fe7140057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=838020b593c8a765 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:49:14.719 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:14.715+0000 7fe72559a640 1 -- 172.21.15.40:0/516968113 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7100052d0 con 0x7fe7140047c0 2023-12-17T11:49:14.719 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:14.715+0000 7fe72559a640 1 -- 172.21.15.40:0/516968113 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe71002e050 con 0x7fe7140047c0 2023-12-17T11:49:14.719 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:14.715+0000 7fe72559a640 1 -- 172.21.15.40:0/516968113 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe710003830 con 0x7fe7140047c0 2023-12-17T11:49:14.719 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:14.715+0000 7fe72759e640 1 -- 172.21.15.40:0/516968113 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe7140047c0 msgr2=0x7fe714004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:14.719 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:14.715+0000 7fe72759e640 1 --2- 172.21.15.40:0/516968113 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe7140047c0 0x7fe714004c40 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fe710001750 tx=0x7fe7140057f0 comp rx=0 tx=0).stop 2023-12-17T11:49:14.719 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:14.715+0000 7fe726d9d640 1 -- 172.21.15.40:0/516968113 reap_dead start 2023-12-17T11:49:14.720 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:14.715+0000 7fe72759e640 1 -- 172.21.15.40:0/516968113 shutdown_connections 2023-12-17T11:49:14.720 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:14.715+0000 7fe72759e640 1 -- 172.21.15.40:0/516968113 >> 172.21.15.40:0/516968113 conn(0x7fe7280d3030 msgr2=0x7fe7280d3440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:49:14.720 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:14.715+0000 7fe72759e640 1 -- 172.21.15.40:0/516968113 shutdown_connections 2023-12-17T11:49:14.720 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:14.716+0000 7fe72759e640 1 -- 172.21.15.40:0/516968113 wait complete. 2023-12-17T11:49:14.720 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:14.717+0000 7fe72759e640 1 Processor -- start 2023-12-17T11:49:14.722 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:14.717+0000 7fe72759e640 1 -- start start 2023-12-17T11:49:14.722 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:14.718+0000 7fe72759e640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe7140047c0 0x7fe72814b550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:14.722 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:14.718+0000 7fe72759e640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe7281518e0 0x7fe72814e740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:14.722 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:14.718+0000 7fe72759e640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe72814bd00 0x7fe72814c1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:14.722 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:14.718+0000 7fe72759e640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe72814ba90 con 0x7fe72814bd00 2023-12-17T11:49:14.722 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:14.718+0000 7fe72759e640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7280b6390 con 0x7fe7140047c0 2023-12-17T11:49:14.722 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:14.718+0000 7fe72759e640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7280b7dc0 con 0x7fe7281518e0 2023-12-17T11:49:14.722 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:14.719+0000 7fe726d9d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe72814bd00 0x7fe72814c1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:14.722 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:14.719+0000 7fe726d9d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe72814bd00 0x7fe72814c1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:41486/0 (socket says 172.21.15.40:41486) 2023-12-17T11:49:14.723 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:14.719+0000 7fe726d9d640 1 -- 172.21.15.40:0/1847748387 learned_addr learned my addr 172.21.15.40:0/1847748387 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-17T11:49:14.723 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:14.719+0000 7fe72659c640 1 --2- 172.21.15.40:0/1847748387 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe7140047c0 0x7fe72814b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:14.723 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:14.719+0000 7fe726d9d640 1 -- 172.21.15.40:0/1847748387 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe7281518e0 msgr2=0x7fe72814e740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:14.723 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:14.719+0000 7fe726d9d640 1 --2- 172.21.15.40:0/1847748387 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe7281518e0 0x7fe72814e740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:14.723 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:14.719+0000 7fe726d9d640 1 -- 172.21.15.40:0/1847748387 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe7140047c0 msgr2=0x7fe72814b550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:14.723 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:14.719+0000 7fe726d9d640 1 --2- 172.21.15.40:0/1847748387 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe7140047c0 0x7fe72814b550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:14.723 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:14.719+0000 7fe726d9d640 1 -- 172.21.15.40:0/1847748387 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7280b48a0 con 0x7fe72814bd00 2023-12-17T11:49:14.723 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:14.720+0000 7fe726d9d640 1 --2- 172.21.15.40:0/1847748387 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe72814bd00 0x7fe72814c1b0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fe7280cd730 tx=0x7fe72000f670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:49:14.723 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:14.720+0000 7fe71effd640 1 -- 172.21.15.40:0/1847748387 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe720004440 con 0x7fe72814bd00 2023-12-17T11:49:14.723 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:14.720+0000 7fe71effd640 1 -- 172.21.15.40:0/1847748387 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe72000fe70 con 0x7fe72814bd00 2023-12-17T11:49:14.723 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:14.720+0000 7fe72759e640 1 -- 172.21.15.40:0/1847748387 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7280b77b0 con 0x7fe72814bd00 2023-12-17T11:49:14.723 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:14.720+0000 7fe71effd640 1 -- 172.21.15.40:0/1847748387 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe720003850 con 0x7fe72814bd00 2023-12-17T11:49:14.723 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:14.720+0000 7fe72759e640 1 -- 172.21.15.40:0/1847748387 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7280b60b0 con 0x7fe72814bd00 2023-12-17T11:49:14.724 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:14.721+0000 7fe72759e640 1 -- 172.21.15.40:0/1847748387 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe728074450 con 0x7fe72814bd00 2023-12-17T11:49:14.724 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:14.722+0000 7fe71effd640 1 -- 172.21.15.40:0/1847748387 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fe7200039b0 con 0x7fe72814bd00 2023-12-17T11:49:14.725 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:14.723+0000 7fe71effd640 1 --2- 172.21.15.40:0/1847748387 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7fe70806ae70 0x7fe70806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:14.725 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:14.723+0000 7fe71effd640 1 -- 172.21.15.40:0/1847748387 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6692+0+0 (secure 0 0 0) 0x7fe720089680 con 0x7fe72814bd00 2023-12-17T11:49:14.725 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:14.724+0000 7fe72659c640 1 --2- 172.21.15.40:0/1847748387 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7fe70806ae70 0x7fe70806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:14.727 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:14.725+0000 7fe72659c640 1 --2- 172.21.15.40:0/1847748387 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7fe70806ae70 0x7fe70806d330 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fe718001370 tx=0x7fe718009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:49:14.730 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:14.728+0000 7fe71effd640 1 -- 172.21.15.40:0/1847748387 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fe7200542b0 con 0x7fe72814bd00 2023-12-17T11:49:14.931 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:14.928+0000 7fe72759e640 1 -- 172.21.15.40:0/1847748387 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fe728072830 con 0x7fe72814bd00 2023-12-17T11:49:14.931 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:14.929+0000 7fe71effd640 1 -- 172.21.15.40:0/1847748387 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) v1 ==== 93+0+10 (secure 0 0 0) 0x7fe7200578d0 con 0x7fe72814bd00 2023-12-17T11:49:14.931 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 1 2023-12-17T11:49:14.934 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:14.932+0000 7fe72759e640 1 -- 172.21.15.40:0/1847748387 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7fe70806ae70 msgr2=0x7fe70806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:14.934 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:14.932+0000 7fe72759e640 1 --2- 172.21.15.40:0/1847748387 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7fe70806ae70 0x7fe70806d330 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fe718001370 tx=0x7fe718009040 comp rx=0 tx=0).stop 2023-12-17T11:49:14.934 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:14.932+0000 7fe72759e640 1 -- 172.21.15.40:0/1847748387 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe72814bd00 msgr2=0x7fe72814c1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:14.934 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:14.932+0000 7fe72759e640 1 --2- 172.21.15.40:0/1847748387 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe72814bd00 0x7fe72814c1b0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fe7280cd730 tx=0x7fe72000f670 comp rx=0 tx=0).stop 2023-12-17T11:49:14.934 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:14.932+0000 7fe72759e640 1 -- 172.21.15.40:0/1847748387 shutdown_connections 2023-12-17T11:49:14.934 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:14.932+0000 7fe72759e640 1 --2- 172.21.15.40:0/1847748387 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7fe70806ae70 0x7fe70806d330 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:14.935 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:14.932+0000 7fe72759e640 1 --2- 172.21.15.40:0/1847748387 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe72814bd00 0x7fe72814c1b0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:14.935 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:14.932+0000 7fe72759e640 1 --2- 172.21.15.40:0/1847748387 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe7281518e0 0x7fe72814e740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:14.935 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:14.932+0000 7fe72759e640 1 --2- 172.21.15.40:0/1847748387 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe7140047c0 0x7fe72814b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:14.935 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:14.932+0000 7fe72759e640 1 -- 172.21.15.40:0/1847748387 >> 172.21.15.40:0/1847748387 conn(0x7fe7280d3030 msgr2=0x7fe7280cf6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:49:14.935 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:14.932+0000 7fe72759e640 1 -- 172.21.15.40:0/1847748387 shutdown_connections 2023-12-17T11:49:14.935 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:14.932+0000 7fe72759e640 1 -- 172.21.15.40:0/1847748387 wait complete. 2023-12-17T11:49:14.952 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-17T11:49:15.181 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:15.179+0000 7f2396464640 1 Processor -- start 2023-12-17T11:49:15.182 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:15.179+0000 7f2396464640 1 -- start start 2023-12-17T11:49:15.183 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:15.181+0000 7f2396464640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f2390071c70 0x7f2390165ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:15.183 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:15.181+0000 7f2396464640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f239006c770 con 0x7f23900cb5b0 2023-12-17T11:49:15.183 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:15.181+0000 7f2396464640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f239006ca50 con 0x7f239006c130 2023-12-17T11:49:15.183 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:15.181+0000 7f2396464640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f239006cd30 con 0x7f2390071c70 2023-12-17T11:49:15.183 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:15.181+0000 7f2395462640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f23900cb5b0 0x7f23900cb990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:37836/0 (socket says 172.21.15.40:37836) 2023-12-17T11:49:15.184 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:15.181+0000 7f2395462640 1 -- 172.21.15.40:0/1742107154 learned_addr learned my addr 172.21.15.40:0/1742107154 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-12-17T11:49:15.184 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:15.181+0000 7f2395c63640 1 --2- 172.21.15.40:0/1742107154 >> v2:172.21.15.40:3300/0 conn(0x7f2390071c70 0x7f2390165ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:15.184 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:15.182+0000 7f2395c63640 1 -- 172.21.15.40:0/1742107154 >> v1:172.21.15.159:6789/0 conn(0x7f239006c130 legacy=0x7f239015f510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:49:15.184 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:15.182+0000 7f2387fff640 1 -- 172.21.15.40:0/1742107154 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4293473878 0 0) 0x7f239006c770 con 0x7f23900cb5b0 2023-12-17T11:49:15.184 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:15.182+0000 7f2395c63640 1 -- 172.21.15.40:0/1742107154 >> v1:172.21.15.40:6789/0 conn(0x7f23900cb5b0 legacy=0x7f23900cb990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:15.184 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:15.182+0000 7f2395c63640 1 -- 172.21.15.40:0/1742107154 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f239006d010 con 0x7f2390071c70 2023-12-17T11:49:15.185 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:15.183+0000 7f2395c63640 1 --2- 172.21.15.40:0/1742107154 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2390071c70 0x7f2390165ee0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f2388009d90 tx=0x7f238802bf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7c6bbd3319280a server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:49:15.186 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:15.184+0000 7f2387fff640 1 -- 172.21.15.40:0/1742107154 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f238802cd00 con 0x7f2390071c70 2023-12-17T11:49:15.186 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:15.184+0000 7f2387fff640 1 -- 172.21.15.40:0/1742107154 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f238802ce60 con 0x7f2390071c70 2023-12-17T11:49:15.186 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:15.184+0000 7f2387fff640 1 -- 172.21.15.40:0/1742107154 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2388034660 con 0x7f2390071c70 2023-12-17T11:49:15.187 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:15.184+0000 7f2396464640 1 -- 172.21.15.40:0/1742107154 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2390071c70 msgr2=0x7f2390165ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:15.187 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:15.184+0000 7f2396464640 1 --2- 172.21.15.40:0/1742107154 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2390071c70 0x7f2390165ee0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f2388009d90 tx=0x7f238802bf50 comp rx=0 tx=0).stop 2023-12-17T11:49:15.187 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:15.184+0000 7f2396464640 1 -- 172.21.15.40:0/1742107154 shutdown_connections 2023-12-17T11:49:15.187 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:15.184+0000 7f2396464640 1 --2- 172.21.15.40:0/1742107154 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2390071c70 0x7f2390165ee0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:15.187 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:15.184+0000 7f2396464640 1 -- 172.21.15.40:0/1742107154 >> 172.21.15.40:0/1742107154 conn(0x7f23900b0940 msgr2=0x7f23900b0d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:49:15.187 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:15.184+0000 7f2396464640 1 -- 172.21.15.40:0/1742107154 shutdown_connections 2023-12-17T11:49:15.187 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:15.184+0000 7f2396464640 1 -- 172.21.15.40:0/1742107154 wait complete. 2023-12-17T11:49:15.188 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:15.186+0000 7f2396464640 1 Processor -- start 2023-12-17T11:49:15.188 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:15.186+0000 7f2396464640 1 -- start start 2023-12-17T11:49:15.190 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:15.187+0000 7f2396464640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f239006c130 0x7f23900b3320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:15.190 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:15.187+0000 7f2396464640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2390071c70 0x7f239014f180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:15.190 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:15.187+0000 7f2396464640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f23900cb5b0 0x7f239014f6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:15.190 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:15.187+0000 7f2396464640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23900ccb30 con 0x7f239006c130 2023-12-17T11:49:15.191 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:15.187+0000 7f2396464640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23900cce10 con 0x7f23900cb5b0 2023-12-17T11:49:15.191 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:15.187+0000 7f2396464640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23900cd0f0 con 0x7f2390071c70 2023-12-17T11:49:15.191 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:15.188+0000 7f2395462640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f239006c130 0x7f23900b3320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:15.191 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:15.188+0000 7f2395462640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f239006c130 0x7f23900b3320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:48126/0 (socket says 172.21.15.40:48126) 2023-12-17T11:49:15.191 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:15.188+0000 7f2395462640 1 -- 172.21.15.40:0/1901020657 learned_addr learned my addr 172.21.15.40:0/1901020657 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-17T11:49:15.191 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:15.188+0000 7f2395462640 1 -- 172.21.15.40:0/1901020657 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2390071c70 msgr2=0x7f239014f180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:15.191 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:15.188+0000 7f2395462640 1 --2- 172.21.15.40:0/1901020657 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2390071c70 0x7f239014f180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:15.191 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:15.188+0000 7f2395462640 1 -- 172.21.15.40:0/1901020657 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f23900cb5b0 msgr2=0x7f239014f6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:15.191 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:15.188+0000 7f2395c63640 1 --2- 172.21.15.40:0/1901020657 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f23900cb5b0 0x7f239014f6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:15.191 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:15.188+0000 7f2395462640 1 --2- 172.21.15.40:0/1901020657 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f23900cb5b0 0x7f239014f6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:15.191 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:15.188+0000 7f2395462640 1 -- 172.21.15.40:0/1901020657 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2388009a70 con 0x7f239006c130 2023-12-17T11:49:15.191 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:15.188+0000 7f2395462640 1 --2- 172.21.15.40:0/1901020657 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f239006c130 0x7f23900b3320 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f238c00c3f0 tx=0x7f238c00c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:49:15.192 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:15.189+0000 7f2385ffb640 1 -- 172.21.15.40:0/1901020657 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f238c0074e0 con 0x7f239006c130 2023-12-17T11:49:15.192 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:15.189+0000 7f2385ffb640 1 -- 172.21.15.40:0/1901020657 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f238c007640 con 0x7f239006c130 2023-12-17T11:49:15.193 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:15.189+0000 7f2385ffb640 1 -- 172.21.15.40:0/1901020657 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f238c004a00 con 0x7f239006c130 2023-12-17T11:49:15.193 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:15.189+0000 7f2396464640 1 -- 172.21.15.40:0/1901020657 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23900cd3d0 con 0x7f239006c130 2023-12-17T11:49:15.193 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:15.189+0000 7f2396464640 1 -- 172.21.15.40:0/1901020657 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23900b3860 con 0x7f239006c130 2023-12-17T11:49:15.193 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:15.190+0000 7f2396464640 1 -- 172.21.15.40:0/1901020657 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2390067910 con 0x7f239006c130 2023-12-17T11:49:15.193 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:15.191+0000 7f2385ffb640 1 -- 172.21.15.40:0/1901020657 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f238c004b60 con 0x7f239006c130 2023-12-17T11:49:15.194 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:15.192+0000 7f2385ffb640 1 --2- 172.21.15.40:0/1901020657 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f237406ae40 0x7f237406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:15.194 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:15.192+0000 7f2385ffb640 1 -- 172.21.15.40:0/1901020657 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f238c089800 con 0x7f239006c130 2023-12-17T11:49:15.194 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:15.193+0000 7f2394c61640 1 --2- 172.21.15.40:0/1901020657 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f237406ae40 0x7f237406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:15.195 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:15.194+0000 7f2394c61640 1 --2- 172.21.15.40:0/1901020657 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f237406ae40 0x7f237406d300 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f2380000f60 tx=0x7f23800079b0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:49:15.199 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:15.197+0000 7f2385ffb640 1 -- 172.21.15.40:0/1901020657 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f238c0544c0 con 0x7f239006c130 2023-12-17T11:49:15.395 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:15.393+0000 7f2396464640 1 -- 172.21.15.40:0/1901020657 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f2390074450 con 0x7f239006c130 2023-12-17T11:49:15.395 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:15.393+0000 7f2385ffb640 1 -- 172.21.15.40:0/1901020657 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) v1 ==== 104+0+11 (secure 0 0 0) 0x7f238c057ae0 con 0x7f239006c130 2023-12-17T11:49:15.396 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 32 2023-12-17T11:49:15.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:15.396+0000 7f2396464640 1 -- 172.21.15.40:0/1901020657 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f237406ae40 msgr2=0x7f237406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:15.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:15.396+0000 7f2396464640 1 --2- 172.21.15.40:0/1901020657 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f237406ae40 0x7f237406d300 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f2380000f60 tx=0x7f23800079b0 comp rx=0 tx=0).stop 2023-12-17T11:49:15.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:15.396+0000 7f2396464640 1 -- 172.21.15.40:0/1901020657 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f239006c130 msgr2=0x7f23900b3320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:15.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:15.396+0000 7f2396464640 1 --2- 172.21.15.40:0/1901020657 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f239006c130 0x7f23900b3320 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f238c00c3f0 tx=0x7f238c00c8b0 comp rx=0 tx=0).stop 2023-12-17T11:49:15.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:15.396+0000 7f2396464640 1 -- 172.21.15.40:0/1901020657 shutdown_connections 2023-12-17T11:49:15.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:15.396+0000 7f2396464640 1 --2- 172.21.15.40:0/1901020657 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f237406ae40 0x7f237406d300 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:15.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:15.396+0000 7f2396464640 1 --2- 172.21.15.40:0/1901020657 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f23900cb5b0 0x7f239014f6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:15.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:15.396+0000 7f2396464640 1 --2- 172.21.15.40:0/1901020657 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f2390071c70 0x7f239014f180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:15.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:15.396+0000 7f2396464640 1 --2- 172.21.15.40:0/1901020657 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f239006c130 0x7f23900b3320 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:15.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:15.396+0000 7f2396464640 1 -- 172.21.15.40:0/1901020657 >> 172.21.15.40:0/1901020657 conn(0x7f23900b0940 msgr2=0x7f23900aca00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:49:15.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:15.397+0000 7f2396464640 1 -- 172.21.15.40:0/1901020657 shutdown_connections 2023-12-17T11:49:15.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:15.397+0000 7f2396464640 1 -- 172.21.15.40:0/1901020657 wait complete. 2023-12-17T11:49:15.419 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-17T11:49:15.641 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:15.639+0000 7f6f426a3640 1 Processor -- start 2023-12-17T11:49:15.641 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:15.639+0000 7f6f426a3640 1 -- start start 2023-12-17T11:49:15.643 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:15.640+0000 7f6f426a3640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f6f3c155400 0x7f6f3c06bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:15.643 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:15.641+0000 7f6f426a3640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f3c15b4a0 con 0x7f6f3c0cf500 2023-12-17T11:49:15.643 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:15.641+0000 7f6f426a3640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f3c0adbb0 con 0x7f6f3c0ce150 2023-12-17T11:49:15.643 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:15.641+0000 7f6f426a3640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f3c0ade90 con 0x7f6f3c155400 2023-12-17T11:49:15.643 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:15.641+0000 7f6f416a1640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f6f3c155400 0x7f6f3c06bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:15.644 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:15.641+0000 7f6f416a1640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f6f3c155400 0x7f6f3c06bdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:48136/0 (socket says 172.21.15.40:48136) 2023-12-17T11:49:15.644 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:15.641+0000 7f6f416a1640 1 -- 172.21.15.40:0/2448846698 learned_addr learned my addr 172.21.15.40:0/2448846698 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-17T11:49:15.644 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:15.641+0000 7f6f416a1640 1 -- 172.21.15.40:0/2448846698 >> v1:172.21.15.159:6789/0 conn(0x7f6f3c0ce150 legacy=0x7f6f3c0cedf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:49:15.644 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:15.641+0000 7f6f416a1640 1 -- 172.21.15.40:0/2448846698 >> v1:172.21.15.40:6789/0 conn(0x7f6f3c0cf500 legacy=0x7f6f3c15b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:15.644 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:15.641+0000 7f6f416a1640 1 -- 172.21.15.40:0/2448846698 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f3c0ae170 con 0x7f6f3c155400 2023-12-17T11:49:15.644 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:15.643+0000 7f6f416a1640 1 --2- 172.21.15.40:0/2448846698 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6f3c155400 0x7f6f3c06bdf0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f6f38009870 tx=0x7f6f3802b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f65e2c3267da6cf2 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:49:15.645 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:15.643+0000 7f6f33fff640 1 -- 172.21.15.40:0/2448846698 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f38030860 con 0x7f6f3c155400 2023-12-17T11:49:15.645 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:15.643+0000 7f6f33fff640 1 -- 172.21.15.40:0/2448846698 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f380309c0 con 0x7f6f3c155400 2023-12-17T11:49:15.645 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:15.643+0000 7f6f33fff640 1 -- 172.21.15.40:0/2448846698 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f38030d50 con 0x7f6f3c155400 2023-12-17T11:49:15.646 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:15.643+0000 7f6f426a3640 1 -- 172.21.15.40:0/2448846698 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6f3c155400 msgr2=0x7f6f3c06bdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:15.646 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:15.643+0000 7f6f426a3640 1 --2- 172.21.15.40:0/2448846698 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6f3c155400 0x7f6f3c06bdf0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f6f38009870 tx=0x7f6f3802b9a0 comp rx=0 tx=0).stop 2023-12-17T11:49:15.646 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:15.644+0000 7f6f426a3640 1 -- 172.21.15.40:0/2448846698 shutdown_connections 2023-12-17T11:49:15.646 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:15.644+0000 7f6f426a3640 1 --2- 172.21.15.40:0/2448846698 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6f3c155400 0x7f6f3c06bdf0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:15.646 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:15.644+0000 7f6f426a3640 1 -- 172.21.15.40:0/2448846698 >> 172.21.15.40:0/2448846698 conn(0x7f6f3c06a640 msgr2=0x7f6f3c06aa50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:49:15.646 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:15.644+0000 7f6f426a3640 1 -- 172.21.15.40:0/2448846698 shutdown_connections 2023-12-17T11:49:15.646 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:15.644+0000 7f6f426a3640 1 -- 172.21.15.40:0/2448846698 wait complete. 2023-12-17T11:49:15.647 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:15.645+0000 7f6f426a3640 1 Processor -- start 2023-12-17T11:49:15.647 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:15.646+0000 7f6f426a3640 1 -- start start 2023-12-17T11:49:15.649 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:15.646+0000 7f6f426a3640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6f3c0ce150 0x7f6f3c151ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:15.649 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:15.646+0000 7f6f426a3640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6f3c0cf500 0x7f6f3c09b210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:15.649 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:15.647+0000 7f6f426a3640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6f3c155400 0x7f6f3c1411c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:15.649 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:15.647+0000 7f6f426a3640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f3c150cb0 con 0x7f6f3c0cf500 2023-12-17T11:49:15.649 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:15.647+0000 7f6f426a3640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f3c1500a0 con 0x7f6f3c0ce150 2023-12-17T11:49:15.649 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:15.647+0000 7f6f426a3640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f3c150380 con 0x7f6f3c155400 2023-12-17T11:49:15.649 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:15.647+0000 7f6f40ea0640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6f3c0cf500 0x7f6f3c09b210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:15.649 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:15.647+0000 7f6f40ea0640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6f3c0cf500 0x7f6f3c09b210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:48150/0 (socket says 172.21.15.40:48150) 2023-12-17T11:49:15.649 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:15.647+0000 7f6f40ea0640 1 -- 172.21.15.40:0/2465019385 learned_addr learned my addr 172.21.15.40:0/2465019385 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-17T11:49:15.650 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:15.647+0000 7f6f40ea0640 1 -- 172.21.15.40:0/2465019385 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6f3c155400 msgr2=0x7f6f3c1411c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:15.650 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:15.647+0000 7f6f40ea0640 1 --2- 172.21.15.40:0/2465019385 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6f3c155400 0x7f6f3c1411c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:15.650 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:15.647+0000 7f6f40ea0640 1 -- 172.21.15.40:0/2465019385 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6f3c0ce150 msgr2=0x7f6f3c151ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:15.650 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:15.647+0000 7f6f40ea0640 1 --2- 172.21.15.40:0/2465019385 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6f3c0ce150 0x7f6f3c151ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:15.650 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:15.647+0000 7f6f40ea0640 1 -- 172.21.15.40:0/2465019385 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f380094d0 con 0x7f6f3c0cf500 2023-12-17T11:49:15.651 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:15.648+0000 7f6f40ea0640 1 --2- 172.21.15.40:0/2465019385 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6f3c0cf500 0x7f6f3c09b210 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f6f2c00b3f0 tx=0x7f6f2c00b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:49:15.651 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:15.648+0000 7f6f31ffb640 1 -- 172.21.15.40:0/2465019385 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f2c011830 con 0x7f6f3c0cf500 2023-12-17T11:49:15.651 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:15.648+0000 7f6f31ffb640 1 -- 172.21.15.40:0/2465019385 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f2c011990 con 0x7f6f3c0cf500 2023-12-17T11:49:15.651 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:15.648+0000 7f6f31ffb640 1 -- 172.21.15.40:0/2465019385 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f2c011d40 con 0x7f6f3c0cf500 2023-12-17T11:49:15.651 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:15.648+0000 7f6f426a3640 1 -- 172.21.15.40:0/2465019385 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f3c150660 con 0x7f6f3c0cf500 2023-12-17T11:49:15.651 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:15.648+0000 7f6f426a3640 1 -- 172.21.15.40:0/2465019385 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f3c152010 con 0x7f6f3c0cf500 2023-12-17T11:49:15.651 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:15.649+0000 7f6f426a3640 1 -- 172.21.15.40:0/2465019385 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f3c15dcb0 con 0x7f6f3c0cf500 2023-12-17T11:49:15.652 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:15.650+0000 7f6f31ffb640 1 -- 172.21.15.40:0/2465019385 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f6f2c01a400 con 0x7f6f3c0cf500 2023-12-17T11:49:15.653 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:15.651+0000 7f6f31ffb640 1 --2- 172.21.15.40:0/2465019385 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f6f2006ae40 0x7f6f2006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:15.654 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:15.652+0000 7f6f31ffb640 1 -- 172.21.15.40:0/2465019385 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f6f2c0898d0 con 0x7f6f3c0cf500 2023-12-17T11:49:15.654 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:15.652+0000 7f6f416a1640 1 --2- 172.21.15.40:0/2465019385 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f6f2006ae40 0x7f6f2006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:15.655 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:15.653+0000 7f6f416a1640 1 --2- 172.21.15.40:0/2465019385 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f6f2006ae40 0x7f6f2006d300 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f6f38036000 tx=0x7f6f3803b040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:49:15.658 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:15.656+0000 7f6f31ffb640 1 -- 172.21.15.40:0/2465019385 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f6f2c054500 con 0x7f6f3c0cf500 2023-12-17T11:49:15.853 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:15.851+0000 7f6f426a3640 1 -- 172.21.15.40:0/2465019385 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f6f3c074450 con 0x7f6f3c0cf500 2023-12-17T11:49:15.853 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:15.852+0000 7f6f31ffb640 1 -- 172.21.15.40:0/2465019385 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) v1 ==== 100+0+11 (secure 0 0 0) 0x7f6f2c057b20 con 0x7f6f3c0cf500 2023-12-17T11:49:15.854 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 64 2023-12-17T11:49:15.856 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:15.854+0000 7f6f426a3640 1 -- 172.21.15.40:0/2465019385 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f6f2006ae40 msgr2=0x7f6f2006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:15.856 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:15.854+0000 7f6f426a3640 1 --2- 172.21.15.40:0/2465019385 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f6f2006ae40 0x7f6f2006d300 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f6f38036000 tx=0x7f6f3803b040 comp rx=0 tx=0).stop 2023-12-17T11:49:15.856 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:15.854+0000 7f6f426a3640 1 -- 172.21.15.40:0/2465019385 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6f3c0cf500 msgr2=0x7f6f3c09b210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:15.857 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:15.854+0000 7f6f426a3640 1 --2- 172.21.15.40:0/2465019385 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6f3c0cf500 0x7f6f3c09b210 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f6f2c00b3f0 tx=0x7f6f2c00b8b0 comp rx=0 tx=0).stop 2023-12-17T11:49:15.857 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:15.854+0000 7f6f426a3640 1 -- 172.21.15.40:0/2465019385 shutdown_connections 2023-12-17T11:49:15.857 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:15.854+0000 7f6f426a3640 1 --2- 172.21.15.40:0/2465019385 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f6f2006ae40 0x7f6f2006d300 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:15.857 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:15.854+0000 7f6f426a3640 1 --2- 172.21.15.40:0/2465019385 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f6f3c155400 0x7f6f3c1411c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:15.857 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:15.854+0000 7f6f426a3640 1 --2- 172.21.15.40:0/2465019385 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6f3c0cf500 0x7f6f3c09b210 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:15.857 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:15.854+0000 7f6f426a3640 1 --2- 172.21.15.40:0/2465019385 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6f3c0ce150 0x7f6f3c151ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:15.857 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:15.854+0000 7f6f426a3640 1 -- 172.21.15.40:0/2465019385 >> 172.21.15.40:0/2465019385 conn(0x7f6f3c06a640 msgr2=0x7f6f3c15df20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:49:15.857 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:15.854+0000 7f6f426a3640 1 -- 172.21.15.40:0/2465019385 shutdown_connections 2023-12-17T11:49:15.857 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:15.854+0000 7f6f426a3640 1 -- 172.21.15.40:0/2465019385 wait complete. 2023-12-17T11:49:15.876 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-12-17T11:49:16.105 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:16.103+0000 7fb9b3fe5640 1 Processor -- start 2023-12-17T11:49:16.105 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:16.103+0000 7fb9b3fe5640 1 -- start start 2023-12-17T11:49:16.107 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:16.105+0000 7fb9b3fe5640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fb9ac13eef0 0x7fb9ac15e200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:16.108 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:16.105+0000 7fb9b3fe5640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7fb9ac072590 0x7fb9ac0cea40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:16.108 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:16.105+0000 7fb9b3fe5640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9ac140430 con 0x7fb9ac13f2d0 2023-12-17T11:49:16.108 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:16.105+0000 7fb9b3fe5640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9ac13f820 con 0x7fb9ac13eef0 2023-12-17T11:49:16.108 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:16.105+0000 7fb9b3fe5640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9ac13fb00 con 0x7fb9ac072590 2023-12-17T11:49:16.108 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:16.105+0000 7fb9b1d81640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fb9ac13eef0 0x7fb9ac15e200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:16.108 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:16.105+0000 7fb9b1d81640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fb9ac13eef0 0x7fb9ac15e200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:48158/0 (socket says 172.21.15.40:48158) 2023-12-17T11:49:16.108 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:16.105+0000 7fb9b1d81640 1 -- 172.21.15.40:0/1200150710 learned_addr learned my addr 172.21.15.40:0/1200150710 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-17T11:49:16.108 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:16.106+0000 7fb9b2582640 1 --2- 172.21.15.40:0/1200150710 >> v2:172.21.15.159:3300/0 conn(0x7fb9ac072590 0x7fb9ac0cea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:16.108 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:16.106+0000 7fb9b1d81640 1 -- 172.21.15.40:0/1200150710 >> v2:172.21.15.159:3300/0 conn(0x7fb9ac072590 msgr2=0x7fb9ac0cea40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:49:16.108 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:16.106+0000 7fb9b1d81640 1 --2- 172.21.15.40:0/1200150710 >> v2:172.21.15.159:3300/0 conn(0x7fb9ac072590 0x7fb9ac0cea40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:16.108 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:16.106+0000 7fb9b1d81640 1 -- 172.21.15.40:0/1200150710 >> v1:172.21.15.159:6789/0 conn(0x7fb9ac13f2d0 legacy=0x7fb9ac071e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:49:16.108 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:16.106+0000 7fb9b1d81640 1 -- 172.21.15.40:0/1200150710 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9ac13fde0 con 0x7fb9ac13eef0 2023-12-17T11:49:16.109 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:16.107+0000 7fb9b1d81640 1 --2- 172.21.15.40:0/1200150710 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb9ac13eef0 0x7fb9ac15e200 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fb9ac13d470 tx=0x7fb9a802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=144afe1cbdb6a1da server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:49:16.109 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:16.107+0000 7fb9b0d7f640 1 -- 172.21.15.40:0/1200150710 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9a8031870 con 0x7fb9ac13eef0 2023-12-17T11:49:16.109 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:16.107+0000 7fb9b0d7f640 1 -- 172.21.15.40:0/1200150710 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9a80319d0 con 0x7fb9ac13eef0 2023-12-17T11:49:16.109 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:16.107+0000 7fb9b0d7f640 1 -- 172.21.15.40:0/1200150710 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9a8031d60 con 0x7fb9ac13eef0 2023-12-17T11:49:16.110 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:16.108+0000 7fb9b3fe5640 1 -- 172.21.15.40:0/1200150710 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb9ac13eef0 msgr2=0x7fb9ac15e200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:16.110 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:16.108+0000 7fb9b3fe5640 1 --2- 172.21.15.40:0/1200150710 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb9ac13eef0 0x7fb9ac15e200 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fb9ac13d470 tx=0x7fb9a802b910 comp rx=0 tx=0).stop 2023-12-17T11:49:16.110 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:16.108+0000 7fb9b3fe5640 1 -- 172.21.15.40:0/1200150710 shutdown_connections 2023-12-17T11:49:16.110 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:16.108+0000 7fb9b3fe5640 1 --2- 172.21.15.40:0/1200150710 >> v2:172.21.15.159:3300/0 conn(0x7fb9ac072590 0x7fb9ac0cea40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:16.110 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:16.108+0000 7fb9b3fe5640 1 --2- 172.21.15.40:0/1200150710 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb9ac13eef0 0x7fb9ac15e200 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:16.110 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:16.108+0000 7fb9b3fe5640 1 -- 172.21.15.40:0/1200150710 >> 172.21.15.40:0/1200150710 conn(0x7fb9ac071360 msgr2=0x7fb9ac071770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:49:16.110 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:16.108+0000 7fb9b3fe5640 1 -- 172.21.15.40:0/1200150710 shutdown_connections 2023-12-17T11:49:16.110 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:16.108+0000 7fb9b3fe5640 1 -- 172.21.15.40:0/1200150710 wait complete. 2023-12-17T11:49:16.112 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:16.110+0000 7fb9b3fe5640 1 Processor -- start 2023-12-17T11:49:16.112 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:16.110+0000 7fb9b3fe5640 1 -- start start 2023-12-17T11:49:16.114 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:16.111+0000 7fb9b3fe5640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb9ac072590 0x7fb9ac1515a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:16.114 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:16.111+0000 7fb9b3fe5640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb9ac13eef0 0x7fb9ac0b0bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:16.114 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:16.111+0000 7fb9b3fe5640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb9ac13f2d0 0x7fb9ac0b10f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:16.114 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:16.111+0000 7fb9b3fe5640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9ac159090 con 0x7fb9ac13f2d0 2023-12-17T11:49:16.114 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:16.111+0000 7fb9b3fe5640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9ac151f80 con 0x7fb9ac13eef0 2023-12-17T11:49:16.114 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:16.111+0000 7fb9b3fe5640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9ac152260 con 0x7fb9ac072590 2023-12-17T11:49:16.114 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:16.111+0000 7fb9b2582640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb9ac13f2d0 0x7fb9ac0b10f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:16.115 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:16.111+0000 7fb9b2582640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb9ac13f2d0 0x7fb9ac0b10f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:48164/0 (socket says 172.21.15.40:48164) 2023-12-17T11:49:16.115 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:16.111+0000 7fb9b2582640 1 -- 172.21.15.40:0/1385839746 learned_addr learned my addr 172.21.15.40:0/1385839746 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-17T11:49:16.115 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:16.112+0000 7fb9b1d81640 1 --2- 172.21.15.40:0/1385839746 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb9ac072590 0x7fb9ac1515a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:16.115 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:16.112+0000 7fb9b1580640 1 --2- 172.21.15.40:0/1385839746 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb9ac13eef0 0x7fb9ac0b0bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:16.115 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:16.112+0000 7fb9b2582640 1 -- 172.21.15.40:0/1385839746 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb9ac072590 msgr2=0x7fb9ac1515a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:16.115 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:16.112+0000 7fb9b2582640 1 --2- 172.21.15.40:0/1385839746 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb9ac072590 0x7fb9ac1515a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:16.115 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:16.112+0000 7fb9b2582640 1 -- 172.21.15.40:0/1385839746 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb9ac13eef0 msgr2=0x7fb9ac0b0bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:16.115 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:16.112+0000 7fb9b2582640 1 --2- 172.21.15.40:0/1385839746 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb9ac13eef0 0x7fb9ac0b0bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:16.115 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:16.112+0000 7fb9b2582640 1 -- 172.21.15.40:0/1385839746 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9a80094d0 con 0x7fb9ac13f2d0 2023-12-17T11:49:16.115 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:16.112+0000 7fb9b2582640 1 --2- 172.21.15.40:0/1385839746 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb9ac13f2d0 0x7fb9ac0b10f0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fb9a400cc00 tx=0x7fb9a400a5c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:49:16.116 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:16.112+0000 7fb9a27fc640 1 -- 172.21.15.40:0/1385839746 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9a400ce10 con 0x7fb9ac13f2d0 2023-12-17T11:49:16.116 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:16.113+0000 7fb9a27fc640 1 -- 172.21.15.40:0/1385839746 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9a4003990 con 0x7fb9ac13f2d0 2023-12-17T11:49:16.116 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:16.113+0000 7fb9b3fe5640 1 -- 172.21.15.40:0/1385839746 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9ac152540 con 0x7fb9ac13f2d0 2023-12-17T11:49:16.116 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:16.113+0000 7fb9a27fc640 1 -- 172.21.15.40:0/1385839746 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9a4003d20 con 0x7fb9ac13f2d0 2023-12-17T11:49:16.116 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:16.113+0000 7fb9b3fe5640 1 -- 172.21.15.40:0/1385839746 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9ac151ae0 con 0x7fb9ac13f2d0 2023-12-17T11:49:16.116 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:16.114+0000 7fb9b3fe5640 1 -- 172.21.15.40:0/1385839746 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9ac0745d0 con 0x7fb9ac13f2d0 2023-12-17T11:49:16.117 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:16.115+0000 7fb9a27fc640 1 -- 172.21.15.40:0/1385839746 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fb9a4003e80 con 0x7fb9ac13f2d0 2023-12-17T11:49:16.118 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:16.116+0000 7fb9a27fc640 1 --2- 172.21.15.40:0/1385839746 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7fb99006ae70 0x7fb99006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:16.118 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:16.116+0000 7fb9a27fc640 1 -- 172.21.15.40:0/1385839746 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6692+0+0 (secure 0 0 0) 0x7fb9a4089c50 con 0x7fb9ac13f2d0 2023-12-17T11:49:16.118 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:16.116+0000 7fb9b1d81640 1 --2- 172.21.15.40:0/1385839746 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7fb99006ae70 0x7fb99006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:16.119 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:16.118+0000 7fb9b1d81640 1 --2- 172.21.15.40:0/1385839746 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7fb99006ae70 0x7fb99006d330 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fb9a8036000 tx=0x7fb9a803c040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:49:16.122 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:16.120+0000 7fb9a27fc640 1 -- 172.21.15.40:0/1385839746 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fb9a40549c0 con 0x7fb9ac13f2d0 2023-12-17T11:49:16.314 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:16.312+0000 7fb9b3fe5640 1 -- 172.21.15.40:0/1385839746 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fb9ac152a60 con 0x7fb9ac13f2d0 2023-12-17T11:49:16.314 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:16.312+0000 7fb9a27fc640 1 -- 172.21.15.40:0/1385839746 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) v1 ==== 103+0+11 (secure 0 0 0) 0x7fb9ac152a60 con 0x7fb9ac13f2d0 2023-12-17T11:49:16.315 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 32 2023-12-17T11:49:16.317 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:16.315+0000 7fb9b3fe5640 1 -- 172.21.15.40:0/1385839746 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7fb99006ae70 msgr2=0x7fb99006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:16.317 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:16.315+0000 7fb9b3fe5640 1 --2- 172.21.15.40:0/1385839746 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7fb99006ae70 0x7fb99006d330 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fb9a8036000 tx=0x7fb9a803c040 comp rx=0 tx=0).stop 2023-12-17T11:49:16.317 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:16.315+0000 7fb9b3fe5640 1 -- 172.21.15.40:0/1385839746 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb9ac13f2d0 msgr2=0x7fb9ac0b10f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:16.317 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:16.315+0000 7fb9b3fe5640 1 --2- 172.21.15.40:0/1385839746 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb9ac13f2d0 0x7fb9ac0b10f0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fb9a400cc00 tx=0x7fb9a400a5c0 comp rx=0 tx=0).stop 2023-12-17T11:49:16.318 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:16.315+0000 7fb9b3fe5640 1 -- 172.21.15.40:0/1385839746 shutdown_connections 2023-12-17T11:49:16.318 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:16.315+0000 7fb9b3fe5640 1 --2- 172.21.15.40:0/1385839746 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7fb99006ae70 0x7fb99006d330 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:16.318 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:16.315+0000 7fb9b3fe5640 1 --2- 172.21.15.40:0/1385839746 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb9ac13f2d0 0x7fb9ac0b10f0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:16.318 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:16.315+0000 7fb9b3fe5640 1 --2- 172.21.15.40:0/1385839746 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb9ac13eef0 0x7fb9ac0b0bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:16.318 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:16.315+0000 7fb9b3fe5640 1 --2- 172.21.15.40:0/1385839746 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb9ac072590 0x7fb9ac1515a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:16.318 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:16.315+0000 7fb9b3fe5640 1 -- 172.21.15.40:0/1385839746 >> 172.21.15.40:0/1385839746 conn(0x7fb9ac071360 msgr2=0x7fb9ac0ceb90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:49:16.318 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:16.316+0000 7fb9b3fe5640 1 -- 172.21.15.40:0/1385839746 shutdown_connections 2023-12-17T11:49:16.319 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:16.316+0000 7fb9b3fe5640 1 -- 172.21.15.40:0/1385839746 wait complete. 2023-12-17T11:49:16.344 INFO:tasks.cephfs_test_runner:Starting test: test_generic (tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev) 2023-12-17T11:49:16.345 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-17T11:49:16.578 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:16.576+0000 7ff6dffff640 1 Processor -- start 2023-12-17T11:49:16.578 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:16.576+0000 7ff6dffff640 1 -- start start 2023-12-17T11:49:16.580 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:16.578+0000 7ff6dffff640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff6e00713b0 0x7ff6e00ae1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:16.580 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:16.578+0000 7ff6dffff640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6e0070070 con 0x7ff6e0070750 2023-12-17T11:49:16.580 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:16.578+0000 7ff6dffff640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6e0070310 con 0x7ff6e0159fd0 2023-12-17T11:49:16.580 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:16.578+0000 7ff6dffff640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6e00705f0 con 0x7ff6e00713b0 2023-12-17T11:49:16.580 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:16.578+0000 7ff6df7fe640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7ff6e0070750 0x7ff6e00b27e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:37848/0 (socket says 172.21.15.40:37848) 2023-12-17T11:49:16.580 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:16.578+0000 7ff6de7fc640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff6e00713b0 0x7ff6e00ae1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:16.580 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:16.578+0000 7ff6df7fe640 1 -- 172.21.15.40:0/93874666 learned_addr learned my addr 172.21.15.40:0/93874666 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-12-17T11:49:16.581 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:16.579+0000 7ff6de7fc640 1 -- 172.21.15.40:0/93874666 >> v1:172.21.15.159:6789/0 conn(0x7ff6e0159fd0 legacy=0x7ff6e0070ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:49:16.581 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:16.579+0000 7ff6de7fc640 1 -- 172.21.15.40:0/93874666 >> v1:172.21.15.40:6789/0 conn(0x7ff6e0070750 legacy=0x7ff6e00b27e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:16.581 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:16.579+0000 7ff6de7fc640 1 -- 172.21.15.40:0/93874666 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6e00b1d00 con 0x7ff6e00713b0 2023-12-17T11:49:16.582 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:16.580+0000 7ff6de7fc640 1 --2- 172.21.15.40:0/93874666 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff6e00713b0 0x7ff6e00ae1d0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7ff6d40097a0 tx=0x7ff6d402db70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8fc8708d218acd3 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:49:16.582 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:16.580+0000 7ff6ddffb640 1 -- 172.21.15.40:0/93874666 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6d402e920 con 0x7ff6e00713b0 2023-12-17T11:49:16.582 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:16.580+0000 7ff6ddffb640 1 -- 172.21.15.40:0/93874666 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6d402ea80 con 0x7ff6e00713b0 2023-12-17T11:49:16.582 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:16.580+0000 7ff6ddffb640 1 -- 172.21.15.40:0/93874666 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6d402ee10 con 0x7ff6e00713b0 2023-12-17T11:49:16.583 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:16.581+0000 7ff6dffff640 1 -- 172.21.15.40:0/93874666 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff6e00713b0 msgr2=0x7ff6e00ae1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:16.583 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:16.581+0000 7ff6dffff640 1 --2- 172.21.15.40:0/93874666 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff6e00713b0 0x7ff6e00ae1d0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7ff6d40097a0 tx=0x7ff6d402db70 comp rx=0 tx=0).stop 2023-12-17T11:49:16.583 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:16.581+0000 7ff6dffff640 1 -- 172.21.15.40:0/93874666 shutdown_connections 2023-12-17T11:49:16.583 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:16.581+0000 7ff6dffff640 1 --2- 172.21.15.40:0/93874666 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff6e00713b0 0x7ff6e00ae1d0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:16.583 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:16.581+0000 7ff6dffff640 1 -- 172.21.15.40:0/93874666 >> 172.21.15.40:0/93874666 conn(0x7ff6e00b0860 msgr2=0x7ff6e00b0c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:49:16.583 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:16.581+0000 7ff6dffff640 1 -- 172.21.15.40:0/93874666 shutdown_connections 2023-12-17T11:49:16.583 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:16.581+0000 7ff6dffff640 1 -- 172.21.15.40:0/93874666 wait complete. 2023-12-17T11:49:16.585 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:16.583+0000 7ff6dffff640 1 Processor -- start 2023-12-17T11:49:16.585 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:16.583+0000 7ff6dffff640 1 -- start start 2023-12-17T11:49:16.588 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:16.584+0000 7ff6dffff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff6e0070750 0x7ff6e015cc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:16.588 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:16.584+0000 7ff6dffff640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff6e00713b0 0x7ff6e01f2040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:16.588 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:16.584+0000 7ff6dffff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff6e0159fd0 0x7ff6e01558f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:16.588 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:16.584+0000 7ff6dffff640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6e0147df0 con 0x7ff6e0070750 2023-12-17T11:49:16.588 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:16.584+0000 7ff6dffff640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6e015a530 con 0x7ff6e0159fd0 2023-12-17T11:49:16.588 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:16.584+0000 7ff6dffff640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6e015a810 con 0x7ff6e00713b0 2023-12-17T11:49:16.588 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:16.584+0000 7ff6deffd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff6e0070750 0x7ff6e015cc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:16.588 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:16.584+0000 7ff6deffd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff6e0070750 0x7ff6e015cc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:48184/0 (socket says 172.21.15.40:48184) 2023-12-17T11:49:16.589 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:16.584+0000 7ff6deffd640 1 -- 172.21.15.40:0/1535985967 learned_addr learned my addr 172.21.15.40:0/1535985967 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-17T11:49:16.589 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:16.585+0000 7ff6de7fc640 1 --2- 172.21.15.40:0/1535985967 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff6e00713b0 0x7ff6e01f2040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:16.589 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:16.585+0000 7ff6df7fe640 1 --2- 172.21.15.40:0/1535985967 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff6e0159fd0 0x7ff6e01558f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:16.589 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:16.585+0000 7ff6deffd640 1 -- 172.21.15.40:0/1535985967 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff6e00713b0 msgr2=0x7ff6e01f2040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:16.589 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:16.585+0000 7ff6deffd640 1 --2- 172.21.15.40:0/1535985967 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff6e00713b0 0x7ff6e01f2040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:16.589 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:16.585+0000 7ff6deffd640 1 -- 172.21.15.40:0/1535985967 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff6e0159fd0 msgr2=0x7ff6e01558f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:16.589 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:16.585+0000 7ff6deffd640 1 --2- 172.21.15.40:0/1535985967 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff6e0159fd0 0x7ff6e01558f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:16.589 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:16.585+0000 7ff6deffd640 1 -- 172.21.15.40:0/1535985967 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6d4009400 con 0x7ff6e0070750 2023-12-17T11:49:16.589 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:16.585+0000 7ff6de7fc640 1 --2- 172.21.15.40:0/1535985967 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff6e00713b0 0x7ff6e01f2040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-17T11:49:16.589 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:16.585+0000 7ff6deffd640 1 --2- 172.21.15.40:0/1535985967 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff6e0070750 0x7ff6e015cc90 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7ff6d000b3f0 tx=0x7ff6d000b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:49:16.589 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:16.586+0000 7ff6c77fe640 1 -- 172.21.15.40:0/1535985967 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6d0011830 con 0x7ff6e0070750 2023-12-17T11:49:16.589 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:16.586+0000 7ff6c77fe640 1 -- 172.21.15.40:0/1535985967 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6d0011990 con 0x7ff6e0070750 2023-12-17T11:49:16.589 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:16.586+0000 7ff6c77fe640 1 -- 172.21.15.40:0/1535985967 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6d0011d40 con 0x7ff6e0070750 2023-12-17T11:49:16.589 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:16.586+0000 7ff6dffff640 1 -- 172.21.15.40:0/1535985967 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6e015aaf0 con 0x7ff6e0070750 2023-12-17T11:49:16.590 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:16.586+0000 7ff6dffff640 1 -- 172.21.15.40:0/1535985967 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6e015b0b0 con 0x7ff6e0070750 2023-12-17T11:49:16.590 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:16.587+0000 7ff6dffff640 1 -- 172.21.15.40:0/1535985967 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6e0074450 con 0x7ff6e0070750 2023-12-17T11:49:16.590 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:16.588+0000 7ff6c77fe640 1 -- 172.21.15.40:0/1535985967 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ff6d001a400 con 0x7ff6e0070750 2023-12-17T11:49:16.591 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:16.589+0000 7ff6c77fe640 1 --2- 172.21.15.40:0/1535985967 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7ff6cc06ae40 0x7ff6cc06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:16.591 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:16.589+0000 7ff6c77fe640 1 -- 172.21.15.40:0/1535985967 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6692+0+0 (secure 0 0 0) 0x7ff6d0089830 con 0x7ff6e0070750 2023-12-17T11:49:16.591 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:16.590+0000 7ff6de7fc640 1 --2- 172.21.15.40:0/1535985967 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7ff6cc06ae40 0x7ff6cc06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:16.592 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:16.591+0000 7ff6de7fc640 1 --2- 172.21.15.40:0/1535985967 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7ff6cc06ae40 0x7ff6cc06d300 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7ff6d4038000 tx=0x7ff6d4032000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:49:16.595 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:16.593+0000 7ff6c77fe640 1 -- 172.21.15.40:0/1535985967 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7ff6d0054500 con 0x7ff6e0070750 2023-12-17T11:49:16.793 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:16.791+0000 7ff6dffff640 1 -- 172.21.15.40:0/1535985967 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff6e01550f0 con 0x7ff6e0070750 2023-12-17T11:49:16.795 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:16.793+0000 7ff6c77fe640 1 -- 172.21.15.40:0/1535985967 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+18697 (secure 0 0 0) 0x7ff6d0057b20 con 0x7ff6e0070750 2023-12-17T11:49:16.795 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T11:49:16.795 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":27,"fsid":"099cd35d-80d9-4ca4-8424-de13b3b03ac7","created":"2023-12-17T11:47:53.450097+0000","modified":"2023-12-17T11:49:00.483840+0000","last_up_change":"2023-12-17T11:48:05.724195+0000","last_in_change":"2023-12-17T11:47:56.956499+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-17T11:48:06.668943+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-17T11:48:16.151444+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-17T11:48:16.717726+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-17T11:48:20.534819+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a88bfd46-63b8-48b1-9c0e-5c9cdc31bd38","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":555204741},{"type":"v1","addr":"172.21.15.40:6802","nonce":555204741}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":555204741},{"type":"v1","addr":"172.21.15.40:6807","nonce":555204741}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":555204741},{"type":"v1","addr":"172.21.15.40:6815","nonce":555204741}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6809","nonce":555204741},{"type":"v1","addr":"172.21.15.40:6812","nonce":555204741}]},"public_addr":"172.21.15.40:6802/555204741","cluster_addr":"172.21.15.40:6807/555204741","heartbeat_back_addr":"172.21.15.40:6815/555204741","heartbeat_front_addr":"172.21.15.40:6812/555204741","state":["exists","up"]},{"osd":1,"uuid":"c5d628ae-36f4-4866-802c-b162f0e90add","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6801","nonce":1221318112},{"type":"v1","addr":"172.21.15.40:6803","nonce":1221318112}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6805","nonce":1221318112},{"type":"v1","addr":"172.21.15.40:6806","nonce":1221318112}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6811","nonce":1221318112},{"type":"v1","addr":"172.21.15.40:6813","nonce":1221318112}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":1221318112},{"type":"v1","addr":"172.21.15.40:6810","nonce":1221318112}]},"public_addr":"172.21.15.40:6803/1221318112","cluster_addr":"172.21.15.40:6806/1221318112","heartbeat_back_addr":"172.21.15.40:6813/1221318112","heartbeat_front_addr":"172.21.15.40:6810/1221318112","state":["exists","up"]},{"osd":2,"uuid":"d986ad6a-af2f-47fc-9c3b-fbda27b82b73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":1959000265},{"type":"v1","addr":"172.21.15.40:6817","nonce":1959000265}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6818","nonce":1959000265},{"type":"v1","addr":"172.21.15.40:6819","nonce":1959000265}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":1959000265},{"type":"v1","addr":"172.21.15.40:6827","nonce":1959000265}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":1959000265},{"type":"v1","addr":"172.21.15.40:6822","nonce":1959000265}]},"public_addr":"172.21.15.40:6817/1959000265","cluster_addr":"172.21.15.40:6819/1959000265","heartbeat_back_addr":"172.21.15.40:6827/1959000265","heartbeat_front_addr":"172.21.15.40:6822/1959000265","state":["exists","up"]},{"osd":3,"uuid":"d79d22b7-be05-41b2-b95d-697db677fd02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6821","nonce":974040287},{"type":"v1","addr":"172.21.15.40:6823","nonce":974040287}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6825","nonce":974040287},{"type":"v1","addr":"172.21.15.40:6826","nonce":974040287}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":974040287},{"type":"v1","addr":"172.21.15.40:6831","nonce":974040287}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":974040287},{"type":"v1","addr":"172.21.15.40:6829","nonce":974040287}]},"public_addr":"172.21.15.40:6823/974040287","cluster_addr":"172.21.15.40:6826/974040287","heartbeat_back_addr":"172.21.15.40:6831/974040287","heartbeat_front_addr":"172.21.15.40:6829/974040287","state":["exists","up"]},{"osd":4,"uuid":"62a7a233-d3ea-40be-91de-180c0208d639","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6808","nonce":3937787733},{"type":"v1","addr":"172.21.15.159:6809","nonce":3937787733}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6810","nonce":3937787733},{"type":"v1","addr":"172.21.15.159:6811","nonce":3937787733}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6814","nonce":3937787733},{"type":"v1","addr":"172.21.15.159:6815","nonce":3937787733}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6812","nonce":3937787733},{"type":"v1","addr":"172.21.15.159:6813","nonce":3937787733}]},"public_addr":"172.21.15.159:6809/3937787733","cluster_addr":"172.21.15.159:6811/3937787733","heartbeat_back_addr":"172.21.15.159:6815/3937787733","heartbeat_front_addr":"172.21.15.159:6813/3937787733","state":["exists","up"]},{"osd":5,"uuid":"84629cea-dc0e-4b5e-b203-5ea963839281","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6816","nonce":3032505240},{"type":"v1","addr":"172.21.15.159:6817","nonce":3032505240}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6818","nonce":3032505240},{"type":"v1","addr":"172.21.15.159:6819","nonce":3032505240}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6822","nonce":3032505240},{"type":"v1","addr":"172.21.15.159:6823","nonce":3032505240}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6820","nonce":3032505240},{"type":"v1","addr":"172.21.15.159:6821","nonce":3032505240}]},"public_addr":"172.21.15.159:6817/3032505240","cluster_addr":"172.21.15.159:6819/3032505240","heartbeat_back_addr":"172.21.15.159:6823/3032505240","heartbeat_front_addr":"172.21.15.159:6821/3032505240","state":["exists","up"]},{"osd":6,"uuid":"4ae3af3a-1743-4070-a91d-8be5c31cdb04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6800","nonce":2411788597},{"type":"v1","addr":"172.21.15.159:6801","nonce":2411788597}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6802","nonce":2411788597},{"type":"v1","addr":"172.21.15.159:6803","nonce":2411788597}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6806","nonce":2411788597},{"type":"v1","addr":"172.21.15.159:6807","nonce":2411788597}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6804","nonce":2411788597},{"type":"v1","addr":"172.21.15.159:6805","nonce":2411788597}]},"public_addr":"172.21.15.159:6801/2411788597","cluster_addr":"172.21.15.159:6803/2411788597","heartbeat_back_addr":"172.21.15.159:6807/2411788597","heartbeat_front_addr":"172.21.15.159:6805/2411788597","state":["exists","up"]},{"osd":7,"uuid":"c1f4c7f2-8f75-4f95-bc63-a332773e3b8e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6824","nonce":478953349},{"type":"v1","addr":"172.21.15.159:6825","nonce":478953349}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6826","nonce":478953349},{"type":"v1","addr":"172.21.15.159:6827","nonce":478953349}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6830","nonce":478953349},{"type":"v1","addr":"172.21.15.159:6831","nonce":478953349}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6828","nonce":478953349},{"type":"v1","addr":"172.21.15.159:6829","nonce":478953349}]},"public_addr":"172.21.15.159:6825/478953349","cluster_addr":"172.21.15.159:6827/478953349","heartbeat_back_addr":"172.21.15.159:6831/478953349","heartbeat_front_addr":"172.21.15.159:6829/478953349","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T11:48:02.023567+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T11:48:02.278216+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T11:48:02.311843+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T11:48:01.773372+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T11:48:02.618910+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T11:48:02.361559+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T11:48:02.223997+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T11:48:02.604403+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.2","mappings":[{"from":3,"to":2}]},{"pgid":"3.d","mappings":[{"from":5,"to":1}]},{"pgid":"3.13","mappings":[{"from":7,"to":2}]},{"pgid":"3.17","mappings":[{"from":0,"to":2}]},{"pgid":"3.38","mappings":[{"from":5,"to":1}]},{"pgid":"4.2","mappings":[{"from":1,"to":2}]},{"pgid":"4.10","mappings":[{"from":1,"to":2}]},{"pgid":"4.18","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-17T11:49:16.798 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:16.795+0000 7ff6dffff640 1 -- 172.21.15.40:0/1535985967 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7ff6cc06ae40 msgr2=0x7ff6cc06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:16.798 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:16.795+0000 7ff6dffff640 1 --2- 172.21.15.40:0/1535985967 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7ff6cc06ae40 0x7ff6cc06d300 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7ff6d4038000 tx=0x7ff6d4032000 comp rx=0 tx=0).stop 2023-12-17T11:49:16.798 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:16.795+0000 7ff6dffff640 1 -- 172.21.15.40:0/1535985967 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff6e0070750 msgr2=0x7ff6e015cc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:16.798 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:16.795+0000 7ff6dffff640 1 --2- 172.21.15.40:0/1535985967 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff6e0070750 0x7ff6e015cc90 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7ff6d000b3f0 tx=0x7ff6d000b8b0 comp rx=0 tx=0).stop 2023-12-17T11:49:16.798 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:16.796+0000 7ff6dffff640 1 -- 172.21.15.40:0/1535985967 shutdown_connections 2023-12-17T11:49:16.798 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:16.796+0000 7ff6dffff640 1 --2- 172.21.15.40:0/1535985967 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7ff6cc06ae40 0x7ff6cc06d300 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:16.798 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:16.796+0000 7ff6dffff640 1 --2- 172.21.15.40:0/1535985967 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff6e0159fd0 0x7ff6e01558f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:16.798 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:16.796+0000 7ff6dffff640 1 --2- 172.21.15.40:0/1535985967 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff6e00713b0 0x7ff6e01f2040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:16.798 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:16.796+0000 7ff6dffff640 1 --2- 172.21.15.40:0/1535985967 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff6e0070750 0x7ff6e015cc90 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:16.798 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:16.796+0000 7ff6dffff640 1 -- 172.21.15.40:0/1535985967 >> 172.21.15.40:0/1535985967 conn(0x7ff6e00b0860 msgr2=0x7ff6e00acf20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:49:16.798 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:16.796+0000 7ff6dffff640 1 -- 172.21.15.40:0/1535985967 shutdown_connections 2023-12-17T11:49:16.799 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:16.796+0000 7ff6dffff640 1 -- 172.21.15.40:0/1535985967 wait complete. 2023-12-17T11:49:16.818 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-17T11:48:06.668943+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-17T11:48:16.151444+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-17T11:48:16.717726+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-12-17T11:48:20.534819+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-12-17T11:49:16.818 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-17T11:49:17.046 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:17.044+0000 7f9e2569f640 1 Processor -- start 2023-12-17T11:49:17.047 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:17.045+0000 7f9e2569f640 1 -- start start 2023-12-17T11:49:17.048 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:17.046+0000 7f9e2569f640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f9e20155400 0x7f9e2006bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:17.048 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:17.046+0000 7f9e2569f640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9e200cf500 0x7f9e200ce5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:17.048 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:17.046+0000 7f9e2569f640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e2015b4a0 con 0x7f9e200ce150 2023-12-17T11:49:17.048 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:17.046+0000 7f9e2569f640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e200adbb0 con 0x7f9e20155400 2023-12-17T11:49:17.049 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:17.046+0000 7f9e2569f640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e200ade90 con 0x7f9e200cf500 2023-12-17T11:49:17.049 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:17.046+0000 7f9e1ffff640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f9e20155400 0x7f9e2006bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:17.049 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:17.046+0000 7f9e1ffff640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f9e20155400 0x7f9e2006bdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:48194/0 (socket says 172.21.15.40:48194) 2023-12-17T11:49:17.049 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:17.046+0000 7f9e1ffff640 1 -- 172.21.15.40:0/3689718363 learned_addr learned my addr 172.21.15.40:0/3689718363 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-17T11:49:17.049 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:17.047+0000 7f9e24e9e640 1 --2- 172.21.15.40:0/3689718363 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9e200cf500 0x7f9e200ce5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:17.049 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:17.047+0000 7f9e1ffff640 1 -- 172.21.15.40:0/3689718363 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9e200cf500 msgr2=0x7f9e200ce5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:49:17.050 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:17.047+0000 7f9e1ffff640 1 --2- 172.21.15.40:0/3689718363 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9e200cf500 0x7f9e200ce5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:17.050 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:17.047+0000 7f9e1ffff640 1 -- 172.21.15.40:0/3689718363 >> v1:172.21.15.159:6789/0 conn(0x7f9e200ce150 legacy=0x7f9e200cedf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:49:17.050 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:17.047+0000 7f9e1ffff640 1 -- 172.21.15.40:0/3689718363 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e200ae170 con 0x7f9e20155400 2023-12-17T11:49:17.050 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:17.048+0000 7f9e1ffff640 1 --2- 172.21.15.40:0/3689718363 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9e20155400 0x7f9e2006bdf0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f9e10009870 tx=0x7f9e1002b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14a6f17fe5d6a5d6 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:49:17.050 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:17.048+0000 7f9e1f7fe640 1 -- 172.21.15.40:0/3689718363 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e10031640 con 0x7f9e20155400 2023-12-17T11:49:17.051 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:17.048+0000 7f9e1f7fe640 1 -- 172.21.15.40:0/3689718363 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e100317a0 con 0x7f9e20155400 2023-12-17T11:49:17.051 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:17.048+0000 7f9e1f7fe640 1 -- 172.21.15.40:0/3689718363 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e10031b30 con 0x7f9e20155400 2023-12-17T11:49:17.051 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:17.049+0000 7f9e2569f640 1 -- 172.21.15.40:0/3689718363 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9e20155400 msgr2=0x7f9e2006bdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:17.051 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:17.049+0000 7f9e2569f640 1 --2- 172.21.15.40:0/3689718363 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9e20155400 0x7f9e2006bdf0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f9e10009870 tx=0x7f9e1002b8f0 comp rx=0 tx=0).stop 2023-12-17T11:49:17.052 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:17.049+0000 7f9e2569f640 1 -- 172.21.15.40:0/3689718363 shutdown_connections 2023-12-17T11:49:17.052 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:17.049+0000 7f9e2569f640 1 --2- 172.21.15.40:0/3689718363 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9e200cf500 0x7f9e200ce5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:17.052 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:17.049+0000 7f9e2569f640 1 --2- 172.21.15.40:0/3689718363 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9e20155400 0x7f9e2006bdf0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:17.052 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:17.049+0000 7f9e2569f640 1 -- 172.21.15.40:0/3689718363 >> 172.21.15.40:0/3689718363 conn(0x7f9e2006a640 msgr2=0x7f9e2006aa50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:49:17.052 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:17.049+0000 7f9e2569f640 1 -- 172.21.15.40:0/3689718363 shutdown_connections 2023-12-17T11:49:17.052 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:17.049+0000 7f9e2569f640 1 -- 172.21.15.40:0/3689718363 wait complete. 2023-12-17T11:49:17.053 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:17.051+0000 7f9e2569f640 1 Processor -- start 2023-12-17T11:49:17.053 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:17.051+0000 7f9e2569f640 1 -- start start 2023-12-17T11:49:17.055 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:17.052+0000 7f9e2569f640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9e200ce150 0x7f9e2013df40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:17.055 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:17.052+0000 7f9e2569f640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9e200cf500 0x7f9e2009c290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:17.055 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:17.052+0000 7f9e2569f640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9e20155400 0x7f9e20140640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:17.055 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:17.052+0000 7f9e2569f640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e201e38e0 con 0x7f9e200cf500 2023-12-17T11:49:17.055 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:17.052+0000 7f9e2569f640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e201f2db0 con 0x7f9e20155400 2023-12-17T11:49:17.055 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:17.052+0000 7f9e2569f640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e200af9c0 con 0x7f9e200ce150 2023-12-17T11:49:17.056 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:17.052+0000 7f9e17fff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9e200cf500 0x7f9e2009c290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:17.056 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:17.053+0000 7f9e17fff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9e200cf500 0x7f9e2009c290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:48196/0 (socket says 172.21.15.40:48196) 2023-12-17T11:49:17.056 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:17.053+0000 7f9e17fff640 1 -- 172.21.15.40:0/2516608226 learned_addr learned my addr 172.21.15.40:0/2516608226 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-17T11:49:17.056 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:17.053+0000 7f9e1ffff640 1 --2- 172.21.15.40:0/2516608226 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9e200ce150 0x7f9e2013df40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:17.056 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:17.053+0000 7f9e24e9e640 1 --2- 172.21.15.40:0/2516608226 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9e20155400 0x7f9e20140640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:17.056 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:17.053+0000 7f9e17fff640 1 -- 172.21.15.40:0/2516608226 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9e200ce150 msgr2=0x7f9e2013df40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:17.056 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:17.053+0000 7f9e17fff640 1 --2- 172.21.15.40:0/2516608226 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9e200ce150 0x7f9e2013df40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:17.056 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:17.053+0000 7f9e17fff640 1 -- 172.21.15.40:0/2516608226 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9e20155400 msgr2=0x7f9e20140640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:17.056 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:17.053+0000 7f9e17fff640 1 --2- 172.21.15.40:0/2516608226 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9e20155400 0x7f9e20140640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:17.056 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:17.053+0000 7f9e17fff640 1 -- 172.21.15.40:0/2516608226 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e100094d0 con 0x7f9e200cf500 2023-12-17T11:49:17.056 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:17.053+0000 7f9e1ffff640 1 --2- 172.21.15.40:0/2516608226 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9e200ce150 0x7f9e2013df40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-17T11:49:17.056 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:17.053+0000 7f9e17fff640 1 --2- 172.21.15.40:0/2516608226 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9e200cf500 0x7f9e2009c290 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f9e0800c430 tx=0x7f9e0800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:49:17.057 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:17.054+0000 7f9e1d7fa640 1 -- 172.21.15.40:0/2516608226 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e08011790 con 0x7f9e200cf500 2023-12-17T11:49:17.057 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:17.054+0000 7f9e1d7fa640 1 -- 172.21.15.40:0/2516608226 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e080118f0 con 0x7f9e200cf500 2023-12-17T11:49:17.057 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:17.054+0000 7f9e1d7fa640 1 -- 172.21.15.40:0/2516608226 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e08011ce0 con 0x7f9e200cf500 2023-12-17T11:49:17.057 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:17.054+0000 7f9e2569f640 1 -- 172.21.15.40:0/2516608226 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e200afca0 con 0x7f9e200cf500 2023-12-17T11:49:17.058 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:17.054+0000 7f9e2569f640 1 -- 172.21.15.40:0/2516608226 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e200b0260 con 0x7f9e200cf500 2023-12-17T11:49:17.058 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:17.055+0000 7f9e2569f640 1 -- 172.21.15.40:0/2516608226 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e200ad780 con 0x7f9e200cf500 2023-12-17T11:49:17.058 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:17.056+0000 7f9e1d7fa640 1 -- 172.21.15.40:0/2516608226 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f9e0801c460 con 0x7f9e200cf500 2023-12-17T11:49:17.059 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:17.057+0000 7f9e1d7fa640 1 --2- 172.21.15.40:0/2516608226 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f9e0006ae40 0x7f9e0006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:17.059 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:17.057+0000 7f9e1d7fa640 1 -- 172.21.15.40:0/2516608226 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f9e08089a50 con 0x7f9e200cf500 2023-12-17T11:49:17.059 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:17.058+0000 7f9e1ffff640 1 --2- 172.21.15.40:0/2516608226 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f9e0006ae40 0x7f9e0006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:17.060 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:17.059+0000 7f9e1ffff640 1 --2- 172.21.15.40:0/2516608226 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f9e0006ae40 0x7f9e0006d300 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f9e10036000 tx=0x7f9e1003c040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:49:17.063 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:17.061+0000 7f9e1d7fa640 1 -- 172.21.15.40:0/2516608226 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f9e08054680 con 0x7f9e200cf500 2023-12-17T11:49:17.261 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:17.259+0000 7f9e2569f640 1 -- 172.21.15.40:0/2516608226 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f9e20074450 con 0x7f9e200cf500 2023-12-17T11:49:17.262 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:17.260+0000 7f9e1d7fa640 1 -- 172.21.15.40:0/2516608226 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) v1 ==== 93+0+10 (secure 0 0 0) 0x7f9e08057ca0 con 0x7f9e200cf500 2023-12-17T11:49:17.262 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 1 2023-12-17T11:49:17.265 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:17.262+0000 7f9e2569f640 1 -- 172.21.15.40:0/2516608226 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f9e0006ae40 msgr2=0x7f9e0006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:17.265 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:17.262+0000 7f9e2569f640 1 --2- 172.21.15.40:0/2516608226 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f9e0006ae40 0x7f9e0006d300 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f9e10036000 tx=0x7f9e1003c040 comp rx=0 tx=0).stop 2023-12-17T11:49:17.265 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:17.262+0000 7f9e2569f640 1 -- 172.21.15.40:0/2516608226 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9e200cf500 msgr2=0x7f9e2009c290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:17.265 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:17.262+0000 7f9e2569f640 1 --2- 172.21.15.40:0/2516608226 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9e200cf500 0x7f9e2009c290 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f9e0800c430 tx=0x7f9e0800c8f0 comp rx=0 tx=0).stop 2023-12-17T11:49:17.265 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:17.262+0000 7f9e2569f640 1 -- 172.21.15.40:0/2516608226 shutdown_connections 2023-12-17T11:49:17.265 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:17.262+0000 7f9e2569f640 1 --2- 172.21.15.40:0/2516608226 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f9e0006ae40 0x7f9e0006d300 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:17.265 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:17.262+0000 7f9e2569f640 1 --2- 172.21.15.40:0/2516608226 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9e20155400 0x7f9e20140640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:17.265 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:17.262+0000 7f9e2569f640 1 --2- 172.21.15.40:0/2516608226 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9e200cf500 0x7f9e2009c290 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:17.265 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:17.262+0000 7f9e2569f640 1 --2- 172.21.15.40:0/2516608226 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9e200ce150 0x7f9e2013df40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:17.265 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:17.263+0000 7f9e2569f640 1 -- 172.21.15.40:0/2516608226 >> 172.21.15.40:0/2516608226 conn(0x7f9e2006a640 msgr2=0x7f9e200cedc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:49:17.266 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:17.263+0000 7f9e2569f640 1 -- 172.21.15.40:0/2516608226 shutdown_connections 2023-12-17T11:49:17.266 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:17.263+0000 7f9e2569f640 1 -- 172.21.15.40:0/2516608226 wait complete. 2023-12-17T11:49:17.284 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-17T11:49:17.493 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:17.491+0000 7f35527e2640 1 Processor -- start 2023-12-17T11:49:17.493 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:17.491+0000 7f35527e2640 1 -- start start 2023-12-17T11:49:17.495 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:17.492+0000 7f35527e2640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f354c15d360 0x7f354c0d3660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:17.495 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:17.493+0000 7f35527e2640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f354c0cece0 0x7f354c0d1530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:17.495 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:17.493+0000 7f35527e2640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f354c0cdf20 con 0x7f354c0d1a70 2023-12-17T11:49:17.495 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:17.493+0000 7f35527e2640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f354c0d1f00 con 0x7f354c0cece0 2023-12-17T11:49:17.495 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:17.493+0000 7f35527e2640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f354c0ce200 con 0x7f354c15d360 2023-12-17T11:49:17.495 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:17.493+0000 7f3551fe1640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f354c0d1a70 0x7f354c160f80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:37854/0 (socket says 172.21.15.40:37854) 2023-12-17T11:49:17.495 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:17.493+0000 7f3551fe1640 1 -- 172.21.15.40:0/2847428011 learned_addr learned my addr 172.21.15.40:0/2847428011 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-12-17T11:49:17.495 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:17.493+0000 7f3550fdf640 1 --2- 172.21.15.40:0/2847428011 >> v2:172.21.15.40:3300/0 conn(0x7f354c0cece0 0x7f354c0d1530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:17.495 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:17.493+0000 7f35517e0640 1 --2- 172.21.15.40:0/2847428011 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f354c15d360 0x7f354c0d3660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:17.496 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:17.493+0000 7f3543fff640 1 -- 172.21.15.40:0/2847428011 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4221878366 0 0) 0x7f354c0cdf20 con 0x7f354c0d1a70 2023-12-17T11:49:17.496 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:17.493+0000 7f3543fff640 1 -- 172.21.15.40:0/2847428011 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3538003520 con 0x7f354c0d1a70 2023-12-17T11:49:17.496 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:17.494+0000 7f3550fdf640 1 -- 172.21.15.40:0/2847428011 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f354c15d360 msgr2=0x7f354c0d3660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:49:17.497 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:17.494+0000 7f3550fdf640 1 --2- 172.21.15.40:0/2847428011 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f354c15d360 0x7f354c0d3660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:17.497 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:17.494+0000 7f3550fdf640 1 -- 172.21.15.40:0/2847428011 >> v1:172.21.15.40:6789/0 conn(0x7f354c0d1a70 legacy=0x7f354c160f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:17.497 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:17.494+0000 7f3550fdf640 1 -- 172.21.15.40:0/2847428011 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f354c0ce4e0 con 0x7f354c0cece0 2023-12-17T11:49:17.497 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:17.495+0000 7f3550fdf640 1 --2- 172.21.15.40:0/2847428011 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f354c0cece0 0x7f354c0d1530 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f353c0097a0 tx=0x7f353c02b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=109bddb38f814313 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:49:17.498 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:17.495+0000 7f3543fff640 1 -- 172.21.15.40:0/2847428011 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f353c030610 con 0x7f354c0cece0 2023-12-17T11:49:17.498 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:17.495+0000 7f3543fff640 1 -- 172.21.15.40:0/2847428011 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f353c030770 con 0x7f354c0cece0 2023-12-17T11:49:17.498 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:17.495+0000 7f3543fff640 1 -- 172.21.15.40:0/2847428011 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f353c030b00 con 0x7f354c0cece0 2023-12-17T11:49:17.498 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:17.496+0000 7f35527e2640 1 -- 172.21.15.40:0/2847428011 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f354c0cece0 msgr2=0x7f354c0d1530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:17.498 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:17.496+0000 7f35527e2640 1 --2- 172.21.15.40:0/2847428011 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f354c0cece0 0x7f354c0d1530 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f353c0097a0 tx=0x7f353c02b960 comp rx=0 tx=0).stop 2023-12-17T11:49:17.498 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:17.496+0000 7f35527e2640 1 -- 172.21.15.40:0/2847428011 shutdown_connections 2023-12-17T11:49:17.498 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:17.496+0000 7f35527e2640 1 --2- 172.21.15.40:0/2847428011 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f354c0cece0 0x7f354c0d1530 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:17.498 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:17.496+0000 7f35527e2640 1 --2- 172.21.15.40:0/2847428011 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f354c15d360 0x7f354c0d3660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:17.498 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:17.496+0000 7f35527e2640 1 -- 172.21.15.40:0/2847428011 >> 172.21.15.40:0/2847428011 conn(0x7f354c09c230 msgr2=0x7f354c0d2f50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:49:17.499 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:17.496+0000 7f35527e2640 1 -- 172.21.15.40:0/2847428011 shutdown_connections 2023-12-17T11:49:17.499 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:17.496+0000 7f35527e2640 1 -- 172.21.15.40:0/2847428011 wait complete. 2023-12-17T11:49:17.499 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:17.498+0000 7f35527e2640 1 Processor -- start 2023-12-17T11:49:17.499 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:17.498+0000 7f35527e2640 1 -- start start 2023-12-17T11:49:17.501 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:17.499+0000 7f35527e2640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f354c0cece0 0x7f354c1600e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:17.501 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:17.499+0000 7f35527e2640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f354c0d1a70 0x7f354c14c050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:17.501 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:17.499+0000 7f35527e2640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f354c15d360 0x7f354c14c590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:17.501 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:17.499+0000 7f35527e2640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f354c14cfa0 con 0x7f354c15d360 2023-12-17T11:49:17.502 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:17.499+0000 7f35527e2640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f354c0c9400 con 0x7f354c0d1a70 2023-12-17T11:49:17.502 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:17.499+0000 7f35527e2640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f354c158fb0 con 0x7f354c0cece0 2023-12-17T11:49:17.502 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:17.499+0000 7f3551fe1640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f354c15d360 0x7f354c14c590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:17.502 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:17.499+0000 7f3551fe1640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f354c15d360 0x7f354c14c590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:48214/0 (socket says 172.21.15.40:48214) 2023-12-17T11:49:17.502 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:17.499+0000 7f3551fe1640 1 -- 172.21.15.40:0/359933245 learned_addr learned my addr 172.21.15.40:0/359933245 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-17T11:49:17.502 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:17.499+0000 7f3551fe1640 1 -- 172.21.15.40:0/359933245 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f354c0cece0 msgr2=0x7f354c1600e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:17.502 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:17.499+0000 7f3551fe1640 1 --2- 172.21.15.40:0/359933245 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f354c0cece0 0x7f354c1600e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:17.502 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:17.499+0000 7f3551fe1640 1 -- 172.21.15.40:0/359933245 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f354c0d1a70 msgr2=0x7f354c14c050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:17.502 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:17.499+0000 7f3551fe1640 1 --2- 172.21.15.40:0/359933245 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f354c0d1a70 0x7f354c14c050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:17.502 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:17.499+0000 7f3551fe1640 1 -- 172.21.15.40:0/359933245 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f353c009400 con 0x7f354c15d360 2023-12-17T11:49:17.502 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:17.500+0000 7f3551fe1640 1 --2- 172.21.15.40:0/359933245 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f354c15d360 0x7f354c14c590 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f354400ca20 tx=0x7f354400cee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:49:17.503 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:17.500+0000 7f3541ffb640 1 -- 172.21.15.40:0/359933245 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f354400abd0 con 0x7f354c15d360 2023-12-17T11:49:17.503 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:17.500+0000 7f3541ffb640 1 -- 172.21.15.40:0/359933245 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f354400ad30 con 0x7f354c15d360 2023-12-17T11:49:17.503 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:17.500+0000 7f3541ffb640 1 -- 172.21.15.40:0/359933245 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f354400aea0 con 0x7f354c15d360 2023-12-17T11:49:17.503 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:17.500+0000 7f35527e2640 1 -- 172.21.15.40:0/359933245 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f354c1607a0 con 0x7f354c15d360 2023-12-17T11:49:17.503 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:17.500+0000 7f35527e2640 1 -- 172.21.15.40:0/359933245 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f354c158960 con 0x7f354c15d360 2023-12-17T11:49:17.504 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:17.501+0000 7f35527e2640 1 -- 172.21.15.40:0/359933245 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f354c0678e0 con 0x7f354c15d360 2023-12-17T11:49:17.504 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:17.502+0000 7f3541ffb640 1 -- 172.21.15.40:0/359933245 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f3544007070 con 0x7f354c15d360 2023-12-17T11:49:17.505 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:17.503+0000 7f3541ffb640 1 --2- 172.21.15.40:0/359933245 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f353006ae40 0x7f353006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:17.505 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:17.503+0000 7f3541ffb640 1 -- 172.21.15.40:0/359933245 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f35440899a0 con 0x7f354c15d360 2023-12-17T11:49:17.506 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:17.504+0000 7f35517e0640 1 --2- 172.21.15.40:0/359933245 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f353006ae40 0x7f353006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:17.507 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:17.505+0000 7f35517e0640 1 --2- 172.21.15.40:0/359933245 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f353006ae40 0x7f353006d300 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f35480098f0 tx=0x7f3548008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:49:17.510 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:17.508+0000 7f3541ffb640 1 -- 172.21.15.40:0/359933245 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f35440545d0 con 0x7f354c15d360 2023-12-17T11:49:17.701 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:17.699+0000 7f35527e2640 1 -- 172.21.15.40:0/359933245 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f354c074450 con 0x7f354c15d360 2023-12-17T11:49:17.702 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:17.700+0000 7f3541ffb640 1 -- 172.21.15.40:0/359933245 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) v1 ==== 104+0+11 (secure 0 0 0) 0x7f3544057bf0 con 0x7f354c15d360 2023-12-17T11:49:17.702 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 32 2023-12-17T11:49:17.705 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:17.703+0000 7f35527e2640 1 -- 172.21.15.40:0/359933245 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f353006ae40 msgr2=0x7f353006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:17.705 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:17.703+0000 7f35527e2640 1 --2- 172.21.15.40:0/359933245 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f353006ae40 0x7f353006d300 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f35480098f0 tx=0x7f3548008040 comp rx=0 tx=0).stop 2023-12-17T11:49:17.705 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:17.703+0000 7f35527e2640 1 -- 172.21.15.40:0/359933245 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f354c15d360 msgr2=0x7f354c14c590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:17.705 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:17.703+0000 7f35527e2640 1 --2- 172.21.15.40:0/359933245 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f354c15d360 0x7f354c14c590 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f354400ca20 tx=0x7f354400cee0 comp rx=0 tx=0).stop 2023-12-17T11:49:17.705 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:17.703+0000 7f35527e2640 1 -- 172.21.15.40:0/359933245 shutdown_connections 2023-12-17T11:49:17.705 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:17.703+0000 7f35527e2640 1 --2- 172.21.15.40:0/359933245 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f353006ae40 0x7f353006d300 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:17.706 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:17.703+0000 7f35527e2640 1 --2- 172.21.15.40:0/359933245 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f354c15d360 0x7f354c14c590 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:17.706 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:17.703+0000 7f35527e2640 1 --2- 172.21.15.40:0/359933245 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f354c0d1a70 0x7f354c14c050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:17.706 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:17.703+0000 7f35527e2640 1 --2- 172.21.15.40:0/359933245 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f354c0cece0 0x7f354c1600e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:17.706 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:17.703+0000 7f35527e2640 1 -- 172.21.15.40:0/359933245 >> 172.21.15.40:0/359933245 conn(0x7f354c09c230 msgr2=0x7f354c15a730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:49:17.706 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:17.703+0000 7f35527e2640 1 -- 172.21.15.40:0/359933245 shutdown_connections 2023-12-17T11:49:17.706 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:17.703+0000 7f35527e2640 1 -- 172.21.15.40:0/359933245 wait complete. 2023-12-17T11:49:17.724 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-17T11:49:17.950 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:17.948+0000 7f801a947640 1 Processor -- start 2023-12-17T11:49:17.950 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:17.948+0000 7f801a947640 1 -- start start 2023-12-17T11:49:17.951 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:17.949+0000 7f801a947640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f801415eec0 0x7f8014162440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:17.951 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:17.949+0000 7f801a947640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f801406c8b0 0x7f80140cedf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:17.951 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:17.949+0000 7f801a947640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80140cf760 con 0x7f80140cf330 2023-12-17T11:49:17.952 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:17.949+0000 7f801a947640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f801406bdf0 con 0x7f801406c8b0 2023-12-17T11:49:17.952 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:17.950+0000 7f801a947640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8014070430 con 0x7f801415eec0 2023-12-17T11:49:17.952 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:17.950+0000 7f8019144640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f801406c8b0 0x7f80140cedf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:17.952 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:17.950+0000 7f8019144640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f801406c8b0 0x7f80140cedf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:48220/0 (socket says 172.21.15.40:48220) 2023-12-17T11:49:17.953 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:17.950+0000 7f8019144640 1 -- 172.21.15.40:0/1414064047 learned_addr learned my addr 172.21.15.40:0/1414064047 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-17T11:49:17.953 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:17.950+0000 7f8019945640 1 --2- 172.21.15.40:0/1414064047 >> v2:172.21.15.159:3300/0 conn(0x7f801415eec0 0x7f8014162440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:17.953 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:17.950+0000 7f8019144640 1 -- 172.21.15.40:0/1414064047 >> v2:172.21.15.159:3300/0 conn(0x7f801415eec0 msgr2=0x7f8014162440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:49:17.953 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:17.950+0000 7f8019144640 1 --2- 172.21.15.40:0/1414064047 >> v2:172.21.15.159:3300/0 conn(0x7f801415eec0 0x7f8014162440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:17.953 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:17.950+0000 7f8019144640 1 -- 172.21.15.40:0/1414064047 >> v1:172.21.15.159:6789/0 conn(0x7f80140cf330 legacy=0x7f80140abd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:49:17.953 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:17.950+0000 7f8019144640 1 -- 172.21.15.40:0/1414064047 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8014070710 con 0x7f801406c8b0 2023-12-17T11:49:17.954 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:17.951+0000 7f8019144640 1 --2- 172.21.15.40:0/1414064047 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f801406c8b0 0x7f80140cedf0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f801406b520 tx=0x7f800402b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=339d56e2eef1fedc server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:49:17.954 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:17.952+0000 7f8018943640 1 -- 172.21.15.40:0/1414064047 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8004031870 con 0x7f801406c8b0 2023-12-17T11:49:17.954 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:17.952+0000 7f8018943640 1 -- 172.21.15.40:0/1414064047 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80040319d0 con 0x7f801406c8b0 2023-12-17T11:49:17.954 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:17.952+0000 7f8018943640 1 -- 172.21.15.40:0/1414064047 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8004031d60 con 0x7f801406c8b0 2023-12-17T11:49:17.955 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:17.952+0000 7f801a947640 1 -- 172.21.15.40:0/1414064047 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f801406c8b0 msgr2=0x7f80140cedf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:17.955 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:17.952+0000 7f801a947640 1 --2- 172.21.15.40:0/1414064047 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f801406c8b0 0x7f80140cedf0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f801406b520 tx=0x7f800402b910 comp rx=0 tx=0).stop 2023-12-17T11:49:17.955 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:17.953+0000 7f801a947640 1 -- 172.21.15.40:0/1414064047 shutdown_connections 2023-12-17T11:49:17.955 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:17.953+0000 7f801a947640 1 --2- 172.21.15.40:0/1414064047 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f801406c8b0 0x7f80140cedf0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:17.955 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:17.953+0000 7f801a947640 1 --2- 172.21.15.40:0/1414064047 >> v2:172.21.15.159:3300/0 conn(0x7f801415eec0 0x7f8014162440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:17.955 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:17.953+0000 7f801a947640 1 -- 172.21.15.40:0/1414064047 >> 172.21.15.40:0/1414064047 conn(0x7f801406a640 msgr2=0x7f801406aa50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:49:17.955 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:17.953+0000 7f801a947640 1 -- 172.21.15.40:0/1414064047 shutdown_connections 2023-12-17T11:49:17.955 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:17.953+0000 7f801a947640 1 -- 172.21.15.40:0/1414064047 wait complete. 2023-12-17T11:49:17.957 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:17.955+0000 7f801a947640 1 Processor -- start 2023-12-17T11:49:17.957 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:17.955+0000 7f801a947640 1 -- start start 2023-12-17T11:49:17.959 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:17.956+0000 7f801a947640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f801406c8b0 0x7f801414cb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:17.959 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:17.956+0000 7f801a947640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f80140cf330 0x7f80140cdde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:17.959 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:17.956+0000 7f801a947640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f801415eec0 0x7f80140cb5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:17.959 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:17.956+0000 7f801a947640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f801414ab00 con 0x7f801415eec0 2023-12-17T11:49:17.960 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:17.956+0000 7f801a947640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f801414d470 con 0x7f80140cf330 2023-12-17T11:49:17.960 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:17.956+0000 7f801a947640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f801414d750 con 0x7f801406c8b0 2023-12-17T11:49:17.960 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:17.957+0000 7f801a146640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f801415eec0 0x7f80140cb5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:17.960 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:17.957+0000 7f801a146640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f801415eec0 0x7f80140cb5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:48232/0 (socket says 172.21.15.40:48232) 2023-12-17T11:49:17.960 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:17.957+0000 7f801a146640 1 -- 172.21.15.40:0/3229316710 learned_addr learned my addr 172.21.15.40:0/3229316710 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-17T11:49:17.960 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:17.957+0000 7f8019144640 1 --2- 172.21.15.40:0/3229316710 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f80140cf330 0x7f80140cdde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:17.960 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:17.957+0000 7f801a146640 1 -- 172.21.15.40:0/3229316710 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f801406c8b0 msgr2=0x7f801414cb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:17.960 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:17.957+0000 7f801a146640 1 --2- 172.21.15.40:0/3229316710 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f801406c8b0 0x7f801414cb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:17.960 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:17.957+0000 7f801a146640 1 -- 172.21.15.40:0/3229316710 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f80140cf330 msgr2=0x7f80140cdde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:17.960 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:17.957+0000 7f801a146640 1 --2- 172.21.15.40:0/3229316710 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f80140cf330 0x7f80140cdde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:17.960 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:17.957+0000 7f801a146640 1 -- 172.21.15.40:0/3229316710 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80040094d0 con 0x7f801415eec0 2023-12-17T11:49:17.960 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:17.958+0000 7f801a146640 1 --2- 172.21.15.40:0/3229316710 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f801415eec0 0x7f80140cb5c0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f800c00c780 tx=0x7f800c00cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:49:17.961 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:17.958+0000 7f800a7fc640 1 -- 172.21.15.40:0/3229316710 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f800c003d80 con 0x7f801415eec0 2023-12-17T11:49:17.961 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:17.958+0000 7f800a7fc640 1 -- 172.21.15.40:0/3229316710 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f800c00ce90 con 0x7f801415eec0 2023-12-17T11:49:17.961 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:17.958+0000 7f801a947640 1 -- 172.21.15.40:0/3229316710 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f801414da30 con 0x7f801415eec0 2023-12-17T11:49:17.961 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:17.958+0000 7f800a7fc640 1 -- 172.21.15.40:0/3229316710 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f800c0052b0 con 0x7f801415eec0 2023-12-17T11:49:17.962 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:17.958+0000 7f801a947640 1 -- 172.21.15.40:0/3229316710 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f801409adc0 con 0x7f801415eec0 2023-12-17T11:49:17.962 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:17.959+0000 7f801a947640 1 -- 172.21.15.40:0/3229316710 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8014071070 con 0x7f801415eec0 2023-12-17T11:49:17.962 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:17.960+0000 7f800a7fc640 1 -- 172.21.15.40:0/3229316710 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f800c005410 con 0x7f801415eec0 2023-12-17T11:49:17.963 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:17.961+0000 7f800a7fc640 1 --2- 172.21.15.40:0/3229316710 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f7ff806ae40 0x7f7ff806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:17.963 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:17.961+0000 7f800a7fc640 1 -- 172.21.15.40:0/3229316710 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f800c0892d0 con 0x7f801415eec0 2023-12-17T11:49:17.963 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:17.962+0000 7f8019945640 1 --2- 172.21.15.40:0/3229316710 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f7ff806ae40 0x7f7ff806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:17.965 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:17.963+0000 7f8019945640 1 --2- 172.21.15.40:0/3229316710 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f7ff806ae40 0x7f7ff806d300 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f801000a810 tx=0x7f8010008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:49:17.967 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:17.965+0000 7f800a7fc640 1 -- 172.21.15.40:0/3229316710 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f800c053f00 con 0x7f801415eec0 2023-12-17T11:49:18.152 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:18.149+0000 7f801a947640 1 -- 172.21.15.40:0/3229316710 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f8014074450 con 0x7f801415eec0 2023-12-17T11:49:18.152 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:18.150+0000 7f800a7fc640 1 -- 172.21.15.40:0/3229316710 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) v1 ==== 100+0+11 (secure 0 0 0) 0x7f800c0170a0 con 0x7f801415eec0 2023-12-17T11:49:18.153 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 64 2023-12-17T11:49:18.155 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:18.153+0000 7f801a947640 1 -- 172.21.15.40:0/3229316710 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f7ff806ae40 msgr2=0x7f7ff806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:18.155 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:18.153+0000 7f801a947640 1 --2- 172.21.15.40:0/3229316710 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f7ff806ae40 0x7f7ff806d300 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f801000a810 tx=0x7f8010008040 comp rx=0 tx=0).stop 2023-12-17T11:49:18.155 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:18.153+0000 7f801a947640 1 -- 172.21.15.40:0/3229316710 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f801415eec0 msgr2=0x7f80140cb5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:18.156 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:18.153+0000 7f801a947640 1 --2- 172.21.15.40:0/3229316710 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f801415eec0 0x7f80140cb5c0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f800c00c780 tx=0x7f800c00cc40 comp rx=0 tx=0).stop 2023-12-17T11:49:18.156 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:18.153+0000 7f801a947640 1 -- 172.21.15.40:0/3229316710 shutdown_connections 2023-12-17T11:49:18.156 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:18.153+0000 7f801a947640 1 --2- 172.21.15.40:0/3229316710 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f7ff806ae40 0x7f7ff806d300 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:18.156 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:18.153+0000 7f801a947640 1 --2- 172.21.15.40:0/3229316710 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f801415eec0 0x7f80140cb5c0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:18.156 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:18.153+0000 7f801a947640 1 --2- 172.21.15.40:0/3229316710 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f80140cf330 0x7f80140cdde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:18.156 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:18.153+0000 7f801a947640 1 --2- 172.21.15.40:0/3229316710 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f801406c8b0 0x7f801414cb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:18.156 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:18.153+0000 7f801a947640 1 -- 172.21.15.40:0/3229316710 >> 172.21.15.40:0/3229316710 conn(0x7f801406a640 msgr2=0x7f8014072ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:49:18.156 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:18.153+0000 7f801a947640 1 -- 172.21.15.40:0/3229316710 shutdown_connections 2023-12-17T11:49:18.156 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:18.153+0000 7f801a947640 1 -- 172.21.15.40:0/3229316710 wait complete. 2023-12-17T11:49:18.174 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-12-17T11:49:18.396 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:18.394+0000 7f1316f9a640 1 Processor -- start 2023-12-17T11:49:18.396 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:18.394+0000 7f1316f9a640 1 -- start start 2023-12-17T11:49:18.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:18.396+0000 7f1316f9a640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f131015ba90 0x7f131006d370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:18.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:18.396+0000 7f1316f9a640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f131006d950 con 0x7f13100b2aa0 2023-12-17T11:49:18.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:18.396+0000 7f1316f9a640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13100cc720 con 0x7f13100cc2f0 2023-12-17T11:49:18.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:18.396+0000 7f1316f9a640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13100b3fe0 con 0x7f131015ba90 2023-12-17T11:49:18.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:18.396+0000 7f1315f98640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f131015ba90 0x7f131006d370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:18.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:18.396+0000 7f1315797640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f13100b2aa0 0x7f13100cbbe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:37862/0 (socket says 172.21.15.40:37862) 2023-12-17T11:49:18.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:18.396+0000 7f1315797640 1 -- 172.21.15.40:0/2424532685 learned_addr learned my addr 172.21.15.40:0/2424532685 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-12-17T11:49:18.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:18.397+0000 7f1315f98640 1 -- 172.21.15.40:0/2424532685 >> v1:172.21.15.159:6789/0 conn(0x7f13100cc2f0 legacy=0x7f1310161a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:49:18.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:18.397+0000 7f1315f98640 1 -- 172.21.15.40:0/2424532685 >> v1:172.21.15.40:6789/0 conn(0x7f13100b2aa0 legacy=0x7f13100cbbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:18.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:18.397+0000 7f1315f98640 1 -- 172.21.15.40:0/2424532685 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f131006c0b0 con 0x7f131015ba90 2023-12-17T11:49:18.400 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:18.398+0000 7f1315f98640 1 --2- 172.21.15.40:0/2424532685 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f131015ba90 0x7f131006d370 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f130c0097a0 tx=0x7f130c02b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2d54921f616e22b server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:49:18.400 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:18.398+0000 7f1314f96640 1 -- 172.21.15.40:0/2424532685 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f130c02e070 con 0x7f131015ba90 2023-12-17T11:49:18.400 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:18.398+0000 7f1314f96640 1 -- 172.21.15.40:0/2424532685 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f130c0315a0 con 0x7f131015ba90 2023-12-17T11:49:18.400 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:18.398+0000 7f1314f96640 1 -- 172.21.15.40:0/2424532685 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f130c031930 con 0x7f131015ba90 2023-12-17T11:49:18.401 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:18.399+0000 7f1316f9a640 1 -- 172.21.15.40:0/2424532685 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f131015ba90 msgr2=0x7f131006d370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:18.401 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:18.399+0000 7f1316f9a640 1 --2- 172.21.15.40:0/2424532685 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f131015ba90 0x7f131006d370 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f130c0097a0 tx=0x7f130c02b840 comp rx=0 tx=0).stop 2023-12-17T11:49:18.401 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:18.399+0000 7f1316f9a640 1 -- 172.21.15.40:0/2424532685 shutdown_connections 2023-12-17T11:49:18.401 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:18.399+0000 7f1316f9a640 1 --2- 172.21.15.40:0/2424532685 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f131015ba90 0x7f131006d370 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:18.401 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:18.399+0000 7f1316f9a640 1 -- 172.21.15.40:0/2424532685 >> 172.21.15.40:0/2424532685 conn(0x7f13100b0940 msgr2=0x7f13100b0d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:49:18.401 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:18.399+0000 7f1316f9a640 1 -- 172.21.15.40:0/2424532685 shutdown_connections 2023-12-17T11:49:18.402 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:18.399+0000 7f1316f9a640 1 -- 172.21.15.40:0/2424532685 wait complete. 2023-12-17T11:49:18.403 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:18.401+0000 7f1316f9a640 1 Processor -- start 2023-12-17T11:49:18.403 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:18.401+0000 7f1316f9a640 1 -- start start 2023-12-17T11:49:18.405 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:18.402+0000 7f1316f9a640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f13100b2aa0 0x7f13100cd4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:18.405 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:18.402+0000 7f1316f9a640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f13100cc2f0 0x7f13101fad80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:18.405 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:18.402+0000 7f1316f9a640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f131015ba90 0x7f1310163760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:18.405 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:18.402+0000 7f1316f9a640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13101fa960 con 0x7f13100b2aa0 2023-12-17T11:49:18.405 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:18.402+0000 7f1316f9a640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13101f77b0 con 0x7f13100cc2f0 2023-12-17T11:49:18.405 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:18.402+0000 7f1316f9a640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13101f7a90 con 0x7f131015ba90 2023-12-17T11:49:18.405 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:18.402+0000 7f1315f98640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f13100b2aa0 0x7f13100cd4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:18.406 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:18.402+0000 7f1315f98640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f13100b2aa0 0x7f13100cd4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:48254/0 (socket says 172.21.15.40:48254) 2023-12-17T11:49:18.406 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:18.402+0000 7f1315f98640 1 -- 172.21.15.40:0/2240554503 learned_addr learned my addr 172.21.15.40:0/2240554503 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-17T11:49:18.406 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:18.403+0000 7f1315797640 1 --2- 172.21.15.40:0/2240554503 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f13100cc2f0 0x7f13101fad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:18.406 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:18.403+0000 7f1315f98640 1 -- 172.21.15.40:0/2240554503 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f131015ba90 msgr2=0x7f1310163760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:18.406 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:18.403+0000 7f1315f98640 1 --2- 172.21.15.40:0/2240554503 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f131015ba90 0x7f1310163760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:18.406 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:18.403+0000 7f1315f98640 1 -- 172.21.15.40:0/2240554503 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f13100cc2f0 msgr2=0x7f13101fad80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:18.406 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:18.403+0000 7f1315f98640 1 --2- 172.21.15.40:0/2240554503 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f13100cc2f0 0x7f13101fad80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:18.406 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:18.403+0000 7f1315f98640 1 -- 172.21.15.40:0/2240554503 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f130c009400 con 0x7f13100b2aa0 2023-12-17T11:49:18.406 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:18.403+0000 7f1315f98640 1 --2- 172.21.15.40:0/2240554503 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f13100b2aa0 0x7f13100cd4c0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f130c034040 tx=0x7f130c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:49:18.407 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:18.403+0000 7f13067fc640 1 -- 172.21.15.40:0/2240554503 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f130c032900 con 0x7f13100b2aa0 2023-12-17T11:49:18.407 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:18.404+0000 7f13067fc640 1 -- 172.21.15.40:0/2240554503 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f130c032a80 con 0x7f13100b2aa0 2023-12-17T11:49:18.407 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:18.404+0000 7f13067fc640 1 -- 172.21.15.40:0/2240554503 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f130c032e30 con 0x7f13100b2aa0 2023-12-17T11:49:18.407 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:18.404+0000 7f1316f9a640 1 -- 172.21.15.40:0/2240554503 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13101f7d70 con 0x7f13100b2aa0 2023-12-17T11:49:18.407 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:18.404+0000 7f1316f9a640 1 -- 172.21.15.40:0/2240554503 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13101fb2c0 con 0x7f13100b2aa0 2023-12-17T11:49:18.407 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:18.405+0000 7f1316f9a640 1 -- 172.21.15.40:0/2240554503 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1310067910 con 0x7f13100b2aa0 2023-12-17T11:49:18.408 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:18.406+0000 7f13067fc640 1 -- 172.21.15.40:0/2240554503 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f130c03b3f0 con 0x7f13100b2aa0 2023-12-17T11:49:18.408 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:18.407+0000 7f13067fc640 1 --2- 172.21.15.40:0/2240554503 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f12f406ae40 0x7f12f406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:18.409 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:18.407+0000 7f13067fc640 1 -- 172.21.15.40:0/2240554503 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f130c0abb50 con 0x7f13100b2aa0 2023-12-17T11:49:18.409 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:18.407+0000 7f1315797640 1 --2- 172.21.15.40:0/2240554503 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f12f406ae40 0x7f12f406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:18.410 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:18.409+0000 7f1315797640 1 --2- 172.21.15.40:0/2240554503 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f12f406ae40 0x7f12f406d300 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f131014ac00 tx=0x7f1300009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:49:18.413 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:18.411+0000 7f13067fc640 1 -- 172.21.15.40:0/2240554503 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f130c076780 con 0x7f13100b2aa0 2023-12-17T11:49:18.616 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:18.614+0000 7f1316f9a640 1 -- 172.21.15.40:0/2240554503 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f1310074450 con 0x7f13100b2aa0 2023-12-17T11:49:18.616 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:18.614+0000 7f13067fc640 1 -- 172.21.15.40:0/2240554503 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) v1 ==== 103+0+11 (secure 0 0 0) 0x7f130c079da0 con 0x7f13100b2aa0 2023-12-17T11:49:18.616 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 32 2023-12-17T11:49:18.619 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:18.617+0000 7f1316f9a640 1 -- 172.21.15.40:0/2240554503 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f12f406ae40 msgr2=0x7f12f406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:18.619 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:18.617+0000 7f1316f9a640 1 --2- 172.21.15.40:0/2240554503 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f12f406ae40 0x7f12f406d300 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f131014ac00 tx=0x7f1300009040 comp rx=0 tx=0).stop 2023-12-17T11:49:18.619 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:18.617+0000 7f1316f9a640 1 -- 172.21.15.40:0/2240554503 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f13100b2aa0 msgr2=0x7f13100cd4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:18.619 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:18.617+0000 7f1316f9a640 1 --2- 172.21.15.40:0/2240554503 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f13100b2aa0 0x7f13100cd4c0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f130c034040 tx=0x7f130c0046c0 comp rx=0 tx=0).stop 2023-12-17T11:49:18.619 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:18.617+0000 7f1316f9a640 1 -- 172.21.15.40:0/2240554503 shutdown_connections 2023-12-17T11:49:18.620 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:18.617+0000 7f1316f9a640 1 --2- 172.21.15.40:0/2240554503 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f12f406ae40 0x7f12f406d300 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:18.620 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:18.617+0000 7f1316f9a640 1 --2- 172.21.15.40:0/2240554503 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f131015ba90 0x7f1310163760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:18.620 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:18.617+0000 7f1316f9a640 1 --2- 172.21.15.40:0/2240554503 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f13100cc2f0 0x7f13101fad80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:18.620 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:18.617+0000 7f1316f9a640 1 --2- 172.21.15.40:0/2240554503 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f13100b2aa0 0x7f13100cd4c0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:18.620 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:18.617+0000 7f1316f9a640 1 -- 172.21.15.40:0/2240554503 >> 172.21.15.40:0/2240554503 conn(0x7f13100b0940 msgr2=0x7f13100ae700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:49:18.620 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:18.617+0000 7f1316f9a640 1 -- 172.21.15.40:0/2240554503 shutdown_connections 2023-12-17T11:49:18.620 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:18.617+0000 7f1316f9a640 1 -- 172.21.15.40:0/2240554503 wait complete. 2023-12-17T11:49:18.640 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev.test_generic' 2023-12-17T11:49:18.863 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:18.860+0000 7fad4ffff640 1 Processor -- start 2023-12-17T11:49:18.863 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:18.860+0000 7fad4ffff640 1 -- start start 2023-12-17T11:49:18.866 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:18.862+0000 7fad4ffff640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fad5006ab70 0x7fad50161ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:18.866 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:18.862+0000 7fad4ffff640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7fad50162010 0x7fad500cf810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:18.866 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:18.862+0000 7fad4ffff640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad50146bd0 con 0x7fad500b3390 2023-12-17T11:49:18.866 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:18.862+0000 7fad4ffff640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad501448c0 con 0x7fad50162010 2023-12-17T11:49:18.866 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:18.862+0000 7fad4ffff640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad500b3770 con 0x7fad5006ab70 2023-12-17T11:49:18.866 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:18.862+0000 7fad4effd640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fad500b3390 0x7fad5006a460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:37876/0 (socket says 172.21.15.40:37876) 2023-12-17T11:49:18.866 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:18.862+0000 7fad4effd640 1 -- 172.21.15.40:0/1497913759 learned_addr learned my addr 172.21.15.40:0/1497913759 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-12-17T11:49:18.866 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:18.863+0000 7fad4f7fe640 1 --2- 172.21.15.40:0/1497913759 >> v2:172.21.15.159:3300/0 conn(0x7fad50162010 0x7fad500cf810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:18.867 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:18.863+0000 7fad4e7fc640 1 --2- 172.21.15.40:0/1497913759 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fad5006ab70 0x7fad50161ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:18.867 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:18.863+0000 7fad4dffb640 1 -- 172.21.15.40:0/1497913759 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2023873592 0 0) 0x7fad50146bd0 con 0x7fad500b3390 2023-12-17T11:49:18.867 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:18.863+0000 7fad4dffb640 1 -- 172.21.15.40:0/1497913759 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fad3c003520 con 0x7fad500b3390 2023-12-17T11:49:18.867 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:18.863+0000 7fad4dffb640 1 -- 172.21.15.40:0/1497913759 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 908457336 0 0) 0x7fad3c003520 con 0x7fad500b3390 2023-12-17T11:49:18.867 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:18.863+0000 7fad4dffb640 1 -- 172.21.15.40:0/1497913759 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fad5006ab70 msgr2=0x7fad50161ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:49:18.867 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:18.863+0000 7fad4dffb640 1 --2- 172.21.15.40:0/1497913759 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fad5006ab70 0x7fad50161ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:18.867 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:18.863+0000 7fad4dffb640 1 -- 172.21.15.40:0/1497913759 >> v2:172.21.15.159:3300/0 conn(0x7fad50162010 msgr2=0x7fad500cf810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:49:18.867 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:18.863+0000 7fad4dffb640 1 --2- 172.21.15.40:0/1497913759 >> v2:172.21.15.159:3300/0 conn(0x7fad50162010 0x7fad500cf810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:18.867 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:18.863+0000 7fad4dffb640 1 -- 172.21.15.40:0/1497913759 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad50162800 con 0x7fad500b3390 2023-12-17T11:49:18.867 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:18.863+0000 7fad4dffb640 1 -- 172.21.15.40:0/1497913759 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2643242555 0 0) 0x7fad400019f0 con 0x7fad500b3390 2023-12-17T11:49:18.867 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:18.863+0000 7fad4dffb640 1 -- 172.21.15.40:0/1497913759 >> v1:172.21.15.40:6789/0 conn(0x7fad500b3390 legacy=0x7fad5006a460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:18.868 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:18.863+0000 7fad4dffb640 1 --2- 172.21.15.40:0/1497913759 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fad3c003970 0x7fad3c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:18.868 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:18.863+0000 7fad4dffb640 1 --2- 172.21.15.40:0/1497913759 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fad3c0047c0 0x7fad3c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:18.868 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:18.863+0000 7fad4dffb640 1 --2- 172.21.15.40:0/1497913759 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fad5006ab70 0x7fad3c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:18.868 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:18.863+0000 7fad4dffb640 1 -- 172.21.15.40:0/1497913759 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad501448c0 con 0x7fad3c0047c0 2023-12-17T11:49:18.868 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:18.863+0000 7fad4dffb640 1 -- 172.21.15.40:0/1497913759 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad500b3770 con 0x7fad3c003970 2023-12-17T11:49:18.868 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:18.863+0000 7fad4dffb640 1 -- 172.21.15.40:0/1497913759 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad3c00b980 con 0x7fad5006ab70 2023-12-17T11:49:18.868 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:18.864+0000 7fad4e7fc640 1 --2- 172.21.15.40:0/1497913759 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fad3c0047c0 0x7fad3c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:18.868 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:18.864+0000 7fad4effd640 1 --2- 172.21.15.40:0/1497913759 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fad3c003970 0x7fad3c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:18.868 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:18.864+0000 7fad4e7fc640 1 -- 172.21.15.40:0/1497913759 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fad5006ab70 msgr2=0x7fad3c005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:49:18.868 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:18.864+0000 7fad4e7fc640 1 --2- 172.21.15.40:0/1497913759 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fad5006ab70 0x7fad3c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:18.868 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:18.864+0000 7fad4e7fc640 1 -- 172.21.15.40:0/1497913759 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fad3c003970 msgr2=0x7fad3c003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:49:18.868 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:18.864+0000 7fad4e7fc640 1 --2- 172.21.15.40:0/1497913759 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fad3c003970 0x7fad3c003d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:18.868 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:18.864+0000 7fad4e7fc640 1 -- 172.21.15.40:0/1497913759 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad3c003520 con 0x7fad3c0047c0 2023-12-17T11:49:18.869 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:18.865+0000 7fad4e7fc640 1 --2- 172.21.15.40:0/1497913759 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fad3c0047c0 0x7fad3c004c40 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fad38009af0 tx=0x7fad3c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=901fcf51f04b4315 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:49:18.870 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:18.866+0000 7fad4dffb640 1 -- 172.21.15.40:0/1497913759 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad3802c710 con 0x7fad3c0047c0 2023-12-17T11:49:18.870 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:18.866+0000 7fad4dffb640 1 -- 172.21.15.40:0/1497913759 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad3802c870 con 0x7fad3c0047c0 2023-12-17T11:49:18.870 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:18.866+0000 7fad4dffb640 1 -- 172.21.15.40:0/1497913759 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad3802cc00 con 0x7fad3c0047c0 2023-12-17T11:49:18.870 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:18.866+0000 7fad4ffff640 1 -- 172.21.15.40:0/1497913759 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fad3c0047c0 msgr2=0x7fad3c004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:18.870 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:18.866+0000 7fad4ffff640 1 --2- 172.21.15.40:0/1497913759 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fad3c0047c0 0x7fad3c004c40 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fad38009af0 tx=0x7fad3c0057f0 comp rx=0 tx=0).stop 2023-12-17T11:49:18.870 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:18.866+0000 7fad4f7fe640 1 -- 172.21.15.40:0/1497913759 reap_dead start 2023-12-17T11:49:18.870 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:18.866+0000 7fad4ffff640 1 -- 172.21.15.40:0/1497913759 shutdown_connections 2023-12-17T11:49:18.870 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:18.866+0000 7fad4ffff640 1 -- 172.21.15.40:0/1497913759 >> 172.21.15.40:0/1497913759 conn(0x7fad500b1840 msgr2=0x7fad500b1c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:49:18.870 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:18.866+0000 7fad4ffff640 1 -- 172.21.15.40:0/1497913759 shutdown_connections 2023-12-17T11:49:18.870 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:18.866+0000 7fad4ffff640 1 -- 172.21.15.40:0/1497913759 wait complete. 2023-12-17T11:49:18.872 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:18.868+0000 7fad4ffff640 1 Processor -- start 2023-12-17T11:49:18.872 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:18.868+0000 7fad4ffff640 1 -- start start 2023-12-17T11:49:18.872 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:18.869+0000 7fad4ffff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fad3c0047c0 0x7fad501eb810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:18.872 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:18.869+0000 7fad4ffff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fad501439b0 0x7fad501579a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:18.872 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:18.869+0000 7fad4ffff640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fad501f76d0 0x7fad50145e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:18.872 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:18.869+0000 7fad4ffff640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad501ece60 con 0x7fad501439b0 2023-12-17T11:49:18.872 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:18.869+0000 7fad4ffff640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad501ebd50 con 0x7fad3c0047c0 2023-12-17T11:49:18.872 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:18.869+0000 7fad4ffff640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad5015a8d0 con 0x7fad501f76d0 2023-12-17T11:49:18.873 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:18.870+0000 7fad4e7fc640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fad501439b0 0x7fad501579a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:18.873 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:18.870+0000 7fad4e7fc640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fad501439b0 0x7fad501579a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:48266/0 (socket says 172.21.15.40:48266) 2023-12-17T11:49:18.873 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:18.870+0000 7fad4e7fc640 1 -- 172.21.15.40:0/2004708492 learned_addr learned my addr 172.21.15.40:0/2004708492 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-17T11:49:18.873 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:18.870+0000 7fad4effd640 1 --2- 172.21.15.40:0/2004708492 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fad3c0047c0 0x7fad501eb810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:18.873 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:18.870+0000 7fad4f7fe640 1 --2- 172.21.15.40:0/2004708492 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fad501f76d0 0x7fad50145e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:18.873 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:18.870+0000 7fad4e7fc640 1 -- 172.21.15.40:0/2004708492 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fad501f76d0 msgr2=0x7fad50145e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:18.873 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:18.870+0000 7fad4e7fc640 1 --2- 172.21.15.40:0/2004708492 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fad501f76d0 0x7fad50145e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:18.873 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:18.870+0000 7fad4e7fc640 1 -- 172.21.15.40:0/2004708492 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fad3c0047c0 msgr2=0x7fad501eb810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:18.873 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:18.870+0000 7fad4e7fc640 1 --2- 172.21.15.40:0/2004708492 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fad3c0047c0 0x7fad501eb810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:18.873 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:18.870+0000 7fad4e7fc640 1 -- 172.21.15.40:0/2004708492 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad50157ee0 con 0x7fad501439b0 2023-12-17T11:49:18.873 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:18.870+0000 7fad4effd640 1 --2- 172.21.15.40:0/2004708492 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fad3c0047c0 0x7fad501eb810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-17T11:49:18.874 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:18.870+0000 7fad4e7fc640 1 --2- 172.21.15.40:0/2004708492 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fad501439b0 0x7fad501579a0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fad38037040 tx=0x7fad38004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:49:18.874 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:18.871+0000 7fad477fe640 1 -- 172.21.15.40:0/2004708492 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad38003810 con 0x7fad501439b0 2023-12-17T11:49:18.874 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:18.871+0000 7fad477fe640 1 -- 172.21.15.40:0/2004708492 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad3802de90 con 0x7fad501439b0 2023-12-17T11:49:18.874 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:18.871+0000 7fad477fe640 1 -- 172.21.15.40:0/2004708492 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad38003b70 con 0x7fad501439b0 2023-12-17T11:49:18.874 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:18.871+0000 7fad4ffff640 1 -- 172.21.15.40:0/2004708492 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad501ebf80 con 0x7fad501439b0 2023-12-17T11:49:18.875 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:18.871+0000 7fad4ffff640 1 -- 172.21.15.40:0/2004708492 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad5015a560 con 0x7fad501439b0 2023-12-17T11:49:18.875 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:18.872+0000 7fad4ffff640 1 -- 172.21.15.40:0/2004708492 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad500673f0 con 0x7fad501439b0 2023-12-17T11:49:18.875 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:18.873+0000 7fad477fe640 1 -- 172.21.15.40:0/2004708492 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fad38003cd0 con 0x7fad501439b0 2023-12-17T11:49:18.876 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:18.874+0000 7fad477fe640 1 --2- 172.21.15.40:0/2004708492 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7fad3006ae70 0x7fad3006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:18.876 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:18.874+0000 7fad477fe640 1 -- 172.21.15.40:0/2004708492 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6692+0+0 (secure 0 0 0) 0x7fad380ab870 con 0x7fad501439b0 2023-12-17T11:49:18.876 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:18.875+0000 7fad4effd640 1 --2- 172.21.15.40:0/2004708492 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7fad3006ae70 0x7fad3006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:18.878 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:18.876+0000 7fad4effd640 1 --2- 172.21.15.40:0/2004708492 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7fad3006ae70 0x7fad3006d330 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fad40007c40 tx=0x7fad40009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:49:18.880 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:18.879+0000 7fad477fe640 1 -- 172.21.15.40:0/2004708492 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fad380764a0 con 0x7fad501439b0 2023-12-17T11:49:19.145 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:19.143+0000 7fad4ffff640 1 -- 172.21.15.40:0/2004708492 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev.test_generic"]} v 0) v1 -- 0x7fad5015aa10 con 0x7fad501439b0 2023-12-17T11:49:19.779 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:19.777+0000 7fad477fe640 1 -- 172.21.15.40:0/2004708492 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev.test_generic"]}]=0 v81) v1 ==== 147+0+0 (secure 0 0 0) 0x7fad38079ac0 con 0x7fad501439b0 2023-12-17T11:49:19.784 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:19.781+0000 7fad4ffff640 1 -- 172.21.15.40:0/2004708492 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7fad3006ae70 msgr2=0x7fad3006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:19.784 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:19.781+0000 7fad4ffff640 1 --2- 172.21.15.40:0/2004708492 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7fad3006ae70 0x7fad3006d330 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fad40007c40 tx=0x7fad40009040 comp rx=0 tx=0).stop 2023-12-17T11:49:19.784 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:19.781+0000 7fad4ffff640 1 -- 172.21.15.40:0/2004708492 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fad501439b0 msgr2=0x7fad501579a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:19.784 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:19.781+0000 7fad4ffff640 1 --2- 172.21.15.40:0/2004708492 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fad501439b0 0x7fad501579a0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fad38037040 tx=0x7fad38004730 comp rx=0 tx=0).stop 2023-12-17T11:49:19.784 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:19.782+0000 7fad4ffff640 1 -- 172.21.15.40:0/2004708492 shutdown_connections 2023-12-17T11:49:19.784 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:19.782+0000 7fad4ffff640 1 --2- 172.21.15.40:0/2004708492 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7fad3006ae70 0x7fad3006d330 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:19.784 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:19.782+0000 7fad4ffff640 1 --2- 172.21.15.40:0/2004708492 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fad501f76d0 0x7fad50145e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:19.784 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:19.782+0000 7fad4ffff640 1 --2- 172.21.15.40:0/2004708492 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fad501439b0 0x7fad501579a0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:19.785 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:19.782+0000 7fad4ffff640 1 --2- 172.21.15.40:0/2004708492 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fad3c0047c0 0x7fad501eb810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:19.785 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:19.782+0000 7fad4ffff640 1 -- 172.21.15.40:0/2004708492 >> 172.21.15.40:0/2004708492 conn(0x7fad500b1840 msgr2=0x7fad50164960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:49:19.785 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:19.782+0000 7fad4ffff640 1 -- 172.21.15.40:0/2004708492 shutdown_connections 2023-12-17T11:49:19.785 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:19.782+0000 7fad4ffff640 1 -- 172.21.15.40:0/2004708492 wait complete. 2023-12-17T11:49:19.804 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-12-17T11:49:20.036 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:20.034+0000 7ff0623a5640 1 Processor -- start 2023-12-17T11:49:20.036 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:20.034+0000 7ff0623a5640 1 -- start start 2023-12-17T11:49:20.038 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:20.036+0000 7ff0623a5640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff05c1543f0 0x7ff05c15a590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:20.038 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:20.036+0000 7ff0623a5640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7ff05c1547d0 0x7ff05c070070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:20.039 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:20.036+0000 7ff0623a5640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff05c15ae30 con 0x7ff05c0b3810 2023-12-17T11:49:20.039 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:20.036+0000 7ff0623a5640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff05c15b110 con 0x7ff05c1543f0 2023-12-17T11:49:20.039 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:20.036+0000 7ff0623a5640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff05c15b3f0 con 0x7ff05c1547d0 2023-12-17T11:49:20.039 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:20.036+0000 7ff0613a3640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff05c1543f0 0x7ff05c15a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:20.039 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:20.036+0000 7ff0613a3640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff05c1543f0 0x7ff05c15a590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:48278/0 (socket says 172.21.15.40:48278) 2023-12-17T11:49:20.039 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:20.036+0000 7ff0613a3640 1 -- 172.21.15.40:0/3432448459 learned_addr learned my addr 172.21.15.40:0/3432448459 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-17T11:49:20.039 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:20.036+0000 7ff060ba2640 1 --2- 172.21.15.40:0/3432448459 >> v2:172.21.15.159:3300/0 conn(0x7ff05c1547d0 0x7ff05c070070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:20.039 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:20.036+0000 7ff0613a3640 1 -- 172.21.15.40:0/3432448459 >> v2:172.21.15.159:3300/0 conn(0x7ff05c1547d0 msgr2=0x7ff05c070070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:49:20.039 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:20.037+0000 7ff0613a3640 1 --2- 172.21.15.40:0/3432448459 >> v2:172.21.15.159:3300/0 conn(0x7ff05c1547d0 0x7ff05c070070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:20.039 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:20.037+0000 7ff0613a3640 1 -- 172.21.15.40:0/3432448459 >> v1:172.21.15.159:6789/0 conn(0x7ff05c0b3810 legacy=0x7ff05c0cedf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:49:20.039 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:20.037+0000 7ff0613a3640 1 -- 172.21.15.40:0/3432448459 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff05c0aca50 con 0x7ff05c1543f0 2023-12-17T11:49:20.039 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:20.037+0000 7ff060ba2640 1 --2- 172.21.15.40:0/3432448459 >> v2:172.21.15.159:3300/0 conn(0x7ff05c1547d0 0x7ff05c070070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-17T11:49:20.040 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:20.038+0000 7ff0613a3640 1 --2- 172.21.15.40:0/3432448459 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff05c1543f0 0x7ff05c15a590 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7ff05c0cf9b0 tx=0x7ff05802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6385892d99cd9dfb server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:49:20.040 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:20.038+0000 7ff053fff640 1 -- 172.21.15.40:0/3432448459 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff058031870 con 0x7ff05c1543f0 2023-12-17T11:49:20.040 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:20.038+0000 7ff053fff640 1 -- 172.21.15.40:0/3432448459 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0580319d0 con 0x7ff05c1543f0 2023-12-17T11:49:20.040 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:20.038+0000 7ff053fff640 1 -- 172.21.15.40:0/3432448459 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff058031d60 con 0x7ff05c1543f0 2023-12-17T11:49:20.040 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:20.039+0000 7ff0623a5640 1 -- 172.21.15.40:0/3432448459 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff05c1543f0 msgr2=0x7ff05c15a590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:20.041 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:20.039+0000 7ff0623a5640 1 --2- 172.21.15.40:0/3432448459 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff05c1543f0 0x7ff05c15a590 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7ff05c0cf9b0 tx=0x7ff05802b910 comp rx=0 tx=0).stop 2023-12-17T11:49:20.041 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:20.039+0000 7ff0623a5640 1 -- 172.21.15.40:0/3432448459 shutdown_connections 2023-12-17T11:49:20.041 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:20.039+0000 7ff0623a5640 1 --2- 172.21.15.40:0/3432448459 >> v2:172.21.15.159:3300/0 conn(0x7ff05c1547d0 0x7ff05c070070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:20.041 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:20.039+0000 7ff0623a5640 1 --2- 172.21.15.40:0/3432448459 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff05c1543f0 0x7ff05c15a590 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:20.041 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:20.039+0000 7ff0623a5640 1 -- 172.21.15.40:0/3432448459 >> 172.21.15.40:0/3432448459 conn(0x7ff05c06a640 msgr2=0x7ff05c06aa50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:49:20.042 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:20.039+0000 7ff0623a5640 1 -- 172.21.15.40:0/3432448459 shutdown_connections 2023-12-17T11:49:20.042 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:20.039+0000 7ff0623a5640 1 -- 172.21.15.40:0/3432448459 wait complete. 2023-12-17T11:49:20.043 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:20.041+0000 7ff0623a5640 1 Processor -- start 2023-12-17T11:49:20.043 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:20.041+0000 7ff0623a5640 1 -- start start 2023-12-17T11:49:20.045 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:20.042+0000 7ff0623a5640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff05c0b3810 0x7ff05c1498e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:20.045 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:20.042+0000 7ff0623a5640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff05c1543f0 0x7ff05c15c9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:20.045 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:20.042+0000 7ff0623a5640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff05c1547d0 0x7ff05c157360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:20.046 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:20.042+0000 7ff0623a5640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff05c15b730 con 0x7ff05c0b3810 2023-12-17T11:49:20.046 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:20.042+0000 7ff0623a5640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff05c15c550 con 0x7ff05c1543f0 2023-12-17T11:49:20.046 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:20.042+0000 7ff0623a5640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff05c15b940 con 0x7ff05c1547d0 2023-12-17T11:49:20.046 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:20.043+0000 7ff0613a3640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff05c0b3810 0x7ff05c1498e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:20.046 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:20.043+0000 7ff0613a3640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff05c0b3810 0x7ff05c1498e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:48290/0 (socket says 172.21.15.40:48290) 2023-12-17T11:49:20.046 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:20.043+0000 7ff0613a3640 1 -- 172.21.15.40:0/3250698250 learned_addr learned my addr 172.21.15.40:0/3250698250 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-17T11:49:20.046 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:20.043+0000 7ff060ba2640 1 --2- 172.21.15.40:0/3250698250 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff05c1543f0 0x7ff05c15c9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:20.046 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:20.043+0000 7ff061ba4640 1 --2- 172.21.15.40:0/3250698250 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff05c1547d0 0x7ff05c157360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:20.046 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:20.043+0000 7ff0613a3640 1 -- 172.21.15.40:0/3250698250 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff05c1547d0 msgr2=0x7ff05c157360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:20.046 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:20.043+0000 7ff0613a3640 1 --2- 172.21.15.40:0/3250698250 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff05c1547d0 0x7ff05c157360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:20.046 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:20.043+0000 7ff0613a3640 1 -- 172.21.15.40:0/3250698250 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff05c1543f0 msgr2=0x7ff05c15c9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:20.046 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:20.043+0000 7ff0613a3640 1 --2- 172.21.15.40:0/3250698250 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff05c1543f0 0x7ff05c15c9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:20.046 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:20.043+0000 7ff0613a3640 1 -- 172.21.15.40:0/3250698250 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0580094d0 con 0x7ff05c0b3810 2023-12-17T11:49:20.047 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:20.043+0000 7ff0613a3640 1 --2- 172.21.15.40:0/3250698250 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff05c0b3810 0x7ff05c1498e0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7ff058000c00 tx=0x7ff0580046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:49:20.047 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:20.044+0000 7ff051ffb640 1 -- 172.21.15.40:0/3250698250 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff058031840 con 0x7ff05c0b3810 2023-12-17T11:49:20.048 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:20.044+0000 7ff051ffb640 1 -- 172.21.15.40:0/3250698250 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0580443f0 con 0x7ff05c0b3810 2023-12-17T11:49:20.048 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:20.044+0000 7ff051ffb640 1 -- 172.21.15.40:0/3250698250 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0580447a0 con 0x7ff05c0b3810 2023-12-17T11:49:20.048 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:20.044+0000 7ff0623a5640 1 -- 172.21.15.40:0/3250698250 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff05c15bc20 con 0x7ff05c0b3810 2023-12-17T11:49:20.048 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:20.044+0000 7ff0623a5640 1 -- 172.21.15.40:0/3250698250 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff05c15c1e0 con 0x7ff05c0b3810 2023-12-17T11:49:20.048 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:20.045+0000 7ff0623a5640 1 -- 172.21.15.40:0/3250698250 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff05c074450 con 0x7ff05c0b3810 2023-12-17T11:49:20.048 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:20.046+0000 7ff051ffb640 1 -- 172.21.15.40:0/3250698250 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ff05804d450 con 0x7ff05c0b3810 2023-12-17T11:49:20.049 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:20.047+0000 7ff051ffb640 1 --2- 172.21.15.40:0/3250698250 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7ff04006ae40 0x7ff04006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:20.049 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:20.047+0000 7ff051ffb640 1 -- 172.21.15.40:0/3250698250 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6692+0+0 (secure 0 0 0) 0x7ff05802d040 con 0x7ff05c0b3810 2023-12-17T11:49:20.049 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:20.048+0000 7ff060ba2640 1 --2- 172.21.15.40:0/3250698250 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7ff04006ae40 0x7ff04006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:20.051 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:20.049+0000 7ff060ba2640 1 --2- 172.21.15.40:0/3250698250 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7ff04006ae40 0x7ff04006d300 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7ff05c154ee0 tx=0x7ff04c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:49:20.053 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:20.051+0000 7ff051ffb640 1 -- 172.21.15.40:0/3250698250 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7ff058076ec0 con 0x7ff05c0b3810 2023-12-17T11:49:20.253 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:20.251+0000 7ff0623a5640 1 -- 172.21.15.40:0/3250698250 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7ff05c09ca20 con 0x7ff05c0b3810 2023-12-17T11:49:20.261 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:20.257+0000 7ff051ffb640 1 -- 172.21.15.40:0/3250698250 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) v1 ==== 122+0+0 (secure 0 0 0) 0x7ff05807a4e0 con 0x7ff05c0b3810 2023-12-17T11:49:20.262 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:20.260+0000 7ff0623a5640 1 -- 172.21.15.40:0/3250698250 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7ff04006ae40 msgr2=0x7ff04006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:20.263 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:20.260+0000 7ff0623a5640 1 --2- 172.21.15.40:0/3250698250 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7ff04006ae40 0x7ff04006d300 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7ff05c154ee0 tx=0x7ff04c008040 comp rx=0 tx=0).stop 2023-12-17T11:49:20.263 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:20.260+0000 7ff0623a5640 1 -- 172.21.15.40:0/3250698250 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff05c0b3810 msgr2=0x7ff05c1498e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:20.263 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:20.260+0000 7ff0623a5640 1 --2- 172.21.15.40:0/3250698250 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff05c0b3810 0x7ff05c1498e0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7ff058000c00 tx=0x7ff0580046c0 comp rx=0 tx=0).stop 2023-12-17T11:49:20.263 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:20.260+0000 7ff0623a5640 1 -- 172.21.15.40:0/3250698250 shutdown_connections 2023-12-17T11:49:20.263 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:20.260+0000 7ff0623a5640 1 --2- 172.21.15.40:0/3250698250 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7ff04006ae40 0x7ff04006d300 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:20.263 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:20.260+0000 7ff0623a5640 1 --2- 172.21.15.40:0/3250698250 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff05c1547d0 0x7ff05c157360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:20.263 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:20.260+0000 7ff0623a5640 1 --2- 172.21.15.40:0/3250698250 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff05c1543f0 0x7ff05c15c9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:20.263 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:20.260+0000 7ff0623a5640 1 --2- 172.21.15.40:0/3250698250 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff05c0b3810 0x7ff05c1498e0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:20.263 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:20.260+0000 7ff0623a5640 1 -- 172.21.15.40:0/3250698250 >> 172.21.15.40:0/3250698250 conn(0x7ff05c06a640 msgr2=0x7ff05c0cedc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:49:20.263 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:20.260+0000 7ff0623a5640 1 -- 172.21.15.40:0/3250698250 shutdown_connections 2023-12-17T11:49:20.263 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:20.261+0000 7ff0623a5640 1 -- 172.21.15.40:0/3250698250 wait complete. 2023-12-17T11:49:20.283 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-12-17T11:49:20.283 DEBUG:teuthology.orchestra.run.smithi040:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-17T11:49:20.414 DEBUG:teuthology.orchestra.run.smithi159:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-17T11:49:20.549 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-12-17T11:49:20.549 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2023-12-17T11:49:20.549 DEBUG:teuthology.orchestra.run.smithi040:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-17T11:49:20.613 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2023-12-17T11:49:20.614 DEBUG:teuthology.orchestra.run.smithi040:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-17T11:49:20.671 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2023-12-17T11:49:20.671 DEBUG:teuthology.orchestra.run.smithi040:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-17T11:49:20.727 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-17T11:49:20.957 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:20.955+0000 7f86a65b5640 1 Processor -- start 2023-12-17T11:49:20.957 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:20.955+0000 7f86a65b5640 1 -- start start 2023-12-17T11:49:20.959 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:20.956+0000 7f86a65b5640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f86a0160810 0x7f86a00c6a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:20.959 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:20.956+0000 7f86a65b5640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f86a00c6fa0 0x7f86a00c7420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:20.959 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:20.956+0000 7f86a65b5640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86a00d3a30 con 0x7f86a00d0f70 2023-12-17T11:49:20.959 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:20.956+0000 7f86a65b5640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86a00cef40 con 0x7f86a00c6fa0 2023-12-17T11:49:20.959 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:20.956+0000 7f86a65b5640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86a00b3d10 con 0x7f86a0160810 2023-12-17T11:49:20.959 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:20.957+0000 7f86a4db2640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f86a00c6fa0 0x7f86a00c7420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:20.959 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:20.957+0000 7f86a4db2640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f86a00c6fa0 0x7f86a00c7420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:48306/0 (socket says 172.21.15.40:48306) 2023-12-17T11:49:20.959 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:20.957+0000 7f86a4db2640 1 -- 172.21.15.40:0/2100425343 learned_addr learned my addr 172.21.15.40:0/2100425343 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-17T11:49:20.959 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:20.957+0000 7f86a55b3640 1 --2- 172.21.15.40:0/2100425343 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f86a0160810 0x7f86a00c6a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:20.960 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:20.957+0000 7f86a4db2640 1 -- 172.21.15.40:0/2100425343 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f86a0160810 msgr2=0x7f86a00c6a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:49:20.960 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:20.957+0000 7f86a4db2640 1 --2- 172.21.15.40:0/2100425343 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f86a0160810 0x7f86a00c6a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:20.960 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:20.957+0000 7f86a4db2640 1 -- 172.21.15.40:0/2100425343 >> v1:172.21.15.159:6789/0 conn(0x7f86a00d0f70 legacy=0x7f86a00d1400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:49:20.960 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:20.957+0000 7f86a4db2640 1 -- 172.21.15.40:0/2100425343 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86a00d0ae0 con 0x7f86a00c6fa0 2023-12-17T11:49:20.960 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:20.958+0000 7f86a4db2640 1 --2- 172.21.15.40:0/2100425343 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f86a00c6fa0 0x7f86a00c7420 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f86940098d0 tx=0x7f869402b7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=edae6afd752e6bb7 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:49:20.960 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:20.958+0000 7f869ffff640 1 -- 172.21.15.40:0/2100425343 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8694031710 con 0x7f86a00c6fa0 2023-12-17T11:49:20.960 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:20.958+0000 7f869ffff640 1 -- 172.21.15.40:0/2100425343 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f869402f050 con 0x7f86a00c6fa0 2023-12-17T11:49:20.961 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:20.958+0000 7f869ffff640 1 -- 172.21.15.40:0/2100425343 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8694031a90 con 0x7f86a00c6fa0 2023-12-17T11:49:20.961 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:20.959+0000 7f86a65b5640 1 -- 172.21.15.40:0/2100425343 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f86a00c6fa0 msgr2=0x7f86a00c7420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:20.961 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:20.959+0000 7f86a65b5640 1 --2- 172.21.15.40:0/2100425343 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f86a00c6fa0 0x7f86a00c7420 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f86940098d0 tx=0x7f869402b7b0 comp rx=0 tx=0).stop 2023-12-17T11:49:20.961 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:20.959+0000 7f86a65b5640 1 -- 172.21.15.40:0/2100425343 shutdown_connections 2023-12-17T11:49:20.962 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:20.959+0000 7f86a65b5640 1 --2- 172.21.15.40:0/2100425343 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f86a00c6fa0 0x7f86a00c7420 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:20.962 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:20.959+0000 7f86a65b5640 1 --2- 172.21.15.40:0/2100425343 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f86a0160810 0x7f86a00c6a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:20.962 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:20.959+0000 7f86a65b5640 1 -- 172.21.15.40:0/2100425343 >> 172.21.15.40:0/2100425343 conn(0x7f86a00d2f10 msgr2=0x7f86a00d3320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:49:20.962 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:20.959+0000 7f86a65b5640 1 -- 172.21.15.40:0/2100425343 shutdown_connections 2023-12-17T11:49:20.962 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:20.959+0000 7f86a65b5640 1 -- 172.21.15.40:0/2100425343 wait complete. 2023-12-17T11:49:20.963 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:20.961+0000 7f86a65b5640 1 Processor -- start 2023-12-17T11:49:20.963 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:20.961+0000 7f86a65b5640 1 -- start start 2023-12-17T11:49:20.966 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:20.962+0000 7f86a65b5640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f86a00c6fa0 0x7f86a0151640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:20.966 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:20.962+0000 7f86a65b5640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f86a00d0f70 0x7f86a00b5b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:20.966 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:20.962+0000 7f86a65b5640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f86a0160810 0x7f86a00cb970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:20.966 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:20.962+0000 7f86a65b5640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86a00b7100 con 0x7f86a00c6fa0 2023-12-17T11:49:20.966 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:20.962+0000 7f86a65b5640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86a00b7520 con 0x7f86a00d0f70 2023-12-17T11:49:20.967 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:20.962+0000 7f86a65b5640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86a00b6480 con 0x7f86a0160810 2023-12-17T11:49:20.967 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:20.962+0000 7f86a55b3640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f86a00c6fa0 0x7f86a0151640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:20.967 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:20.962+0000 7f86a55b3640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f86a00c6fa0 0x7f86a0151640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:48314/0 (socket says 172.21.15.40:48314) 2023-12-17T11:49:20.967 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:20.962+0000 7f86a55b3640 1 -- 172.21.15.40:0/1669265271 learned_addr learned my addr 172.21.15.40:0/1669265271 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-17T11:49:20.967 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:20.963+0000 7f86a4db2640 1 --2- 172.21.15.40:0/1669265271 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f86a00d0f70 0x7f86a00b5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:20.967 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:20.963+0000 7f86a5db4640 1 --2- 172.21.15.40:0/1669265271 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f86a0160810 0x7f86a00cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:20.967 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:20.963+0000 7f86a55b3640 1 -- 172.21.15.40:0/1669265271 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f86a0160810 msgr2=0x7f86a00cb970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:20.967 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:20.963+0000 7f86a55b3640 1 --2- 172.21.15.40:0/1669265271 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f86a0160810 0x7f86a00cb970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:20.967 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:20.963+0000 7f86a55b3640 1 -- 172.21.15.40:0/1669265271 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f86a00d0f70 msgr2=0x7f86a00b5b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:20.967 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:20.963+0000 7f86a55b3640 1 --2- 172.21.15.40:0/1669265271 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f86a00d0f70 0x7f86a00b5b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:20.967 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:20.963+0000 7f86a55b3640 1 -- 172.21.15.40:0/1669265271 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86940094d0 con 0x7f86a00c6fa0 2023-12-17T11:49:20.967 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:20.963+0000 7f86a55b3640 1 --2- 172.21.15.40:0/1669265271 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f86a00c6fa0 0x7f86a0151640 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f8690007ef0 tx=0x7f869000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:49:20.967 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:20.964+0000 7f869dffb640 1 -- 172.21.15.40:0/1669265271 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8690014620 con 0x7f86a00c6fa0 2023-12-17T11:49:20.967 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:20.964+0000 7f869dffb640 1 -- 172.21.15.40:0/1669265271 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8690014780 con 0x7f86a00c6fa0 2023-12-17T11:49:20.968 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:20.964+0000 7f869dffb640 1 -- 172.21.15.40:0/1669265271 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8690014b30 con 0x7f86a00c6fa0 2023-12-17T11:49:20.968 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:20.964+0000 7f86a65b5640 1 -- 172.21.15.40:0/1669265271 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86a00b6760 con 0x7f86a00c6fa0 2023-12-17T11:49:20.968 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:20.964+0000 7f86a65b5640 1 -- 172.21.15.40:0/1669265271 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86a00b6d20 con 0x7f86a00c6fa0 2023-12-17T11:49:20.968 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:20.965+0000 7f86a65b5640 1 -- 172.21.15.40:0/1669265271 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86a00b7370 con 0x7f86a00c6fa0 2023-12-17T11:49:20.968 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:20.966+0000 7f869dffb640 1 -- 172.21.15.40:0/1669265271 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f8690014c90 con 0x7f86a00c6fa0 2023-12-17T11:49:20.969 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:20.967+0000 7f869dffb640 1 --2- 172.21.15.40:0/1669265271 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f868c06ae70 0x7f868c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:20.969 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:20.967+0000 7f869dffb640 1 -- 172.21.15.40:0/1669265271 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f869008a420 con 0x7f86a00c6fa0 2023-12-17T11:49:20.969 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:20.968+0000 7f86a4db2640 1 --2- 172.21.15.40:0/1669265271 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f868c06ae70 0x7f868c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:20.970 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:20.969+0000 7f86a4db2640 1 --2- 172.21.15.40:0/1669265271 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f868c06ae70 0x7f868c06d330 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f8694035000 tx=0x7f8694008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:49:20.973 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:20.971+0000 7f869dffb640 1 -- 172.21.15.40:0/1669265271 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f86900550e0 con 0x7f86a00c6fa0 2023-12-17T11:49:21.168 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:21.166+0000 7f86a65b5640 1 -- 172.21.15.40:0/1669265271 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f86a00673f0 con 0x7f86a00c6fa0 2023-12-17T11:49:21.171 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:21.169+0000 7f869dffb640 1 -- 172.21.15.40:0/1669265271 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+18697 (secure 0 0 0) 0x7f8690058700 con 0x7f86a00c6fa0 2023-12-17T11:49:21.172 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T11:49:21.172 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":27,"fsid":"099cd35d-80d9-4ca4-8424-de13b3b03ac7","created":"2023-12-17T11:47:53.450097+0000","modified":"2023-12-17T11:49:00.483840+0000","last_up_change":"2023-12-17T11:48:05.724195+0000","last_in_change":"2023-12-17T11:47:56.956499+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-17T11:48:06.668943+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-17T11:48:16.151444+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-17T11:48:16.717726+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-17T11:48:20.534819+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a88bfd46-63b8-48b1-9c0e-5c9cdc31bd38","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":555204741},{"type":"v1","addr":"172.21.15.40:6802","nonce":555204741}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":555204741},{"type":"v1","addr":"172.21.15.40:6807","nonce":555204741}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":555204741},{"type":"v1","addr":"172.21.15.40:6815","nonce":555204741}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6809","nonce":555204741},{"type":"v1","addr":"172.21.15.40:6812","nonce":555204741}]},"public_addr":"172.21.15.40:6802/555204741","cluster_addr":"172.21.15.40:6807/555204741","heartbeat_back_addr":"172.21.15.40:6815/555204741","heartbeat_front_addr":"172.21.15.40:6812/555204741","state":["exists","up"]},{"osd":1,"uuid":"c5d628ae-36f4-4866-802c-b162f0e90add","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6801","nonce":1221318112},{"type":"v1","addr":"172.21.15.40:6803","nonce":1221318112}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6805","nonce":1221318112},{"type":"v1","addr":"172.21.15.40:6806","nonce":1221318112}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6811","nonce":1221318112},{"type":"v1","addr":"172.21.15.40:6813","nonce":1221318112}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":1221318112},{"type":"v1","addr":"172.21.15.40:6810","nonce":1221318112}]},"public_addr":"172.21.15.40:6803/1221318112","cluster_addr":"172.21.15.40:6806/1221318112","heartbeat_back_addr":"172.21.15.40:6813/1221318112","heartbeat_front_addr":"172.21.15.40:6810/1221318112","state":["exists","up"]},{"osd":2,"uuid":"d986ad6a-af2f-47fc-9c3b-fbda27b82b73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":1959000265},{"type":"v1","addr":"172.21.15.40:6817","nonce":1959000265}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6818","nonce":1959000265},{"type":"v1","addr":"172.21.15.40:6819","nonce":1959000265}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":1959000265},{"type":"v1","addr":"172.21.15.40:6827","nonce":1959000265}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":1959000265},{"type":"v1","addr":"172.21.15.40:6822","nonce":1959000265}]},"public_addr":"172.21.15.40:6817/1959000265","cluster_addr":"172.21.15.40:6819/1959000265","heartbeat_back_addr":"172.21.15.40:6827/1959000265","heartbeat_front_addr":"172.21.15.40:6822/1959000265","state":["exists","up"]},{"osd":3,"uuid":"d79d22b7-be05-41b2-b95d-697db677fd02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6821","nonce":974040287},{"type":"v1","addr":"172.21.15.40:6823","nonce":974040287}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6825","nonce":974040287},{"type":"v1","addr":"172.21.15.40:6826","nonce":974040287}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":974040287},{"type":"v1","addr":"172.21.15.40:6831","nonce":974040287}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":974040287},{"type":"v1","addr":"172.21.15.40:6829","nonce":974040287}]},"public_addr":"172.21.15.40:6823/974040287","cluster_addr":"172.21.15.40:6826/974040287","heartbeat_back_addr":"172.21.15.40:6831/974040287","heartbeat_front_addr":"172.21.15.40:6829/974040287","state":["exists","up"]},{"osd":4,"uuid":"62a7a233-d3ea-40be-91de-180c0208d639","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6808","nonce":3937787733},{"type":"v1","addr":"172.21.15.159:6809","nonce":3937787733}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6810","nonce":3937787733},{"type":"v1","addr":"172.21.15.159:6811","nonce":3937787733}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6814","nonce":3937787733},{"type":"v1","addr":"172.21.15.159:6815","nonce":3937787733}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6812","nonce":3937787733},{"type":"v1","addr":"172.21.15.159:6813","nonce":3937787733}]},"public_addr":"172.21.15.159:6809/3937787733","cluster_addr":"172.21.15.159:6811/3937787733","heartbeat_back_addr":"172.21.15.159:6815/3937787733","heartbeat_front_addr":"172.21.15.159:6813/3937787733","state":["exists","up"]},{"osd":5,"uuid":"84629cea-dc0e-4b5e-b203-5ea963839281","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6816","nonce":3032505240},{"type":"v1","addr":"172.21.15.159:6817","nonce":3032505240}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6818","nonce":3032505240},{"type":"v1","addr":"172.21.15.159:6819","nonce":3032505240}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6822","nonce":3032505240},{"type":"v1","addr":"172.21.15.159:6823","nonce":3032505240}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6820","nonce":3032505240},{"type":"v1","addr":"172.21.15.159:6821","nonce":3032505240}]},"public_addr":"172.21.15.159:6817/3032505240","cluster_addr":"172.21.15.159:6819/3032505240","heartbeat_back_addr":"172.21.15.159:6823/3032505240","heartbeat_front_addr":"172.21.15.159:6821/3032505240","state":["exists","up"]},{"osd":6,"uuid":"4ae3af3a-1743-4070-a91d-8be5c31cdb04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6800","nonce":2411788597},{"type":"v1","addr":"172.21.15.159:6801","nonce":2411788597}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6802","nonce":2411788597},{"type":"v1","addr":"172.21.15.159:6803","nonce":2411788597}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6806","nonce":2411788597},{"type":"v1","addr":"172.21.15.159:6807","nonce":2411788597}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6804","nonce":2411788597},{"type":"v1","addr":"172.21.15.159:6805","nonce":2411788597}]},"public_addr":"172.21.15.159:6801/2411788597","cluster_addr":"172.21.15.159:6803/2411788597","heartbeat_back_addr":"172.21.15.159:6807/2411788597","heartbeat_front_addr":"172.21.15.159:6805/2411788597","state":["exists","up"]},{"osd":7,"uuid":"c1f4c7f2-8f75-4f95-bc63-a332773e3b8e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6824","nonce":478953349},{"type":"v1","addr":"172.21.15.159:6825","nonce":478953349}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6826","nonce":478953349},{"type":"v1","addr":"172.21.15.159:6827","nonce":478953349}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6830","nonce":478953349},{"type":"v1","addr":"172.21.15.159:6831","nonce":478953349}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6828","nonce":478953349},{"type":"v1","addr":"172.21.15.159:6829","nonce":478953349}]},"public_addr":"172.21.15.159:6825/478953349","cluster_addr":"172.21.15.159:6827/478953349","heartbeat_back_addr":"172.21.15.159:6831/478953349","heartbeat_front_addr":"172.21.15.159:6829/478953349","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T11:48:02.023567+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T11:48:02.278216+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T11:48:02.311843+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T11:48:01.773372+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T11:48:02.618910+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T11:48:02.361559+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T11:48:02.223997+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T11:48:02.604403+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.2","mappings":[{"from":3,"to":2}]},{"pgid":"3.d","mappings":[{"from":5,"to":1}]},{"pgid":"3.13","mappings":[{"from":7,"to":2}]},{"pgid":"3.17","mappings":[{"from":0,"to":2}]},{"pgid":"3.38","mappings":[{"from":5,"to":1}]},{"pgid":"4.2","mappings":[{"from":1,"to":2}]},{"pgid":"4.10","mappings":[{"from":1,"to":2}]},{"pgid":"4.18","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-17T11:49:21.174 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:21.172+0000 7f86a65b5640 1 -- 172.21.15.40:0/1669265271 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f868c06ae70 msgr2=0x7f868c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:21.174 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:21.172+0000 7f86a65b5640 1 --2- 172.21.15.40:0/1669265271 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f868c06ae70 0x7f868c06d330 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f8694035000 tx=0x7f8694008030 comp rx=0 tx=0).stop 2023-12-17T11:49:21.174 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:21.172+0000 7f86a65b5640 1 -- 172.21.15.40:0/1669265271 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f86a00c6fa0 msgr2=0x7f86a0151640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:21.174 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:21.172+0000 7f86a65b5640 1 --2- 172.21.15.40:0/1669265271 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f86a00c6fa0 0x7f86a0151640 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f8690007ef0 tx=0x7f869000e4b0 comp rx=0 tx=0).stop 2023-12-17T11:49:21.174 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:21.172+0000 7f86a65b5640 1 -- 172.21.15.40:0/1669265271 shutdown_connections 2023-12-17T11:49:21.175 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:21.172+0000 7f86a65b5640 1 --2- 172.21.15.40:0/1669265271 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f868c06ae70 0x7f868c06d330 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:21.175 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:21.172+0000 7f86a65b5640 1 --2- 172.21.15.40:0/1669265271 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f86a0160810 0x7f86a00cb970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:21.175 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:21.172+0000 7f86a65b5640 1 --2- 172.21.15.40:0/1669265271 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f86a00d0f70 0x7f86a00b5b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:21.175 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:21.172+0000 7f86a65b5640 1 --2- 172.21.15.40:0/1669265271 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f86a00c6fa0 0x7f86a0151640 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:21.175 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:21.172+0000 7f86a65b5640 1 -- 172.21.15.40:0/1669265271 >> 172.21.15.40:0/1669265271 conn(0x7f86a00d2f10 msgr2=0x7f86a00ce300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:49:21.175 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:21.172+0000 7f86a65b5640 1 -- 172.21.15.40:0/1669265271 shutdown_connections 2023-12-17T11:49:21.175 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:21.172+0000 7f86a65b5640 1 -- 172.21.15.40:0/1669265271 wait complete. 2023-12-17T11:49:21.194 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-17T11:48:06.668943+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-17T11:48:16.151444+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-17T11:48:16.717726+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-12-17T11:48:20.534819+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-12-17T11:49:21.194 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-17T11:49:21.433 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:21.431+0000 7f497ea31640 1 Processor -- start 2023-12-17T11:49:21.433 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:21.431+0000 7f497ea31640 1 -- start start 2023-12-17T11:49:21.435 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:21.432+0000 7f497ea31640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f4978160b40 0x7f49780b46a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:21.435 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:21.432+0000 7f497ea31640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f49780b35a0 0x7f49780cddb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:21.435 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:21.433+0000 7f497ea31640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49780d0af0 con 0x7f49780b2a50 2023-12-17T11:49:21.435 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:21.433+0000 7f497ea31640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49780b3a30 con 0x7f49780b35a0 2023-12-17T11:49:21.435 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:21.433+0000 7f497ea31640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4978160f20 con 0x7f4978160b40 2023-12-17T11:49:21.435 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:21.433+0000 7f497cfce640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f49780b35a0 0x7f49780cddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:21.435 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:21.433+0000 7f497cfce640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f49780b35a0 0x7f49780cddb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:48316/0 (socket says 172.21.15.40:48316) 2023-12-17T11:49:21.435 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:21.433+0000 7f497cfce640 1 -- 172.21.15.40:0/2767001984 learned_addr learned my addr 172.21.15.40:0/2767001984 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-17T11:49:21.435 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:21.433+0000 7f4977fff640 1 --2- 172.21.15.40:0/2767001984 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f4978160b40 0x7f49780b46a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:21.436 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:21.434+0000 7f497cfce640 1 -- 172.21.15.40:0/2767001984 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f4978160b40 msgr2=0x7f49780b46a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:49:21.436 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:21.434+0000 7f497cfce640 1 --2- 172.21.15.40:0/2767001984 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f4978160b40 0x7f49780b46a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:21.436 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:21.434+0000 7f497cfce640 1 -- 172.21.15.40:0/2767001984 >> v1:172.21.15.159:6789/0 conn(0x7f49780b2a50 legacy=0x7f49780b2e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:49:21.436 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:21.434+0000 7f497cfce640 1 -- 172.21.15.40:0/2767001984 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49780d1520 con 0x7f49780b35a0 2023-12-17T11:49:21.437 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:21.435+0000 7f497cfce640 1 --2- 172.21.15.40:0/2767001984 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f49780b35a0 0x7f49780cddb0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f4970009870 tx=0x7f497002b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff4deb85ac0f7ec0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:49:21.437 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:21.435+0000 7f4976ffd640 1 -- 172.21.15.40:0/2767001984 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4970031640 con 0x7f49780b35a0 2023-12-17T11:49:21.437 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:21.435+0000 7f4976ffd640 1 -- 172.21.15.40:0/2767001984 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49700317a0 con 0x7f49780b35a0 2023-12-17T11:49:21.437 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:21.435+0000 7f4976ffd640 1 -- 172.21.15.40:0/2767001984 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4970031b30 con 0x7f49780b35a0 2023-12-17T11:49:21.437 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:21.436+0000 7f497ea31640 1 -- 172.21.15.40:0/2767001984 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f49780b35a0 msgr2=0x7f49780cddb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:21.437 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:21.436+0000 7f497ea31640 1 --2- 172.21.15.40:0/2767001984 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f49780b35a0 0x7f49780cddb0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f4970009870 tx=0x7f497002b8f0 comp rx=0 tx=0).stop 2023-12-17T11:49:21.438 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:21.436+0000 7f497ea31640 1 -- 172.21.15.40:0/2767001984 shutdown_connections 2023-12-17T11:49:21.438 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:21.436+0000 7f497ea31640 1 --2- 172.21.15.40:0/2767001984 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f49780b35a0 0x7f49780cddb0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:21.438 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:21.436+0000 7f497ea31640 1 --2- 172.21.15.40:0/2767001984 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f4978160b40 0x7f49780b46a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:21.438 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:21.436+0000 7f497ea31640 1 -- 172.21.15.40:0/2767001984 >> 172.21.15.40:0/2767001984 conn(0x7f497809c420 msgr2=0x7f49780d30f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:49:21.438 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:21.436+0000 7f497ea31640 1 -- 172.21.15.40:0/2767001984 shutdown_connections 2023-12-17T11:49:21.438 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:21.436+0000 7f497ea31640 1 -- 172.21.15.40:0/2767001984 wait complete. 2023-12-17T11:49:21.440 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:21.438+0000 7f497ea31640 1 Processor -- start 2023-12-17T11:49:21.440 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:21.439+0000 7f497ea31640 1 -- start start 2023-12-17T11:49:21.442 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:21.440+0000 7f497ea31640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f49780b2a50 0x7f49780b5ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:21.442 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:21.440+0000 7f497ea31640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f49780b35a0 0x7f4978157a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:21.442 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:21.440+0000 7f497ea31640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4978160b40 0x7f49780cc640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:21.442 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:21.440+0000 7f497ea31640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49780ca250 con 0x7f49780b35a0 2023-12-17T11:49:21.443 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:21.440+0000 7f497ea31640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4978158af0 con 0x7f4978160b40 2023-12-17T11:49:21.443 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:21.440+0000 7f497ea31640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49780b63e0 con 0x7f49780b2a50 2023-12-17T11:49:21.443 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:21.440+0000 7f49777fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f49780b35a0 0x7f4978157a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:21.443 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:21.440+0000 7f49777fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f49780b35a0 0x7f4978157a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:48332/0 (socket says 172.21.15.40:48332) 2023-12-17T11:49:21.443 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:21.440+0000 7f49777fe640 1 -- 172.21.15.40:0/693546232 learned_addr learned my addr 172.21.15.40:0/693546232 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-17T11:49:21.443 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:21.441+0000 7f4977fff640 1 --2- 172.21.15.40:0/693546232 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f49780b2a50 0x7f49780b5ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:21.443 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:21.441+0000 7f497cfce640 1 --2- 172.21.15.40:0/693546232 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4978160b40 0x7f49780cc640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:21.444 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:21.441+0000 7f49777fe640 1 -- 172.21.15.40:0/693546232 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f49780b2a50 msgr2=0x7f49780b5ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:21.444 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:21.441+0000 7f49777fe640 1 --2- 172.21.15.40:0/693546232 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f49780b2a50 0x7f49780b5ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:21.444 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:21.441+0000 7f49777fe640 1 -- 172.21.15.40:0/693546232 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4978160b40 msgr2=0x7f49780cc640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:21.444 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:21.441+0000 7f49777fe640 1 --2- 172.21.15.40:0/693546232 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4978160b40 0x7f49780cc640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:21.444 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:21.441+0000 7f49777fe640 1 -- 172.21.15.40:0/693546232 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49700094d0 con 0x7f49780b35a0 2023-12-17T11:49:21.444 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:21.441+0000 7f49777fe640 1 --2- 172.21.15.40:0/693546232 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f49780b35a0 0x7f4978157a90 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f496c00c430 tx=0x7f496c00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:49:21.444 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:21.442+0000 7f4974ff9640 1 -- 172.21.15.40:0/693546232 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f496c011790 con 0x7f49780b35a0 2023-12-17T11:49:21.445 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:21.442+0000 7f4974ff9640 1 -- 172.21.15.40:0/693546232 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f496c0118f0 con 0x7f49780b35a0 2023-12-17T11:49:21.445 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:21.442+0000 7f4974ff9640 1 -- 172.21.15.40:0/693546232 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f496c011ce0 con 0x7f49780b35a0 2023-12-17T11:49:21.445 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:21.442+0000 7f497ea31640 1 -- 172.21.15.40:0/693546232 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49780b66c0 con 0x7f49780b35a0 2023-12-17T11:49:21.445 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:21.442+0000 7f497ea31640 1 -- 172.21.15.40:0/693546232 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49780b6c80 con 0x7f49780b35a0 2023-12-17T11:49:21.445 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:21.443+0000 7f497ea31640 1 -- 172.21.15.40:0/693546232 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49780ca3c0 con 0x7f49780b35a0 2023-12-17T11:49:21.446 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:21.444+0000 7f4974ff9640 1 -- 172.21.15.40:0/693546232 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f496c01c460 con 0x7f49780b35a0 2023-12-17T11:49:21.447 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:21.445+0000 7f4974ff9640 1 --2- 172.21.15.40:0/693546232 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f496406ae70 0x7f496406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:21.447 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:21.445+0000 7f4974ff9640 1 -- 172.21.15.40:0/693546232 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f496c089940 con 0x7f49780b35a0 2023-12-17T11:49:21.447 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:21.446+0000 7f4977fff640 1 --2- 172.21.15.40:0/693546232 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f496406ae70 0x7f496406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:21.449 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:21.447+0000 7f4977fff640 1 --2- 172.21.15.40:0/693546232 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f496406ae70 0x7f496406d330 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f49680099c0 tx=0x7f4968003990 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:49:21.451 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:21.449+0000 7f4974ff9640 1 -- 172.21.15.40:0/693546232 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f496c054600 con 0x7f49780b35a0 2023-12-17T11:49:21.649 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:21.646+0000 7f497ea31640 1 -- 172.21.15.40:0/693546232 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f4978074450 con 0x7f49780b35a0 2023-12-17T11:49:21.649 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:21.647+0000 7f4974ff9640 1 -- 172.21.15.40:0/693546232 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) v1 ==== 93+0+10 (secure 0 0 0) 0x7f496c057c20 con 0x7f49780b35a0 2023-12-17T11:49:21.649 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 1 2023-12-17T11:49:21.652 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:21.650+0000 7f497ea31640 1 -- 172.21.15.40:0/693546232 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f496406ae70 msgr2=0x7f496406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:21.652 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:21.650+0000 7f497ea31640 1 --2- 172.21.15.40:0/693546232 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f496406ae70 0x7f496406d330 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f49680099c0 tx=0x7f4968003990 comp rx=0 tx=0).stop 2023-12-17T11:49:21.653 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:21.650+0000 7f497ea31640 1 -- 172.21.15.40:0/693546232 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f49780b35a0 msgr2=0x7f4978157a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:21.653 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:21.650+0000 7f497ea31640 1 --2- 172.21.15.40:0/693546232 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f49780b35a0 0x7f4978157a90 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f496c00c430 tx=0x7f496c00c8f0 comp rx=0 tx=0).stop 2023-12-17T11:49:21.653 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:21.650+0000 7f497ea31640 1 -- 172.21.15.40:0/693546232 shutdown_connections 2023-12-17T11:49:21.653 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:21.650+0000 7f497ea31640 1 --2- 172.21.15.40:0/693546232 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f496406ae70 0x7f496406d330 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:21.653 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:21.650+0000 7f497ea31640 1 --2- 172.21.15.40:0/693546232 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4978160b40 0x7f49780cc640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:21.653 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:21.650+0000 7f497ea31640 1 --2- 172.21.15.40:0/693546232 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f49780b35a0 0x7f4978157a90 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:21.653 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:21.650+0000 7f497ea31640 1 --2- 172.21.15.40:0/693546232 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f49780b2a50 0x7f49780b5ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:21.653 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:21.650+0000 7f497ea31640 1 -- 172.21.15.40:0/693546232 >> 172.21.15.40:0/693546232 conn(0x7f497809c420 msgr2=0x7f497806b190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:49:21.653 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:21.650+0000 7f497ea31640 1 -- 172.21.15.40:0/693546232 shutdown_connections 2023-12-17T11:49:21.653 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:21.651+0000 7f497ea31640 1 -- 172.21.15.40:0/693546232 wait complete. 2023-12-17T11:49:21.673 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-17T11:49:21.907 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:21.905+0000 7f599b0f3640 1 Processor -- start 2023-12-17T11:49:21.907 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:21.905+0000 7f599b0f3640 1 -- start start 2023-12-17T11:49:21.910 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:21.907+0000 7f599b0f3640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f599406d770 0x7f59940b1e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:21.910 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:21.907+0000 7f599b0f3640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f599406db50 0x7f5994141250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:21.910 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:21.907+0000 7f599b0f3640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f599415b780 con 0x7f5994141790 2023-12-17T11:49:21.910 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:21.907+0000 7f599b0f3640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5994141c20 con 0x7f599406d770 2023-12-17T11:49:21.910 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:21.907+0000 7f599b0f3640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f599415b9d0 con 0x7f599406db50 2023-12-17T11:49:21.910 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:21.908+0000 7f5999690640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f5994141790 0x7f599415ed70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:37888/0 (socket says 172.21.15.40:37888) 2023-12-17T11:49:21.910 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:21.908+0000 7f5999690640 1 -- 172.21.15.40:0/1476950300 learned_addr learned my addr 172.21.15.40:0/1476950300 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-12-17T11:49:21.910 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:21.908+0000 7f5998e8f640 1 --2- 172.21.15.40:0/1476950300 >> v2:172.21.15.40:3300/0 conn(0x7f599406d770 0x7f59940b1e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:21.910 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:21.908+0000 7f598bfff640 1 --2- 172.21.15.40:0/1476950300 >> v2:172.21.15.159:3300/0 conn(0x7f599406db50 0x7f5994141250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:21.911 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:21.908+0000 7f598b7fe640 1 -- 172.21.15.40:0/1476950300 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 138790533 0 0) 0x7f599415b780 con 0x7f5994141790 2023-12-17T11:49:21.911 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:21.908+0000 7f598b7fe640 1 -- 172.21.15.40:0/1476950300 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f597c003520 con 0x7f5994141790 2023-12-17T11:49:21.911 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:21.909+0000 7f5998e8f640 1 -- 172.21.15.40:0/1476950300 >> v2:172.21.15.159:3300/0 conn(0x7f599406db50 msgr2=0x7f5994141250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:49:21.911 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:21.909+0000 7f5998e8f640 1 --2- 172.21.15.40:0/1476950300 >> v2:172.21.15.159:3300/0 conn(0x7f599406db50 0x7f5994141250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:21.911 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:21.909+0000 7f5998e8f640 1 -- 172.21.15.40:0/1476950300 >> v1:172.21.15.40:6789/0 conn(0x7f5994141790 legacy=0x7f599415ed70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:21.912 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:21.909+0000 7f5998e8f640 1 -- 172.21.15.40:0/1476950300 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f599415bcb0 con 0x7f599406d770 2023-12-17T11:49:21.913 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:21.910+0000 7f5998e8f640 1 --2- 172.21.15.40:0/1476950300 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f599406d770 0x7f59940b1e00 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f5994067c70 tx=0x7f599002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11c9860043d3518b server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:49:21.913 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:21.910+0000 7f598b7fe640 1 -- 172.21.15.40:0/1476950300 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5990031830 con 0x7f599406d770 2023-12-17T11:49:21.913 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:21.910+0000 7f598b7fe640 1 -- 172.21.15.40:0/1476950300 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5990031990 con 0x7f599406d770 2023-12-17T11:49:21.913 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:21.910+0000 7f598b7fe640 1 -- 172.21.15.40:0/1476950300 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5990031d20 con 0x7f599406d770 2023-12-17T11:49:21.913 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:21.911+0000 7f599b0f3640 1 -- 172.21.15.40:0/1476950300 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f599406d770 msgr2=0x7f59940b1e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:21.913 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:21.911+0000 7f599b0f3640 1 --2- 172.21.15.40:0/1476950300 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f599406d770 0x7f59940b1e00 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f5994067c70 tx=0x7f599002b8d0 comp rx=0 tx=0).stop 2023-12-17T11:49:21.913 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:21.911+0000 7f599b0f3640 1 -- 172.21.15.40:0/1476950300 shutdown_connections 2023-12-17T11:49:21.913 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:21.911+0000 7f599b0f3640 1 --2- 172.21.15.40:0/1476950300 >> v2:172.21.15.159:3300/0 conn(0x7f599406db50 0x7f5994141250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:21.914 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:21.911+0000 7f599b0f3640 1 --2- 172.21.15.40:0/1476950300 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f599406d770 0x7f59940b1e00 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:21.914 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:21.911+0000 7f599b0f3640 1 -- 172.21.15.40:0/1476950300 >> 172.21.15.40:0/1476950300 conn(0x7f59940cb850 msgr2=0x7f59940cbc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:49:21.914 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:21.911+0000 7f599b0f3640 1 -- 172.21.15.40:0/1476950300 shutdown_connections 2023-12-17T11:49:21.914 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:21.911+0000 7f599b0f3640 1 -- 172.21.15.40:0/1476950300 wait complete. 2023-12-17T11:49:21.914 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:21.913+0000 7f599b0f3640 1 Processor -- start 2023-12-17T11:49:21.915 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:21.913+0000 7f599b0f3640 1 -- start start 2023-12-17T11:49:21.917 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:21.914+0000 7f599b0f3640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f599406d770 0x7f59940c3d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:21.917 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:21.914+0000 7f599b0f3640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f599406db50 0x7f59941364b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:21.917 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:21.914+0000 7f599b0f3640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5994141790 0x7f599413f0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:21.917 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:21.914+0000 7f599b0f3640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59941f30f0 con 0x7f599406db50 2023-12-17T11:49:21.917 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:21.914+0000 7f599b0f3640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59940c4470 con 0x7f599406d770 2023-12-17T11:49:21.918 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:21.914+0000 7f599b0f3640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5994072240 con 0x7f5994141790 2023-12-17T11:49:21.918 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:21.914+0000 7f598bfff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f599406db50 0x7f59941364b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:21.918 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:21.914+0000 7f598bfff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f599406db50 0x7f59941364b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:48348/0 (socket says 172.21.15.40:48348) 2023-12-17T11:49:21.918 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:21.914+0000 7f598bfff640 1 -- 172.21.15.40:0/4216522194 learned_addr learned my addr 172.21.15.40:0/4216522194 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-17T11:49:21.918 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:21.914+0000 7f5998e8f640 1 --2- 172.21.15.40:0/4216522194 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f599406d770 0x7f59940c3d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:21.918 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:21.914+0000 7f598bfff640 1 -- 172.21.15.40:0/4216522194 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5994141790 msgr2=0x7f599413f0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:21.918 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:21.914+0000 7f598bfff640 1 --2- 172.21.15.40:0/4216522194 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5994141790 0x7f599413f0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:21.918 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:21.915+0000 7f598bfff640 1 -- 172.21.15.40:0/4216522194 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f599406d770 msgr2=0x7f59940c3d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:21.918 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:21.915+0000 7f598bfff640 1 --2- 172.21.15.40:0/4216522194 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f599406d770 0x7f59940c3d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:21.918 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:21.915+0000 7f598bfff640 1 -- 172.21.15.40:0/4216522194 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5990009400 con 0x7f599406db50 2023-12-17T11:49:21.918 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:21.915+0000 7f598bfff640 1 --2- 172.21.15.40:0/4216522194 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f599406db50 0x7f59941364b0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f598400e9b0 tx=0x7f598400ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:49:21.918 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:21.915+0000 7f59897fa640 1 -- 172.21.15.40:0/4216522194 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5984009670 con 0x7f599406db50 2023-12-17T11:49:21.918 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:21.915+0000 7f59897fa640 1 -- 172.21.15.40:0/4216522194 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f598400c9a0 con 0x7f599406db50 2023-12-17T11:49:21.918 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:21.915+0000 7f59897fa640 1 -- 172.21.15.40:0/4216522194 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f598400cd50 con 0x7f599406db50 2023-12-17T11:49:21.919 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:21.915+0000 7f599b0f3640 1 -- 172.21.15.40:0/4216522194 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59940ae3f0 con 0x7f599406db50 2023-12-17T11:49:21.919 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:21.915+0000 7f599b0f3640 1 -- 172.21.15.40:0/4216522194 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59940ae9b0 con 0x7f599406db50 2023-12-17T11:49:21.919 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:21.916+0000 7f599b0f3640 1 -- 172.21.15.40:0/4216522194 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59940aebd0 con 0x7f599406db50 2023-12-17T11:49:21.919 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:21.917+0000 7f59897fa640 1 -- 172.21.15.40:0/4216522194 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f5984013470 con 0x7f599406db50 2023-12-17T11:49:21.920 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:21.918+0000 7f59897fa640 1 --2- 172.21.15.40:0/4216522194 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f598006ae40 0x7f598006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:21.920 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:21.918+0000 7f59897fa640 1 -- 172.21.15.40:0/4216522194 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f5984089bb0 con 0x7f599406db50 2023-12-17T11:49:21.921 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:21.919+0000 7f5998e8f640 1 --2- 172.21.15.40:0/4216522194 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f598006ae40 0x7f598006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:21.922 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:21.921+0000 7f5998e8f640 1 --2- 172.21.15.40:0/4216522194 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f598006ae40 0x7f598006d300 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f5990036000 tx=0x7f5990008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:49:21.925 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:21.923+0000 7f59897fa640 1 -- 172.21.15.40:0/4216522194 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f5984054910 con 0x7f599406db50 2023-12-17T11:49:22.118 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:22.116+0000 7f599b0f3640 1 -- 172.21.15.40:0/4216522194 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f599415f120 con 0x7f599406db50 2023-12-17T11:49:22.118 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:22.117+0000 7f59897fa640 1 -- 172.21.15.40:0/4216522194 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) v1 ==== 104+0+11 (secure 0 0 0) 0x7f5984017020 con 0x7f599406db50 2023-12-17T11:49:22.119 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 32 2023-12-17T11:49:22.121 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:22.119+0000 7f599b0f3640 1 -- 172.21.15.40:0/4216522194 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f598006ae40 msgr2=0x7f598006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:22.121 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:22.119+0000 7f599b0f3640 1 --2- 172.21.15.40:0/4216522194 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f598006ae40 0x7f598006d300 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f5990036000 tx=0x7f5990008030 comp rx=0 tx=0).stop 2023-12-17T11:49:22.122 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:22.119+0000 7f599b0f3640 1 -- 172.21.15.40:0/4216522194 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f599406db50 msgr2=0x7f59941364b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:22.122 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:22.119+0000 7f599b0f3640 1 --2- 172.21.15.40:0/4216522194 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f599406db50 0x7f59941364b0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f598400e9b0 tx=0x7f598400ee70 comp rx=0 tx=0).stop 2023-12-17T11:49:22.122 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:22.119+0000 7f599b0f3640 1 -- 172.21.15.40:0/4216522194 shutdown_connections 2023-12-17T11:49:22.122 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:22.119+0000 7f599b0f3640 1 --2- 172.21.15.40:0/4216522194 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f598006ae40 0x7f598006d300 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:22.122 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:22.119+0000 7f599b0f3640 1 --2- 172.21.15.40:0/4216522194 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5994141790 0x7f599413f0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:22.122 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:22.119+0000 7f599b0f3640 1 --2- 172.21.15.40:0/4216522194 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f599406db50 0x7f59941364b0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:22.122 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:22.119+0000 7f599b0f3640 1 --2- 172.21.15.40:0/4216522194 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f599406d770 0x7f59940c3d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:22.122 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:22.119+0000 7f599b0f3640 1 -- 172.21.15.40:0/4216522194 >> 172.21.15.40:0/4216522194 conn(0x7f59940cb850 msgr2=0x7f599415c920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:49:22.122 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:22.119+0000 7f599b0f3640 1 -- 172.21.15.40:0/4216522194 shutdown_connections 2023-12-17T11:49:22.122 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:22.120+0000 7f599b0f3640 1 -- 172.21.15.40:0/4216522194 wait complete. 2023-12-17T11:49:22.143 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-17T11:49:22.371 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:22.369+0000 7fd6478fa640 1 Processor -- start 2023-12-17T11:49:22.371 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:22.369+0000 7fd6478fa640 1 -- start start 2023-12-17T11:49:22.373 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:22.371+0000 7fd6478fa640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd640143390 0x7fd6400cddb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:22.373 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:22.371+0000 7fd6478fa640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7fd6401438e0 0x7fd64015e390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:22.373 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:22.371+0000 7fd6478fa640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd64006daf0 con 0x7fd640142ea0 2023-12-17T11:49:22.373 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:22.371+0000 7fd6478fa640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd64015e8d0 con 0x7fd6401438e0 2023-12-17T11:49:22.374 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:22.371+0000 7fd6478fa640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd64006ddd0 con 0x7fd640143390 2023-12-17T11:49:22.374 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:22.371+0000 7fd645696640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fd640142ea0 0x7fd64015dc80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:37902/0 (socket says 172.21.15.40:37902) 2023-12-17T11:49:22.374 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:22.371+0000 7fd645696640 1 -- 172.21.15.40:0/1237149170 learned_addr learned my addr 172.21.15.40:0/1237149170 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-12-17T11:49:22.376 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:22.372+0000 7fd644e95640 1 --2- 172.21.15.40:0/1237149170 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd640143390 0x7fd6400cddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:22.376 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:22.372+0000 7fd645e97640 1 --2- 172.21.15.40:0/1237149170 >> v2:172.21.15.159:3300/0 conn(0x7fd6401438e0 0x7fd64015e390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:22.376 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:22.372+0000 7fd637fff640 1 -- 172.21.15.40:0/1237149170 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1905344093 0 0) 0x7fd64006daf0 con 0x7fd640142ea0 2023-12-17T11:49:22.376 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:22.372+0000 7fd637fff640 1 -- 172.21.15.40:0/1237149170 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd62c003520 con 0x7fd640142ea0 2023-12-17T11:49:22.376 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:22.372+0000 7fd637fff640 1 -- 172.21.15.40:0/1237149170 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3115108859 0 0) 0x7fd62c003520 con 0x7fd640142ea0 2023-12-17T11:49:22.376 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:22.372+0000 7fd637fff640 1 -- 172.21.15.40:0/1237149170 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd640143390 msgr2=0x7fd6400cddb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:49:22.376 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:22.372+0000 7fd637fff640 1 --2- 172.21.15.40:0/1237149170 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd640143390 0x7fd6400cddb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:22.376 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:22.372+0000 7fd637fff640 1 -- 172.21.15.40:0/1237149170 >> v2:172.21.15.159:3300/0 conn(0x7fd6401438e0 msgr2=0x7fd64015e390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:49:22.376 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:22.372+0000 7fd637fff640 1 --2- 172.21.15.40:0/1237149170 >> v2:172.21.15.159:3300/0 conn(0x7fd6401438e0 0x7fd64015e390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:22.377 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:22.372+0000 7fd637fff640 1 -- 172.21.15.40:0/1237149170 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd64006f890 con 0x7fd640142ea0 2023-12-17T11:49:22.377 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:22.372+0000 7fd637fff640 1 -- 172.21.15.40:0/1237149170 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2643242555 0 0) 0x7fd63c001670 con 0x7fd640142ea0 2023-12-17T11:49:22.377 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:22.373+0000 7fd637fff640 1 -- 172.21.15.40:0/1237149170 >> v1:172.21.15.40:6789/0 conn(0x7fd640142ea0 legacy=0x7fd64015dc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:22.377 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:22.373+0000 7fd637fff640 1 --2- 172.21.15.40:0/1237149170 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd62c003970 0x7fd62c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:22.377 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:22.373+0000 7fd637fff640 1 --2- 172.21.15.40:0/1237149170 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd640143390 0x7fd62c0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:22.377 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:22.373+0000 7fd637fff640 1 --2- 172.21.15.40:0/1237149170 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd62c004d00 0x7fd62c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:22.377 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:22.373+0000 7fd637fff640 1 -- 172.21.15.40:0/1237149170 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd64015e8d0 con 0x7fd62c003970 2023-12-17T11:49:22.377 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:22.373+0000 7fd637fff640 1 -- 172.21.15.40:0/1237149170 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd64006ddd0 con 0x7fd62c004d00 2023-12-17T11:49:22.377 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:22.373+0000 7fd637fff640 1 -- 172.21.15.40:0/1237149170 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd62c00b980 con 0x7fd640143390 2023-12-17T11:49:22.377 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:22.373+0000 7fd645696640 1 --2- 172.21.15.40:0/1237149170 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd62c003970 0x7fd62c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:22.377 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:22.373+0000 7fd644e95640 1 --2- 172.21.15.40:0/1237149170 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd640143390 0x7fd62c0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:22.377 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:22.373+0000 7fd645e97640 1 --2- 172.21.15.40:0/1237149170 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd62c004d00 0x7fd62c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:22.377 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:22.373+0000 7fd645696640 1 -- 172.21.15.40:0/1237149170 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd640143390 msgr2=0x7fd62c0047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:49:22.378 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:22.374+0000 7fd645696640 1 --2- 172.21.15.40:0/1237149170 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd640143390 0x7fd62c0047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:22.378 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:22.374+0000 7fd645696640 1 -- 172.21.15.40:0/1237149170 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd62c004d00 msgr2=0x7fd62c005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:49:22.378 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:22.374+0000 7fd645696640 1 --2- 172.21.15.40:0/1237149170 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd62c004d00 0x7fd62c005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:22.378 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:22.374+0000 7fd645696640 1 -- 172.21.15.40:0/1237149170 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd62c003520 con 0x7fd62c003970 2023-12-17T11:49:22.379 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:22.375+0000 7fd645696640 1 --2- 172.21.15.40:0/1237149170 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd62c003970 0x7fd62c003d90 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fd63c00c160 tx=0x7fd62c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5fa43027aa1bcc44 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:49:22.379 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:22.375+0000 7fd637fff640 1 -- 172.21.15.40:0/1237149170 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd63c005ad0 con 0x7fd62c003970 2023-12-17T11:49:22.379 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:22.375+0000 7fd637fff640 1 -- 172.21.15.40:0/1237149170 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd63c005c30 con 0x7fd62c003970 2023-12-17T11:49:22.379 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:22.375+0000 7fd637fff640 1 -- 172.21.15.40:0/1237149170 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd63c02c810 con 0x7fd62c003970 2023-12-17T11:49:22.379 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:22.376+0000 7fd6478fa640 1 -- 172.21.15.40:0/1237149170 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd62c003970 msgr2=0x7fd62c003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:22.379 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:22.376+0000 7fd6478fa640 1 --2- 172.21.15.40:0/1237149170 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd62c003970 0x7fd62c003d90 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fd63c00c160 tx=0x7fd62c0057f0 comp rx=0 tx=0).stop 2023-12-17T11:49:22.379 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:22.376+0000 7fd645e97640 1 -- 172.21.15.40:0/1237149170 reap_dead start 2023-12-17T11:49:22.379 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:22.376+0000 7fd6478fa640 1 -- 172.21.15.40:0/1237149170 shutdown_connections 2023-12-17T11:49:22.379 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:22.376+0000 7fd6478fa640 1 -- 172.21.15.40:0/1237149170 >> 172.21.15.40:0/1237149170 conn(0x7fd6400cc9b0 msgr2=0x7fd6400ccd90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:49:22.379 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:22.376+0000 7fd6478fa640 1 -- 172.21.15.40:0/1237149170 shutdown_connections 2023-12-17T11:49:22.379 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:22.376+0000 7fd6478fa640 1 -- 172.21.15.40:0/1237149170 wait complete. 2023-12-17T11:49:22.380 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:22.378+0000 7fd6478fa640 1 Processor -- start 2023-12-17T11:49:22.380 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:22.378+0000 7fd6478fa640 1 -- start start 2023-12-17T11:49:22.381 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:22.379+0000 7fd6478fa640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd62c003970 0x7fd640152830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:22.381 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:22.379+0000 7fd6478fa640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd640159b40 0x7fd64013aef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:22.381 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:22.379+0000 7fd6478fa640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd64013d2e0 0x7fd64013d760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:22.381 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:22.379+0000 7fd6478fa640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd64013dca0 con 0x7fd640159b40 2023-12-17T11:49:22.381 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:22.379+0000 7fd6478fa640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd64013c400 con 0x7fd64013d2e0 2023-12-17T11:49:22.381 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:22.379+0000 7fd6478fa640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd64013b7f0 con 0x7fd62c003970 2023-12-17T11:49:22.381 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:22.379+0000 7fd644e95640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd640159b40 0x7fd64013aef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:22.382 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:22.379+0000 7fd644e95640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd640159b40 0x7fd64013aef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:48372/0 (socket says 172.21.15.40:48372) 2023-12-17T11:49:22.382 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:22.379+0000 7fd644e95640 1 -- 172.21.15.40:0/3629155649 learned_addr learned my addr 172.21.15.40:0/3629155649 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-17T11:49:22.383 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:22.380+0000 7fd645e97640 1 --2- 172.21.15.40:0/3629155649 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd64013d2e0 0x7fd64013d760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:22.383 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:22.380+0000 7fd644e95640 1 -- 172.21.15.40:0/3629155649 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd62c003970 msgr2=0x7fd640152830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:22.383 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:22.380+0000 7fd644e95640 1 --2- 172.21.15.40:0/3629155649 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd62c003970 0x7fd640152830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:22.383 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:22.380+0000 7fd644e95640 1 -- 172.21.15.40:0/3629155649 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd64013d2e0 msgr2=0x7fd64013d760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:22.383 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:22.380+0000 7fd644e95640 1 --2- 172.21.15.40:0/3629155649 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd64013d2e0 0x7fd64013d760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:22.383 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:22.380+0000 7fd644e95640 1 -- 172.21.15.40:0/3629155649 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd64013bad0 con 0x7fd640159b40 2023-12-17T11:49:22.383 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:22.380+0000 7fd645e97640 1 --2- 172.21.15.40:0/3629155649 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd64013d2e0 0x7fd64013d760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-17T11:49:22.383 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:22.380+0000 7fd644e95640 1 --2- 172.21.15.40:0/3629155649 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd640159b40 0x7fd64013aef0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fd630011570 tx=0x7fd630011a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:49:22.384 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:22.380+0000 7fd635ffb640 1 -- 172.21.15.40:0/3629155649 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd630015930 con 0x7fd640159b40 2023-12-17T11:49:22.384 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:22.380+0000 7fd635ffb640 1 -- 172.21.15.40:0/3629155649 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd630015a90 con 0x7fd640159b40 2023-12-17T11:49:22.384 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:22.380+0000 7fd6478fa640 1 -- 172.21.15.40:0/3629155649 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd64013bdb0 con 0x7fd640159b40 2023-12-17T11:49:22.384 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:22.380+0000 7fd635ffb640 1 -- 172.21.15.40:0/3629155649 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd630015e60 con 0x7fd640159b40 2023-12-17T11:49:22.384 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:22.381+0000 7fd6478fa640 1 -- 172.21.15.40:0/3629155649 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd640152d70 con 0x7fd640159b40 2023-12-17T11:49:22.384 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:22.382+0000 7fd6478fa640 1 -- 172.21.15.40:0/3629155649 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd640074450 con 0x7fd640159b40 2023-12-17T11:49:22.385 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:22.383+0000 7fd635ffb640 1 -- 172.21.15.40:0/3629155649 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fd63001d400 con 0x7fd640159b40 2023-12-17T11:49:22.386 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:22.384+0000 7fd635ffb640 1 --2- 172.21.15.40:0/3629155649 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7fd62406ae70 0x7fd62406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:22.386 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:22.384+0000 7fd635ffb640 1 -- 172.21.15.40:0/3629155649 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6692+0+0 (secure 0 0 0) 0x7fd63008a270 con 0x7fd640159b40 2023-12-17T11:49:22.386 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:22.384+0000 7fd645696640 1 --2- 172.21.15.40:0/3629155649 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7fd62406ae70 0x7fd62406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:22.387 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:22.386+0000 7fd645696640 1 --2- 172.21.15.40:0/3629155649 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7fd62406ae70 0x7fd62406d330 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fd63c001050 tx=0x7fd63c02e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:49:22.390 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:22.388+0000 7fd635ffb640 1 -- 172.21.15.40:0/3629155649 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fd630054ea0 con 0x7fd640159b40 2023-12-17T11:49:22.585 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:22.583+0000 7fd6478fa640 1 -- 172.21.15.40:0/3629155649 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fd64013c540 con 0x7fd640159b40 2023-12-17T11:49:22.586 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:22.584+0000 7fd635ffb640 1 -- 172.21.15.40:0/3629155649 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) v1 ==== 100+0+11 (secure 0 0 0) 0x7fd6300584c0 con 0x7fd640159b40 2023-12-17T11:49:22.586 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 64 2023-12-17T11:49:22.589 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:22.587+0000 7fd6478fa640 1 -- 172.21.15.40:0/3629155649 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7fd62406ae70 msgr2=0x7fd62406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:22.589 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:22.587+0000 7fd6478fa640 1 --2- 172.21.15.40:0/3629155649 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7fd62406ae70 0x7fd62406d330 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fd63c001050 tx=0x7fd63c02e000 comp rx=0 tx=0).stop 2023-12-17T11:49:22.589 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:22.587+0000 7fd6478fa640 1 -- 172.21.15.40:0/3629155649 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd640159b40 msgr2=0x7fd64013aef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:22.589 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:22.587+0000 7fd6478fa640 1 --2- 172.21.15.40:0/3629155649 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd640159b40 0x7fd64013aef0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fd630011570 tx=0x7fd630011a30 comp rx=0 tx=0).stop 2023-12-17T11:49:22.590 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:22.587+0000 7fd6478fa640 1 -- 172.21.15.40:0/3629155649 shutdown_connections 2023-12-17T11:49:22.590 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:22.587+0000 7fd6478fa640 1 --2- 172.21.15.40:0/3629155649 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7fd62406ae70 0x7fd62406d330 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:22.590 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:22.587+0000 7fd6478fa640 1 --2- 172.21.15.40:0/3629155649 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd64013d2e0 0x7fd64013d760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:22.590 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:22.587+0000 7fd6478fa640 1 --2- 172.21.15.40:0/3629155649 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd640159b40 0x7fd64013aef0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:22.590 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:22.587+0000 7fd6478fa640 1 --2- 172.21.15.40:0/3629155649 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd62c003970 0x7fd640152830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:22.590 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:22.587+0000 7fd6478fa640 1 -- 172.21.15.40:0/3629155649 >> 172.21.15.40:0/3629155649 conn(0x7fd6400cc9b0 msgr2=0x7fd6400ceab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:49:22.590 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:22.587+0000 7fd6478fa640 1 -- 172.21.15.40:0/3629155649 shutdown_connections 2023-12-17T11:49:22.590 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:22.587+0000 7fd6478fa640 1 -- 172.21.15.40:0/3629155649 wait complete. 2023-12-17T11:49:22.608 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-12-17T11:49:22.830 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:22.828+0000 7f15481a9640 1 Processor -- start 2023-12-17T11:49:22.830 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:22.828+0000 7f15481a9640 1 -- start start 2023-12-17T11:49:22.833 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:22.829+0000 7f15481a9640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f1540142de0 0x7f15400cdd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:22.833 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:22.830+0000 7f15481a9640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f154006dc10 0x7f1540070250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:22.833 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:22.830+0000 7f15481a9640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15400b4980 con 0x7f15401432b0 2023-12-17T11:49:22.833 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:22.830+0000 7f15481a9640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15400ce2a0 con 0x7f1540142de0 2023-12-17T11:49:22.834 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:22.830+0000 7f15481a9640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15400b4050 con 0x7f154006dc10 2023-12-17T11:49:22.834 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:22.830+0000 7f1545f45640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f1540142de0 0x7f15400cdd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:22.834 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:22.830+0000 7f1545f45640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f1540142de0 0x7f15400cdd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:48384/0 (socket says 172.21.15.40:48384) 2023-12-17T11:49:22.834 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:22.830+0000 7f1545f45640 1 -- 172.21.15.40:0/1668543839 learned_addr learned my addr 172.21.15.40:0/1668543839 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-17T11:49:22.834 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:22.830+0000 7f1545f45640 1 -- 172.21.15.40:0/1668543839 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f154006dc10 msgr2=0x7f1540070250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:49:22.834 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:22.830+0000 7f1545f45640 1 --2- 172.21.15.40:0/1668543839 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f154006dc10 0x7f1540070250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:22.834 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:22.830+0000 7f1545f45640 1 -- 172.21.15.40:0/1668543839 >> v1:172.21.15.159:6789/0 conn(0x7f15401432b0 legacy=0x7f154006d500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:49:22.834 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:22.830+0000 7f1545f45640 1 -- 172.21.15.40:0/1668543839 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15400b4330 con 0x7f1540142de0 2023-12-17T11:49:22.836 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:22.832+0000 7f1545f45640 1 --2- 172.21.15.40:0/1668543839 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1540142de0 0x7f15400cdd60 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f1530009e50 tx=0x7f153002be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb6a686f203712c2 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:49:22.836 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:22.832+0000 7f1544f43640 1 -- 172.21.15.40:0/1668543839 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f153002c9f0 con 0x7f1540142de0 2023-12-17T11:49:22.836 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:22.832+0000 7f1544f43640 1 -- 172.21.15.40:0/1668543839 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f153002cb50 con 0x7f1540142de0 2023-12-17T11:49:22.836 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:22.832+0000 7f1544f43640 1 -- 172.21.15.40:0/1668543839 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15300343f0 con 0x7f1540142de0 2023-12-17T11:49:22.836 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:22.832+0000 7f15481a9640 1 -- 172.21.15.40:0/1668543839 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1540142de0 msgr2=0x7f15400cdd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:22.837 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:22.833+0000 7f15481a9640 1 --2- 172.21.15.40:0/1668543839 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1540142de0 0x7f15400cdd60 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f1530009e50 tx=0x7f153002be50 comp rx=0 tx=0).stop 2023-12-17T11:49:22.837 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:22.833+0000 7f15481a9640 1 -- 172.21.15.40:0/1668543839 shutdown_connections 2023-12-17T11:49:22.837 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:22.833+0000 7f15481a9640 1 --2- 172.21.15.40:0/1668543839 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f154006dc10 0x7f1540070250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:22.837 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:22.833+0000 7f15481a9640 1 --2- 172.21.15.40:0/1668543839 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1540142de0 0x7f15400cdd60 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:22.837 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:22.833+0000 7f15481a9640 1 -- 172.21.15.40:0/1668543839 >> 172.21.15.40:0/1668543839 conn(0x7f15400cb850 msgr2=0x7f15400cbc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:49:22.837 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:22.833+0000 7f15481a9640 1 -- 172.21.15.40:0/1668543839 shutdown_connections 2023-12-17T11:49:22.837 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:22.833+0000 7f15481a9640 1 -- 172.21.15.40:0/1668543839 wait complete. 2023-12-17T11:49:22.840 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:22.835+0000 7f15481a9640 1 Processor -- start 2023-12-17T11:49:22.840 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:22.835+0000 7f15481a9640 1 -- start start 2023-12-17T11:49:22.841 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:22.837+0000 7f15481a9640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f154006dc10 0x7f154013b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:22.841 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:22.837+0000 7f15481a9640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1540142de0 0x7f15401382a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:22.841 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:22.837+0000 7f15481a9640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f15401432b0 0x7f15401e4a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:22.841 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:22.837+0000 7f15481a9640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15401387e0 con 0x7f1540142de0 2023-12-17T11:49:22.842 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:22.837+0000 7f15481a9640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15401e5e40 con 0x7f154006dc10 2023-12-17T11:49:22.842 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:22.837+0000 7f15481a9640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15401e4f90 con 0x7f15401432b0 2023-12-17T11:49:22.842 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:22.837+0000 7f1545744640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1540142de0 0x7f15401382a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:22.842 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:22.837+0000 7f1545744640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1540142de0 0x7f15401382a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:48396/0 (socket says 172.21.15.40:48396) 2023-12-17T11:49:22.842 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:22.837+0000 7f1545744640 1 -- 172.21.15.40:0/1599200259 learned_addr learned my addr 172.21.15.40:0/1599200259 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-17T11:49:22.842 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:22.837+0000 7f1545f45640 1 --2- 172.21.15.40:0/1599200259 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f154006dc10 0x7f154013b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:22.842 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:22.837+0000 7f1546746640 1 --2- 172.21.15.40:0/1599200259 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f15401432b0 0x7f15401e4a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:22.842 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:22.837+0000 7f1545744640 1 -- 172.21.15.40:0/1599200259 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f15401432b0 msgr2=0x7f15401e4a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:22.843 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:22.837+0000 7f1545744640 1 --2- 172.21.15.40:0/1599200259 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f15401432b0 0x7f15401e4a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:22.843 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:22.837+0000 7f1545744640 1 -- 172.21.15.40:0/1599200259 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f154006dc10 msgr2=0x7f154013b650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:22.843 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:22.837+0000 7f1545744640 1 --2- 172.21.15.40:0/1599200259 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f154006dc10 0x7f154013b650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:22.843 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:22.838+0000 7f1545744640 1 -- 172.21.15.40:0/1599200259 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1530009b30 con 0x7f1540142de0 2023-12-17T11:49:22.843 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:22.838+0000 7f1545f45640 1 --2- 172.21.15.40:0/1599200259 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f154006dc10 0x7f154013b650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-17T11:49:22.843 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:22.838+0000 7f1546746640 1 --2- 172.21.15.40:0/1599200259 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f15401432b0 0x7f15401e4a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-17T11:49:22.843 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:22.838+0000 7f1545744640 1 --2- 172.21.15.40:0/1599200259 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1540142de0 0x7f15401382a0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f153400b3e0 tx=0x7f153400b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:49:22.843 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:22.838+0000 7f153e7fc640 1 -- 172.21.15.40:0/1599200259 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1534011830 con 0x7f1540142de0 2023-12-17T11:49:22.844 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:22.838+0000 7f153e7fc640 1 -- 172.21.15.40:0/1599200259 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15340119b0 con 0x7f1540142de0 2023-12-17T11:49:22.844 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:22.838+0000 7f153e7fc640 1 -- 172.21.15.40:0/1599200259 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1534011d60 con 0x7f1540142de0 2023-12-17T11:49:22.844 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:22.838+0000 7f15481a9640 1 -- 172.21.15.40:0/1599200259 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15401e5230 con 0x7f1540142de0 2023-12-17T11:49:22.844 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:22.838+0000 7f15481a9640 1 -- 172.21.15.40:0/1599200259 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15401e57f0 con 0x7f1540142de0 2023-12-17T11:49:22.845 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:22.839+0000 7f15481a9640 1 -- 172.21.15.40:0/1599200259 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15400745d0 con 0x7f1540142de0 2023-12-17T11:49:22.845 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:22.840+0000 7f153e7fc640 1 -- 172.21.15.40:0/1599200259 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f153401a400 con 0x7f1540142de0 2023-12-17T11:49:22.846 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:22.841+0000 7f153e7fc640 1 --2- 172.21.15.40:0/1599200259 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f152c06ae40 0x7f152c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:22.846 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:22.841+0000 7f153e7fc640 1 -- 172.21.15.40:0/1599200259 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f1534089cd0 con 0x7f1540142de0 2023-12-17T11:49:22.846 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:22.842+0000 7f1545f45640 1 --2- 172.21.15.40:0/1599200259 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f152c06ae40 0x7f152c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:22.846 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:22.843+0000 7f1545f45640 1 --2- 172.21.15.40:0/1599200259 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f152c06ae40 0x7f152c06d300 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f1530035000 tx=0x7f1530030000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:49:22.847 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:22.845+0000 7f153e7fc640 1 -- 172.21.15.40:0/1599200259 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f1534054900 con 0x7f1540142de0 2023-12-17T11:49:23.041 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:23.039+0000 7f15481a9640 1 -- 172.21.15.40:0/1599200259 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f154006d7b0 con 0x7f1540142de0 2023-12-17T11:49:23.042 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:23.040+0000 7f153e7fc640 1 -- 172.21.15.40:0/1599200259 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) v1 ==== 103+0+11 (secure 0 0 0) 0x7f1534015020 con 0x7f1540142de0 2023-12-17T11:49:23.042 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 32 2023-12-17T11:49:23.045 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:23.042+0000 7f15481a9640 1 -- 172.21.15.40:0/1599200259 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f152c06ae40 msgr2=0x7f152c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:23.045 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:23.042+0000 7f15481a9640 1 --2- 172.21.15.40:0/1599200259 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f152c06ae40 0x7f152c06d300 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f1530035000 tx=0x7f1530030000 comp rx=0 tx=0).stop 2023-12-17T11:49:23.045 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:23.042+0000 7f15481a9640 1 -- 172.21.15.40:0/1599200259 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1540142de0 msgr2=0x7f15401382a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:23.045 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:23.042+0000 7f15481a9640 1 --2- 172.21.15.40:0/1599200259 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1540142de0 0x7f15401382a0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f153400b3e0 tx=0x7f153400b8a0 comp rx=0 tx=0).stop 2023-12-17T11:49:23.045 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:23.042+0000 7f15481a9640 1 -- 172.21.15.40:0/1599200259 shutdown_connections 2023-12-17T11:49:23.045 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:23.042+0000 7f15481a9640 1 --2- 172.21.15.40:0/1599200259 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f152c06ae40 0x7f152c06d300 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:23.045 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:23.042+0000 7f15481a9640 1 --2- 172.21.15.40:0/1599200259 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f15401432b0 0x7f15401e4a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:23.046 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:23.042+0000 7f15481a9640 1 --2- 172.21.15.40:0/1599200259 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1540142de0 0x7f15401382a0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:23.046 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:23.042+0000 7f15481a9640 1 --2- 172.21.15.40:0/1599200259 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f154006dc10 0x7f154013b650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:23.046 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:23.043+0000 7f15481a9640 1 -- 172.21.15.40:0/1599200259 >> 172.21.15.40:0/1599200259 conn(0x7f15400cb850 msgr2=0x7f154006cd80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:49:23.046 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:23.043+0000 7f15481a9640 1 -- 172.21.15.40:0/1599200259 shutdown_connections 2023-12-17T11:49:23.046 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:23.043+0000 7f15481a9640 1 -- 172.21.15.40:0/1599200259 wait complete. 2023-12-17T11:49:23.065 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-17T11:49:23.295 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:23.293+0000 7f8a200ad640 1 Processor -- start 2023-12-17T11:49:23.295 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:23.293+0000 7f8a200ad640 1 -- start start 2023-12-17T11:49:23.297 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:23.295+0000 7f8a200ad640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f8a18157a60 0x7f8a1806c410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:23.297 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:23.295+0000 7f8a200ad640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8a1806de20 0x7f8a1815dba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:23.297 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:23.295+0000 7f8a200ad640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a1806ca40 con 0x7f8a1815e0e0 2023-12-17T11:49:23.297 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:23.295+0000 7f8a200ad640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a1815e550 con 0x7f8a18157a60 2023-12-17T11:49:23.297 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:23.295+0000 7f8a200ad640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a18071cd0 con 0x7f8a1806de20 2023-12-17T11:49:23.298 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:23.296+0000 7f8a1d648640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8a1806de20 0x7f8a1815dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:23.298 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:23.296+0000 7f8a1de49640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f8a18157a60 0x7f8a1806c410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:23.298 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:23.296+0000 7f8a1d648640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8a1806de20 0x7f8a1815dba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3301/0 says I am v2:172.21.15.40:59418/0 (socket says 172.21.15.40:59418) 2023-12-17T11:49:23.298 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:23.296+0000 7f8a1d648640 1 -- 172.21.15.40:0/113339513 learned_addr learned my addr 172.21.15.40:0/113339513 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-17T11:49:23.299 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:23.297+0000 7f8a1d648640 1 -- 172.21.15.40:0/113339513 >> v2:172.21.15.159:3300/0 conn(0x7f8a18157a60 msgr2=0x7f8a1806c410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:49:23.299 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:23.297+0000 7f8a1d648640 1 --2- 172.21.15.40:0/113339513 >> v2:172.21.15.159:3300/0 conn(0x7f8a18157a60 0x7f8a1806c410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:23.299 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:23.297+0000 7f8a1d648640 1 -- 172.21.15.40:0/113339513 >> v1:172.21.15.159:6789/0 conn(0x7f8a1815e0e0 legacy=0x7f8a1815a5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:23.299 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:23.297+0000 7f8a1d648640 1 -- 172.21.15.40:0/113339513 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a18070f10 con 0x7f8a1806de20 2023-12-17T11:49:23.300 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:23.298+0000 7f8a1d648640 1 --2- 172.21.15.40:0/113339513 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8a1806de20 0x7f8a1815dba0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f8a14009870 tx=0x7f8a1402b8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2760fa0001f6efb1 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:49:23.301 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:23.299+0000 7f8a1ce47640 1 -- 172.21.15.40:0/113339513 <== mon.2 v2:172.21.15.159:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a14031640 con 0x7f8a1806de20 2023-12-17T11:49:23.301 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:23.299+0000 7f8a1ce47640 1 -- 172.21.15.40:0/113339513 <== mon.2 v2:172.21.15.159:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a140317a0 con 0x7f8a1806de20 2023-12-17T11:49:23.301 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:23.299+0000 7f8a1ce47640 1 -- 172.21.15.40:0/113339513 <== mon.2 v2:172.21.15.159:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a14031b30 con 0x7f8a1806de20 2023-12-17T11:49:23.302 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:23.299+0000 7f8a200ad640 1 -- 172.21.15.40:0/113339513 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8a1806de20 msgr2=0x7f8a1815dba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:23.302 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:23.299+0000 7f8a200ad640 1 --2- 172.21.15.40:0/113339513 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8a1806de20 0x7f8a1815dba0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f8a14009870 tx=0x7f8a1402b8f0 comp rx=0 tx=0).stop 2023-12-17T11:49:23.302 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:23.299+0000 7f8a200ad640 1 -- 172.21.15.40:0/113339513 shutdown_connections 2023-12-17T11:49:23.302 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:23.299+0000 7f8a200ad640 1 --2- 172.21.15.40:0/113339513 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8a1806de20 0x7f8a1815dba0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:23.302 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:23.300+0000 7f8a200ad640 1 --2- 172.21.15.40:0/113339513 >> v2:172.21.15.159:3300/0 conn(0x7f8a18157a60 0x7f8a1806c410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:23.302 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:23.300+0000 7f8a200ad640 1 -- 172.21.15.40:0/113339513 >> 172.21.15.40:0/113339513 conn(0x7f8a180b0a90 msgr2=0x7f8a180b0e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:49:23.302 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:23.300+0000 7f8a200ad640 1 -- 172.21.15.40:0/113339513 shutdown_connections 2023-12-17T11:49:23.302 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:23.300+0000 7f8a200ad640 1 -- 172.21.15.40:0/113339513 wait complete. 2023-12-17T11:49:23.303 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:23.301+0000 7f8a200ad640 1 Processor -- start 2023-12-17T11:49:23.303 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:23.302+0000 7f8a200ad640 1 -- start start 2023-12-17T11:49:23.306 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:23.302+0000 7f8a200ad640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8a1806de20 0x7f8a181543c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:23.306 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:23.302+0000 7f8a200ad640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8a18157a60 0x7f8a1815c070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:23.306 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:23.303+0000 7f8a200ad640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8a1815e0e0 0x7f8a1815c5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:23.306 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:23.303+0000 7f8a200ad640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a180b2d40 con 0x7f8a1806de20 2023-12-17T11:49:23.306 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:23.303+0000 7f8a200ad640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a1815b9e0 con 0x7f8a1815e0e0 2023-12-17T11:49:23.306 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:23.303+0000 7f8a200ad640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a18156640 con 0x7f8a18157a60 2023-12-17T11:49:23.306 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:23.303+0000 7f8a1de49640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8a1806de20 0x7f8a181543c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:23.307 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:23.303+0000 7f8a1de49640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8a1806de20 0x7f8a181543c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:48400/0 (socket says 172.21.15.40:48400) 2023-12-17T11:49:23.307 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:23.303+0000 7f8a1de49640 1 -- 172.21.15.40:0/891042451 learned_addr learned my addr 172.21.15.40:0/891042451 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-17T11:49:23.307 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:23.303+0000 7f8a1e64a640 1 --2- 172.21.15.40:0/891042451 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8a1815e0e0 0x7f8a1815c5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:23.307 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:23.303+0000 7f8a1de49640 1 -- 172.21.15.40:0/891042451 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8a18157a60 msgr2=0x7f8a1815c070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:23.307 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:23.303+0000 7f8a1d648640 1 --2- 172.21.15.40:0/891042451 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8a18157a60 0x7f8a1815c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:23.307 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:23.303+0000 7f8a1de49640 1 --2- 172.21.15.40:0/891042451 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8a18157a60 0x7f8a1815c070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:23.307 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:23.303+0000 7f8a1de49640 1 -- 172.21.15.40:0/891042451 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8a1815e0e0 msgr2=0x7f8a1815c5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:23.307 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:23.303+0000 7f8a1de49640 1 --2- 172.21.15.40:0/891042451 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8a1815e0e0 0x7f8a1815c5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:23.307 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:23.303+0000 7f8a1de49640 1 -- 172.21.15.40:0/891042451 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a140094d0 con 0x7f8a1806de20 2023-12-17T11:49:23.307 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:23.303+0000 7f8a1e64a640 1 --2- 172.21.15.40:0/891042451 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8a1815e0e0 0x7f8a1815c5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-17T11:49:23.307 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:23.303+0000 7f8a1d648640 1 --2- 172.21.15.40:0/891042451 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8a18157a60 0x7f8a1815c070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-17T11:49:23.307 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:23.304+0000 7f8a1de49640 1 --2- 172.21.15.40:0/891042451 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8a1806de20 0x7f8a181543c0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f8a0800e9e0 tx=0x7f8a0800eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:49:23.307 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:23.304+0000 7f8a0e7fc640 1 -- 172.21.15.40:0/891042451 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a08009670 con 0x7f8a1806de20 2023-12-17T11:49:23.308 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:23.304+0000 7f8a0e7fc640 1 -- 172.21.15.40:0/891042451 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a0800c9d0 con 0x7f8a1806de20 2023-12-17T11:49:23.308 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:23.304+0000 7f8a0e7fc640 1 -- 172.21.15.40:0/891042451 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a0800cd80 con 0x7f8a1806de20 2023-12-17T11:49:23.308 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:23.304+0000 7f8a200ad640 1 -- 172.21.15.40:0/891042451 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a18156920 con 0x7f8a1806de20 2023-12-17T11:49:23.308 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:23.304+0000 7f8a200ad640 1 -- 172.21.15.40:0/891042451 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a180b2f90 con 0x7f8a1806de20 2023-12-17T11:49:23.308 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:23.305+0000 7f8a200ad640 1 -- 172.21.15.40:0/891042451 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a180745d0 con 0x7f8a1806de20 2023-12-17T11:49:23.308 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:23.306+0000 7f8a0e7fc640 1 -- 172.21.15.40:0/891042451 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f8a08013470 con 0x7f8a1806de20 2023-12-17T11:49:23.309 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:23.308+0000 7f8a0e7fc640 1 --2- 172.21.15.40:0/891042451 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f8a0406ae40 0x7f8a0406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:23.310 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:23.308+0000 7f8a0e7fc640 1 -- 172.21.15.40:0/891042451 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f8a08089cc0 con 0x7f8a1806de20 2023-12-17T11:49:23.310 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:23.308+0000 7f8a1d648640 1 --2- 172.21.15.40:0/891042451 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f8a0406ae40 0x7f8a0406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:23.311 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:23.309+0000 7f8a1d648640 1 --2- 172.21.15.40:0/891042451 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f8a0406ae40 0x7f8a0406d300 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f8a14036000 tx=0x7f8a1403c040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:49:23.314 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:23.312+0000 7f8a0e7fc640 1 -- 172.21.15.40:0/891042451 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f8a08090080 con 0x7f8a1806de20 2023-12-17T11:49:23.526 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:23.524+0000 7f8a200ad640 1 -- 172.21.15.40:0/891042451 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f8a1815a0f0 con 0x7f8a1806de20 2023-12-17T11:49:23.527 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:23.525+0000 7f8a0e7fc640 1 -- 172.21.15.40:0/891042451 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v27) v1 ==== 80+0+0 (secure 0 0 0) 0x7f8a08017080 con 0x7f8a1806de20 2023-12-17T11:49:23.527 INFO:teuthology.orchestra.run.smithi040.stderr:listed 0 entries 2023-12-17T11:49:23.530 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:23.527+0000 7f8a200ad640 1 -- 172.21.15.40:0/891042451 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f8a0406ae40 msgr2=0x7f8a0406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:23.530 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:23.527+0000 7f8a200ad640 1 --2- 172.21.15.40:0/891042451 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f8a0406ae40 0x7f8a0406d300 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f8a14036000 tx=0x7f8a1403c040 comp rx=0 tx=0).stop 2023-12-17T11:49:23.530 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:23.527+0000 7f8a200ad640 1 -- 172.21.15.40:0/891042451 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8a1806de20 msgr2=0x7f8a181543c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:23.530 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:23.528+0000 7f8a200ad640 1 --2- 172.21.15.40:0/891042451 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8a1806de20 0x7f8a181543c0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f8a0800e9e0 tx=0x7f8a0800eea0 comp rx=0 tx=0).stop 2023-12-17T11:49:23.530 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:23.528+0000 7f8a200ad640 1 -- 172.21.15.40:0/891042451 shutdown_connections 2023-12-17T11:49:23.530 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:23.528+0000 7f8a200ad640 1 --2- 172.21.15.40:0/891042451 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f8a0406ae40 0x7f8a0406d300 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:23.530 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:23.528+0000 7f8a200ad640 1 --2- 172.21.15.40:0/891042451 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8a1815e0e0 0x7f8a1815c5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:23.530 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:23.528+0000 7f8a200ad640 1 --2- 172.21.15.40:0/891042451 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8a18157a60 0x7f8a1815c070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:23.531 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:23.528+0000 7f8a200ad640 1 --2- 172.21.15.40:0/891042451 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8a1806de20 0x7f8a181543c0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:23.531 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:23.528+0000 7f8a200ad640 1 -- 172.21.15.40:0/891042451 >> 172.21.15.40:0/891042451 conn(0x7f8a180b0a90 msgr2=0x7f8a180ad750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:49:23.531 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:23.528+0000 7f8a200ad640 1 -- 172.21.15.40:0/891042451 shutdown_connections 2023-12-17T11:49:23.531 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:23.528+0000 7f8a200ad640 1 -- 172.21.15.40:0/891042451 wait complete. 2023-12-17T11:49:23.548 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-12-17T11:49:23.549 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-17T11:49:23.549 DEBUG:teuthology.orchestra.run.smithi040:> sudo umount /home/ubuntu/cephtest/mnt.0 -f 2023-12-17T11:49:23.658 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi040.front.sepia.ceph.com 2023-12-17T11:49:23.658 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-17T11:49:23.658 DEBUG:teuthology.orchestra.run.smithi040:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-12-17T11:49:23.715 DEBUG:teuthology.orchestra.run.smithi159:> set -ex 2023-12-17T11:49:23.715 DEBUG:teuthology.orchestra.run.smithi159:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-17T11:49:23.775 DEBUG:teuthology.orchestra.run.smithi159:> set -ex 2023-12-17T11:49:23.775 DEBUG:teuthology.orchestra.run.smithi159:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-17T11:49:23.829 DEBUG:teuthology.orchestra.run.smithi159:> set -ex 2023-12-17T11:49:23.829 DEBUG:teuthology.orchestra.run.smithi159:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-17T11:49:23.880 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-17T11:49:24.113 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:24.111+0000 7f4424b27640 1 Processor -- start 2023-12-17T11:49:24.113 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:24.111+0000 7f4424b27640 1 -- start start 2023-12-17T11:49:24.115 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:24.113+0000 7f4424b27640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f442015e5d0 0x7f442006bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:24.115 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:24.113+0000 7f4424b27640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f44200ae200 0x7f4420070b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:24.115 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:24.113+0000 7f4424b27640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4420071f90 con 0x7f442006c330 2023-12-17T11:49:24.115 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:24.113+0000 7f4424b27640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4420072270 con 0x7f44200ae200 2023-12-17T11:49:24.116 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:24.113+0000 7f4424b27640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4420070070 con 0x7f442015e5d0 2023-12-17T11:49:24.116 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:24.113+0000 7f441effd640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f44200ae200 0x7f4420070b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:24.116 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:24.113+0000 7f441effd640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f44200ae200 0x7f4420070b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:48404/0 (socket says 172.21.15.40:48404) 2023-12-17T11:49:24.116 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:24.113+0000 7f441effd640 1 -- 172.21.15.40:0/2204280475 learned_addr learned my addr 172.21.15.40:0/2204280475 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-17T11:49:24.116 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:24.114+0000 7f441effd640 1 -- 172.21.15.40:0/2204280475 >> v2:172.21.15.159:3300/0 conn(0x7f442015e5d0 msgr2=0x7f442006bdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:49:24.116 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:24.114+0000 7f441f7fe640 1 --2- 172.21.15.40:0/2204280475 >> v2:172.21.15.159:3300/0 conn(0x7f442015e5d0 0x7f442006bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:24.117 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:24.114+0000 7f441effd640 1 --2- 172.21.15.40:0/2204280475 >> v2:172.21.15.159:3300/0 conn(0x7f442015e5d0 0x7f442006bdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:24.117 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:24.114+0000 7f441effd640 1 -- 172.21.15.40:0/2204280475 >> v1:172.21.15.159:6789/0 conn(0x7f442006c330 legacy=0x7f44200cded0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:49:24.117 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:24.114+0000 7f441effd640 1 -- 172.21.15.40:0/2204280475 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4420070350 con 0x7f44200ae200 2023-12-17T11:49:24.117 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:24.114+0000 7f441f7fe640 1 --2- 172.21.15.40:0/2204280475 >> v2:172.21.15.159:3300/0 conn(0x7f442015e5d0 0x7f442006bdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-17T11:49:24.118 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:24.115+0000 7f441effd640 1 --2- 172.21.15.40:0/2204280475 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f44200ae200 0x7f4420070b50 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f442006bb50 tx=0x7f441402b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2cdc709a45580bd4 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:49:24.118 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:24.115+0000 7f441e7fc640 1 -- 172.21.15.40:0/2204280475 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4414031800 con 0x7f44200ae200 2023-12-17T11:49:24.118 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:24.115+0000 7f441e7fc640 1 -- 172.21.15.40:0/2204280475 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4414031960 con 0x7f44200ae200 2023-12-17T11:49:24.118 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:24.116+0000 7f441e7fc640 1 -- 172.21.15.40:0/2204280475 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4414031cf0 con 0x7f44200ae200 2023-12-17T11:49:24.118 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:24.116+0000 7f4424b27640 1 -- 172.21.15.40:0/2204280475 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f44200ae200 msgr2=0x7f4420070b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:24.118 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:24.116+0000 7f4424b27640 1 --2- 172.21.15.40:0/2204280475 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f44200ae200 0x7f4420070b50 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f442006bb50 tx=0x7f441402b8a0 comp rx=0 tx=0).stop 2023-12-17T11:49:24.118 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:24.116+0000 7f4424b27640 1 -- 172.21.15.40:0/2204280475 shutdown_connections 2023-12-17T11:49:24.119 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:24.116+0000 7f4424b27640 1 --2- 172.21.15.40:0/2204280475 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f44200ae200 0x7f4420070b50 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:24.119 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:24.116+0000 7f4424b27640 1 --2- 172.21.15.40:0/2204280475 >> v2:172.21.15.159:3300/0 conn(0x7f442015e5d0 0x7f442006bdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:24.119 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:24.116+0000 7f4424b27640 1 -- 172.21.15.40:0/2204280475 >> 172.21.15.40:0/2204280475 conn(0x7f44200b0860 msgr2=0x7f44200b0c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:49:24.119 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:24.116+0000 7f4424b27640 1 -- 172.21.15.40:0/2204280475 shutdown_connections 2023-12-17T11:49:24.119 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:24.116+0000 7f4424b27640 1 -- 172.21.15.40:0/2204280475 wait complete. 2023-12-17T11:49:24.120 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:24.118+0000 7f4424b27640 1 Processor -- start 2023-12-17T11:49:24.120 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:24.118+0000 7f4424b27640 1 -- start start 2023-12-17T11:49:24.122 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:24.119+0000 7f4424b27640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f442006c330 0x7f4420157850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:24.122 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:24.119+0000 7f4424b27640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f44200ae200 0x7f4420148800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:24.122 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:24.119+0000 7f4424b27640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f442015e5d0 0x7f442009b3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:24.122 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:24.119+0000 7f4424b27640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f442009a390 con 0x7f442015e5d0 2023-12-17T11:49:24.122 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:24.119+0000 7f4424b27640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f442009b8f0 con 0x7f44200ae200 2023-12-17T11:49:24.122 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:24.119+0000 7f4424b27640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4420148e90 con 0x7f442006c330 2023-12-17T11:49:24.122 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:24.120+0000 7f441ffff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f442015e5d0 0x7f442009b3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:24.123 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:24.120+0000 7f441ffff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f442015e5d0 0x7f442009b3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:48412/0 (socket says 172.21.15.40:48412) 2023-12-17T11:49:24.123 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:24.120+0000 7f441ffff640 1 -- 172.21.15.40:0/4266972597 learned_addr learned my addr 172.21.15.40:0/4266972597 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-17T11:49:24.123 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:24.120+0000 7f441f7fe640 1 --2- 172.21.15.40:0/4266972597 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f442006c330 0x7f4420157850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:24.124 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:24.120+0000 7f441effd640 1 --2- 172.21.15.40:0/4266972597 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f44200ae200 0x7f4420148800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:24.124 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:24.120+0000 7f441ffff640 1 -- 172.21.15.40:0/4266972597 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f442006c330 msgr2=0x7f4420157850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:24.124 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:24.120+0000 7f441ffff640 1 --2- 172.21.15.40:0/4266972597 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f442006c330 0x7f4420157850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:24.124 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:24.120+0000 7f441ffff640 1 -- 172.21.15.40:0/4266972597 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f44200ae200 msgr2=0x7f4420148800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:24.124 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:24.120+0000 7f441ffff640 1 --2- 172.21.15.40:0/4266972597 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f44200ae200 0x7f4420148800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:24.124 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:24.120+0000 7f441ffff640 1 -- 172.21.15.40:0/4266972597 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44140094d0 con 0x7f442015e5d0 2023-12-17T11:49:24.124 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:24.121+0000 7f441ffff640 1 --2- 172.21.15.40:0/4266972597 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f442015e5d0 0x7f442009b3b0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f441800c7b0 tx=0x7f441800cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:49:24.124 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:24.121+0000 7f4407fff640 1 -- 172.21.15.40:0/4266972597 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4418003d80 con 0x7f442015e5d0 2023-12-17T11:49:24.124 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:24.121+0000 7f4407fff640 1 -- 172.21.15.40:0/4266972597 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4418005070 con 0x7f442015e5d0 2023-12-17T11:49:24.124 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:24.121+0000 7f4407fff640 1 -- 172.21.15.40:0/4266972597 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4418005420 con 0x7f442015e5d0 2023-12-17T11:49:24.125 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:24.121+0000 7f4424b27640 1 -- 172.21.15.40:0/4266972597 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44200999f0 con 0x7f442015e5d0 2023-12-17T11:49:24.125 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:24.121+0000 7f4424b27640 1 -- 172.21.15.40:0/4266972597 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4420099fb0 con 0x7f442015e5d0 2023-12-17T11:49:24.125 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:24.122+0000 7f4424b27640 1 -- 172.21.15.40:0/4266972597 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f442009a4d0 con 0x7f442015e5d0 2023-12-17T11:49:24.125 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:24.123+0000 7f4407fff640 1 -- 172.21.15.40:0/4266972597 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f4418005580 con 0x7f442015e5d0 2023-12-17T11:49:24.126 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:24.124+0000 7f4407fff640 1 --2- 172.21.15.40:0/4266972597 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f440c06ae40 0x7f440c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:24.126 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:24.124+0000 7f4407fff640 1 -- 172.21.15.40:0/4266972597 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f4418088e90 con 0x7f442015e5d0 2023-12-17T11:49:24.127 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:24.125+0000 7f441f7fe640 1 --2- 172.21.15.40:0/4266972597 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f440c06ae40 0x7f440c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:24.128 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:24.126+0000 7f441f7fe640 1 --2- 172.21.15.40:0/4266972597 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f440c06ae40 0x7f440c06d300 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f441000a950 tx=0x7f4410008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:49:24.131 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:24.129+0000 7f4407fff640 1 -- 172.21.15.40:0/4266972597 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f442009a4d0 con 0x7f442015e5d0 2023-12-17T11:49:24.326 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:24.324+0000 7f4424b27640 1 -- 172.21.15.40:0/4266972597 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f442009a4d0 con 0x7f442015e5d0 2023-12-17T11:49:24.328 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:24.326+0000 7f4407fff640 1 -- 172.21.15.40:0/4266972597 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+18697 (secure 0 0 0) 0x7f4418080e60 con 0x7f442015e5d0 2023-12-17T11:49:24.328 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T11:49:24.328 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":27,"fsid":"099cd35d-80d9-4ca4-8424-de13b3b03ac7","created":"2023-12-17T11:47:53.450097+0000","modified":"2023-12-17T11:49:00.483840+0000","last_up_change":"2023-12-17T11:48:05.724195+0000","last_in_change":"2023-12-17T11:47:56.956499+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-17T11:48:06.668943+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-17T11:48:16.151444+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-17T11:48:16.717726+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-17T11:48:20.534819+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a88bfd46-63b8-48b1-9c0e-5c9cdc31bd38","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":555204741},{"type":"v1","addr":"172.21.15.40:6802","nonce":555204741}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":555204741},{"type":"v1","addr":"172.21.15.40:6807","nonce":555204741}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":555204741},{"type":"v1","addr":"172.21.15.40:6815","nonce":555204741}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6809","nonce":555204741},{"type":"v1","addr":"172.21.15.40:6812","nonce":555204741}]},"public_addr":"172.21.15.40:6802/555204741","cluster_addr":"172.21.15.40:6807/555204741","heartbeat_back_addr":"172.21.15.40:6815/555204741","heartbeat_front_addr":"172.21.15.40:6812/555204741","state":["exists","up"]},{"osd":1,"uuid":"c5d628ae-36f4-4866-802c-b162f0e90add","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6801","nonce":1221318112},{"type":"v1","addr":"172.21.15.40:6803","nonce":1221318112}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6805","nonce":1221318112},{"type":"v1","addr":"172.21.15.40:6806","nonce":1221318112}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6811","nonce":1221318112},{"type":"v1","addr":"172.21.15.40:6813","nonce":1221318112}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":1221318112},{"type":"v1","addr":"172.21.15.40:6810","nonce":1221318112}]},"public_addr":"172.21.15.40:6803/1221318112","cluster_addr":"172.21.15.40:6806/1221318112","heartbeat_back_addr":"172.21.15.40:6813/1221318112","heartbeat_front_addr":"172.21.15.40:6810/1221318112","state":["exists","up"]},{"osd":2,"uuid":"d986ad6a-af2f-47fc-9c3b-fbda27b82b73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":1959000265},{"type":"v1","addr":"172.21.15.40:6817","nonce":1959000265}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6818","nonce":1959000265},{"type":"v1","addr":"172.21.15.40:6819","nonce":1959000265}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":1959000265},{"type":"v1","addr":"172.21.15.40:6827","nonce":1959000265}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":1959000265},{"type":"v1","addr":"172.21.15.40:6822","nonce":1959000265}]},"public_addr":"172.21.15.40:6817/1959000265","cluster_addr":"172.21.15.40:6819/1959000265","heartbeat_back_addr":"172.21.15.40:6827/1959000265","heartbeat_front_addr":"172.21.15.40:6822/1959000265","state":["exists","up"]},{"osd":3,"uuid":"d79d22b7-be05-41b2-b95d-697db677fd02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6821","nonce":974040287},{"type":"v1","addr":"172.21.15.40:6823","nonce":974040287}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6825","nonce":974040287},{"type":"v1","addr":"172.21.15.40:6826","nonce":974040287}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":974040287},{"type":"v1","addr":"172.21.15.40:6831","nonce":974040287}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":974040287},{"type":"v1","addr":"172.21.15.40:6829","nonce":974040287}]},"public_addr":"172.21.15.40:6823/974040287","cluster_addr":"172.21.15.40:6826/974040287","heartbeat_back_addr":"172.21.15.40:6831/974040287","heartbeat_front_addr":"172.21.15.40:6829/974040287","state":["exists","up"]},{"osd":4,"uuid":"62a7a233-d3ea-40be-91de-180c0208d639","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6808","nonce":3937787733},{"type":"v1","addr":"172.21.15.159:6809","nonce":3937787733}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6810","nonce":3937787733},{"type":"v1","addr":"172.21.15.159:6811","nonce":3937787733}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6814","nonce":3937787733},{"type":"v1","addr":"172.21.15.159:6815","nonce":3937787733}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6812","nonce":3937787733},{"type":"v1","addr":"172.21.15.159:6813","nonce":3937787733}]},"public_addr":"172.21.15.159:6809/3937787733","cluster_addr":"172.21.15.159:6811/3937787733","heartbeat_back_addr":"172.21.15.159:6815/3937787733","heartbeat_front_addr":"172.21.15.159:6813/3937787733","state":["exists","up"]},{"osd":5,"uuid":"84629cea-dc0e-4b5e-b203-5ea963839281","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6816","nonce":3032505240},{"type":"v1","addr":"172.21.15.159:6817","nonce":3032505240}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6818","nonce":3032505240},{"type":"v1","addr":"172.21.15.159:6819","nonce":3032505240}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6822","nonce":3032505240},{"type":"v1","addr":"172.21.15.159:6823","nonce":3032505240}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6820","nonce":3032505240},{"type":"v1","addr":"172.21.15.159:6821","nonce":3032505240}]},"public_addr":"172.21.15.159:6817/3032505240","cluster_addr":"172.21.15.159:6819/3032505240","heartbeat_back_addr":"172.21.15.159:6823/3032505240","heartbeat_front_addr":"172.21.15.159:6821/3032505240","state":["exists","up"]},{"osd":6,"uuid":"4ae3af3a-1743-4070-a91d-8be5c31cdb04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6800","nonce":2411788597},{"type":"v1","addr":"172.21.15.159:6801","nonce":2411788597}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6802","nonce":2411788597},{"type":"v1","addr":"172.21.15.159:6803","nonce":2411788597}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6806","nonce":2411788597},{"type":"v1","addr":"172.21.15.159:6807","nonce":2411788597}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6804","nonce":2411788597},{"type":"v1","addr":"172.21.15.159:6805","nonce":2411788597}]},"public_addr":"172.21.15.159:6801/2411788597","cluster_addr":"172.21.15.159:6803/2411788597","heartbeat_back_addr":"172.21.15.159:6807/2411788597","heartbeat_front_addr":"172.21.15.159:6805/2411788597","state":["exists","up"]},{"osd":7,"uuid":"c1f4c7f2-8f75-4f95-bc63-a332773e3b8e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6824","nonce":478953349},{"type":"v1","addr":"172.21.15.159:6825","nonce":478953349}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6826","nonce":478953349},{"type":"v1","addr":"172.21.15.159:6827","nonce":478953349}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6830","nonce":478953349},{"type":"v1","addr":"172.21.15.159:6831","nonce":478953349}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6828","nonce":478953349},{"type":"v1","addr":"172.21.15.159:6829","nonce":478953349}]},"public_addr":"172.21.15.159:6825/478953349","cluster_addr":"172.21.15.159:6827/478953349","heartbeat_back_addr":"172.21.15.159:6831/478953349","heartbeat_front_addr":"172.21.15.159:6829/478953349","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T11:48:02.023567+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T11:48:02.278216+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T11:48:02.311843+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T11:48:01.773372+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T11:48:02.618910+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T11:48:02.361559+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T11:48:02.223997+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T11:48:02.604403+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.2","mappings":[{"from":3,"to":2}]},{"pgid":"3.d","mappings":[{"from":5,"to":1}]},{"pgid":"3.13","mappings":[{"from":7,"to":2}]},{"pgid":"3.17","mappings":[{"from":0,"to":2}]},{"pgid":"3.38","mappings":[{"from":5,"to":1}]},{"pgid":"4.2","mappings":[{"from":1,"to":2}]},{"pgid":"4.10","mappings":[{"from":1,"to":2}]},{"pgid":"4.18","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-17T11:49:24.331 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:24.329+0000 7f4424b27640 1 -- 172.21.15.40:0/4266972597 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f440c06ae40 msgr2=0x7f440c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:24.331 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:24.329+0000 7f4424b27640 1 --2- 172.21.15.40:0/4266972597 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f440c06ae40 0x7f440c06d300 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f441000a950 tx=0x7f4410008040 comp rx=0 tx=0).stop 2023-12-17T11:49:24.331 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:24.329+0000 7f4424b27640 1 -- 172.21.15.40:0/4266972597 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f442015e5d0 msgr2=0x7f442009b3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:24.331 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:24.329+0000 7f4424b27640 1 --2- 172.21.15.40:0/4266972597 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f442015e5d0 0x7f442009b3b0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f441800c7b0 tx=0x7f441800cc70 comp rx=0 tx=0).stop 2023-12-17T11:49:24.331 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:24.329+0000 7f4424b27640 1 -- 172.21.15.40:0/4266972597 shutdown_connections 2023-12-17T11:49:24.331 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:24.329+0000 7f4424b27640 1 --2- 172.21.15.40:0/4266972597 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f440c06ae40 0x7f440c06d300 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:24.331 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:24.329+0000 7f4424b27640 1 --2- 172.21.15.40:0/4266972597 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f442015e5d0 0x7f442009b3b0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:24.331 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:24.329+0000 7f4424b27640 1 --2- 172.21.15.40:0/4266972597 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f44200ae200 0x7f4420148800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:24.332 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:24.329+0000 7f4424b27640 1 --2- 172.21.15.40:0/4266972597 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f442006c330 0x7f4420157850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:24.332 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:24.329+0000 7f4424b27640 1 -- 172.21.15.40:0/4266972597 >> 172.21.15.40:0/4266972597 conn(0x7f44200b0860 msgr2=0x7f442015ea40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:49:24.332 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:24.329+0000 7f4424b27640 1 -- 172.21.15.40:0/4266972597 shutdown_connections 2023-12-17T11:49:24.332 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:24.329+0000 7f4424b27640 1 -- 172.21.15.40:0/4266972597 wait complete. 2023-12-17T11:49:24.349 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-17T11:48:06.668943+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-17T11:48:16.151444+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-17T11:48:16.717726+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-12-17T11:48:20.534819+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-12-17T11:49:24.350 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-17T11:49:24.590 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:24.588+0000 7fb58eef3640 1 Processor -- start 2023-12-17T11:49:24.590 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:24.588+0000 7fb58eef3640 1 -- start start 2023-12-17T11:49:24.592 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:24.590+0000 7fb58eef3640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fb58815af50 0x7fb58806c170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:24.592 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:24.590+0000 7fb58eef3640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb5880ce7e0 0x7fb58815ec00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:24.592 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:24.590+0000 7fb58eef3640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7fb58806a460 0x7fb58806a8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:24.592 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:24.590+0000 7fb58eef3640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb58806ae30 con 0x7fb58815af50 2023-12-17T11:49:24.592 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:24.590+0000 7fb58eef3640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5880717e0 con 0x7fb58806a460 2023-12-17T11:49:24.592 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:24.590+0000 7fb58eef3640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb588071cd0 con 0x7fb5880ce7e0 2023-12-17T11:49:24.592 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:24.590+0000 7fb58cc8f640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fb58815af50 0x7fb58806c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:24.593 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:24.590+0000 7fb58cc8f640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fb58815af50 0x7fb58806c170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:48426/0 (socket says 172.21.15.40:48426) 2023-12-17T11:49:24.593 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:24.590+0000 7fb58cc8f640 1 -- 172.21.15.40:0/2382993344 learned_addr learned my addr 172.21.15.40:0/2382993344 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-17T11:49:24.593 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:24.590+0000 7fb58d490640 1 --2- 172.21.15.40:0/2382993344 >> v2:172.21.15.159:3300/0 conn(0x7fb58806a460 0x7fb58806a8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:24.594 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:24.590+0000 7fb587fff640 1 --2- 172.21.15.40:0/2382993344 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb5880ce7e0 0x7fb58815ec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:24.594 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:24.591+0000 7fb58cc8f640 1 -- 172.21.15.40:0/2382993344 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb5880ce7e0 msgr2=0x7fb58815ec00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:49:24.594 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:24.591+0000 7fb58cc8f640 1 --2- 172.21.15.40:0/2382993344 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb5880ce7e0 0x7fb58815ec00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:24.594 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:24.591+0000 7fb58cc8f640 1 -- 172.21.15.40:0/2382993344 >> v2:172.21.15.159:3300/0 conn(0x7fb58806a460 msgr2=0x7fb58806a8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:49:24.594 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:24.591+0000 7fb58cc8f640 1 --2- 172.21.15.40:0/2382993344 >> v2:172.21.15.159:3300/0 conn(0x7fb58806a460 0x7fb58806a8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:24.594 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:24.591+0000 7fb58cc8f640 1 -- 172.21.15.40:0/2382993344 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb58806c6b0 con 0x7fb58815af50 2023-12-17T11:49:24.594 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:24.591+0000 7fb587fff640 1 --2- 172.21.15.40:0/2382993344 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb5880ce7e0 0x7fb58815ec00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-17T11:49:24.594 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:24.591+0000 7fb58d490640 1 --2- 172.21.15.40:0/2382993344 >> v2:172.21.15.159:3300/0 conn(0x7fb58806a460 0x7fb58806a8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-17T11:49:24.594 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:24.592+0000 7fb58cc8f640 1 --2- 172.21.15.40:0/2382993344 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb58815af50 0x7fb58806c170 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fb5880cec40 tx=0x7fb57802b7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71409ce04cf5f6cf server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:49:24.595 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:24.592+0000 7fb5877fe640 1 -- 172.21.15.40:0/2382993344 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb578031750 con 0x7fb58815af50 2023-12-17T11:49:24.595 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:24.592+0000 7fb5877fe640 1 -- 172.21.15.40:0/2382993344 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5780318b0 con 0x7fb58815af50 2023-12-17T11:49:24.596 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:24.592+0000 7fb5877fe640 1 -- 172.21.15.40:0/2382993344 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb578031c40 con 0x7fb58815af50 2023-12-17T11:49:24.596 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:24.593+0000 7fb58eef3640 1 -- 172.21.15.40:0/2382993344 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb58815af50 msgr2=0x7fb58806c170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:24.596 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:24.593+0000 7fb58eef3640 1 --2- 172.21.15.40:0/2382993344 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb58815af50 0x7fb58806c170 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fb5880cec40 tx=0x7fb57802b7f0 comp rx=0 tx=0).stop 2023-12-17T11:49:24.596 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:24.593+0000 7fb58eef3640 1 -- 172.21.15.40:0/2382993344 shutdown_connections 2023-12-17T11:49:24.596 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:24.593+0000 7fb58eef3640 1 --2- 172.21.15.40:0/2382993344 >> v2:172.21.15.159:3300/0 conn(0x7fb58806a460 0x7fb58806a8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:24.596 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:24.593+0000 7fb58eef3640 1 --2- 172.21.15.40:0/2382993344 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb5880ce7e0 0x7fb58815ec00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:24.596 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:24.593+0000 7fb58eef3640 1 --2- 172.21.15.40:0/2382993344 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb58815af50 0x7fb58806c170 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:24.596 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:24.593+0000 7fb58eef3640 1 -- 172.21.15.40:0/2382993344 >> 172.21.15.40:0/2382993344 conn(0x7fb5880cee70 msgr2=0x7fb5880cf280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:49:24.596 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:24.593+0000 7fb58eef3640 1 -- 172.21.15.40:0/2382993344 shutdown_connections 2023-12-17T11:49:24.596 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:24.593+0000 7fb58eef3640 1 -- 172.21.15.40:0/2382993344 wait complete. 2023-12-17T11:49:24.597 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:24.595+0000 7fb58eef3640 1 Processor -- start 2023-12-17T11:49:24.597 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:24.595+0000 7fb58eef3640 1 -- start start 2023-12-17T11:49:24.599 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:24.596+0000 7fb58eef3640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb58806a460 0x7fb5880c8720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:24.599 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:24.596+0000 7fb58eef3640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb5880ce7e0 0x7fb5880c5d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:24.599 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:24.596+0000 7fb58eef3640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb58815af50 0x7fb5880999f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:24.599 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:24.596+0000 7fb58eef3640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb58814f590 con 0x7fb5880ce7e0 2023-12-17T11:49:24.599 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:24.596+0000 7fb58eef3640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb588099f30 con 0x7fb58806a460 2023-12-17T11:49:24.599 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:24.596+0000 7fb58eef3640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5880c8d00 con 0x7fb58815af50 2023-12-17T11:49:24.599 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:24.597+0000 7fb587fff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb5880ce7e0 0x7fb5880c5d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:24.600 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:24.597+0000 7fb587fff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb5880ce7e0 0x7fb5880c5d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:48434/0 (socket says 172.21.15.40:48434) 2023-12-17T11:49:24.600 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:24.597+0000 7fb587fff640 1 -- 172.21.15.40:0/2084195179 learned_addr learned my addr 172.21.15.40:0/2084195179 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-17T11:49:24.600 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:24.597+0000 7fb58d490640 1 --2- 172.21.15.40:0/2084195179 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb58815af50 0x7fb5880999f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:24.600 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:24.597+0000 7fb58cc8f640 1 --2- 172.21.15.40:0/2084195179 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb58806a460 0x7fb5880c8720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:24.600 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:24.597+0000 7fb587fff640 1 -- 172.21.15.40:0/2084195179 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb58815af50 msgr2=0x7fb5880999f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:24.600 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:24.597+0000 7fb587fff640 1 --2- 172.21.15.40:0/2084195179 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb58815af50 0x7fb5880999f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:24.600 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:24.597+0000 7fb587fff640 1 -- 172.21.15.40:0/2084195179 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb58806a460 msgr2=0x7fb5880c8720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:24.600 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:24.597+0000 7fb587fff640 1 --2- 172.21.15.40:0/2084195179 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb58806a460 0x7fb5880c8720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:24.600 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:24.597+0000 7fb587fff640 1 -- 172.21.15.40:0/2084195179 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5780094d0 con 0x7fb5880ce7e0 2023-12-17T11:49:24.601 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:24.597+0000 7fb587fff640 1 --2- 172.21.15.40:0/2084195179 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb5880ce7e0 0x7fb5880c5d60 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fb57c00c820 tx=0x7fb57c00cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:49:24.601 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:24.598+0000 7fb5857fa640 1 -- 172.21.15.40:0/2084195179 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb57c007a30 con 0x7fb5880ce7e0 2023-12-17T11:49:24.601 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:24.598+0000 7fb5857fa640 1 -- 172.21.15.40:0/2084195179 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb57c007b90 con 0x7fb5880ce7e0 2023-12-17T11:49:24.601 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:24.598+0000 7fb58eef3640 1 -- 172.21.15.40:0/2084195179 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb58809b6d0 con 0x7fb5880ce7e0 2023-12-17T11:49:24.601 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:24.598+0000 7fb5857fa640 1 -- 172.21.15.40:0/2084195179 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb57c00ce70 con 0x7fb5880ce7e0 2023-12-17T11:49:24.602 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:24.598+0000 7fb58eef3640 1 -- 172.21.15.40:0/2084195179 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb58809bc90 con 0x7fb5880ce7e0 2023-12-17T11:49:24.602 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:24.599+0000 7fb58eef3640 1 -- 172.21.15.40:0/2084195179 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb58809be80 con 0x7fb5880ce7e0 2023-12-17T11:49:24.602 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:24.601+0000 7fb5857fa640 1 -- 172.21.15.40:0/2084195179 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fb57c0113f0 con 0x7fb5880ce7e0 2023-12-17T11:49:24.603 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:24.602+0000 7fb5857fa640 1 --2- 172.21.15.40:0/2084195179 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7fb57406ae40 0x7fb57406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:24.603 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:24.602+0000 7fb5857fa640 1 -- 172.21.15.40:0/2084195179 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6692+0+0 (secure 0 0 0) 0x7fb57c089ae0 con 0x7fb5880ce7e0 2023-12-17T11:49:24.604 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:24.602+0000 7fb58cc8f640 1 --2- 172.21.15.40:0/2084195179 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7fb57406ae40 0x7fb57406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:24.605 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:24.603+0000 7fb58cc8f640 1 --2- 172.21.15.40:0/2084195179 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7fb57406ae40 0x7fb57406d300 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fb578035000 tx=0x7fb578008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:49:24.608 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:24.606+0000 7fb5857fa640 1 -- 172.21.15.40:0/2084195179 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fb57c0547a0 con 0x7fb5880ce7e0 2023-12-17T11:49:24.805 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:24.803+0000 7fb58eef3640 1 -- 172.21.15.40:0/2084195179 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fb588074450 con 0x7fb5880ce7e0 2023-12-17T11:49:24.806 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:24.804+0000 7fb5857fa640 1 -- 172.21.15.40:0/2084195179 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) v1 ==== 93+0+10 (secure 0 0 0) 0x7fb57c01f020 con 0x7fb5880ce7e0 2023-12-17T11:49:24.807 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 1 2023-12-17T11:49:24.809 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:24.807+0000 7fb58eef3640 1 -- 172.21.15.40:0/2084195179 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7fb57406ae40 msgr2=0x7fb57406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:24.809 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:24.807+0000 7fb58eef3640 1 --2- 172.21.15.40:0/2084195179 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7fb57406ae40 0x7fb57406d300 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fb578035000 tx=0x7fb578008030 comp rx=0 tx=0).stop 2023-12-17T11:49:24.810 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:24.807+0000 7fb58eef3640 1 -- 172.21.15.40:0/2084195179 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb5880ce7e0 msgr2=0x7fb5880c5d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:24.810 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:24.807+0000 7fb58eef3640 1 --2- 172.21.15.40:0/2084195179 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb5880ce7e0 0x7fb5880c5d60 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fb57c00c820 tx=0x7fb57c00cc20 comp rx=0 tx=0).stop 2023-12-17T11:49:24.810 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:24.807+0000 7fb58eef3640 1 -- 172.21.15.40:0/2084195179 shutdown_connections 2023-12-17T11:49:24.810 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:24.807+0000 7fb58eef3640 1 --2- 172.21.15.40:0/2084195179 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7fb57406ae40 0x7fb57406d300 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:24.810 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:24.807+0000 7fb58eef3640 1 --2- 172.21.15.40:0/2084195179 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb58815af50 0x7fb5880999f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:24.810 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:24.807+0000 7fb58eef3640 1 --2- 172.21.15.40:0/2084195179 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb5880ce7e0 0x7fb5880c5d60 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:24.810 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:24.807+0000 7fb58eef3640 1 --2- 172.21.15.40:0/2084195179 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb58806a460 0x7fb5880c8720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:24.810 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:24.807+0000 7fb58eef3640 1 -- 172.21.15.40:0/2084195179 >> 172.21.15.40:0/2084195179 conn(0x7fb5880cee70 msgr2=0x7fb58815e100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:49:24.810 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:24.808+0000 7fb58eef3640 1 -- 172.21.15.40:0/2084195179 shutdown_connections 2023-12-17T11:49:24.810 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:24.808+0000 7fb58eef3640 1 -- 172.21.15.40:0/2084195179 wait complete. 2023-12-17T11:49:24.828 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-17T11:49:25.048 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:25.046+0000 7f02c957c640 1 Processor -- start 2023-12-17T11:49:25.049 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:25.047+0000 7f02c957c640 1 -- start start 2023-12-17T11:49:25.051 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:25.048+0000 7f02c957c640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f02c40b2b90 0x7f02c415e5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:25.051 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:25.048+0000 7f02c957c640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f02c40cf7e0 0x7f02c40cfc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:25.052 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:25.049+0000 7f02c957c640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02c406d5e0 con 0x7f02c40b2f70 2023-12-17T11:49:25.052 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:25.049+0000 7f02c957c640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02c40cf350 con 0x7f02c40b2b90 2023-12-17T11:49:25.052 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:25.049+0000 7f02c957c640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02c4157f30 con 0x7f02c40cf7e0 2023-12-17T11:49:25.052 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:25.049+0000 7f02c2ffd640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f02c40b2b90 0x7f02c415e5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:25.052 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:25.049+0000 7f02c2ffd640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f02c40b2b90 0x7f02c415e5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:38514/0 (socket says 172.21.15.40:38514) 2023-12-17T11:49:25.052 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:25.049+0000 7f02c2ffd640 1 -- 172.21.15.40:0/502688089 learned_addr learned my addr 172.21.15.40:0/502688089 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-17T11:49:25.052 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:25.049+0000 7f02c37fe640 1 --2- 172.21.15.40:0/502688089 >> v2:172.21.15.159:3300/0 conn(0x7f02c40cf7e0 0x7f02c40cfc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:25.052 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:25.049+0000 7f02c2ffd640 1 -- 172.21.15.40:0/502688089 >> v2:172.21.15.159:3300/0 conn(0x7f02c40cf7e0 msgr2=0x7f02c40cfc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:49:25.052 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:25.049+0000 7f02c2ffd640 1 --2- 172.21.15.40:0/502688089 >> v2:172.21.15.159:3300/0 conn(0x7f02c40cf7e0 0x7f02c40cfc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:25.052 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:25.049+0000 7f02c2ffd640 1 -- 172.21.15.40:0/502688089 >> v1:172.21.15.159:6789/0 conn(0x7f02c40b2f70 legacy=0x7f02c406c510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:49:25.052 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:25.050+0000 7f02c2ffd640 1 -- 172.21.15.40:0/502688089 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02c406cd40 con 0x7f02c40b2b90 2023-12-17T11:49:25.053 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:25.051+0000 7f02c2ffd640 1 --2- 172.21.15.40:0/502688089 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f02c40b2b90 0x7f02c415e5d0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f02c406f740 tx=0x7f02b402b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=570798560b276aba server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:49:25.053 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:25.051+0000 7f02c27fc640 1 -- 172.21.15.40:0/502688089 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02b4031870 con 0x7f02c40b2b90 2023-12-17T11:49:25.054 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:25.052+0000 7f02c27fc640 1 -- 172.21.15.40:0/502688089 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02b40319d0 con 0x7f02c40b2b90 2023-12-17T11:49:25.054 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:25.052+0000 7f02c27fc640 1 -- 172.21.15.40:0/502688089 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02b4031d60 con 0x7f02c40b2b90 2023-12-17T11:49:25.054 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:25.052+0000 7f02c957c640 1 -- 172.21.15.40:0/502688089 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f02c40b2b90 msgr2=0x7f02c415e5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:25.054 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:25.052+0000 7f02c957c640 1 --2- 172.21.15.40:0/502688089 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f02c40b2b90 0x7f02c415e5d0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f02c406f740 tx=0x7f02b402b910 comp rx=0 tx=0).stop 2023-12-17T11:49:25.055 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:25.052+0000 7f02c957c640 1 -- 172.21.15.40:0/502688089 shutdown_connections 2023-12-17T11:49:25.055 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:25.052+0000 7f02c957c640 1 --2- 172.21.15.40:0/502688089 >> v2:172.21.15.159:3300/0 conn(0x7f02c40cf7e0 0x7f02c40cfc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:25.055 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:25.052+0000 7f02c957c640 1 --2- 172.21.15.40:0/502688089 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f02c40b2b90 0x7f02c415e5d0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:25.055 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:25.052+0000 7f02c957c640 1 -- 172.21.15.40:0/502688089 >> 172.21.15.40:0/502688089 conn(0x7f02c40b6420 msgr2=0x7f02c40b6800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:49:25.055 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:25.052+0000 7f02c957c640 1 -- 172.21.15.40:0/502688089 shutdown_connections 2023-12-17T11:49:25.055 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:25.053+0000 7f02c957c640 1 -- 172.21.15.40:0/502688089 wait complete. 2023-12-17T11:49:25.056 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:25.054+0000 7f02c957c640 1 Processor -- start 2023-12-17T11:49:25.056 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:25.055+0000 7f02c957c640 1 -- start start 2023-12-17T11:49:25.058 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:25.055+0000 7f02c957c640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f02c40b2b90 0x7f02c413e800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:25.058 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:25.055+0000 7f02c957c640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f02c40b2f70 0x7f02c41412c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:25.058 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:25.056+0000 7f02c957c640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f02c40cf7e0 0x7f02c41f2be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:25.058 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:25.056+0000 7f02c957c640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02c413e570 con 0x7f02c40cf7e0 2023-12-17T11:49:25.058 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:25.056+0000 7f02c957c640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02c4141800 con 0x7f02c40b2f70 2023-12-17T11:49:25.058 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:25.056+0000 7f02c957c640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02c413eec0 con 0x7f02c40b2b90 2023-12-17T11:49:25.058 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:25.056+0000 7f02c37fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f02c40cf7e0 0x7f02c41f2be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:25.058 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:25.056+0000 7f02c37fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f02c40cf7e0 0x7f02c41f2be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:38516/0 (socket says 172.21.15.40:38516) 2023-12-17T11:49:25.058 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:25.056+0000 7f02c37fe640 1 -- 172.21.15.40:0/1352015666 learned_addr learned my addr 172.21.15.40:0/1352015666 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-17T11:49:25.058 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:25.056+0000 7f02c2ffd640 1 --2- 172.21.15.40:0/1352015666 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f02c40b2b90 0x7f02c413e800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:25.060 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:25.056+0000 7f02bbfff640 1 --2- 172.21.15.40:0/1352015666 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f02c40b2f70 0x7f02c41412c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:25.060 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:25.056+0000 7f02c37fe640 1 -- 172.21.15.40:0/1352015666 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f02c40b2b90 msgr2=0x7f02c413e800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:25.060 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:25.056+0000 7f02c37fe640 1 --2- 172.21.15.40:0/1352015666 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f02c40b2b90 0x7f02c413e800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:25.060 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:25.056+0000 7f02c37fe640 1 -- 172.21.15.40:0/1352015666 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f02c40b2f70 msgr2=0x7f02c41412c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:25.060 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:25.056+0000 7f02c37fe640 1 --2- 172.21.15.40:0/1352015666 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f02c40b2f70 0x7f02c41412c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:25.060 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:25.056+0000 7f02c37fe640 1 -- 172.21.15.40:0/1352015666 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02b40094d0 con 0x7f02c40cf7e0 2023-12-17T11:49:25.060 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:25.056+0000 7f02bbfff640 1 --2- 172.21.15.40:0/1352015666 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f02c40b2f70 0x7f02c41412c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-17T11:49:25.060 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:25.057+0000 7f02c37fe640 1 --2- 172.21.15.40:0/1352015666 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f02c40cf7e0 0x7f02c41f2be0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f02bc007e60 tx=0x7f02bc00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:49:25.060 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:25.057+0000 7f02bb7fe640 1 -- 172.21.15.40:0/1352015666 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02bc014420 con 0x7f02c40cf7e0 2023-12-17T11:49:25.060 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:25.057+0000 7f02bb7fe640 1 -- 172.21.15.40:0/1352015666 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02bc0145a0 con 0x7f02c40cf7e0 2023-12-17T11:49:25.060 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:25.057+0000 7f02bb7fe640 1 -- 172.21.15.40:0/1352015666 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02bc014950 con 0x7f02c40cf7e0 2023-12-17T11:49:25.060 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:25.057+0000 7f02c957c640 1 -- 172.21.15.40:0/1352015666 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02c413f1a0 con 0x7f02c40cf7e0 2023-12-17T11:49:25.060 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:25.057+0000 7f02c957c640 1 -- 172.21.15.40:0/1352015666 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02c413f760 con 0x7f02c40cf7e0 2023-12-17T11:49:25.061 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:25.059+0000 7f02c957c640 1 -- 172.21.15.40:0/1352015666 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02c40745d0 con 0x7f02c40cf7e0 2023-12-17T11:49:25.061 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:25.059+0000 7f02bb7fe640 1 -- 172.21.15.40:0/1352015666 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f02bc014ab0 con 0x7f02c40cf7e0 2023-12-17T11:49:25.062 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:25.060+0000 7f02bb7fe640 1 --2- 172.21.15.40:0/1352015666 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f02a406ae70 0x7f02a406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:25.062 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:25.060+0000 7f02bb7fe640 1 -- 172.21.15.40:0/1352015666 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f02bc08a420 con 0x7f02c40cf7e0 2023-12-17T11:49:25.063 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:25.061+0000 7f02c2ffd640 1 --2- 172.21.15.40:0/1352015666 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f02a406ae70 0x7f02a406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:25.064 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:25.062+0000 7f02c2ffd640 1 --2- 172.21.15.40:0/1352015666 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f02a406ae70 0x7f02a406d330 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f02b4036000 tx=0x7f02b403c040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:49:25.066 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:25.064+0000 7f02bb7fe640 1 -- 172.21.15.40:0/1352015666 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f02bc054fc0 con 0x7f02c40cf7e0 2023-12-17T11:49:25.261 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:25.259+0000 7f02c957c640 1 -- 172.21.15.40:0/1352015666 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f02c40b3400 con 0x7f02c40cf7e0 2023-12-17T11:49:25.262 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:25.260+0000 7f02bb7fe640 1 -- 172.21.15.40:0/1352015666 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) v1 ==== 104+0+11 (secure 0 0 0) 0x7f02c40b3400 con 0x7f02c40cf7e0 2023-12-17T11:49:25.262 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 32 2023-12-17T11:49:25.265 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:25.262+0000 7f02c957c640 1 -- 172.21.15.40:0/1352015666 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f02a406ae70 msgr2=0x7f02a406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:25.265 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:25.262+0000 7f02c957c640 1 --2- 172.21.15.40:0/1352015666 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f02a406ae70 0x7f02a406d330 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f02b4036000 tx=0x7f02b403c040 comp rx=0 tx=0).stop 2023-12-17T11:49:25.265 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:25.262+0000 7f02c957c640 1 -- 172.21.15.40:0/1352015666 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f02c40cf7e0 msgr2=0x7f02c41f2be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:25.265 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:25.262+0000 7f02c957c640 1 --2- 172.21.15.40:0/1352015666 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f02c40cf7e0 0x7f02c41f2be0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f02bc007e60 tx=0x7f02bc00e4b0 comp rx=0 tx=0).stop 2023-12-17T11:49:25.265 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:25.262+0000 7f02c957c640 1 -- 172.21.15.40:0/1352015666 shutdown_connections 2023-12-17T11:49:25.265 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:25.262+0000 7f02c957c640 1 --2- 172.21.15.40:0/1352015666 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f02a406ae70 0x7f02a406d330 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:25.265 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:25.262+0000 7f02c957c640 1 --2- 172.21.15.40:0/1352015666 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f02c40cf7e0 0x7f02c41f2be0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:25.265 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:25.262+0000 7f02c957c640 1 --2- 172.21.15.40:0/1352015666 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f02c40b2f70 0x7f02c41412c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:25.265 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:25.262+0000 7f02c957c640 1 --2- 172.21.15.40:0/1352015666 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f02c40b2b90 0x7f02c413e800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:25.265 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:25.263+0000 7f02c957c640 1 -- 172.21.15.40:0/1352015666 >> 172.21.15.40:0/1352015666 conn(0x7f02c40b6420 msgr2=0x7f02c40b43f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:49:25.265 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:25.263+0000 7f02c957c640 1 -- 172.21.15.40:0/1352015666 shutdown_connections 2023-12-17T11:49:25.265 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:25.263+0000 7f02c957c640 1 -- 172.21.15.40:0/1352015666 wait complete. 2023-12-17T11:49:25.283 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-17T11:49:25.516 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:25.514+0000 7f0a2b59e640 1 Processor -- start 2023-12-17T11:49:25.517 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:25.515+0000 7f0a2b59e640 1 -- start start 2023-12-17T11:49:25.519 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:25.516+0000 7f0a2b59e640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f0a2c155400 0x7f0a2c06bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:25.519 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:25.516+0000 7f0a2b59e640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0a2c0ce150 0x7f0a2c0ce5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:25.519 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:25.516+0000 7f0a2b59e640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a2c15b4a0 con 0x7f0a2c0cedf0 2023-12-17T11:49:25.519 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:25.516+0000 7f0a2b59e640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a2c0adbb0 con 0x7f0a2c155400 2023-12-17T11:49:25.519 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:25.516+0000 7f0a2b59e640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a2c0ade90 con 0x7f0a2c0ce150 2023-12-17T11:49:25.520 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:25.517+0000 7f0a2a59c640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f0a2c155400 0x7f0a2c06bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:25.520 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:25.517+0000 7f0a2a59c640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f0a2c155400 0x7f0a2c06bdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:38528/0 (socket says 172.21.15.40:38528) 2023-12-17T11:49:25.520 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:25.517+0000 7f0a2a59c640 1 -- 172.21.15.40:0/2506458451 learned_addr learned my addr 172.21.15.40:0/2506458451 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-17T11:49:25.520 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:25.517+0000 7f0a23fff640 1 --2- 172.21.15.40:0/2506458451 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0a2c0ce150 0x7f0a2c0ce5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:25.520 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:25.517+0000 7f0a2a59c640 1 -- 172.21.15.40:0/2506458451 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0a2c0ce150 msgr2=0x7f0a2c0ce5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:49:25.520 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:25.517+0000 7f0a2a59c640 1 --2- 172.21.15.40:0/2506458451 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0a2c0ce150 0x7f0a2c0ce5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:25.520 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:25.517+0000 7f0a2a59c640 1 -- 172.21.15.40:0/2506458451 >> v1:172.21.15.159:6789/0 conn(0x7f0a2c0cedf0 legacy=0x7f0a2c15b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:49:25.520 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:25.517+0000 7f0a2a59c640 1 -- 172.21.15.40:0/2506458451 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a2c0ae170 con 0x7f0a2c155400 2023-12-17T11:49:25.522 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:25.518+0000 7f0a2a59c640 1 --2- 172.21.15.40:0/2506458451 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0a2c155400 0x7f0a2c06bdf0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f0a1c009870 tx=0x7f0a1c02b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=925bb07739d31b4 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:49:25.522 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:25.519+0000 7f0a29d9b640 1 -- 172.21.15.40:0/2506458451 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a1c031640 con 0x7f0a2c155400 2023-12-17T11:49:25.522 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:25.519+0000 7f0a29d9b640 1 -- 172.21.15.40:0/2506458451 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a1c0317a0 con 0x7f0a2c155400 2023-12-17T11:49:25.522 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:25.519+0000 7f0a29d9b640 1 -- 172.21.15.40:0/2506458451 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a1c031b30 con 0x7f0a2c155400 2023-12-17T11:49:25.522 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:25.519+0000 7f0a2b59e640 1 -- 172.21.15.40:0/2506458451 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0a2c155400 msgr2=0x7f0a2c06bdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:25.522 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:25.519+0000 7f0a2b59e640 1 --2- 172.21.15.40:0/2506458451 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0a2c155400 0x7f0a2c06bdf0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f0a1c009870 tx=0x7f0a1c02b8f0 comp rx=0 tx=0).stop 2023-12-17T11:49:25.522 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:25.520+0000 7f0a2b59e640 1 -- 172.21.15.40:0/2506458451 shutdown_connections 2023-12-17T11:49:25.522 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:25.520+0000 7f0a2b59e640 1 --2- 172.21.15.40:0/2506458451 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0a2c0ce150 0x7f0a2c0ce5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:25.522 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:25.520+0000 7f0a2b59e640 1 --2- 172.21.15.40:0/2506458451 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0a2c155400 0x7f0a2c06bdf0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:25.522 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:25.520+0000 7f0a2b59e640 1 -- 172.21.15.40:0/2506458451 >> 172.21.15.40:0/2506458451 conn(0x7f0a2c06a640 msgr2=0x7f0a2c06aa50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:49:25.522 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:25.520+0000 7f0a2b59e640 1 -- 172.21.15.40:0/2506458451 shutdown_connections 2023-12-17T11:49:25.523 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:25.520+0000 7f0a2b59e640 1 -- 172.21.15.40:0/2506458451 wait complete. 2023-12-17T11:49:25.523 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:25.521+0000 7f0a2b59e640 1 Processor -- start 2023-12-17T11:49:25.523 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:25.522+0000 7f0a2b59e640 1 -- start start 2023-12-17T11:49:25.526 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:25.522+0000 7f0a2b59e640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0a2c0ce150 0x7f0a2c14d840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:25.526 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:25.522+0000 7f0a2b59e640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0a2c0cedf0 0x7f0a2c09bcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:25.526 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:25.523+0000 7f0a2b59e640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0a2c155400 0x7f0a2c09c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:25.526 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:25.523+0000 7f0a2b59e640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a2c14dd80 con 0x7f0a2c0cedf0 2023-12-17T11:49:25.526 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:25.523+0000 7f0a2b59e640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a2c1519f0 con 0x7f0a2c155400 2023-12-17T11:49:25.526 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:25.523+0000 7f0a2b59e640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a2c0af220 con 0x7f0a2c0ce150 2023-12-17T11:49:25.526 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:25.523+0000 7f0a23fff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0a2c0cedf0 0x7f0a2c09bcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:25.527 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:25.523+0000 7f0a23fff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0a2c0cedf0 0x7f0a2c09bcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:38540/0 (socket says 172.21.15.40:38540) 2023-12-17T11:49:25.527 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:25.523+0000 7f0a23fff640 1 -- 172.21.15.40:0/1938505516 learned_addr learned my addr 172.21.15.40:0/1938505516 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-17T11:49:25.527 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:25.523+0000 7f0a2a59c640 1 --2- 172.21.15.40:0/1938505516 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0a2c0ce150 0x7f0a2c14d840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:25.527 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:25.523+0000 7f0a2ad9d640 1 --2- 172.21.15.40:0/1938505516 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0a2c155400 0x7f0a2c09c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:25.527 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:25.523+0000 7f0a23fff640 1 -- 172.21.15.40:0/1938505516 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0a2c0ce150 msgr2=0x7f0a2c14d840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:25.527 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:25.523+0000 7f0a23fff640 1 --2- 172.21.15.40:0/1938505516 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0a2c0ce150 0x7f0a2c14d840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:25.527 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:25.523+0000 7f0a23fff640 1 -- 172.21.15.40:0/1938505516 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0a2c155400 msgr2=0x7f0a2c09c1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:25.527 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:25.523+0000 7f0a23fff640 1 --2- 172.21.15.40:0/1938505516 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0a2c155400 0x7f0a2c09c1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:25.527 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:25.523+0000 7f0a23fff640 1 -- 172.21.15.40:0/1938505516 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a1c0094d0 con 0x7f0a2c0cedf0 2023-12-17T11:49:25.527 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:25.524+0000 7f0a23fff640 1 --2- 172.21.15.40:0/1938505516 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0a2c0cedf0 0x7f0a2c09bcb0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f0a1400c7f0 tx=0x7f0a1400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:49:25.527 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:25.524+0000 7f0a22ffd640 1 -- 172.21.15.40:0/1938505516 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a14004220 con 0x7f0a2c0cedf0 2023-12-17T11:49:25.528 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:25.524+0000 7f0a22ffd640 1 -- 172.21.15.40:0/1938505516 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a140043a0 con 0x7f0a2c0cedf0 2023-12-17T11:49:25.528 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:25.524+0000 7f0a22ffd640 1 -- 172.21.15.40:0/1938505516 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a14007860 con 0x7f0a2c0cedf0 2023-12-17T11:49:25.528 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:25.524+0000 7f0a2b59e640 1 -- 172.21.15.40:0/1938505516 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a2c0af500 con 0x7f0a2c0cedf0 2023-12-17T11:49:25.528 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:25.524+0000 7f0a2b59e640 1 -- 172.21.15.40:0/1938505516 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a2c0afac0 con 0x7f0a2c0cedf0 2023-12-17T11:49:25.528 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:25.525+0000 7f0a2b59e640 1 -- 172.21.15.40:0/1938505516 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a2c0afce0 con 0x7f0a2c0cedf0 2023-12-17T11:49:25.528 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:25.526+0000 7f0a22ffd640 1 -- 172.21.15.40:0/1938505516 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f0a14007bd0 con 0x7f0a2c0cedf0 2023-12-17T11:49:25.529 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:25.527+0000 7f0a22ffd640 1 --2- 172.21.15.40:0/1938505516 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f0a0c06ae40 0x7f0a0c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:25.529 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:25.527+0000 7f0a22ffd640 1 -- 172.21.15.40:0/1938505516 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f0a140899e0 con 0x7f0a2c0cedf0 2023-12-17T11:49:25.530 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:25.528+0000 7f0a2a59c640 1 --2- 172.21.15.40:0/1938505516 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f0a0c06ae40 0x7f0a0c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:25.531 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:25.529+0000 7f0a2a59c640 1 --2- 172.21.15.40:0/1938505516 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f0a0c06ae40 0x7f0a0c06d300 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f0a1c036000 tx=0x7f0a1c03c040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:49:25.533 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:25.531+0000 7f0a22ffd640 1 -- 172.21.15.40:0/1938505516 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f0a14054610 con 0x7f0a2c0cedf0 2023-12-17T11:49:25.732 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:25.730+0000 7f0a2b59e640 1 -- 172.21.15.40:0/1938505516 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f0a2c074450 con 0x7f0a2c0cedf0 2023-12-17T11:49:25.732 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:25.730+0000 7f0a22ffd640 1 -- 172.21.15.40:0/1938505516 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) v1 ==== 100+0+11 (secure 0 0 0) 0x7f0a1401e0a0 con 0x7f0a2c0cedf0 2023-12-17T11:49:25.733 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 64 2023-12-17T11:49:25.736 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:25.733+0000 7f0a2b59e640 1 -- 172.21.15.40:0/1938505516 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f0a0c06ae40 msgr2=0x7f0a0c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:25.736 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:25.733+0000 7f0a2b59e640 1 --2- 172.21.15.40:0/1938505516 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f0a0c06ae40 0x7f0a0c06d300 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f0a1c036000 tx=0x7f0a1c03c040 comp rx=0 tx=0).stop 2023-12-17T11:49:25.736 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:25.733+0000 7f0a2b59e640 1 -- 172.21.15.40:0/1938505516 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0a2c0cedf0 msgr2=0x7f0a2c09bcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:25.736 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:25.733+0000 7f0a2b59e640 1 --2- 172.21.15.40:0/1938505516 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0a2c0cedf0 0x7f0a2c09bcb0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f0a1400c7f0 tx=0x7f0a1400ccb0 comp rx=0 tx=0).stop 2023-12-17T11:49:25.736 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:25.733+0000 7f0a2b59e640 1 -- 172.21.15.40:0/1938505516 shutdown_connections 2023-12-17T11:49:25.736 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:25.733+0000 7f0a2b59e640 1 --2- 172.21.15.40:0/1938505516 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f0a0c06ae40 0x7f0a0c06d300 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:25.736 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:25.733+0000 7f0a2b59e640 1 --2- 172.21.15.40:0/1938505516 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0a2c155400 0x7f0a2c09c1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:25.736 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:25.733+0000 7f0a2b59e640 1 --2- 172.21.15.40:0/1938505516 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0a2c0cedf0 0x7f0a2c09bcb0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:25.736 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:25.733+0000 7f0a2b59e640 1 --2- 172.21.15.40:0/1938505516 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0a2c0ce150 0x7f0a2c14d840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:25.736 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:25.734+0000 7f0a2b59e640 1 -- 172.21.15.40:0/1938505516 >> 172.21.15.40:0/1938505516 conn(0x7f0a2c06a640 msgr2=0x7f0a2c070f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:49:25.736 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:25.734+0000 7f0a2b59e640 1 -- 172.21.15.40:0/1938505516 shutdown_connections 2023-12-17T11:49:25.737 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:25.734+0000 7f0a2b59e640 1 -- 172.21.15.40:0/1938505516 wait complete. 2023-12-17T11:49:25.754 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-12-17T11:49:25.980 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:25.978+0000 7fbd2d116640 1 Processor -- start 2023-12-17T11:49:25.980 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:25.978+0000 7fbd2d116640 1 -- start start 2023-12-17T11:49:25.983 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:25.980+0000 7fbd2d116640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7fbd2815ba90 0x7fbd2806d370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:25.983 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:25.980+0000 7fbd2d116640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fbd280cc2f0 0x7fbd28161a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:25.983 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:25.980+0000 7fbd2d116640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd2806d950 con 0x7fbd280b2aa0 2023-12-17T11:49:25.983 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:25.980+0000 7fbd2d116640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd280b3fe0 con 0x7fbd280cc2f0 2023-12-17T11:49:25.983 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:25.980+0000 7fbd2d116640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd280cc720 con 0x7fbd2815ba90 2023-12-17T11:49:25.983 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:25.980+0000 7fbd2c915640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fbd280cc2f0 0x7fbd28161a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:25.983 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:25.980+0000 7fbd1ffff640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fbd280b2aa0 0x7fbd280cbbe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:57062/0 (socket says 172.21.15.40:57062) 2023-12-17T11:49:25.983 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:25.980+0000 7fbd1ffff640 1 -- 172.21.15.40:0/1611084915 learned_addr learned my addr 172.21.15.40:0/1611084915 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-12-17T11:49:25.983 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:25.981+0000 7fbd27fff640 1 --2- 172.21.15.40:0/1611084915 >> v2:172.21.15.159:3300/0 conn(0x7fbd2815ba90 0x7fbd2806d370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:25.984 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:25.981+0000 7fbd2c915640 1 -- 172.21.15.40:0/1611084915 >> v2:172.21.15.159:3300/0 conn(0x7fbd2815ba90 msgr2=0x7fbd2806d370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:49:25.984 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:25.981+0000 7fbd2c915640 1 --2- 172.21.15.40:0/1611084915 >> v2:172.21.15.159:3300/0 conn(0x7fbd2815ba90 0x7fbd2806d370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:25.984 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:25.981+0000 7fbd2c915640 1 -- 172.21.15.40:0/1611084915 >> v1:172.21.15.40:6789/0 conn(0x7fbd280b2aa0 legacy=0x7fbd280cbbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:25.984 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:25.981+0000 7fbd2c915640 1 -- 172.21.15.40:0/1611084915 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd2806c0b0 con 0x7fbd280cc2f0 2023-12-17T11:49:25.984 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:25.982+0000 7fbd2c915640 1 --2- 172.21.15.40:0/1611084915 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbd280cc2f0 0x7fbd28161a20 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fbd2806bba0 tx=0x7fbd2002be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c646c61e07d9fa8b server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:49:25.985 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:25.982+0000 7fbd277fe640 1 -- 172.21.15.40:0/1611084915 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd2002cbf0 con 0x7fbd280cc2f0 2023-12-17T11:49:25.985 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:25.982+0000 7fbd277fe640 1 -- 172.21.15.40:0/1611084915 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd2002cd50 con 0x7fbd280cc2f0 2023-12-17T11:49:25.985 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:25.982+0000 7fbd277fe640 1 -- 172.21.15.40:0/1611084915 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd20034660 con 0x7fbd280cc2f0 2023-12-17T11:49:25.986 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:25.983+0000 7fbd2d116640 1 -- 172.21.15.40:0/1611084915 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbd280cc2f0 msgr2=0x7fbd28161a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:25.986 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:25.983+0000 7fbd2d116640 1 --2- 172.21.15.40:0/1611084915 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbd280cc2f0 0x7fbd28161a20 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fbd2806bba0 tx=0x7fbd2002be40 comp rx=0 tx=0).stop 2023-12-17T11:49:25.986 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:25.983+0000 7fbd2d116640 1 -- 172.21.15.40:0/1611084915 shutdown_connections 2023-12-17T11:49:25.986 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:25.983+0000 7fbd2d116640 1 --2- 172.21.15.40:0/1611084915 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbd280cc2f0 0x7fbd28161a20 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:25.986 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:25.983+0000 7fbd2d116640 1 --2- 172.21.15.40:0/1611084915 >> v2:172.21.15.159:3300/0 conn(0x7fbd2815ba90 0x7fbd2806d370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:25.986 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:25.983+0000 7fbd2d116640 1 -- 172.21.15.40:0/1611084915 >> 172.21.15.40:0/1611084915 conn(0x7fbd280b0940 msgr2=0x7fbd280b0d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:49:25.986 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:25.983+0000 7fbd2d116640 1 -- 172.21.15.40:0/1611084915 shutdown_connections 2023-12-17T11:49:25.986 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:25.983+0000 7fbd2d116640 1 -- 172.21.15.40:0/1611084915 wait complete. 2023-12-17T11:49:25.987 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:25.985+0000 7fbd2d116640 1 Processor -- start 2023-12-17T11:49:25.987 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:25.985+0000 7fbd2d116640 1 -- start start 2023-12-17T11:49:25.989 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:25.986+0000 7fbd2d116640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbd280b2aa0 0x7fbd280cca90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:25.989 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:25.986+0000 7fbd2d116640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fbd280cc2f0 0x7fbd280cf450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:25.989 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:25.986+0000 7fbd2d116640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbd2815ba90 0x7fbd281496e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:25.989 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:25.986+0000 7fbd2d116640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd280cf990 con 0x7fbd280b2aa0 2023-12-17T11:49:25.989 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:25.986+0000 7fbd2d116640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd2809ac60 con 0x7fbd2815ba90 2023-12-17T11:49:25.989 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:25.986+0000 7fbd2d116640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd2809af40 con 0x7fbd280cc2f0 2023-12-17T11:49:25.989 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:25.987+0000 7fbd27fff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbd280b2aa0 0x7fbd280cca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:25.989 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:25.987+0000 7fbd27fff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbd280b2aa0 0x7fbd280cca90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:38570/0 (socket says 172.21.15.40:38570) 2023-12-17T11:49:25.989 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:25.987+0000 7fbd27fff640 1 -- 172.21.15.40:0/986260939 learned_addr learned my addr 172.21.15.40:0/986260939 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-17T11:49:25.989 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:25.987+0000 7fbd27fff640 1 -- 172.21.15.40:0/986260939 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fbd280cc2f0 msgr2=0x7fbd280cf450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:25.989 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:25.987+0000 7fbd27fff640 1 --2- 172.21.15.40:0/986260939 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fbd280cc2f0 0x7fbd280cf450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:25.989 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:25.987+0000 7fbd27fff640 1 -- 172.21.15.40:0/986260939 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbd2815ba90 msgr2=0x7fbd281496e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:25.990 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:25.987+0000 7fbd27fff640 1 --2- 172.21.15.40:0/986260939 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbd2815ba90 0x7fbd281496e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:25.990 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:25.987+0000 7fbd27fff640 1 -- 172.21.15.40:0/986260939 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd20009a70 con 0x7fbd280b2aa0 2023-12-17T11:49:25.991 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:25.987+0000 7fbd27fff640 1 --2- 172.21.15.40:0/986260939 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbd280b2aa0 0x7fbd280cca90 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fbd1800d5f0 tx=0x7fbd1800dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:49:25.991 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:25.988+0000 7fbd257fa640 1 -- 172.21.15.40:0/986260939 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd180125f0 con 0x7fbd280b2aa0 2023-12-17T11:49:25.991 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:25.988+0000 7fbd257fa640 1 -- 172.21.15.40:0/986260939 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd18012750 con 0x7fbd280b2aa0 2023-12-17T11:49:25.991 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:25.988+0000 7fbd257fa640 1 -- 172.21.15.40:0/986260939 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd18012b00 con 0x7fbd280b2aa0 2023-12-17T11:49:25.991 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:25.988+0000 7fbd2d116640 1 -- 172.21.15.40:0/986260939 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd2809b220 con 0x7fbd280b2aa0 2023-12-17T11:49:25.991 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:25.988+0000 7fbd2d116640 1 -- 172.21.15.40:0/986260939 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd2809b7e0 con 0x7fbd280b2aa0 2023-12-17T11:49:25.991 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:25.989+0000 7fbd2d116640 1 -- 172.21.15.40:0/986260939 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd28067910 con 0x7fbd280b2aa0 2023-12-17T11:49:25.992 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:25.990+0000 7fbd257fa640 1 -- 172.21.15.40:0/986260939 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fbd18012c60 con 0x7fbd280b2aa0 2023-12-17T11:49:25.992 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:25.991+0000 7fbd257fa640 1 --2- 172.21.15.40:0/986260939 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7fbd0806ae40 0x7fbd0806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:25.993 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:25.991+0000 7fbd257fa640 1 -- 172.21.15.40:0/986260939 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6692+0+0 (secure 0 0 0) 0x7fbd18089f50 con 0x7fbd280b2aa0 2023-12-17T11:49:25.993 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:25.991+0000 7fbd1ffff640 1 --2- 172.21.15.40:0/986260939 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7fbd0806ae40 0x7fbd0806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:25.994 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:25.993+0000 7fbd1ffff640 1 --2- 172.21.15.40:0/986260939 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7fbd0806ae40 0x7fbd0806d300 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fbd2815abf0 tx=0x7fbd10007a40 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:49:25.997 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:25.995+0000 7fbd257fa640 1 -- 172.21.15.40:0/986260939 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fbd18054b90 con 0x7fbd280b2aa0 2023-12-17T11:49:26.191 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:26.188+0000 7fbd2d116640 1 -- 172.21.15.40:0/986260939 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fbd28074450 con 0x7fbd280b2aa0 2023-12-17T11:49:26.191 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:26.189+0000 7fbd257fa640 1 -- 172.21.15.40:0/986260939 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) v1 ==== 103+0+11 (secure 0 0 0) 0x7fbd180581b0 con 0x7fbd280b2aa0 2023-12-17T11:49:26.192 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 32 2023-12-17T11:49:26.194 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:26.192+0000 7fbd2d116640 1 -- 172.21.15.40:0/986260939 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7fbd0806ae40 msgr2=0x7fbd0806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:26.194 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:26.192+0000 7fbd2d116640 1 --2- 172.21.15.40:0/986260939 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7fbd0806ae40 0x7fbd0806d300 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fbd2815abf0 tx=0x7fbd10007a40 comp rx=0 tx=0).stop 2023-12-17T11:49:26.194 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:26.192+0000 7fbd2d116640 1 -- 172.21.15.40:0/986260939 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbd280b2aa0 msgr2=0x7fbd280cca90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:26.194 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:26.192+0000 7fbd2d116640 1 --2- 172.21.15.40:0/986260939 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbd280b2aa0 0x7fbd280cca90 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fbd1800d5f0 tx=0x7fbd1800dab0 comp rx=0 tx=0).stop 2023-12-17T11:49:26.194 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:26.192+0000 7fbd2d116640 1 -- 172.21.15.40:0/986260939 shutdown_connections 2023-12-17T11:49:26.195 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:26.192+0000 7fbd2d116640 1 --2- 172.21.15.40:0/986260939 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7fbd0806ae40 0x7fbd0806d300 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:26.195 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:26.192+0000 7fbd2d116640 1 --2- 172.21.15.40:0/986260939 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbd2815ba90 0x7fbd281496e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:26.195 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:26.192+0000 7fbd2d116640 1 --2- 172.21.15.40:0/986260939 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fbd280cc2f0 0x7fbd280cf450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:26.195 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:26.192+0000 7fbd2d116640 1 --2- 172.21.15.40:0/986260939 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbd280b2aa0 0x7fbd280cca90 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:26.195 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:26.192+0000 7fbd2d116640 1 -- 172.21.15.40:0/986260939 >> 172.21.15.40:0/986260939 conn(0x7fbd280b0940 msgr2=0x7fbd280afc70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:49:26.195 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:26.192+0000 7fbd2d116640 1 -- 172.21.15.40:0/986260939 shutdown_connections 2023-12-17T11:49:26.195 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:26.192+0000 7fbd2d116640 1 -- 172.21.15.40:0/986260939 wait complete. 2023-12-17T11:49:26.212 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-17T11:49:26.439 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:26.437+0000 7febcffff640 1 Processor -- start 2023-12-17T11:49:26.439 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:26.437+0000 7febcffff640 1 -- start start 2023-12-17T11:49:26.441 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:26.438+0000 7febcffff640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7febd0159fd0 0x7febd00ae1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:26.441 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:26.438+0000 7febcffff640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7febd00713b0 0x7febd00b27e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:26.441 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:26.438+0000 7febcffff640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7febd0070070 con 0x7febd0070750 2023-12-17T11:49:26.441 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:26.438+0000 7febcffff640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7febd00705f0 con 0x7febd0159fd0 2023-12-17T11:49:26.441 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:26.438+0000 7febcffff640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7febd0070310 con 0x7febd00713b0 2023-12-17T11:49:26.441 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:26.439+0000 7febceffd640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7febd0159fd0 0x7febd00ae1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:26.441 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:26.439+0000 7febceffd640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7febd0159fd0 0x7febd00ae1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:38580/0 (socket says 172.21.15.40:38580) 2023-12-17T11:49:26.441 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:26.439+0000 7febceffd640 1 -- 172.21.15.40:0/894598023 learned_addr learned my addr 172.21.15.40:0/894598023 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-17T11:49:26.442 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:26.439+0000 7febcf7fe640 1 --2- 172.21.15.40:0/894598023 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7febd00713b0 0x7febd00b27e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:26.442 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:26.439+0000 7febceffd640 1 -- 172.21.15.40:0/894598023 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7febd00713b0 msgr2=0x7febd00b27e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:49:26.442 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:26.439+0000 7febceffd640 1 --2- 172.21.15.40:0/894598023 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7febd00713b0 0x7febd00b27e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:26.442 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:26.439+0000 7febceffd640 1 -- 172.21.15.40:0/894598023 >> v1:172.21.15.159:6789/0 conn(0x7febd0070750 legacy=0x7febd0070ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:49:26.442 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:26.440+0000 7febceffd640 1 -- 172.21.15.40:0/894598023 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febd00b1d00 con 0x7febd0159fd0 2023-12-17T11:49:26.443 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:26.441+0000 7febceffd640 1 --2- 172.21.15.40:0/894598023 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7febd0159fd0 0x7febd00ae1d0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7febd006e4f0 tx=0x7febc002e140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c330c0905ebdd3e server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:49:26.443 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:26.441+0000 7febcdffb640 1 -- 172.21.15.40:0/894598023 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febc000b0d0 con 0x7febd0159fd0 2023-12-17T11:49:26.443 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:26.441+0000 7febcdffb640 1 -- 172.21.15.40:0/894598023 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febc000b230 con 0x7febd0159fd0 2023-12-17T11:49:26.443 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:26.441+0000 7febcdffb640 1 -- 172.21.15.40:0/894598023 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febc0009600 con 0x7febd0159fd0 2023-12-17T11:49:26.444 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:26.442+0000 7febcffff640 1 -- 172.21.15.40:0/894598023 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7febd0159fd0 msgr2=0x7febd00ae1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:26.444 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:26.442+0000 7febcffff640 1 --2- 172.21.15.40:0/894598023 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7febd0159fd0 0x7febd00ae1d0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7febd006e4f0 tx=0x7febc002e140 comp rx=0 tx=0).stop 2023-12-17T11:49:26.444 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:26.442+0000 7febcffff640 1 -- 172.21.15.40:0/894598023 shutdown_connections 2023-12-17T11:49:26.444 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:26.442+0000 7febcffff640 1 --2- 172.21.15.40:0/894598023 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7febd00713b0 0x7febd00b27e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:26.444 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:26.442+0000 7febcffff640 1 --2- 172.21.15.40:0/894598023 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7febd0159fd0 0x7febd00ae1d0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:26.444 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:26.442+0000 7febcffff640 1 -- 172.21.15.40:0/894598023 >> 172.21.15.40:0/894598023 conn(0x7febd00b0860 msgr2=0x7febd00b0c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:49:26.444 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:26.442+0000 7febcffff640 1 -- 172.21.15.40:0/894598023 shutdown_connections 2023-12-17T11:49:26.444 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:26.442+0000 7febcffff640 1 -- 172.21.15.40:0/894598023 wait complete. 2023-12-17T11:49:26.445 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:26.444+0000 7febcffff640 1 Processor -- start 2023-12-17T11:49:26.446 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:26.444+0000 7febcffff640 1 -- start start 2023-12-17T11:49:26.447 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:26.445+0000 7febcffff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7febd0070750 0x7febd01513b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:26.447 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:26.445+0000 7febcffff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7febd00713b0 0x7febd0152450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:26.447 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:26.445+0000 7febcffff640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7febd0159fd0 0x7febd0157cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:26.447 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:26.445+0000 7febcffff640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febd0152d50 con 0x7febd00713b0 2023-12-17T11:49:26.447 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:26.445+0000 7febcffff640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febd0099a90 con 0x7febd0070750 2023-12-17T11:49:26.447 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:26.445+0000 7febcffff640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7febd0099d70 con 0x7febd0159fd0 2023-12-17T11:49:26.447 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:26.445+0000 7febce7fc640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7febd00713b0 0x7febd0152450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:26.447 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:26.445+0000 7febce7fc640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7febd00713b0 0x7febd0152450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:38588/0 (socket says 172.21.15.40:38588) 2023-12-17T11:49:26.448 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:26.445+0000 7febce7fc640 1 -- 172.21.15.40:0/3443504737 learned_addr learned my addr 172.21.15.40:0/3443504737 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-17T11:49:26.449 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:26.445+0000 7febceffd640 1 --2- 172.21.15.40:0/3443504737 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7febd0070750 0x7febd01513b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:26.449 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:26.446+0000 7febcf7fe640 1 --2- 172.21.15.40:0/3443504737 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7febd0159fd0 0x7febd0157cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:26.449 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:26.446+0000 7febce7fc640 1 -- 172.21.15.40:0/3443504737 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7febd0159fd0 msgr2=0x7febd0157cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:26.449 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:26.446+0000 7febce7fc640 1 --2- 172.21.15.40:0/3443504737 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7febd0159fd0 0x7febd0157cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:26.449 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:26.446+0000 7febce7fc640 1 -- 172.21.15.40:0/3443504737 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7febd0070750 msgr2=0x7febd01513b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:26.449 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:26.446+0000 7febce7fc640 1 --2- 172.21.15.40:0/3443504737 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7febd0070750 0x7febd01513b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:26.449 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:26.446+0000 7febce7fc640 1 -- 172.21.15.40:0/3443504737 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febc000bd40 con 0x7febd00713b0 2023-12-17T11:49:26.450 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:26.446+0000 7febceffd640 1 --2- 172.21.15.40:0/3443504737 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7febd0070750 0x7febd01513b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-17T11:49:26.450 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:26.446+0000 7febce7fc640 1 --2- 172.21.15.40:0/3443504737 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7febd00713b0 0x7febd0152450 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7febc400c430 tx=0x7febc400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:49:26.450 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:26.446+0000 7febb77fe640 1 -- 172.21.15.40:0/3443504737 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febc4011790 con 0x7febd00713b0 2023-12-17T11:49:26.450 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:26.446+0000 7febb77fe640 1 -- 172.21.15.40:0/3443504737 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febc40118f0 con 0x7febd00713b0 2023-12-17T11:49:26.450 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:26.446+0000 7febcffff640 1 -- 172.21.15.40:0/3443504737 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7febd009a050 con 0x7febd00713b0 2023-12-17T11:49:26.450 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:26.446+0000 7febb77fe640 1 -- 172.21.15.40:0/3443504737 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febc4011ce0 con 0x7febd00713b0 2023-12-17T11:49:26.450 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:26.446+0000 7febcffff640 1 -- 172.21.15.40:0/3443504737 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7febd01e4f30 con 0x7febd00713b0 2023-12-17T11:49:26.450 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:26.448+0000 7febcffff640 1 -- 172.21.15.40:0/3443504737 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7febd0074450 con 0x7febd00713b0 2023-12-17T11:49:26.450 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:26.448+0000 7febb77fe640 1 -- 172.21.15.40:0/3443504737 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7febc401c460 con 0x7febd00713b0 2023-12-17T11:49:26.452 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:26.450+0000 7febb77fe640 1 --2- 172.21.15.40:0/3443504737 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7febbc06ae40 0x7febbc06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:26.452 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:26.450+0000 7febb77fe640 1 -- 172.21.15.40:0/3443504737 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6692+0+0 (secure 0 0 0) 0x7febc4089a50 con 0x7febd00713b0 2023-12-17T11:49:26.452 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:26.451+0000 7febceffd640 1 --2- 172.21.15.40:0/3443504737 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7febbc06ae40 0x7febbc06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:26.453 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:26.452+0000 7febceffd640 1 --2- 172.21.15.40:0/3443504737 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7febbc06ae40 0x7febbc06d300 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7febc0037000 tx=0x7febc0032000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:49:26.456 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:26.454+0000 7febb77fe640 1 -- 172.21.15.40:0/3443504737 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7febc4054680 con 0x7febd00713b0 2023-12-17T11:49:26.671 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:26.669+0000 7febcffff640 1 -- 172.21.15.40:0/3443504737 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7febd009a510 con 0x7febd00713b0 2023-12-17T11:49:26.672 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:26.670+0000 7febb77fe640 1 -- 172.21.15.40:0/3443504737 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v27) v1 ==== 80+0+0 (secure 0 0 0) 0x7febc4057ca0 con 0x7febd00713b0 2023-12-17T11:49:26.672 INFO:teuthology.orchestra.run.smithi040.stderr:listed 0 entries 2023-12-17T11:49:26.675 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:26.673+0000 7febcffff640 1 -- 172.21.15.40:0/3443504737 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7febbc06ae40 msgr2=0x7febbc06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:26.675 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:26.673+0000 7febcffff640 1 --2- 172.21.15.40:0/3443504737 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7febbc06ae40 0x7febbc06d300 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7febc0037000 tx=0x7febc0032000 comp rx=0 tx=0).stop 2023-12-17T11:49:26.675 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:26.673+0000 7febcffff640 1 -- 172.21.15.40:0/3443504737 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7febd00713b0 msgr2=0x7febd0152450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:26.675 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:26.673+0000 7febcffff640 1 --2- 172.21.15.40:0/3443504737 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7febd00713b0 0x7febd0152450 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7febc400c430 tx=0x7febc400c8f0 comp rx=0 tx=0).stop 2023-12-17T11:49:26.675 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:26.673+0000 7febcffff640 1 -- 172.21.15.40:0/3443504737 shutdown_connections 2023-12-17T11:49:26.675 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:26.673+0000 7febcffff640 1 --2- 172.21.15.40:0/3443504737 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7febbc06ae40 0x7febbc06d300 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:26.676 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:26.673+0000 7febcffff640 1 --2- 172.21.15.40:0/3443504737 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7febd0159fd0 0x7febd0157cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:26.676 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:26.673+0000 7febcffff640 1 --2- 172.21.15.40:0/3443504737 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7febd00713b0 0x7febd0152450 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:26.676 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:26.673+0000 7febcffff640 1 --2- 172.21.15.40:0/3443504737 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7febd0070750 0x7febd01513b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:26.676 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:26.673+0000 7febcffff640 1 -- 172.21.15.40:0/3443504737 >> 172.21.15.40:0/3443504737 conn(0x7febd00b0860 msgr2=0x7febd01532f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:49:26.676 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:26.673+0000 7febcffff640 1 -- 172.21.15.40:0/3443504737 shutdown_connections 2023-12-17T11:49:26.676 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:26.673+0000 7febcffff640 1 -- 172.21.15.40:0/3443504737 wait complete. 2023-12-17T11:49:26.695 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-12-17T11:49:26.695 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-17T11:49:26.695 DEBUG:teuthology.orchestra.run.smithi159:> sudo umount /home/ubuntu/cephtest/mnt.1 -f 2023-12-17T11:49:26.804 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi159.front.sepia.ceph.com 2023-12-17T11:49:26.804 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-17T11:49:26.804 DEBUG:teuthology.orchestra.run.smithi159:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-12-17T11:49:26.866 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2023-12-17T11:49:26.866 DEBUG:teuthology.orchestra.run.smithi040:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-17T11:49:26.928 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2023-12-17T11:49:26.928 DEBUG:teuthology.orchestra.run.smithi040:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-17T11:49:26.982 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2023-12-17T11:49:26.982 DEBUG:teuthology.orchestra.run.smithi040:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-17T11:49:27.035 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-17T11:49:27.261 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:27.259+0000 7f68b3fff640 1 Processor -- start 2023-12-17T11:49:27.261 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:27.259+0000 7f68b3fff640 1 -- start start 2023-12-17T11:49:27.262 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:27.260+0000 7f68b3fff640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f68b40b4c20 0x7f68b4161300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:27.262 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:27.260+0000 7f68b3fff640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68b40af0a0 con 0x7f68b40d0750 2023-12-17T11:49:27.262 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:27.260+0000 7f68b3fff640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68b40af340 con 0x7f68b406a460 2023-12-17T11:49:27.262 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:27.260+0000 7f68b3fff640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68b40adbb0 con 0x7f68b40b4c20 2023-12-17T11:49:27.262 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:27.260+0000 7f68b27fc640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f68b40d0750 0x7f68b4160bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:57074/0 (socket says 172.21.15.40:57074) 2023-12-17T11:49:27.263 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:27.260+0000 7f68b27fc640 1 -- 172.21.15.40:0/661972099 learned_addr learned my addr 172.21.15.40:0/661972099 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-12-17T11:49:27.264 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:27.261+0000 7f68b37fe640 1 --2- 172.21.15.40:0/661972099 >> v2:172.21.15.159:3300/0 conn(0x7f68b40b4c20 0x7f68b4161300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:27.265 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:27.261+0000 7f68b1ffb640 1 -- 172.21.15.40:0/661972099 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3565152673 0 0) 0x7f68b40af0a0 con 0x7f68b40d0750 2023-12-17T11:49:27.265 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:27.261+0000 7f68b1ffb640 1 -- 172.21.15.40:0/661972099 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f68a0003520 con 0x7f68b40d0750 2023-12-17T11:49:27.265 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:27.261+0000 7f68b1ffb640 1 -- 172.21.15.40:0/661972099 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1803732786 0 0) 0x7f68a0003520 con 0x7f68b40d0750 2023-12-17T11:49:27.265 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:27.261+0000 7f68b1ffb640 1 -- 172.21.15.40:0/661972099 >> v2:172.21.15.159:3300/0 conn(0x7f68b40b4c20 msgr2=0x7f68b4161300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:49:27.265 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:27.261+0000 7f68b1ffb640 1 --2- 172.21.15.40:0/661972099 >> v2:172.21.15.159:3300/0 conn(0x7f68b40b4c20 0x7f68b4161300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:27.265 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:27.261+0000 7f68b1ffb640 1 -- 172.21.15.40:0/661972099 >> v1:172.21.15.159:6789/0 conn(0x7f68b406a460 legacy=0x7f68b406a840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:27.265 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:27.261+0000 7f68b1ffb640 1 -- 172.21.15.40:0/661972099 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68b40af620 con 0x7f68b40d0750 2023-12-17T11:49:27.265 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:27.261+0000 7f68b1ffb640 1 -- 172.21.15.40:0/661972099 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2643242555 0 0) 0x7f689c001670 con 0x7f68b40d0750 2023-12-17T11:49:27.265 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:27.261+0000 7f68b37fe640 1 --2- 172.21.15.40:0/661972099 >> v2:172.21.15.159:3300/0 conn(0x7f68b40b4c20 0x7f68b4161300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-17T11:49:27.265 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:27.262+0000 7f68b1ffb640 1 -- 172.21.15.40:0/661972099 >> v1:172.21.15.40:6789/0 conn(0x7f68b40d0750 legacy=0x7f68b4160bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:27.265 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:27.262+0000 7f68b1ffb640 1 --2- 172.21.15.40:0/661972099 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f68a0003970 0x7f68a0003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:27.266 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:27.262+0000 7f68b1ffb640 1 --2- 172.21.15.40:0/661972099 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f68a00047c0 0x7f68a0004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:27.266 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:27.262+0000 7f68b1ffb640 1 --2- 172.21.15.40:0/661972099 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f68a0005180 0x7f68a000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:27.266 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:27.262+0000 7f68b1ffb640 1 -- 172.21.15.40:0/661972099 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68b40adbb0 con 0x7f68a0003970 2023-12-17T11:49:27.266 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:27.262+0000 7f68b1ffb640 1 -- 172.21.15.40:0/661972099 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68a000c0d0 con 0x7f68a0005180 2023-12-17T11:49:27.266 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:27.262+0000 7f68b1ffb640 1 -- 172.21.15.40:0/661972099 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68a000c290 con 0x7f68a00047c0 2023-12-17T11:49:27.266 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:27.262+0000 7f68b2ffd640 1 --2- 172.21.15.40:0/661972099 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f68a0003970 0x7f68a0003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:27.266 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:27.262+0000 7f68b27fc640 1 --2- 172.21.15.40:0/661972099 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f68a00047c0 0x7f68a0004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:27.266 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:27.262+0000 7f68b37fe640 1 --2- 172.21.15.40:0/661972099 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f68a0005180 0x7f68a000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:27.266 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:27.262+0000 7f68b2ffd640 1 -- 172.21.15.40:0/661972099 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f68a00047c0 msgr2=0x7f68a0004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:49:27.266 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:27.262+0000 7f68b2ffd640 1 --2- 172.21.15.40:0/661972099 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f68a00047c0 0x7f68a0004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:27.266 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:27.262+0000 7f68b2ffd640 1 -- 172.21.15.40:0/661972099 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f68a0005180 msgr2=0x7f68a000b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:49:27.266 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:27.262+0000 7f68b2ffd640 1 --2- 172.21.15.40:0/661972099 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f68a0005180 0x7f68a000b980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:27.266 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:27.262+0000 7f68b2ffd640 1 -- 172.21.15.40:0/661972099 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68a0003520 con 0x7f68a0003970 2023-12-17T11:49:27.266 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:27.262+0000 7f68b37fe640 1 -- 172.21.15.40:0/661972099 reap_dead start 2023-12-17T11:49:27.267 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:27.262+0000 7f68b27fc640 1 --2- 172.21.15.40:0/661972099 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f68a00047c0 0x7f68a0004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-17T11:49:27.267 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:27.263+0000 7f68b2ffd640 1 --2- 172.21.15.40:0/661972099 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f68a0003970 0x7f68a0003d90 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f68a4001e50 tx=0x7f68a00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c0aa09a2b42f195 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:49:27.268 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:27.264+0000 7f68b1ffb640 1 -- 172.21.15.40:0/661972099 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68a4003b70 con 0x7f68a0003970 2023-12-17T11:49:27.268 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:27.264+0000 7f68b1ffb640 1 -- 172.21.15.40:0/661972099 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68a4003cd0 con 0x7f68a0003970 2023-12-17T11:49:27.268 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:27.264+0000 7f68b1ffb640 1 -- 172.21.15.40:0/661972099 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68a4005310 con 0x7f68a0003970 2023-12-17T11:49:27.268 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:27.264+0000 7f68b3fff640 1 -- 172.21.15.40:0/661972099 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f68a0003970 msgr2=0x7f68a0003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:27.268 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:27.264+0000 7f68b3fff640 1 --2- 172.21.15.40:0/661972099 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f68a0003970 0x7f68a0003d90 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f68a4001e50 tx=0x7f68a00057f0 comp rx=0 tx=0).stop 2023-12-17T11:49:27.268 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:27.264+0000 7f68b3fff640 1 -- 172.21.15.40:0/661972099 shutdown_connections 2023-12-17T11:49:27.268 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:27.264+0000 7f68b3fff640 1 --2- 172.21.15.40:0/661972099 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f68a0003970 0x7f68a0003d90 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:27.268 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:27.264+0000 7f68b3fff640 1 -- 172.21.15.40:0/661972099 >> 172.21.15.40:0/661972099 conn(0x7f68b40cfc30 msgr2=0x7f68b40d0040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:49:27.268 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:27.264+0000 7f68b3fff640 1 -- 172.21.15.40:0/661972099 shutdown_connections 2023-12-17T11:49:27.268 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:27.264+0000 7f68b3fff640 1 -- 172.21.15.40:0/661972099 wait complete. 2023-12-17T11:49:27.269 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:27.266+0000 7f68b3fff640 1 Processor -- start 2023-12-17T11:49:27.269 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:27.266+0000 7f68b3fff640 1 -- start start 2023-12-17T11:49:27.271 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:27.267+0000 7f68b3fff640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f68a0003970 0x7f68b415ea70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:27.271 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:27.267+0000 7f68b3fff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f68b414f7b0 0x7f68b415d340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:27.271 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:27.267+0000 7f68b3fff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f68b41532d0 0x7f68b415f050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:27.271 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:27.267+0000 7f68b3fff640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68b414fc30 con 0x7f68b414f7b0 2023-12-17T11:49:27.271 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:27.267+0000 7f68b3fff640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68b415d9d0 con 0x7f68b41532d0 2023-12-17T11:49:27.271 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:27.267+0000 7f68b3fff640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68b415dcb0 con 0x7f68a0003970 2023-12-17T11:49:27.271 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:27.268+0000 7f68b27fc640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f68b414f7b0 0x7f68b415d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:27.271 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:27.268+0000 7f68b27fc640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f68b414f7b0 0x7f68b415d340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:38604/0 (socket says 172.21.15.40:38604) 2023-12-17T11:49:27.271 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:27.268+0000 7f68b27fc640 1 -- 172.21.15.40:0/2992329727 learned_addr learned my addr 172.21.15.40:0/2992329727 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-17T11:49:27.272 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:27.268+0000 7f68b2ffd640 1 --2- 172.21.15.40:0/2992329727 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f68a0003970 0x7f68b415ea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:27.272 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:27.268+0000 7f68b37fe640 1 --2- 172.21.15.40:0/2992329727 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f68b41532d0 0x7f68b415f050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:27.272 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:27.268+0000 7f68b27fc640 1 -- 172.21.15.40:0/2992329727 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f68a0003970 msgr2=0x7f68b415ea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:27.272 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:27.268+0000 7f68b27fc640 1 --2- 172.21.15.40:0/2992329727 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f68a0003970 0x7f68b415ea70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:27.272 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:27.268+0000 7f68b27fc640 1 -- 172.21.15.40:0/2992329727 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f68b41532d0 msgr2=0x7f68b415f050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:27.272 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:27.268+0000 7f68b27fc640 1 --2- 172.21.15.40:0/2992329727 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f68b41532d0 0x7f68b415f050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:27.272 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:27.268+0000 7f68b27fc640 1 -- 172.21.15.40:0/2992329727 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68b415df90 con 0x7f68b414f7b0 2023-12-17T11:49:27.272 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:27.268+0000 7f68b2ffd640 1 --2- 172.21.15.40:0/2992329727 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f68a0003970 0x7f68b415ea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-17T11:49:27.272 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:27.268+0000 7f68b37fe640 1 --2- 172.21.15.40:0/2992329727 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f68b41532d0 0x7f68b415f050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-17T11:49:27.272 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:27.269+0000 7f68b27fc640 1 --2- 172.21.15.40:0/2992329727 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f68b414f7b0 0x7f68b415d340 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f689c00d7a0 tx=0x7f689c00dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:49:27.272 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:27.269+0000 7f68abfff640 1 -- 172.21.15.40:0/2992329727 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f689c0074e0 con 0x7f68b414f7b0 2023-12-17T11:49:27.272 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:27.269+0000 7f68abfff640 1 -- 172.21.15.40:0/2992329727 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f689c007640 con 0x7f68b414f7b0 2023-12-17T11:49:27.272 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:27.269+0000 7f68abfff640 1 -- 172.21.15.40:0/2992329727 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f689c0049e0 con 0x7f68b414f7b0 2023-12-17T11:49:27.272 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:27.269+0000 7f68b3fff640 1 -- 172.21.15.40:0/2992329727 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68b415e270 con 0x7f68b414f7b0 2023-12-17T11:49:27.272 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:27.269+0000 7f68b3fff640 1 -- 172.21.15.40:0/2992329727 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68b4153750 con 0x7f68b414f7b0 2023-12-17T11:49:27.273 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:27.270+0000 7f68b3fff640 1 -- 172.21.15.40:0/2992329727 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68b40673f0 con 0x7f68b414f7b0 2023-12-17T11:49:27.273 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:27.271+0000 7f68abfff640 1 -- 172.21.15.40:0/2992329727 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f689c004b40 con 0x7f68b414f7b0 2023-12-17T11:49:27.274 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:27.272+0000 7f68abfff640 1 --2- 172.21.15.40:0/2992329727 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f689406ae40 0x7f689406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:27.274 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:27.272+0000 7f68abfff640 1 -- 172.21.15.40:0/2992329727 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f689c089240 con 0x7f68b414f7b0 2023-12-17T11:49:27.274 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:27.273+0000 7f68b2ffd640 1 --2- 172.21.15.40:0/2992329727 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f689406ae40 0x7f689406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:27.276 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:27.274+0000 7f68b2ffd640 1 --2- 172.21.15.40:0/2992329727 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f689406ae40 0x7f689406d300 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f68a4034000 tx=0x7f68a4009030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:49:27.278 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:27.277+0000 7f68abfff640 1 -- 172.21.15.40:0/2992329727 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f689c053f00 con 0x7f68b414f7b0 2023-12-17T11:49:27.478 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:27.476+0000 7f68b3fff640 1 -- 172.21.15.40:0/2992329727 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f68b406b350 con 0x7f68b414f7b0 2023-12-17T11:49:27.480 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:27.478+0000 7f68abfff640 1 -- 172.21.15.40:0/2992329727 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+18697 (secure 0 0 0) 0x7f689c057520 con 0x7f68b414f7b0 2023-12-17T11:49:27.480 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T11:49:27.481 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":27,"fsid":"099cd35d-80d9-4ca4-8424-de13b3b03ac7","created":"2023-12-17T11:47:53.450097+0000","modified":"2023-12-17T11:49:00.483840+0000","last_up_change":"2023-12-17T11:48:05.724195+0000","last_in_change":"2023-12-17T11:47:56.956499+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-17T11:48:06.668943+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-17T11:48:16.151444+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-17T11:48:16.717726+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-17T11:48:20.534819+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a88bfd46-63b8-48b1-9c0e-5c9cdc31bd38","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":555204741},{"type":"v1","addr":"172.21.15.40:6802","nonce":555204741}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":555204741},{"type":"v1","addr":"172.21.15.40:6807","nonce":555204741}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":555204741},{"type":"v1","addr":"172.21.15.40:6815","nonce":555204741}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6809","nonce":555204741},{"type":"v1","addr":"172.21.15.40:6812","nonce":555204741}]},"public_addr":"172.21.15.40:6802/555204741","cluster_addr":"172.21.15.40:6807/555204741","heartbeat_back_addr":"172.21.15.40:6815/555204741","heartbeat_front_addr":"172.21.15.40:6812/555204741","state":["exists","up"]},{"osd":1,"uuid":"c5d628ae-36f4-4866-802c-b162f0e90add","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6801","nonce":1221318112},{"type":"v1","addr":"172.21.15.40:6803","nonce":1221318112}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6805","nonce":1221318112},{"type":"v1","addr":"172.21.15.40:6806","nonce":1221318112}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6811","nonce":1221318112},{"type":"v1","addr":"172.21.15.40:6813","nonce":1221318112}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":1221318112},{"type":"v1","addr":"172.21.15.40:6810","nonce":1221318112}]},"public_addr":"172.21.15.40:6803/1221318112","cluster_addr":"172.21.15.40:6806/1221318112","heartbeat_back_addr":"172.21.15.40:6813/1221318112","heartbeat_front_addr":"172.21.15.40:6810/1221318112","state":["exists","up"]},{"osd":2,"uuid":"d986ad6a-af2f-47fc-9c3b-fbda27b82b73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":1959000265},{"type":"v1","addr":"172.21.15.40:6817","nonce":1959000265}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6818","nonce":1959000265},{"type":"v1","addr":"172.21.15.40:6819","nonce":1959000265}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":1959000265},{"type":"v1","addr":"172.21.15.40:6827","nonce":1959000265}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":1959000265},{"type":"v1","addr":"172.21.15.40:6822","nonce":1959000265}]},"public_addr":"172.21.15.40:6817/1959000265","cluster_addr":"172.21.15.40:6819/1959000265","heartbeat_back_addr":"172.21.15.40:6827/1959000265","heartbeat_front_addr":"172.21.15.40:6822/1959000265","state":["exists","up"]},{"osd":3,"uuid":"d79d22b7-be05-41b2-b95d-697db677fd02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6821","nonce":974040287},{"type":"v1","addr":"172.21.15.40:6823","nonce":974040287}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6825","nonce":974040287},{"type":"v1","addr":"172.21.15.40:6826","nonce":974040287}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":974040287},{"type":"v1","addr":"172.21.15.40:6831","nonce":974040287}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":974040287},{"type":"v1","addr":"172.21.15.40:6829","nonce":974040287}]},"public_addr":"172.21.15.40:6823/974040287","cluster_addr":"172.21.15.40:6826/974040287","heartbeat_back_addr":"172.21.15.40:6831/974040287","heartbeat_front_addr":"172.21.15.40:6829/974040287","state":["exists","up"]},{"osd":4,"uuid":"62a7a233-d3ea-40be-91de-180c0208d639","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6808","nonce":3937787733},{"type":"v1","addr":"172.21.15.159:6809","nonce":3937787733}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6810","nonce":3937787733},{"type":"v1","addr":"172.21.15.159:6811","nonce":3937787733}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6814","nonce":3937787733},{"type":"v1","addr":"172.21.15.159:6815","nonce":3937787733}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6812","nonce":3937787733},{"type":"v1","addr":"172.21.15.159:6813","nonce":3937787733}]},"public_addr":"172.21.15.159:6809/3937787733","cluster_addr":"172.21.15.159:6811/3937787733","heartbeat_back_addr":"172.21.15.159:6815/3937787733","heartbeat_front_addr":"172.21.15.159:6813/3937787733","state":["exists","up"]},{"osd":5,"uuid":"84629cea-dc0e-4b5e-b203-5ea963839281","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6816","nonce":3032505240},{"type":"v1","addr":"172.21.15.159:6817","nonce":3032505240}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6818","nonce":3032505240},{"type":"v1","addr":"172.21.15.159:6819","nonce":3032505240}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6822","nonce":3032505240},{"type":"v1","addr":"172.21.15.159:6823","nonce":3032505240}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6820","nonce":3032505240},{"type":"v1","addr":"172.21.15.159:6821","nonce":3032505240}]},"public_addr":"172.21.15.159:6817/3032505240","cluster_addr":"172.21.15.159:6819/3032505240","heartbeat_back_addr":"172.21.15.159:6823/3032505240","heartbeat_front_addr":"172.21.15.159:6821/3032505240","state":["exists","up"]},{"osd":6,"uuid":"4ae3af3a-1743-4070-a91d-8be5c31cdb04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6800","nonce":2411788597},{"type":"v1","addr":"172.21.15.159:6801","nonce":2411788597}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6802","nonce":2411788597},{"type":"v1","addr":"172.21.15.159:6803","nonce":2411788597}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6806","nonce":2411788597},{"type":"v1","addr":"172.21.15.159:6807","nonce":2411788597}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6804","nonce":2411788597},{"type":"v1","addr":"172.21.15.159:6805","nonce":2411788597}]},"public_addr":"172.21.15.159:6801/2411788597","cluster_addr":"172.21.15.159:6803/2411788597","heartbeat_back_addr":"172.21.15.159:6807/2411788597","heartbeat_front_addr":"172.21.15.159:6805/2411788597","state":["exists","up"]},{"osd":7,"uuid":"c1f4c7f2-8f75-4f95-bc63-a332773e3b8e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6824","nonce":478953349},{"type":"v1","addr":"172.21.15.159:6825","nonce":478953349}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6826","nonce":478953349},{"type":"v1","addr":"172.21.15.159:6827","nonce":478953349}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6830","nonce":478953349},{"type":"v1","addr":"172.21.15.159:6831","nonce":478953349}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6828","nonce":478953349},{"type":"v1","addr":"172.21.15.159:6829","nonce":478953349}]},"public_addr":"172.21.15.159:6825/478953349","cluster_addr":"172.21.15.159:6827/478953349","heartbeat_back_addr":"172.21.15.159:6831/478953349","heartbeat_front_addr":"172.21.15.159:6829/478953349","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T11:48:02.023567+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T11:48:02.278216+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T11:48:02.311843+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T11:48:01.773372+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T11:48:02.618910+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T11:48:02.361559+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T11:48:02.223997+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T11:48:02.604403+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.2","mappings":[{"from":3,"to":2}]},{"pgid":"3.d","mappings":[{"from":5,"to":1}]},{"pgid":"3.13","mappings":[{"from":7,"to":2}]},{"pgid":"3.17","mappings":[{"from":0,"to":2}]},{"pgid":"3.38","mappings":[{"from":5,"to":1}]},{"pgid":"4.2","mappings":[{"from":1,"to":2}]},{"pgid":"4.10","mappings":[{"from":1,"to":2}]},{"pgid":"4.18","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-17T11:49:27.483 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:27.481+0000 7f68b3fff640 1 -- 172.21.15.40:0/2992329727 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f689406ae40 msgr2=0x7f689406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:27.483 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:27.481+0000 7f68b3fff640 1 --2- 172.21.15.40:0/2992329727 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f689406ae40 0x7f689406d300 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f68a4034000 tx=0x7f68a4009030 comp rx=0 tx=0).stop 2023-12-17T11:49:27.483 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:27.481+0000 7f68b3fff640 1 -- 172.21.15.40:0/2992329727 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f68b414f7b0 msgr2=0x7f68b415d340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:27.483 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:27.481+0000 7f68b3fff640 1 --2- 172.21.15.40:0/2992329727 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f68b414f7b0 0x7f68b415d340 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f689c00d7a0 tx=0x7f689c00dc60 comp rx=0 tx=0).stop 2023-12-17T11:49:27.483 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:27.481+0000 7f68b3fff640 1 -- 172.21.15.40:0/2992329727 shutdown_connections 2023-12-17T11:49:27.483 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:27.481+0000 7f68b3fff640 1 --2- 172.21.15.40:0/2992329727 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f689406ae40 0x7f689406d300 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:27.483 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:27.481+0000 7f68b3fff640 1 --2- 172.21.15.40:0/2992329727 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f68b41532d0 0x7f68b415f050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:27.484 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:27.481+0000 7f68b3fff640 1 --2- 172.21.15.40:0/2992329727 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f68b414f7b0 0x7f68b415d340 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:27.484 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:27.481+0000 7f68b3fff640 1 --2- 172.21.15.40:0/2992329727 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f68a0003970 0x7f68b415ea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:27.484 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:27.481+0000 7f68b3fff640 1 -- 172.21.15.40:0/2992329727 >> 172.21.15.40:0/2992329727 conn(0x7f68b40cfc30 msgr2=0x7f68b40b10d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:49:27.484 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:27.481+0000 7f68b3fff640 1 -- 172.21.15.40:0/2992329727 shutdown_connections 2023-12-17T11:49:27.484 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:27.481+0000 7f68b3fff640 1 -- 172.21.15.40:0/2992329727 wait complete. 2023-12-17T11:49:27.503 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-17T11:48:06.668943+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-17T11:48:16.151444+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-17T11:48:16.717726+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-12-17T11:48:20.534819+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-12-17T11:49:27.504 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-17T11:49:27.726 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:27.724+0000 7f412bfff640 1 Processor -- start 2023-12-17T11:49:27.726 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:27.724+0000 7f412bfff640 1 -- start start 2023-12-17T11:49:27.728 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:27.725+0000 7f412bfff640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f412c0b3350 0x7f412c0b3ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:27.728 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:27.726+0000 7f412bfff640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f412c0cfe70 0x7f412c0cdef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:27.728 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:27.726+0000 7f412bfff640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f412c0c6b80 con 0x7f412c0b3730 2023-12-17T11:49:27.728 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:27.726+0000 7f412bfff640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f412c0d3bf0 con 0x7f412c0b3350 2023-12-17T11:49:27.728 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:27.726+0000 7f412bfff640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f412c0d3ed0 con 0x7f412c0cfe70 2023-12-17T11:49:27.728 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:27.726+0000 7f412affd640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f412c0b3350 0x7f412c0b3ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:27.728 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:27.726+0000 7f412affd640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f412c0b3350 0x7f412c0b3ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:38618/0 (socket says 172.21.15.40:38618) 2023-12-17T11:49:27.728 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:27.726+0000 7f412affd640 1 -- 172.21.15.40:0/1027396608 learned_addr learned my addr 172.21.15.40:0/1027396608 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-17T11:49:27.729 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:27.726+0000 7f412b7fe640 1 --2- 172.21.15.40:0/1027396608 >> v2:172.21.15.159:3300/0 conn(0x7f412c0cfe70 0x7f412c0cdef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:27.729 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:27.727+0000 7f412affd640 1 -- 172.21.15.40:0/1027396608 >> v2:172.21.15.159:3300/0 conn(0x7f412c0cfe70 msgr2=0x7f412c0cdef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:49:27.729 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:27.727+0000 7f412affd640 1 --2- 172.21.15.40:0/1027396608 >> v2:172.21.15.159:3300/0 conn(0x7f412c0cfe70 0x7f412c0cdef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:27.729 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:27.727+0000 7f412affd640 1 -- 172.21.15.40:0/1027396608 >> v1:172.21.15.159:6789/0 conn(0x7f412c0b3730 legacy=0x7f412c0cf760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:49:27.729 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:27.727+0000 7f412affd640 1 -- 172.21.15.40:0/1027396608 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f412c0d18c0 con 0x7f412c0b3350 2023-12-17T11:49:27.729 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:27.727+0000 7f412b7fe640 1 --2- 172.21.15.40:0/1027396608 >> v2:172.21.15.159:3300/0 conn(0x7f412c0cfe70 0x7f412c0cdef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-17T11:49:27.730 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:27.728+0000 7f412affd640 1 --2- 172.21.15.40:0/1027396608 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f412c0b3350 0x7f412c0b3ba0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f412c1622a0 tx=0x7f411c02bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ebea7fc1b12cb68f server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:49:27.730 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:27.728+0000 7f4129ffb640 1 -- 172.21.15.40:0/1027396608 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f411c02ca80 con 0x7f412c0b3350 2023-12-17T11:49:27.730 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:27.728+0000 7f4129ffb640 1 -- 172.21.15.40:0/1027396608 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f411c02cbe0 con 0x7f412c0b3350 2023-12-17T11:49:27.730 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:27.728+0000 7f4129ffb640 1 -- 172.21.15.40:0/1027396608 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f411c0343f0 con 0x7f412c0b3350 2023-12-17T11:49:27.731 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:27.729+0000 7f412bfff640 1 -- 172.21.15.40:0/1027396608 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f412c0b3350 msgr2=0x7f412c0b3ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:27.731 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:27.729+0000 7f412bfff640 1 --2- 172.21.15.40:0/1027396608 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f412c0b3350 0x7f412c0b3ba0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f412c1622a0 tx=0x7f411c02bee0 comp rx=0 tx=0).stop 2023-12-17T11:49:27.731 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:27.729+0000 7f412bfff640 1 -- 172.21.15.40:0/1027396608 shutdown_connections 2023-12-17T11:49:27.731 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:27.729+0000 7f412bfff640 1 --2- 172.21.15.40:0/1027396608 >> v2:172.21.15.159:3300/0 conn(0x7f412c0cfe70 0x7f412c0cdef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:27.731 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:27.729+0000 7f412bfff640 1 --2- 172.21.15.40:0/1027396608 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f412c0b3350 0x7f412c0b3ba0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:27.732 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:27.729+0000 7f412bfff640 1 -- 172.21.15.40:0/1027396608 >> 172.21.15.40:0/1027396608 conn(0x7f412c0d3030 msgr2=0x7f412c0d3440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:49:27.732 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:27.729+0000 7f412bfff640 1 -- 172.21.15.40:0/1027396608 shutdown_connections 2023-12-17T11:49:27.732 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:27.729+0000 7f412bfff640 1 -- 172.21.15.40:0/1027396608 wait complete. 2023-12-17T11:49:27.733 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:27.731+0000 7f412bfff640 1 Processor -- start 2023-12-17T11:49:27.733 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:27.731+0000 7f412bfff640 1 -- start start 2023-12-17T11:49:27.734 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:27.732+0000 7f412bfff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f412c0b3350 0x7f412c0b1750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:27.734 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:27.732+0000 7f412bfff640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f412c0b3730 0x7f412c15bce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:27.734 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:27.732+0000 7f412bfff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f412c0cfe70 0x7f412c15c220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:27.734 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:27.732+0000 7f412bfff640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f412c155050 con 0x7f412c0cfe70 2023-12-17T11:49:27.735 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:27.732+0000 7f412bfff640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f412c0b2bb0 con 0x7f412c0b3350 2023-12-17T11:49:27.735 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:27.732+0000 7f412bfff640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f412c0b1fa0 con 0x7f412c0b3730 2023-12-17T11:49:27.735 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:27.732+0000 7f412b7fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f412c0cfe70 0x7f412c15c220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:27.735 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:27.732+0000 7f412b7fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f412c0cfe70 0x7f412c15c220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:38632/0 (socket says 172.21.15.40:38632) 2023-12-17T11:49:27.735 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:27.732+0000 7f412b7fe640 1 -- 172.21.15.40:0/2229144116 learned_addr learned my addr 172.21.15.40:0/2229144116 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-17T11:49:27.735 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:27.733+0000 7f412affd640 1 --2- 172.21.15.40:0/2229144116 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f412c0b3350 0x7f412c0b1750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:27.736 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:27.733+0000 7f412a7fc640 1 --2- 172.21.15.40:0/2229144116 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f412c0b3730 0x7f412c15bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:27.736 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:27.733+0000 7f412b7fe640 1 -- 172.21.15.40:0/2229144116 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f412c0b3730 msgr2=0x7f412c15bce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:27.736 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:27.733+0000 7f412b7fe640 1 --2- 172.21.15.40:0/2229144116 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f412c0b3730 0x7f412c15bce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:27.736 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:27.733+0000 7f412b7fe640 1 -- 172.21.15.40:0/2229144116 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f412c0b3350 msgr2=0x7f412c0b1750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:27.736 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:27.733+0000 7f412b7fe640 1 --2- 172.21.15.40:0/2229144116 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f412c0b3350 0x7f412c0b1750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:27.736 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:27.733+0000 7f412b7fe640 1 -- 172.21.15.40:0/2229144116 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f411c009b30 con 0x7f412c0cfe70 2023-12-17T11:49:27.737 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:27.733+0000 7f412affd640 1 --2- 172.21.15.40:0/2229144116 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f412c0b3350 0x7f412c0b1750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-17T11:49:27.737 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:27.733+0000 7f412b7fe640 1 --2- 172.21.15.40:0/2229144116 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f412c0cfe70 0x7f412c15c220 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f412400c5e0 tx=0x7f412400caa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:49:27.737 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:27.734+0000 7f41137fe640 1 -- 172.21.15.40:0/2229144116 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4124004220 con 0x7f412c0cfe70 2023-12-17T11:49:27.737 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:27.734+0000 7f41137fe640 1 -- 172.21.15.40:0/2229144116 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41240043a0 con 0x7f412c0cfe70 2023-12-17T11:49:27.737 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:27.734+0000 7f41137fe640 1 -- 172.21.15.40:0/2229144116 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4124003850 con 0x7f412c0cfe70 2023-12-17T11:49:27.737 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:27.734+0000 7f412bfff640 1 -- 172.21.15.40:0/2229144116 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f412c0b48a0 con 0x7f412c0cfe70 2023-12-17T11:49:27.737 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:27.734+0000 7f412bfff640 1 -- 172.21.15.40:0/2229144116 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f412c0b2560 con 0x7f412c0cfe70 2023-12-17T11:49:27.737 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:27.735+0000 7f412bfff640 1 -- 172.21.15.40:0/2229144116 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f412c15d360 con 0x7f412c0cfe70 2023-12-17T11:49:27.738 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:27.736+0000 7f41137fe640 1 -- 172.21.15.40:0/2229144116 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f41240039b0 con 0x7f412c0cfe70 2023-12-17T11:49:27.739 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:27.737+0000 7f41137fe640 1 --2- 172.21.15.40:0/2229144116 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f411806ae40 0x7f411806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:27.739 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:27.738+0000 7f41137fe640 1 -- 172.21.15.40:0/2229144116 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f4124089700 con 0x7f412c0cfe70 2023-12-17T11:49:27.740 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:27.738+0000 7f412affd640 1 --2- 172.21.15.40:0/2229144116 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f411806ae40 0x7f411806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:27.741 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:27.740+0000 7f412affd640 1 --2- 172.21.15.40:0/2229144116 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f411806ae40 0x7f411806d300 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f411c035000 tx=0x7f411c030000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:49:27.744 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:27.742+0000 7f41137fe640 1 -- 172.21.15.40:0/2229144116 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f41240543b0 con 0x7f412c0cfe70 2023-12-17T11:49:27.940 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:27.938+0000 7f412bfff640 1 -- 172.21.15.40:0/2229144116 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f412c074450 con 0x7f412c0cfe70 2023-12-17T11:49:27.940 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:27.939+0000 7f41137fe640 1 -- 172.21.15.40:0/2229144116 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) v1 ==== 93+0+10 (secure 0 0 0) 0x7f41240579d0 con 0x7f412c0cfe70 2023-12-17T11:49:27.941 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 1 2023-12-17T11:49:27.943 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:27.941+0000 7f412bfff640 1 -- 172.21.15.40:0/2229144116 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f411806ae40 msgr2=0x7f411806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:27.943 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:27.941+0000 7f412bfff640 1 --2- 172.21.15.40:0/2229144116 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f411806ae40 0x7f411806d300 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f411c035000 tx=0x7f411c030000 comp rx=0 tx=0).stop 2023-12-17T11:49:27.943 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:27.941+0000 7f412bfff640 1 -- 172.21.15.40:0/2229144116 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f412c0cfe70 msgr2=0x7f412c15c220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:27.943 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:27.941+0000 7f412bfff640 1 --2- 172.21.15.40:0/2229144116 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f412c0cfe70 0x7f412c15c220 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f412400c5e0 tx=0x7f412400caa0 comp rx=0 tx=0).stop 2023-12-17T11:49:27.944 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:27.941+0000 7f412bfff640 1 -- 172.21.15.40:0/2229144116 shutdown_connections 2023-12-17T11:49:27.944 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:27.941+0000 7f412bfff640 1 --2- 172.21.15.40:0/2229144116 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f411806ae40 0x7f411806d300 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:27.944 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:27.941+0000 7f412bfff640 1 --2- 172.21.15.40:0/2229144116 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f412c0cfe70 0x7f412c15c220 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:27.944 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:27.941+0000 7f412bfff640 1 --2- 172.21.15.40:0/2229144116 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f412c0b3730 0x7f412c15bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:27.944 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:27.941+0000 7f412bfff640 1 --2- 172.21.15.40:0/2229144116 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f412c0b3350 0x7f412c0b1750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:27.944 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:27.941+0000 7f412bfff640 1 -- 172.21.15.40:0/2229144116 >> 172.21.15.40:0/2229144116 conn(0x7f412c0d3030 msgr2=0x7f412c0cec90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:49:27.944 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:27.942+0000 7f412bfff640 1 -- 172.21.15.40:0/2229144116 shutdown_connections 2023-12-17T11:49:27.944 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:27.942+0000 7f412bfff640 1 -- 172.21.15.40:0/2229144116 wait complete. 2023-12-17T11:49:27.965 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-17T11:49:28.194 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:28.192+0000 7f4e13363640 1 Processor -- start 2023-12-17T11:49:28.194 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:28.192+0000 7f4e13363640 1 -- start start 2023-12-17T11:49:28.196 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:28.193+0000 7f4e13363640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f4e0c15d360 0x7f4e0c0d3660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:28.196 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:28.193+0000 7f4e13363640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f4e0c0cece0 0x7f4e0c0d1530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:28.196 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:28.193+0000 7f4e13363640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e0c0cdf20 con 0x7f4e0c0d1a70 2023-12-17T11:49:28.196 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:28.193+0000 7f4e13363640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e0c0d1f00 con 0x7f4e0c0cece0 2023-12-17T11:49:28.196 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:28.193+0000 7f4e13363640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e0c0ce200 con 0x7f4e0c15d360 2023-12-17T11:49:28.196 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:28.194+0000 7f4e11b60640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f4e0c0cece0 0x7f4e0c0d1530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:28.196 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:28.194+0000 7f4e11b60640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f4e0c0cece0 0x7f4e0c0d1530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:38636/0 (socket says 172.21.15.40:38636) 2023-12-17T11:49:28.196 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:28.194+0000 7f4e11b60640 1 -- 172.21.15.40:0/2044071898 learned_addr learned my addr 172.21.15.40:0/2044071898 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-17T11:49:28.197 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:28.194+0000 7f4e12361640 1 --2- 172.21.15.40:0/2044071898 >> v2:172.21.15.159:3300/0 conn(0x7f4e0c15d360 0x7f4e0c0d3660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:28.197 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:28.194+0000 7f4e11b60640 1 -- 172.21.15.40:0/2044071898 >> v2:172.21.15.159:3300/0 conn(0x7f4e0c15d360 msgr2=0x7f4e0c0d3660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:49:28.197 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:28.194+0000 7f4e11b60640 1 --2- 172.21.15.40:0/2044071898 >> v2:172.21.15.159:3300/0 conn(0x7f4e0c15d360 0x7f4e0c0d3660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:28.197 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:28.194+0000 7f4e11b60640 1 -- 172.21.15.40:0/2044071898 >> v1:172.21.15.159:6789/0 conn(0x7f4e0c0d1a70 legacy=0x7f4e0c160f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:49:28.197 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:28.194+0000 7f4e11b60640 1 -- 172.21.15.40:0/2044071898 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e0c0ce4e0 con 0x7f4e0c0cece0 2023-12-17T11:49:28.197 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:28.196+0000 7f4e11b60640 1 --2- 172.21.15.40:0/2044071898 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4e0c0cece0 0x7f4e0c0d1530 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f4e0c0d2eb0 tx=0x7f4dfc02b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b591c510143974 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:49:28.198 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:28.196+0000 7f4e1135f640 1 -- 172.21.15.40:0/2044071898 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dfc030860 con 0x7f4e0c0cece0 2023-12-17T11:49:28.198 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:28.196+0000 7f4e1135f640 1 -- 172.21.15.40:0/2044071898 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4dfc0309c0 con 0x7f4e0c0cece0 2023-12-17T11:49:28.198 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:28.196+0000 7f4e1135f640 1 -- 172.21.15.40:0/2044071898 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dfc030d50 con 0x7f4e0c0cece0 2023-12-17T11:49:28.199 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:28.197+0000 7f4e13363640 1 -- 172.21.15.40:0/2044071898 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4e0c0cece0 msgr2=0x7f4e0c0d1530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:28.199 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:28.197+0000 7f4e13363640 1 --2- 172.21.15.40:0/2044071898 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4e0c0cece0 0x7f4e0c0d1530 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f4e0c0d2eb0 tx=0x7f4dfc02b9a0 comp rx=0 tx=0).stop 2023-12-17T11:49:28.199 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:28.197+0000 7f4e13363640 1 -- 172.21.15.40:0/2044071898 shutdown_connections 2023-12-17T11:49:28.199 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:28.197+0000 7f4e13363640 1 --2- 172.21.15.40:0/2044071898 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4e0c0cece0 0x7f4e0c0d1530 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:28.199 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:28.197+0000 7f4e13363640 1 --2- 172.21.15.40:0/2044071898 >> v2:172.21.15.159:3300/0 conn(0x7f4e0c15d360 0x7f4e0c0d3660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:28.199 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:28.197+0000 7f4e13363640 1 -- 172.21.15.40:0/2044071898 >> 172.21.15.40:0/2044071898 conn(0x7f4e0c09c230 msgr2=0x7f4e0c0d2f50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:49:28.199 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:28.197+0000 7f4e13363640 1 -- 172.21.15.40:0/2044071898 shutdown_connections 2023-12-17T11:49:28.199 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:28.197+0000 7f4e13363640 1 -- 172.21.15.40:0/2044071898 wait complete. 2023-12-17T11:49:28.200 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:28.199+0000 7f4e13363640 1 Processor -- start 2023-12-17T11:49:28.201 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:28.199+0000 7f4e13363640 1 -- start start 2023-12-17T11:49:28.203 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:28.200+0000 7f4e13363640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f4e0c0cece0 0x7f4e0c0b77b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:28.203 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:28.200+0000 7f4e13363640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4e0c0d1a70 0x7f4e0c0c9460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:28.203 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:28.200+0000 7f4e13363640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4e0c15d360 0x7f4e0c15da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:28.203 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:28.200+0000 7f4e13363640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e0c0b7cf0 con 0x7f4e0c15d360 2023-12-17T11:49:28.203 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:28.200+0000 7f4e13363640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e0c0c99a0 con 0x7f4e0c0d1a70 2023-12-17T11:49:28.203 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:28.200+0000 7f4e13363640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e0c0b6d10 con 0x7f4e0c0cece0 2023-12-17T11:49:28.203 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:28.200+0000 7f4e12b62640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4e0c15d360 0x7f4e0c15da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:28.203 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:28.200+0000 7f4e12b62640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4e0c15d360 0x7f4e0c15da40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:38638/0 (socket says 172.21.15.40:38638) 2023-12-17T11:49:28.203 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:28.200+0000 7f4e12b62640 1 -- 172.21.15.40:0/944761134 learned_addr learned my addr 172.21.15.40:0/944761134 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-17T11:49:28.203 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:28.201+0000 7f4e11b60640 1 --2- 172.21.15.40:0/944761134 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4e0c0d1a70 0x7f4e0c0c9460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:28.203 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:28.201+0000 7f4e12361640 1 --2- 172.21.15.40:0/944761134 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f4e0c0cece0 0x7f4e0c0b77b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:28.203 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:28.201+0000 7f4e12b62640 1 -- 172.21.15.40:0/944761134 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f4e0c0cece0 msgr2=0x7f4e0c0b77b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:28.204 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:28.201+0000 7f4e12b62640 1 --2- 172.21.15.40:0/944761134 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f4e0c0cece0 0x7f4e0c0b77b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:28.204 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:28.201+0000 7f4e12b62640 1 -- 172.21.15.40:0/944761134 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4e0c0d1a70 msgr2=0x7f4e0c0c9460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:28.204 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:28.201+0000 7f4e12b62640 1 --2- 172.21.15.40:0/944761134 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4e0c0d1a70 0x7f4e0c0c9460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:28.204 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:28.201+0000 7f4e12b62640 1 -- 172.21.15.40:0/944761134 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4dfc0094d0 con 0x7f4e0c15d360 2023-12-17T11:49:28.205 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:28.201+0000 7f4e12b62640 1 --2- 172.21.15.40:0/944761134 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4e0c15d360 0x7f4e0c15da40 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f4e0400b3e0 tx=0x7f4e0400b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:49:28.205 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:28.201+0000 7f4e02ffd640 1 -- 172.21.15.40:0/944761134 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e04011830 con 0x7f4e0c15d360 2023-12-17T11:49:28.205 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:28.201+0000 7f4e02ffd640 1 -- 172.21.15.40:0/944761134 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e04011990 con 0x7f4e0c15d360 2023-12-17T11:49:28.205 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:28.201+0000 7f4e02ffd640 1 -- 172.21.15.40:0/944761134 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e04011d80 con 0x7f4e0c15d360 2023-12-17T11:49:28.205 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:28.201+0000 7f4e13363640 1 -- 172.21.15.40:0/944761134 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e0c15df80 con 0x7f4e0c15d360 2023-12-17T11:49:28.205 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:28.202+0000 7f4e13363640 1 -- 172.21.15.40:0/944761134 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e0c0b6fb0 con 0x7f4e0c15d360 2023-12-17T11:49:28.205 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:28.203+0000 7f4e13363640 1 -- 172.21.15.40:0/944761134 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e0c0678e0 con 0x7f4e0c15d360 2023-12-17T11:49:28.205 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:28.204+0000 7f4e02ffd640 1 -- 172.21.15.40:0/944761134 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f4e0401a400 con 0x7f4e0c15d360 2023-12-17T11:49:28.207 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:28.205+0000 7f4e02ffd640 1 --2- 172.21.15.40:0/944761134 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f4df006ae70 0x7f4df006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:28.207 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:28.205+0000 7f4e02ffd640 1 -- 172.21.15.40:0/944761134 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f4e040897f0 con 0x7f4e0c15d360 2023-12-17T11:49:28.207 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:28.206+0000 7f4e12361640 1 --2- 172.21.15.40:0/944761134 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f4df006ae70 0x7f4df006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:28.209 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:28.207+0000 7f4e12361640 1 --2- 172.21.15.40:0/944761134 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f4df006ae70 0x7f4df006d330 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f4e080070b0 tx=0x7f4e08007040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:49:28.211 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:28.209+0000 7f4e02ffd640 1 -- 172.21.15.40:0/944761134 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f4e040544d0 con 0x7f4e0c15d360 2023-12-17T11:49:28.405 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:28.403+0000 7f4e13363640 1 -- 172.21.15.40:0/944761134 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f4e0c074450 con 0x7f4e0c15d360 2023-12-17T11:49:28.406 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:28.404+0000 7f4e02ffd640 1 -- 172.21.15.40:0/944761134 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) v1 ==== 104+0+11 (secure 0 0 0) 0x7f4e04057af0 con 0x7f4e0c15d360 2023-12-17T11:49:28.406 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 32 2023-12-17T11:49:28.409 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:28.406+0000 7f4e13363640 1 -- 172.21.15.40:0/944761134 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f4df006ae70 msgr2=0x7f4df006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:28.409 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:28.406+0000 7f4e13363640 1 --2- 172.21.15.40:0/944761134 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f4df006ae70 0x7f4df006d330 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f4e080070b0 tx=0x7f4e08007040 comp rx=0 tx=0).stop 2023-12-17T11:49:28.409 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:28.406+0000 7f4e13363640 1 -- 172.21.15.40:0/944761134 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4e0c15d360 msgr2=0x7f4e0c15da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:28.409 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:28.406+0000 7f4e13363640 1 --2- 172.21.15.40:0/944761134 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4e0c15d360 0x7f4e0c15da40 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f4e0400b3e0 tx=0x7f4e0400b8a0 comp rx=0 tx=0).stop 2023-12-17T11:49:28.409 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:28.406+0000 7f4e13363640 1 -- 172.21.15.40:0/944761134 shutdown_connections 2023-12-17T11:49:28.409 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:28.407+0000 7f4e13363640 1 --2- 172.21.15.40:0/944761134 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f4df006ae70 0x7f4df006d330 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:28.409 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:28.407+0000 7f4e13363640 1 --2- 172.21.15.40:0/944761134 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4e0c15d360 0x7f4e0c15da40 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:28.409 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:28.407+0000 7f4e13363640 1 --2- 172.21.15.40:0/944761134 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4e0c0d1a70 0x7f4e0c0c9460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:28.409 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:28.407+0000 7f4e13363640 1 --2- 172.21.15.40:0/944761134 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f4e0c0cece0 0x7f4e0c0b77b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:28.409 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:28.407+0000 7f4e13363640 1 -- 172.21.15.40:0/944761134 >> 172.21.15.40:0/944761134 conn(0x7f4e0c09c230 msgr2=0x7f4e0c0b1260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:49:28.410 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:28.407+0000 7f4e13363640 1 -- 172.21.15.40:0/944761134 shutdown_connections 2023-12-17T11:49:28.410 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:28.407+0000 7f4e13363640 1 -- 172.21.15.40:0/944761134 wait complete. 2023-12-17T11:49:28.427 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-17T11:49:28.654 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:28.651+0000 7fef8a17c640 1 Processor -- start 2023-12-17T11:49:28.654 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:28.652+0000 7fef8a17c640 1 -- start start 2023-12-17T11:49:28.655 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:28.653+0000 7fef8a17c640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fef840cfe70 0x7fef84168530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:28.655 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:28.653+0000 7fef8a17c640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef840c6b80 con 0x7fef840b3730 2023-12-17T11:49:28.655 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:28.653+0000 7fef8a17c640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef840d3bf0 con 0x7fef840b3350 2023-12-17T11:49:28.656 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:28.653+0000 7fef8a17c640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef840d3ed0 con 0x7fef840cfe70 2023-12-17T11:49:28.656 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:28.653+0000 7fef88979640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fef840b3730 0x7fef840cf760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:57084/0 (socket says 172.21.15.40:57084) 2023-12-17T11:49:28.656 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:28.654+0000 7fef88979640 1 -- 172.21.15.40:0/4287296662 learned_addr learned my addr 172.21.15.40:0/4287296662 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-12-17T11:49:28.656 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:28.654+0000 7fef8997b640 1 --2- 172.21.15.40:0/4287296662 >> v2:172.21.15.40:3300/0 conn(0x7fef840cfe70 0x7fef84168530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:28.656 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:28.654+0000 7fef7bfff640 1 -- 172.21.15.40:0/4287296662 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1801944591 0 0) 0x7fef840c6b80 con 0x7fef840b3730 2023-12-17T11:49:28.656 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:28.654+0000 7fef7bfff640 1 -- 172.21.15.40:0/4287296662 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fef70003520 con 0x7fef840b3730 2023-12-17T11:49:28.656 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:28.654+0000 7fef8997b640 1 -- 172.21.15.40:0/4287296662 >> v1:172.21.15.159:6789/0 conn(0x7fef840b3350 legacy=0x7fef840b3ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:49:28.657 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:28.654+0000 7fef8997b640 1 -- 172.21.15.40:0/4287296662 >> v1:172.21.15.40:6789/0 conn(0x7fef840b3730 legacy=0x7fef840cf760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:28.657 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:28.654+0000 7fef8997b640 1 -- 172.21.15.40:0/4287296662 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef840d18c0 con 0x7fef840cfe70 2023-12-17T11:49:28.657 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:28.655+0000 7fef8997b640 1 --2- 172.21.15.40:0/4287296662 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fef840cfe70 0x7fef84168530 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fef7c009d90 tx=0x7fef7c02beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6234bfd9e16d6e59 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:49:28.657 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:28.655+0000 7fef7bfff640 1 -- 172.21.15.40:0/4287296662 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef7c02cc60 con 0x7fef840cfe70 2023-12-17T11:49:28.657 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:28.656+0000 7fef7bfff640 1 -- 172.21.15.40:0/4287296662 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef7c02cdc0 con 0x7fef840cfe70 2023-12-17T11:49:28.658 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:28.656+0000 7fef7bfff640 1 -- 172.21.15.40:0/4287296662 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef7c034660 con 0x7fef840cfe70 2023-12-17T11:49:28.658 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:28.656+0000 7fef8a17c640 1 -- 172.21.15.40:0/4287296662 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fef840cfe70 msgr2=0x7fef84168530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:28.658 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:28.656+0000 7fef8a17c640 1 --2- 172.21.15.40:0/4287296662 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fef840cfe70 0x7fef84168530 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fef7c009d90 tx=0x7fef7c02beb0 comp rx=0 tx=0).stop 2023-12-17T11:49:28.658 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:28.656+0000 7fef8a17c640 1 -- 172.21.15.40:0/4287296662 shutdown_connections 2023-12-17T11:49:28.659 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:28.656+0000 7fef8a17c640 1 --2- 172.21.15.40:0/4287296662 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fef840cfe70 0x7fef84168530 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:28.659 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:28.656+0000 7fef8a17c640 1 -- 172.21.15.40:0/4287296662 >> 172.21.15.40:0/4287296662 conn(0x7fef840d3030 msgr2=0x7fef840d3440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:49:28.659 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:28.656+0000 7fef8a17c640 1 -- 172.21.15.40:0/4287296662 shutdown_connections 2023-12-17T11:49:28.659 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:28.656+0000 7fef8a17c640 1 -- 172.21.15.40:0/4287296662 wait complete. 2023-12-17T11:49:28.660 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:28.658+0000 7fef8a17c640 1 Processor -- start 2023-12-17T11:49:28.660 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:28.658+0000 7fef8a17c640 1 -- start start 2023-12-17T11:49:28.662 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:28.659+0000 7fef8a17c640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fef840b3350 0x7fef840b76b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:28.662 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:28.659+0000 7fef8a17c640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fef840b3730 0x7fef841f2ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:28.662 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:28.659+0000 7fef8a17c640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fef840cfe70 0x7fef841f3000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:28.662 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:28.659+0000 7fef8a17c640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef840b8650 con 0x7fef840cfe70 2023-12-17T11:49:28.662 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:28.659+0000 7fef8a17c640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef8415e980 con 0x7fef840b3350 2023-12-17T11:49:28.662 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:28.659+0000 7fef8a17c640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef840b8090 con 0x7fef840b3730 2023-12-17T11:49:28.662 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:28.659+0000 7fef8997b640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fef840cfe70 0x7fef841f3000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:28.663 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:28.659+0000 7fef8997b640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fef840cfe70 0x7fef841f3000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:38658/0 (socket says 172.21.15.40:38658) 2023-12-17T11:49:28.663 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:28.659+0000 7fef8997b640 1 -- 172.21.15.40:0/2844432137 learned_addr learned my addr 172.21.15.40:0/2844432137 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-17T11:49:28.663 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:28.660+0000 7fef8917a640 1 --2- 172.21.15.40:0/2844432137 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fef840b3350 0x7fef840b76b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:28.663 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:28.660+0000 7fef88979640 1 --2- 172.21.15.40:0/2844432137 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fef840b3730 0x7fef841f2ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:28.663 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:28.660+0000 7fef8997b640 1 -- 172.21.15.40:0/2844432137 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fef840b3730 msgr2=0x7fef841f2ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:28.663 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:28.660+0000 7fef8997b640 1 --2- 172.21.15.40:0/2844432137 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fef840b3730 0x7fef841f2ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:28.663 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:28.660+0000 7fef8997b640 1 -- 172.21.15.40:0/2844432137 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fef840b3350 msgr2=0x7fef840b76b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:28.663 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:28.660+0000 7fef8997b640 1 --2- 172.21.15.40:0/2844432137 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fef840b3350 0x7fef840b76b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:28.663 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:28.660+0000 7fef8997b640 1 -- 172.21.15.40:0/2844432137 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef7c009a70 con 0x7fef840cfe70 2023-12-17T11:49:28.663 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:28.660+0000 7fef8997b640 1 --2- 172.21.15.40:0/2844432137 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fef840cfe70 0x7fef841f3000 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fef7c009d90 tx=0x7fef7c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:49:28.664 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:28.661+0000 7fef79ffb640 1 -- 172.21.15.40:0/2844432137 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef7c040650 con 0x7fef840cfe70 2023-12-17T11:49:28.664 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:28.661+0000 7fef79ffb640 1 -- 172.21.15.40:0/2844432137 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef7c0407b0 con 0x7fef840cfe70 2023-12-17T11:49:28.664 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:28.661+0000 7fef79ffb640 1 -- 172.21.15.40:0/2844432137 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef7c040b60 con 0x7fef840cfe70 2023-12-17T11:49:28.664 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:28.661+0000 7fef8a17c640 1 -- 172.21.15.40:0/2844432137 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef840b48a0 con 0x7fef840cfe70 2023-12-17T11:49:28.664 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:28.661+0000 7fef8a17c640 1 -- 172.21.15.40:0/2844432137 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef8415ec20 con 0x7fef840cfe70 2023-12-17T11:49:28.665 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:28.662+0000 7fef8a17c640 1 -- 172.21.15.40:0/2844432137 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef84074450 con 0x7fef840cfe70 2023-12-17T11:49:28.665 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:28.663+0000 7fef79ffb640 1 -- 172.21.15.40:0/2844432137 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fef7c040cc0 con 0x7fef840cfe70 2023-12-17T11:49:28.666 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:28.664+0000 7fef79ffb640 1 --2- 172.21.15.40:0/2844432137 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7fef6806ae40 0x7fef6806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:28.668 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:28.664+0000 7fef79ffb640 1 -- 172.21.15.40:0/2844432137 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6692+0+0 (secure 0 0 0) 0x7fef7c0ac7a0 con 0x7fef840cfe70 2023-12-17T11:49:28.669 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:28.665+0000 7fef8917a640 1 --2- 172.21.15.40:0/2844432137 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7fef6806ae40 0x7fef6806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:28.669 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:28.666+0000 7fef8917a640 1 --2- 172.21.15.40:0/2844432137 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7fef6806ae40 0x7fef6806d300 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fef80006fd0 tx=0x7fef80008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:49:28.670 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:28.669+0000 7fef79ffb640 1 -- 172.21.15.40:0/2844432137 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fef7c077530 con 0x7fef840cfe70 2023-12-17T11:49:28.873 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:28.868+0000 7fef8a17c640 1 -- 172.21.15.40:0/2844432137 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fef84072830 con 0x7fef840cfe70 2023-12-17T11:49:28.873 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:28.869+0000 7fef79ffb640 1 -- 172.21.15.40:0/2844432137 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) v1 ==== 100+0+11 (secure 0 0 0) 0x7fef7c009450 con 0x7fef840cfe70 2023-12-17T11:49:28.873 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 64 2023-12-17T11:49:28.874 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:28.872+0000 7fef8a17c640 1 -- 172.21.15.40:0/2844432137 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7fef6806ae40 msgr2=0x7fef6806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:28.874 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:28.872+0000 7fef8a17c640 1 --2- 172.21.15.40:0/2844432137 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7fef6806ae40 0x7fef6806d300 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fef80006fd0 tx=0x7fef80008040 comp rx=0 tx=0).stop 2023-12-17T11:49:28.874 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:28.872+0000 7fef8a17c640 1 -- 172.21.15.40:0/2844432137 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fef840cfe70 msgr2=0x7fef841f3000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:28.875 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:28.872+0000 7fef8a17c640 1 --2- 172.21.15.40:0/2844432137 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fef840cfe70 0x7fef841f3000 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fef7c009d90 tx=0x7fef7c004a40 comp rx=0 tx=0).stop 2023-12-17T11:49:28.875 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:28.872+0000 7fef8a17c640 1 -- 172.21.15.40:0/2844432137 shutdown_connections 2023-12-17T11:49:28.875 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:28.872+0000 7fef8a17c640 1 --2- 172.21.15.40:0/2844432137 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7fef6806ae40 0x7fef6806d300 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:28.875 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:28.872+0000 7fef8a17c640 1 --2- 172.21.15.40:0/2844432137 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fef840cfe70 0x7fef841f3000 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:28.875 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:28.872+0000 7fef8a17c640 1 --2- 172.21.15.40:0/2844432137 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fef840b3730 0x7fef841f2ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:28.875 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:28.872+0000 7fef8a17c640 1 --2- 172.21.15.40:0/2844432137 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fef840b3350 0x7fef840b76b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:28.875 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:28.872+0000 7fef8a17c640 1 -- 172.21.15.40:0/2844432137 >> 172.21.15.40:0/2844432137 conn(0x7fef840d3030 msgr2=0x7fef8406aee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:49:28.876 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:28.872+0000 7fef8a17c640 1 -- 172.21.15.40:0/2844432137 shutdown_connections 2023-12-17T11:49:28.876 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:28.872+0000 7fef8a17c640 1 -- 172.21.15.40:0/2844432137 wait complete. 2023-12-17T11:49:28.894 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-12-17T11:49:29.121 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:29.119+0000 7f8df359e640 1 Processor -- start 2023-12-17T11:49:29.122 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:29.119+0000 7f8df359e640 1 -- start start 2023-12-17T11:49:29.124 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:29.121+0000 7f8df359e640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f8df415d360 0x7f8df40d3660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:29.124 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:29.121+0000 7f8df359e640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8df40cece0 0x7f8df40d1530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:29.125 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:29.121+0000 7f8df359e640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f8df40d1a70 0x7f8df4160f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:29.125 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:29.121+0000 7f8df359e640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8df40d1f00 con 0x7f8df415d360 2023-12-17T11:49:29.125 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:29.121+0000 7f8df359e640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8df40cdf20 con 0x7f8df40d1a70 2023-12-17T11:49:29.125 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:29.121+0000 7f8df359e640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8df40ce200 con 0x7f8df40cece0 2023-12-17T11:49:29.125 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:29.121+0000 7f8df259c640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f8df415d360 0x7f8df40d3660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:29.125 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:29.121+0000 7f8df259c640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f8df415d360 0x7f8df40d3660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:38662/0 (socket says 172.21.15.40:38662) 2023-12-17T11:49:29.126 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:29.121+0000 7f8df259c640 1 -- 172.21.15.40:0/3466971880 learned_addr learned my addr 172.21.15.40:0/3466971880 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-17T11:49:29.126 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:29.121+0000 7f8df2d9d640 1 --2- 172.21.15.40:0/3466971880 >> v2:172.21.15.159:3300/0 conn(0x7f8df40d1a70 0x7f8df4160f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:29.126 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:29.122+0000 7f8df1d9b640 1 --2- 172.21.15.40:0/3466971880 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8df40cece0 0x7f8df40d1530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:29.126 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:29.122+0000 7f8df259c640 1 -- 172.21.15.40:0/3466971880 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8df40cece0 msgr2=0x7f8df40d1530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:49:29.126 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:29.122+0000 7f8df259c640 1 --2- 172.21.15.40:0/3466971880 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8df40cece0 0x7f8df40d1530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:29.127 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:29.122+0000 7f8df259c640 1 -- 172.21.15.40:0/3466971880 >> v2:172.21.15.159:3300/0 conn(0x7f8df40d1a70 msgr2=0x7f8df4160f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:49:29.127 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:29.122+0000 7f8df259c640 1 --2- 172.21.15.40:0/3466971880 >> v2:172.21.15.159:3300/0 conn(0x7f8df40d1a70 0x7f8df4160f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:29.127 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:29.122+0000 7f8df259c640 1 -- 172.21.15.40:0/3466971880 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8df40ce4e0 con 0x7f8df415d360 2023-12-17T11:49:29.133 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:29.123+0000 7f8df259c640 1 --2- 172.21.15.40:0/3466971880 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8df415d360 0x7f8df40d3660 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f8df4162040 tx=0x7f8de402bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d0308d6f067f927 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:49:29.133 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:29.124+0000 7f8df159a640 1 -- 172.21.15.40:0/3466971880 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8de402cb00 con 0x7f8df415d360 2023-12-17T11:49:29.134 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:29.124+0000 7f8df159a640 1 -- 172.21.15.40:0/3466971880 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8de402cc60 con 0x7f8df415d360 2023-12-17T11:49:29.134 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:29.124+0000 7f8df159a640 1 -- 172.21.15.40:0/3466971880 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8de40343f0 con 0x7f8df415d360 2023-12-17T11:49:29.134 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:29.124+0000 7f8df359e640 1 -- 172.21.15.40:0/3466971880 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8df415d360 msgr2=0x7f8df40d3660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:29.134 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:29.124+0000 7f8df359e640 1 --2- 172.21.15.40:0/3466971880 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8df415d360 0x7f8df40d3660 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f8df4162040 tx=0x7f8de402bf60 comp rx=0 tx=0).stop 2023-12-17T11:49:29.134 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:29.124+0000 7f8df359e640 1 -- 172.21.15.40:0/3466971880 shutdown_connections 2023-12-17T11:49:29.134 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:29.124+0000 7f8df359e640 1 --2- 172.21.15.40:0/3466971880 >> v2:172.21.15.159:3300/0 conn(0x7f8df40d1a70 0x7f8df4160f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:29.135 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:29.124+0000 7f8df359e640 1 --2- 172.21.15.40:0/3466971880 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8df40cece0 0x7f8df40d1530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:29.135 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:29.125+0000 7f8df359e640 1 --2- 172.21.15.40:0/3466971880 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8df415d360 0x7f8df40d3660 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:29.135 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:29.125+0000 7f8df359e640 1 -- 172.21.15.40:0/3466971880 >> 172.21.15.40:0/3466971880 conn(0x7f8df409c230 msgr2=0x7f8df40d2f50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:49:29.135 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:29.125+0000 7f8df359e640 1 -- 172.21.15.40:0/3466971880 shutdown_connections 2023-12-17T11:49:29.135 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:29.125+0000 7f8df359e640 1 -- 172.21.15.40:0/3466971880 wait complete. 2023-12-17T11:49:29.135 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:29.126+0000 7f8df359e640 1 Processor -- start 2023-12-17T11:49:29.136 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:29.127+0000 7f8df359e640 1 -- start start 2023-12-17T11:49:29.136 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:29.128+0000 7f8df359e640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8df40cece0 0x7f8df41e8cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:29.136 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:29.128+0000 7f8df359e640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8df40d1a70 0x7f8df40b5b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:29.136 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:29.128+0000 7f8df359e640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8df415d360 0x7f8df40b60b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:29.136 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:29.128+0000 7f8df359e640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8df40ca940 con 0x7f8df40d1a70 2023-12-17T11:49:29.136 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:29.128+0000 7f8df359e640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8df4160220 con 0x7f8df40cece0 2023-12-17T11:49:29.137 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:29.128+0000 7f8df359e640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8df40cab50 con 0x7f8df415d360 2023-12-17T11:49:29.137 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:29.128+0000 7f8df1d9b640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8df40d1a70 0x7f8df40b5b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:29.137 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:29.128+0000 7f8df1d9b640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8df40d1a70 0x7f8df40b5b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:38666/0 (socket says 172.21.15.40:38666) 2023-12-17T11:49:29.137 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:29.128+0000 7f8df1d9b640 1 -- 172.21.15.40:0/2446591234 learned_addr learned my addr 172.21.15.40:0/2446591234 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-17T11:49:29.137 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:29.128+0000 7f8df1d9b640 1 -- 172.21.15.40:0/2446591234 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8df415d360 msgr2=0x7f8df40b60b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:29.137 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:29.128+0000 7f8df1d9b640 1 --2- 172.21.15.40:0/2446591234 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8df415d360 0x7f8df40b60b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:29.138 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:29.128+0000 7f8df1d9b640 1 -- 172.21.15.40:0/2446591234 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8df40cece0 msgr2=0x7f8df41e8cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:29.138 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:29.128+0000 7f8df1d9b640 1 --2- 172.21.15.40:0/2446591234 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8df40cece0 0x7f8df41e8cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:29.138 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:29.128+0000 7f8df1d9b640 1 -- 172.21.15.40:0/2446591234 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8de4009b30 con 0x7f8df40d1a70 2023-12-17T11:49:29.138 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:29.129+0000 7f8df1d9b640 1 --2- 172.21.15.40:0/2446591234 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8df40d1a70 0x7f8df40b5b70 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f8ddc00d800 tx=0x7f8ddc00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:49:29.138 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:29.129+0000 7f8deaffd640 1 -- 172.21.15.40:0/2446591234 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ddc0096a0 con 0x7f8df40d1a70 2023-12-17T11:49:29.139 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:29.129+0000 7f8deaffd640 1 -- 172.21.15.40:0/2446591234 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ddc009800 con 0x7f8df40d1a70 2023-12-17T11:49:29.139 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:29.129+0000 7f8deaffd640 1 -- 172.21.15.40:0/2446591234 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ddc009990 con 0x7f8df40d1a70 2023-12-17T11:49:29.139 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:29.129+0000 7f8df359e640 1 -- 172.21.15.40:0/2446591234 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8df40cae30 con 0x7f8df40d1a70 2023-12-17T11:49:29.139 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:29.129+0000 7f8df359e640 1 -- 172.21.15.40:0/2446591234 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8df41e91f0 con 0x7f8df40d1a70 2023-12-17T11:49:29.139 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:29.130+0000 7f8df359e640 1 -- 172.21.15.40:0/2446591234 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8df40678e0 con 0x7f8df40d1a70 2023-12-17T11:49:29.139 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:29.131+0000 7f8deaffd640 1 -- 172.21.15.40:0/2446591234 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f8ddc009af0 con 0x7f8df40d1a70 2023-12-17T11:49:29.141 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:29.132+0000 7f8deaffd640 1 --2- 172.21.15.40:0/2446591234 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f8dd406ae40 0x7f8dd406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:29.141 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:29.132+0000 7f8deaffd640 1 -- 172.21.15.40:0/2446591234 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f8ddc089f70 con 0x7f8df40d1a70 2023-12-17T11:49:29.141 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:29.133+0000 7f8df259c640 1 --2- 172.21.15.40:0/2446591234 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f8dd406ae40 0x7f8dd406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:29.141 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:29.134+0000 7f8df259c640 1 --2- 172.21.15.40:0/2446591234 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f8dd406ae40 0x7f8dd406d300 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f8de4035000 tx=0x7f8de402e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:49:29.141 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:29.136+0000 7f8deaffd640 1 -- 172.21.15.40:0/2446591234 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f8ddc054ba0 con 0x7f8df40d1a70 2023-12-17T11:49:29.333 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:29.331+0000 7f8df359e640 1 -- 172.21.15.40:0/2446591234 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f8df4074450 con 0x7f8df40d1a70 2023-12-17T11:49:29.334 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:29.332+0000 7f8deaffd640 1 -- 172.21.15.40:0/2446591234 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) v1 ==== 103+0+11 (secure 0 0 0) 0x7f8ddc0581c0 con 0x7f8df40d1a70 2023-12-17T11:49:29.334 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 32 2023-12-17T11:49:29.337 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:29.334+0000 7f8df359e640 1 -- 172.21.15.40:0/2446591234 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f8dd406ae40 msgr2=0x7f8dd406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:29.337 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:29.334+0000 7f8df359e640 1 --2- 172.21.15.40:0/2446591234 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f8dd406ae40 0x7f8dd406d300 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f8de4035000 tx=0x7f8de402e000 comp rx=0 tx=0).stop 2023-12-17T11:49:29.337 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:29.334+0000 7f8df359e640 1 -- 172.21.15.40:0/2446591234 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8df40d1a70 msgr2=0x7f8df40b5b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:29.337 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:29.334+0000 7f8df359e640 1 --2- 172.21.15.40:0/2446591234 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8df40d1a70 0x7f8df40b5b70 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f8ddc00d800 tx=0x7f8ddc00dcc0 comp rx=0 tx=0).stop 2023-12-17T11:49:29.337 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:29.335+0000 7f8df359e640 1 -- 172.21.15.40:0/2446591234 shutdown_connections 2023-12-17T11:49:29.337 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:29.335+0000 7f8df359e640 1 --2- 172.21.15.40:0/2446591234 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f8dd406ae40 0x7f8dd406d300 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:29.337 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:29.335+0000 7f8df359e640 1 --2- 172.21.15.40:0/2446591234 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f8df415d360 0x7f8df40b60b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:29.337 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:29.335+0000 7f8df359e640 1 --2- 172.21.15.40:0/2446591234 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8df40d1a70 0x7f8df40b5b70 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:29.337 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:29.335+0000 7f8df359e640 1 --2- 172.21.15.40:0/2446591234 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8df40cece0 0x7f8df41e8cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:29.337 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:29.335+0000 7f8df359e640 1 -- 172.21.15.40:0/2446591234 >> 172.21.15.40:0/2446591234 conn(0x7f8df409c230 msgr2=0x7f8df40b0290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:49:29.337 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:29.335+0000 7f8df359e640 1 -- 172.21.15.40:0/2446591234 shutdown_connections 2023-12-17T11:49:29.338 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:29.335+0000 7f8df359e640 1 -- 172.21.15.40:0/2446591234 wait complete. 2023-12-17T11:49:29.357 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-17T11:49:29.585 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:29.583+0000 7fde7d9f4640 1 Processor -- start 2023-12-17T11:49:29.585 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:29.583+0000 7fde7d9f4640 1 -- start start 2023-12-17T11:49:29.587 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:29.585+0000 7fde7d9f4640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fde7815e5d0 0x7fde7806bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:29.587 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:29.585+0000 7fde7d9f4640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7fde780ae200 0x7fde78070b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:29.587 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:29.585+0000 7fde7d9f4640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde78071f90 con 0x7fde7806c330 2023-12-17T11:49:29.587 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:29.585+0000 7fde7d9f4640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde78072270 con 0x7fde780ae200 2023-12-17T11:49:29.587 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:29.585+0000 7fde7d9f4640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde78070070 con 0x7fde7815e5d0 2023-12-17T11:49:29.587 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:29.585+0000 7fde7d1f3640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fde7806c330 0x7fde780cded0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:57098/0 (socket says 172.21.15.40:57098) 2023-12-17T11:49:29.587 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:29.585+0000 7fde7d1f3640 1 -- 172.21.15.40:0/4104185295 learned_addr learned my addr 172.21.15.40:0/4104185295 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-12-17T11:49:29.589 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:29.586+0000 7fde6ffff640 1 --2- 172.21.15.40:0/4104185295 >> v2:172.21.15.159:3300/0 conn(0x7fde780ae200 0x7fde78070b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:29.589 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:29.586+0000 7fde7c9f2640 1 --2- 172.21.15.40:0/4104185295 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fde7815e5d0 0x7fde7806bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:29.590 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:29.586+0000 7fde6f7fe640 1 -- 172.21.15.40:0/4104185295 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 779497050 0 0) 0x7fde78071f90 con 0x7fde7806c330 2023-12-17T11:49:29.590 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:29.586+0000 7fde6f7fe640 1 -- 172.21.15.40:0/4104185295 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fde60003520 con 0x7fde7806c330 2023-12-17T11:49:29.590 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:29.586+0000 7fde6f7fe640 1 -- 172.21.15.40:0/4104185295 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 372720053 0 0) 0x7fde60003520 con 0x7fde7806c330 2023-12-17T11:49:29.590 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:29.586+0000 7fde6f7fe640 1 -- 172.21.15.40:0/4104185295 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fde7815e5d0 msgr2=0x7fde7806bdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:49:29.590 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:29.586+0000 7fde6f7fe640 1 --2- 172.21.15.40:0/4104185295 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fde7815e5d0 0x7fde7806bdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:29.590 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:29.586+0000 7fde6f7fe640 1 -- 172.21.15.40:0/4104185295 >> v2:172.21.15.159:3300/0 conn(0x7fde780ae200 msgr2=0x7fde78070b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:49:29.590 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:29.586+0000 7fde6f7fe640 1 --2- 172.21.15.40:0/4104185295 >> v2:172.21.15.159:3300/0 conn(0x7fde780ae200 0x7fde78070b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:29.590 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:29.586+0000 7fde6f7fe640 1 -- 172.21.15.40:0/4104185295 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde78070350 con 0x7fde7806c330 2023-12-17T11:49:29.590 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:29.586+0000 7fde6f7fe640 1 -- 172.21.15.40:0/4104185295 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2643242555 0 0) 0x7fde70001670 con 0x7fde7806c330 2023-12-17T11:49:29.590 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:29.586+0000 7fde6f7fe640 1 -- 172.21.15.40:0/4104185295 >> v1:172.21.15.40:6789/0 conn(0x7fde7806c330 legacy=0x7fde780cded0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:29.590 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:29.586+0000 7fde6f7fe640 1 --2- 172.21.15.40:0/4104185295 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fde60003970 0x7fde60003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:29.590 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:29.586+0000 7fde6f7fe640 1 --2- 172.21.15.40:0/4104185295 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fde7815e5d0 0x7fde600047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:29.590 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:29.586+0000 7fde6f7fe640 1 --2- 172.21.15.40:0/4104185295 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fde60004d00 0x7fde60005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:29.590 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:29.586+0000 7fde6f7fe640 1 -- 172.21.15.40:0/4104185295 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde78072270 con 0x7fde60004d00 2023-12-17T11:49:29.591 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:29.586+0000 7fde6f7fe640 1 -- 172.21.15.40:0/4104185295 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde78070070 con 0x7fde60003970 2023-12-17T11:49:29.591 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:29.586+0000 7fde6f7fe640 1 -- 172.21.15.40:0/4104185295 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde6000b9b0 con 0x7fde7815e5d0 2023-12-17T11:49:29.591 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:29.587+0000 7fde7d1f3640 1 --2- 172.21.15.40:0/4104185295 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fde60004d00 0x7fde60005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:29.591 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:29.587+0000 7fde7c9f2640 1 --2- 172.21.15.40:0/4104185295 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fde60003970 0x7fde60003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:29.591 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:29.587+0000 7fde6ffff640 1 --2- 172.21.15.40:0/4104185295 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fde7815e5d0 0x7fde600047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:29.591 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:29.587+0000 7fde7d1f3640 1 -- 172.21.15.40:0/4104185295 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fde7815e5d0 msgr2=0x7fde600047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:49:29.591 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:29.587+0000 7fde7d1f3640 1 --2- 172.21.15.40:0/4104185295 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fde7815e5d0 0x7fde600047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:29.591 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:29.587+0000 7fde7d1f3640 1 -- 172.21.15.40:0/4104185295 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fde60003970 msgr2=0x7fde60003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:49:29.591 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:29.587+0000 7fde7d1f3640 1 --2- 172.21.15.40:0/4104185295 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fde60003970 0x7fde60003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:29.591 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:29.587+0000 7fde7d1f3640 1 -- 172.21.15.40:0/4104185295 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde60003520 con 0x7fde60004d00 2023-12-17T11:49:29.592 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:29.588+0000 7fde7d1f3640 1 --2- 172.21.15.40:0/4104185295 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fde60004d00 0x7fde60005180 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fde7000c160 tx=0x7fde600057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4413df3758f8f753 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:49:29.592 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:29.589+0000 7fde6f7fe640 1 -- 172.21.15.40:0/4104185295 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde70005ad0 con 0x7fde60004d00 2023-12-17T11:49:29.592 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:29.589+0000 7fde6f7fe640 1 -- 172.21.15.40:0/4104185295 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde70005c30 con 0x7fde60004d00 2023-12-17T11:49:29.592 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:29.589+0000 7fde6f7fe640 1 -- 172.21.15.40:0/4104185295 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde7002c810 con 0x7fde60004d00 2023-12-17T11:49:29.592 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:29.589+0000 7fde7d9f4640 1 -- 172.21.15.40:0/4104185295 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fde60004d00 msgr2=0x7fde60005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:29.592 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:29.589+0000 7fde7d9f4640 1 --2- 172.21.15.40:0/4104185295 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fde60004d00 0x7fde60005180 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fde7000c160 tx=0x7fde600057f0 comp rx=0 tx=0).stop 2023-12-17T11:49:29.593 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:29.589+0000 7fde7d1f3640 1 -- 172.21.15.40:0/4104185295 reap_dead start 2023-12-17T11:49:29.593 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:29.589+0000 7fde7d9f4640 1 -- 172.21.15.40:0/4104185295 shutdown_connections 2023-12-17T11:49:29.593 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:29.589+0000 7fde7d9f4640 1 -- 172.21.15.40:0/4104185295 >> 172.21.15.40:0/4104185295 conn(0x7fde780b0860 msgr2=0x7fde780b0c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:49:29.593 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:29.589+0000 7fde7d9f4640 1 -- 172.21.15.40:0/4104185295 shutdown_connections 2023-12-17T11:49:29.593 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:29.590+0000 7fde7d9f4640 1 -- 172.21.15.40:0/4104185295 wait complete. 2023-12-17T11:49:29.593 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:29.591+0000 7fde7d9f4640 1 Processor -- start 2023-12-17T11:49:29.593 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:29.592+0000 7fde7d9f4640 1 -- start start 2023-12-17T11:49:29.595 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:29.592+0000 7fde7d9f4640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fde60004d00 0x7fde781486e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:29.595 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:29.592+0000 7fde7d9f4640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fde78145dd0 0x7fde78150fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:29.595 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:29.593+0000 7fde7d9f4640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fde781514e0 0x7fde78157280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:29.595 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:29.593+0000 7fde7d9f4640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde7809b180 con 0x7fde60004d00 2023-12-17T11:49:29.595 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:29.593+0000 7fde7d9f4640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde78156720 con 0x7fde781514e0 2023-12-17T11:49:29.595 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:29.593+0000 7fde7d9f4640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde78151950 con 0x7fde78145dd0 2023-12-17T11:49:29.595 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:29.593+0000 7fde7c9f2640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fde60004d00 0x7fde781486e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:29.595 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:29.593+0000 7fde7c9f2640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fde60004d00 0x7fde781486e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:38692/0 (socket says 172.21.15.40:38692) 2023-12-17T11:49:29.595 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:29.593+0000 7fde7c9f2640 1 -- 172.21.15.40:0/4101213876 learned_addr learned my addr 172.21.15.40:0/4101213876 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-17T11:49:29.596 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:29.593+0000 7fde7c9f2640 1 -- 172.21.15.40:0/4101213876 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fde78145dd0 msgr2=0x7fde78150fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:29.596 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:29.593+0000 7fde7c9f2640 1 --2- 172.21.15.40:0/4101213876 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fde78145dd0 0x7fde78150fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:29.596 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:29.593+0000 7fde7c9f2640 1 -- 172.21.15.40:0/4101213876 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fde781514e0 msgr2=0x7fde78157280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:29.596 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:29.593+0000 7fde7c9f2640 1 --2- 172.21.15.40:0/4101213876 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fde781514e0 0x7fde78157280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:29.596 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:29.593+0000 7fde7c9f2640 1 -- 172.21.15.40:0/4101213876 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde7809a540 con 0x7fde60004d00 2023-12-17T11:49:29.597 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:29.594+0000 7fde7c9f2640 1 --2- 172.21.15.40:0/4101213876 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fde60004d00 0x7fde781486e0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fde74007f00 tx=0x7fde740115a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:49:29.597 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:29.594+0000 7fde6d7fa640 1 -- 172.21.15.40:0/4101213876 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde7400e030 con 0x7fde60004d00 2023-12-17T11:49:29.597 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:29.594+0000 7fde6d7fa640 1 -- 172.21.15.40:0/4101213876 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde74016470 con 0x7fde60004d00 2023-12-17T11:49:29.597 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:29.594+0000 7fde6d7fa640 1 -- 172.21.15.40:0/4101213876 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde74016800 con 0x7fde60004d00 2023-12-17T11:49:29.597 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:29.594+0000 7fde7d9f4640 1 -- 172.21.15.40:0/4101213876 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde7809a7e0 con 0x7fde60004d00 2023-12-17T11:49:29.597 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:29.594+0000 7fde7d9f4640 1 -- 172.21.15.40:0/4101213876 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde7809ada0 con 0x7fde60004d00 2023-12-17T11:49:29.597 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:29.595+0000 7fde7d9f4640 1 -- 172.21.15.40:0/4101213876 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde78074450 con 0x7fde60004d00 2023-12-17T11:49:29.598 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:29.596+0000 7fde6d7fa640 1 -- 172.21.15.40:0/4101213876 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fde74016960 con 0x7fde60004d00 2023-12-17T11:49:29.599 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:29.597+0000 7fde6d7fa640 1 --2- 172.21.15.40:0/4101213876 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7fde6406ae40 0x7fde6406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:29.599 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:29.597+0000 7fde6d7fa640 1 -- 172.21.15.40:0/4101213876 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6692+0+0 (secure 0 0 0) 0x7fde7400f070 con 0x7fde60004d00 2023-12-17T11:49:29.599 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:29.598+0000 7fde6ffff640 1 --2- 172.21.15.40:0/4101213876 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7fde6406ae40 0x7fde6406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:29.601 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:29.599+0000 7fde6ffff640 1 --2- 172.21.15.40:0/4101213876 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7fde6406ae40 0x7fde6406d300 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fde781461f0 tx=0x7fde68008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:49:29.603 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:29.602+0000 7fde6d7fa640 1 -- 172.21.15.40:0/4101213876 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fde740556e0 con 0x7fde60004d00 2023-12-17T11:49:29.816 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:29.814+0000 7fde7d9f4640 1 -- 172.21.15.40:0/4101213876 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fde780adfe0 con 0x7fde60004d00 2023-12-17T11:49:29.817 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:29.815+0000 7fde6d7fa640 1 -- 172.21.15.40:0/4101213876 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v27) v1 ==== 80+0+0 (secure 0 0 0) 0x7fde74058d00 con 0x7fde60004d00 2023-12-17T11:49:29.817 INFO:teuthology.orchestra.run.smithi040.stderr:listed 0 entries 2023-12-17T11:49:29.820 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:29.818+0000 7fde7d9f4640 1 -- 172.21.15.40:0/4101213876 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7fde6406ae40 msgr2=0x7fde6406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:29.820 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:29.818+0000 7fde7d9f4640 1 --2- 172.21.15.40:0/4101213876 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7fde6406ae40 0x7fde6406d300 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fde781461f0 tx=0x7fde68008040 comp rx=0 tx=0).stop 2023-12-17T11:49:29.820 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:29.818+0000 7fde7d9f4640 1 -- 172.21.15.40:0/4101213876 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fde60004d00 msgr2=0x7fde781486e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:29.820 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:29.818+0000 7fde7d9f4640 1 --2- 172.21.15.40:0/4101213876 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fde60004d00 0x7fde781486e0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fde74007f00 tx=0x7fde740115a0 comp rx=0 tx=0).stop 2023-12-17T11:49:29.820 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:29.818+0000 7fde7d9f4640 1 -- 172.21.15.40:0/4101213876 shutdown_connections 2023-12-17T11:49:29.820 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:29.818+0000 7fde7d9f4640 1 --2- 172.21.15.40:0/4101213876 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7fde6406ae40 0x7fde6406d300 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:29.821 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:29.818+0000 7fde7d9f4640 1 --2- 172.21.15.40:0/4101213876 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fde781514e0 0x7fde78157280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:29.821 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:29.818+0000 7fde7d9f4640 1 --2- 172.21.15.40:0/4101213876 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fde78145dd0 0x7fde78150fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:29.821 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:29.818+0000 7fde7d9f4640 1 --2- 172.21.15.40:0/4101213876 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fde60004d00 0x7fde781486e0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:29.821 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:29.818+0000 7fde7d9f4640 1 -- 172.21.15.40:0/4101213876 >> 172.21.15.40:0/4101213876 conn(0x7fde780b0860 msgr2=0x7fde78070a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:49:29.821 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:29.818+0000 7fde7d9f4640 1 -- 172.21.15.40:0/4101213876 shutdown_connections 2023-12-17T11:49:29.821 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:29.818+0000 7fde7d9f4640 1 -- 172.21.15.40:0/4101213876 wait complete. 2023-12-17T11:49:29.842 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.2... 2023-12-17T11:49:29.842 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-17T11:49:29.842 DEBUG:teuthology.orchestra.run.smithi040:> sudo umount /home/ubuntu/cephtest/mnt.2 -f 2023-12-17T11:49:29.951 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi040.front.sepia.ceph.com 2023-12-17T11:49:29.951 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-17T11:49:29.951 DEBUG:teuthology.orchestra.run.smithi040:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-12-17T11:49:30.008 DEBUG:teuthology.orchestra.run.smithi159:> set -ex 2023-12-17T11:49:30.008 DEBUG:teuthology.orchestra.run.smithi159:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-17T11:49:30.069 DEBUG:teuthology.orchestra.run.smithi159:> set -ex 2023-12-17T11:49:30.069 DEBUG:teuthology.orchestra.run.smithi159:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-17T11:49:30.123 DEBUG:teuthology.orchestra.run.smithi159:> set -ex 2023-12-17T11:49:30.124 DEBUG:teuthology.orchestra.run.smithi159:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-17T11:49:30.177 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-17T11:49:30.413 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:30.411+0000 7fea20390640 1 Processor -- start 2023-12-17T11:49:30.413 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:30.411+0000 7fea20390640 1 -- start start 2023-12-17T11:49:30.415 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:30.413+0000 7fea20390640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fea1806c410 0x7fea18166020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:30.415 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:30.413+0000 7fea20390640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea180b3bb0 con 0x7fea18143e00 2023-12-17T11:49:30.415 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:30.413+0000 7fea20390640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea180b4e60 con 0x7fea18072180 2023-12-17T11:49:30.415 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:30.413+0000 7fea20390640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea181441e0 con 0x7fea1806c410 2023-12-17T11:49:30.415 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:30.413+0000 7fea1e92d640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fea1806c410 0x7fea18166020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:30.415 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:30.413+0000 7fea1e92d640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fea1806c410 0x7fea18166020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:38708/0 (socket says 172.21.15.40:38708) 2023-12-17T11:49:30.415 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:30.413+0000 7fea1e92d640 1 -- 172.21.15.40:0/3607789640 learned_addr learned my addr 172.21.15.40:0/3607789640 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-17T11:49:30.416 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:30.414+0000 7fea1e92d640 1 -- 172.21.15.40:0/3607789640 >> v1:172.21.15.159:6789/0 conn(0x7fea18072180 legacy=0x7fea180b4750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:49:30.416 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:30.414+0000 7fea1e92d640 1 -- 172.21.15.40:0/3607789640 >> v1:172.21.15.40:6789/0 conn(0x7fea18143e00 legacy=0x7fea180b4040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:30.416 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:30.414+0000 7fea1e92d640 1 -- 172.21.15.40:0/3607789640 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea18072680 con 0x7fea1806c410 2023-12-17T11:49:30.416 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:30.415+0000 7fea1e92d640 1 --2- 172.21.15.40:0/3607789640 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fea1806c410 0x7fea18166020 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fea10009e50 tx=0x7fea1002bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2adb49d11a29f8ac server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:49:30.417 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:30.415+0000 7fea1d12a640 1 -- 172.21.15.40:0/3607789640 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea1002ca80 con 0x7fea1806c410 2023-12-17T11:49:30.417 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:30.415+0000 7fea1d12a640 1 -- 172.21.15.40:0/3607789640 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea1002cbe0 con 0x7fea1806c410 2023-12-17T11:49:30.417 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:30.415+0000 7fea1d12a640 1 -- 172.21.15.40:0/3607789640 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea100343f0 con 0x7fea1806c410 2023-12-17T11:49:30.418 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:30.416+0000 7fea20390640 1 -- 172.21.15.40:0/3607789640 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fea1806c410 msgr2=0x7fea18166020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:30.418 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:30.416+0000 7fea20390640 1 --2- 172.21.15.40:0/3607789640 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fea1806c410 0x7fea18166020 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fea10009e50 tx=0x7fea1002bee0 comp rx=0 tx=0).stop 2023-12-17T11:49:30.418 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:30.416+0000 7fea20390640 1 -- 172.21.15.40:0/3607789640 shutdown_connections 2023-12-17T11:49:30.418 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:30.416+0000 7fea20390640 1 --2- 172.21.15.40:0/3607789640 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fea1806c410 0x7fea18166020 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:30.418 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:30.416+0000 7fea20390640 1 -- 172.21.15.40:0/3607789640 >> 172.21.15.40:0/3607789640 conn(0x7fea180b0a90 msgr2=0x7fea180b0e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:49:30.418 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:30.416+0000 7fea20390640 1 -- 172.21.15.40:0/3607789640 shutdown_connections 2023-12-17T11:49:30.418 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:30.416+0000 7fea20390640 1 -- 172.21.15.40:0/3607789640 wait complete. 2023-12-17T11:49:30.419 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:30.418+0000 7fea20390640 1 Processor -- start 2023-12-17T11:49:30.419 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:30.418+0000 7fea20390640 1 -- start start 2023-12-17T11:49:30.422 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:30.419+0000 7fea20390640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fea1806c410 0x7fea18142bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:30.422 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:30.419+0000 7fea20390640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fea18072180 0x7fea181406f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:30.422 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:30.419+0000 7fea20390640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fea18143e00 0x7fea18133340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:30.422 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:30.419+0000 7fea20390640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea181435a0 con 0x7fea1806c410 2023-12-17T11:49:30.422 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:30.419+0000 7fea20390640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea181432c0 con 0x7fea18143e00 2023-12-17T11:49:30.422 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:30.419+0000 7fea20390640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea180cca90 con 0x7fea18072180 2023-12-17T11:49:30.422 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:30.419+0000 7fea1e12c640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fea1806c410 0x7fea18142bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:30.422 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:30.419+0000 7fea1e12c640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fea1806c410 0x7fea18142bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:38718/0 (socket says 172.21.15.40:38718) 2023-12-17T11:49:30.422 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:30.419+0000 7fea1e12c640 1 -- 172.21.15.40:0/2790140385 learned_addr learned my addr 172.21.15.40:0/2790140385 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-17T11:49:30.422 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:30.419+0000 7fea1e12c640 1 -- 172.21.15.40:0/2790140385 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fea18072180 msgr2=0x7fea181406f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:30.422 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:30.419+0000 7fea1e12c640 1 --2- 172.21.15.40:0/2790140385 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fea18072180 0x7fea181406f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:30.422 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:30.419+0000 7fea1e12c640 1 -- 172.21.15.40:0/2790140385 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fea18143e00 msgr2=0x7fea18133340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:30.422 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:30.419+0000 7fea1e92d640 1 --2- 172.21.15.40:0/2790140385 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fea18143e00 0x7fea18133340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:30.423 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:30.420+0000 7fea1e12c640 1 --2- 172.21.15.40:0/2790140385 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fea18143e00 0x7fea18133340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:30.423 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:30.420+0000 7fea1e12c640 1 -- 172.21.15.40:0/2790140385 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea10009b30 con 0x7fea1806c410 2023-12-17T11:49:30.423 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:30.420+0000 7fea1e12c640 1 --2- 172.21.15.40:0/2790140385 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fea1806c410 0x7fea18142bc0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fea1400c450 tx=0x7fea1400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:49:30.423 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:30.420+0000 7fea0effd640 1 -- 172.21.15.40:0/2790140385 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea140052d0 con 0x7fea1806c410 2023-12-17T11:49:30.423 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:30.420+0000 7fea0effd640 1 -- 172.21.15.40:0/2790140385 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea14005430 con 0x7fea1806c410 2023-12-17T11:49:30.424 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:30.420+0000 7fea0effd640 1 -- 172.21.15.40:0/2790140385 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea14012870 con 0x7fea1806c410 2023-12-17T11:49:30.424 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:30.420+0000 7fea20390640 1 -- 172.21.15.40:0/2790140385 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea180ccd70 con 0x7fea1806c410 2023-12-17T11:49:30.424 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:30.420+0000 7fea20390640 1 -- 172.21.15.40:0/2790140385 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea18133880 con 0x7fea1806c410 2023-12-17T11:49:30.425 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:30.422+0000 7fea20390640 1 -- 172.21.15.40:0/2790140385 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea180cc8f0 con 0x7fea1806c410 2023-12-17T11:49:30.425 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:30.422+0000 7fea0effd640 1 -- 172.21.15.40:0/2790140385 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fea140129d0 con 0x7fea1806c410 2023-12-17T11:49:30.426 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:30.425+0000 7fea0effd640 1 --2- 172.21.15.40:0/2790140385 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7fe9fc06ae70 0x7fe9fc06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:30.426 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:30.425+0000 7fea0effd640 1 -- 172.21.15.40:0/2790140385 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6692+0+0 (secure 0 0 0) 0x7fea14089620 con 0x7fea1806c410 2023-12-17T11:49:30.427 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:30.425+0000 7fea1d92b640 1 --2- 172.21.15.40:0/2790140385 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7fe9fc06ae70 0x7fe9fc06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:30.428 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:30.427+0000 7fea1d92b640 1 --2- 172.21.15.40:0/2790140385 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7fe9fc06ae70 0x7fe9fc06d330 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fea1813be00 tx=0x7fea080079b0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:49:30.432 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:30.431+0000 7fea0effd640 1 -- 172.21.15.40:0/2790140385 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fea180cc8f0 con 0x7fea1806c410 2023-12-17T11:49:30.630 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:30.628+0000 7fea20390640 1 -- 172.21.15.40:0/2790140385 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fea180cc8f0 con 0x7fea1806c410 2023-12-17T11:49:30.632 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:30.630+0000 7fea0effd640 1 -- 172.21.15.40:0/2790140385 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+18697 (secure 0 0 0) 0x7fea180cc8f0 con 0x7fea1806c410 2023-12-17T11:49:30.633 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T11:49:30.633 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":27,"fsid":"099cd35d-80d9-4ca4-8424-de13b3b03ac7","created":"2023-12-17T11:47:53.450097+0000","modified":"2023-12-17T11:49:00.483840+0000","last_up_change":"2023-12-17T11:48:05.724195+0000","last_in_change":"2023-12-17T11:47:56.956499+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-17T11:48:06.668943+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-17T11:48:16.151444+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-17T11:48:16.717726+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-17T11:48:20.534819+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a88bfd46-63b8-48b1-9c0e-5c9cdc31bd38","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":555204741},{"type":"v1","addr":"172.21.15.40:6802","nonce":555204741}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":555204741},{"type":"v1","addr":"172.21.15.40:6807","nonce":555204741}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":555204741},{"type":"v1","addr":"172.21.15.40:6815","nonce":555204741}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6809","nonce":555204741},{"type":"v1","addr":"172.21.15.40:6812","nonce":555204741}]},"public_addr":"172.21.15.40:6802/555204741","cluster_addr":"172.21.15.40:6807/555204741","heartbeat_back_addr":"172.21.15.40:6815/555204741","heartbeat_front_addr":"172.21.15.40:6812/555204741","state":["exists","up"]},{"osd":1,"uuid":"c5d628ae-36f4-4866-802c-b162f0e90add","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6801","nonce":1221318112},{"type":"v1","addr":"172.21.15.40:6803","nonce":1221318112}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6805","nonce":1221318112},{"type":"v1","addr":"172.21.15.40:6806","nonce":1221318112}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6811","nonce":1221318112},{"type":"v1","addr":"172.21.15.40:6813","nonce":1221318112}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":1221318112},{"type":"v1","addr":"172.21.15.40:6810","nonce":1221318112}]},"public_addr":"172.21.15.40:6803/1221318112","cluster_addr":"172.21.15.40:6806/1221318112","heartbeat_back_addr":"172.21.15.40:6813/1221318112","heartbeat_front_addr":"172.21.15.40:6810/1221318112","state":["exists","up"]},{"osd":2,"uuid":"d986ad6a-af2f-47fc-9c3b-fbda27b82b73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":1959000265},{"type":"v1","addr":"172.21.15.40:6817","nonce":1959000265}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6818","nonce":1959000265},{"type":"v1","addr":"172.21.15.40:6819","nonce":1959000265}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":1959000265},{"type":"v1","addr":"172.21.15.40:6827","nonce":1959000265}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":1959000265},{"type":"v1","addr":"172.21.15.40:6822","nonce":1959000265}]},"public_addr":"172.21.15.40:6817/1959000265","cluster_addr":"172.21.15.40:6819/1959000265","heartbeat_back_addr":"172.21.15.40:6827/1959000265","heartbeat_front_addr":"172.21.15.40:6822/1959000265","state":["exists","up"]},{"osd":3,"uuid":"d79d22b7-be05-41b2-b95d-697db677fd02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6821","nonce":974040287},{"type":"v1","addr":"172.21.15.40:6823","nonce":974040287}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6825","nonce":974040287},{"type":"v1","addr":"172.21.15.40:6826","nonce":974040287}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":974040287},{"type":"v1","addr":"172.21.15.40:6831","nonce":974040287}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":974040287},{"type":"v1","addr":"172.21.15.40:6829","nonce":974040287}]},"public_addr":"172.21.15.40:6823/974040287","cluster_addr":"172.21.15.40:6826/974040287","heartbeat_back_addr":"172.21.15.40:6831/974040287","heartbeat_front_addr":"172.21.15.40:6829/974040287","state":["exists","up"]},{"osd":4,"uuid":"62a7a233-d3ea-40be-91de-180c0208d639","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6808","nonce":3937787733},{"type":"v1","addr":"172.21.15.159:6809","nonce":3937787733}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6810","nonce":3937787733},{"type":"v1","addr":"172.21.15.159:6811","nonce":3937787733}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6814","nonce":3937787733},{"type":"v1","addr":"172.21.15.159:6815","nonce":3937787733}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6812","nonce":3937787733},{"type":"v1","addr":"172.21.15.159:6813","nonce":3937787733}]},"public_addr":"172.21.15.159:6809/3937787733","cluster_addr":"172.21.15.159:6811/3937787733","heartbeat_back_addr":"172.21.15.159:6815/3937787733","heartbeat_front_addr":"172.21.15.159:6813/3937787733","state":["exists","up"]},{"osd":5,"uuid":"84629cea-dc0e-4b5e-b203-5ea963839281","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6816","nonce":3032505240},{"type":"v1","addr":"172.21.15.159:6817","nonce":3032505240}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6818","nonce":3032505240},{"type":"v1","addr":"172.21.15.159:6819","nonce":3032505240}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6822","nonce":3032505240},{"type":"v1","addr":"172.21.15.159:6823","nonce":3032505240}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6820","nonce":3032505240},{"type":"v1","addr":"172.21.15.159:6821","nonce":3032505240}]},"public_addr":"172.21.15.159:6817/3032505240","cluster_addr":"172.21.15.159:6819/3032505240","heartbeat_back_addr":"172.21.15.159:6823/3032505240","heartbeat_front_addr":"172.21.15.159:6821/3032505240","state":["exists","up"]},{"osd":6,"uuid":"4ae3af3a-1743-4070-a91d-8be5c31cdb04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6800","nonce":2411788597},{"type":"v1","addr":"172.21.15.159:6801","nonce":2411788597}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6802","nonce":2411788597},{"type":"v1","addr":"172.21.15.159:6803","nonce":2411788597}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6806","nonce":2411788597},{"type":"v1","addr":"172.21.15.159:6807","nonce":2411788597}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6804","nonce":2411788597},{"type":"v1","addr":"172.21.15.159:6805","nonce":2411788597}]},"public_addr":"172.21.15.159:6801/2411788597","cluster_addr":"172.21.15.159:6803/2411788597","heartbeat_back_addr":"172.21.15.159:6807/2411788597","heartbeat_front_addr":"172.21.15.159:6805/2411788597","state":["exists","up"]},{"osd":7,"uuid":"c1f4c7f2-8f75-4f95-bc63-a332773e3b8e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6824","nonce":478953349},{"type":"v1","addr":"172.21.15.159:6825","nonce":478953349}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6826","nonce":478953349},{"type":"v1","addr":"172.21.15.159:6827","nonce":478953349}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6830","nonce":478953349},{"type":"v1","addr":"172.21.15.159:6831","nonce":478953349}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6828","nonce":478953349},{"type":"v1","addr":"172.21.15.159:6829","nonce":478953349}]},"public_addr":"172.21.15.159:6825/478953349","cluster_addr":"172.21.15.159:6827/478953349","heartbeat_back_addr":"172.21.15.159:6831/478953349","heartbeat_front_addr":"172.21.15.159:6829/478953349","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T11:48:02.023567+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T11:48:02.278216+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T11:48:02.311843+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T11:48:01.773372+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T11:48:02.618910+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T11:48:02.361559+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T11:48:02.223997+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T11:48:02.604403+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.2","mappings":[{"from":3,"to":2}]},{"pgid":"3.d","mappings":[{"from":5,"to":1}]},{"pgid":"3.13","mappings":[{"from":7,"to":2}]},{"pgid":"3.17","mappings":[{"from":0,"to":2}]},{"pgid":"3.38","mappings":[{"from":5,"to":1}]},{"pgid":"4.2","mappings":[{"from":1,"to":2}]},{"pgid":"4.10","mappings":[{"from":1,"to":2}]},{"pgid":"4.18","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-17T11:49:30.635 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:30.633+0000 7fea20390640 1 -- 172.21.15.40:0/2790140385 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7fe9fc06ae70 msgr2=0x7fe9fc06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:30.635 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:30.633+0000 7fea20390640 1 --2- 172.21.15.40:0/2790140385 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7fe9fc06ae70 0x7fe9fc06d330 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fea1813be00 tx=0x7fea080079b0 comp rx=0 tx=0).stop 2023-12-17T11:49:30.635 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:30.633+0000 7fea20390640 1 -- 172.21.15.40:0/2790140385 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fea1806c410 msgr2=0x7fea18142bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:30.635 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:30.633+0000 7fea20390640 1 --2- 172.21.15.40:0/2790140385 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fea1806c410 0x7fea18142bc0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fea1400c450 tx=0x7fea1400c910 comp rx=0 tx=0).stop 2023-12-17T11:49:30.636 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:30.633+0000 7fea20390640 1 -- 172.21.15.40:0/2790140385 shutdown_connections 2023-12-17T11:49:30.636 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:30.633+0000 7fea20390640 1 --2- 172.21.15.40:0/2790140385 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7fe9fc06ae70 0x7fe9fc06d330 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:30.636 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:30.633+0000 7fea20390640 1 --2- 172.21.15.40:0/2790140385 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fea18143e00 0x7fea18133340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:30.636 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:30.633+0000 7fea20390640 1 --2- 172.21.15.40:0/2790140385 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fea18072180 0x7fea181406f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:30.636 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:30.633+0000 7fea20390640 1 --2- 172.21.15.40:0/2790140385 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fea1806c410 0x7fea18142bc0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:30.636 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:30.633+0000 7fea20390640 1 -- 172.21.15.40:0/2790140385 >> 172.21.15.40:0/2790140385 conn(0x7fea180b0a90 msgr2=0x7fea180b4040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:49:30.636 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:30.633+0000 7fea20390640 1 -- 172.21.15.40:0/2790140385 shutdown_connections 2023-12-17T11:49:30.636 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:30.633+0000 7fea20390640 1 -- 172.21.15.40:0/2790140385 wait complete. 2023-12-17T11:49:30.656 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-17T11:48:06.668943+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-17T11:48:16.151444+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-17T11:48:16.717726+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-12-17T11:48:20.534819+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-12-17T11:49:30.657 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-17T11:49:30.888 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:30.886+0000 7fcea1588640 1 Processor -- start 2023-12-17T11:49:30.888 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:30.886+0000 7fcea1588640 1 -- start start 2023-12-17T11:49:30.890 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:30.887+0000 7fcea1588640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fce9c0d1400 0x7fce9c0cc4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:30.890 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:30.887+0000 7fcea1588640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce9c0cf320 con 0x7fce9c15ac00 2023-12-17T11:49:30.890 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:30.888+0000 7fcea1588640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce9c0cdfb0 con 0x7fce9c15e410 2023-12-17T11:49:30.890 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:30.888+0000 7fcea1588640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce9c0cddc0 con 0x7fce9c0d1400 2023-12-17T11:49:30.890 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:30.888+0000 7fcea0d87640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fce9c0d1400 0x7fce9c0cc4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:30.890 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:30.888+0000 7fcea0d87640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fce9c0d1400 0x7fce9c0cc4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:38722/0 (socket says 172.21.15.40:38722) 2023-12-17T11:49:30.890 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:30.888+0000 7fcea0d87640 1 -- 172.21.15.40:0/3345039299 learned_addr learned my addr 172.21.15.40:0/3345039299 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-17T11:49:30.890 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:30.888+0000 7fce9bfff640 1 --1- 172.21.15.40:0/3345039299 >> v1:172.21.15.40:6789/0 conn(0x7fce9c15ac00 0x7fce9c0cd6b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:57102/0 (socket says 172.21.15.40:57102) 2023-12-17T11:49:30.891 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:30.888+0000 7fcea0d87640 1 -- 172.21.15.40:0/3345039299 >> v1:172.21.15.159:6789/0 conn(0x7fce9c15e410 legacy=0x7fce9c0d0cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:49:30.891 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:30.888+0000 7fcea0d87640 1 -- 172.21.15.40:0/3345039299 >> v1:172.21.15.40:6789/0 conn(0x7fce9c15ac00 legacy=0x7fce9c0cd6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:30.891 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:30.888+0000 7fcea0d87640 1 -- 172.21.15.40:0/3345039299 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce9c0ce290 con 0x7fce9c0d1400 2023-12-17T11:49:30.891 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:30.889+0000 7fcea0d87640 1 --2- 172.21.15.40:0/3345039299 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fce9c0d1400 0x7fce9c0cc4c0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fce94009870 tx=0x7fce9402b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba7f9c5c35e954bb server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:49:30.892 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:30.890+0000 7fce9affd640 1 -- 172.21.15.40:0/3345039299 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce94030860 con 0x7fce9c0d1400 2023-12-17T11:49:30.892 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:30.890+0000 7fce9affd640 1 -- 172.21.15.40:0/3345039299 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce940309c0 con 0x7fce9c0d1400 2023-12-17T11:49:30.892 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:30.890+0000 7fce9affd640 1 -- 172.21.15.40:0/3345039299 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce94030d50 con 0x7fce9c0d1400 2023-12-17T11:49:30.893 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:30.890+0000 7fcea1588640 1 -- 172.21.15.40:0/3345039299 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fce9c0d1400 msgr2=0x7fce9c0cc4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:30.893 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:30.890+0000 7fcea1588640 1 --2- 172.21.15.40:0/3345039299 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fce9c0d1400 0x7fce9c0cc4c0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fce94009870 tx=0x7fce9402b9a0 comp rx=0 tx=0).stop 2023-12-17T11:49:30.893 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:30.891+0000 7fcea1588640 1 -- 172.21.15.40:0/3345039299 shutdown_connections 2023-12-17T11:49:30.893 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:30.891+0000 7fcea1588640 1 --2- 172.21.15.40:0/3345039299 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fce9c0d1400 0x7fce9c0cc4c0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:30.893 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:30.891+0000 7fcea1588640 1 -- 172.21.15.40:0/3345039299 >> 172.21.15.40:0/3345039299 conn(0x7fce9c0999f0 msgr2=0x7fce9c099e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:49:30.893 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:30.891+0000 7fcea1588640 1 -- 172.21.15.40:0/3345039299 shutdown_connections 2023-12-17T11:49:30.893 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:30.891+0000 7fcea1588640 1 -- 172.21.15.40:0/3345039299 wait complete. 2023-12-17T11:49:30.894 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:30.893+0000 7fcea1588640 1 Processor -- start 2023-12-17T11:49:30.894 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:30.893+0000 7fcea1588640 1 -- start start 2023-12-17T11:49:30.896 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:30.894+0000 7fcea1588640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fce9c0d1400 0x7fce9c1f3d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:30.896 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:30.894+0000 7fcea1588640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fce9c15ac00 0x7fce9c0c7010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:30.896 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:30.894+0000 7fcea1588640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fce9c15e410 0x7fce9c0c48b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:30.896 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:30.894+0000 7fcea1588640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce9c1f3bf0 con 0x7fce9c15ac00 2023-12-17T11:49:30.896 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:30.894+0000 7fcea1588640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce9c157140 con 0x7fce9c15e410 2023-12-17T11:49:30.896 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:30.894+0000 7fcea1588640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce9c1f3910 con 0x7fce9c0d1400 2023-12-17T11:49:30.896 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:30.894+0000 7fce9b7fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fce9c15ac00 0x7fce9c0c7010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:30.896 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:30.894+0000 7fce9b7fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fce9c15ac00 0x7fce9c0c7010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:38730/0 (socket says 172.21.15.40:38730) 2023-12-17T11:49:30.896 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:30.894+0000 7fce9b7fe640 1 -- 172.21.15.40:0/19600349 learned_addr learned my addr 172.21.15.40:0/19600349 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-17T11:49:30.898 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:30.894+0000 7fce9bfff640 1 --2- 172.21.15.40:0/19600349 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fce9c0d1400 0x7fce9c1f3d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:30.898 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:30.894+0000 7fce9b7fe640 1 -- 172.21.15.40:0/19600349 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fce9c0d1400 msgr2=0x7fce9c1f3d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:30.898 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:30.894+0000 7fce9b7fe640 1 --2- 172.21.15.40:0/19600349 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fce9c0d1400 0x7fce9c1f3d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:30.898 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:30.894+0000 7fce9b7fe640 1 -- 172.21.15.40:0/19600349 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fce9c15e410 msgr2=0x7fce9c0c48b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:30.898 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:30.894+0000 7fce9b7fe640 1 --2- 172.21.15.40:0/19600349 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fce9c15e410 0x7fce9c0c48b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:30.898 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:30.894+0000 7fce9b7fe640 1 -- 172.21.15.40:0/19600349 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce940094d0 con 0x7fce9c15ac00 2023-12-17T11:49:30.898 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:30.895+0000 7fce9b7fe640 1 --2- 172.21.15.40:0/19600349 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fce9c15ac00 0x7fce9c0c7010 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fce8c00c7f0 tx=0x7fce8c00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:49:30.898 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:30.895+0000 7fce98ff9640 1 -- 172.21.15.40:0/19600349 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce8c003d80 con 0x7fce9c15ac00 2023-12-17T11:49:30.898 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:30.895+0000 7fce98ff9640 1 -- 172.21.15.40:0/19600349 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce8c005070 con 0x7fce9c15ac00 2023-12-17T11:49:30.898 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:30.895+0000 7fce98ff9640 1 -- 172.21.15.40:0/19600349 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce8c005460 con 0x7fce9c15ac00 2023-12-17T11:49:30.898 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:30.895+0000 7fcea1588640 1 -- 172.21.15.40:0/19600349 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce9c156af0 con 0x7fce9c15ac00 2023-12-17T11:49:30.898 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:30.895+0000 7fcea1588640 1 -- 172.21.15.40:0/19600349 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce9c0c7550 con 0x7fce9c15ac00 2023-12-17T11:49:30.899 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:30.896+0000 7fcea1588640 1 -- 172.21.15.40:0/19600349 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce9c1572f0 con 0x7fce9c15ac00 2023-12-17T11:49:30.899 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:30.898+0000 7fce98ff9640 1 -- 172.21.15.40:0/19600349 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fce8c0055c0 con 0x7fce9c15ac00 2023-12-17T11:49:30.901 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:30.899+0000 7fce98ff9640 1 --2- 172.21.15.40:0/19600349 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7fce7c06ae70 0x7fce7c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:30.901 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:30.899+0000 7fce98ff9640 1 -- 172.21.15.40:0/19600349 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6692+0+0 (secure 0 0 0) 0x7fce8c088fe0 con 0x7fce9c15ac00 2023-12-17T11:49:30.901 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:30.900+0000 7fce9bfff640 1 --2- 172.21.15.40:0/19600349 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7fce7c06ae70 0x7fce7c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:30.902 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:30.901+0000 7fce9bfff640 1 --2- 172.21.15.40:0/19600349 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7fce7c06ae70 0x7fce7c06d330 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fce84000f60 tx=0x7fce84009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:49:30.905 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:30.904+0000 7fce98ff9640 1 -- 172.21.15.40:0/19600349 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fce9c1572f0 con 0x7fce9c15ac00 2023-12-17T11:49:31.100 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:31.098+0000 7fcea1588640 1 -- 172.21.15.40:0/19600349 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fce9c1572b0 con 0x7fce9c15ac00 2023-12-17T11:49:31.101 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:31.099+0000 7fce98ff9640 1 -- 172.21.15.40:0/19600349 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) v1 ==== 93+0+10 (secure 0 0 0) 0x7fce8c017020 con 0x7fce9c15ac00 2023-12-17T11:49:31.101 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 1 2023-12-17T11:49:31.104 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:31.102+0000 7fcea1588640 1 -- 172.21.15.40:0/19600349 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7fce7c06ae70 msgr2=0x7fce7c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:31.104 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:31.102+0000 7fcea1588640 1 --2- 172.21.15.40:0/19600349 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7fce7c06ae70 0x7fce7c06d330 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fce84000f60 tx=0x7fce84009040 comp rx=0 tx=0).stop 2023-12-17T11:49:31.104 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:31.102+0000 7fcea1588640 1 -- 172.21.15.40:0/19600349 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fce9c15ac00 msgr2=0x7fce9c0c7010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:31.104 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:31.102+0000 7fcea1588640 1 --2- 172.21.15.40:0/19600349 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fce9c15ac00 0x7fce9c0c7010 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fce8c00c7f0 tx=0x7fce8c00ccb0 comp rx=0 tx=0).stop 2023-12-17T11:49:31.104 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:31.102+0000 7fcea1588640 1 -- 172.21.15.40:0/19600349 shutdown_connections 2023-12-17T11:49:31.104 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:31.102+0000 7fcea1588640 1 --2- 172.21.15.40:0/19600349 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7fce7c06ae70 0x7fce7c06d330 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:31.104 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:31.102+0000 7fcea1588640 1 --2- 172.21.15.40:0/19600349 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fce9c15e410 0x7fce9c0c48b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:31.105 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:31.102+0000 7fcea1588640 1 --2- 172.21.15.40:0/19600349 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fce9c15ac00 0x7fce9c0c7010 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:31.105 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:31.102+0000 7fcea1588640 1 --2- 172.21.15.40:0/19600349 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fce9c0d1400 0x7fce9c1f3d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:31.105 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:31.102+0000 7fcea1588640 1 -- 172.21.15.40:0/19600349 >> 172.21.15.40:0/19600349 conn(0x7fce9c0999f0 msgr2=0x7fce9c06b570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:49:31.105 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:31.102+0000 7fcea1588640 1 -- 172.21.15.40:0/19600349 shutdown_connections 2023-12-17T11:49:31.105 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:31.102+0000 7fcea1588640 1 -- 172.21.15.40:0/19600349 wait complete. 2023-12-17T11:49:31.122 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-17T11:49:31.352 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:31.350+0000 7fe167fff640 1 Processor -- start 2023-12-17T11:49:31.352 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:31.350+0000 7fe167fff640 1 -- start start 2023-12-17T11:49:31.354 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:31.352+0000 7fe167fff640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fe16806c130 0x7fe16815f510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:31.354 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:31.352+0000 7fe167fff640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe16806c770 con 0x7fe1680cb5b0 2023-12-17T11:49:31.354 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:31.352+0000 7fe167fff640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe16806ca50 con 0x7fe168070c60 2023-12-17T11:49:31.354 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:31.352+0000 7fe167fff640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe16806cd30 con 0x7fe16806c130 2023-12-17T11:49:31.355 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:31.353+0000 7fe15e7fc640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fe16806c130 0x7fe16815f510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:31.355 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:31.353+0000 7fe166ffd640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fe1680cb5b0 0x7fe1680cb990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:57106/0 (socket says 172.21.15.40:57106) 2023-12-17T11:49:31.355 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:31.353+0000 7fe166ffd640 1 -- 172.21.15.40:0/3833078750 learned_addr learned my addr 172.21.15.40:0/3833078750 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-12-17T11:49:31.355 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:31.353+0000 7fe15e7fc640 1 -- 172.21.15.40:0/3833078750 >> v1:172.21.15.159:6789/0 conn(0x7fe168070c60 legacy=0x7fe168071110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:49:31.355 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:31.353+0000 7fe15e7fc640 1 -- 172.21.15.40:0/3833078750 >> v1:172.21.15.40:6789/0 conn(0x7fe1680cb5b0 legacy=0x7fe1680cb990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:31.356 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:31.353+0000 7fe1667fc640 1 -- 172.21.15.40:0/3833078750 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2744765232 0 0) 0x7fe16806c770 con 0x7fe1680cb5b0 2023-12-17T11:49:31.356 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:31.353+0000 7fe15e7fc640 1 -- 172.21.15.40:0/3833078750 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe16806d010 con 0x7fe16806c130 2023-12-17T11:49:31.356 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:31.355+0000 7fe15e7fc640 1 --2- 172.21.15.40:0/3833078750 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe16806c130 0x7fe16815f510 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fe150009dc0 tx=0x7fe15002be90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a983f38905c63bac server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:49:31.357 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:31.355+0000 7fe1667fc640 1 -- 172.21.15.40:0/3833078750 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe15002cc40 con 0x7fe16806c130 2023-12-17T11:49:31.357 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:31.355+0000 7fe1667fc640 1 -- 172.21.15.40:0/3833078750 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe15002cda0 con 0x7fe16806c130 2023-12-17T11:49:31.357 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:31.355+0000 7fe1667fc640 1 -- 172.21.15.40:0/3833078750 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe150034660 con 0x7fe16806c130 2023-12-17T11:49:31.358 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:31.356+0000 7fe167fff640 1 -- 172.21.15.40:0/3833078750 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe16806c130 msgr2=0x7fe16815f510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:31.358 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:31.356+0000 7fe167fff640 1 --2- 172.21.15.40:0/3833078750 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe16806c130 0x7fe16815f510 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fe150009dc0 tx=0x7fe15002be90 comp rx=0 tx=0).stop 2023-12-17T11:49:31.358 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:31.356+0000 7fe167fff640 1 -- 172.21.15.40:0/3833078750 shutdown_connections 2023-12-17T11:49:31.358 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:31.356+0000 7fe167fff640 1 --2- 172.21.15.40:0/3833078750 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe16806c130 0x7fe16815f510 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:31.358 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:31.356+0000 7fe167fff640 1 -- 172.21.15.40:0/3833078750 >> 172.21.15.40:0/3833078750 conn(0x7fe1680b0940 msgr2=0x7fe1680b0d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:49:31.358 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:31.356+0000 7fe167fff640 1 -- 172.21.15.40:0/3833078750 shutdown_connections 2023-12-17T11:49:31.358 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:31.356+0000 7fe167fff640 1 -- 172.21.15.40:0/3833078750 wait complete. 2023-12-17T11:49:31.359 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:31.358+0000 7fe167fff640 1 Processor -- start 2023-12-17T11:49:31.359 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:31.358+0000 7fe167fff640 1 -- start start 2023-12-17T11:49:31.361 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:31.359+0000 7fe167fff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe16806c130 0x7fe1680999f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:31.361 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:31.359+0000 7fe167fff640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe168070c60 0x7fe16809a530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:31.361 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:31.359+0000 7fe167fff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe1680cb5b0 0x7fe16809aa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:31.361 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:31.359+0000 7fe167fff640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1680b2f10 con 0x7fe1680cb5b0 2023-12-17T11:49:31.361 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:31.359+0000 7fe167fff640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1680b31f0 con 0x7fe16806c130 2023-12-17T11:49:31.361 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:31.359+0000 7fe167fff640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1680b34d0 con 0x7fe168070c60 2023-12-17T11:49:31.361 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:31.359+0000 7fe1677fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe1680cb5b0 0x7fe16809aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:31.361 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:31.359+0000 7fe1677fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe1680cb5b0 0x7fe16809aa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:38736/0 (socket says 172.21.15.40:38736) 2023-12-17T11:49:31.361 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:31.359+0000 7fe1677fe640 1 -- 172.21.15.40:0/1820728210 learned_addr learned my addr 172.21.15.40:0/1820728210 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-17T11:49:31.363 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:31.359+0000 7fe166ffd640 1 --2- 172.21.15.40:0/1820728210 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe16806c130 0x7fe1680999f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:31.363 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:31.359+0000 7fe15e7fc640 1 --2- 172.21.15.40:0/1820728210 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe168070c60 0x7fe16809a530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:31.363 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:31.360+0000 7fe1677fe640 1 -- 172.21.15.40:0/1820728210 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe168070c60 msgr2=0x7fe16809a530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:31.363 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:31.360+0000 7fe1677fe640 1 --2- 172.21.15.40:0/1820728210 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe168070c60 0x7fe16809a530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:31.363 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:31.360+0000 7fe1677fe640 1 -- 172.21.15.40:0/1820728210 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe16806c130 msgr2=0x7fe1680999f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:31.363 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:31.360+0000 7fe1677fe640 1 --2- 172.21.15.40:0/1820728210 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe16806c130 0x7fe1680999f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:31.363 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:31.360+0000 7fe1677fe640 1 -- 172.21.15.40:0/1820728210 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe150009a70 con 0x7fe1680cb5b0 2023-12-17T11:49:31.363 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:31.360+0000 7fe15e7fc640 1 --2- 172.21.15.40:0/1820728210 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe168070c60 0x7fe16809a530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-17T11:49:31.363 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:31.360+0000 7fe1677fe640 1 --2- 172.21.15.40:0/1820728210 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe1680cb5b0 0x7fe16809aa70 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fe16000c410 tx=0x7fe16000c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:49:31.363 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:31.360+0000 7fe164ff9640 1 -- 172.21.15.40:0/1820728210 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe160011790 con 0x7fe1680cb5b0 2023-12-17T11:49:31.363 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:31.360+0000 7fe164ff9640 1 -- 172.21.15.40:0/1820728210 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1600118f0 con 0x7fe1680cb5b0 2023-12-17T11:49:31.363 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:31.360+0000 7fe164ff9640 1 -- 172.21.15.40:0/1820728210 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe160011ce0 con 0x7fe1680cb5b0 2023-12-17T11:49:31.364 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:31.360+0000 7fe167fff640 1 -- 172.21.15.40:0/1820728210 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1680b37b0 con 0x7fe1680cb5b0 2023-12-17T11:49:31.364 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:31.360+0000 7fe167fff640 1 -- 172.21.15.40:0/1820728210 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe16809c9e0 con 0x7fe1680cb5b0 2023-12-17T11:49:31.364 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:31.362+0000 7fe167fff640 1 -- 172.21.15.40:0/1820728210 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe168067910 con 0x7fe1680cb5b0 2023-12-17T11:49:31.364 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:31.363+0000 7fe164ff9640 1 -- 172.21.15.40:0/1820728210 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fe16001c460 con 0x7fe1680cb5b0 2023-12-17T11:49:31.366 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:31.364+0000 7fe164ff9640 1 --2- 172.21.15.40:0/1820728210 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7fe14806ae40 0x7fe14806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:31.366 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:31.364+0000 7fe164ff9640 1 -- 172.21.15.40:0/1820728210 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6692+0+0 (secure 0 0 0) 0x7fe160089600 con 0x7fe1680cb5b0 2023-12-17T11:49:31.366 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:31.365+0000 7fe166ffd640 1 --2- 172.21.15.40:0/1820728210 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7fe14806ae40 0x7fe14806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:31.368 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:31.366+0000 7fe166ffd640 1 --2- 172.21.15.40:0/1820728210 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7fe14806ae40 0x7fe14806d300 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fe158000f60 tx=0x7fe158007c00 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:49:31.370 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:31.368+0000 7fe164ff9640 1 -- 172.21.15.40:0/1820728210 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fe160054360 con 0x7fe1680cb5b0 2023-12-17T11:49:31.565 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:31.562+0000 7fe167fff640 1 -- 172.21.15.40:0/1820728210 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fe1680b3cd0 con 0x7fe1680cb5b0 2023-12-17T11:49:31.565 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:31.563+0000 7fe164ff9640 1 -- 172.21.15.40:0/1820728210 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) v1 ==== 104+0+11 (secure 0 0 0) 0x7fe1680b3cd0 con 0x7fe1680cb5b0 2023-12-17T11:49:31.565 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 32 2023-12-17T11:49:31.569 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:31.566+0000 7fe167fff640 1 -- 172.21.15.40:0/1820728210 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7fe14806ae40 msgr2=0x7fe14806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:31.569 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:31.566+0000 7fe167fff640 1 --2- 172.21.15.40:0/1820728210 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7fe14806ae40 0x7fe14806d300 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fe158000f60 tx=0x7fe158007c00 comp rx=0 tx=0).stop 2023-12-17T11:49:31.569 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:31.566+0000 7fe167fff640 1 -- 172.21.15.40:0/1820728210 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe1680cb5b0 msgr2=0x7fe16809aa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:31.569 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:31.566+0000 7fe167fff640 1 --2- 172.21.15.40:0/1820728210 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe1680cb5b0 0x7fe16809aa70 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fe16000c410 tx=0x7fe16000c8d0 comp rx=0 tx=0).stop 2023-12-17T11:49:31.569 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:31.566+0000 7fe167fff640 1 -- 172.21.15.40:0/1820728210 shutdown_connections 2023-12-17T11:49:31.569 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:31.566+0000 7fe167fff640 1 --2- 172.21.15.40:0/1820728210 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7fe14806ae40 0x7fe14806d300 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:31.569 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:31.566+0000 7fe167fff640 1 --2- 172.21.15.40:0/1820728210 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe1680cb5b0 0x7fe16809aa70 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:31.569 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:31.566+0000 7fe167fff640 1 --2- 172.21.15.40:0/1820728210 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe168070c60 0x7fe16809a530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:31.569 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:31.566+0000 7fe167fff640 1 --2- 172.21.15.40:0/1820728210 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe16806c130 0x7fe1680999f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:31.570 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:31.566+0000 7fe167fff640 1 -- 172.21.15.40:0/1820728210 >> 172.21.15.40:0/1820728210 conn(0x7fe1680b0940 msgr2=0x7fe1680af8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:49:31.570 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:31.567+0000 7fe167fff640 1 -- 172.21.15.40:0/1820728210 shutdown_connections 2023-12-17T11:49:31.570 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:31.567+0000 7fe167fff640 1 -- 172.21.15.40:0/1820728210 wait complete. 2023-12-17T11:49:31.589 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-17T11:49:31.822 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:31.819+0000 7f029e490640 1 Processor -- start 2023-12-17T11:49:31.822 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:31.820+0000 7f029e490640 1 -- start start 2023-12-17T11:49:31.823 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:31.821+0000 7f029e490640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f029815b130 0x7f0298141c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:31.823 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:31.821+0000 7f029e490640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f029806b780 0x7f029815ec00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:31.824 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:31.821+0000 7f029e490640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02980cf3c0 con 0x7f02980ce9e0 2023-12-17T11:49:31.824 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:31.821+0000 7f029e490640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f029815b510 con 0x7f029815b130 2023-12-17T11:49:31.824 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:31.821+0000 7f029e490640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02980cee70 con 0x7f029806b780 2023-12-17T11:49:31.825 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:31.822+0000 7f0297fff640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f029815b130 0x7f0298141c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:31.825 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:31.822+0000 7f02977fe640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f02980ce9e0 0x7f029806b070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:57114/0 (socket says 172.21.15.40:57114) 2023-12-17T11:49:31.825 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:31.822+0000 7f02977fe640 1 -- 172.21.15.40:0/165614775 learned_addr learned my addr 172.21.15.40:0/165614775 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-12-17T11:49:31.825 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:31.822+0000 7f0297fff640 1 --2- 172.21.15.40:0/165614775 >> v2:172.21.15.40:3300/0 conn(0x7f029815b130 0x7f0298141c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:38752/0 (socket says 172.21.15.40:38752) 2023-12-17T11:49:31.825 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:31.822+0000 7f029ca2d640 1 --2- 172.21.15.40:0/165614775 >> v2:172.21.15.159:3300/0 conn(0x7f029806b780 0x7f029815ec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:31.825 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:31.822+0000 7f0297fff640 1 -- 172.21.15.40:0/165614775 >> v2:172.21.15.159:3300/0 conn(0x7f029806b780 msgr2=0x7f029815ec00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:49:31.825 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:31.822+0000 7f0297fff640 1 --2- 172.21.15.40:0/165614775 >> v2:172.21.15.159:3300/0 conn(0x7f029806b780 0x7f029815ec00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:31.825 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:31.823+0000 7f0297fff640 1 -- 172.21.15.40:0/165614775 >> v1:172.21.15.40:6789/0 conn(0x7f02980ce9e0 legacy=0x7f029806b070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:31.826 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:31.823+0000 7f0297fff640 1 -- 172.21.15.40:0/165614775 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02980cf0e0 con 0x7f029815b130 2023-12-17T11:49:31.826 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:31.822+0000 7f0296ffd640 1 -- 172.21.15.40:0/165614775 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2056380961 0 0) 0x7f02980cf3c0 con 0x7f02980ce9e0 2023-12-17T11:49:31.827 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:31.824+0000 7f0297fff640 1 --2- 172.21.15.40:0/165614775 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f029815b130 0x7f0298141c10 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f02980cdc80 tx=0x7f028802b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df0ee72b9a9dcc03 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:49:31.827 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:31.824+0000 7f0296ffd640 1 -- 172.21.15.40:0/165614775 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f028802e070 con 0x7f029815b130 2023-12-17T11:49:31.827 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:31.824+0000 7f0296ffd640 1 -- 172.21.15.40:0/165614775 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02880315a0 con 0x7f029815b130 2023-12-17T11:49:31.827 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:31.824+0000 7f0296ffd640 1 -- 172.21.15.40:0/165614775 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0288031930 con 0x7f029815b130 2023-12-17T11:49:31.827 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:31.825+0000 7f029e490640 1 -- 172.21.15.40:0/165614775 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f029815b130 msgr2=0x7f0298141c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:31.827 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:31.825+0000 7f029e490640 1 --2- 172.21.15.40:0/165614775 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f029815b130 0x7f0298141c10 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f02980cdc80 tx=0x7f028802b840 comp rx=0 tx=0).stop 2023-12-17T11:49:31.827 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:31.825+0000 7f029e490640 1 -- 172.21.15.40:0/165614775 shutdown_connections 2023-12-17T11:49:31.827 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:31.825+0000 7f029e490640 1 --2- 172.21.15.40:0/165614775 >> v2:172.21.15.159:3300/0 conn(0x7f029806b780 0x7f029815ec00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:31.827 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:31.825+0000 7f029e490640 1 --2- 172.21.15.40:0/165614775 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f029815b130 0x7f0298141c10 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:31.828 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:31.825+0000 7f029e490640 1 -- 172.21.15.40:0/165614775 >> 172.21.15.40:0/165614775 conn(0x7f02980cf5c0 msgr2=0x7f02980cf9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:49:31.828 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:31.825+0000 7f029e490640 1 -- 172.21.15.40:0/165614775 shutdown_connections 2023-12-17T11:49:31.828 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:31.825+0000 7f029e490640 1 -- 172.21.15.40:0/165614775 wait complete. 2023-12-17T11:49:31.829 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:31.827+0000 7f029e490640 1 Processor -- start 2023-12-17T11:49:31.830 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:31.828+0000 7f029e490640 1 -- start start 2023-12-17T11:49:31.832 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:31.829+0000 7f029e490640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f029806b780 0x7f029806e030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:31.832 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:31.829+0000 7f029e490640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f02980ce9e0 0x7f029806e570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:31.832 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:31.829+0000 7f029e490640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f029815b130 0x7f02981586a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:31.832 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:31.829+0000 7f029e490640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f029815bc40 con 0x7f029815b130 2023-12-17T11:49:31.832 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:31.829+0000 7f029e490640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f029815b650 con 0x7f029806b780 2023-12-17T11:49:31.832 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:31.829+0000 7f029e490640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f029815dce0 con 0x7f02980ce9e0 2023-12-17T11:49:31.832 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:31.830+0000 7f029ca2d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f029815b130 0x7f02981586a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:31.832 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:31.830+0000 7f029ca2d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f029815b130 0x7f02981586a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:38754/0 (socket says 172.21.15.40:38754) 2023-12-17T11:49:31.832 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:31.830+0000 7f029ca2d640 1 -- 172.21.15.40:0/1864187000 learned_addr learned my addr 172.21.15.40:0/1864187000 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-17T11:49:31.832 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:31.830+0000 7f0297fff640 1 --2- 172.21.15.40:0/1864187000 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f029806b780 0x7f029806e030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:31.832 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:31.830+0000 7f02977fe640 1 --2- 172.21.15.40:0/1864187000 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f02980ce9e0 0x7f029806e570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:31.833 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:31.830+0000 7f029ca2d640 1 -- 172.21.15.40:0/1864187000 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f02980ce9e0 msgr2=0x7f029806e570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:31.833 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:31.830+0000 7f029ca2d640 1 --2- 172.21.15.40:0/1864187000 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f02980ce9e0 0x7f029806e570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:31.833 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:31.830+0000 7f029ca2d640 1 -- 172.21.15.40:0/1864187000 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f029806b780 msgr2=0x7f029806e030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:31.833 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:31.830+0000 7f029ca2d640 1 --2- 172.21.15.40:0/1864187000 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f029806b780 0x7f029806e030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:31.833 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:31.830+0000 7f029ca2d640 1 -- 172.21.15.40:0/1864187000 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0288009400 con 0x7f029815b130 2023-12-17T11:49:31.833 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:31.831+0000 7f029ca2d640 1 --2- 172.21.15.40:0/1864187000 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f029815b130 0x7f02981586a0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f0290007e40 tx=0x7f029000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:49:31.836 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:31.833+0000 7f0294ff9640 1 -- 172.21.15.40:0/1864187000 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0290014620 con 0x7f029815b130 2023-12-17T11:49:31.836 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:31.834+0000 7f0294ff9640 1 -- 172.21.15.40:0/1864187000 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f029000ee90 con 0x7f029815b130 2023-12-17T11:49:31.836 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:31.834+0000 7f0294ff9640 1 -- 172.21.15.40:0/1864187000 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02900149e0 con 0x7f029815b130 2023-12-17T11:49:31.836 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:31.834+0000 7f029e490640 1 -- 172.21.15.40:0/1864187000 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f029815dfc0 con 0x7f029815b130 2023-12-17T11:49:31.836 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:31.834+0000 7f029e490640 1 -- 172.21.15.40:0/1864187000 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f029815b860 con 0x7f029815b130 2023-12-17T11:49:31.837 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:31.835+0000 7f029e490640 1 -- 172.21.15.40:0/1864187000 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f029815bd80 con 0x7f029815b130 2023-12-17T11:49:31.838 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:31.836+0000 7f0294ff9640 1 -- 172.21.15.40:0/1864187000 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f0290014b40 con 0x7f029815b130 2023-12-17T11:49:31.839 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:31.837+0000 7f0294ff9640 1 --2- 172.21.15.40:0/1864187000 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f028406ae40 0x7f028406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:31.840 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:31.837+0000 7f0294ff9640 1 -- 172.21.15.40:0/1864187000 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f029008a380 con 0x7f029815b130 2023-12-17T11:49:31.840 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:31.838+0000 7f0297fff640 1 --2- 172.21.15.40:0/1864187000 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f028406ae40 0x7f028406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:31.840 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:31.839+0000 7f0297fff640 1 --2- 172.21.15.40:0/1864187000 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f028406ae40 0x7f028406d300 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f0288036000 tx=0x7f028803d040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:49:31.843 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:31.841+0000 7f0294ff9640 1 -- 172.21.15.40:0/1864187000 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f029815bd80 con 0x7f029815b130 2023-12-17T11:49:32.036 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:32.034+0000 7f029e490640 1 -- 172.21.15.40:0/1864187000 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f029815ba20 con 0x7f029815b130 2023-12-17T11:49:32.037 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:32.035+0000 7f0294ff9640 1 -- 172.21.15.40:0/1864187000 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) v1 ==== 100+0+11 (secure 0 0 0) 0x7f02900550e0 con 0x7f029815b130 2023-12-17T11:49:32.037 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 64 2023-12-17T11:49:32.039 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:32.037+0000 7f029e490640 1 -- 172.21.15.40:0/1864187000 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f028406ae40 msgr2=0x7f028406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:32.039 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:32.037+0000 7f029e490640 1 --2- 172.21.15.40:0/1864187000 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f028406ae40 0x7f028406d300 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f0288036000 tx=0x7f028803d040 comp rx=0 tx=0).stop 2023-12-17T11:49:32.039 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:32.037+0000 7f029e490640 1 -- 172.21.15.40:0/1864187000 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f029815b130 msgr2=0x7f02981586a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:32.040 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:32.037+0000 7f029e490640 1 --2- 172.21.15.40:0/1864187000 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f029815b130 0x7f02981586a0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f0290007e40 tx=0x7f029000e4b0 comp rx=0 tx=0).stop 2023-12-17T11:49:32.040 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:32.037+0000 7f029e490640 1 -- 172.21.15.40:0/1864187000 shutdown_connections 2023-12-17T11:49:32.040 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:32.037+0000 7f029e490640 1 --2- 172.21.15.40:0/1864187000 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f028406ae40 0x7f028406d300 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:32.040 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:32.037+0000 7f029e490640 1 --2- 172.21.15.40:0/1864187000 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f029815b130 0x7f02981586a0 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:32.040 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:32.037+0000 7f029e490640 1 --2- 172.21.15.40:0/1864187000 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f02980ce9e0 0x7f029806e570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:32.040 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:32.037+0000 7f029e490640 1 --2- 172.21.15.40:0/1864187000 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f029806b780 0x7f029806e030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:32.040 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:32.037+0000 7f029e490640 1 -- 172.21.15.40:0/1864187000 >> 172.21.15.40:0/1864187000 conn(0x7f02980cf5c0 msgr2=0x7f0298143730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:49:32.040 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:32.038+0000 7f029e490640 1 -- 172.21.15.40:0/1864187000 shutdown_connections 2023-12-17T11:49:32.041 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:32.038+0000 7f029e490640 1 -- 172.21.15.40:0/1864187000 wait complete. 2023-12-17T11:49:32.060 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-12-17T11:49:32.268 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:32.265+0000 7f9e87071640 1 Processor -- start 2023-12-17T11:49:32.268 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:32.266+0000 7f9e87071640 1 -- start start 2023-12-17T11:49:32.270 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:32.267+0000 7f9e87071640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9e80161920 0x7f9e8015ddf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:32.270 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:32.268+0000 7f9e87071640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e80160bf0 con 0x7f9e8006ab70 2023-12-17T11:49:32.270 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:32.268+0000 7f9e87071640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e8015e450 con 0x7f9e800ad590 2023-12-17T11:49:32.270 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:32.268+0000 7f9e87071640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e80160e40 con 0x7f9e80161920 2023-12-17T11:49:32.270 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:32.268+0000 7f9e8586e640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f9e8006ab70 0x7f9e8015d6e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:57120/0 (socket says 172.21.15.40:57120) 2023-12-17T11:49:32.270 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:32.268+0000 7f9e8586e640 1 -- 172.21.15.40:0/1013321862 learned_addr learned my addr 172.21.15.40:0/1013321862 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-12-17T11:49:32.272 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:32.268+0000 7f9e86870640 1 --2- 172.21.15.40:0/1013321862 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9e80161920 0x7f9e8015ddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:32.272 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:32.268+0000 7f9e8506d640 1 -- 172.21.15.40:0/1013321862 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1583187955 0 0) 0x7f9e80160bf0 con 0x7f9e8006ab70 2023-12-17T11:49:32.272 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:32.269+0000 7f9e8506d640 1 -- 172.21.15.40:0/1013321862 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9e6c003520 con 0x7f9e8006ab70 2023-12-17T11:49:32.272 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:32.269+0000 7f9e8506d640 1 -- 172.21.15.40:0/1013321862 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4027679325 0 0) 0x7f9e6c003520 con 0x7f9e8006ab70 2023-12-17T11:49:32.272 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:32.269+0000 7f9e8506d640 1 -- 172.21.15.40:0/1013321862 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9e80161920 msgr2=0x7f9e8015ddf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:49:32.272 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:32.269+0000 7f9e8506d640 1 --2- 172.21.15.40:0/1013321862 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9e80161920 0x7f9e8015ddf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:32.272 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:32.269+0000 7f9e8506d640 1 -- 172.21.15.40:0/1013321862 >> v1:172.21.15.159:6789/0 conn(0x7f9e800ad590 legacy=0x7f9e8006a460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:32.272 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:32.269+0000 7f9e8506d640 1 -- 172.21.15.40:0/1013321862 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e80161120 con 0x7f9e8006ab70 2023-12-17T11:49:32.273 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:32.269+0000 7f9e8506d640 1 -- 172.21.15.40:0/1013321862 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2643242555 0 0) 0x7f9e70001670 con 0x7f9e8006ab70 2023-12-17T11:49:32.273 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:32.269+0000 7f9e8506d640 1 -- 172.21.15.40:0/1013321862 >> v1:172.21.15.40:6789/0 conn(0x7f9e8006ab70 legacy=0x7f9e8015d6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:32.273 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:32.269+0000 7f9e8506d640 1 --2- 172.21.15.40:0/1013321862 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9e80161920 0x7f9e6c0039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:32.273 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:32.269+0000 7f9e8506d640 1 --2- 172.21.15.40:0/1013321862 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9e6c003ee0 0x7f9e6c0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:32.273 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:32.269+0000 7f9e8506d640 1 --2- 172.21.15.40:0/1013321862 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9e6c004d00 0x7f9e6c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:32.273 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:32.269+0000 7f9e8506d640 1 -- 172.21.15.40:0/1013321862 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e80160e40 con 0x7f9e6c003ee0 2023-12-17T11:49:32.273 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:32.269+0000 7f9e8506d640 1 -- 172.21.15.40:0/1013321862 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e6c00ba30 con 0x7f9e6c004d00 2023-12-17T11:49:32.273 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:32.269+0000 7f9e8506d640 1 -- 172.21.15.40:0/1013321862 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e6c00bbf0 con 0x7f9e80161920 2023-12-17T11:49:32.273 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:32.270+0000 7f9e8586e640 1 --2- 172.21.15.40:0/1013321862 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9e6c003ee0 0x7f9e6c0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:32.273 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:32.270+0000 7f9e8606f640 1 --2- 172.21.15.40:0/1013321862 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9e80161920 0x7f9e6c0039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:32.273 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:32.270+0000 7f9e8586e640 1 -- 172.21.15.40:0/1013321862 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9e80161920 msgr2=0x7f9e6c0039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:49:32.273 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:32.270+0000 7f9e86870640 1 --2- 172.21.15.40:0/1013321862 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9e6c004d00 0x7f9e6c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:32.273 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:32.270+0000 7f9e8586e640 1 --2- 172.21.15.40:0/1013321862 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9e80161920 0x7f9e6c0039a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:32.273 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:32.270+0000 7f9e8586e640 1 -- 172.21.15.40:0/1013321862 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9e6c004d00 msgr2=0x7f9e6c005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:49:32.274 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:32.270+0000 7f9e8586e640 1 --2- 172.21.15.40:0/1013321862 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9e6c004d00 0x7f9e6c005180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:32.274 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:32.270+0000 7f9e8586e640 1 -- 172.21.15.40:0/1013321862 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e6c003520 con 0x7f9e6c003ee0 2023-12-17T11:49:32.274 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:32.270+0000 7f9e8606f640 1 --2- 172.21.15.40:0/1013321862 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9e80161920 0x7f9e6c0039a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-17T11:49:32.275 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:32.271+0000 7f9e8586e640 1 --2- 172.21.15.40:0/1013321862 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9e6c003ee0 0x7f9e6c0047c0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f9e7000c190 tx=0x7f9e6c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a1a36c2959b10cd server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:49:32.275 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:32.271+0000 7f9e8506d640 1 -- 172.21.15.40:0/1013321862 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e70005ad0 con 0x7f9e6c003ee0 2023-12-17T11:49:32.275 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:32.271+0000 7f9e8506d640 1 -- 172.21.15.40:0/1013321862 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e70005c30 con 0x7f9e6c003ee0 2023-12-17T11:49:32.275 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:32.271+0000 7f9e8506d640 1 -- 172.21.15.40:0/1013321862 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e7002c810 con 0x7f9e6c003ee0 2023-12-17T11:49:32.275 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:32.272+0000 7f9e87071640 1 -- 172.21.15.40:0/1013321862 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9e6c003ee0 msgr2=0x7f9e6c0047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:32.275 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:32.272+0000 7f9e87071640 1 --2- 172.21.15.40:0/1013321862 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9e6c003ee0 0x7f9e6c0047c0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f9e7000c190 tx=0x7f9e6c0057f0 comp rx=0 tx=0).stop 2023-12-17T11:49:32.275 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:32.272+0000 7f9e86870640 1 -- 172.21.15.40:0/1013321862 reap_dead start 2023-12-17T11:49:32.275 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:32.272+0000 7f9e87071640 1 -- 172.21.15.40:0/1013321862 shutdown_connections 2023-12-17T11:49:32.276 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:32.272+0000 7f9e87071640 1 -- 172.21.15.40:0/1013321862 >> 172.21.15.40:0/1013321862 conn(0x7f9e8006bf90 msgr2=0x7f9e800b1970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:49:32.276 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:32.273+0000 7f9e87071640 1 -- 172.21.15.40:0/1013321862 shutdown_connections 2023-12-17T11:49:32.276 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:32.273+0000 7f9e87071640 1 -- 172.21.15.40:0/1013321862 wait complete. 2023-12-17T11:49:32.278 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:32.275+0000 7f9e87071640 1 Processor -- start 2023-12-17T11:49:32.278 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:32.276+0000 7f9e87071640 1 -- start start 2023-12-17T11:49:32.282 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:32.277+0000 7f9e87071640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9e6c003ee0 0x7f9e8015d2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:32.282 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:32.277+0000 7f9e87071640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9e801441c0 0x7f9e8013eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:32.282 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:32.277+0000 7f9e87071640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9e801407a0 0x7f9e8015e730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:32.282 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:32.277+0000 7f9e87071640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e8015d7e0 con 0x7f9e801441c0 2023-12-17T11:49:32.282 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:32.277+0000 7f9e87071640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e8013f700 con 0x7f9e801407a0 2023-12-17T11:49:32.282 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:32.277+0000 7f9e87071640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e8013f9e0 con 0x7f9e6c003ee0 2023-12-17T11:49:32.283 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:32.278+0000 7f9e8586e640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9e801441c0 0x7f9e8013eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:32.283 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:32.278+0000 7f9e8586e640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9e801441c0 0x7f9e8013eeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:38780/0 (socket says 172.21.15.40:38780) 2023-12-17T11:49:32.283 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:32.278+0000 7f9e8586e640 1 -- 172.21.15.40:0/1577420675 learned_addr learned my addr 172.21.15.40:0/1577420675 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-17T11:49:32.283 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:32.278+0000 7f9e8606f640 1 --2- 172.21.15.40:0/1577420675 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9e6c003ee0 0x7f9e8015d2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:32.283 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:32.278+0000 7f9e86870640 1 --2- 172.21.15.40:0/1577420675 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9e801407a0 0x7f9e8015e730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:32.283 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:32.278+0000 7f9e8586e640 1 -- 172.21.15.40:0/1577420675 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9e6c003ee0 msgr2=0x7f9e8015d2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:32.284 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:32.278+0000 7f9e8586e640 1 --2- 172.21.15.40:0/1577420675 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9e6c003ee0 0x7f9e8015d2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:32.284 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:32.278+0000 7f9e8586e640 1 -- 172.21.15.40:0/1577420675 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9e801407a0 msgr2=0x7f9e8015e730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:32.284 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:32.278+0000 7f9e8586e640 1 --2- 172.21.15.40:0/1577420675 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9e801407a0 0x7f9e8015e730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:32.284 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:32.278+0000 7f9e8586e640 1 -- 172.21.15.40:0/1577420675 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e8013fcc0 con 0x7f9e801441c0 2023-12-17T11:49:32.284 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:32.279+0000 7f9e8586e640 1 --2- 172.21.15.40:0/1577420675 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9e801441c0 0x7f9e8013eeb0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f9e70001c60 tx=0x7f9e70001930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:49:32.284 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:32.279+0000 7f9e76ffd640 1 -- 172.21.15.40:0/1577420675 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e70039070 con 0x7f9e801441c0 2023-12-17T11:49:32.284 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:32.279+0000 7f9e76ffd640 1 -- 172.21.15.40:0/1577420675 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e7002cc20 con 0x7f9e801441c0 2023-12-17T11:49:32.284 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:32.279+0000 7f9e76ffd640 1 -- 172.21.15.40:0/1577420675 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e70007070 con 0x7f9e801441c0 2023-12-17T11:49:32.284 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:32.279+0000 7f9e87071640 1 -- 172.21.15.40:0/1577420675 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e8013ffa0 con 0x7f9e801441c0 2023-12-17T11:49:32.284 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:32.279+0000 7f9e87071640 1 -- 172.21.15.40:0/1577420675 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e8013f3f0 con 0x7f9e801441c0 2023-12-17T11:49:32.285 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:32.281+0000 7f9e87071640 1 -- 172.21.15.40:0/1577420675 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e800673f0 con 0x7f9e801441c0 2023-12-17T11:49:32.285 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:32.282+0000 7f9e76ffd640 1 -- 172.21.15.40:0/1577420675 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f9e70032070 con 0x7f9e801441c0 2023-12-17T11:49:32.285 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:32.283+0000 7f9e76ffd640 1 --2- 172.21.15.40:0/1577420675 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f9e6406ae40 0x7f9e6406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:32.285 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:32.283+0000 7f9e76ffd640 1 -- 172.21.15.40:0/1577420675 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f9e7003c040 con 0x7f9e801441c0 2023-12-17T11:49:32.286 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:32.284+0000 7f9e8606f640 1 --2- 172.21.15.40:0/1577420675 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f9e6406ae40 0x7f9e6406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:32.286 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:32.285+0000 7f9e8606f640 1 --2- 172.21.15.40:0/1577420675 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f9e6406ae40 0x7f9e6406d300 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f9e7c000f60 tx=0x7f9e7c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:49:32.290 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:32.288+0000 7f9e76ffd640 1 -- 172.21.15.40:0/1577420675 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f9e70075910 con 0x7f9e801441c0 2023-12-17T11:49:32.484 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:32.481+0000 7f9e87071640 1 -- 172.21.15.40:0/1577420675 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f9e800b4ad0 con 0x7f9e801441c0 2023-12-17T11:49:32.484 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:32.482+0000 7f9e76ffd640 1 -- 172.21.15.40:0/1577420675 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) v1 ==== 103+0+11 (secure 0 0 0) 0x7f9e70078f30 con 0x7f9e801441c0 2023-12-17T11:49:32.484 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 32 2023-12-17T11:49:32.487 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:32.485+0000 7f9e87071640 1 -- 172.21.15.40:0/1577420675 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f9e6406ae40 msgr2=0x7f9e6406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:32.487 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:32.485+0000 7f9e87071640 1 --2- 172.21.15.40:0/1577420675 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f9e6406ae40 0x7f9e6406d300 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f9e7c000f60 tx=0x7f9e7c009040 comp rx=0 tx=0).stop 2023-12-17T11:49:32.487 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:32.485+0000 7f9e87071640 1 -- 172.21.15.40:0/1577420675 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9e801441c0 msgr2=0x7f9e8013eeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:32.487 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:32.485+0000 7f9e87071640 1 --2- 172.21.15.40:0/1577420675 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9e801441c0 0x7f9e8013eeb0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f9e70001c60 tx=0x7f9e70001930 comp rx=0 tx=0).stop 2023-12-17T11:49:32.488 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:32.485+0000 7f9e87071640 1 -- 172.21.15.40:0/1577420675 shutdown_connections 2023-12-17T11:49:32.488 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:32.485+0000 7f9e87071640 1 --2- 172.21.15.40:0/1577420675 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f9e6406ae40 0x7f9e6406d300 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:32.488 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:32.485+0000 7f9e87071640 1 --2- 172.21.15.40:0/1577420675 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9e801407a0 0x7f9e8015e730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:32.488 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:32.485+0000 7f9e87071640 1 --2- 172.21.15.40:0/1577420675 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9e801441c0 0x7f9e8013eeb0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:32.488 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:32.485+0000 7f9e87071640 1 --2- 172.21.15.40:0/1577420675 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9e6c003ee0 0x7f9e8015d2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:32.488 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:32.485+0000 7f9e87071640 1 -- 172.21.15.40:0/1577420675 >> 172.21.15.40:0/1577420675 conn(0x7f9e8006bf90 msgr2=0x7f9e8015f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:49:32.488 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:32.485+0000 7f9e87071640 1 -- 172.21.15.40:0/1577420675 shutdown_connections 2023-12-17T11:49:32.488 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:32.485+0000 7f9e87071640 1 -- 172.21.15.40:0/1577420675 wait complete. 2023-12-17T11:49:32.507 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-17T11:49:32.727 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:32.724+0000 7f70eefc9640 1 Processor -- start 2023-12-17T11:49:32.727 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:32.725+0000 7f70eefc9640 1 -- start start 2023-12-17T11:49:32.729 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:32.726+0000 7f70eefc9640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f70e8157a60 0x7f70e806c410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:32.729 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:32.726+0000 7f70eefc9640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f70e806de20 0x7f70e815dba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:32.729 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:32.726+0000 7f70eefc9640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70e806ca40 con 0x7f70e815e0e0 2023-12-17T11:49:32.729 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:32.727+0000 7f70eefc9640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70e815e550 con 0x7f70e8157a60 2023-12-17T11:49:32.729 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:32.727+0000 7f70eefc9640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70e8071cd0 con 0x7f70e806de20 2023-12-17T11:49:32.730 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:32.727+0000 7f70ecd65640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f70e8157a60 0x7f70e806c410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:32.730 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:32.727+0000 7f70ed566640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f70e815e0e0 0x7f70e815a5b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:57134/0 (socket says 172.21.15.40:57134) 2023-12-17T11:49:32.730 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:32.727+0000 7f70ed566640 1 -- 172.21.15.40:0/1280454983 learned_addr learned my addr 172.21.15.40:0/1280454983 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-12-17T11:49:32.730 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:32.727+0000 7f70ecd65640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f70e8157a60 0x7f70e806c410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:38794/0 (socket says 172.21.15.40:38794) 2023-12-17T11:49:32.730 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:32.727+0000 7f70e7fff640 1 --2- 172.21.15.40:0/1280454983 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f70e806de20 0x7f70e815dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:32.730 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:32.727+0000 7f70ecd65640 1 -- 172.21.15.40:0/1280454983 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f70e806de20 msgr2=0x7f70e815dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:49:32.730 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:32.727+0000 7f70ecd65640 1 --2- 172.21.15.40:0/1280454983 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f70e806de20 0x7f70e815dba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:32.730 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:32.727+0000 7f70ecd65640 1 -- 172.21.15.40:0/1280454983 >> v1:172.21.15.40:6789/0 conn(0x7f70e815e0e0 legacy=0x7f70e815a5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:32.730 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:32.727+0000 7f70ecd65640 1 -- 172.21.15.40:0/1280454983 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70e8070f10 con 0x7f70e8157a60 2023-12-17T11:49:32.730 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:32.729+0000 7f70ecd65640 1 --2- 172.21.15.40:0/1280454983 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f70e8157a60 0x7f70e806c410 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f70dc0097d0 tx=0x7f70dc02b820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5ffa4de4d47003a server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:49:32.731 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:32.729+0000 7f70e77fe640 1 -- 172.21.15.40:0/1280454983 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70dc031780 con 0x7f70e8157a60 2023-12-17T11:49:32.731 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:32.729+0000 7f70e77fe640 1 -- 172.21.15.40:0/1280454983 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70dc0318e0 con 0x7f70e8157a60 2023-12-17T11:49:32.731 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:32.729+0000 7f70e77fe640 1 -- 172.21.15.40:0/1280454983 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70dc031c70 con 0x7f70e8157a60 2023-12-17T11:49:32.732 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:32.730+0000 7f70eefc9640 1 -- 172.21.15.40:0/1280454983 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f70e8157a60 msgr2=0x7f70e806c410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:32.732 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:32.730+0000 7f70eefc9640 1 --2- 172.21.15.40:0/1280454983 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f70e8157a60 0x7f70e806c410 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f70dc0097d0 tx=0x7f70dc02b820 comp rx=0 tx=0).stop 2023-12-17T11:49:32.732 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:32.730+0000 7f70eefc9640 1 -- 172.21.15.40:0/1280454983 shutdown_connections 2023-12-17T11:49:32.732 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:32.730+0000 7f70eefc9640 1 --2- 172.21.15.40:0/1280454983 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f70e806de20 0x7f70e815dba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:32.732 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:32.730+0000 7f70eefc9640 1 --2- 172.21.15.40:0/1280454983 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f70e8157a60 0x7f70e806c410 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:32.732 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:32.730+0000 7f70eefc9640 1 -- 172.21.15.40:0/1280454983 >> 172.21.15.40:0/1280454983 conn(0x7f70e80b0a90 msgr2=0x7f70e80b0e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:49:32.732 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:32.730+0000 7f70eefc9640 1 -- 172.21.15.40:0/1280454983 shutdown_connections 2023-12-17T11:49:32.732 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:32.730+0000 7f70eefc9640 1 -- 172.21.15.40:0/1280454983 wait complete. 2023-12-17T11:49:32.734 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:32.732+0000 7f70eefc9640 1 Processor -- start 2023-12-17T11:49:32.734 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:32.732+0000 7f70eefc9640 1 -- start start 2023-12-17T11:49:32.736 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:32.733+0000 7f70eefc9640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f70e806de20 0x7f70e80b3ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:32.736 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:32.733+0000 7f70eefc9640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f70e8157a60 0x7f70e814e820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:32.736 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:32.734+0000 7f70eefc9640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f70e815e0e0 0x7f70e8149c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:32.736 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:32.734+0000 7f70eefc9640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70e80b2830 con 0x7f70e815e0e0 2023-12-17T11:49:32.736 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:32.734+0000 7f70eefc9640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70e80b2a40 con 0x7f70e8157a60 2023-12-17T11:49:32.736 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:32.734+0000 7f70eefc9640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70e80b2d20 con 0x7f70e806de20 2023-12-17T11:49:32.736 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:32.734+0000 7f70ed566640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f70e815e0e0 0x7f70e8149c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:32.736 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:32.734+0000 7f70ed566640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f70e815e0e0 0x7f70e8149c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:38802/0 (socket says 172.21.15.40:38802) 2023-12-17T11:49:32.736 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:32.734+0000 7f70ed566640 1 -- 172.21.15.40:0/1544330284 learned_addr learned my addr 172.21.15.40:0/1544330284 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-17T11:49:32.737 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:32.734+0000 7f70e7fff640 1 --2- 172.21.15.40:0/1544330284 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f70e8157a60 0x7f70e814e820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:32.738 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:32.734+0000 7f70ecd65640 1 --2- 172.21.15.40:0/1544330284 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f70e806de20 0x7f70e80b3ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:32.738 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:32.734+0000 7f70ed566640 1 -- 172.21.15.40:0/1544330284 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f70e806de20 msgr2=0x7f70e80b3ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:32.738 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:32.734+0000 7f70ed566640 1 --2- 172.21.15.40:0/1544330284 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f70e806de20 0x7f70e80b3ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:32.738 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:32.735+0000 7f70ed566640 1 -- 172.21.15.40:0/1544330284 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f70e8157a60 msgr2=0x7f70e814e820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:32.738 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:32.735+0000 7f70ed566640 1 --2- 172.21.15.40:0/1544330284 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f70e8157a60 0x7f70e814e820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:32.738 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:32.735+0000 7f70ed566640 1 -- 172.21.15.40:0/1544330284 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70dc009400 con 0x7f70e815e0e0 2023-12-17T11:49:32.738 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:32.735+0000 7f70ed566640 1 --2- 172.21.15.40:0/1544330284 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f70e815e0e0 0x7f70e8149c10 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f70e000ca80 tx=0x7f70e000cf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:49:32.738 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:32.735+0000 7f70e57fa640 1 -- 172.21.15.40:0/1544330284 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70e000ac30 con 0x7f70e815e0e0 2023-12-17T11:49:32.738 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:32.735+0000 7f70e57fa640 1 -- 172.21.15.40:0/1544330284 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70e000ad90 con 0x7f70e815e0e0 2023-12-17T11:49:32.738 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:32.735+0000 7f70e57fa640 1 -- 172.21.15.40:0/1544330284 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70e0012600 con 0x7f70e815e0e0 2023-12-17T11:49:32.738 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:32.735+0000 7f70eefc9640 1 -- 172.21.15.40:0/1544330284 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70e80b3000 con 0x7f70e815e0e0 2023-12-17T11:49:32.738 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:32.735+0000 7f70eefc9640 1 -- 172.21.15.40:0/1544330284 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70e80b35c0 con 0x7f70e815e0e0 2023-12-17T11:49:32.739 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:32.736+0000 7f70eefc9640 1 -- 172.21.15.40:0/1544330284 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70e80b37e0 con 0x7f70e815e0e0 2023-12-17T11:49:32.739 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:32.738+0000 7f70e57fa640 1 -- 172.21.15.40:0/1544330284 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f70e0007070 con 0x7f70e815e0e0 2023-12-17T11:49:32.740 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:32.739+0000 7f70e57fa640 1 --2- 172.21.15.40:0/1544330284 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f70cc06ae40 0x7f70cc06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:32.741 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:32.739+0000 7f70e57fa640 1 -- 172.21.15.40:0/1544330284 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f70e0089770 con 0x7f70e815e0e0 2023-12-17T11:49:32.741 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:32.739+0000 7f70ecd65640 1 --2- 172.21.15.40:0/1544330284 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f70cc06ae40 0x7f70cc06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:32.742 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:32.740+0000 7f70ecd65640 1 --2- 172.21.15.40:0/1544330284 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f70cc06ae40 0x7f70cc06d300 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f70dc036000 tx=0x7f70dc03d040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:49:32.745 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:32.743+0000 7f70e57fa640 1 -- 172.21.15.40:0/1544330284 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f70e00544f0 con 0x7f70e815e0e0 2023-12-17T11:49:32.954 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:32.952+0000 7f70eefc9640 1 -- 172.21.15.40:0/1544330284 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f70e80745d0 con 0x7f70e815e0e0 2023-12-17T11:49:32.955 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:32.953+0000 7f70e57fa640 1 -- 172.21.15.40:0/1544330284 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v27) v1 ==== 80+0+0 (secure 0 0 0) 0x7f70e0057b10 con 0x7f70e815e0e0 2023-12-17T11:49:32.955 INFO:teuthology.orchestra.run.smithi040.stderr:listed 0 entries 2023-12-17T11:49:32.958 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:32.955+0000 7f70eefc9640 1 -- 172.21.15.40:0/1544330284 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f70cc06ae40 msgr2=0x7f70cc06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:32.958 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:32.955+0000 7f70eefc9640 1 --2- 172.21.15.40:0/1544330284 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f70cc06ae40 0x7f70cc06d300 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f70dc036000 tx=0x7f70dc03d040 comp rx=0 tx=0).stop 2023-12-17T11:49:32.958 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:32.955+0000 7f70eefc9640 1 -- 172.21.15.40:0/1544330284 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f70e815e0e0 msgr2=0x7f70e8149c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:32.958 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:32.955+0000 7f70eefc9640 1 --2- 172.21.15.40:0/1544330284 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f70e815e0e0 0x7f70e8149c10 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f70e000ca80 tx=0x7f70e000cf40 comp rx=0 tx=0).stop 2023-12-17T11:49:32.958 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:32.956+0000 7f70eefc9640 1 -- 172.21.15.40:0/1544330284 shutdown_connections 2023-12-17T11:49:32.958 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:32.956+0000 7f70eefc9640 1 --2- 172.21.15.40:0/1544330284 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f70cc06ae40 0x7f70cc06d300 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:32.959 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:32.956+0000 7f70eefc9640 1 --2- 172.21.15.40:0/1544330284 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f70e815e0e0 0x7f70e8149c10 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:32.959 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:32.956+0000 7f70eefc9640 1 --2- 172.21.15.40:0/1544330284 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f70e8157a60 0x7f70e814e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:32.959 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:32.956+0000 7f70eefc9640 1 --2- 172.21.15.40:0/1544330284 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f70e806de20 0x7f70e80b3ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:32.959 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:32.956+0000 7f70eefc9640 1 -- 172.21.15.40:0/1544330284 >> 172.21.15.40:0/1544330284 conn(0x7f70e80b0a90 msgr2=0x7f70e8152900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:49:32.959 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:32.956+0000 7f70eefc9640 1 -- 172.21.15.40:0/1544330284 shutdown_connections 2023-12-17T11:49:32.959 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:32.956+0000 7f70eefc9640 1 -- 172.21.15.40:0/1544330284 wait complete. 2023-12-17T11:49:32.978 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.3... 2023-12-17T11:49:32.978 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-17T11:49:32.978 DEBUG:teuthology.orchestra.run.smithi159:> sudo umount /home/ubuntu/cephtest/mnt.3 -f 2023-12-17T11:49:33.090 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi159.front.sepia.ceph.com 2023-12-17T11:49:33.090 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-17T11:49:33.090 DEBUG:teuthology.orchestra.run.smithi159:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-12-17T11:49:33.144 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-12-17T11:49:33.145 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-17T11:49:33.377 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:33.375+0000 7f40d5627640 1 Processor -- start 2023-12-17T11:49:33.377 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:33.375+0000 7f40d5627640 1 -- start start 2023-12-17T11:49:33.379 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:33.377+0000 7f40d5627640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f40d0159fd0 0x7f40d00ae1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:33.379 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:33.377+0000 7f40d5627640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40d0070070 con 0x7f40d0070750 2023-12-17T11:49:33.379 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:33.377+0000 7f40d5627640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40d0070310 con 0x7f40d00713b0 2023-12-17T11:49:33.379 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:33.377+0000 7f40d5627640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40d00705f0 con 0x7f40d0159fd0 2023-12-17T11:49:33.379 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:33.377+0000 7f40cf7fe640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f40d0070750 0x7f40d0070ca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:57146/0 (socket says 172.21.15.40:57146) 2023-12-17T11:49:33.379 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:33.377+0000 7f40cf7fe640 1 -- 172.21.15.40:0/534517745 learned_addr learned my addr 172.21.15.40:0/534517745 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-12-17T11:49:33.379 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:33.377+0000 7f40cffff640 1 --2- 172.21.15.40:0/534517745 >> v2:172.21.15.40:3300/0 conn(0x7f40d0159fd0 0x7f40d00ae1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:33.380 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:33.378+0000 7f40cffff640 1 -- 172.21.15.40:0/534517745 >> v1:172.21.15.159:6789/0 conn(0x7f40d00713b0 legacy=0x7f40d00b27e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:49:33.380 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:33.378+0000 7f40cffff640 1 -- 172.21.15.40:0/534517745 >> v1:172.21.15.40:6789/0 conn(0x7f40d0070750 legacy=0x7f40d0070ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:33.380 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:33.378+0000 7f40cffff640 1 -- 172.21.15.40:0/534517745 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40d00b1d00 con 0x7f40d0159fd0 2023-12-17T11:49:33.381 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:33.379+0000 7f40cffff640 1 --2- 172.21.15.40:0/534517745 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f40d0159fd0 0x7f40d00ae1d0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f40c0009d90 tx=0x7f40c002e160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1cf880fe09d7a2ca server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:49:33.381 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:33.379+0000 7f40ceffd640 1 -- 172.21.15.40:0/534517745 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40c0036440 con 0x7f40d0159fd0 2023-12-17T11:49:33.381 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:33.379+0000 7f40ceffd640 1 -- 172.21.15.40:0/534517745 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40c00365a0 con 0x7f40d0159fd0 2023-12-17T11:49:33.381 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:33.379+0000 7f40ceffd640 1 -- 172.21.15.40:0/534517745 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40c0036930 con 0x7f40d0159fd0 2023-12-17T11:49:33.382 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:33.380+0000 7f40d5627640 1 -- 172.21.15.40:0/534517745 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f40d0159fd0 msgr2=0x7f40d00ae1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:33.382 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:33.380+0000 7f40d5627640 1 --2- 172.21.15.40:0/534517745 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f40d0159fd0 0x7f40d00ae1d0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f40c0009d90 tx=0x7f40c002e160 comp rx=0 tx=0).stop 2023-12-17T11:49:33.382 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:33.380+0000 7f40d5627640 1 -- 172.21.15.40:0/534517745 shutdown_connections 2023-12-17T11:49:33.382 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:33.380+0000 7f40d5627640 1 --2- 172.21.15.40:0/534517745 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f40d0159fd0 0x7f40d00ae1d0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:33.382 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:33.380+0000 7f40d5627640 1 -- 172.21.15.40:0/534517745 >> 172.21.15.40:0/534517745 conn(0x7f40d00b0860 msgr2=0x7f40d00b0c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:49:33.382 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:33.380+0000 7f40d5627640 1 -- 172.21.15.40:0/534517745 shutdown_connections 2023-12-17T11:49:33.382 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:33.380+0000 7f40d5627640 1 -- 172.21.15.40:0/534517745 wait complete. 2023-12-17T11:49:33.384 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:33.382+0000 7f40d5627640 1 Processor -- start 2023-12-17T11:49:33.384 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:33.382+0000 7f40d5627640 1 -- start start 2023-12-17T11:49:33.387 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:33.384+0000 7f40d5627640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f40d0070750 0x7f40d00cdd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:33.387 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:33.384+0000 7f40d5627640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f40d00713b0 0x7f40d009be40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:33.387 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:33.384+0000 7f40d5627640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f40d0159fd0 0x7f40d00b3280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:33.387 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:33.384+0000 7f40d5627640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40d009c890 con 0x7f40d00713b0 2023-12-17T11:49:33.387 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:33.384+0000 7f40d5627640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40d01f2e50 con 0x7f40d0070750 2023-12-17T11:49:33.387 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:33.384+0000 7f40d5627640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40d01f3130 con 0x7f40d0159fd0 2023-12-17T11:49:33.387 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:33.384+0000 7f40cf7fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f40d00713b0 0x7f40d009be40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:33.387 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:33.384+0000 7f40cf7fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f40d00713b0 0x7f40d009be40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:38818/0 (socket says 172.21.15.40:38818) 2023-12-17T11:49:33.387 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:33.384+0000 7f40cf7fe640 1 -- 172.21.15.40:0/1423506029 learned_addr learned my addr 172.21.15.40:0/1423506029 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-17T11:49:33.387 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:33.384+0000 7f40cffff640 1 --2- 172.21.15.40:0/1423506029 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f40d0070750 0x7f40d00cdd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:33.387 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:33.384+0000 7f40d4e26640 1 --2- 172.21.15.40:0/1423506029 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f40d0159fd0 0x7f40d00b3280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:33.387 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:33.385+0000 7f40cf7fe640 1 -- 172.21.15.40:0/1423506029 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f40d0159fd0 msgr2=0x7f40d00b3280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:33.388 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:33.385+0000 7f40cf7fe640 1 --2- 172.21.15.40:0/1423506029 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f40d0159fd0 0x7f40d00b3280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:33.388 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:33.385+0000 7f40cf7fe640 1 -- 172.21.15.40:0/1423506029 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f40d0070750 msgr2=0x7f40d00cdd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:33.388 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:33.385+0000 7f40cf7fe640 1 --2- 172.21.15.40:0/1423506029 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f40d0070750 0x7f40d00cdd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:33.388 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:33.385+0000 7f40cf7fe640 1 -- 172.21.15.40:0/1423506029 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40c0009a70 con 0x7f40d00713b0 2023-12-17T11:49:33.388 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:33.385+0000 7f40cf7fe640 1 --2- 172.21.15.40:0/1423506029 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f40d00713b0 0x7f40d009be40 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f40c400c4a0 tx=0x7f40c400c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:49:33.389 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:33.385+0000 7f40ccff9640 1 -- 172.21.15.40:0/1423506029 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40c4005ce0 con 0x7f40d00713b0 2023-12-17T11:49:33.389 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:33.385+0000 7f40ccff9640 1 -- 172.21.15.40:0/1423506029 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40c4005e40 con 0x7f40d00713b0 2023-12-17T11:49:33.389 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:33.385+0000 7f40ccff9640 1 -- 172.21.15.40:0/1423506029 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40c4007270 con 0x7f40d00713b0 2023-12-17T11:49:33.389 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:33.385+0000 7f40d5627640 1 -- 172.21.15.40:0/1423506029 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40d01f3410 con 0x7f40d00713b0 2023-12-17T11:49:33.390 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:33.386+0000 7f40d5627640 1 -- 172.21.15.40:0/1423506029 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40d01f3c10 con 0x7f40d00713b0 2023-12-17T11:49:33.390 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:33.387+0000 7f40d5627640 1 -- 172.21.15.40:0/1423506029 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40d01f3930 con 0x7f40d00713b0 2023-12-17T11:49:33.390 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:33.388+0000 7f40ccff9640 1 -- 172.21.15.40:0/1423506029 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f40c4007490 con 0x7f40d00713b0 2023-12-17T11:49:33.391 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:33.389+0000 7f40ccff9640 1 --2- 172.21.15.40:0/1423506029 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f40bc06ae40 0x7f40bc06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:33.391 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:33.389+0000 7f40ccff9640 1 -- 172.21.15.40:0/1423506029 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f40c4088f50 con 0x7f40d00713b0 2023-12-17T11:49:33.391 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:33.389+0000 7f40cffff640 1 --2- 172.21.15.40:0/1423506029 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f40bc06ae40 0x7f40bc06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:33.392 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:33.391+0000 7f40cffff640 1 --2- 172.21.15.40:0/1423506029 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f40bc06ae40 0x7f40bc06d300 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f40c0038000 tx=0x7f40c000d040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:49:33.394 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:33.393+0000 7f40ccff9640 1 -- 172.21.15.40:0/1423506029 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f40d01f3930 con 0x7f40d00713b0 2023-12-17T11:49:33.627 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:33.624+0000 7f40d5627640 1 -- 172.21.15.40:0/1423506029 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f40d01f3930 con 0x7f40d00713b0 2023-12-17T11:49:33.628 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:33.626+0000 7f40ccff9640 1 -- 172.21.15.40:0/1423506029 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4915 (secure 0 0 0) 0x7f40d01f3930 con 0x7f40d00713b0 2023-12-17T11:49:33.628 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T11:49:33.628 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/3337931457","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":3337931457},{"type":"v1","addr":"172.21.15.40:6835","nonce":3337931457}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4257,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6833/1874601964","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6832","nonce":1874601964},{"type":"v1","addr":"172.21.15.40:6833","nonce":1874601964}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4267,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6836/3645037845","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6834","nonce":3645037845},{"type":"v1","addr":"172.21.15.159:6836","nonce":3645037845}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-17T11:48:17.696113+0000","modified":"2023-12-17T11:48:40.061005+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4270},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4270":{"gid":4270,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.159:6837/1288849778","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6835","nonce":1288849778},{"type":"v1","addr":"172.21.15.159:6837","nonce":1288849778}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-12-17T11:49:33.628 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 8 2023-12-17T11:49:33.631 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:33.628+0000 7f40d5627640 1 -- 172.21.15.40:0/1423506029 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f40bc06ae40 msgr2=0x7f40bc06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:33.631 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:33.628+0000 7f40d5627640 1 --2- 172.21.15.40:0/1423506029 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f40bc06ae40 0x7f40bc06d300 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f40c0038000 tx=0x7f40c000d040 comp rx=0 tx=0).stop 2023-12-17T11:49:33.631 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:33.628+0000 7f40d5627640 1 -- 172.21.15.40:0/1423506029 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f40d00713b0 msgr2=0x7f40d009be40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:33.631 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:33.628+0000 7f40d5627640 1 --2- 172.21.15.40:0/1423506029 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f40d00713b0 0x7f40d009be40 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f40c400c4a0 tx=0x7f40c400c960 comp rx=0 tx=0).stop 2023-12-17T11:49:33.631 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:33.629+0000 7f40d5627640 1 -- 172.21.15.40:0/1423506029 shutdown_connections 2023-12-17T11:49:33.631 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:33.629+0000 7f40d5627640 1 --2- 172.21.15.40:0/1423506029 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f40bc06ae40 0x7f40bc06d300 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:33.631 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:33.629+0000 7f40d5627640 1 --2- 172.21.15.40:0/1423506029 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f40d0159fd0 0x7f40d00b3280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:33.632 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:33.629+0000 7f40d5627640 1 --2- 172.21.15.40:0/1423506029 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f40d00713b0 0x7f40d009be40 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:33.632 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:33.629+0000 7f40d5627640 1 --2- 172.21.15.40:0/1423506029 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f40d0070750 0x7f40d00cdd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:33.632 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:33.629+0000 7f40d5627640 1 -- 172.21.15.40:0/1423506029 >> 172.21.15.40:0/1423506029 conn(0x7f40d00b0860 msgr2=0x7f40d00aed80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:49:33.632 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:33.629+0000 7f40d5627640 1 -- 172.21.15.40:0/1423506029 shutdown_connections 2023-12-17T11:49:33.632 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:33.629+0000 7f40d5627640 1 -- 172.21.15.40:0/1423506029 wait complete. 2023-12-17T11:49:33.650 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-17T11:49:33.876 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:33.874+0000 7f5e9ab3c640 1 Processor -- start 2023-12-17T11:49:33.876 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:33.874+0000 7f5e9ab3c640 1 -- start start 2023-12-17T11:49:33.878 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:33.876+0000 7f5e9ab3c640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f5e9406c410 0x7f5e94166020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:33.878 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:33.876+0000 7f5e9ab3c640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e940b3bb0 con 0x7f5e94143e00 2023-12-17T11:49:33.878 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:33.876+0000 7f5e9ab3c640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e940b4e60 con 0x7f5e94072180 2023-12-17T11:49:33.878 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:33.876+0000 7f5e9ab3c640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e941441e0 con 0x7f5e9406c410 2023-12-17T11:49:33.878 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:33.876+0000 7f5e988d8640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f5e94143e00 0x7f5e940b4040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:57162/0 (socket says 172.21.15.40:57162) 2023-12-17T11:49:33.878 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:33.876+0000 7f5e988d8640 1 -- 172.21.15.40:0/3907165800 learned_addr learned my addr 172.21.15.40:0/3907165800 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-12-17T11:49:33.880 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:33.877+0000 7f5e990d9640 1 --2- 172.21.15.40:0/3907165800 >> v2:172.21.15.159:3300/0 conn(0x7f5e9406c410 0x7f5e94166020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:33.880 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:33.877+0000 7f5e937fe640 1 -- 172.21.15.40:0/3907165800 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2615750596 0 0) 0x7f5e940b3bb0 con 0x7f5e94143e00 2023-12-17T11:49:33.881 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:33.877+0000 7f5e937fe640 1 -- 172.21.15.40:0/3907165800 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5e84003520 con 0x7f5e94143e00 2023-12-17T11:49:33.881 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:33.877+0000 7f5e937fe640 1 -- 172.21.15.40:0/3907165800 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2419638777 0 0) 0x7f5e84003520 con 0x7f5e94143e00 2023-12-17T11:49:33.881 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:33.877+0000 7f5e937fe640 1 -- 172.21.15.40:0/3907165800 >> v2:172.21.15.159:3300/0 conn(0x7f5e9406c410 msgr2=0x7f5e94166020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:49:33.881 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:33.877+0000 7f5e937fe640 1 --2- 172.21.15.40:0/3907165800 >> v2:172.21.15.159:3300/0 conn(0x7f5e9406c410 0x7f5e94166020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:33.881 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:33.877+0000 7f5e937fe640 1 -- 172.21.15.40:0/3907165800 >> v1:172.21.15.159:6789/0 conn(0x7f5e94072180 legacy=0x7f5e940b4750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:33.881 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:33.877+0000 7f5e937fe640 1 -- 172.21.15.40:0/3907165800 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e94072680 con 0x7f5e94143e00 2023-12-17T11:49:33.881 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:33.877+0000 7f5e937fe640 1 -- 172.21.15.40:0/3907165800 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2643242555 0 0) 0x7f5e88001670 con 0x7f5e94143e00 2023-12-17T11:49:33.881 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:33.877+0000 7f5e937fe640 1 -- 172.21.15.40:0/3907165800 >> v1:172.21.15.40:6789/0 conn(0x7f5e94143e00 legacy=0x7f5e940b4040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:33.881 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:33.877+0000 7f5e937fe640 1 --2- 172.21.15.40:0/3907165800 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5e840039c0 0x7f5e84003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:33.881 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:33.877+0000 7f5e937fe640 1 --2- 172.21.15.40:0/3907165800 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5e840047c0 0x7f5e84004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:33.881 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:33.877+0000 7f5e937fe640 1 --2- 172.21.15.40:0/3907165800 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5e840051d0 0x7f5e8400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:33.881 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:33.877+0000 7f5e937fe640 1 -- 172.21.15.40:0/3907165800 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e941441e0 con 0x7f5e840039c0 2023-12-17T11:49:33.881 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:33.877+0000 7f5e937fe640 1 -- 172.21.15.40:0/3907165800 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e8400c120 con 0x7f5e840047c0 2023-12-17T11:49:33.882 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:33.877+0000 7f5e937fe640 1 -- 172.21.15.40:0/3907165800 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e8400c2e0 con 0x7f5e840051d0 2023-12-17T11:49:33.882 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:33.878+0000 7f5e988d8640 1 --2- 172.21.15.40:0/3907165800 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5e840039c0 0x7f5e84003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:33.882 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:33.878+0000 7f5e93fff640 1 --2- 172.21.15.40:0/3907165800 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5e840047c0 0x7f5e84004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:33.882 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:33.878+0000 7f5e988d8640 1 -- 172.21.15.40:0/3907165800 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5e840051d0 msgr2=0x7f5e8400b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:49:33.882 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:33.878+0000 7f5e988d8640 1 --2- 172.21.15.40:0/3907165800 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5e840051d0 0x7f5e8400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:33.882 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:33.878+0000 7f5e988d8640 1 -- 172.21.15.40:0/3907165800 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5e840047c0 msgr2=0x7f5e84004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:49:33.882 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:33.878+0000 7f5e988d8640 1 --2- 172.21.15.40:0/3907165800 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5e840047c0 0x7f5e84004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:33.882 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:33.878+0000 7f5e988d8640 1 -- 172.21.15.40:0/3907165800 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e84003520 con 0x7f5e840039c0 2023-12-17T11:49:33.882 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:33.878+0000 7f5e990d9640 1 -- 172.21.15.40:0/3907165800 reap_dead start 2023-12-17T11:49:33.882 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:33.878+0000 7f5e93fff640 1 --2- 172.21.15.40:0/3907165800 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5e840047c0 0x7f5e84004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-17T11:49:33.883 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:33.879+0000 7f5e988d8640 1 --2- 172.21.15.40:0/3907165800 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5e840039c0 0x7f5e84003de0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f5e88001eb0 tx=0x7f5e840057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cbeb407bd4037981 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:49:33.883 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:33.879+0000 7f5e937fe640 1 -- 172.21.15.40:0/3907165800 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e88005ad0 con 0x7f5e840039c0 2023-12-17T11:49:33.884 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:33.880+0000 7f5e937fe640 1 -- 172.21.15.40:0/3907165800 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e88005c30 con 0x7f5e840039c0 2023-12-17T11:49:33.884 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:33.880+0000 7f5e937fe640 1 -- 172.21.15.40:0/3907165800 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e8802c9d0 con 0x7f5e840039c0 2023-12-17T11:49:33.884 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:33.880+0000 7f5e9ab3c640 1 -- 172.21.15.40:0/3907165800 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5e840039c0 msgr2=0x7f5e84003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:33.884 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:33.880+0000 7f5e9ab3c640 1 --2- 172.21.15.40:0/3907165800 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5e840039c0 0x7f5e84003de0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f5e88001eb0 tx=0x7f5e840057f0 comp rx=0 tx=0).stop 2023-12-17T11:49:33.884 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:33.880+0000 7f5e9ab3c640 1 -- 172.21.15.40:0/3907165800 shutdown_connections 2023-12-17T11:49:33.884 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:33.880+0000 7f5e9ab3c640 1 --2- 172.21.15.40:0/3907165800 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5e840039c0 0x7f5e84003de0 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:33.884 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:33.880+0000 7f5e9ab3c640 1 -- 172.21.15.40:0/3907165800 >> 172.21.15.40:0/3907165800 conn(0x7f5e940b0a90 msgr2=0x7f5e940b0e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:49:33.884 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:33.880+0000 7f5e9ab3c640 1 -- 172.21.15.40:0/3907165800 shutdown_connections 2023-12-17T11:49:33.884 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:33.880+0000 7f5e9ab3c640 1 -- 172.21.15.40:0/3907165800 wait complete. 2023-12-17T11:49:33.885 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:33.882+0000 7f5e9ab3c640 1 Processor -- start 2023-12-17T11:49:33.885 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:33.882+0000 7f5e9ab3c640 1 -- start start 2023-12-17T11:49:33.886 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:33.883+0000 7f5e9ab3c640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5e840039c0 0x7f5e9413a820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:33.887 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:33.883+0000 7f5e9ab3c640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5e941f2cf0 0x7f5e9414efe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:33.887 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:33.883+0000 7f5e9ab3c640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5e940a8450 0x7f5e940a8900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:33.887 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:33.883+0000 7f5e9ab3c640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e941f3da0 con 0x7f5e941f2cf0 2023-12-17T11:49:33.887 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:33.883+0000 7f5e9ab3c640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e940a8e40 con 0x7f5e940a8450 2023-12-17T11:49:33.887 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:33.883+0000 7f5e9ab3c640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e9414f520 con 0x7f5e840039c0 2023-12-17T11:49:33.887 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:33.883+0000 7f5e93fff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5e941f2cf0 0x7f5e9414efe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:33.887 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:33.884+0000 7f5e93fff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5e941f2cf0 0x7f5e9414efe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:38836/0 (socket says 172.21.15.40:38836) 2023-12-17T11:49:33.887 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:33.884+0000 7f5e93fff640 1 -- 172.21.15.40:0/286844073 learned_addr learned my addr 172.21.15.40:0/286844073 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-17T11:49:33.887 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:33.884+0000 7f5e990d9640 1 --2- 172.21.15.40:0/286844073 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5e940a8450 0x7f5e940a8900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:33.887 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:33.884+0000 7f5e988d8640 1 --2- 172.21.15.40:0/286844073 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5e840039c0 0x7f5e9413a820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:33.887 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:33.884+0000 7f5e93fff640 1 -- 172.21.15.40:0/286844073 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5e840039c0 msgr2=0x7f5e9413a820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:33.887 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:33.884+0000 7f5e93fff640 1 --2- 172.21.15.40:0/286844073 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5e840039c0 0x7f5e9413a820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:33.887 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:33.884+0000 7f5e93fff640 1 -- 172.21.15.40:0/286844073 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5e940a8450 msgr2=0x7f5e940a8900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:33.887 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:33.884+0000 7f5e93fff640 1 --2- 172.21.15.40:0/286844073 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5e940a8450 0x7f5e940a8900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:33.888 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:33.884+0000 7f5e93fff640 1 -- 172.21.15.40:0/286844073 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e941f3190 con 0x7f5e941f2cf0 2023-12-17T11:49:33.888 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:33.884+0000 7f5e990d9640 1 --2- 172.21.15.40:0/286844073 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5e940a8450 0x7f5e940a8900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-17T11:49:33.888 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:33.884+0000 7f5e93fff640 1 --2- 172.21.15.40:0/286844073 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5e941f2cf0 0x7f5e9414efe0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f5e8000d4d0 tx=0x7f5e8000d990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:49:33.888 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:33.884+0000 7f5e917fa640 1 -- 172.21.15.40:0/286844073 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e80005480 con 0x7f5e941f2cf0 2023-12-17T11:49:33.888 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:33.885+0000 7f5e917fa640 1 -- 172.21.15.40:0/286844073 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e80003610 con 0x7f5e941f2cf0 2023-12-17T11:49:33.888 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:33.885+0000 7f5e917fa640 1 -- 172.21.15.40:0/286844073 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e800039a0 con 0x7f5e941f2cf0 2023-12-17T11:49:33.888 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:33.885+0000 7f5e9ab3c640 1 -- 172.21.15.40:0/286844073 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e941f3470 con 0x7f5e941f2cf0 2023-12-17T11:49:33.888 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:33.885+0000 7f5e9ab3c640 1 -- 172.21.15.40:0/286844073 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e941f3a30 con 0x7f5e941f2cf0 2023-12-17T11:49:33.888 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:33.886+0000 7f5e9ab3c640 1 -- 172.21.15.40:0/286844073 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e941f3bf0 con 0x7f5e941f2cf0 2023-12-17T11:49:33.889 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:33.887+0000 7f5e917fa640 1 -- 172.21.15.40:0/286844073 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f5e80003b00 con 0x7f5e941f2cf0 2023-12-17T11:49:33.890 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:33.888+0000 7f5e917fa640 1 --2- 172.21.15.40:0/286844073 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f5e7806ae40 0x7f5e7806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:33.890 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:33.889+0000 7f5e917fa640 1 -- 172.21.15.40:0/286844073 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f5e800897e0 con 0x7f5e941f2cf0 2023-12-17T11:49:33.891 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:33.889+0000 7f5e988d8640 1 --2- 172.21.15.40:0/286844073 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f5e7806ae40 0x7f5e7806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:33.892 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:33.890+0000 7f5e988d8640 1 --2- 172.21.15.40:0/286844073 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f5e7806ae40 0x7f5e7806d300 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f5e88034000 tx=0x7f5e88009030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:49:33.895 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:33.893+0000 7f5e917fa640 1 -- 172.21.15.40:0/286844073 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f5e80054560 con 0x7f5e941f2cf0 2023-12-17T11:49:34.089 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:34.087+0000 7f5e9ab3c640 1 -- 172.21.15.40:0/286844073 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5e9414c5f0 con 0x7f5e941f2cf0 2023-12-17T11:49:34.092 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:34.090+0000 7f5e917fa640 1 -- 172.21.15.40:0/286844073 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+18697 (secure 0 0 0) 0x7f5e9414c5f0 con 0x7f5e941f2cf0 2023-12-17T11:49:34.093 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T11:49:34.093 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":27,"fsid":"099cd35d-80d9-4ca4-8424-de13b3b03ac7","created":"2023-12-17T11:47:53.450097+0000","modified":"2023-12-17T11:49:00.483840+0000","last_up_change":"2023-12-17T11:48:05.724195+0000","last_in_change":"2023-12-17T11:47:56.956499+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-17T11:48:06.668943+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-17T11:48:16.151444+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-17T11:48:16.717726+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-17T11:48:20.534819+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a88bfd46-63b8-48b1-9c0e-5c9cdc31bd38","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":555204741},{"type":"v1","addr":"172.21.15.40:6802","nonce":555204741}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":555204741},{"type":"v1","addr":"172.21.15.40:6807","nonce":555204741}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":555204741},{"type":"v1","addr":"172.21.15.40:6815","nonce":555204741}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6809","nonce":555204741},{"type":"v1","addr":"172.21.15.40:6812","nonce":555204741}]},"public_addr":"172.21.15.40:6802/555204741","cluster_addr":"172.21.15.40:6807/555204741","heartbeat_back_addr":"172.21.15.40:6815/555204741","heartbeat_front_addr":"172.21.15.40:6812/555204741","state":["exists","up"]},{"osd":1,"uuid":"c5d628ae-36f4-4866-802c-b162f0e90add","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6801","nonce":1221318112},{"type":"v1","addr":"172.21.15.40:6803","nonce":1221318112}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6805","nonce":1221318112},{"type":"v1","addr":"172.21.15.40:6806","nonce":1221318112}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6811","nonce":1221318112},{"type":"v1","addr":"172.21.15.40:6813","nonce":1221318112}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":1221318112},{"type":"v1","addr":"172.21.15.40:6810","nonce":1221318112}]},"public_addr":"172.21.15.40:6803/1221318112","cluster_addr":"172.21.15.40:6806/1221318112","heartbeat_back_addr":"172.21.15.40:6813/1221318112","heartbeat_front_addr":"172.21.15.40:6810/1221318112","state":["exists","up"]},{"osd":2,"uuid":"d986ad6a-af2f-47fc-9c3b-fbda27b82b73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":1959000265},{"type":"v1","addr":"172.21.15.40:6817","nonce":1959000265}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6818","nonce":1959000265},{"type":"v1","addr":"172.21.15.40:6819","nonce":1959000265}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":1959000265},{"type":"v1","addr":"172.21.15.40:6827","nonce":1959000265}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":1959000265},{"type":"v1","addr":"172.21.15.40:6822","nonce":1959000265}]},"public_addr":"172.21.15.40:6817/1959000265","cluster_addr":"172.21.15.40:6819/1959000265","heartbeat_back_addr":"172.21.15.40:6827/1959000265","heartbeat_front_addr":"172.21.15.40:6822/1959000265","state":["exists","up"]},{"osd":3,"uuid":"d79d22b7-be05-41b2-b95d-697db677fd02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6821","nonce":974040287},{"type":"v1","addr":"172.21.15.40:6823","nonce":974040287}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6825","nonce":974040287},{"type":"v1","addr":"172.21.15.40:6826","nonce":974040287}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":974040287},{"type":"v1","addr":"172.21.15.40:6831","nonce":974040287}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":974040287},{"type":"v1","addr":"172.21.15.40:6829","nonce":974040287}]},"public_addr":"172.21.15.40:6823/974040287","cluster_addr":"172.21.15.40:6826/974040287","heartbeat_back_addr":"172.21.15.40:6831/974040287","heartbeat_front_addr":"172.21.15.40:6829/974040287","state":["exists","up"]},{"osd":4,"uuid":"62a7a233-d3ea-40be-91de-180c0208d639","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6808","nonce":3937787733},{"type":"v1","addr":"172.21.15.159:6809","nonce":3937787733}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6810","nonce":3937787733},{"type":"v1","addr":"172.21.15.159:6811","nonce":3937787733}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6814","nonce":3937787733},{"type":"v1","addr":"172.21.15.159:6815","nonce":3937787733}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6812","nonce":3937787733},{"type":"v1","addr":"172.21.15.159:6813","nonce":3937787733}]},"public_addr":"172.21.15.159:6809/3937787733","cluster_addr":"172.21.15.159:6811/3937787733","heartbeat_back_addr":"172.21.15.159:6815/3937787733","heartbeat_front_addr":"172.21.15.159:6813/3937787733","state":["exists","up"]},{"osd":5,"uuid":"84629cea-dc0e-4b5e-b203-5ea963839281","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6816","nonce":3032505240},{"type":"v1","addr":"172.21.15.159:6817","nonce":3032505240}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6818","nonce":3032505240},{"type":"v1","addr":"172.21.15.159:6819","nonce":3032505240}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6822","nonce":3032505240},{"type":"v1","addr":"172.21.15.159:6823","nonce":3032505240}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6820","nonce":3032505240},{"type":"v1","addr":"172.21.15.159:6821","nonce":3032505240}]},"public_addr":"172.21.15.159:6817/3032505240","cluster_addr":"172.21.15.159:6819/3032505240","heartbeat_back_addr":"172.21.15.159:6823/3032505240","heartbeat_front_addr":"172.21.15.159:6821/3032505240","state":["exists","up"]},{"osd":6,"uuid":"4ae3af3a-1743-4070-a91d-8be5c31cdb04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6800","nonce":2411788597},{"type":"v1","addr":"172.21.15.159:6801","nonce":2411788597}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6802","nonce":2411788597},{"type":"v1","addr":"172.21.15.159:6803","nonce":2411788597}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6806","nonce":2411788597},{"type":"v1","addr":"172.21.15.159:6807","nonce":2411788597}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6804","nonce":2411788597},{"type":"v1","addr":"172.21.15.159:6805","nonce":2411788597}]},"public_addr":"172.21.15.159:6801/2411788597","cluster_addr":"172.21.15.159:6803/2411788597","heartbeat_back_addr":"172.21.15.159:6807/2411788597","heartbeat_front_addr":"172.21.15.159:6805/2411788597","state":["exists","up"]},{"osd":7,"uuid":"c1f4c7f2-8f75-4f95-bc63-a332773e3b8e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6824","nonce":478953349},{"type":"v1","addr":"172.21.15.159:6825","nonce":478953349}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6826","nonce":478953349},{"type":"v1","addr":"172.21.15.159:6827","nonce":478953349}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6830","nonce":478953349},{"type":"v1","addr":"172.21.15.159:6831","nonce":478953349}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6828","nonce":478953349},{"type":"v1","addr":"172.21.15.159:6829","nonce":478953349}]},"public_addr":"172.21.15.159:6825/478953349","cluster_addr":"172.21.15.159:6827/478953349","heartbeat_back_addr":"172.21.15.159:6831/478953349","heartbeat_front_addr":"172.21.15.159:6829/478953349","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T11:48:02.023567+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T11:48:02.278216+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T11:48:02.311843+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T11:48:01.773372+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T11:48:02.618910+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T11:48:02.361559+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T11:48:02.223997+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T11:48:02.604403+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.2","mappings":[{"from":3,"to":2}]},{"pgid":"3.d","mappings":[{"from":5,"to":1}]},{"pgid":"3.13","mappings":[{"from":7,"to":2}]},{"pgid":"3.17","mappings":[{"from":0,"to":2}]},{"pgid":"3.38","mappings":[{"from":5,"to":1}]},{"pgid":"4.2","mappings":[{"from":1,"to":2}]},{"pgid":"4.10","mappings":[{"from":1,"to":2}]},{"pgid":"4.18","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-17T11:49:34.095 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:34.093+0000 7f5e9ab3c640 1 -- 172.21.15.40:0/286844073 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f5e7806ae40 msgr2=0x7f5e7806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:34.095 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:34.093+0000 7f5e9ab3c640 1 --2- 172.21.15.40:0/286844073 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f5e7806ae40 0x7f5e7806d300 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f5e88034000 tx=0x7f5e88009030 comp rx=0 tx=0).stop 2023-12-17T11:49:34.095 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:34.093+0000 7f5e9ab3c640 1 -- 172.21.15.40:0/286844073 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5e941f2cf0 msgr2=0x7f5e9414efe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:34.095 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:34.093+0000 7f5e9ab3c640 1 --2- 172.21.15.40:0/286844073 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5e941f2cf0 0x7f5e9414efe0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f5e8000d4d0 tx=0x7f5e8000d990 comp rx=0 tx=0).stop 2023-12-17T11:49:34.095 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:34.093+0000 7f5e9ab3c640 1 -- 172.21.15.40:0/286844073 shutdown_connections 2023-12-17T11:49:34.095 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:34.093+0000 7f5e9ab3c640 1 --2- 172.21.15.40:0/286844073 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f5e7806ae40 0x7f5e7806d300 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:34.095 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:34.093+0000 7f5e9ab3c640 1 --2- 172.21.15.40:0/286844073 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5e940a8450 0x7f5e940a8900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:34.096 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:34.093+0000 7f5e9ab3c640 1 --2- 172.21.15.40:0/286844073 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5e941f2cf0 0x7f5e9414efe0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:34.096 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:34.093+0000 7f5e9ab3c640 1 --2- 172.21.15.40:0/286844073 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5e840039c0 0x7f5e9413a820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:34.096 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:34.093+0000 7f5e9ab3c640 1 -- 172.21.15.40:0/286844073 >> 172.21.15.40:0/286844073 conn(0x7f5e940b0a90 msgr2=0x7f5e940b4040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:49:34.096 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:34.093+0000 7f5e9ab3c640 1 -- 172.21.15.40:0/286844073 shutdown_connections 2023-12-17T11:49:34.096 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:34.093+0000 7f5e9ab3c640 1 -- 172.21.15.40:0/286844073 wait complete. 2023-12-17T11:49:34.115 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-17T11:48:06.668943+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-17T11:48:16.151444+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-17T11:48:16.717726+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-12-17T11:48:20.534819+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-12-17T11:49:34.115 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-17T11:49:34.349 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:34.346+0000 7fe3bd561640 1 Processor -- start 2023-12-17T11:49:34.349 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:34.347+0000 7fe3bd561640 1 -- start start 2023-12-17T11:49:34.350 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:34.348+0000 7fe3bd561640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fe3b815af50 0x7fe3b806c170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:34.351 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:34.348+0000 7fe3bd561640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7fe3b80ce7e0 0x7fe3b815ec00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:34.351 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:34.348+0000 7fe3bd561640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3b8071cd0 con 0x7fe3b806a460 2023-12-17T11:49:34.351 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:34.348+0000 7fe3bd561640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3b80717e0 con 0x7fe3b815af50 2023-12-17T11:49:34.351 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:34.348+0000 7fe3bd561640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3b806c6b0 con 0x7fe3b80ce7e0 2023-12-17T11:49:34.351 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:34.349+0000 7fe3b6ffd640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fe3b815af50 0x7fe3b806c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:34.351 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:34.349+0000 7fe3b6ffd640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fe3b815af50 0x7fe3b806c170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:38846/0 (socket says 172.21.15.40:38846) 2023-12-17T11:49:34.351 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:34.349+0000 7fe3b6ffd640 1 -- 172.21.15.40:0/2731865971 learned_addr learned my addr 172.21.15.40:0/2731865971 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-17T11:49:34.352 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:34.349+0000 7fe3b67fc640 1 --2- 172.21.15.40:0/2731865971 >> v2:172.21.15.159:3300/0 conn(0x7fe3b80ce7e0 0x7fe3b815ec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:34.352 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:34.349+0000 7fe3b6ffd640 1 -- 172.21.15.40:0/2731865971 >> v2:172.21.15.159:3300/0 conn(0x7fe3b80ce7e0 msgr2=0x7fe3b815ec00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:49:34.352 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:34.349+0000 7fe3b6ffd640 1 --2- 172.21.15.40:0/2731865971 >> v2:172.21.15.159:3300/0 conn(0x7fe3b80ce7e0 0x7fe3b815ec00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:34.352 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:34.349+0000 7fe3b6ffd640 1 -- 172.21.15.40:0/2731865971 >> v1:172.21.15.159:6789/0 conn(0x7fe3b806a460 legacy=0x7fe3b80ccc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:49:34.352 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:34.349+0000 7fe3b6ffd640 1 -- 172.21.15.40:0/2731865971 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3b80719f0 con 0x7fe3b815af50 2023-12-17T11:49:34.352 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:34.351+0000 7fe3b6ffd640 1 --2- 172.21.15.40:0/2731865971 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe3b815af50 0x7fe3b806c170 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fe3b809d070 tx=0x7fe3a802b7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c35579a533f7f18c server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:49:34.353 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:34.351+0000 7fe3b5ffb640 1 -- 172.21.15.40:0/2731865971 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3a8031750 con 0x7fe3b815af50 2023-12-17T11:49:34.353 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:34.351+0000 7fe3b5ffb640 1 -- 172.21.15.40:0/2731865971 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3a80318b0 con 0x7fe3b815af50 2023-12-17T11:49:34.353 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:34.351+0000 7fe3b5ffb640 1 -- 172.21.15.40:0/2731865971 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3a8031c40 con 0x7fe3b815af50 2023-12-17T11:49:34.354 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:34.352+0000 7fe3bd561640 1 -- 172.21.15.40:0/2731865971 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe3b815af50 msgr2=0x7fe3b806c170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:34.354 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:34.352+0000 7fe3bd561640 1 --2- 172.21.15.40:0/2731865971 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe3b815af50 0x7fe3b806c170 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fe3b809d070 tx=0x7fe3a802b7f0 comp rx=0 tx=0).stop 2023-12-17T11:49:34.354 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:34.352+0000 7fe3bd561640 1 -- 172.21.15.40:0/2731865971 shutdown_connections 2023-12-17T11:49:34.354 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:34.352+0000 7fe3bd561640 1 --2- 172.21.15.40:0/2731865971 >> v2:172.21.15.159:3300/0 conn(0x7fe3b80ce7e0 0x7fe3b815ec00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:34.355 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:34.352+0000 7fe3bd561640 1 --2- 172.21.15.40:0/2731865971 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe3b815af50 0x7fe3b806c170 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:34.355 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:34.352+0000 7fe3bd561640 1 -- 172.21.15.40:0/2731865971 >> 172.21.15.40:0/2731865971 conn(0x7fe3b80cee70 msgr2=0x7fe3b80cf280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:49:34.355 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:34.352+0000 7fe3bd561640 1 -- 172.21.15.40:0/2731865971 shutdown_connections 2023-12-17T11:49:34.355 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:34.352+0000 7fe3bd561640 1 -- 172.21.15.40:0/2731865971 wait complete. 2023-12-17T11:49:34.356 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:34.354+0000 7fe3bd561640 1 Processor -- start 2023-12-17T11:49:34.356 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:34.355+0000 7fe3bd561640 1 -- start start 2023-12-17T11:49:34.358 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:34.356+0000 7fe3bd561640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe3b806a460 0x7fe3b8155650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:34.358 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:34.356+0000 7fe3bd561640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe3b80ce7e0 0x7fe3b81e4a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:34.358 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:34.356+0000 7fe3bd561640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe3b815af50 0x7fe3b80c4150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:34.358 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:34.356+0000 7fe3bd561640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3b80c4eb0 con 0x7fe3b80ce7e0 2023-12-17T11:49:34.358 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:34.356+0000 7fe3bd561640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3b8155b90 con 0x7fe3b806a460 2023-12-17T11:49:34.358 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:34.356+0000 7fe3bd561640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3b80c4bd0 con 0x7fe3b815af50 2023-12-17T11:49:34.360 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:34.357+0000 7fe3b6ffd640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe3b806a460 0x7fe3b8155650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:34.360 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:34.357+0000 7fe3b67fc640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe3b80ce7e0 0x7fe3b81e4a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:34.360 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:34.357+0000 7fe3b6ffd640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe3b806a460 0x7fe3b8155650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.40:53978/0 (socket says 172.21.15.40:53978) 2023-12-17T11:49:34.360 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:34.357+0000 7fe3b67fc640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe3b80ce7e0 0x7fe3b81e4a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:38850/0 (socket says 172.21.15.40:38850) 2023-12-17T11:49:34.360 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:34.357+0000 7fe3b6ffd640 1 -- 172.21.15.40:0/1979690120 learned_addr learned my addr 172.21.15.40:0/1979690120 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-17T11:49:34.360 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:34.357+0000 7fe3b77fe640 1 --2- 172.21.15.40:0/1979690120 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe3b815af50 0x7fe3b80c4150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:34.360 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:34.357+0000 7fe3b67fc640 1 -- 172.21.15.40:0/1979690120 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe3b815af50 msgr2=0x7fe3b80c4150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:34.360 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:34.357+0000 7fe3b67fc640 1 --2- 172.21.15.40:0/1979690120 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe3b815af50 0x7fe3b80c4150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:34.360 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:34.357+0000 7fe3b67fc640 1 -- 172.21.15.40:0/1979690120 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe3b806a460 msgr2=0x7fe3b8155650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:34.360 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:34.357+0000 7fe3b67fc640 1 --2- 172.21.15.40:0/1979690120 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe3b806a460 0x7fe3b8155650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:34.360 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:34.357+0000 7fe3b67fc640 1 -- 172.21.15.40:0/1979690120 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3a80094d0 con 0x7fe3b80ce7e0 2023-12-17T11:49:34.361 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:34.357+0000 7fe3b67fc640 1 --2- 172.21.15.40:0/1979690120 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe3b80ce7e0 0x7fe3b81e4a00 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fe3a000d5f0 tx=0x7fe3a000dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:49:34.361 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:34.358+0000 7fe3af7fe640 1 -- 172.21.15.40:0/1979690120 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3a00125f0 con 0x7fe3b80ce7e0 2023-12-17T11:49:34.361 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:34.358+0000 7fe3af7fe640 1 -- 172.21.15.40:0/1979690120 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3a0012750 con 0x7fe3b80ce7e0 2023-12-17T11:49:34.361 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:34.358+0000 7fe3bd561640 1 -- 172.21.15.40:0/1979690120 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3b80c7120 con 0x7fe3b80ce7e0 2023-12-17T11:49:34.361 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:34.358+0000 7fe3af7fe640 1 -- 172.21.15.40:0/1979690120 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3a0012b00 con 0x7fe3b80ce7e0 2023-12-17T11:49:34.361 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:34.358+0000 7fe3bd561640 1 -- 172.21.15.40:0/1979690120 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3b80c76e0 con 0x7fe3b80ce7e0 2023-12-17T11:49:34.361 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:34.359+0000 7fe3bd561640 1 -- 172.21.15.40:0/1979690120 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3b80c78a0 con 0x7fe3b80ce7e0 2023-12-17T11:49:34.362 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:34.360+0000 7fe3af7fe640 1 -- 172.21.15.40:0/1979690120 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fe3a0012c60 con 0x7fe3b80ce7e0 2023-12-17T11:49:34.363 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:34.361+0000 7fe3af7fe640 1 --2- 172.21.15.40:0/1979690120 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7fe39806ae40 0x7fe39806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:34.363 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:34.361+0000 7fe3af7fe640 1 -- 172.21.15.40:0/1979690120 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6692+0+0 (secure 0 0 0) 0x7fe3a0089e00 con 0x7fe3b80ce7e0 2023-12-17T11:49:34.363 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:34.362+0000 7fe3b6ffd640 1 --2- 172.21.15.40:0/1979690120 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7fe39806ae40 0x7fe39806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:34.365 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:34.363+0000 7fe3b6ffd640 1 --2- 172.21.15.40:0/1979690120 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7fe39806ae40 0x7fe39806d300 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fe3a802b830 tx=0x7fe3a8008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:49:34.368 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:34.366+0000 7fe3af7fe640 1 -- 172.21.15.40:0/1979690120 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fe3a0054ae0 con 0x7fe3b80ce7e0 2023-12-17T11:49:34.563 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:34.561+0000 7fe3bd561640 1 -- 172.21.15.40:0/1979690120 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fe3b80c6f80 con 0x7fe3b80ce7e0 2023-12-17T11:49:34.564 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:34.562+0000 7fe3af7fe640 1 -- 172.21.15.40:0/1979690120 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) v1 ==== 93+0+10 (secure 0 0 0) 0x7fe3b80c6f80 con 0x7fe3b80ce7e0 2023-12-17T11:49:34.565 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 1 2023-12-17T11:49:34.567 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:34.564+0000 7fe3bd561640 1 -- 172.21.15.40:0/1979690120 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7fe39806ae40 msgr2=0x7fe39806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:34.567 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:34.564+0000 7fe3bd561640 1 --2- 172.21.15.40:0/1979690120 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7fe39806ae40 0x7fe39806d300 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fe3a802b830 tx=0x7fe3a8008030 comp rx=0 tx=0).stop 2023-12-17T11:49:34.567 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:34.565+0000 7fe3bd561640 1 -- 172.21.15.40:0/1979690120 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe3b80ce7e0 msgr2=0x7fe3b81e4a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:34.567 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:34.565+0000 7fe3bd561640 1 --2- 172.21.15.40:0/1979690120 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe3b80ce7e0 0x7fe3b81e4a00 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fe3a000d5f0 tx=0x7fe3a000dab0 comp rx=0 tx=0).stop 2023-12-17T11:49:34.567 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:34.565+0000 7fe3bd561640 1 -- 172.21.15.40:0/1979690120 shutdown_connections 2023-12-17T11:49:34.567 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:34.565+0000 7fe3bd561640 1 --2- 172.21.15.40:0/1979690120 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7fe39806ae40 0x7fe39806d300 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:34.567 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:34.565+0000 7fe3bd561640 1 --2- 172.21.15.40:0/1979690120 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe3b815af50 0x7fe3b80c4150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:34.568 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:34.565+0000 7fe3bd561640 1 --2- 172.21.15.40:0/1979690120 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe3b80ce7e0 0x7fe3b81e4a00 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:34.568 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:34.565+0000 7fe3bd561640 1 --2- 172.21.15.40:0/1979690120 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe3b806a460 0x7fe3b8155650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:34.568 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:34.565+0000 7fe3bd561640 1 -- 172.21.15.40:0/1979690120 >> 172.21.15.40:0/1979690120 conn(0x7fe3b80cee70 msgr2=0x7fe3b806c7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:49:34.568 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:34.565+0000 7fe3bd561640 1 -- 172.21.15.40:0/1979690120 shutdown_connections 2023-12-17T11:49:34.568 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:34.565+0000 7fe3bd561640 1 -- 172.21.15.40:0/1979690120 wait complete. 2023-12-17T11:49:34.584 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-17T11:49:34.806 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:34.804+0000 7ff898f9e640 1 Processor -- start 2023-12-17T11:49:34.807 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:34.805+0000 7ff898f9e640 1 -- start start 2023-12-17T11:49:34.808 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:34.806+0000 7ff898f9e640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff8940cb5b0 0x7ff89406c130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:34.808 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:34.806+0000 7ff898f9e640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7ff894070c60 0x7ff8940710c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:34.808 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:34.806+0000 7ff898f9e640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff89406c770 con 0x7ff8940cb990 2023-12-17T11:49:34.808 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:34.806+0000 7ff898f9e640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff89406ca50 con 0x7ff894070c60 2023-12-17T11:49:34.808 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:34.806+0000 7ff898f9e640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff89406cd30 con 0x7ff8940cb5b0 2023-12-17T11:49:34.810 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:34.807+0000 7ff8937fe640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff8940cb5b0 0x7ff89406c130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:34.810 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:34.807+0000 7ff8937fe640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff8940cb5b0 0x7ff89406c130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3301/0 says I am v2:172.21.15.40:50324/0 (socket says 172.21.15.40:50324) 2023-12-17T11:49:34.810 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:34.807+0000 7ff8937fe640 1 -- 172.21.15.40:0/3058362992 learned_addr learned my addr 172.21.15.40:0/3058362992 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-17T11:49:34.810 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:34.807+0000 7ff893fff640 1 --2- 172.21.15.40:0/3058362992 >> v2:172.21.15.159:3300/0 conn(0x7ff894070c60 0x7ff8940710c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:34.810 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:34.807+0000 7ff8937fe640 1 -- 172.21.15.40:0/3058362992 >> v2:172.21.15.159:3300/0 conn(0x7ff894070c60 msgr2=0x7ff8940710c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:49:34.810 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:34.807+0000 7ff8937fe640 1 --2- 172.21.15.40:0/3058362992 >> v2:172.21.15.159:3300/0 conn(0x7ff894070c60 0x7ff8940710c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:34.810 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:34.807+0000 7ff8937fe640 1 -- 172.21.15.40:0/3058362992 >> v1:172.21.15.159:6789/0 conn(0x7ff8940cb990 legacy=0x7ff89415f510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:34.810 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:34.807+0000 7ff8937fe640 1 -- 172.21.15.40:0/3058362992 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff89406d010 con 0x7ff8940cb5b0 2023-12-17T11:49:34.811 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:34.807+0000 7ff8927fc640 1 -- 172.21.15.40:0/3058362992 <== mon.1 v1:172.21.15.159:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1253767089 0 0) 0x7ff89406c770 con 0x7ff8940cb990 2023-12-17T11:49:34.812 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:34.809+0000 7ff8937fe640 1 --2- 172.21.15.40:0/3058362992 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff8940cb5b0 0x7ff89406c130 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7ff884009870 tx=0x7ff88402b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=831c94f1067cb2b2 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:49:34.813 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:34.809+0000 7ff8927fc640 1 -- 172.21.15.40:0/3058362992 <== mon.2 v2:172.21.15.159:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff884030840 con 0x7ff8940cb5b0 2023-12-17T11:49:34.813 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:34.809+0000 7ff8927fc640 1 -- 172.21.15.40:0/3058362992 <== mon.2 v2:172.21.15.159:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8840309a0 con 0x7ff8940cb5b0 2023-12-17T11:49:34.813 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:34.809+0000 7ff8927fc640 1 -- 172.21.15.40:0/3058362992 <== mon.2 v2:172.21.15.159:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff884030d30 con 0x7ff8940cb5b0 2023-12-17T11:49:34.813 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:34.810+0000 7ff898f9e640 1 -- 172.21.15.40:0/3058362992 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff8940cb5b0 msgr2=0x7ff89406c130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:34.813 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:34.810+0000 7ff898f9e640 1 --2- 172.21.15.40:0/3058362992 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff8940cb5b0 0x7ff89406c130 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7ff884009870 tx=0x7ff88402b980 comp rx=0 tx=0).stop 2023-12-17T11:49:34.813 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:34.810+0000 7ff898f9e640 1 -- 172.21.15.40:0/3058362992 shutdown_connections 2023-12-17T11:49:34.813 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:34.810+0000 7ff898f9e640 1 --2- 172.21.15.40:0/3058362992 >> v2:172.21.15.159:3300/0 conn(0x7ff894070c60 0x7ff8940710c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:34.813 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:34.810+0000 7ff898f9e640 1 --2- 172.21.15.40:0/3058362992 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff8940cb5b0 0x7ff89406c130 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:34.813 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:34.810+0000 7ff898f9e640 1 -- 172.21.15.40:0/3058362992 >> 172.21.15.40:0/3058362992 conn(0x7ff8940b0940 msgr2=0x7ff8940b0d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:49:34.814 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:34.810+0000 7ff898f9e640 1 -- 172.21.15.40:0/3058362992 shutdown_connections 2023-12-17T11:49:34.814 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:34.810+0000 7ff898f9e640 1 -- 172.21.15.40:0/3058362992 wait complete. 2023-12-17T11:49:34.817 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:34.812+0000 7ff898f9e640 1 Processor -- start 2023-12-17T11:49:34.817 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:34.812+0000 7ff898f9e640 1 -- start start 2023-12-17T11:49:34.817 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:34.813+0000 7ff898f9e640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff894070c60 0x7ff8940c7fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:34.817 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:34.813+0000 7ff898f9e640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff8940cb5b0 0x7ff8940af2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:34.817 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:34.813+0000 7ff898f9e640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff8940cb990 0x7ff89415a330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:34.817 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:34.813+0000 7ff898f9e640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8941f3e40 con 0x7ff894070c60 2023-12-17T11:49:34.817 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:34.813+0000 7ff898f9e640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8941f32c0 con 0x7ff8940cb990 2023-12-17T11:49:34.817 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:34.813+0000 7ff898f9e640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8941f35a0 con 0x7ff8940cb5b0 2023-12-17T11:49:34.818 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:34.813+0000 7ff8937fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff894070c60 0x7ff8940c7fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:34.818 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:34.813+0000 7ff8937fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff894070c60 0x7ff8940c7fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:38854/0 (socket says 172.21.15.40:38854) 2023-12-17T11:49:34.818 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:34.813+0000 7ff8937fe640 1 -- 172.21.15.40:0/3538768052 learned_addr learned my addr 172.21.15.40:0/3538768052 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-17T11:49:34.818 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:34.813+0000 7ff893fff640 1 --2- 172.21.15.40:0/3538768052 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff8940cb990 0x7ff89415a330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:34.818 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:34.814+0000 7ff892ffd640 1 --2- 172.21.15.40:0/3538768052 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff8940cb5b0 0x7ff8940af2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:34.818 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:34.814+0000 7ff8937fe640 1 -- 172.21.15.40:0/3538768052 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff8940cb5b0 msgr2=0x7ff8940af2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:34.818 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:34.814+0000 7ff8937fe640 1 --2- 172.21.15.40:0/3538768052 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff8940cb5b0 0x7ff8940af2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:34.818 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:34.814+0000 7ff8937fe640 1 -- 172.21.15.40:0/3538768052 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff8940cb990 msgr2=0x7ff89415a330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:34.819 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:34.814+0000 7ff8937fe640 1 --2- 172.21.15.40:0/3538768052 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff8940cb990 0x7ff89415a330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:34.819 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:34.814+0000 7ff8937fe640 1 -- 172.21.15.40:0/3538768052 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8840094d0 con 0x7ff894070c60 2023-12-17T11:49:34.819 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:34.814+0000 7ff8937fe640 1 --2- 172.21.15.40:0/3538768052 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff894070c60 0x7ff8940c7fc0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7ff8840090b0 tx=0x7ff884004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:49:34.819 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:34.814+0000 7ff87bfff640 1 -- 172.21.15.40:0/3538768052 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff884039c10 con 0x7ff894070c60 2023-12-17T11:49:34.819 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:34.814+0000 7ff87bfff640 1 -- 172.21.15.40:0/3538768052 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff884039d70 con 0x7ff894070c60 2023-12-17T11:49:34.819 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:34.814+0000 7ff87bfff640 1 -- 172.21.15.40:0/3538768052 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff884004250 con 0x7ff894070c60 2023-12-17T11:49:34.819 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:34.814+0000 7ff898f9e640 1 -- 172.21.15.40:0/3538768052 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8941f3880 con 0x7ff894070c60 2023-12-17T11:49:34.820 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:34.815+0000 7ff898f9e640 1 -- 172.21.15.40:0/3538768052 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8941f2eb0 con 0x7ff894070c60 2023-12-17T11:49:34.821 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:34.816+0000 7ff898f9e640 1 -- 172.21.15.40:0/3538768052 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff894067910 con 0x7ff894070c60 2023-12-17T11:49:34.821 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:34.816+0000 7ff87bfff640 1 -- 172.21.15.40:0/3538768052 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ff8840043b0 con 0x7ff894070c60 2023-12-17T11:49:34.821 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:34.817+0000 7ff87bfff640 1 --2- 172.21.15.40:0/3538768052 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7ff88006ae70 0x7ff88006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:34.821 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:34.817+0000 7ff87bfff640 1 -- 172.21.15.40:0/3538768052 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6692+0+0 (secure 0 0 0) 0x7ff88403e070 con 0x7ff894070c60 2023-12-17T11:49:34.821 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:34.818+0000 7ff892ffd640 1 --2- 172.21.15.40:0/3538768052 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7ff88006ae70 0x7ff88006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:34.822 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:34.819+0000 7ff892ffd640 1 --2- 172.21.15.40:0/3538768052 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7ff88006ae70 0x7ff88006d330 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7ff8940717e0 tx=0x7ff888009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:49:34.825 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:34.822+0000 7ff87bfff640 1 -- 172.21.15.40:0/3538768052 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7ff884076a70 con 0x7ff894070c60 2023-12-17T11:49:35.018 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:35.016+0000 7ff898f9e640 1 -- 172.21.15.40:0/3538768052 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7ff8940b1db0 con 0x7ff894070c60 2023-12-17T11:49:35.019 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:35.017+0000 7ff87bfff640 1 -- 172.21.15.40:0/3538768052 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) v1 ==== 104+0+11 (secure 0 0 0) 0x7ff8940b1db0 con 0x7ff894070c60 2023-12-17T11:49:35.019 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 32 2023-12-17T11:49:35.021 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:35.019+0000 7ff898f9e640 1 -- 172.21.15.40:0/3538768052 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7ff88006ae70 msgr2=0x7ff88006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:35.021 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:35.019+0000 7ff898f9e640 1 --2- 172.21.15.40:0/3538768052 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7ff88006ae70 0x7ff88006d330 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7ff8940717e0 tx=0x7ff888009040 comp rx=0 tx=0).stop 2023-12-17T11:49:35.021 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:35.019+0000 7ff898f9e640 1 -- 172.21.15.40:0/3538768052 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff894070c60 msgr2=0x7ff8940c7fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:35.021 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:35.019+0000 7ff898f9e640 1 --2- 172.21.15.40:0/3538768052 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff894070c60 0x7ff8940c7fc0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7ff8840090b0 tx=0x7ff884004730 comp rx=0 tx=0).stop 2023-12-17T11:49:35.021 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:35.019+0000 7ff898f9e640 1 -- 172.21.15.40:0/3538768052 shutdown_connections 2023-12-17T11:49:35.022 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:35.019+0000 7ff898f9e640 1 --2- 172.21.15.40:0/3538768052 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7ff88006ae70 0x7ff88006d330 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:35.022 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:35.019+0000 7ff898f9e640 1 --2- 172.21.15.40:0/3538768052 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff8940cb990 0x7ff89415a330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:35.022 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:35.019+0000 7ff898f9e640 1 --2- 172.21.15.40:0/3538768052 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff8940cb5b0 0x7ff8940af2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:35.022 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:35.019+0000 7ff898f9e640 1 --2- 172.21.15.40:0/3538768052 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff894070c60 0x7ff8940c7fc0 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:35.022 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:35.019+0000 7ff898f9e640 1 -- 172.21.15.40:0/3538768052 >> 172.21.15.40:0/3538768052 conn(0x7ff8940b0940 msgr2=0x7ff894072ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:49:35.022 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:35.019+0000 7ff898f9e640 1 -- 172.21.15.40:0/3538768052 shutdown_connections 2023-12-17T11:49:35.022 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:35.019+0000 7ff898f9e640 1 -- 172.21.15.40:0/3538768052 wait complete. 2023-12-17T11:49:35.041 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-17T11:49:35.267 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:35.265+0000 7fb46b23d640 1 Processor -- start 2023-12-17T11:49:35.267 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:35.265+0000 7fb46b23d640 1 -- start start 2023-12-17T11:49:35.271 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:35.267+0000 7fb46b23d640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb464072210 0x7fb464161530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:35.271 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:35.267+0000 7fb46b23d640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb464160dc0 con 0x7fb464161a70 2023-12-17T11:49:35.272 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:35.267+0000 7fb46b23d640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4640ceab0 con 0x7fb46415d0e0 2023-12-17T11:49:35.272 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:35.267+0000 7fb46b23d640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb464070280 con 0x7fb464072210 2023-12-17T11:49:35.272 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:35.267+0000 7fb4697da640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fb464161a70 0x7fb4640c92e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:39734/0 (socket says 172.21.15.40:39734) 2023-12-17T11:49:35.272 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:35.267+0000 7fb4697da640 1 -- 172.21.15.40:0/4229742480 learned_addr learned my addr 172.21.15.40:0/4229742480 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-12-17T11:49:35.272 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:35.267+0000 7fb463fff640 1 --2- 172.21.15.40:0/4229742480 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb464072210 0x7fb464161530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:35.272 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:35.268+0000 7fb4637fe640 1 -- 172.21.15.40:0/4229742480 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2908804047 0 0) 0x7fb464160dc0 con 0x7fb464161a70 2023-12-17T11:49:35.272 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:35.268+0000 7fb4637fe640 1 -- 172.21.15.40:0/4229742480 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb454003520 con 0x7fb464161a70 2023-12-17T11:49:35.272 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:35.268+0000 7fb4637fe640 1 -- 172.21.15.40:0/4229742480 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2563076687 0 0) 0x7fb454003520 con 0x7fb464161a70 2023-12-17T11:49:35.272 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:35.268+0000 7fb4637fe640 1 -- 172.21.15.40:0/4229742480 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb464072210 msgr2=0x7fb464161530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:49:35.272 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:35.268+0000 7fb4637fe640 1 --2- 172.21.15.40:0/4229742480 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb464072210 0x7fb464161530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:35.272 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:35.268+0000 7fb4637fe640 1 -- 172.21.15.40:0/4229742480 >> v1:172.21.15.159:6789/0 conn(0x7fb46415d0e0 legacy=0x7fb4640ce3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:35.272 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:35.268+0000 7fb4637fe640 1 -- 172.21.15.40:0/4229742480 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb464070560 con 0x7fb464161a70 2023-12-17T11:49:35.272 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:35.268+0000 7fb4637fe640 1 -- 172.21.15.40:0/4229742480 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2643242555 0 0) 0x7fb45c0019f0 con 0x7fb464161a70 2023-12-17T11:49:35.272 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:35.268+0000 7fb4637fe640 1 -- 172.21.15.40:0/4229742480 >> v1:172.21.15.40:6789/0 conn(0x7fb464161a70 legacy=0x7fb4640c92e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:35.273 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:35.268+0000 7fb4637fe640 1 --2- 172.21.15.40:0/4229742480 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb464072210 0x7fb4540039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:35.273 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:35.268+0000 7fb4637fe640 1 --2- 172.21.15.40:0/4229742480 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb454003f70 0x7fb4540047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:35.273 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:35.268+0000 7fb4637fe640 1 --2- 172.21.15.40:0/4229742480 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb454004d00 0x7fb454005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:35.273 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:35.268+0000 7fb4637fe640 1 -- 172.21.15.40:0/4229742480 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb464070280 con 0x7fb454004d00 2023-12-17T11:49:35.273 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:35.268+0000 7fb4637fe640 1 -- 172.21.15.40:0/4229742480 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb45400bac0 con 0x7fb454003f70 2023-12-17T11:49:35.273 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:35.268+0000 7fb4637fe640 1 -- 172.21.15.40:0/4229742480 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb45400bc80 con 0x7fb464072210 2023-12-17T11:49:35.273 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:35.268+0000 7fb4697da640 1 --2- 172.21.15.40:0/4229742480 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb454004d00 0x7fb454005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:35.273 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:35.269+0000 7fb468fd9640 1 --2- 172.21.15.40:0/4229742480 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb464072210 0x7fb4540039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:35.273 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:35.269+0000 7fb463fff640 1 --2- 172.21.15.40:0/4229742480 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb454003f70 0x7fb4540047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:35.273 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:35.269+0000 7fb4697da640 1 -- 172.21.15.40:0/4229742480 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb464072210 msgr2=0x7fb4540039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:49:35.273 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:35.269+0000 7fb4697da640 1 --2- 172.21.15.40:0/4229742480 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb464072210 0x7fb4540039a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:35.273 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:35.269+0000 7fb4697da640 1 -- 172.21.15.40:0/4229742480 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb454003f70 msgr2=0x7fb4540047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:49:35.273 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:35.269+0000 7fb4697da640 1 --2- 172.21.15.40:0/4229742480 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb454003f70 0x7fb4540047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:35.274 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:35.269+0000 7fb4697da640 1 -- 172.21.15.40:0/4229742480 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb454003520 con 0x7fb454004d00 2023-12-17T11:49:35.274 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:35.269+0000 7fb463fff640 1 --2- 172.21.15.40:0/4229742480 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb454003f70 0x7fb4540047c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-17T11:49:35.275 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:35.270+0000 7fb4697da640 1 --2- 172.21.15.40:0/4229742480 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb454004d00 0x7fb454005180 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fb4640c5d10 tx=0x7fb4540057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=319061ab35b97fd server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:49:35.275 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:35.270+0000 7fb4637fe640 1 -- 172.21.15.40:0/4229742480 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb45c034630 con 0x7fb454004d00 2023-12-17T11:49:35.275 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:35.270+0000 7fb4637fe640 1 -- 172.21.15.40:0/4229742480 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb45c02f070 con 0x7fb454004d00 2023-12-17T11:49:35.275 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:35.270+0000 7fb4637fe640 1 -- 172.21.15.40:0/4229742480 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb45c034a50 con 0x7fb454004d00 2023-12-17T11:49:35.275 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:35.271+0000 7fb46b23d640 1 -- 172.21.15.40:0/4229742480 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb454004d00 msgr2=0x7fb454005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:35.275 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:35.271+0000 7fb46b23d640 1 --2- 172.21.15.40:0/4229742480 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb454004d00 0x7fb454005180 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fb4640c5d10 tx=0x7fb4540057f0 comp rx=0 tx=0).stop 2023-12-17T11:49:35.275 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:35.271+0000 7fb4697da640 1 -- 172.21.15.40:0/4229742480 reap_dead start 2023-12-17T11:49:35.276 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:35.271+0000 7fb46b23d640 1 -- 172.21.15.40:0/4229742480 shutdown_connections 2023-12-17T11:49:35.276 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:35.271+0000 7fb46b23d640 1 -- 172.21.15.40:0/4229742480 >> 172.21.15.40:0/4229742480 conn(0x7fb4640cee70 msgr2=0x7fb4640cf280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:49:35.276 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:35.271+0000 7fb46b23d640 1 -- 172.21.15.40:0/4229742480 shutdown_connections 2023-12-17T11:49:35.276 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:35.271+0000 7fb46b23d640 1 -- 172.21.15.40:0/4229742480 wait complete. 2023-12-17T11:49:35.276 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:35.273+0000 7fb46b23d640 1 Processor -- start 2023-12-17T11:49:35.276 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:35.273+0000 7fb46b23d640 1 -- start start 2023-12-17T11:49:35.278 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:35.274+0000 7fb46b23d640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb464155990 0x7fb4640af4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:35.278 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:35.274+0000 7fb46b23d640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb464156090 0x7fb4640afa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:35.278 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:35.274+0000 7fb46b23d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb4640ae030 0x7fb4640c5d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:35.278 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:35.274+0000 7fb46b23d640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4640ad270 con 0x7fb4640ae030 2023-12-17T11:49:35.278 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:35.274+0000 7fb46b23d640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4640ad550 con 0x7fb464156090 2023-12-17T11:49:35.278 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:35.274+0000 7fb46b23d640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4640ad830 con 0x7fb464155990 2023-12-17T11:49:35.278 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:35.274+0000 7fb4697da640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb4640ae030 0x7fb4640c5d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:35.278 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:35.275+0000 7fb4697da640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb4640ae030 0x7fb4640c5d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:36840/0 (socket says 172.21.15.40:36840) 2023-12-17T11:49:35.278 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:35.275+0000 7fb4697da640 1 -- 172.21.15.40:0/2819074235 learned_addr learned my addr 172.21.15.40:0/2819074235 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-17T11:49:35.278 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:35.275+0000 7fb468fd9640 1 --2- 172.21.15.40:0/2819074235 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb464155990 0x7fb4640af4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:35.278 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:35.275+0000 7fb463fff640 1 --2- 172.21.15.40:0/2819074235 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb464156090 0x7fb4640afa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:35.279 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:35.275+0000 7fb4697da640 1 -- 172.21.15.40:0/2819074235 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb464155990 msgr2=0x7fb4640af4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:35.279 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:35.275+0000 7fb4697da640 1 --2- 172.21.15.40:0/2819074235 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb464155990 0x7fb4640af4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:35.279 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:35.275+0000 7fb4697da640 1 -- 172.21.15.40:0/2819074235 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb464156090 msgr2=0x7fb4640afa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:35.279 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:35.275+0000 7fb4697da640 1 --2- 172.21.15.40:0/2819074235 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb464156090 0x7fb4640afa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:35.279 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:35.275+0000 7fb4697da640 1 -- 172.21.15.40:0/2819074235 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4640adb10 con 0x7fb4640ae030 2023-12-17T11:49:35.279 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:35.275+0000 7fb4697da640 1 --2- 172.21.15.40:0/2819074235 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb4640ae030 0x7fb4640c5d60 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fb45c00a850 tx=0x7fb45c001cb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:49:35.279 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:35.276+0000 7fb4617fa640 1 -- 172.21.15.40:0/2819074235 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb45c034840 con 0x7fb4640ae030 2023-12-17T11:49:35.279 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:35.276+0000 7fb4617fa640 1 -- 172.21.15.40:0/2819074235 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb45c0349a0 con 0x7fb4640ae030 2023-12-17T11:49:35.279 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:35.276+0000 7fb4617fa640 1 -- 172.21.15.40:0/2819074235 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb45c034d10 con 0x7fb4640ae030 2023-12-17T11:49:35.279 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:35.276+0000 7fb46b23d640 1 -- 172.21.15.40:0/2819074235 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb464156730 con 0x7fb4640ae030 2023-12-17T11:49:35.279 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:35.276+0000 7fb46b23d640 1 -- 172.21.15.40:0/2819074235 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb464155d70 con 0x7fb4640ae030 2023-12-17T11:49:35.280 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:35.277+0000 7fb46b23d640 1 -- 172.21.15.40:0/2819074235 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb4640acfe0 con 0x7fb4640ae030 2023-12-17T11:49:35.280 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:35.278+0000 7fb4617fa640 1 -- 172.21.15.40:0/2819074235 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fb45c031030 con 0x7fb4640ae030 2023-12-17T11:49:35.281 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:35.279+0000 7fb4617fa640 1 --2- 172.21.15.40:0/2819074235 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7fb44806ae70 0x7fb44806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:35.281 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:35.279+0000 7fb4617fa640 1 -- 172.21.15.40:0/2819074235 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6692+0+0 (secure 0 0 0) 0x7fb45c0abe90 con 0x7fb4640ae030 2023-12-17T11:49:35.281 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:35.280+0000 7fb468fd9640 1 --2- 172.21.15.40:0/2819074235 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7fb44806ae70 0x7fb44806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:35.282 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:35.281+0000 7fb468fd9640 1 --2- 172.21.15.40:0/2819074235 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7fb44806ae70 0x7fb44806d330 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fb458007fd0 tx=0x7fb458009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:49:35.285 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:35.283+0000 7fb4617fa640 1 -- 172.21.15.40:0/2819074235 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fb45c076be0 con 0x7fb4640ae030 2023-12-17T11:49:35.481 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:35.479+0000 7fb46b23d640 1 -- 172.21.15.40:0/2819074235 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fb4640acfe0 con 0x7fb4640ae030 2023-12-17T11:49:35.482 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:35.480+0000 7fb4617fa640 1 -- 172.21.15.40:0/2819074235 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) v1 ==== 100+0+11 (secure 0 0 0) 0x7fb45c0ad020 con 0x7fb4640ae030 2023-12-17T11:49:35.482 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 64 2023-12-17T11:49:35.485 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:35.483+0000 7fb46b23d640 1 -- 172.21.15.40:0/2819074235 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7fb44806ae70 msgr2=0x7fb44806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:35.485 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:35.483+0000 7fb46b23d640 1 --2- 172.21.15.40:0/2819074235 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7fb44806ae70 0x7fb44806d330 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fb458007fd0 tx=0x7fb458009040 comp rx=0 tx=0).stop 2023-12-17T11:49:35.485 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:35.483+0000 7fb46b23d640 1 -- 172.21.15.40:0/2819074235 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb4640ae030 msgr2=0x7fb4640c5d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:35.485 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:35.483+0000 7fb46b23d640 1 --2- 172.21.15.40:0/2819074235 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb4640ae030 0x7fb4640c5d60 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fb45c00a850 tx=0x7fb45c001cb0 comp rx=0 tx=0).stop 2023-12-17T11:49:35.485 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:35.483+0000 7fb46b23d640 1 -- 172.21.15.40:0/2819074235 shutdown_connections 2023-12-17T11:49:35.485 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:35.483+0000 7fb46b23d640 1 --2- 172.21.15.40:0/2819074235 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7fb44806ae70 0x7fb44806d330 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:35.485 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:35.483+0000 7fb46b23d640 1 --2- 172.21.15.40:0/2819074235 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb4640ae030 0x7fb4640c5d60 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:35.485 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:35.483+0000 7fb46b23d640 1 --2- 172.21.15.40:0/2819074235 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb464156090 0x7fb4640afa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:35.485 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:35.483+0000 7fb46b23d640 1 --2- 172.21.15.40:0/2819074235 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb464155990 0x7fb4640af4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:35.485 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:35.483+0000 7fb46b23d640 1 -- 172.21.15.40:0/2819074235 >> 172.21.15.40:0/2819074235 conn(0x7fb4640cee70 msgr2=0x7fb4640cce20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:49:35.486 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:35.483+0000 7fb46b23d640 1 -- 172.21.15.40:0/2819074235 shutdown_connections 2023-12-17T11:49:35.486 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:35.483+0000 7fb46b23d640 1 -- 172.21.15.40:0/2819074235 wait complete. 2023-12-17T11:49:35.505 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-12-17T11:49:35.735 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:35.732+0000 7f3a6f59e640 1 Processor -- start 2023-12-17T11:49:35.735 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:35.733+0000 7f3a6f59e640 1 -- start start 2023-12-17T11:49:35.737 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:35.735+0000 7f3a6f59e640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f3a700cb5b0 0x7f3a7006c130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:35.737 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:35.735+0000 7f3a6f59e640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f3a700cb990 0x7f3a7015f510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:35.737 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:35.735+0000 7f3a6f59e640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f3a7015b250 0x7f3a7015b6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:35.737 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:35.735+0000 7f3a6f59e640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a7006c770 con 0x7f3a700cb990 2023-12-17T11:49:35.737 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:35.735+0000 7f3a6f59e640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a7006ca50 con 0x7f3a7015b250 2023-12-17T11:49:35.737 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:35.735+0000 7f3a6f59e640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a7006cd30 con 0x7f3a700cb5b0 2023-12-17T11:49:35.738 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:35.735+0000 7f3a67fff640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f3a700cb990 0x7f3a7015f510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:35.738 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:35.735+0000 7f3a67fff640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f3a700cb990 0x7f3a7015f510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:36844/0 (socket says 172.21.15.40:36844) 2023-12-17T11:49:35.738 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:35.735+0000 7f3a67fff640 1 -- 172.21.15.40:0/677573913 learned_addr learned my addr 172.21.15.40:0/677573913 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-17T11:49:35.738 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:35.735+0000 7f3a6e59c640 1 --2- 172.21.15.40:0/677573913 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f3a700cb5b0 0x7f3a7006c130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:35.738 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:35.736+0000 7f3a6ed9d640 1 --2- 172.21.15.40:0/677573913 >> v2:172.21.15.159:3300/0 conn(0x7f3a7015b250 0x7f3a7015b6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:35.738 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:35.736+0000 7f3a67fff640 1 -- 172.21.15.40:0/677573913 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f3a700cb5b0 msgr2=0x7f3a7006c130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:49:35.739 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:35.736+0000 7f3a67fff640 1 --2- 172.21.15.40:0/677573913 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f3a700cb5b0 0x7f3a7006c130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:35.739 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:35.736+0000 7f3a67fff640 1 -- 172.21.15.40:0/677573913 >> v2:172.21.15.159:3300/0 conn(0x7f3a7015b250 msgr2=0x7f3a7015b6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:49:35.739 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:35.736+0000 7f3a67fff640 1 --2- 172.21.15.40:0/677573913 >> v2:172.21.15.159:3300/0 conn(0x7f3a7015b250 0x7f3a7015b6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:35.739 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:35.736+0000 7f3a67fff640 1 -- 172.21.15.40:0/677573913 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a7006d010 con 0x7f3a700cb990 2023-12-17T11:49:35.739 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:35.736+0000 7f3a6ed9d640 1 --2- 172.21.15.40:0/677573913 >> v2:172.21.15.159:3300/0 conn(0x7f3a7015b250 0x7f3a7015b6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-17T11:49:35.739 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:35.736+0000 7f3a6e59c640 1 --2- 172.21.15.40:0/677573913 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f3a700cb5b0 0x7f3a7006c130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-17T11:49:35.740 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:35.737+0000 7f3a67fff640 1 --2- 172.21.15.40:0/677573913 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3a700cb990 0x7f3a7015f510 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f3a700ceb60 tx=0x7f3a5802b920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef034e54480da93b server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:49:35.740 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:35.737+0000 7f3a6dd9b640 1 -- 172.21.15.40:0/677573913 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a58031880 con 0x7f3a700cb990 2023-12-17T11:49:35.740 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:35.737+0000 7f3a6dd9b640 1 -- 172.21.15.40:0/677573913 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a580319e0 con 0x7f3a700cb990 2023-12-17T11:49:35.740 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:35.737+0000 7f3a6dd9b640 1 -- 172.21.15.40:0/677573913 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a58031d70 con 0x7f3a700cb990 2023-12-17T11:49:35.740 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:35.738+0000 7f3a6f59e640 1 -- 172.21.15.40:0/677573913 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3a700cb990 msgr2=0x7f3a7015f510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:35.741 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:35.738+0000 7f3a6f59e640 1 --2- 172.21.15.40:0/677573913 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3a700cb990 0x7f3a7015f510 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f3a700ceb60 tx=0x7f3a5802b920 comp rx=0 tx=0).stop 2023-12-17T11:49:35.741 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:35.738+0000 7f3a6f59e640 1 -- 172.21.15.40:0/677573913 shutdown_connections 2023-12-17T11:49:35.741 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:35.738+0000 7f3a6f59e640 1 --2- 172.21.15.40:0/677573913 >> v2:172.21.15.159:3300/0 conn(0x7f3a7015b250 0x7f3a7015b6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:35.741 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:35.738+0000 7f3a6f59e640 1 --2- 172.21.15.40:0/677573913 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3a700cb990 0x7f3a7015f510 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:35.741 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:35.738+0000 7f3a6f59e640 1 --2- 172.21.15.40:0/677573913 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f3a700cb5b0 0x7f3a7006c130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:35.741 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:35.738+0000 7f3a6f59e640 1 -- 172.21.15.40:0/677573913 >> 172.21.15.40:0/677573913 conn(0x7f3a700b0940 msgr2=0x7f3a700b0d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:49:35.741 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:35.738+0000 7f3a6f59e640 1 -- 172.21.15.40:0/677573913 shutdown_connections 2023-12-17T11:49:35.741 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:35.738+0000 7f3a6f59e640 1 -- 172.21.15.40:0/677573913 wait complete. 2023-12-17T11:49:35.742 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:35.740+0000 7f3a6f59e640 1 Processor -- start 2023-12-17T11:49:35.742 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:35.740+0000 7f3a6f59e640 1 -- start start 2023-12-17T11:49:35.744 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:35.741+0000 7f3a6f59e640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f3a700cb5b0 0x7f3a7014e470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:35.744 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:35.741+0000 7f3a6f59e640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3a700cb990 0x7f3a7014dde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:35.744 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:35.741+0000 7f3a6f59e640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3a7015b250 0x7f3a701f37c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:35.744 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:35.741+0000 7f3a6f59e640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a700c7fc0 con 0x7f3a700cb990 2023-12-17T11:49:35.745 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:35.741+0000 7f3a6f59e640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a700c8b40 con 0x7f3a7015b250 2023-12-17T11:49:35.745 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:35.741+0000 7f3a6f59e640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a700c8210 con 0x7f3a700cb5b0 2023-12-17T11:49:35.745 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:35.741+0000 7f3a67fff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3a700cb990 0x7f3a7014dde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:35.745 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:35.741+0000 7f3a67fff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3a700cb990 0x7f3a7014dde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:36850/0 (socket says 172.21.15.40:36850) 2023-12-17T11:49:35.745 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:35.741+0000 7f3a67fff640 1 -- 172.21.15.40:0/2812521710 learned_addr learned my addr 172.21.15.40:0/2812521710 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-17T11:49:35.745 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:35.742+0000 7f3a6e59c640 1 --2- 172.21.15.40:0/2812521710 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f3a700cb5b0 0x7f3a7014e470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:35.745 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:35.742+0000 7f3a6ed9d640 1 --2- 172.21.15.40:0/2812521710 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3a7015b250 0x7f3a701f37c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:35.745 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:35.742+0000 7f3a67fff640 1 -- 172.21.15.40:0/2812521710 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f3a700cb5b0 msgr2=0x7f3a7014e470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:35.745 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:35.742+0000 7f3a67fff640 1 --2- 172.21.15.40:0/2812521710 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f3a700cb5b0 0x7f3a7014e470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:35.745 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:35.742+0000 7f3a67fff640 1 -- 172.21.15.40:0/2812521710 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3a7015b250 msgr2=0x7f3a701f37c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:35.745 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:35.742+0000 7f3a67fff640 1 --2- 172.21.15.40:0/2812521710 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3a7015b250 0x7f3a701f37c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:35.745 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:35.742+0000 7f3a67fff640 1 -- 172.21.15.40:0/2812521710 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a580094d0 con 0x7f3a700cb990 2023-12-17T11:49:35.747 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:35.742+0000 7f3a67fff640 1 --2- 172.21.15.40:0/2812521710 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3a700cb990 0x7f3a7014dde0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f3a58000c00 tx=0x7f3a580046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:49:35.747 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:35.743+0000 7f3a66ffd640 1 -- 172.21.15.40:0/2812521710 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a5803ad30 con 0x7f3a700cb990 2023-12-17T11:49:35.747 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:35.743+0000 7f3a66ffd640 1 -- 172.21.15.40:0/2812521710 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a580443f0 con 0x7f3a700cb990 2023-12-17T11:49:35.747 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:35.743+0000 7f3a6f59e640 1 -- 172.21.15.40:0/2812521710 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a700c84f0 con 0x7f3a700cb990 2023-12-17T11:49:35.747 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:35.743+0000 7f3a66ffd640 1 -- 172.21.15.40:0/2812521710 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a580447a0 con 0x7f3a700cb990 2023-12-17T11:49:35.748 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:35.743+0000 7f3a6f59e640 1 -- 172.21.15.40:0/2812521710 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a701f3d00 con 0x7f3a700cb990 2023-12-17T11:49:35.748 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:35.744+0000 7f3a6f59e640 1 -- 172.21.15.40:0/2812521710 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a70067910 con 0x7f3a700cb990 2023-12-17T11:49:35.748 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:35.745+0000 7f3a66ffd640 1 -- 172.21.15.40:0/2812521710 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f3a58044900 con 0x7f3a700cb990 2023-12-17T11:49:35.748 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:35.746+0000 7f3a66ffd640 1 --2- 172.21.15.40:0/2812521710 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f3a5006ae70 0x7f3a5006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:35.748 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:35.746+0000 7f3a66ffd640 1 -- 172.21.15.40:0/2812521710 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f3a580ac090 con 0x7f3a700cb990 2023-12-17T11:49:35.749 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:35.747+0000 7f3a6e59c640 1 --2- 172.21.15.40:0/2812521710 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f3a5006ae70 0x7f3a5006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:35.750 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:35.748+0000 7f3a6e59c640 1 --2- 172.21.15.40:0/2812521710 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f3a5006ae70 0x7f3a5006d330 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f3a60006fd0 tx=0x7f3a60008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:49:35.752 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:35.750+0000 7f3a66ffd640 1 -- 172.21.15.40:0/2812521710 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f3a58076e80 con 0x7f3a700cb990 2023-12-17T11:49:35.948 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:35.945+0000 7f3a6f59e640 1 -- 172.21.15.40:0/2812521710 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f3a700c8cb0 con 0x7f3a700cb990 2023-12-17T11:49:35.948 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:35.946+0000 7f3a66ffd640 1 -- 172.21.15.40:0/2812521710 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) v1 ==== 103+0+11 (secure 0 0 0) 0x7f3a58035020 con 0x7f3a700cb990 2023-12-17T11:49:35.948 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 32 2023-12-17T11:49:35.952 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:35.949+0000 7f3a6f59e640 1 -- 172.21.15.40:0/2812521710 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f3a5006ae70 msgr2=0x7f3a5006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:35.952 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:35.949+0000 7f3a6f59e640 1 --2- 172.21.15.40:0/2812521710 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f3a5006ae70 0x7f3a5006d330 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f3a60006fd0 tx=0x7f3a60008040 comp rx=0 tx=0).stop 2023-12-17T11:49:35.952 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:35.949+0000 7f3a6f59e640 1 -- 172.21.15.40:0/2812521710 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3a700cb990 msgr2=0x7f3a7014dde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:35.952 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:35.949+0000 7f3a6f59e640 1 --2- 172.21.15.40:0/2812521710 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3a700cb990 0x7f3a7014dde0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f3a58000c00 tx=0x7f3a580046c0 comp rx=0 tx=0).stop 2023-12-17T11:49:35.952 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:35.949+0000 7f3a6f59e640 1 -- 172.21.15.40:0/2812521710 shutdown_connections 2023-12-17T11:49:35.952 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:35.949+0000 7f3a6f59e640 1 --2- 172.21.15.40:0/2812521710 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f3a5006ae70 0x7f3a5006d330 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:35.952 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:35.949+0000 7f3a6f59e640 1 --2- 172.21.15.40:0/2812521710 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3a7015b250 0x7f3a701f37c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:35.952 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:35.949+0000 7f3a6f59e640 1 --2- 172.21.15.40:0/2812521710 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3a700cb990 0x7f3a7014dde0 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:35.952 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:35.949+0000 7f3a6f59e640 1 --2- 172.21.15.40:0/2812521710 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f3a700cb5b0 0x7f3a7014e470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:35.952 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:35.949+0000 7f3a6f59e640 1 -- 172.21.15.40:0/2812521710 >> 172.21.15.40:0/2812521710 conn(0x7f3a700b0940 msgr2=0x7f3a70070c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:49:35.952 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:35.950+0000 7f3a6f59e640 1 -- 172.21.15.40:0/2812521710 shutdown_connections 2023-12-17T11:49:35.952 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:35.950+0000 7f3a6f59e640 1 -- 172.21.15.40:0/2812521710 wait complete. 2023-12-17T11:49:35.970 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-17T11:49:36.200 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:36.198+0000 7f25f9f90640 1 Processor -- start 2023-12-17T11:49:36.200 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:36.198+0000 7f25f9f90640 1 -- start start 2023-12-17T11:49:36.202 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:36.200+0000 7f25f9f90640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f25f4143e00 0x7f25f40b4040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:36.202 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:36.200+0000 7f25f9f90640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f25f4072180 0x7f25f40b4580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:36.202 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:36.200+0000 7f25f9f90640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25f40b3bb0 con 0x7f25f406c410 2023-12-17T11:49:36.202 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:36.200+0000 7f25f9f90640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25f41441e0 con 0x7f25f4143e00 2023-12-17T11:49:36.202 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:36.200+0000 7f25f9f90640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25f4072680 con 0x7f25f4072180 2023-12-17T11:49:36.203 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:36.200+0000 7f25f37fe640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f25f4143e00 0x7f25f40b4040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:36.203 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:36.200+0000 7f25f3fff640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f25f406c410 0x7f25f4070690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:39750/0 (socket says 172.21.15.40:39750) 2023-12-17T11:49:36.203 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:36.200+0000 7f25f3fff640 1 -- 172.21.15.40:0/2569058719 learned_addr learned my addr 172.21.15.40:0/2569058719 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-12-17T11:49:36.203 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:36.201+0000 7f25f2ffd640 1 --2- 172.21.15.40:0/2569058719 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f25f4072180 0x7f25f40b4580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:36.203 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:36.201+0000 7f25f37fe640 1 -- 172.21.15.40:0/2569058719 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f25f4072180 msgr2=0x7f25f40b4580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:49:36.203 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:36.201+0000 7f25f37fe640 1 --2- 172.21.15.40:0/2569058719 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f25f4072180 0x7f25f40b4580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:36.203 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:36.201+0000 7f25f37fe640 1 -- 172.21.15.40:0/2569058719 >> v1:172.21.15.40:6789/0 conn(0x7f25f406c410 legacy=0x7f25f4070690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:36.203 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:36.201+0000 7f25f37fe640 1 -- 172.21.15.40:0/2569058719 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25f40b1e30 con 0x7f25f4143e00 2023-12-17T11:49:36.204 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:36.201+0000 7f25f27fc640 1 -- 172.21.15.40:0/2569058719 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2828114314 0 0) 0x7f25f40b3bb0 con 0x7f25f406c410 2023-12-17T11:49:36.204 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:36.202+0000 7f25f37fe640 1 --2- 172.21.15.40:0/2569058719 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f25f4143e00 0x7f25f40b4040 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f25e40097a0 tx=0x7f25e402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16661114343ec60e server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:49:36.204 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:36.203+0000 7f25f27fc640 1 -- 172.21.15.40:0/2569058719 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25e4031830 con 0x7f25f4143e00 2023-12-17T11:49:36.204 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:36.203+0000 7f25f27fc640 1 -- 172.21.15.40:0/2569058719 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25e4031990 con 0x7f25f4143e00 2023-12-17T11:49:36.205 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:36.203+0000 7f25f27fc640 1 -- 172.21.15.40:0/2569058719 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25e4031d20 con 0x7f25f4143e00 2023-12-17T11:49:36.206 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:36.203+0000 7f25f9f90640 1 -- 172.21.15.40:0/2569058719 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f25f4143e00 msgr2=0x7f25f40b4040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:36.206 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:36.203+0000 7f25f9f90640 1 --2- 172.21.15.40:0/2569058719 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f25f4143e00 0x7f25f40b4040 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f25e40097a0 tx=0x7f25e402b8d0 comp rx=0 tx=0).stop 2023-12-17T11:49:36.206 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:36.203+0000 7f25f9f90640 1 -- 172.21.15.40:0/2569058719 shutdown_connections 2023-12-17T11:49:36.206 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:36.203+0000 7f25f9f90640 1 --2- 172.21.15.40:0/2569058719 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f25f4072180 0x7f25f40b4580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:36.206 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:36.203+0000 7f25f9f90640 1 --2- 172.21.15.40:0/2569058719 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f25f4143e00 0x7f25f40b4040 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:36.206 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:36.203+0000 7f25f9f90640 1 -- 172.21.15.40:0/2569058719 >> 172.21.15.40:0/2569058719 conn(0x7f25f40b0a90 msgr2=0x7f25f40b0e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:49:36.206 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:36.203+0000 7f25f9f90640 1 -- 172.21.15.40:0/2569058719 shutdown_connections 2023-12-17T11:49:36.206 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:36.204+0000 7f25f9f90640 1 -- 172.21.15.40:0/2569058719 wait complete. 2023-12-17T11:49:36.207 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:36.205+0000 7f25f9f90640 1 Processor -- start 2023-12-17T11:49:36.207 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:36.206+0000 7f25f9f90640 1 -- start start 2023-12-17T11:49:36.209 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:36.207+0000 7f25f9f90640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f25f406c410 0x7f25f41f3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:36.209 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:36.207+0000 7f25f9f90640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f25f4072180 0x7f25f41422b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:36.209 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:36.207+0000 7f25f9f90640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f25f4143e00 0x7f25f4139120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:36.209 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:36.207+0000 7f25f9f90640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25f4143460 con 0x7f25f406c410 2023-12-17T11:49:36.209 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:36.207+0000 7f25f9f90640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25f4142bc0 con 0x7f25f4143e00 2023-12-17T11:49:36.209 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:36.207+0000 7f25f9f90640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25f4142ea0 con 0x7f25f4072180 2023-12-17T11:49:36.209 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:36.207+0000 7f25f37fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f25f406c410 0x7f25f41f3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:36.209 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:36.207+0000 7f25f37fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f25f406c410 0x7f25f41f3ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:36870/0 (socket says 172.21.15.40:36870) 2023-12-17T11:49:36.209 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:36.207+0000 7f25f37fe640 1 -- 172.21.15.40:0/1030293450 learned_addr learned my addr 172.21.15.40:0/1030293450 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-17T11:49:36.211 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:36.207+0000 7f25f37fe640 1 -- 172.21.15.40:0/1030293450 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f25f4072180 msgr2=0x7f25f41422b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:36.211 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:36.207+0000 7f25f37fe640 1 --2- 172.21.15.40:0/1030293450 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f25f4072180 0x7f25f41422b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:36.211 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:36.207+0000 7f25f37fe640 1 -- 172.21.15.40:0/1030293450 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f25f4143e00 msgr2=0x7f25f4139120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:36.211 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:36.207+0000 7f25f37fe640 1 --2- 172.21.15.40:0/1030293450 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f25f4143e00 0x7f25f4139120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:36.211 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:36.207+0000 7f25f37fe640 1 -- 172.21.15.40:0/1030293450 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25e4009400 con 0x7f25f406c410 2023-12-17T11:49:36.211 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:36.208+0000 7f25f37fe640 1 --2- 172.21.15.40:0/1030293450 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f25f406c410 0x7f25f41f3ab0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f25e4000c00 tx=0x7f25e40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:49:36.211 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:36.208+0000 7f25ebfff640 1 -- 172.21.15.40:0/1030293450 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25e4004230 con 0x7f25f406c410 2023-12-17T11:49:36.211 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:36.208+0000 7f25ebfff640 1 -- 172.21.15.40:0/1030293450 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25e4004390 con 0x7f25f406c410 2023-12-17T11:49:36.211 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:36.208+0000 7f25ebfff640 1 -- 172.21.15.40:0/1030293450 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25e403a880 con 0x7f25f406c410 2023-12-17T11:49:36.211 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:36.208+0000 7f25f9f90640 1 -- 172.21.15.40:0/1030293450 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25f4143180 con 0x7f25f406c410 2023-12-17T11:49:36.211 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:36.208+0000 7f25f9f90640 1 -- 172.21.15.40:0/1030293450 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25f41427f0 con 0x7f25f406c410 2023-12-17T11:49:36.212 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:36.209+0000 7f25f9f90640 1 -- 172.21.15.40:0/1030293450 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25f4142980 con 0x7f25f406c410 2023-12-17T11:49:36.212 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:36.211+0000 7f25ebfff640 1 -- 172.21.15.40:0/1030293450 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f25e403a9e0 con 0x7f25f406c410 2023-12-17T11:49:36.213 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:36.211+0000 7f25ebfff640 1 --2- 172.21.15.40:0/1030293450 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f25d406ae90 0x7f25d406d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:36.213 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:36.212+0000 7f25ebfff640 1 -- 172.21.15.40:0/1030293450 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f25e40ac420 con 0x7f25f406c410 2023-12-17T11:49:36.214 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:36.212+0000 7f25f2ffd640 1 --2- 172.21.15.40:0/1030293450 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f25d406ae90 0x7f25d406d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:36.215 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:36.213+0000 7f25f2ffd640 1 --2- 172.21.15.40:0/1030293450 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f25d406ae90 0x7f25d406d350 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f25dc0070b0 tx=0x7f25dc007040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:49:36.218 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:36.216+0000 7f25ebfff640 1 -- 172.21.15.40:0/1030293450 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f25f4142980 con 0x7f25f406c410 2023-12-17T11:49:36.455 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:36.453+0000 7f25f9f90640 1 -- 172.21.15.40:0/1030293450 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f25f4142980 con 0x7f25f406c410 2023-12-17T11:49:36.456 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:36.454+0000 7f25ebfff640 1 -- 172.21.15.40:0/1030293450 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4915 (secure 0 0 0) 0x7f25f4142980 con 0x7f25f406c410 2023-12-17T11:49:36.456 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T11:49:36.457 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/3337931457","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":3337931457},{"type":"v1","addr":"172.21.15.40:6835","nonce":3337931457}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4257,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6833/1874601964","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6832","nonce":1874601964},{"type":"v1","addr":"172.21.15.40:6833","nonce":1874601964}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4267,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6836/3645037845","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6834","nonce":3645037845},{"type":"v1","addr":"172.21.15.159:6836","nonce":3645037845}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-17T11:48:17.696113+0000","modified":"2023-12-17T11:48:40.061005+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4270},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4270":{"gid":4270,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.159:6837/1288849778","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6835","nonce":1288849778},{"type":"v1","addr":"172.21.15.159:6837","nonce":1288849778}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-12-17T11:49:36.457 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 8 2023-12-17T11:49:36.459 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:36.457+0000 7f25f9f90640 1 -- 172.21.15.40:0/1030293450 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f25d406ae90 msgr2=0x7f25d406d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:36.459 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:36.457+0000 7f25f9f90640 1 --2- 172.21.15.40:0/1030293450 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f25d406ae90 0x7f25d406d350 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f25dc0070b0 tx=0x7f25dc007040 comp rx=0 tx=0).stop 2023-12-17T11:49:36.460 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:36.457+0000 7f25f9f90640 1 -- 172.21.15.40:0/1030293450 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f25f406c410 msgr2=0x7f25f41f3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:36.460 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:36.457+0000 7f25f9f90640 1 --2- 172.21.15.40:0/1030293450 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f25f406c410 0x7f25f41f3ab0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f25e4000c00 tx=0x7f25e40046c0 comp rx=0 tx=0).stop 2023-12-17T11:49:36.460 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:36.457+0000 7f25f9f90640 1 -- 172.21.15.40:0/1030293450 shutdown_connections 2023-12-17T11:49:36.460 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:36.457+0000 7f25f9f90640 1 --2- 172.21.15.40:0/1030293450 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f25d406ae90 0x7f25d406d350 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:36.460 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:36.457+0000 7f25f9f90640 1 --2- 172.21.15.40:0/1030293450 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f25f4143e00 0x7f25f4139120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:36.460 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:36.457+0000 7f25f9f90640 1 --2- 172.21.15.40:0/1030293450 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f25f4072180 0x7f25f41422b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:36.460 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:36.457+0000 7f25f9f90640 1 --2- 172.21.15.40:0/1030293450 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f25f406c410 0x7f25f41f3ab0 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:36.460 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:36.457+0000 7f25f9f90640 1 -- 172.21.15.40:0/1030293450 >> 172.21.15.40:0/1030293450 conn(0x7f25f40b0a90 msgr2=0x7f25f4070690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:49:36.460 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:36.457+0000 7f25f9f90640 1 -- 172.21.15.40:0/1030293450 shutdown_connections 2023-12-17T11:49:36.460 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:36.458+0000 7f25f9f90640 1 -- 172.21.15.40:0/1030293450 wait complete. 2023-12-17T11:49:36.480 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-17T11:49:36.697 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:36.695+0000 7f45e6f16640 1 Processor -- start 2023-12-17T11:49:36.697 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:36.695+0000 7f45e6f16640 1 -- start start 2023-12-17T11:49:36.699 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:36.697+0000 7f45e6f16640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f45e015e5d0 0x7f45e006bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:36.699 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:36.697+0000 7f45e6f16640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f45e00ae200 0x7f45e0070b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:36.699 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:36.697+0000 7f45e6f16640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45e0071f90 con 0x7f45e006c330 2023-12-17T11:49:36.699 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:36.697+0000 7f45e6f16640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45e0072270 con 0x7f45e015e5d0 2023-12-17T11:49:36.699 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:36.697+0000 7f45e6f16640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45e0070070 con 0x7f45e00ae200 2023-12-17T11:49:36.699 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:36.697+0000 7f45e5f14640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f45e015e5d0 0x7f45e006bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:36.700 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:36.697+0000 7f45e5713640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f45e00ae200 0x7f45e0070b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:36.700 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:36.698+0000 7f45e5f14640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f45e015e5d0 0x7f45e006bdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.40:39504/0 (socket says 172.21.15.40:39504) 2023-12-17T11:49:36.700 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:36.698+0000 7f45e6715640 1 --1- >> v1:172.21.15.159:6789/0 conn(0x7f45e006c330 0x7f45e00cded0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.159:6789/0 says I am v1:172.21.15.40:45922/0 (socket says 172.21.15.40:45922) 2023-12-17T11:49:36.700 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:36.698+0000 7f45e5f14640 1 -- 172.21.15.40:0/4165234041 learned_addr learned my addr 172.21.15.40:0/4165234041 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-17T11:49:36.700 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:36.698+0000 7f45e5713640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f45e00ae200 0x7f45e0070b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3301/0 says I am v2:172.21.15.40:52730/0 (socket says 172.21.15.40:52730) 2023-12-17T11:49:36.700 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:36.698+0000 7f45e5713640 1 -- 172.21.15.40:0/4165234041 >> v2:172.21.15.159:3300/0 conn(0x7f45e015e5d0 msgr2=0x7f45e006bdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:49:36.700 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:36.698+0000 7f45e5713640 1 --2- 172.21.15.40:0/4165234041 >> v2:172.21.15.159:3300/0 conn(0x7f45e015e5d0 0x7f45e006bdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:36.701 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:36.698+0000 7f45e5713640 1 -- 172.21.15.40:0/4165234041 >> v1:172.21.15.159:6789/0 conn(0x7f45e006c330 legacy=0x7f45e00cded0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:36.701 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:36.698+0000 7f45e5713640 1 -- 172.21.15.40:0/4165234041 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45e0070350 con 0x7f45e00ae200 2023-12-17T11:49:36.701 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:36.698+0000 7f45e5f14640 1 --2- 172.21.15.40:0/4165234041 >> v2:172.21.15.159:3300/0 conn(0x7f45e015e5d0 0x7f45e006bdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-17T11:49:36.701 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:36.700+0000 7f45e5713640 1 --2- 172.21.15.40:0/4165234041 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f45e00ae200 0x7f45e0070b50 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f45d00097a0 tx=0x7f45d002b820 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b393a2b474f22b11 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:49:36.702 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:36.700+0000 7f45e4f12640 1 -- 172.21.15.40:0/4165234041 <== mon.2 v2:172.21.15.159:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45d0031780 con 0x7f45e00ae200 2023-12-17T11:49:36.702 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:36.700+0000 7f45e4f12640 1 -- 172.21.15.40:0/4165234041 <== mon.2 v2:172.21.15.159:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45d00318e0 con 0x7f45e00ae200 2023-12-17T11:49:36.702 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:36.700+0000 7f45e4f12640 1 -- 172.21.15.40:0/4165234041 <== mon.2 v2:172.21.15.159:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45d0031c70 con 0x7f45e00ae200 2023-12-17T11:49:36.703 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:36.701+0000 7f45e6f16640 1 -- 172.21.15.40:0/4165234041 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f45e00ae200 msgr2=0x7f45e0070b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:36.703 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:36.701+0000 7f45e6f16640 1 --2- 172.21.15.40:0/4165234041 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f45e00ae200 0x7f45e0070b50 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f45d00097a0 tx=0x7f45d002b820 comp rx=0 tx=0).stop 2023-12-17T11:49:36.703 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:36.701+0000 7f45e6f16640 1 -- 172.21.15.40:0/4165234041 shutdown_connections 2023-12-17T11:49:36.703 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:36.701+0000 7f45e6f16640 1 --2- 172.21.15.40:0/4165234041 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f45e00ae200 0x7f45e0070b50 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:36.703 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:36.701+0000 7f45e6f16640 1 --2- 172.21.15.40:0/4165234041 >> v2:172.21.15.159:3300/0 conn(0x7f45e015e5d0 0x7f45e006bdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:36.703 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:36.701+0000 7f45e6f16640 1 -- 172.21.15.40:0/4165234041 >> 172.21.15.40:0/4165234041 conn(0x7f45e00b0860 msgr2=0x7f45e00b0c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:49:36.703 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:36.701+0000 7f45e6f16640 1 -- 172.21.15.40:0/4165234041 shutdown_connections 2023-12-17T11:49:36.703 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:36.701+0000 7f45e6f16640 1 -- 172.21.15.40:0/4165234041 wait complete. 2023-12-17T11:49:36.705 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:36.703+0000 7f45e6f16640 1 Processor -- start 2023-12-17T11:49:36.705 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:36.703+0000 7f45e6f16640 1 -- start start 2023-12-17T11:49:36.706 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:36.704+0000 7f45e6f16640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f45e006c330 0x7f45e01528f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:36.706 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:36.704+0000 7f45e6f16640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f45e00ae200 0x7f45e009ab70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:36.706 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:36.704+0000 7f45e6f16640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f45e015e5d0 0x7f45e009b0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:36.707 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:36.704+0000 7f45e6f16640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45e0152e30 con 0x7f45e015e5d0 2023-12-17T11:49:36.707 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:36.704+0000 7f45e6f16640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45e015a340 con 0x7f45e00ae200 2023-12-17T11:49:36.707 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:36.704+0000 7f45e6f16640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45e015abe0 con 0x7f45e006c330 2023-12-17T11:49:36.707 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:36.705+0000 7f45e6715640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f45e015e5d0 0x7f45e009b0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:36.707 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:36.705+0000 7f45e6715640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f45e015e5d0 0x7f45e009b0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:36876/0 (socket says 172.21.15.40:36876) 2023-12-17T11:49:36.707 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:36.705+0000 7f45e6715640 1 -- 172.21.15.40:0/1026153769 learned_addr learned my addr 172.21.15.40:0/1026153769 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-17T11:49:36.708 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:36.705+0000 7f45e5713640 1 --2- 172.21.15.40:0/1026153769 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f45e00ae200 0x7f45e009ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:36.708 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:36.705+0000 7f45e5f14640 1 --2- 172.21.15.40:0/1026153769 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f45e006c330 0x7f45e01528f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:36.708 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:36.705+0000 7f45e6715640 1 -- 172.21.15.40:0/1026153769 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f45e006c330 msgr2=0x7f45e01528f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:36.708 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:36.705+0000 7f45e6715640 1 --2- 172.21.15.40:0/1026153769 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f45e006c330 0x7f45e01528f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:36.708 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:36.705+0000 7f45e6715640 1 -- 172.21.15.40:0/1026153769 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f45e00ae200 msgr2=0x7f45e009ab70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:36.708 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:36.705+0000 7f45e6715640 1 --2- 172.21.15.40:0/1026153769 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f45e00ae200 0x7f45e009ab70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:36.708 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:36.705+0000 7f45e6715640 1 -- 172.21.15.40:0/1026153769 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45dc0094d0 con 0x7f45e015e5d0 2023-12-17T11:49:36.708 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:36.705+0000 7f45e6715640 1 --2- 172.21.15.40:0/1026153769 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f45e015e5d0 0x7f45e009b0b0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f45d800c7b0 tx=0x7f45d800cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:49:36.709 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:36.706+0000 7f45d67fc640 1 -- 172.21.15.40:0/1026153769 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45d800a640 con 0x7f45e015e5d0 2023-12-17T11:49:36.709 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:36.706+0000 7f45d67fc640 1 -- 172.21.15.40:0/1026153769 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45d800a7a0 con 0x7f45e015e5d0 2023-12-17T11:49:36.709 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:36.706+0000 7f45d67fc640 1 -- 172.21.15.40:0/1026153769 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45d800ab10 con 0x7f45e015e5d0 2023-12-17T11:49:36.709 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:36.706+0000 7f45e6f16640 1 -- 172.21.15.40:0/1026153769 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45d0009400 con 0x7f45e015e5d0 2023-12-17T11:49:36.709 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:36.706+0000 7f45e6f16640 1 -- 172.21.15.40:0/1026153769 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45e00b38c0 con 0x7f45e015e5d0 2023-12-17T11:49:36.709 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:36.707+0000 7f45e6f16640 1 -- 172.21.15.40:0/1026153769 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45e0074450 con 0x7f45e015e5d0 2023-12-17T11:49:36.710 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:36.708+0000 7f45d67fc640 1 -- 172.21.15.40:0/1026153769 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f45d800ac70 con 0x7f45e015e5d0 2023-12-17T11:49:36.711 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:36.709+0000 7f45d67fc640 1 --2- 172.21.15.40:0/1026153769 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f45c406ae40 0x7f45c406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:36.711 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:36.709+0000 7f45d67fc640 1 -- 172.21.15.40:0/1026153769 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f45d80891c0 con 0x7f45e015e5d0 2023-12-17T11:49:36.711 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:36.710+0000 7f45e5f14640 1 --2- 172.21.15.40:0/1026153769 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f45c406ae40 0x7f45c406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:36.713 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:36.711+0000 7f45e5f14640 1 --2- 172.21.15.40:0/1026153769 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f45c406ae40 0x7f45c406d300 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f45dc009b70 tx=0x7f45dc008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:49:36.715 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:36.713+0000 7f45d67fc640 1 -- 172.21.15.40:0/1026153769 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f45d8053ea0 con 0x7f45e015e5d0 2023-12-17T11:49:36.910 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:36.908+0000 7f45e6f16640 1 -- 172.21.15.40:0/1026153769 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f45e015ad20 con 0x7f45e015e5d0 2023-12-17T11:49:36.911 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:36.909+0000 7f45d67fc640 1 -- 172.21.15.40:0/1026153769 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+18697 (secure 0 0 0) 0x7f45d80574c0 con 0x7f45e015e5d0 2023-12-17T11:49:36.912 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T11:49:36.912 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":27,"fsid":"099cd35d-80d9-4ca4-8424-de13b3b03ac7","created":"2023-12-17T11:47:53.450097+0000","modified":"2023-12-17T11:49:00.483840+0000","last_up_change":"2023-12-17T11:48:05.724195+0000","last_in_change":"2023-12-17T11:47:56.956499+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-17T11:48:06.668943+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-17T11:48:16.151444+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-17T11:48:16.717726+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-17T11:48:20.534819+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a88bfd46-63b8-48b1-9c0e-5c9cdc31bd38","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":555204741},{"type":"v1","addr":"172.21.15.40:6802","nonce":555204741}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":555204741},{"type":"v1","addr":"172.21.15.40:6807","nonce":555204741}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":555204741},{"type":"v1","addr":"172.21.15.40:6815","nonce":555204741}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6809","nonce":555204741},{"type":"v1","addr":"172.21.15.40:6812","nonce":555204741}]},"public_addr":"172.21.15.40:6802/555204741","cluster_addr":"172.21.15.40:6807/555204741","heartbeat_back_addr":"172.21.15.40:6815/555204741","heartbeat_front_addr":"172.21.15.40:6812/555204741","state":["exists","up"]},{"osd":1,"uuid":"c5d628ae-36f4-4866-802c-b162f0e90add","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6801","nonce":1221318112},{"type":"v1","addr":"172.21.15.40:6803","nonce":1221318112}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6805","nonce":1221318112},{"type":"v1","addr":"172.21.15.40:6806","nonce":1221318112}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6811","nonce":1221318112},{"type":"v1","addr":"172.21.15.40:6813","nonce":1221318112}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":1221318112},{"type":"v1","addr":"172.21.15.40:6810","nonce":1221318112}]},"public_addr":"172.21.15.40:6803/1221318112","cluster_addr":"172.21.15.40:6806/1221318112","heartbeat_back_addr":"172.21.15.40:6813/1221318112","heartbeat_front_addr":"172.21.15.40:6810/1221318112","state":["exists","up"]},{"osd":2,"uuid":"d986ad6a-af2f-47fc-9c3b-fbda27b82b73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":1959000265},{"type":"v1","addr":"172.21.15.40:6817","nonce":1959000265}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6818","nonce":1959000265},{"type":"v1","addr":"172.21.15.40:6819","nonce":1959000265}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":1959000265},{"type":"v1","addr":"172.21.15.40:6827","nonce":1959000265}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":1959000265},{"type":"v1","addr":"172.21.15.40:6822","nonce":1959000265}]},"public_addr":"172.21.15.40:6817/1959000265","cluster_addr":"172.21.15.40:6819/1959000265","heartbeat_back_addr":"172.21.15.40:6827/1959000265","heartbeat_front_addr":"172.21.15.40:6822/1959000265","state":["exists","up"]},{"osd":3,"uuid":"d79d22b7-be05-41b2-b95d-697db677fd02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6821","nonce":974040287},{"type":"v1","addr":"172.21.15.40:6823","nonce":974040287}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6825","nonce":974040287},{"type":"v1","addr":"172.21.15.40:6826","nonce":974040287}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":974040287},{"type":"v1","addr":"172.21.15.40:6831","nonce":974040287}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":974040287},{"type":"v1","addr":"172.21.15.40:6829","nonce":974040287}]},"public_addr":"172.21.15.40:6823/974040287","cluster_addr":"172.21.15.40:6826/974040287","heartbeat_back_addr":"172.21.15.40:6831/974040287","heartbeat_front_addr":"172.21.15.40:6829/974040287","state":["exists","up"]},{"osd":4,"uuid":"62a7a233-d3ea-40be-91de-180c0208d639","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6808","nonce":3937787733},{"type":"v1","addr":"172.21.15.159:6809","nonce":3937787733}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6810","nonce":3937787733},{"type":"v1","addr":"172.21.15.159:6811","nonce":3937787733}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6814","nonce":3937787733},{"type":"v1","addr":"172.21.15.159:6815","nonce":3937787733}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6812","nonce":3937787733},{"type":"v1","addr":"172.21.15.159:6813","nonce":3937787733}]},"public_addr":"172.21.15.159:6809/3937787733","cluster_addr":"172.21.15.159:6811/3937787733","heartbeat_back_addr":"172.21.15.159:6815/3937787733","heartbeat_front_addr":"172.21.15.159:6813/3937787733","state":["exists","up"]},{"osd":5,"uuid":"84629cea-dc0e-4b5e-b203-5ea963839281","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6816","nonce":3032505240},{"type":"v1","addr":"172.21.15.159:6817","nonce":3032505240}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6818","nonce":3032505240},{"type":"v1","addr":"172.21.15.159:6819","nonce":3032505240}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6822","nonce":3032505240},{"type":"v1","addr":"172.21.15.159:6823","nonce":3032505240}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6820","nonce":3032505240},{"type":"v1","addr":"172.21.15.159:6821","nonce":3032505240}]},"public_addr":"172.21.15.159:6817/3032505240","cluster_addr":"172.21.15.159:6819/3032505240","heartbeat_back_addr":"172.21.15.159:6823/3032505240","heartbeat_front_addr":"172.21.15.159:6821/3032505240","state":["exists","up"]},{"osd":6,"uuid":"4ae3af3a-1743-4070-a91d-8be5c31cdb04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6800","nonce":2411788597},{"type":"v1","addr":"172.21.15.159:6801","nonce":2411788597}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6802","nonce":2411788597},{"type":"v1","addr":"172.21.15.159:6803","nonce":2411788597}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6806","nonce":2411788597},{"type":"v1","addr":"172.21.15.159:6807","nonce":2411788597}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6804","nonce":2411788597},{"type":"v1","addr":"172.21.15.159:6805","nonce":2411788597}]},"public_addr":"172.21.15.159:6801/2411788597","cluster_addr":"172.21.15.159:6803/2411788597","heartbeat_back_addr":"172.21.15.159:6807/2411788597","heartbeat_front_addr":"172.21.15.159:6805/2411788597","state":["exists","up"]},{"osd":7,"uuid":"c1f4c7f2-8f75-4f95-bc63-a332773e3b8e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6824","nonce":478953349},{"type":"v1","addr":"172.21.15.159:6825","nonce":478953349}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6826","nonce":478953349},{"type":"v1","addr":"172.21.15.159:6827","nonce":478953349}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6830","nonce":478953349},{"type":"v1","addr":"172.21.15.159:6831","nonce":478953349}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6828","nonce":478953349},{"type":"v1","addr":"172.21.15.159:6829","nonce":478953349}]},"public_addr":"172.21.15.159:6825/478953349","cluster_addr":"172.21.15.159:6827/478953349","heartbeat_back_addr":"172.21.15.159:6831/478953349","heartbeat_front_addr":"172.21.15.159:6829/478953349","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T11:48:02.023567+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T11:48:02.278216+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T11:48:02.311843+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T11:48:01.773372+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T11:48:02.618910+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T11:48:02.361559+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T11:48:02.223997+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T11:48:02.604403+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.2","mappings":[{"from":3,"to":2}]},{"pgid":"3.d","mappings":[{"from":5,"to":1}]},{"pgid":"3.13","mappings":[{"from":7,"to":2}]},{"pgid":"3.17","mappings":[{"from":0,"to":2}]},{"pgid":"3.38","mappings":[{"from":5,"to":1}]},{"pgid":"4.2","mappings":[{"from":1,"to":2}]},{"pgid":"4.10","mappings":[{"from":1,"to":2}]},{"pgid":"4.18","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-17T11:49:36.914 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:36.912+0000 7f45e6f16640 1 -- 172.21.15.40:0/1026153769 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f45c406ae40 msgr2=0x7f45c406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:36.914 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:36.912+0000 7f45e6f16640 1 --2- 172.21.15.40:0/1026153769 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f45c406ae40 0x7f45c406d300 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f45dc009b70 tx=0x7f45dc008040 comp rx=0 tx=0).stop 2023-12-17T11:49:36.914 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:36.912+0000 7f45e6f16640 1 -- 172.21.15.40:0/1026153769 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f45e015e5d0 msgr2=0x7f45e009b0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:36.914 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:36.912+0000 7f45e6f16640 1 --2- 172.21.15.40:0/1026153769 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f45e015e5d0 0x7f45e009b0b0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f45d800c7b0 tx=0x7f45d800cc70 comp rx=0 tx=0).stop 2023-12-17T11:49:36.914 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:36.912+0000 7f45e6f16640 1 -- 172.21.15.40:0/1026153769 shutdown_connections 2023-12-17T11:49:36.914 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:36.912+0000 7f45e6f16640 1 --2- 172.21.15.40:0/1026153769 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f45c406ae40 0x7f45c406d300 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:36.914 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:36.912+0000 7f45e6f16640 1 --2- 172.21.15.40:0/1026153769 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f45e015e5d0 0x7f45e009b0b0 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:36.914 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:36.912+0000 7f45e6f16640 1 --2- 172.21.15.40:0/1026153769 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f45e00ae200 0x7f45e009ab70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:36.915 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:36.912+0000 7f45e6f16640 1 --2- 172.21.15.40:0/1026153769 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f45e006c330 0x7f45e01528f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:36.915 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:36.912+0000 7f45e6f16640 1 -- 172.21.15.40:0/1026153769 >> 172.21.15.40:0/1026153769 conn(0x7f45e00b0860 msgr2=0x7f45e006c810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:49:36.915 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:36.912+0000 7f45e6f16640 1 -- 172.21.15.40:0/1026153769 shutdown_connections 2023-12-17T11:49:36.915 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:36.912+0000 7f45e6f16640 1 -- 172.21.15.40:0/1026153769 wait complete. 2023-12-17T11:49:36.933 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-12-17T11:49:36.934 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-17T11:49:37.160 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:37.158+0000 7f87f8125640 1 Processor -- start 2023-12-17T11:49:37.160 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:37.158+0000 7f87f8125640 1 -- start start 2023-12-17T11:49:37.162 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:37.160+0000 7f87f8125640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f87f0157a60 0x7f87f006c410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:37.162 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:37.160+0000 7f87f8125640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f87f015e2b0 0x7f87f00cc8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:37.162 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:37.160+0000 7f87f8125640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87f006ca40 con 0x7f87f006de20 2023-12-17T11:49:37.162 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:37.160+0000 7f87f8125640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87f0071cd0 con 0x7f87f015e2b0 2023-12-17T11:49:37.162 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:37.160+0000 7f87f8125640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87f0070f10 con 0x7f87f0157a60 2023-12-17T11:49:37.162 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:37.160+0000 7f87f56c0640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f87f006de20 0x7f87f015dba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:39756/0 (socket says 172.21.15.40:39756) 2023-12-17T11:49:37.162 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:37.160+0000 7f87f56c0640 1 -- 172.21.15.40:0/1576323090 learned_addr learned my addr 172.21.15.40:0/1576323090 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-12-17T11:49:37.164 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:37.161+0000 7f87f66c2640 1 --2- 172.21.15.40:0/1576323090 >> v2:172.21.15.159:3300/0 conn(0x7f87f015e2b0 0x7f87f00cc8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:37.165 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:37.161+0000 7f87f5ec1640 1 --2- 172.21.15.40:0/1576323090 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f87f0157a60 0x7f87f006c410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:37.165 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:37.161+0000 7f87f4ebf640 1 -- 172.21.15.40:0/1576323090 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3416989141 0 0) 0x7f87f006ca40 con 0x7f87f006de20 2023-12-17T11:49:37.165 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:37.161+0000 7f87f4ebf640 1 -- 172.21.15.40:0/1576323090 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f87dc003520 con 0x7f87f006de20 2023-12-17T11:49:37.165 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:37.161+0000 7f87f4ebf640 1 -- 172.21.15.40:0/1576323090 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 159574307 0 0) 0x7f87dc003520 con 0x7f87f006de20 2023-12-17T11:49:37.165 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:37.161+0000 7f87f4ebf640 1 -- 172.21.15.40:0/1576323090 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f87f0157a60 msgr2=0x7f87f006c410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:49:37.165 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:37.161+0000 7f87f4ebf640 1 --2- 172.21.15.40:0/1576323090 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f87f0157a60 0x7f87f006c410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:37.165 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:37.161+0000 7f87f4ebf640 1 -- 172.21.15.40:0/1576323090 >> v2:172.21.15.159:3300/0 conn(0x7f87f015e2b0 msgr2=0x7f87f00cc8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:49:37.165 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:37.161+0000 7f87f4ebf640 1 --2- 172.21.15.40:0/1576323090 >> v2:172.21.15.159:3300/0 conn(0x7f87f015e2b0 0x7f87f00cc8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:37.165 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:37.161+0000 7f87f4ebf640 1 -- 172.21.15.40:0/1576323090 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87f00711f0 con 0x7f87f006de20 2023-12-17T11:49:37.165 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:37.161+0000 7f87f4ebf640 1 -- 172.21.15.40:0/1576323090 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2643242555 0 0) 0x7f87e0001670 con 0x7f87f006de20 2023-12-17T11:49:37.165 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:37.161+0000 7f87f4ebf640 1 -- 172.21.15.40:0/1576323090 >> v1:172.21.15.40:6789/0 conn(0x7f87f006de20 legacy=0x7f87f015dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:37.165 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:37.161+0000 7f87f4ebf640 1 --2- 172.21.15.40:0/1576323090 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f87f0157a60 0x7f87dc003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:37.165 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:37.161+0000 7f87f4ebf640 1 --2- 172.21.15.40:0/1576323090 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f87dc003ef0 0x7f87dc0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:37.165 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:37.161+0000 7f87f4ebf640 1 --2- 172.21.15.40:0/1576323090 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f87dc004d00 0x7f87dc005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:37.166 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:37.161+0000 7f87f4ebf640 1 -- 172.21.15.40:0/1576323090 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87f0071cd0 con 0x7f87dc004d00 2023-12-17T11:49:37.166 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:37.161+0000 7f87f4ebf640 1 -- 172.21.15.40:0/1576323090 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87f0070f10 con 0x7f87dc003ef0 2023-12-17T11:49:37.166 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:37.161+0000 7f87f4ebf640 1 -- 172.21.15.40:0/1576323090 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87dc00dc90 con 0x7f87f0157a60 2023-12-17T11:49:37.166 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:37.162+0000 7f87f66c2640 1 --2- 172.21.15.40:0/1576323090 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f87dc004d00 0x7f87dc005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:37.166 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:37.162+0000 7f87f5ec1640 1 --2- 172.21.15.40:0/1576323090 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f87f0157a60 0x7f87dc003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:37.166 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:37.162+0000 7f87f56c0640 1 --2- 172.21.15.40:0/1576323090 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f87dc003ef0 0x7f87dc0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:37.166 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:37.162+0000 7f87f66c2640 1 -- 172.21.15.40:0/1576323090 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f87f0157a60 msgr2=0x7f87dc003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:49:37.166 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:37.162+0000 7f87f66c2640 1 --2- 172.21.15.40:0/1576323090 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f87f0157a60 0x7f87dc003970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:37.166 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:37.162+0000 7f87f66c2640 1 -- 172.21.15.40:0/1576323090 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f87dc003ef0 msgr2=0x7f87dc0047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:49:37.166 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:37.162+0000 7f87f66c2640 1 --2- 172.21.15.40:0/1576323090 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f87dc003ef0 0x7f87dc0047c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:37.166 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:37.162+0000 7f87f66c2640 1 -- 172.21.15.40:0/1576323090 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87dc003520 con 0x7f87dc004d00 2023-12-17T11:49:37.167 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:37.162+0000 7f87f5ec1640 1 --2- 172.21.15.40:0/1576323090 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f87f0157a60 0x7f87dc003970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-17T11:49:37.168 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:37.163+0000 7f87f66c2640 1 --2- 172.21.15.40:0/1576323090 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f87dc004d00 0x7f87dc005180 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f87e8009f90 tx=0x7f87dc0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33bdcea3959c1e22 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:49:37.168 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:37.164+0000 7f87f4ebf640 1 -- 172.21.15.40:0/1576323090 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87e802cbd0 con 0x7f87dc004d00 2023-12-17T11:49:37.168 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:37.164+0000 7f87f4ebf640 1 -- 172.21.15.40:0/1576323090 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87e800f040 con 0x7f87dc004d00 2023-12-17T11:49:37.168 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:37.164+0000 7f87f4ebf640 1 -- 172.21.15.40:0/1576323090 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87e8034440 con 0x7f87dc004d00 2023-12-17T11:49:37.168 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:37.164+0000 7f87f8125640 1 -- 172.21.15.40:0/1576323090 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f87dc004d00 msgr2=0x7f87dc005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:37.168 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:37.164+0000 7f87f8125640 1 --2- 172.21.15.40:0/1576323090 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f87dc004d00 0x7f87dc005180 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f87e8009f90 tx=0x7f87dc0057f0 comp rx=0 tx=0).stop 2023-12-17T11:49:37.168 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:37.164+0000 7f87f66c2640 1 -- 172.21.15.40:0/1576323090 reap_dead start 2023-12-17T11:49:37.168 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:37.164+0000 7f87f8125640 1 -- 172.21.15.40:0/1576323090 shutdown_connections 2023-12-17T11:49:37.168 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:37.164+0000 7f87f8125640 1 -- 172.21.15.40:0/1576323090 >> 172.21.15.40:0/1576323090 conn(0x7f87f00b0a90 msgr2=0x7f87f00b0e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:49:37.168 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:37.164+0000 7f87f8125640 1 -- 172.21.15.40:0/1576323090 shutdown_connections 2023-12-17T11:49:37.168 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:37.165+0000 7f87f8125640 1 -- 172.21.15.40:0/1576323090 wait complete. 2023-12-17T11:49:37.169 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:37.166+0000 7f87f8125640 1 Processor -- start 2023-12-17T11:49:37.169 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:37.166+0000 7f87f8125640 1 -- start start 2023-12-17T11:49:37.171 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:37.167+0000 7f87f8125640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f87f0146830 0x7f87f014a640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:37.171 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:37.167+0000 7f87f8125640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f87f0159d50 0x7f87f00af410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:37.171 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:37.167+0000 7f87f8125640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f87f0146c10 0x7f87f00af950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:37.171 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:37.167+0000 7f87f8125640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87f0156b10 con 0x7f87f0159d50 2023-12-17T11:49:37.171 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:37.167+0000 7f87f8125640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87f015b6e0 con 0x7f87f0146c10 2023-12-17T11:49:37.171 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:37.168+0000 7f87f8125640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87f015bca0 con 0x7f87f0146830 2023-12-17T11:49:37.171 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:37.168+0000 7f87f56c0640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f87f0159d50 0x7f87f00af410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:37.171 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:37.168+0000 7f87f56c0640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f87f0159d50 0x7f87f00af410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:36882/0 (socket says 172.21.15.40:36882) 2023-12-17T11:49:37.171 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:37.168+0000 7f87f56c0640 1 -- 172.21.15.40:0/705741963 learned_addr learned my addr 172.21.15.40:0/705741963 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-17T11:49:37.171 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:37.168+0000 7f87f5ec1640 1 --2- 172.21.15.40:0/705741963 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f87f0146830 0x7f87f014a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:37.172 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:37.168+0000 7f87f66c2640 1 --2- 172.21.15.40:0/705741963 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f87f0146c10 0x7f87f00af950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:37.172 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:37.168+0000 7f87f56c0640 1 -- 172.21.15.40:0/705741963 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f87f0146830 msgr2=0x7f87f014a640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:37.172 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:37.168+0000 7f87f56c0640 1 --2- 172.21.15.40:0/705741963 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f87f0146830 0x7f87f014a640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:37.172 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:37.168+0000 7f87f56c0640 1 -- 172.21.15.40:0/705741963 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f87f0146c10 msgr2=0x7f87f00af950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:37.172 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:37.168+0000 7f87f56c0640 1 --2- 172.21.15.40:0/705741963 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f87f0146c10 0x7f87f00af950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:37.172 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:37.168+0000 7f87f56c0640 1 -- 172.21.15.40:0/705741963 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87f0156d60 con 0x7f87f0159d50 2023-12-17T11:49:37.172 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:37.169+0000 7f87f56c0640 1 --2- 172.21.15.40:0/705741963 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f87f0159d50 0x7f87f00af410 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f87e000db70 tx=0x7f87e000b4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:49:37.172 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:37.169+0000 7f87e67fc640 1 -- 172.21.15.40:0/705741963 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87e000bdb0 con 0x7f87f0159d50 2023-12-17T11:49:37.172 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:37.169+0000 7f87e67fc640 1 -- 172.21.15.40:0/705741963 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87e000de70 con 0x7f87f0159d50 2023-12-17T11:49:37.172 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:37.169+0000 7f87e67fc640 1 -- 172.21.15.40:0/705741963 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87e0004ac0 con 0x7f87f0159d50 2023-12-17T11:49:37.172 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:37.169+0000 7f87f8125640 1 -- 172.21.15.40:0/705741963 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87f015b930 con 0x7f87f0159d50 2023-12-17T11:49:37.172 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:37.169+0000 7f87f8125640 1 -- 172.21.15.40:0/705741963 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87f0159480 con 0x7f87f0159d50 2023-12-17T11:49:37.173 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:37.171+0000 7f87f8125640 1 -- 172.21.15.40:0/705741963 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87f00745d0 con 0x7f87f0159d50 2023-12-17T11:49:37.173 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:37.172+0000 7f87e67fc640 1 -- 172.21.15.40:0/705741963 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f87e0004c20 con 0x7f87f0159d50 2023-12-17T11:49:37.174 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:37.173+0000 7f87e67fc640 1 --2- 172.21.15.40:0/705741963 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f87d406ae40 0x7f87d406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:37.174 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:37.173+0000 7f87e67fc640 1 -- 172.21.15.40:0/705741963 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f87e0089480 con 0x7f87f0159d50 2023-12-17T11:49:37.175 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:37.173+0000 7f87f5ec1640 1 --2- 172.21.15.40:0/705741963 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f87d406ae40 0x7f87d406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:37.176 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:37.175+0000 7f87f5ec1640 1 --2- 172.21.15.40:0/705741963 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f87d406ae40 0x7f87d406d300 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f87f01506b0 tx=0x7f87ec008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:49:37.179 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:37.177+0000 7f87e67fc640 1 -- 172.21.15.40:0/705741963 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f87e0054140 con 0x7f87f0159d50 2023-12-17T11:49:37.292 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T11:49:37.302 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T11:49:37.415 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:37.413+0000 7f87f8125640 1 -- 172.21.15.40:0/705741963 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f87f015bde0 con 0x7f87f0159d50 2023-12-17T11:49:37.416 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:37.414+0000 7f87e67fc640 1 -- 172.21.15.40:0/705741963 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4915 (secure 0 0 0) 0x7f87e0057760 con 0x7f87f0159d50 2023-12-17T11:49:37.416 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T11:49:37.416 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/3337931457","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":3337931457},{"type":"v1","addr":"172.21.15.40:6835","nonce":3337931457}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4257,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6833/1874601964","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6832","nonce":1874601964},{"type":"v1","addr":"172.21.15.40:6833","nonce":1874601964}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4267,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6836/3645037845","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6834","nonce":3645037845},{"type":"v1","addr":"172.21.15.159:6836","nonce":3645037845}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-17T11:48:17.696113+0000","modified":"2023-12-17T11:48:40.061005+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4270},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4270":{"gid":4270,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.159:6837/1288849778","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6835","nonce":1288849778},{"type":"v1","addr":"172.21.15.159:6837","nonce":1288849778}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-12-17T11:49:37.417 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 8 2023-12-17T11:49:37.419 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:37.417+0000 7f87f8125640 1 -- 172.21.15.40:0/705741963 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f87d406ae40 msgr2=0x7f87d406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:37.420 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:37.417+0000 7f87f8125640 1 --2- 172.21.15.40:0/705741963 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f87d406ae40 0x7f87d406d300 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f87f01506b0 tx=0x7f87ec008040 comp rx=0 tx=0).stop 2023-12-17T11:49:37.420 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:37.417+0000 7f87f8125640 1 -- 172.21.15.40:0/705741963 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f87f0159d50 msgr2=0x7f87f00af410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:37.420 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:37.417+0000 7f87f8125640 1 --2- 172.21.15.40:0/705741963 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f87f0159d50 0x7f87f00af410 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f87e000db70 tx=0x7f87e000b4a0 comp rx=0 tx=0).stop 2023-12-17T11:49:37.420 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:37.417+0000 7f87f8125640 1 -- 172.21.15.40:0/705741963 shutdown_connections 2023-12-17T11:49:37.420 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:37.417+0000 7f87f8125640 1 --2- 172.21.15.40:0/705741963 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f87d406ae40 0x7f87d406d300 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:37.420 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:37.417+0000 7f87f8125640 1 --2- 172.21.15.40:0/705741963 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f87f0146c10 0x7f87f00af950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:37.420 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:37.417+0000 7f87f8125640 1 --2- 172.21.15.40:0/705741963 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f87f0159d50 0x7f87f00af410 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:37.420 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:37.417+0000 7f87f8125640 1 --2- 172.21.15.40:0/705741963 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f87f0146830 0x7f87f014a640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:37.420 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:37.417+0000 7f87f8125640 1 -- 172.21.15.40:0/705741963 >> 172.21.15.40:0/705741963 conn(0x7f87f00b0a90 msgr2=0x7f87f00b0350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:49:37.420 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:37.417+0000 7f87f8125640 1 -- 172.21.15.40:0/705741963 shutdown_connections 2023-12-17T11:49:37.420 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:37.417+0000 7f87f8125640 1 -- 172.21.15.40:0/705741963 wait complete. 2023-12-17T11:49:37.439 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-17T11:49:37.715 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:37.713+0000 7f7417fff640 1 Processor -- start 2023-12-17T11:49:37.715 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:37.713+0000 7f7417fff640 1 -- start start 2023-12-17T11:49:37.716 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:37.714+0000 7f7417fff640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f74180d13c0 0x7f74180ce5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:37.717 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:37.714+0000 7f7417fff640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f74180d0d70 0x7f74180d17a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:37.717 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:37.714+0000 7f7417fff640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f74180cf6a0 0x7f74180cfb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:37.717 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:37.714+0000 7f7417fff640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74180b2280 con 0x7f74180d13c0 2023-12-17T11:49:37.717 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:37.714+0000 7f7417fff640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74180cee70 con 0x7f74180cf6a0 2023-12-17T11:49:37.717 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:37.714+0000 7f7417fff640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74180d1190 con 0x7f74180d0d70 2023-12-17T11:49:37.717 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:37.715+0000 7f7416ffd640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f74180d13c0 0x7f74180ce5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:37.717 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:37.715+0000 7f7416ffd640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f74180d13c0 0x7f74180ce5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:36890/0 (socket says 172.21.15.40:36890) 2023-12-17T11:49:37.717 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:37.715+0000 7f7416ffd640 1 -- 172.21.15.40:0/3271416176 learned_addr learned my addr 172.21.15.40:0/3271416176 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-17T11:49:37.717 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:37.715+0000 7f74177fe640 1 --2- 172.21.15.40:0/3271416176 >> v2:172.21.15.159:3300/0 conn(0x7f74180cf6a0 0x7f74180cfb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:37.718 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:37.715+0000 7f7416ffd640 1 -- 172.21.15.40:0/3271416176 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f74180d0d70 msgr2=0x7f74180d17a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:49:37.718 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:37.715+0000 7f7416ffd640 1 --2- 172.21.15.40:0/3271416176 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f74180d0d70 0x7f74180d17a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:37.718 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:37.715+0000 7f7416ffd640 1 -- 172.21.15.40:0/3271416176 >> v2:172.21.15.159:3300/0 conn(0x7f74180cf6a0 msgr2=0x7f74180cfb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:49:37.718 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:37.715+0000 7f7416ffd640 1 --2- 172.21.15.40:0/3271416176 >> v2:172.21.15.159:3300/0 conn(0x7f74180cf6a0 0x7f74180cfb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:37.718 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:37.715+0000 7f7416ffd640 1 -- 172.21.15.40:0/3271416176 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74180d1ce0 con 0x7f74180d13c0 2023-12-17T11:49:37.718 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:37.716+0000 7f7416ffd640 1 --2- 172.21.15.40:0/3271416176 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f74180d13c0 0x7f74180ce5b0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f74180cf2e0 tx=0x7f740802b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf75ebeb2fd28628 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:49:37.719 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:37.716+0000 7f7415ffb640 1 -- 172.21.15.40:0/3271416176 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74080317e0 con 0x7f74180d13c0 2023-12-17T11:49:37.719 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:37.717+0000 7f7415ffb640 1 -- 172.21.15.40:0/3271416176 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7408031940 con 0x7f74180d13c0 2023-12-17T11:49:37.719 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:37.717+0000 7f7415ffb640 1 -- 172.21.15.40:0/3271416176 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7408031cd0 con 0x7f74180d13c0 2023-12-17T11:49:37.719 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:37.717+0000 7f7417fff640 1 -- 172.21.15.40:0/3271416176 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f74180d13c0 msgr2=0x7f74180ce5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:37.719 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:37.717+0000 7f7417fff640 1 --2- 172.21.15.40:0/3271416176 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f74180d13c0 0x7f74180ce5b0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f74180cf2e0 tx=0x7f740802b880 comp rx=0 tx=0).stop 2023-12-17T11:49:37.720 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:37.717+0000 7f7417fff640 1 -- 172.21.15.40:0/3271416176 shutdown_connections 2023-12-17T11:49:37.720 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:37.717+0000 7f7417fff640 1 --2- 172.21.15.40:0/3271416176 >> v2:172.21.15.159:3300/0 conn(0x7f74180cf6a0 0x7f74180cfb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:37.720 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:37.717+0000 7f7417fff640 1 --2- 172.21.15.40:0/3271416176 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f74180d0d70 0x7f74180d17a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:37.720 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:37.717+0000 7f7417fff640 1 --2- 172.21.15.40:0/3271416176 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f74180d13c0 0x7f74180ce5b0 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:37.720 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:37.717+0000 7f7417fff640 1 -- 172.21.15.40:0/3271416176 >> 172.21.15.40:0/3271416176 conn(0x7f741809c260 msgr2=0x7f74180d2f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:49:37.720 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:37.718+0000 7f7417fff640 1 -- 172.21.15.40:0/3271416176 shutdown_connections 2023-12-17T11:49:37.720 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:37.718+0000 7f7417fff640 1 -- 172.21.15.40:0/3271416176 wait complete. 2023-12-17T11:49:37.721 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:37.719+0000 7f7417fff640 1 Processor -- start 2023-12-17T11:49:37.721 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:37.720+0000 7f7417fff640 1 -- start start 2023-12-17T11:49:37.723 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:37.721+0000 7f7417fff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f74180cf6a0 0x7f741806c280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:37.723 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:37.721+0000 7f7417fff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f74180d0d70 0x7f741806c7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:37.724 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:37.721+0000 7f7417fff640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f74180d13c0 0x7f74181faa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:37.724 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:37.721+0000 7f7417fff640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74180ca7c0 con 0x7f74180cf6a0 2023-12-17T11:49:37.724 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:37.721+0000 7f7417fff640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74180a0c90 con 0x7f74180d0d70 2023-12-17T11:49:37.724 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:37.721+0000 7f7417fff640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74180ccf40 con 0x7f74180d13c0 2023-12-17T11:49:37.724 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:37.721+0000 7f7416ffd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f74180cf6a0 0x7f741806c280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:37.724 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:37.721+0000 7f7416ffd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f74180cf6a0 0x7f741806c280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:36902/0 (socket says 172.21.15.40:36902) 2023-12-17T11:49:37.724 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:37.721+0000 7f7416ffd640 1 -- 172.21.15.40:0/786931840 learned_addr learned my addr 172.21.15.40:0/786931840 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-17T11:49:37.724 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:37.721+0000 7f7416ffd640 1 -- 172.21.15.40:0/786931840 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f74180d13c0 msgr2=0x7f74181faa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:37.724 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:37.721+0000 7f7416ffd640 1 --2- 172.21.15.40:0/786931840 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f74180d13c0 0x7f74181faa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:37.724 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:37.721+0000 7f7416ffd640 1 -- 172.21.15.40:0/786931840 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f74180d0d70 msgr2=0x7f741806c7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:37.724 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:37.721+0000 7f74167fc640 1 --2- 172.21.15.40:0/786931840 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f74180d0d70 0x7f741806c7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:37.724 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:37.721+0000 7f7416ffd640 1 --2- 172.21.15.40:0/786931840 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f74180d0d70 0x7f741806c7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:37.724 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:37.721+0000 7f7416ffd640 1 -- 172.21.15.40:0/786931840 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74080094d0 con 0x7f74180cf6a0 2023-12-17T11:49:37.724 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:37.721+0000 7f74167fc640 1 --2- 172.21.15.40:0/786931840 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f74180d0d70 0x7f741806c7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-17T11:49:37.725 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:37.722+0000 7f7416ffd640 1 --2- 172.21.15.40:0/786931840 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f74180cf6a0 0x7f741806c280 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f74080090b0 tx=0x7f74080046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:49:37.725 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:37.722+0000 7f740ffff640 1 -- 172.21.15.40:0/786931840 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7408032880 con 0x7f74180cf6a0 2023-12-17T11:49:37.725 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:37.722+0000 7f740ffff640 1 -- 172.21.15.40:0/786931840 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7408032a00 con 0x7f74180cf6a0 2023-12-17T11:49:37.725 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:37.722+0000 7f740ffff640 1 -- 172.21.15.40:0/786931840 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7408032db0 con 0x7f74180cf6a0 2023-12-17T11:49:37.726 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:37.722+0000 7f7417fff640 1 -- 172.21.15.40:0/786931840 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74180ccc60 con 0x7f74180cf6a0 2023-12-17T11:49:37.726 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:37.723+0000 7f7417fff640 1 -- 172.21.15.40:0/786931840 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74180ca3e0 con 0x7f74180cf6a0 2023-12-17T11:49:37.726 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:37.724+0000 7f7417fff640 1 -- 172.21.15.40:0/786931840 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74180ca900 con 0x7f74180cf6a0 2023-12-17T11:49:37.726 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:37.725+0000 7f740ffff640 1 -- 172.21.15.40:0/786931840 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f740804d3f0 con 0x7f74180cf6a0 2023-12-17T11:49:37.727 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:37.726+0000 7f740ffff640 1 --2- 172.21.15.40:0/786931840 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f73f806ae40 0x7f73f806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:37.728 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:37.726+0000 7f740ffff640 1 -- 172.21.15.40:0/786931840 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f74080ab880 con 0x7f74180cf6a0 2023-12-17T11:49:37.728 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:37.726+0000 7f74167fc640 1 --2- 172.21.15.40:0/786931840 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f73f806ae40 0x7f73f806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:37.729 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:37.727+0000 7f74167fc640 1 --2- 172.21.15.40:0/786931840 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f73f806ae40 0x7f73f806d300 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f74181fa550 tx=0x7f74000073c0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:49:37.732 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:37.730+0000 7f740ffff640 1 -- 172.21.15.40:0/786931840 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f74180ca900 con 0x7f74180cf6a0 2023-12-17T11:49:37.970 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:37.967+0000 7f7417fff640 1 -- 172.21.15.40:0/786931840 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f74180ca900 con 0x7f74180cf6a0 2023-12-17T11:49:37.971 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:37.969+0000 7f740ffff640 1 -- 172.21.15.40:0/786931840 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4915 (secure 0 0 0) 0x7f7408076540 con 0x7f74180cf6a0 2023-12-17T11:49:37.971 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T11:49:37.971 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/3337931457","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":3337931457},{"type":"v1","addr":"172.21.15.40:6835","nonce":3337931457}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4257,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6833/1874601964","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6832","nonce":1874601964},{"type":"v1","addr":"172.21.15.40:6833","nonce":1874601964}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4267,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6836/3645037845","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6834","nonce":3645037845},{"type":"v1","addr":"172.21.15.159:6836","nonce":3645037845}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-17T11:48:17.696113+0000","modified":"2023-12-17T11:48:40.061005+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4270},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4270":{"gid":4270,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.159:6837/1288849778","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6835","nonce":1288849778},{"type":"v1","addr":"172.21.15.159:6837","nonce":1288849778}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-12-17T11:49:37.971 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 8 2023-12-17T11:49:37.974 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:37.971+0000 7f7417fff640 1 -- 172.21.15.40:0/786931840 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f73f806ae40 msgr2=0x7f73f806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:37.974 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:37.971+0000 7f7417fff640 1 --2- 172.21.15.40:0/786931840 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f73f806ae40 0x7f73f806d300 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f74181fa550 tx=0x7f74000073c0 comp rx=0 tx=0).stop 2023-12-17T11:49:37.974 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:37.971+0000 7f7417fff640 1 -- 172.21.15.40:0/786931840 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f74180cf6a0 msgr2=0x7f741806c280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:37.974 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:37.971+0000 7f7417fff640 1 --2- 172.21.15.40:0/786931840 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f74180cf6a0 0x7f741806c280 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f74080090b0 tx=0x7f74080046c0 comp rx=0 tx=0).stop 2023-12-17T11:49:37.974 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:37.972+0000 7f7417fff640 1 -- 172.21.15.40:0/786931840 shutdown_connections 2023-12-17T11:49:37.974 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:37.972+0000 7f7417fff640 1 --2- 172.21.15.40:0/786931840 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f73f806ae40 0x7f73f806d300 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:37.974 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:37.972+0000 7f7417fff640 1 --2- 172.21.15.40:0/786931840 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f74180d13c0 0x7f74181faa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:37.974 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:37.972+0000 7f7417fff640 1 --2- 172.21.15.40:0/786931840 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f74180d0d70 0x7f741806c7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:37.974 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:37.972+0000 7f7417fff640 1 --2- 172.21.15.40:0/786931840 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f74180cf6a0 0x7f741806c280 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:37.975 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:37.972+0000 7f7417fff640 1 -- 172.21.15.40:0/786931840 >> 172.21.15.40:0/786931840 conn(0x7f741809c260 msgr2=0x7f74180b5fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:49:37.975 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:37.972+0000 7f7417fff640 1 -- 172.21.15.40:0/786931840 shutdown_connections 2023-12-17T11:49:37.975 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:37.972+0000 7f7417fff640 1 -- 172.21.15.40:0/786931840 wait complete. 2023-12-17T11:49:37.994 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-17T11:49:38.213 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:38.210+0000 7fb00a09b640 1 Processor -- start 2023-12-17T11:49:38.213 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:38.211+0000 7fb00a09b640 1 -- start start 2023-12-17T11:49:38.214 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:38.212+0000 7fb00a09b640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fb00415b440 0x7fb0040ce120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:38.214 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:38.212+0000 7fb00a09b640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7fb0040cf710 0x7fb0040adc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:38.214 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:38.212+0000 7fb00a09b640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0040cb9a0 con 0x7fb0040d1b40 2023-12-17T11:49:38.214 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:38.212+0000 7fb00a09b640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0040cbc40 con 0x7fb00415b440 2023-12-17T11:49:38.215 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:38.212+0000 7fb00a09b640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0040cbf20 con 0x7fb0040cf710 2023-12-17T11:49:38.215 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:38.213+0000 7fb0037fe640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fb00415b440 0x7fb0040ce120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:38.215 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:38.213+0000 7fb0037fe640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fb00415b440 0x7fb0040ce120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:36904/0 (socket says 172.21.15.40:36904) 2023-12-17T11:49:38.216 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:38.213+0000 7fb0037fe640 1 -- 172.21.15.40:0/404458183 learned_addr learned my addr 172.21.15.40:0/404458183 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-17T11:49:38.216 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:38.213+0000 7faffbfff640 1 --1- 172.21.15.40:0/404458183 >> v1:172.21.15.159:6789/0 conn(0x7fb0040d1b40 0x7fb0040cf000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.159:6789/0 says I am v1:172.21.15.40:45934/0 (socket says 172.21.15.40:45934) 2023-12-17T11:49:38.216 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:38.213+0000 7fb003fff640 1 --2- 172.21.15.40:0/404458183 >> v2:172.21.15.159:3300/0 conn(0x7fb0040cf710 0x7fb0040adc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:38.216 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:38.213+0000 7fb0037fe640 1 -- 172.21.15.40:0/404458183 >> v2:172.21.15.159:3300/0 conn(0x7fb0040cf710 msgr2=0x7fb0040adc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:49:38.216 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:38.213+0000 7fb0037fe640 1 --2- 172.21.15.40:0/404458183 >> v2:172.21.15.159:3300/0 conn(0x7fb0040cf710 0x7fb0040adc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:38.216 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:38.213+0000 7fb0037fe640 1 -- 172.21.15.40:0/404458183 >> v1:172.21.15.159:6789/0 conn(0x7fb0040d1b40 legacy=0x7fb0040cf000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:38.216 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:38.214+0000 7fb0037fe640 1 -- 172.21.15.40:0/404458183 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0040cc200 con 0x7fb00415b440 2023-12-17T11:49:38.216 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:38.214+0000 7fb003fff640 1 --2- 172.21.15.40:0/404458183 >> v2:172.21.15.159:3300/0 conn(0x7fb0040cf710 0x7fb0040adc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-17T11:49:38.217 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:38.215+0000 7fb0037fe640 1 --2- 172.21.15.40:0/404458183 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb00415b440 0x7fb0040ce120 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fb00409aa80 tx=0x7faff402b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b8205c93c8d8fae server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:49:38.217 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:38.216+0000 7fb002ffd640 1 -- 172.21.15.40:0/404458183 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faff4030860 con 0x7fb00415b440 2023-12-17T11:49:38.218 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:38.216+0000 7fb002ffd640 1 -- 172.21.15.40:0/404458183 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faff40309c0 con 0x7fb00415b440 2023-12-17T11:49:38.218 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:38.216+0000 7fb002ffd640 1 -- 172.21.15.40:0/404458183 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faff4030d50 con 0x7fb00415b440 2023-12-17T11:49:38.219 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:38.216+0000 7fb00a09b640 1 -- 172.21.15.40:0/404458183 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb00415b440 msgr2=0x7fb0040ce120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:38.219 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:38.216+0000 7fb00a09b640 1 --2- 172.21.15.40:0/404458183 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb00415b440 0x7fb0040ce120 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fb00409aa80 tx=0x7faff402b9a0 comp rx=0 tx=0).stop 2023-12-17T11:49:38.219 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:38.217+0000 7fb00a09b640 1 -- 172.21.15.40:0/404458183 shutdown_connections 2023-12-17T11:49:38.219 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:38.217+0000 7fb00a09b640 1 --2- 172.21.15.40:0/404458183 >> v2:172.21.15.159:3300/0 conn(0x7fb0040cf710 0x7fb0040adc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:38.219 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:38.217+0000 7fb00a09b640 1 --2- 172.21.15.40:0/404458183 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb00415b440 0x7fb0040ce120 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:38.219 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:38.217+0000 7fb00a09b640 1 -- 172.21.15.40:0/404458183 >> 172.21.15.40:0/404458183 conn(0x7fb0040d0e90 msgr2=0x7fb0040d12a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:49:38.219 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:38.217+0000 7fb00a09b640 1 -- 172.21.15.40:0/404458183 shutdown_connections 2023-12-17T11:49:38.219 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:38.217+0000 7fb00a09b640 1 -- 172.21.15.40:0/404458183 wait complete. 2023-12-17T11:49:38.220 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:38.219+0000 7fb00a09b640 1 Processor -- start 2023-12-17T11:49:38.221 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:38.219+0000 7fb00a09b640 1 -- start start 2023-12-17T11:49:38.222 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:38.220+0000 7fb00a09b640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb0040cf710 0x7fb0040c7660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:38.222 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:38.220+0000 7fb00a09b640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb0040d1b40 0x7fb0040c5de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:38.222 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:38.220+0000 7fb00a09b640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb00415b440 0x7fb00406f530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:38.222 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:38.220+0000 7fb00a09b640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb00415a340 con 0x7fb0040cf710 2023-12-17T11:49:38.223 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:38.220+0000 7fb00a09b640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0040c71d0 con 0x7fb00415b440 2023-12-17T11:49:38.223 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:38.220+0000 7fb00a09b640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0040c6320 con 0x7fb0040d1b40 2023-12-17T11:49:38.223 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:38.220+0000 7fb0037fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb0040cf710 0x7fb0040c7660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:38.223 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:38.220+0000 7fb0037fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb0040cf710 0x7fb0040c7660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:36916/0 (socket says 172.21.15.40:36916) 2023-12-17T11:49:38.223 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:38.220+0000 7fb0037fe640 1 -- 172.21.15.40:0/4132891102 learned_addr learned my addr 172.21.15.40:0/4132891102 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-17T11:49:38.223 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:38.220+0000 7faffbfff640 1 --2- 172.21.15.40:0/4132891102 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb0040d1b40 0x7fb0040c5de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:38.223 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:38.221+0000 7fb003fff640 1 --2- 172.21.15.40:0/4132891102 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb00415b440 0x7fb00406f530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:38.224 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:38.221+0000 7fb0037fe640 1 -- 172.21.15.40:0/4132891102 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb0040d1b40 msgr2=0x7fb0040c5de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:38.224 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:38.221+0000 7fb0037fe640 1 --2- 172.21.15.40:0/4132891102 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb0040d1b40 0x7fb0040c5de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:38.224 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:38.221+0000 7fb0037fe640 1 -- 172.21.15.40:0/4132891102 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb00415b440 msgr2=0x7fb00406f530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:38.224 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:38.221+0000 7fb0037fe640 1 --2- 172.21.15.40:0/4132891102 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb00415b440 0x7fb00406f530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:38.224 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:38.221+0000 7fb0037fe640 1 -- 172.21.15.40:0/4132891102 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faff40094d0 con 0x7fb0040cf710 2023-12-17T11:49:38.224 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:38.221+0000 7fb0037fe640 1 --2- 172.21.15.40:0/4132891102 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb0040cf710 0x7fb0040c7660 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7faff402b9e0 tx=0x7faff4004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:49:38.225 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:38.221+0000 7fb000ff9640 1 -- 172.21.15.40:0/4132891102 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faff4039d60 con 0x7fb0040cf710 2023-12-17T11:49:38.225 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:38.222+0000 7fb000ff9640 1 -- 172.21.15.40:0/4132891102 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faff4043400 con 0x7fb0040cf710 2023-12-17T11:49:38.225 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:38.222+0000 7fb000ff9640 1 -- 172.21.15.40:0/4132891102 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faff40437b0 con 0x7fb0040cf710 2023-12-17T11:49:38.225 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:38.222+0000 7fb00a09b640 1 -- 172.21.15.40:0/4132891102 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0040c65c0 con 0x7fb0040cf710 2023-12-17T11:49:38.225 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:38.222+0000 7fb00a09b640 1 -- 172.21.15.40:0/4132891102 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0040c6b80 con 0x7fb0040cf710 2023-12-17T11:49:38.225 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:38.223+0000 7fb00a09b640 1 -- 172.21.15.40:0/4132891102 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0040745d0 con 0x7fb0040cf710 2023-12-17T11:49:38.230 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:38.224+0000 7fb000ff9640 1 -- 172.21.15.40:0/4132891102 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7faff4043910 con 0x7fb0040cf710 2023-12-17T11:49:38.230 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:38.225+0000 7fb000ff9640 1 --2- 172.21.15.40:0/4132891102 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7fafe406f250 0x7fafe4071710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:38.230 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:38.226+0000 7fb000ff9640 1 -- 172.21.15.40:0/4132891102 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6692+0+0 (secure 0 0 0) 0x7faff403e070 con 0x7fb0040cf710 2023-12-17T11:49:38.230 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:38.226+0000 7faffbfff640 1 --2- 172.21.15.40:0/4132891102 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7fafe406f250 0x7fafe4071710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:38.230 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:38.227+0000 7faffbfff640 1 --2- 172.21.15.40:0/4132891102 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7fafe406f250 0x7fafe4071710 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fb0040c4910 tx=0x7fafec000ed0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:49:38.232 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:38.230+0000 7fb000ff9640 1 -- 172.21.15.40:0/4132891102 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7faff4077970 con 0x7fb0040cf710 2023-12-17T11:49:38.432 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:38.430+0000 7fb00a09b640 1 -- 172.21.15.40:0/4132891102 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb0040b6e10 con 0x7fb0040cf710 2023-12-17T11:49:38.435 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:38.433+0000 7fb000ff9640 1 -- 172.21.15.40:0/4132891102 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+18697 (secure 0 0 0) 0x7faff407af90 con 0x7fb0040cf710 2023-12-17T11:49:38.436 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T11:49:38.436 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":27,"fsid":"099cd35d-80d9-4ca4-8424-de13b3b03ac7","created":"2023-12-17T11:47:53.450097+0000","modified":"2023-12-17T11:49:00.483840+0000","last_up_change":"2023-12-17T11:48:05.724195+0000","last_in_change":"2023-12-17T11:47:56.956499+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-17T11:48:06.668943+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-17T11:48:16.151444+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-17T11:48:16.717726+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-17T11:48:20.534819+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a88bfd46-63b8-48b1-9c0e-5c9cdc31bd38","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":555204741},{"type":"v1","addr":"172.21.15.40:6802","nonce":555204741}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":555204741},{"type":"v1","addr":"172.21.15.40:6807","nonce":555204741}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":555204741},{"type":"v1","addr":"172.21.15.40:6815","nonce":555204741}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6809","nonce":555204741},{"type":"v1","addr":"172.21.15.40:6812","nonce":555204741}]},"public_addr":"172.21.15.40:6802/555204741","cluster_addr":"172.21.15.40:6807/555204741","heartbeat_back_addr":"172.21.15.40:6815/555204741","heartbeat_front_addr":"172.21.15.40:6812/555204741","state":["exists","up"]},{"osd":1,"uuid":"c5d628ae-36f4-4866-802c-b162f0e90add","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6801","nonce":1221318112},{"type":"v1","addr":"172.21.15.40:6803","nonce":1221318112}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6805","nonce":1221318112},{"type":"v1","addr":"172.21.15.40:6806","nonce":1221318112}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6811","nonce":1221318112},{"type":"v1","addr":"172.21.15.40:6813","nonce":1221318112}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":1221318112},{"type":"v1","addr":"172.21.15.40:6810","nonce":1221318112}]},"public_addr":"172.21.15.40:6803/1221318112","cluster_addr":"172.21.15.40:6806/1221318112","heartbeat_back_addr":"172.21.15.40:6813/1221318112","heartbeat_front_addr":"172.21.15.40:6810/1221318112","state":["exists","up"]},{"osd":2,"uuid":"d986ad6a-af2f-47fc-9c3b-fbda27b82b73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":1959000265},{"type":"v1","addr":"172.21.15.40:6817","nonce":1959000265}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6818","nonce":1959000265},{"type":"v1","addr":"172.21.15.40:6819","nonce":1959000265}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":1959000265},{"type":"v1","addr":"172.21.15.40:6827","nonce":1959000265}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":1959000265},{"type":"v1","addr":"172.21.15.40:6822","nonce":1959000265}]},"public_addr":"172.21.15.40:6817/1959000265","cluster_addr":"172.21.15.40:6819/1959000265","heartbeat_back_addr":"172.21.15.40:6827/1959000265","heartbeat_front_addr":"172.21.15.40:6822/1959000265","state":["exists","up"]},{"osd":3,"uuid":"d79d22b7-be05-41b2-b95d-697db677fd02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6821","nonce":974040287},{"type":"v1","addr":"172.21.15.40:6823","nonce":974040287}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6825","nonce":974040287},{"type":"v1","addr":"172.21.15.40:6826","nonce":974040287}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":974040287},{"type":"v1","addr":"172.21.15.40:6831","nonce":974040287}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":974040287},{"type":"v1","addr":"172.21.15.40:6829","nonce":974040287}]},"public_addr":"172.21.15.40:6823/974040287","cluster_addr":"172.21.15.40:6826/974040287","heartbeat_back_addr":"172.21.15.40:6831/974040287","heartbeat_front_addr":"172.21.15.40:6829/974040287","state":["exists","up"]},{"osd":4,"uuid":"62a7a233-d3ea-40be-91de-180c0208d639","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6808","nonce":3937787733},{"type":"v1","addr":"172.21.15.159:6809","nonce":3937787733}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6810","nonce":3937787733},{"type":"v1","addr":"172.21.15.159:6811","nonce":3937787733}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6814","nonce":3937787733},{"type":"v1","addr":"172.21.15.159:6815","nonce":3937787733}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6812","nonce":3937787733},{"type":"v1","addr":"172.21.15.159:6813","nonce":3937787733}]},"public_addr":"172.21.15.159:6809/3937787733","cluster_addr":"172.21.15.159:6811/3937787733","heartbeat_back_addr":"172.21.15.159:6815/3937787733","heartbeat_front_addr":"172.21.15.159:6813/3937787733","state":["exists","up"]},{"osd":5,"uuid":"84629cea-dc0e-4b5e-b203-5ea963839281","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6816","nonce":3032505240},{"type":"v1","addr":"172.21.15.159:6817","nonce":3032505240}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6818","nonce":3032505240},{"type":"v1","addr":"172.21.15.159:6819","nonce":3032505240}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6822","nonce":3032505240},{"type":"v1","addr":"172.21.15.159:6823","nonce":3032505240}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6820","nonce":3032505240},{"type":"v1","addr":"172.21.15.159:6821","nonce":3032505240}]},"public_addr":"172.21.15.159:6817/3032505240","cluster_addr":"172.21.15.159:6819/3032505240","heartbeat_back_addr":"172.21.15.159:6823/3032505240","heartbeat_front_addr":"172.21.15.159:6821/3032505240","state":["exists","up"]},{"osd":6,"uuid":"4ae3af3a-1743-4070-a91d-8be5c31cdb04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6800","nonce":2411788597},{"type":"v1","addr":"172.21.15.159:6801","nonce":2411788597}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6802","nonce":2411788597},{"type":"v1","addr":"172.21.15.159:6803","nonce":2411788597}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6806","nonce":2411788597},{"type":"v1","addr":"172.21.15.159:6807","nonce":2411788597}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6804","nonce":2411788597},{"type":"v1","addr":"172.21.15.159:6805","nonce":2411788597}]},"public_addr":"172.21.15.159:6801/2411788597","cluster_addr":"172.21.15.159:6803/2411788597","heartbeat_back_addr":"172.21.15.159:6807/2411788597","heartbeat_front_addr":"172.21.15.159:6805/2411788597","state":["exists","up"]},{"osd":7,"uuid":"c1f4c7f2-8f75-4f95-bc63-a332773e3b8e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6824","nonce":478953349},{"type":"v1","addr":"172.21.15.159:6825","nonce":478953349}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6826","nonce":478953349},{"type":"v1","addr":"172.21.15.159:6827","nonce":478953349}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6830","nonce":478953349},{"type":"v1","addr":"172.21.15.159:6831","nonce":478953349}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6828","nonce":478953349},{"type":"v1","addr":"172.21.15.159:6829","nonce":478953349}]},"public_addr":"172.21.15.159:6825/478953349","cluster_addr":"172.21.15.159:6827/478953349","heartbeat_back_addr":"172.21.15.159:6831/478953349","heartbeat_front_addr":"172.21.15.159:6829/478953349","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T11:48:02.023567+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T11:48:02.278216+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T11:48:02.311843+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T11:48:01.773372+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T11:48:02.618910+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T11:48:02.361559+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T11:48:02.223997+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T11:48:02.604403+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.2","mappings":[{"from":3,"to":2}]},{"pgid":"3.d","mappings":[{"from":5,"to":1}]},{"pgid":"3.13","mappings":[{"from":7,"to":2}]},{"pgid":"3.17","mappings":[{"from":0,"to":2}]},{"pgid":"3.38","mappings":[{"from":5,"to":1}]},{"pgid":"4.2","mappings":[{"from":1,"to":2}]},{"pgid":"4.10","mappings":[{"from":1,"to":2}]},{"pgid":"4.18","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-17T11:49:38.438 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:38.436+0000 7fb00a09b640 1 -- 172.21.15.40:0/4132891102 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7fafe406f250 msgr2=0x7fafe4071710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:38.438 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:38.436+0000 7fb00a09b640 1 --2- 172.21.15.40:0/4132891102 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7fafe406f250 0x7fafe4071710 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fb0040c4910 tx=0x7fafec000ed0 comp rx=0 tx=0).stop 2023-12-17T11:49:38.439 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:38.436+0000 7fb00a09b640 1 -- 172.21.15.40:0/4132891102 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb0040cf710 msgr2=0x7fb0040c7660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:38.439 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:38.436+0000 7fb00a09b640 1 --2- 172.21.15.40:0/4132891102 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb0040cf710 0x7fb0040c7660 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7faff402b9e0 tx=0x7faff4004730 comp rx=0 tx=0).stop 2023-12-17T11:49:38.439 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:38.436+0000 7fb00a09b640 1 -- 172.21.15.40:0/4132891102 shutdown_connections 2023-12-17T11:49:38.439 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:38.436+0000 7fb00a09b640 1 --2- 172.21.15.40:0/4132891102 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7fafe406f250 0x7fafe4071710 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:38.439 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:38.436+0000 7fb00a09b640 1 --2- 172.21.15.40:0/4132891102 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb00415b440 0x7fb00406f530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:38.439 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:38.436+0000 7fb00a09b640 1 --2- 172.21.15.40:0/4132891102 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb0040d1b40 0x7fb0040c5de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:38.439 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:38.436+0000 7fb00a09b640 1 --2- 172.21.15.40:0/4132891102 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb0040cf710 0x7fb0040c7660 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:38.439 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:38.436+0000 7fb00a09b640 1 -- 172.21.15.40:0/4132891102 >> 172.21.15.40:0/4132891102 conn(0x7fb0040d0e90 msgr2=0x7fb0040adc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:49:38.439 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:38.436+0000 7fb00a09b640 1 -- 172.21.15.40:0/4132891102 shutdown_connections 2023-12-17T11:49:38.439 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:38.436+0000 7fb00a09b640 1 -- 172.21.15.40:0/4132891102 wait complete. 2023-12-17T11:49:38.459 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-12-17T11:49:38.678 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:38.676+0000 7fd1bf383640 1 Processor -- start 2023-12-17T11:49:38.678 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:38.676+0000 7fd1bf383640 1 -- start start 2023-12-17T11:49:38.680 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:38.677+0000 7fd1bf383640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd1b80ae200 0x7fd1b8070b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:38.680 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:38.677+0000 7fd1bf383640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fd1b80abd20 0x7fd1b8071090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:38.680 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:38.677+0000 7fd1bf383640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1b8071f90 con 0x7fd1b815e5d0 2023-12-17T11:49:38.680 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:38.677+0000 7fd1bf383640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1b8072270 con 0x7fd1b80abd20 2023-12-17T11:49:38.680 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:38.677+0000 7fd1bf383640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1b8070070 con 0x7fd1b80ae200 2023-12-17T11:49:38.680 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:38.678+0000 7fd1beb82640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fd1b80abd20 0x7fd1b8071090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:38.680 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:38.678+0000 7fd1beb82640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fd1b80abd20 0x7fd1b8071090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:36918/0 (socket says 172.21.15.40:36918) 2023-12-17T11:49:38.680 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:38.678+0000 7fd1beb82640 1 -- 172.21.15.40:0/1003622452 learned_addr learned my addr 172.21.15.40:0/1003622452 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-17T11:49:38.681 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:38.678+0000 7fd1beb82640 1 -- 172.21.15.40:0/1003622452 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd1b80ae200 msgr2=0x7fd1b8070b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:49:38.681 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:38.678+0000 7fd1beb82640 1 --2- 172.21.15.40:0/1003622452 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd1b80ae200 0x7fd1b8070b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:38.681 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:38.678+0000 7fd1beb82640 1 -- 172.21.15.40:0/1003622452 >> v1:172.21.15.159:6789/0 conn(0x7fd1b815e5d0 legacy=0x7fd1b806bdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:49:38.681 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:38.678+0000 7fd1beb82640 1 -- 172.21.15.40:0/1003622452 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1b8070350 con 0x7fd1b80abd20 2023-12-17T11:49:38.681 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:38.680+0000 7fd1beb82640 1 --2- 172.21.15.40:0/1003622452 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd1b80abd20 0x7fd1b8071090 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fd1b0009e50 tx=0x7fd1b002bdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56c82b698414e89c server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:49:38.682 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:38.680+0000 7fd1bd37f640 1 -- 172.21.15.40:0/1003622452 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1b002c950 con 0x7fd1b80abd20 2023-12-17T11:49:38.682 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:38.680+0000 7fd1bd37f640 1 -- 172.21.15.40:0/1003622452 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1b002cab0 con 0x7fd1b80abd20 2023-12-17T11:49:38.682 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:38.680+0000 7fd1bd37f640 1 -- 172.21.15.40:0/1003622452 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1b002ce40 con 0x7fd1b80abd20 2023-12-17T11:49:38.683 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:38.681+0000 7fd1bf383640 1 -- 172.21.15.40:0/1003622452 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd1b80abd20 msgr2=0x7fd1b8071090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:38.683 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:38.681+0000 7fd1bf383640 1 --2- 172.21.15.40:0/1003622452 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd1b80abd20 0x7fd1b8071090 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fd1b0009e50 tx=0x7fd1b002bdb0 comp rx=0 tx=0).stop 2023-12-17T11:49:38.683 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:38.681+0000 7fd1bf383640 1 -- 172.21.15.40:0/1003622452 shutdown_connections 2023-12-17T11:49:38.683 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:38.681+0000 7fd1bf383640 1 --2- 172.21.15.40:0/1003622452 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd1b80abd20 0x7fd1b8071090 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:38.683 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:38.681+0000 7fd1bf383640 1 --2- 172.21.15.40:0/1003622452 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd1b80ae200 0x7fd1b8070b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:38.683 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:38.681+0000 7fd1bf383640 1 -- 172.21.15.40:0/1003622452 >> 172.21.15.40:0/1003622452 conn(0x7fd1b80b0860 msgr2=0x7fd1b80b0c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:49:38.683 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:38.681+0000 7fd1bf383640 1 -- 172.21.15.40:0/1003622452 shutdown_connections 2023-12-17T11:49:38.683 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:38.681+0000 7fd1bf383640 1 -- 172.21.15.40:0/1003622452 wait complete. 2023-12-17T11:49:38.685 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:38.683+0000 7fd1bf383640 1 Processor -- start 2023-12-17T11:49:38.685 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:38.683+0000 7fd1bf383640 1 -- start start 2023-12-17T11:49:38.687 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:38.684+0000 7fd1bf383640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd1b80abd20 0x7fd1b814e540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:38.687 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:38.684+0000 7fd1bf383640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd1b80ae200 0x7fd1b81f5fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:38.687 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:38.684+0000 7fd1bf383640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd1b815e5d0 0x7fd1b815cc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:38.687 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:38.684+0000 7fd1bf383640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1b8156480 con 0x7fd1b80abd20 2023-12-17T11:49:38.687 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:38.684+0000 7fd1bf383640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1b81f6980 con 0x7fd1b80ae200 2023-12-17T11:49:38.687 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:38.684+0000 7fd1bf383640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1b81f6c60 con 0x7fd1b815e5d0 2023-12-17T11:49:38.687 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:38.684+0000 7fd1be381640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd1b80abd20 0x7fd1b814e540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:38.688 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:38.684+0000 7fd1be381640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd1b80abd20 0x7fd1b814e540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:36934/0 (socket says 172.21.15.40:36934) 2023-12-17T11:49:38.688 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:38.685+0000 7fd1be381640 1 -- 172.21.15.40:0/3590586942 learned_addr learned my addr 172.21.15.40:0/3590586942 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-17T11:49:38.688 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:38.685+0000 7fd1bdb80640 1 --2- 172.21.15.40:0/3590586942 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd1b80ae200 0x7fd1b81f5fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:38.688 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:38.685+0000 7fd1beb82640 1 --2- 172.21.15.40:0/3590586942 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd1b815e5d0 0x7fd1b815cc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:38.688 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:38.685+0000 7fd1be381640 1 -- 172.21.15.40:0/3590586942 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd1b815e5d0 msgr2=0x7fd1b815cc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:38.688 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:38.685+0000 7fd1be381640 1 --2- 172.21.15.40:0/3590586942 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd1b815e5d0 0x7fd1b815cc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:38.688 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:38.685+0000 7fd1be381640 1 -- 172.21.15.40:0/3590586942 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd1b80ae200 msgr2=0x7fd1b81f5fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:38.688 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:38.685+0000 7fd1be381640 1 --2- 172.21.15.40:0/3590586942 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd1b80ae200 0x7fd1b81f5fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:38.688 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:38.685+0000 7fd1be381640 1 -- 172.21.15.40:0/3590586942 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1b0009b30 con 0x7fd1b80abd20 2023-12-17T11:49:38.688 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:38.685+0000 7fd1beb82640 1 --2- 172.21.15.40:0/3590586942 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd1b815e5d0 0x7fd1b815cc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-17T11:49:38.688 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:38.685+0000 7fd1be381640 1 --2- 172.21.15.40:0/3590586942 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd1b80abd20 0x7fd1b814e540 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fd1b400c410 tx=0x7fd1b400c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:49:38.689 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:38.686+0000 7fd1aeffd640 1 -- 172.21.15.40:0/3590586942 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1b40035f0 con 0x7fd1b80abd20 2023-12-17T11:49:38.689 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:38.686+0000 7fd1aeffd640 1 -- 172.21.15.40:0/3590586942 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1b4003750 con 0x7fd1b80abd20 2023-12-17T11:49:38.689 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:38.686+0000 7fd1bf383640 1 -- 172.21.15.40:0/3590586942 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1b806c680 con 0x7fd1b80abd20 2023-12-17T11:49:38.689 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:38.686+0000 7fd1aeffd640 1 -- 172.21.15.40:0/3590586942 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1b4003b40 con 0x7fd1b80abd20 2023-12-17T11:49:38.689 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:38.686+0000 7fd1bf383640 1 -- 172.21.15.40:0/3590586942 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1b814ea80 con 0x7fd1b80abd20 2023-12-17T11:49:38.689 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:38.687+0000 7fd1bf383640 1 -- 172.21.15.40:0/3590586942 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1b814ec40 con 0x7fd1b80abd20 2023-12-17T11:49:38.690 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:38.688+0000 7fd1aeffd640 1 -- 172.21.15.40:0/3590586942 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fd1b4003ca0 con 0x7fd1b80abd20 2023-12-17T11:49:38.691 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:38.689+0000 7fd1aeffd640 1 --2- 172.21.15.40:0/3590586942 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7fd19c06ae40 0x7fd19c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:38.691 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:38.689+0000 7fd1aeffd640 1 -- 172.21.15.40:0/3590586942 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6692+0+0 (secure 0 0 0) 0x7fd1b40890f0 con 0x7fd1b80abd20 2023-12-17T11:49:38.691 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:38.690+0000 7fd1bdb80640 1 --2- 172.21.15.40:0/3590586942 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7fd19c06ae40 0x7fd19c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:38.693 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:38.691+0000 7fd1bdb80640 1 --2- 172.21.15.40:0/3590586942 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7fd19c06ae40 0x7fd19c06d300 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fd1b8156290 tx=0x7fd1a8008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:49:38.696 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:38.694+0000 7fd1aeffd640 1 -- 172.21.15.40:0/3590586942 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fd1b4053d20 con 0x7fd1b80abd20 2023-12-17T11:49:38.931 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:38.929+0000 7fd1bf383640 1 -- 172.21.15.40:0/3590586942 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fd1b81f6e80 con 0x7fd1b80abd20 2023-12-17T11:49:38.933 INFO:tasks.ceph.mon.a.smithi040.stderr:2023-12-17T11:49:38.931+0000 7fed3ee18640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-12-17T11:49:38.937 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:38.935+0000 7fd1aeffd640 1 -- 172.21.15.40:0/3590586942 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v9) v1 ==== 161+0+0 (secure 0 0 0) 0x7fd1b4017090 con 0x7fd1b80abd20 2023-12-17T11:49:38.937 INFO:teuthology.orchestra.run.smithi040.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-12-17T11:49:38.940 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:38.937+0000 7fd1bf383640 1 -- 172.21.15.40:0/3590586942 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7fd19c06ae40 msgr2=0x7fd19c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:38.940 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:38.938+0000 7fd1bf383640 1 --2- 172.21.15.40:0/3590586942 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7fd19c06ae40 0x7fd19c06d300 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fd1b8156290 tx=0x7fd1a8008040 comp rx=0 tx=0).stop 2023-12-17T11:49:38.941 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:38.938+0000 7fd1bf383640 1 -- 172.21.15.40:0/3590586942 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd1b80abd20 msgr2=0x7fd1b814e540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:38.941 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:38.938+0000 7fd1bf383640 1 --2- 172.21.15.40:0/3590586942 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd1b80abd20 0x7fd1b814e540 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fd1b400c410 tx=0x7fd1b400c8d0 comp rx=0 tx=0).stop 2023-12-17T11:49:38.941 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:38.938+0000 7fd1bf383640 1 -- 172.21.15.40:0/3590586942 shutdown_connections 2023-12-17T11:49:38.941 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:38.938+0000 7fd1bf383640 1 --2- 172.21.15.40:0/3590586942 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7fd19c06ae40 0x7fd19c06d300 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:38.941 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:38.938+0000 7fd1bf383640 1 --2- 172.21.15.40:0/3590586942 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd1b815e5d0 0x7fd1b815cc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:38.941 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:38.938+0000 7fd1bf383640 1 --2- 172.21.15.40:0/3590586942 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd1b80ae200 0x7fd1b81f5fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:38.941 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:38.938+0000 7fd1bf383640 1 --2- 172.21.15.40:0/3590586942 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd1b80abd20 0x7fd1b814e540 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:38.941 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:38.938+0000 7fd1bf383640 1 -- 172.21.15.40:0/3590586942 >> 172.21.15.40:0/3590586942 conn(0x7fd1b80b0860 msgr2=0x7fd1b806cff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:49:38.941 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:38.938+0000 7fd1bf383640 1 -- 172.21.15.40:0/3590586942 shutdown_connections 2023-12-17T11:49:38.941 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:38.938+0000 7fd1bf383640 1 -- 172.21.15.40:0/3590586942 wait complete. 2023-12-17T11:49:38.961 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-12-17T11:49:38.972 INFO:tasks.ceph.mds.d.smithi159.stderr: -5926> 2023-12-17T11:48:19.103+0000 7f61c96bf640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-12-17T11:49:39.050 INFO:tasks.ceph.mds.d.smithi159.stdout:starting mds.d at 2023-12-17T11:49:39.183 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:39.180+0000 7ff07a8df640 1 Processor -- start 2023-12-17T11:49:39.183 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:39.181+0000 7ff07a8df640 1 -- start start 2023-12-17T11:49:39.184 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:39.182+0000 7ff07a8df640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff07415d360 0x7ff07406e9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:39.185 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:39.183+0000 7ff07a8df640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0740cfa50 con 0x7ff07406ab70 2023-12-17T11:49:39.185 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:39.183+0000 7ff07a8df640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0740acaa0 con 0x7ff0741618e0 2023-12-17T11:49:39.185 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:39.183+0000 7ff07a8df640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff074161de0 con 0x7ff07415d360 2023-12-17T11:49:39.185 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:39.183+0000 7ff07a0de640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7ff07406ab70 0x7ff0740acf30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:39762/0 (socket says 172.21.15.40:39762) 2023-12-17T11:49:39.185 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:39.183+0000 7ff07a0de640 1 -- 172.21.15.40:0/674242213 learned_addr learned my addr 172.21.15.40:0/674242213 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-12-17T11:49:39.187 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:39.183+0000 7ff0798dd640 1 --2- 172.21.15.40:0/674242213 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff07415d360 0x7ff07406e9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:39.187 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:39.183+0000 7ff0788db640 1 -- 172.21.15.40:0/674242213 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2339903852 0 0) 0x7ff06c001110 con 0x7ff07406ab70 2023-12-17T11:49:39.187 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:39.183+0000 7ff0788db640 1 -- 172.21.15.40:0/674242213 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff060003520 con 0x7ff07406ab70 2023-12-17T11:49:39.187 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:39.184+0000 7ff0788db640 1 -- 172.21.15.40:0/674242213 <== mon.1 v1:172.21.15.159:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1540100152 0 0) 0x7ff0740acaa0 con 0x7ff0741618e0 2023-12-17T11:49:39.187 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:39.184+0000 7ff0788db640 1 -- 172.21.15.40:0/674242213 --> v1:172.21.15.159:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff06c001110 con 0x7ff0741618e0 2023-12-17T11:49:39.187 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:39.184+0000 7ff0788db640 1 -- 172.21.15.40:0/674242213 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4138443448 0 0) 0x7ff060003520 con 0x7ff07406ab70 2023-12-17T11:49:39.187 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:39.184+0000 7ff0788db640 1 -- 172.21.15.40:0/674242213 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff07415d360 msgr2=0x7ff07406e9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:49:39.187 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:39.184+0000 7ff0788db640 1 --2- 172.21.15.40:0/674242213 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff07415d360 0x7ff07406e9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:39.187 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:39.184+0000 7ff0788db640 1 -- 172.21.15.40:0/674242213 >> v1:172.21.15.159:6789/0 conn(0x7ff0741618e0 legacy=0x7ff07406a460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:39.187 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:39.184+0000 7ff0788db640 1 -- 172.21.15.40:0/674242213 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff07406eef0 con 0x7ff07406ab70 2023-12-17T11:49:39.187 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:39.184+0000 7ff0788db640 1 -- 172.21.15.40:0/674242213 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2643242555 0 0) 0x7ff06c001780 con 0x7ff07406ab70 2023-12-17T11:49:39.187 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:39.184+0000 7ff0788db640 1 -- 172.21.15.40:0/674242213 >> v1:172.21.15.40:6789/0 conn(0x7ff07406ab70 legacy=0x7ff0740acf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:39.188 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:39.184+0000 7ff0788db640 1 --2- 172.21.15.40:0/674242213 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff060003b30 0x7ff060003f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:39.188 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:39.184+0000 7ff0788db640 1 --2- 172.21.15.40:0/674242213 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff07415d360 0x7ff0600047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:39.188 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:39.184+0000 7ff0788db640 1 --2- 172.21.15.40:0/674242213 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff060004d00 0x7ff060005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:39.188 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:39.184+0000 7ff0788db640 1 -- 172.21.15.40:0/674242213 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff074161de0 con 0x7ff060003b30 2023-12-17T11:49:39.188 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:39.184+0000 7ff0788db640 1 -- 172.21.15.40:0/674242213 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff06000bb10 con 0x7ff060004d00 2023-12-17T11:49:39.188 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:39.184+0000 7ff0788db640 1 -- 172.21.15.40:0/674242213 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff06000bca0 con 0x7ff07415d360 2023-12-17T11:49:39.188 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:39.184+0000 7ff0798dd640 1 --2- 172.21.15.40:0/674242213 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff060003b30 0x7ff060003f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:39.188 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:39.185+0000 7ff0790dc640 1 --2- 172.21.15.40:0/674242213 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff07415d360 0x7ff0600047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:39.188 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:39.185+0000 7ff07a0de640 1 --2- 172.21.15.40:0/674242213 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff060004d00 0x7ff060005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:39.188 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:39.185+0000 7ff0798dd640 1 -- 172.21.15.40:0/674242213 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff07415d360 msgr2=0x7ff0600047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:49:39.188 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:39.185+0000 7ff0798dd640 1 --2- 172.21.15.40:0/674242213 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff07415d360 0x7ff0600047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:39.188 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:39.185+0000 7ff0798dd640 1 -- 172.21.15.40:0/674242213 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff060004d00 msgr2=0x7ff060005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:49:39.188 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:39.185+0000 7ff0798dd640 1 --2- 172.21.15.40:0/674242213 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff060004d00 0x7ff060005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:39.188 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:39.185+0000 7ff0798dd640 1 -- 172.21.15.40:0/674242213 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff060003520 con 0x7ff060003b30 2023-12-17T11:49:39.189 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:39.186+0000 7ff0798dd640 1 --2- 172.21.15.40:0/674242213 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff060003b30 0x7ff060003f30 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7ff07000e170 tx=0x7ff0600057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4f14820c5aa8355 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:49:39.190 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:39.186+0000 7ff0788db640 1 -- 172.21.15.40:0/674242213 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff07002cbf0 con 0x7ff060003b30 2023-12-17T11:49:39.190 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:39.186+0000 7ff0788db640 1 -- 172.21.15.40:0/674242213 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff07000f040 con 0x7ff060003b30 2023-12-17T11:49:39.190 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:39.186+0000 7ff0788db640 1 -- 172.21.15.40:0/674242213 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff070034440 con 0x7ff060003b30 2023-12-17T11:49:39.190 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:39.187+0000 7ff07a8df640 1 -- 172.21.15.40:0/674242213 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff060003b30 msgr2=0x7ff060003f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:39.190 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:39.187+0000 7ff07a8df640 1 --2- 172.21.15.40:0/674242213 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff060003b30 0x7ff060003f30 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7ff07000e170 tx=0x7ff0600057f0 comp rx=0 tx=0).stop 2023-12-17T11:49:39.190 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:39.187+0000 7ff07a0de640 1 -- 172.21.15.40:0/674242213 reap_dead start 2023-12-17T11:49:39.190 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:39.187+0000 7ff07a8df640 1 -- 172.21.15.40:0/674242213 shutdown_connections 2023-12-17T11:49:39.190 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:39.187+0000 7ff07a8df640 1 -- 172.21.15.40:0/674242213 >> 172.21.15.40:0/674242213 conn(0x7ff0740b17d0 msgr2=0x7ff0740b1bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:49:39.190 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:39.187+0000 7ff07a8df640 1 -- 172.21.15.40:0/674242213 shutdown_connections 2023-12-17T11:49:39.190 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:39.187+0000 7ff07a8df640 1 -- 172.21.15.40:0/674242213 wait complete. 2023-12-17T11:49:39.191 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:39.189+0000 7ff07a8df640 1 Processor -- start 2023-12-17T11:49:39.191 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:39.189+0000 7ff07a8df640 1 -- start start 2023-12-17T11:49:39.193 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:39.190+0000 7ff07a8df640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff0740b3fc0 0x7ff074156a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:39.193 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:39.190+0000 7ff07a8df640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff0740b43a0 0x7ff0741598d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:39.193 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:39.190+0000 7ff07a8df640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff07414bc20 0x7ff07414c0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:39.193 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:39.190+0000 7ff07a8df640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff074156f70 con 0x7ff0740b3fc0 2023-12-17T11:49:39.193 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:39.190+0000 7ff07a8df640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff074159e10 con 0x7ff07414bc20 2023-12-17T11:49:39.193 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:39.190+0000 7ff07a8df640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0741f6940 con 0x7ff0740b43a0 2023-12-17T11:49:39.193 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:39.191+0000 7ff0798dd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff0740b3fc0 0x7ff074156a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:39.194 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:39.191+0000 7ff0798dd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff0740b3fc0 0x7ff074156a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:36938/0 (socket says 172.21.15.40:36938) 2023-12-17T11:49:39.194 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:39.191+0000 7ff0798dd640 1 -- 172.21.15.40:0/1746614185 learned_addr learned my addr 172.21.15.40:0/1746614185 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-17T11:49:39.194 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:39.191+0000 7ff07a0de640 1 --2- 172.21.15.40:0/1746614185 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff07414bc20 0x7ff07414c0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:39.194 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:39.191+0000 7ff0798dd640 1 -- 172.21.15.40:0/1746614185 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff0740b43a0 msgr2=0x7ff0741598d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:39.194 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:39.191+0000 7ff0798dd640 1 --2- 172.21.15.40:0/1746614185 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff0740b43a0 0x7ff0741598d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:39.194 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:39.191+0000 7ff0798dd640 1 -- 172.21.15.40:0/1746614185 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff07414bc20 msgr2=0x7ff07414c0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:39.194 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:39.191+0000 7ff0798dd640 1 --2- 172.21.15.40:0/1746614185 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff07414bc20 0x7ff07414c0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:39.194 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:39.191+0000 7ff0798dd640 1 -- 172.21.15.40:0/1746614185 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0741f74c0 con 0x7ff0740b3fc0 2023-12-17T11:49:39.194 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:39.191+0000 7ff07a0de640 1 --2- 172.21.15.40:0/1746614185 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff07414bc20 0x7ff07414c0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-17T11:49:39.194 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:39.191+0000 7ff0798dd640 1 --2- 172.21.15.40:0/1746614185 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff0740b3fc0 0x7ff074156a30 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7ff07000e170 tx=0x7ff070009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:49:39.195 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:39.192+0000 7ff06a7fc640 1 -- 172.21.15.40:0/1746614185 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff070034cc0 con 0x7ff0740b3fc0 2023-12-17T11:49:39.195 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:39.192+0000 7ff06a7fc640 1 -- 172.21.15.40:0/1746614185 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff070034e20 con 0x7ff0740b3fc0 2023-12-17T11:49:39.195 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:39.192+0000 7ff06a7fc640 1 -- 172.21.15.40:0/1746614185 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff07003e680 con 0x7ff0740b3fc0 2023-12-17T11:49:39.195 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:39.192+0000 7ff07a8df640 1 -- 172.21.15.40:0/1746614185 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff07414c5e0 con 0x7ff0740b3fc0 2023-12-17T11:49:39.195 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:39.192+0000 7ff07a8df640 1 -- 172.21.15.40:0/1746614185 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0741f6e70 con 0x7ff0740b3fc0 2023-12-17T11:49:39.195 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:39.193+0000 7ff07a8df640 1 -- 172.21.15.40:0/1746614185 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff074074450 con 0x7ff0740b3fc0 2023-12-17T11:49:39.196 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:39.194+0000 7ff06a7fc640 1 -- 172.21.15.40:0/1746614185 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ff07003e7e0 con 0x7ff0740b3fc0 2023-12-17T11:49:39.197 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:39.195+0000 7ff06a7fc640 1 --2- 172.21.15.40:0/1746614185 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7ff05806ae40 0x7ff05806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:39.197 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:39.195+0000 7ff06a7fc640 1 -- 172.21.15.40:0/1746614185 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6778+0+0 (secure 0 0 0) 0x7ff0700abe00 con 0x7ff0740b3fc0 2023-12-17T11:49:39.197 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:39.196+0000 7ff0790dc640 1 --2- 172.21.15.40:0/1746614185 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7ff05806ae40 0x7ff05806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:39.198 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:39.197+0000 7ff0790dc640 1 --2- 172.21.15.40:0/1746614185 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7ff05806ae40 0x7ff05806d300 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7ff064007fd0 tx=0x7ff064009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:49:39.201 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:39.199+0000 7ff06a7fc640 1 -- 172.21.15.40:0/1746614185 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7ff0700769e0 con 0x7ff0740b3fc0 2023-12-17T11:49:39.436 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:39.434+0000 7ff07a8df640 1 -- 172.21.15.40:0/1746614185 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7ff0740711c0 con 0x7ff0740b3fc0 2023-12-17T11:49:39.941 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:39.938+0000 7ff06a7fc640 1 -- 172.21.15.40:0/1746614185 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v10) v1 ==== 104+0+0 (secure 0 0 0) 0x7ff07007a000 con 0x7ff0740b3fc0 2023-12-17T11:49:39.945 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:39.942+0000 7ff07a8df640 1 -- 172.21.15.40:0/1746614185 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7ff05806ae40 msgr2=0x7ff05806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:39.945 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:39.942+0000 7ff07a8df640 1 --2- 172.21.15.40:0/1746614185 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7ff05806ae40 0x7ff05806d300 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7ff064007fd0 tx=0x7ff064009040 comp rx=0 tx=0).stop 2023-12-17T11:49:39.945 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:39.942+0000 7ff07a8df640 1 -- 172.21.15.40:0/1746614185 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff0740b3fc0 msgr2=0x7ff074156a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:39.945 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:39.942+0000 7ff07a8df640 1 --2- 172.21.15.40:0/1746614185 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff0740b3fc0 0x7ff074156a30 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7ff07000e170 tx=0x7ff070009750 comp rx=0 tx=0).stop 2023-12-17T11:49:39.945 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:39.942+0000 7ff07a8df640 1 -- 172.21.15.40:0/1746614185 shutdown_connections 2023-12-17T11:49:39.945 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:39.942+0000 7ff07a8df640 1 --2- 172.21.15.40:0/1746614185 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7ff05806ae40 0x7ff05806d300 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:39.946 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:39.942+0000 7ff07a8df640 1 --2- 172.21.15.40:0/1746614185 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff07414bc20 0x7ff07414c0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:39.946 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:39.942+0000 7ff07a8df640 1 --2- 172.21.15.40:0/1746614185 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff0740b43a0 0x7ff0741598d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:39.946 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:39.942+0000 7ff07a8df640 1 --2- 172.21.15.40:0/1746614185 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff0740b3fc0 0x7ff074156a30 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:39.946 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:39.942+0000 7ff07a8df640 1 -- 172.21.15.40:0/1746614185 >> 172.21.15.40:0/1746614185 conn(0x7ff0740b17d0 msgr2=0x7ff0740730f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:49:39.946 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:39.942+0000 7ff07a8df640 1 -- 172.21.15.40:0/1746614185 shutdown_connections 2023-12-17T11:49:39.946 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:39.942+0000 7ff07a8df640 1 -- 172.21.15.40:0/1746614185 wait complete. 2023-12-17T11:49:39.967 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-12-17T11:49:40.200 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:40.198+0000 7fe59f167640 1 Processor -- start 2023-12-17T11:49:40.200 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:40.198+0000 7fe59f167640 1 -- start start 2023-12-17T11:49:40.202 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:40.200+0000 7fe59f167640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fe59815d2a0 0x7fe5980b6070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:40.202 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:40.200+0000 7fe59f167640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe5980b1c10 0x7fe5980d1750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:40.202 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:40.200+0000 7fe59f167640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7fe5980b65b0 0x7fe5980d1c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:40.202 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:40.200+0000 7fe59f167640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5980d1300 con 0x7fe59815d2a0 2023-12-17T11:49:40.202 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:40.200+0000 7fe59f167640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5980cd980 con 0x7fe5980b65b0 2023-12-17T11:49:40.202 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:40.200+0000 7fe59f167640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5980cdc60 con 0x7fe5980b1c10 2023-12-17T11:49:40.203 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:40.200+0000 7fe59e165640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fe59815d2a0 0x7fe5980b6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:40.203 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:40.200+0000 7fe59e165640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fe59815d2a0 0x7fe5980b6070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:36954/0 (socket says 172.21.15.40:36954) 2023-12-17T11:49:40.203 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:40.200+0000 7fe59e165640 1 -- 172.21.15.40:0/1888635182 learned_addr learned my addr 172.21.15.40:0/1888635182 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-17T11:49:40.203 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:40.201+0000 7fe59d964640 1 --2- 172.21.15.40:0/1888635182 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe5980b1c10 0x7fe5980d1750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:40.203 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:40.201+0000 7fe59e165640 1 -- 172.21.15.40:0/1888635182 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe5980b1c10 msgr2=0x7fe5980d1750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:49:40.204 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:40.201+0000 7fe59e165640 1 --2- 172.21.15.40:0/1888635182 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe5980b1c10 0x7fe5980d1750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:40.204 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:40.201+0000 7fe59e165640 1 -- 172.21.15.40:0/1888635182 >> v2:172.21.15.159:3300/0 conn(0x7fe5980b65b0 msgr2=0x7fe5980d1c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:49:40.204 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:40.201+0000 7fe59e966640 1 --2- 172.21.15.40:0/1888635182 >> v2:172.21.15.159:3300/0 conn(0x7fe5980b65b0 0x7fe5980d1c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:40.204 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:40.201+0000 7fe59e165640 1 --2- 172.21.15.40:0/1888635182 >> v2:172.21.15.159:3300/0 conn(0x7fe5980b65b0 0x7fe5980d1c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:40.204 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:40.201+0000 7fe59e165640 1 -- 172.21.15.40:0/1888635182 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5980cdf40 con 0x7fe59815d2a0 2023-12-17T11:49:40.204 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:40.201+0000 7fe59e966640 1 --2- 172.21.15.40:0/1888635182 >> v2:172.21.15.159:3300/0 conn(0x7fe5980b65b0 0x7fe5980d1c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-17T11:49:40.204 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:40.202+0000 7fe59e165640 1 --2- 172.21.15.40:0/1888635182 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe59815d2a0 0x7fe5980b6070 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fe59806ce90 tx=0x7fe59402b990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3bb559690f2d53e5 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:49:40.204 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:40.202+0000 7fe59d163640 1 -- 172.21.15.40:0/1888635182 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe594030850 con 0x7fe59815d2a0 2023-12-17T11:49:40.205 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:40.202+0000 7fe59d163640 1 -- 172.21.15.40:0/1888635182 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5940309b0 con 0x7fe59815d2a0 2023-12-17T11:49:40.205 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:40.202+0000 7fe59d163640 1 -- 172.21.15.40:0/1888635182 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe594030d40 con 0x7fe59815d2a0 2023-12-17T11:49:40.205 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:40.203+0000 7fe59f167640 1 -- 172.21.15.40:0/1888635182 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe59815d2a0 msgr2=0x7fe5980b6070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:40.205 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:40.203+0000 7fe59f167640 1 --2- 172.21.15.40:0/1888635182 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe59815d2a0 0x7fe5980b6070 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fe59806ce90 tx=0x7fe59402b990 comp rx=0 tx=0).stop 2023-12-17T11:49:40.206 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:40.203+0000 7fe59f167640 1 -- 172.21.15.40:0/1888635182 shutdown_connections 2023-12-17T11:49:40.206 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:40.203+0000 7fe59f167640 1 --2- 172.21.15.40:0/1888635182 >> v2:172.21.15.159:3300/0 conn(0x7fe5980b65b0 0x7fe5980d1c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:40.206 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:40.203+0000 7fe59f167640 1 --2- 172.21.15.40:0/1888635182 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe5980b1c10 0x7fe5980d1750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:40.206 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:40.203+0000 7fe59f167640 1 --2- 172.21.15.40:0/1888635182 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe59815d2a0 0x7fe5980b6070 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:40.206 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:40.203+0000 7fe59f167640 1 -- 172.21.15.40:0/1888635182 >> 172.21.15.40:0/1888635182 conn(0x7fe5980b4c30 msgr2=0x7fe5980b5040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:49:40.206 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:40.203+0000 7fe59f167640 1 -- 172.21.15.40:0/1888635182 shutdown_connections 2023-12-17T11:49:40.206 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:40.203+0000 7fe59f167640 1 -- 172.21.15.40:0/1888635182 wait complete. 2023-12-17T11:49:40.207 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:40.205+0000 7fe59f167640 1 Processor -- start 2023-12-17T11:49:40.208 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:40.206+0000 7fe59f167640 1 -- start start 2023-12-17T11:49:40.209 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:40.207+0000 7fe59f167640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe5980b1c10 0x7fe5981601a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:40.209 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:40.207+0000 7fe59f167640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe5980b65b0 0x7fe5980c89b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:40.209 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:40.207+0000 7fe59f167640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe59815d2a0 0x7fe5980c93f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:40.209 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:40.207+0000 7fe59f167640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5980c7c60 con 0x7fe5980b65b0 2023-12-17T11:49:40.209 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:40.207+0000 7fe59f167640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5980c7ed0 con 0x7fe5980b1c10 2023-12-17T11:49:40.210 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:40.207+0000 7fe59f167640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5980c81b0 con 0x7fe59815d2a0 2023-12-17T11:49:40.210 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:40.207+0000 7fe59d964640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe5980b65b0 0x7fe5980c89b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:40.210 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:40.207+0000 7fe59d964640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe5980b65b0 0x7fe5980c89b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:36968/0 (socket says 172.21.15.40:36968) 2023-12-17T11:49:40.210 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:40.207+0000 7fe59d964640 1 -- 172.21.15.40:0/3490757674 learned_addr learned my addr 172.21.15.40:0/3490757674 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-17T11:49:40.211 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:40.208+0000 7fe59e966640 1 --2- 172.21.15.40:0/3490757674 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe59815d2a0 0x7fe5980c93f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:40.211 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:40.208+0000 7fe59e165640 1 --2- 172.21.15.40:0/3490757674 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe5980b1c10 0x7fe5981601a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:40.211 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:40.208+0000 7fe59d964640 1 -- 172.21.15.40:0/3490757674 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe59815d2a0 msgr2=0x7fe5980c93f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:40.211 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:40.208+0000 7fe59d964640 1 --2- 172.21.15.40:0/3490757674 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe59815d2a0 0x7fe5980c93f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:40.211 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:40.208+0000 7fe59d964640 1 -- 172.21.15.40:0/3490757674 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe5980b1c10 msgr2=0x7fe5981601a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:40.211 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:40.208+0000 7fe59d964640 1 --2- 172.21.15.40:0/3490757674 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe5980b1c10 0x7fe5981601a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:40.211 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:40.208+0000 7fe59d964640 1 -- 172.21.15.40:0/3490757674 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5940094d0 con 0x7fe5980b65b0 2023-12-17T11:49:40.211 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:40.208+0000 7fe59d964640 1 --2- 172.21.15.40:0/3490757674 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe5980b65b0 0x7fe5980c89b0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fe58800c7f0 tx=0x7fe58800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:49:40.212 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:40.208+0000 7fe58effd640 1 -- 172.21.15.40:0/3490757674 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe588004220 con 0x7fe5980b65b0 2023-12-17T11:49:40.212 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:40.208+0000 7fe58effd640 1 -- 172.21.15.40:0/3490757674 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe588004380 con 0x7fe5980b65b0 2023-12-17T11:49:40.212 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:40.208+0000 7fe59f167640 1 -- 172.21.15.40:0/3490757674 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5980c8490 con 0x7fe5980b65b0 2023-12-17T11:49:40.212 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:40.209+0000 7fe58effd640 1 -- 172.21.15.40:0/3490757674 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe588007840 con 0x7fe5980b65b0 2023-12-17T11:49:40.212 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:40.209+0000 7fe59f167640 1 -- 172.21.15.40:0/3490757674 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5980cadd0 con 0x7fe5980b65b0 2023-12-17T11:49:40.212 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:40.210+0000 7fe59f167640 1 -- 172.21.15.40:0/3490757674 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe598073970 con 0x7fe5980b65b0 2023-12-17T11:49:40.213 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:40.211+0000 7fe58effd640 1 -- 172.21.15.40:0/3490757674 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fe588007bb0 con 0x7fe5980b65b0 2023-12-17T11:49:40.214 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:40.212+0000 7fe58effd640 1 --2- 172.21.15.40:0/3490757674 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7fe57c06ae40 0x7fe57c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:40.214 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:40.212+0000 7fe58effd640 1 -- 172.21.15.40:0/3490757674 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6778+0+0 (secure 0 0 0) 0x7fe5880898b0 con 0x7fe5980b65b0 2023-12-17T11:49:40.214 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:40.212+0000 7fe59e165640 1 --2- 172.21.15.40:0/3490757674 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7fe57c06ae40 0x7fe57c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:40.215 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:40.214+0000 7fe59e165640 1 --2- 172.21.15.40:0/3490757674 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7fe57c06ae40 0x7fe57c06d300 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fe594036000 tx=0x7fe594008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:49:40.218 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:40.216+0000 7fe58effd640 1 -- 172.21.15.40:0/3490757674 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fe5880545c0 con 0x7fe5980b65b0 2023-12-17T11:49:40.411 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:40.409+0000 7fe59f167640 1 -- 172.21.15.40:0/3490757674 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fe598074450 con 0x7fe5980b65b0 2023-12-17T11:49:40.952 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:40.949+0000 7fe58effd640 1 -- 172.21.15.40:0/3490757674 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v29) v1 ==== 181+0+0 (secure 0 0 0) 0x7fe58801e0d0 con 0x7fe5980b65b0 2023-12-17T11:49:40.952 INFO:teuthology.orchestra.run.smithi040.stderr:pool 'cephfs_metadata' removed 2023-12-17T11:49:40.956 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:40.953+0000 7fe59f167640 1 -- 172.21.15.40:0/3490757674 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7fe57c06ae40 msgr2=0x7fe57c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:40.956 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:40.953+0000 7fe59f167640 1 --2- 172.21.15.40:0/3490757674 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7fe57c06ae40 0x7fe57c06d300 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fe594036000 tx=0x7fe594008030 comp rx=0 tx=0).stop 2023-12-17T11:49:40.956 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:40.953+0000 7fe59f167640 1 -- 172.21.15.40:0/3490757674 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe5980b65b0 msgr2=0x7fe5980c89b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:40.956 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:40.953+0000 7fe59f167640 1 --2- 172.21.15.40:0/3490757674 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe5980b65b0 0x7fe5980c89b0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fe58800c7f0 tx=0x7fe58800ccb0 comp rx=0 tx=0).stop 2023-12-17T11:49:40.956 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:40.954+0000 7fe59f167640 1 -- 172.21.15.40:0/3490757674 shutdown_connections 2023-12-17T11:49:40.956 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:40.954+0000 7fe59f167640 1 --2- 172.21.15.40:0/3490757674 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7fe57c06ae40 0x7fe57c06d300 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:40.956 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:40.954+0000 7fe59f167640 1 --2- 172.21.15.40:0/3490757674 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe59815d2a0 0x7fe5980c93f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:40.956 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:40.954+0000 7fe59f167640 1 --2- 172.21.15.40:0/3490757674 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe5980b65b0 0x7fe5980c89b0 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:40.956 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:40.954+0000 7fe59f167640 1 --2- 172.21.15.40:0/3490757674 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe5980b1c10 0x7fe5981601a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:40.957 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:40.954+0000 7fe59f167640 1 -- 172.21.15.40:0/3490757674 >> 172.21.15.40:0/3490757674 conn(0x7fe5980b4c30 msgr2=0x7fe5980b7970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:49:40.957 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:40.954+0000 7fe59f167640 1 -- 172.21.15.40:0/3490757674 shutdown_connections 2023-12-17T11:49:40.957 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:40.954+0000 7fe59f167640 1 -- 172.21.15.40:0/3490757674 wait complete. 2023-12-17T11:49:40.982 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-12-17T11:49:41.210 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:41.208+0000 7fc13998e640 1 Processor -- start 2023-12-17T11:49:41.210 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:41.208+0000 7fc13998e640 1 -- start start 2023-12-17T11:49:41.211 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:41.210+0000 7fc13998e640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fc134143790 0x7fc1340ccb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:41.212 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:41.210+0000 7fc13998e640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7fc1340cd040 0x7fc13406c900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:41.212 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:41.210+0000 7fc13998e640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc13415dd10 con 0x7fc13406ce40 2023-12-17T11:49:41.212 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:41.210+0000 7fc13998e640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc13406e160 con 0x7fc134143790 2023-12-17T11:49:41.212 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:41.210+0000 7fc13998e640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1340cd4d0 con 0x7fc1340cd040 2023-12-17T11:49:41.213 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:41.210+0000 7fc1337fe640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fc13406ce40 0x7fc134160f40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:39768/0 (socket says 172.21.15.40:39768) 2023-12-17T11:49:41.213 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:41.210+0000 7fc1337fe640 1 -- 172.21.15.40:0/922594371 learned_addr learned my addr 172.21.15.40:0/922594371 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-12-17T11:49:41.213 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:41.210+0000 7fc132ffd640 1 --2- 172.21.15.40:0/922594371 >> v2:172.21.15.40:3300/0 conn(0x7fc134143790 0x7fc1340ccb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:41.213 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:41.210+0000 7fc1327fc640 1 --2- 172.21.15.40:0/922594371 >> v2:172.21.15.159:3300/0 conn(0x7fc1340cd040 0x7fc13406c900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:41.213 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:41.211+0000 7fc132ffd640 1 -- 172.21.15.40:0/922594371 >> v2:172.21.15.159:3300/0 conn(0x7fc1340cd040 msgr2=0x7fc13406c900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:49:41.213 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:41.211+0000 7fc132ffd640 1 --2- 172.21.15.40:0/922594371 >> v2:172.21.15.159:3300/0 conn(0x7fc1340cd040 0x7fc13406c900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:41.213 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:41.211+0000 7fc132ffd640 1 -- 172.21.15.40:0/922594371 >> v1:172.21.15.40:6789/0 conn(0x7fc13406ce40 legacy=0x7fc134160f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:41.213 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:41.211+0000 7fc132ffd640 1 -- 172.21.15.40:0/922594371 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc13406d270 con 0x7fc134143790 2023-12-17T11:49:41.213 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:41.211+0000 7fc131ffb640 1 -- 172.21.15.40:0/922594371 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2737586324 0 0) 0x7fc13415dd10 con 0x7fc13406ce40 2023-12-17T11:49:41.214 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:41.212+0000 7fc132ffd640 1 --2- 172.21.15.40:0/922594371 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc134143790 0x7fc1340ccb00 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fc13406e710 tx=0x7fc12402b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b94ffd837ff229f server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:49:41.214 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:41.212+0000 7fc131ffb640 1 -- 172.21.15.40:0/922594371 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc12402e070 con 0x7fc134143790 2023-12-17T11:49:41.214 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:41.212+0000 7fc131ffb640 1 -- 172.21.15.40:0/922594371 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1240315a0 con 0x7fc134143790 2023-12-17T11:49:41.214 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:41.212+0000 7fc131ffb640 1 -- 172.21.15.40:0/922594371 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc124031930 con 0x7fc134143790 2023-12-17T11:49:41.215 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:41.213+0000 7fc13998e640 1 -- 172.21.15.40:0/922594371 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc134143790 msgr2=0x7fc1340ccb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:41.215 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:41.213+0000 7fc13998e640 1 --2- 172.21.15.40:0/922594371 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc134143790 0x7fc1340ccb00 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fc13406e710 tx=0x7fc12402b840 comp rx=0 tx=0).stop 2023-12-17T11:49:41.215 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:41.213+0000 7fc13998e640 1 -- 172.21.15.40:0/922594371 shutdown_connections 2023-12-17T11:49:41.215 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:41.213+0000 7fc13998e640 1 --2- 172.21.15.40:0/922594371 >> v2:172.21.15.159:3300/0 conn(0x7fc1340cd040 0x7fc13406c900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:41.216 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:41.213+0000 7fc13998e640 1 --2- 172.21.15.40:0/922594371 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc134143790 0x7fc1340ccb00 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:41.216 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:41.213+0000 7fc13998e640 1 -- 172.21.15.40:0/922594371 >> 172.21.15.40:0/922594371 conn(0x7fc1340b0a90 msgr2=0x7fc1340b0ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:49:41.216 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:41.213+0000 7fc13998e640 1 -- 172.21.15.40:0/922594371 shutdown_connections 2023-12-17T11:49:41.216 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:41.213+0000 7fc13998e640 1 -- 172.21.15.40:0/922594371 wait complete. 2023-12-17T11:49:41.217 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:41.215+0000 7fc13998e640 1 Processor -- start 2023-12-17T11:49:41.217 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:41.215+0000 7fc13998e640 1 -- start start 2023-12-17T11:49:41.219 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:41.216+0000 7fc13998e640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc13406ce40 0x7fc13413f6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:41.220 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:41.216+0000 7fc13998e640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc1340cd040 0x7fc1340708e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:41.220 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:41.216+0000 7fc13998e640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc134143790 0x7fc134070e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:41.220 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:41.216+0000 7fc13998e640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1340b1c40 con 0x7fc13406ce40 2023-12-17T11:49:41.220 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:41.216+0000 7fc13998e640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1340b1f20 con 0x7fc134143790 2023-12-17T11:49:41.220 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:41.216+0000 7fc13998e640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1340b2200 con 0x7fc1340cd040 2023-12-17T11:49:41.220 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:41.216+0000 7fc132ffd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc13406ce40 0x7fc13413f6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:41.220 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:41.216+0000 7fc132ffd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc13406ce40 0x7fc13413f6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:36980/0 (socket says 172.21.15.40:36980) 2023-12-17T11:49:41.220 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:41.216+0000 7fc132ffd640 1 -- 172.21.15.40:0/2575205919 learned_addr learned my addr 172.21.15.40:0/2575205919 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-17T11:49:41.220 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:41.217+0000 7fc1337fe640 1 --2- 172.21.15.40:0/2575205919 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc134143790 0x7fc134070e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:41.220 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:41.217+0000 7fc132ffd640 1 -- 172.21.15.40:0/2575205919 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc1340cd040 msgr2=0x7fc1340708e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:41.220 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:41.217+0000 7fc1327fc640 1 --2- 172.21.15.40:0/2575205919 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc1340cd040 0x7fc1340708e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:41.220 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:41.217+0000 7fc132ffd640 1 --2- 172.21.15.40:0/2575205919 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc1340cd040 0x7fc1340708e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:41.220 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:41.217+0000 7fc132ffd640 1 -- 172.21.15.40:0/2575205919 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc134143790 msgr2=0x7fc134070e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:41.220 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:41.217+0000 7fc132ffd640 1 --2- 172.21.15.40:0/2575205919 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc134143790 0x7fc134070e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:41.220 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:41.217+0000 7fc132ffd640 1 -- 172.21.15.40:0/2575205919 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc124009400 con 0x7fc13406ce40 2023-12-17T11:49:41.221 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:41.217+0000 7fc1337fe640 1 --2- 172.21.15.40:0/2575205919 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc134143790 0x7fc134070e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-17T11:49:41.221 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:41.217+0000 7fc132ffd640 1 --2- 172.21.15.40:0/2575205919 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc13406ce40 0x7fc13413f6c0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fc124009890 tx=0x7fc1240046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:49:41.221 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:41.217+0000 7fc11bfff640 1 -- 172.21.15.40:0/2575205919 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc124032840 con 0x7fc13406ce40 2023-12-17T11:49:41.221 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:41.218+0000 7fc11bfff640 1 -- 172.21.15.40:0/2575205919 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1240329a0 con 0x7fc13406ce40 2023-12-17T11:49:41.221 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:41.218+0000 7fc11bfff640 1 -- 172.21.15.40:0/2575205919 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc124032d50 con 0x7fc13406ce40 2023-12-17T11:49:41.221 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:41.218+0000 7fc13998e640 1 -- 172.21.15.40:0/2575205919 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1340b24e0 con 0x7fc13406ce40 2023-12-17T11:49:41.221 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:41.218+0000 7fc13998e640 1 -- 172.21.15.40:0/2575205919 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc13413fc00 con 0x7fc13406ce40 2023-12-17T11:49:41.221 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:41.219+0000 7fc13998e640 1 -- 172.21.15.40:0/2575205919 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc134074670 con 0x7fc13406ce40 2023-12-17T11:49:41.222 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:41.220+0000 7fc11bfff640 1 -- 172.21.15.40:0/2575205919 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fc12403b3f0 con 0x7fc13406ce40 2023-12-17T11:49:41.223 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:41.221+0000 7fc11bfff640 1 --2- 172.21.15.40:0/2575205919 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7fc12006ae40 0x7fc12006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:41.223 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:41.221+0000 7fc11bfff640 1 -- 172.21.15.40:0/2575205919 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6340+0+0 (secure 0 0 0) 0x7fc1240ab850 con 0x7fc13406ce40 2023-12-17T11:49:41.223 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:41.222+0000 7fc1327fc640 1 --2- 172.21.15.40:0/2575205919 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7fc12006ae40 0x7fc12006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:41.225 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:41.223+0000 7fc1327fc640 1 --2- 172.21.15.40:0/2575205919 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7fc12006ae40 0x7fc12006d300 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fc128006fd0 tx=0x7fc128008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:49:41.227 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:41.226+0000 7fc11bfff640 1 -- 172.21.15.40:0/2575205919 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fc124076670 con 0x7fc13406ce40 2023-12-17T11:49:41.425 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:41.423+0000 7fc13998e640 1 -- 172.21.15.40:0/2575205919 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fc1340ad860 con 0x7fc13406ce40 2023-12-17T11:49:41.964 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:41.962+0000 7fc11bfff640 1 -- 172.21.15.40:0/2575205919 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v30) v1 ==== 169+0+0 (secure 0 0 0) 0x7fc124079c90 con 0x7fc13406ce40 2023-12-17T11:49:41.965 INFO:teuthology.orchestra.run.smithi040.stderr:pool 'cephfs_data' removed 2023-12-17T11:49:41.968 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:41.966+0000 7fc13998e640 1 -- 172.21.15.40:0/2575205919 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7fc12006ae40 msgr2=0x7fc12006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:41.968 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:41.966+0000 7fc13998e640 1 --2- 172.21.15.40:0/2575205919 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7fc12006ae40 0x7fc12006d300 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fc128006fd0 tx=0x7fc128008040 comp rx=0 tx=0).stop 2023-12-17T11:49:41.968 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:41.966+0000 7fc13998e640 1 -- 172.21.15.40:0/2575205919 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc13406ce40 msgr2=0x7fc13413f6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:41.968 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:41.966+0000 7fc13998e640 1 --2- 172.21.15.40:0/2575205919 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc13406ce40 0x7fc13413f6c0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fc124009890 tx=0x7fc1240046c0 comp rx=0 tx=0).stop 2023-12-17T11:49:41.969 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:41.966+0000 7fc13998e640 1 -- 172.21.15.40:0/2575205919 shutdown_connections 2023-12-17T11:49:41.969 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:41.966+0000 7fc13998e640 1 --2- 172.21.15.40:0/2575205919 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7fc12006ae40 0x7fc12006d300 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:41.969 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:41.966+0000 7fc13998e640 1 --2- 172.21.15.40:0/2575205919 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc134143790 0x7fc134070e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:41.969 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:41.966+0000 7fc13998e640 1 --2- 172.21.15.40:0/2575205919 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc1340cd040 0x7fc1340708e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:41.969 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:41.966+0000 7fc13998e640 1 --2- 172.21.15.40:0/2575205919 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc13406ce40 0x7fc13413f6c0 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:41.969 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:41.966+0000 7fc13998e640 1 -- 172.21.15.40:0/2575205919 >> 172.21.15.40:0/2575205919 conn(0x7fc1340b0a90 msgr2=0x7fc134071de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:49:41.969 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:41.967+0000 7fc13998e640 1 -- 172.21.15.40:0/2575205919 shutdown_connections 2023-12-17T11:49:41.969 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:41.967+0000 7fc13998e640 1 -- 172.21.15.40:0/2575205919 wait complete. 2023-12-17T11:49:41.997 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data_ec cephfs_data_ec --yes-i-really-really-mean-it 2023-12-17T11:49:42.206 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:42.204+0000 7f09f2fe9640 1 Processor -- start 2023-12-17T11:49:42.206 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:42.204+0000 7f09f2fe9640 1 -- start start 2023-12-17T11:49:42.208 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:42.206+0000 7f09f2fe9640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f09ec0d15b0 0x7f09ec0d3a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:42.208 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:42.206+0000 7f09f2fe9640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f09ec15d4a0 0x7f09ec0d0cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:42.209 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:42.206+0000 7f09f2fe9640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09ec15d8b0 con 0x7f09ec0d1990 2023-12-17T11:49:42.209 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:42.206+0000 7f09f2fe9640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09ec0ce5d0 con 0x7f09ec0d15b0 2023-12-17T11:49:42.209 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:42.206+0000 7f09f2fe9640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09ec0ce870 con 0x7f09ec15d4a0 2023-12-17T11:49:42.209 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:42.206+0000 7f09f1fe7640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f09ec0d15b0 0x7f09ec0d3a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:42.209 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:42.206+0000 7f09f1fe7640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f09ec0d15b0 0x7f09ec0d3a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:36994/0 (socket says 172.21.15.40:36994) 2023-12-17T11:49:42.209 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:42.206+0000 7f09f1fe7640 1 -- 172.21.15.40:0/4269348732 learned_addr learned my addr 172.21.15.40:0/4269348732 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-17T11:49:42.209 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:42.207+0000 7f09f27e8640 1 --2- 172.21.15.40:0/4269348732 >> v2:172.21.15.159:3300/0 conn(0x7f09ec15d4a0 0x7f09ec0d0cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:42.209 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:42.207+0000 7f09f1fe7640 1 -- 172.21.15.40:0/4269348732 >> v2:172.21.15.159:3300/0 conn(0x7f09ec15d4a0 msgr2=0x7f09ec0d0cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:49:42.209 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:42.207+0000 7f09f1fe7640 1 --2- 172.21.15.40:0/4269348732 >> v2:172.21.15.159:3300/0 conn(0x7f09ec15d4a0 0x7f09ec0d0cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:42.209 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:42.207+0000 7f09f1fe7640 1 -- 172.21.15.40:0/4269348732 >> v1:172.21.15.159:6789/0 conn(0x7f09ec0d1990 legacy=0x7f09ec15cd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:49:42.209 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:42.207+0000 7f09f1fe7640 1 -- 172.21.15.40:0/4269348732 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09ec0ceb50 con 0x7f09ec0d15b0 2023-12-17T11:49:42.210 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:42.208+0000 7f09f1fe7640 1 --2- 172.21.15.40:0/4269348732 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f09ec0d15b0 0x7f09ec0d3a30 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f09ec0d3fa0 tx=0x7f09e802b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d97d27d3e9970c9 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:49:42.211 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:42.208+0000 7f09f0fe5640 1 -- 172.21.15.40:0/4269348732 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09e80317e0 con 0x7f09ec0d15b0 2023-12-17T11:49:42.211 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:42.208+0000 7f09f0fe5640 1 -- 172.21.15.40:0/4269348732 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09e8031940 con 0x7f09ec0d15b0 2023-12-17T11:49:42.211 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:42.208+0000 7f09f0fe5640 1 -- 172.21.15.40:0/4269348732 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09e8031cd0 con 0x7f09ec0d15b0 2023-12-17T11:49:42.211 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:42.209+0000 7f09f2fe9640 1 -- 172.21.15.40:0/4269348732 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f09ec0d15b0 msgr2=0x7f09ec0d3a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:42.211 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:42.209+0000 7f09f2fe9640 1 --2- 172.21.15.40:0/4269348732 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f09ec0d15b0 0x7f09ec0d3a30 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f09ec0d3fa0 tx=0x7f09e802b880 comp rx=0 tx=0).stop 2023-12-17T11:49:42.211 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:42.209+0000 7f09f2fe9640 1 -- 172.21.15.40:0/4269348732 shutdown_connections 2023-12-17T11:49:42.211 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:42.209+0000 7f09f2fe9640 1 --2- 172.21.15.40:0/4269348732 >> v2:172.21.15.159:3300/0 conn(0x7f09ec15d4a0 0x7f09ec0d0cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:42.211 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:42.209+0000 7f09f2fe9640 1 --2- 172.21.15.40:0/4269348732 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f09ec0d15b0 0x7f09ec0d3a30 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:42.211 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:42.209+0000 7f09f2fe9640 1 -- 172.21.15.40:0/4269348732 >> 172.21.15.40:0/4269348732 conn(0x7f09ec0d2f10 msgr2=0x7f09ec0d3320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:49:42.211 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:42.209+0000 7f09f2fe9640 1 -- 172.21.15.40:0/4269348732 shutdown_connections 2023-12-17T11:49:42.211 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:42.209+0000 7f09f2fe9640 1 -- 172.21.15.40:0/4269348732 wait complete. 2023-12-17T11:49:42.213 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:42.211+0000 7f09f2fe9640 1 Processor -- start 2023-12-17T11:49:42.213 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:42.211+0000 7f09f2fe9640 1 -- start start 2023-12-17T11:49:42.214 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:42.212+0000 7f09f2fe9640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f09ec0d15b0 0x7f09ec15c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:42.214 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:42.212+0000 7f09f2fe9640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f09ec0d1990 0x7f09ec0b3620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:42.214 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:42.212+0000 7f09f2fe9640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f09ec15d4a0 0x7f09ec09cc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:42.214 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:42.212+0000 7f09f2fe9640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09ec0cc500 con 0x7f09ec15d4a0 2023-12-17T11:49:42.214 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:42.212+0000 7f09f2fe9640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09ec09ef80 con 0x7f09ec0d1990 2023-12-17T11:49:42.214 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:42.212+0000 7f09f2fe9640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09ec09f260 con 0x7f09ec0d15b0 2023-12-17T11:49:42.214 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:42.212+0000 7f09f27e8640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f09ec15d4a0 0x7f09ec09cc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:42.214 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:42.212+0000 7f09f27e8640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f09ec15d4a0 0x7f09ec09cc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:37010/0 (socket says 172.21.15.40:37010) 2023-12-17T11:49:42.214 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:42.212+0000 7f09f27e8640 1 -- 172.21.15.40:0/3795499034 learned_addr learned my addr 172.21.15.40:0/3795499034 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-17T11:49:42.216 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:42.212+0000 7f09f1fe7640 1 --2- 172.21.15.40:0/3795499034 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f09ec0d15b0 0x7f09ec15c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:42.216 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:42.212+0000 7f09f27e8640 1 -- 172.21.15.40:0/3795499034 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f09ec0d15b0 msgr2=0x7f09ec15c540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:42.216 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:42.213+0000 7f09f17e6640 1 --2- 172.21.15.40:0/3795499034 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f09ec0d1990 0x7f09ec0b3620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:42.216 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:42.213+0000 7f09f27e8640 1 --2- 172.21.15.40:0/3795499034 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f09ec0d15b0 0x7f09ec15c540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:42.216 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:42.213+0000 7f09f27e8640 1 -- 172.21.15.40:0/3795499034 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f09ec0d1990 msgr2=0x7f09ec0b3620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:42.216 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:42.213+0000 7f09f27e8640 1 --2- 172.21.15.40:0/3795499034 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f09ec0d1990 0x7f09ec0b3620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:42.216 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:42.213+0000 7f09f27e8640 1 -- 172.21.15.40:0/3795499034 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09e80094d0 con 0x7f09ec15d4a0 2023-12-17T11:49:42.216 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:42.213+0000 7f09f1fe7640 1 --2- 172.21.15.40:0/3795499034 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f09ec0d15b0 0x7f09ec15c540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-17T11:49:42.217 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:42.213+0000 7f09f27e8640 1 --2- 172.21.15.40:0/3795499034 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f09ec15d4a0 0x7f09ec09cc10 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f09e4007e60 tx=0x7f09e400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:49:42.217 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:42.213+0000 7f09e27fc640 1 -- 172.21.15.40:0/3795499034 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09e4014420 con 0x7f09ec15d4a0 2023-12-17T11:49:42.217 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:42.213+0000 7f09e27fc640 1 -- 172.21.15.40:0/3795499034 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09e40145a0 con 0x7f09ec15d4a0 2023-12-17T11:49:42.217 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:42.213+0000 7f09e27fc640 1 -- 172.21.15.40:0/3795499034 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09e4014950 con 0x7f09ec15d4a0 2023-12-17T11:49:42.217 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:42.213+0000 7f09f2fe9640 1 -- 172.21.15.40:0/3795499034 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09ec09f540 con 0x7f09ec15d4a0 2023-12-17T11:49:42.217 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:42.213+0000 7f09f2fe9640 1 -- 172.21.15.40:0/3795499034 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09ec0b3b60 con 0x7f09ec15d4a0 2023-12-17T11:49:42.217 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:42.214+0000 7f09f2fe9640 1 -- 172.21.15.40:0/3795499034 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09ec09fa60 con 0x7f09ec15d4a0 2023-12-17T11:49:42.218 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:42.215+0000 7f09e27fc640 1 -- 172.21.15.40:0/3795499034 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f09e4014ab0 con 0x7f09ec15d4a0 2023-12-17T11:49:42.218 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:42.216+0000 7f09e27fc640 1 --2- 172.21.15.40:0/3795499034 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f09d006ae40 0x7f09d006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:42.218 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:42.217+0000 7f09e27fc640 1 -- 172.21.15.40:0/3795499034 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5781+0+0 (secure 0 0 0) 0x7f09e4089f20 con 0x7f09ec15d4a0 2023-12-17T11:49:42.219 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:42.217+0000 7f09f1fe7640 1 --2- 172.21.15.40:0/3795499034 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f09d006ae40 0x7f09d006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:42.220 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:42.219+0000 7f09f1fe7640 1 --2- 172.21.15.40:0/3795499034 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f09d006ae40 0x7f09d006d300 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f09e8036000 tx=0x7f09e803d040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:49:42.223 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:42.221+0000 7f09e27fc640 1 -- 172.21.15.40:0/3795499034 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f09ec09fa60 con 0x7f09ec15d4a0 2023-12-17T11:49:42.418 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:42.415+0000 7f09f2fe9640 1 -- 172.21.15.40:0/3795499034 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f09ec09fa60 con 0x7f09ec15d4a0 2023-12-17T11:49:42.975 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:42.972+0000 7f09e27fc640 1 -- 172.21.15.40:0/3795499034 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data_ec' removed v31) v1 ==== 178+0+0 (secure 0 0 0) 0x7f09ec09fa60 con 0x7f09ec15d4a0 2023-12-17T11:49:42.975 INFO:teuthology.orchestra.run.smithi040.stderr:pool 'cephfs_data_ec' removed 2023-12-17T11:49:42.980 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:42.978+0000 7f09f2fe9640 1 -- 172.21.15.40:0/3795499034 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f09d006ae40 msgr2=0x7f09d006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:42.980 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:42.978+0000 7f09f2fe9640 1 --2- 172.21.15.40:0/3795499034 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f09d006ae40 0x7f09d006d300 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f09e8036000 tx=0x7f09e803d040 comp rx=0 tx=0).stop 2023-12-17T11:49:42.980 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:42.978+0000 7f09f2fe9640 1 -- 172.21.15.40:0/3795499034 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f09ec15d4a0 msgr2=0x7f09ec09cc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:42.981 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:42.978+0000 7f09f2fe9640 1 --2- 172.21.15.40:0/3795499034 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f09ec15d4a0 0x7f09ec09cc10 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f09e4007e60 tx=0x7f09e400e4b0 comp rx=0 tx=0).stop 2023-12-17T11:49:42.981 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:42.979+0000 7f09f2fe9640 1 -- 172.21.15.40:0/3795499034 shutdown_connections 2023-12-17T11:49:42.981 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:42.979+0000 7f09f2fe9640 1 --2- 172.21.15.40:0/3795499034 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f09d006ae40 0x7f09d006d300 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:42.982 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:42.979+0000 7f09f2fe9640 1 --2- 172.21.15.40:0/3795499034 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f09ec15d4a0 0x7f09ec09cc10 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:42.982 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:42.979+0000 7f09f2fe9640 1 --2- 172.21.15.40:0/3795499034 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f09ec0d1990 0x7f09ec0b3620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:42.982 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:42.979+0000 7f09f2fe9640 1 --2- 172.21.15.40:0/3795499034 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f09ec0d15b0 0x7f09ec15c540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:42.982 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:42.979+0000 7f09f2fe9640 1 -- 172.21.15.40:0/3795499034 >> 172.21.15.40:0/3795499034 conn(0x7f09ec0d2f10 msgr2=0x7f09ec15cd70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:49:42.983 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:42.980+0000 7f09f2fe9640 1 -- 172.21.15.40:0/3795499034 shutdown_connections 2023-12-17T11:49:42.983 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:42.981+0000 7f09f2fe9640 1 -- 172.21.15.40:0/3795499034 wait complete. 2023-12-17T11:49:43.008 INFO:tasks.ceph.mds.a:Restarting daemon 2023-12-17T11:49:43.009 INFO:tasks.ceph.mds.a:Stopping old one... 2023-12-17T11:49:43.009 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-12-17T11:49:43.009 INFO:teuthology.orchestra.run:waiting for 300 2023-12-17T11:49:43.009 INFO:tasks.ceph.mds.c:Restarting daemon 2023-12-17T11:49:43.009 INFO:tasks.ceph.mds.c:Stopping old one... 2023-12-17T11:49:43.009 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-12-17T11:49:43.010 INFO:teuthology.orchestra.run:waiting for 300 2023-12-17T11:49:43.010 INFO:tasks.ceph.mds.b:Restarting daemon 2023-12-17T11:49:43.010 INFO:tasks.ceph.mds.b:Stopping old one... 2023-12-17T11:49:43.010 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-12-17T11:49:43.010 INFO:teuthology.orchestra.run:waiting for 300 2023-12-17T11:49:43.010 INFO:tasks.ceph.mds.d:Restarting daemon 2023-12-17T11:49:43.010 INFO:tasks.ceph.mds.d:Stopping old one... 2023-12-17T11:49:43.011 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-12-17T11:49:43.011 INFO:teuthology.orchestra.run:waiting for 300 2023-12-17T11:49:43.030 INFO:tasks.ceph.mds.d:Stopped 2023-12-17T11:49:43.030 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-12-17T11:49:43.031 INFO:tasks.ceph.mds.a:Stopped 2023-12-17T11:49:43.031 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-12-17T11:49:43.033 INFO:tasks.ceph.mds.c:Stopped 2023-12-17T11:49:43.033 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-12-17T11:49:43.039 INFO:tasks.ceph.mds.b:Stopped 2023-12-17T11:49:43.039 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-12-17T11:49:43.082 INFO:tasks.ceph.mds.a:Started 2023-12-17T11:49:43.082 DEBUG:teuthology.parallel:result is None 2023-12-17T11:49:43.087 INFO:tasks.ceph.mds.d:Started 2023-12-17T11:49:43.088 DEBUG:teuthology.parallel:result is None 2023-12-17T11:49:43.090 INFO:tasks.ceph.mds.c:Started 2023-12-17T11:49:43.090 DEBUG:teuthology.parallel:result is None 2023-12-17T11:49:43.095 INFO:tasks.ceph.mds.b:Started 2023-12-17T11:49:43.095 DEBUG:teuthology.parallel:result is None 2023-12-17T11:49:43.095 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-12-17T11:49:43.246 INFO:tasks.ceph.mds.a.smithi040.stdout:starting mds.a at 2023-12-17T11:49:43.250 INFO:tasks.ceph.mds.c.smithi040.stdout:starting mds.c at 2023-12-17T11:49:43.261 INFO:tasks.ceph.mds.d.smithi159.stdout:starting mds.d at 2023-12-17T11:49:43.261 INFO:tasks.ceph.mds.b.smithi159.stdout:starting mds.b at 2023-12-17T11:49:43.263 INFO:tasks.ceph.mds.d.smithi159.stderr:2023-12-17T11:49:43.261+0000 7f1352aaf640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6834/0: (98) Address already in use 2023-12-17T11:49:43.288 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:43.286+0000 7f1473f61640 1 Processor -- start 2023-12-17T11:49:43.288 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:43.286+0000 7f1473f61640 1 -- start start 2023-12-17T11:49:43.289 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:43.287+0000 7f1473f61640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f146c143e00 0x7f146c0b4040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:43.289 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:43.287+0000 7f1473f61640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f146c0b3bb0 con 0x7f146c072180 2023-12-17T11:49:43.289 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:43.287+0000 7f1473f61640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f146c1441e0 con 0x7f146c06c410 2023-12-17T11:49:43.290 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:43.287+0000 7f1473f61640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f146c072680 con 0x7f146c143e00 2023-12-17T11:49:43.290 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:43.288+0000 7f1471cfd640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f146c143e00 0x7f146c0b4040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:43.290 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:43.288+0000 7f1471cfd640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f146c143e00 0x7f146c0b4040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:37052/0 (socket says 172.21.15.40:37052) 2023-12-17T11:49:43.290 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:43.288+0000 7f1471cfd640 1 -- 172.21.15.40:0/1366558296 learned_addr learned my addr 172.21.15.40:0/1366558296 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-17T11:49:43.290 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:43.288+0000 7f1471cfd640 1 -- 172.21.15.40:0/1366558296 >> v1:172.21.15.159:6789/0 conn(0x7f146c06c410 legacy=0x7f146c15ecb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:49:43.290 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:43.288+0000 7f1471cfd640 1 -- 172.21.15.40:0/1366558296 >> v1:172.21.15.40:6789/0 conn(0x7f146c072180 legacy=0x7f146c0b4580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:43.291 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:43.288+0000 7f1471cfd640 1 -- 172.21.15.40:0/1366558296 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f146c0b1e30 con 0x7f146c143e00 2023-12-17T11:49:43.291 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:43.289+0000 7f1471cfd640 1 --2- 172.21.15.40:0/1366558296 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f146c143e00 0x7f146c0b4040 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f1468009870 tx=0x7f146802b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d70bd04f351fb5c server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:49:43.292 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:43.289+0000 7f1470cfb640 1 -- 172.21.15.40:0/1366558296 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1468030860 con 0x7f146c143e00 2023-12-17T11:49:43.292 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:43.289+0000 7f1470cfb640 1 -- 172.21.15.40:0/1366558296 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14680309c0 con 0x7f146c143e00 2023-12-17T11:49:43.292 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:43.289+0000 7f1470cfb640 1 -- 172.21.15.40:0/1366558296 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1468030d50 con 0x7f146c143e00 2023-12-17T11:49:43.292 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:43.290+0000 7f1473f61640 1 -- 172.21.15.40:0/1366558296 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f146c143e00 msgr2=0x7f146c0b4040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:43.292 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:43.290+0000 7f1473f61640 1 --2- 172.21.15.40:0/1366558296 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f146c143e00 0x7f146c0b4040 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f1468009870 tx=0x7f146802b9a0 comp rx=0 tx=0).stop 2023-12-17T11:49:43.292 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:43.290+0000 7f1473f61640 1 -- 172.21.15.40:0/1366558296 shutdown_connections 2023-12-17T11:49:43.293 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:43.290+0000 7f1473f61640 1 --2- 172.21.15.40:0/1366558296 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f146c143e00 0x7f146c0b4040 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:43.293 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:43.290+0000 7f1473f61640 1 -- 172.21.15.40:0/1366558296 >> 172.21.15.40:0/1366558296 conn(0x7f146c0b0a90 msgr2=0x7f146c0b0e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:49:43.293 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:43.290+0000 7f1473f61640 1 -- 172.21.15.40:0/1366558296 shutdown_connections 2023-12-17T11:49:43.293 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:43.290+0000 7f1473f61640 1 -- 172.21.15.40:0/1366558296 wait complete. 2023-12-17T11:49:43.294 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:43.292+0000 7f1473f61640 1 Processor -- start 2023-12-17T11:49:43.294 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:43.292+0000 7f1473f61640 1 -- start start 2023-12-17T11:49:43.296 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:43.293+0000 7f1473f61640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f146c06c410 0x7f146c15aae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:43.296 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:43.293+0000 7f1473f61640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f146c072180 0x7f146c141b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:43.296 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:43.293+0000 7f1473f61640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f146c143e00 0x7f146c1420b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:43.296 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:43.293+0000 7f1473f61640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f146c1f34c0 con 0x7f146c06c410 2023-12-17T11:49:43.296 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:43.293+0000 7f1473f61640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f146c15b020 con 0x7f146c143e00 2023-12-17T11:49:43.296 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:43.293+0000 7f1473f61640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f146c1f36d0 con 0x7f146c072180 2023-12-17T11:49:43.296 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:43.293+0000 7f1471cfd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f146c06c410 0x7f146c15aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:43.296 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:43.293+0000 7f1471cfd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f146c06c410 0x7f146c15aae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:37064/0 (socket says 172.21.15.40:37064) 2023-12-17T11:49:43.296 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:43.293+0000 7f1471cfd640 1 -- 172.21.15.40:0/1555865656 learned_addr learned my addr 172.21.15.40:0/1555865656 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-17T11:49:43.297 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:43.293+0000 7f14724fe640 1 --2- 172.21.15.40:0/1555865656 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f146c143e00 0x7f146c1420b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:43.297 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:43.293+0000 7f14714fc640 1 --2- 172.21.15.40:0/1555865656 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f146c072180 0x7f146c141b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:43.297 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:43.294+0000 7f1471cfd640 1 -- 172.21.15.40:0/1555865656 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f146c072180 msgr2=0x7f146c141b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:43.297 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:43.294+0000 7f1471cfd640 1 --2- 172.21.15.40:0/1555865656 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f146c072180 0x7f146c141b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:43.297 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:43.294+0000 7f1471cfd640 1 -- 172.21.15.40:0/1555865656 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f146c143e00 msgr2=0x7f146c1420b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:43.297 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:43.294+0000 7f1471cfd640 1 --2- 172.21.15.40:0/1555865656 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f146c143e00 0x7f146c1420b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:43.297 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:43.294+0000 7f1471cfd640 1 -- 172.21.15.40:0/1555865656 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14680094d0 con 0x7f146c06c410 2023-12-17T11:49:43.297 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:43.294+0000 7f1471cfd640 1 --2- 172.21.15.40:0/1555865656 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f146c06c410 0x7f146c15aae0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f1468009870 tx=0x7f1468004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:49:43.298 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:43.294+0000 7f14627fc640 1 -- 172.21.15.40:0/1555865656 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1468030810 con 0x7f146c06c410 2023-12-17T11:49:43.298 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:43.294+0000 7f14627fc640 1 -- 172.21.15.40:0/1555865656 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1468039d90 con 0x7f146c06c410 2023-12-17T11:49:43.298 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:43.294+0000 7f14627fc640 1 -- 172.21.15.40:0/1555865656 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1468043630 con 0x7f146c06c410 2023-12-17T11:49:43.298 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:43.294+0000 7f1473f61640 1 -- 172.21.15.40:0/1555865656 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f146c1f39b0 con 0x7f146c06c410 2023-12-17T11:49:43.298 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:43.295+0000 7f1473f61640 1 -- 172.21.15.40:0/1555865656 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f146c1f3f70 con 0x7f146c06c410 2023-12-17T11:49:43.298 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:43.296+0000 7f1473f61640 1 -- 172.21.15.40:0/1555865656 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f146c0745d0 con 0x7f146c06c410 2023-12-17T11:49:43.298 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:43.297+0000 7f14627fc640 1 -- 172.21.15.40:0/1555865656 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f146802f3b0 con 0x7f146c06c410 2023-12-17T11:49:43.300 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:43.298+0000 7f14627fc640 1 --2- 172.21.15.40:0/1555865656 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f145006ae40 0x7f145006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:43.300 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:43.298+0000 7f14627fc640 1 -- 172.21.15.40:0/1555865656 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5263+0+0 (secure 0 0 0) 0x7f14680ab900 con 0x7f146c06c410 2023-12-17T11:49:43.300 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:43.299+0000 7f14714fc640 1 --2- 172.21.15.40:0/1555865656 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f145006ae40 0x7f145006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:43.301 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:43.299+0000 7f14714fc640 1 --2- 172.21.15.40:0/1555865656 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f145006ae40 0x7f145006d300 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f146c141630 tx=0x7f145c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:49:43.304 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:43.303+0000 7f14627fc640 1 -- 172.21.15.40:0/1555865656 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f1468076af0 con 0x7f146c06c410 2023-12-17T11:49:43.518 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:43.516+0000 7f1473f61640 1 -- 172.21.15.40:0/1555865656 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f146c0b04a0 con 0x7f146c06c410 2023-12-17T11:49:44.519 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:44.517+0000 7f14627fc640 1 -- 172.21.15.40:0/1555865656 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v36) v1 ==== 97+0+0 (secure 0 0 0) 0x7f1468048080 con 0x7f146c06c410 2023-12-17T11:49:44.519 INFO:teuthology.orchestra.run.smithi040.stderr: removed all blocklist entries 2023-12-17T11:49:44.523 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:44.520+0000 7f1473f61640 1 -- 172.21.15.40:0/1555865656 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f145006ae40 msgr2=0x7f145006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:44.523 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:44.520+0000 7f1473f61640 1 --2- 172.21.15.40:0/1555865656 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f145006ae40 0x7f145006d300 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f146c141630 tx=0x7f145c009040 comp rx=0 tx=0).stop 2023-12-17T11:49:44.523 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:44.520+0000 7f1473f61640 1 -- 172.21.15.40:0/1555865656 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f146c06c410 msgr2=0x7f146c15aae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:44.523 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:44.520+0000 7f1473f61640 1 --2- 172.21.15.40:0/1555865656 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f146c06c410 0x7f146c15aae0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f1468009870 tx=0x7f1468004730 comp rx=0 tx=0).stop 2023-12-17T11:49:44.523 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:44.521+0000 7f1473f61640 1 -- 172.21.15.40:0/1555865656 shutdown_connections 2023-12-17T11:49:44.523 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:44.521+0000 7f1473f61640 1 --2- 172.21.15.40:0/1555865656 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f145006ae40 0x7f145006d300 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:44.523 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:44.521+0000 7f1473f61640 1 --2- 172.21.15.40:0/1555865656 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f146c143e00 0x7f146c1420b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:44.523 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:44.521+0000 7f1473f61640 1 --2- 172.21.15.40:0/1555865656 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f146c072180 0x7f146c141b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:44.523 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:44.521+0000 7f1473f61640 1 --2- 172.21.15.40:0/1555865656 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f146c06c410 0x7f146c15aae0 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:44.523 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:44.521+0000 7f1473f61640 1 -- 172.21.15.40:0/1555865656 >> 172.21.15.40:0/1555865656 conn(0x7f146c0b0a90 msgr2=0x7f146c0cebf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:49:44.523 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:44.521+0000 7f1473f61640 1 -- 172.21.15.40:0/1555865656 shutdown_connections 2023-12-17T11:49:44.524 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:44.521+0000 7f1473f61640 1 -- 172.21.15.40:0/1555865656 wait complete. 2023-12-17T11:49:44.544 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-12-17T11:49:44.777 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:44.775+0000 7fdd6159e640 1 Processor -- start 2023-12-17T11:49:44.777 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:44.776+0000 7fdd6159e640 1 -- start start 2023-12-17T11:49:44.779 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:44.777+0000 7fdd6159e640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7fdd5c0d13c0 0x7fdd5c0ce5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:44.779 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:44.777+0000 7fdd6159e640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fdd5c0d0d70 0x7fdd5c0d17a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:44.779 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:44.777+0000 7fdd6159e640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd5c0b2280 con 0x7fdd5c0cf6a0 2023-12-17T11:49:44.779 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:44.777+0000 7fdd6159e640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd5c0cee70 con 0x7fdd5c0d0d70 2023-12-17T11:49:44.779 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:44.777+0000 7fdd6159e640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd5c0d11c0 con 0x7fdd5c0d13c0 2023-12-17T11:49:44.780 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:44.778+0000 7fdd53fff640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fdd5c0d0d70 0x7fdd5c0d17a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:44.780 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:44.778+0000 7fdd53fff640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fdd5c0d0d70 0x7fdd5c0d17a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:37080/0 (socket says 172.21.15.40:37080) 2023-12-17T11:49:44.780 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:44.778+0000 7fdd53fff640 1 -- 172.21.15.40:0/736986849 learned_addr learned my addr 172.21.15.40:0/736986849 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-17T11:49:44.780 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:44.778+0000 7fdd5bfff640 1 --2- 172.21.15.40:0/736986849 >> v2:172.21.15.159:3300/0 conn(0x7fdd5c0d13c0 0x7fdd5c0ce5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:44.781 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:44.778+0000 7fdd53fff640 1 -- 172.21.15.40:0/736986849 >> v2:172.21.15.159:3300/0 conn(0x7fdd5c0d13c0 msgr2=0x7fdd5c0ce5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:49:44.781 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:44.778+0000 7fdd53fff640 1 --2- 172.21.15.40:0/736986849 >> v2:172.21.15.159:3300/0 conn(0x7fdd5c0d13c0 0x7fdd5c0ce5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:44.781 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:44.778+0000 7fdd53fff640 1 -- 172.21.15.40:0/736986849 >> v1:172.21.15.159:6789/0 conn(0x7fdd5c0cf6a0 legacy=0x7fdd5c0cfac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:49:44.781 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:44.778+0000 7fdd53fff640 1 -- 172.21.15.40:0/736986849 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd5c0d1ce0 con 0x7fdd5c0d0d70 2023-12-17T11:49:44.781 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:44.779+0000 7fdd53fff640 1 --2- 172.21.15.40:0/736986849 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdd5c0d0d70 0x7fdd5c0d17a0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fdd5c08b740 tx=0x7fdd4402b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95d967d890fe3355 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:49:44.782 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:44.780+0000 7fdd5b7fe640 1 -- 172.21.15.40:0/736986849 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd440317e0 con 0x7fdd5c0d0d70 2023-12-17T11:49:44.782 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:44.780+0000 7fdd5b7fe640 1 -- 172.21.15.40:0/736986849 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd44031940 con 0x7fdd5c0d0d70 2023-12-17T11:49:44.782 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:44.780+0000 7fdd5b7fe640 1 -- 172.21.15.40:0/736986849 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd44031cd0 con 0x7fdd5c0d0d70 2023-12-17T11:49:44.783 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:44.780+0000 7fdd6159e640 1 -- 172.21.15.40:0/736986849 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdd5c0d0d70 msgr2=0x7fdd5c0d17a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:44.783 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:44.780+0000 7fdd6159e640 1 --2- 172.21.15.40:0/736986849 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdd5c0d0d70 0x7fdd5c0d17a0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fdd5c08b740 tx=0x7fdd4402b880 comp rx=0 tx=0).stop 2023-12-17T11:49:44.783 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:44.780+0000 7fdd6159e640 1 -- 172.21.15.40:0/736986849 shutdown_connections 2023-12-17T11:49:44.783 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:44.780+0000 7fdd6159e640 1 --2- 172.21.15.40:0/736986849 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdd5c0d0d70 0x7fdd5c0d17a0 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:44.783 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:44.780+0000 7fdd6159e640 1 --2- 172.21.15.40:0/736986849 >> v2:172.21.15.159:3300/0 conn(0x7fdd5c0d13c0 0x7fdd5c0ce5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:44.783 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:44.780+0000 7fdd6159e640 1 -- 172.21.15.40:0/736986849 >> 172.21.15.40:0/736986849 conn(0x7fdd5c09c260 msgr2=0x7fdd5c0d2f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:49:44.783 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:44.781+0000 7fdd6159e640 1 -- 172.21.15.40:0/736986849 shutdown_connections 2023-12-17T11:49:44.783 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:44.781+0000 7fdd6159e640 1 -- 172.21.15.40:0/736986849 wait complete. 2023-12-17T11:49:44.784 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:44.782+0000 7fdd6159e640 1 Processor -- start 2023-12-17T11:49:44.784 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:44.783+0000 7fdd6159e640 1 -- start start 2023-12-17T11:49:44.786 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:44.784+0000 7fdd6159e640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fdd5c0cf6a0 0x7fdd5c15a710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:44.786 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:44.784+0000 7fdd6159e640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdd5c0d0d70 0x7fdd5c15af50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:44.786 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:44.784+0000 7fdd6159e640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdd5c0d13c0 0x7fdd5c0c79b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:44.786 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:44.784+0000 7fdd6159e640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd5c0c6910 con 0x7fdd5c0d0d70 2023-12-17T11:49:44.786 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:44.784+0000 7fdd6159e640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd5c0c6bf0 con 0x7fdd5c0d13c0 2023-12-17T11:49:44.786 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:44.784+0000 7fdd6159e640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd5c0c6ed0 con 0x7fdd5c0cf6a0 2023-12-17T11:49:44.786 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:44.784+0000 7fdd53fff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdd5c0d0d70 0x7fdd5c15af50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:44.786 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:44.784+0000 7fdd53fff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdd5c0d0d70 0x7fdd5c15af50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:37084/0 (socket says 172.21.15.40:37084) 2023-12-17T11:49:44.786 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:44.784+0000 7fdd53fff640 1 -- 172.21.15.40:0/1904803655 learned_addr learned my addr 172.21.15.40:0/1904803655 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-17T11:49:44.787 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:44.784+0000 7fdd5bfff640 1 --2- 172.21.15.40:0/1904803655 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fdd5c0cf6a0 0x7fdd5c15a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:44.788 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:44.784+0000 7fdd60d9d640 1 --2- 172.21.15.40:0/1904803655 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdd5c0d13c0 0x7fdd5c0c79b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:44.788 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:44.784+0000 7fdd53fff640 1 -- 172.21.15.40:0/1904803655 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fdd5c0cf6a0 msgr2=0x7fdd5c15a710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:44.788 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:44.784+0000 7fdd53fff640 1 --2- 172.21.15.40:0/1904803655 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fdd5c0cf6a0 0x7fdd5c15a710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:44.788 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:44.784+0000 7fdd53fff640 1 -- 172.21.15.40:0/1904803655 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdd5c0d13c0 msgr2=0x7fdd5c0c79b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:44.788 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:44.784+0000 7fdd53fff640 1 --2- 172.21.15.40:0/1904803655 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdd5c0d13c0 0x7fdd5c0c79b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:44.788 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:44.784+0000 7fdd53fff640 1 -- 172.21.15.40:0/1904803655 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd440094d0 con 0x7fdd5c0d0d70 2023-12-17T11:49:44.788 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:44.785+0000 7fdd53fff640 1 --2- 172.21.15.40:0/1904803655 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdd5c0d0d70 0x7fdd5c15af50 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fdd44000c00 tx=0x7fdd440046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:49:44.788 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:44.785+0000 7fdd597fa640 1 -- 172.21.15.40:0/1904803655 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd44032880 con 0x7fdd5c0d0d70 2023-12-17T11:49:44.788 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:44.785+0000 7fdd597fa640 1 -- 172.21.15.40:0/1904803655 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd440329e0 con 0x7fdd5c0d0d70 2023-12-17T11:49:44.788 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:44.785+0000 7fdd597fa640 1 -- 172.21.15.40:0/1904803655 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd44032d90 con 0x7fdd5c0d0d70 2023-12-17T11:49:44.788 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:44.785+0000 7fdd6159e640 1 -- 172.21.15.40:0/1904803655 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd5c0c71b0 con 0x7fdd5c0d0d70 2023-12-17T11:49:44.788 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:44.785+0000 7fdd6159e640 1 -- 172.21.15.40:0/1904803655 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd5c0c65c0 con 0x7fdd5c0d0d70 2023-12-17T11:49:44.789 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:44.787+0000 7fdd6159e640 1 -- 172.21.15.40:0/1904803655 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd5c0c76d0 con 0x7fdd5c0d0d70 2023-12-17T11:49:44.789 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:44.787+0000 7fdd597fa640 1 -- 172.21.15.40:0/1904803655 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fdd4404d3f0 con 0x7fdd5c0d0d70 2023-12-17T11:49:44.790 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:44.788+0000 7fdd597fa640 1 --2- 172.21.15.40:0/1904803655 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7fdd3c06ae90 0x7fdd3c06d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:44.790 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:44.788+0000 7fdd597fa640 1 -- 172.21.15.40:0/1904803655 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5177+0+0 (secure 0 0 0) 0x7fdd440ab0f0 con 0x7fdd5c0d0d70 2023-12-17T11:49:44.791 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:44.789+0000 7fdd5bfff640 1 --2- 172.21.15.40:0/1904803655 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7fdd3c06ae90 0x7fdd3c06d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:44.792 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:44.790+0000 7fdd5bfff640 1 --2- 172.21.15.40:0/1904803655 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7fdd3c06ae90 0x7fdd3c06d350 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fdd4c006fd0 tx=0x7fdd4c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:49:44.795 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:44.793+0000 7fdd597fa640 1 -- 172.21.15.40:0/1904803655 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fdd5c0c76d0 con 0x7fdd5c0d0d70 2023-12-17T11:49:45.061 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:45.059+0000 7fdd6159e640 1 -- 172.21.15.40:0/1904803655 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7fdd5c0c76d0 con 0x7fdd5c0d0d70 2023-12-17T11:49:45.062 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:45.060+0000 7fdd597fa640 1 -- 172.21.15.40:0/1904803655 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v2) v1 ==== 80+0+6645 (secure 0 0 0) 0x7fdd5c0c76d0 con 0x7fdd5c0d0d70 2023-12-17T11:49:45.062 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T11:49:45.062 INFO:teuthology.orchestra.run.smithi040.stdout:{ 2023-12-17T11:49:45.062 INFO:teuthology.orchestra.run.smithi040.stdout: "auth_dump": [ 2023-12-17T11:49:45.063 INFO:teuthology.orchestra.run.smithi040.stdout: { 2023-12-17T11:49:45.063 INFO:teuthology.orchestra.run.smithi040.stdout: "entity": "mds.a", 2023-12-17T11:49:45.063 INFO:teuthology.orchestra.run.smithi040.stdout: "key": "AQC/335lcMJiAxAAEmAhqsD5Ez8lOxO/36u06Q==", 2023-12-17T11:49:45.063 INFO:teuthology.orchestra.run.smithi040.stdout: "caps": { 2023-12-17T11:49:45.063 INFO:teuthology.orchestra.run.smithi040.stdout: "mds": "allow", 2023-12-17T11:49:45.063 INFO:teuthology.orchestra.run.smithi040.stdout: "mgr": "allow *", 2023-12-17T11:49:45.063 INFO:teuthology.orchestra.run.smithi040.stdout: "mon": "allow *", 2023-12-17T11:49:45.063 INFO:teuthology.orchestra.run.smithi040.stdout: "osd": "allow *" 2023-12-17T11:49:45.063 INFO:teuthology.orchestra.run.smithi040.stdout: } 2023-12-17T11:49:45.063 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2023-12-17T11:49:45.063 INFO:teuthology.orchestra.run.smithi040.stdout: { 2023-12-17T11:49:45.063 INFO:teuthology.orchestra.run.smithi040.stdout: "entity": "mds.b", 2023-12-17T11:49:45.063 INFO:teuthology.orchestra.run.smithi040.stdout: "key": "AQC/335lNTk8JxAAr4s47d9dZY5AF9DZJFJ/GQ==", 2023-12-17T11:49:45.064 INFO:teuthology.orchestra.run.smithi040.stdout: "caps": { 2023-12-17T11:49:45.064 INFO:teuthology.orchestra.run.smithi040.stdout: "mds": "allow", 2023-12-17T11:49:45.064 INFO:teuthology.orchestra.run.smithi040.stdout: "mgr": "allow *", 2023-12-17T11:49:45.064 INFO:teuthology.orchestra.run.smithi040.stdout: "mon": "allow *", 2023-12-17T11:49:45.064 INFO:teuthology.orchestra.run.smithi040.stdout: "osd": "allow *" 2023-12-17T11:49:45.064 INFO:teuthology.orchestra.run.smithi040.stdout: } 2023-12-17T11:49:45.064 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2023-12-17T11:49:45.064 INFO:teuthology.orchestra.run.smithi040.stdout: { 2023-12-17T11:49:45.064 INFO:teuthology.orchestra.run.smithi040.stdout: "entity": "mds.c", 2023-12-17T11:49:45.064 INFO:teuthology.orchestra.run.smithi040.stdout: "key": "AQC/335l69xuFRAA9R2H20UsV4CYNgA6mMVNlw==", 2023-12-17T11:49:45.064 INFO:teuthology.orchestra.run.smithi040.stdout: "caps": { 2023-12-17T11:49:45.065 INFO:teuthology.orchestra.run.smithi040.stdout: "mds": "allow", 2023-12-17T11:49:45.065 INFO:teuthology.orchestra.run.smithi040.stdout: "mgr": "allow *", 2023-12-17T11:49:45.065 INFO:teuthology.orchestra.run.smithi040.stdout: "mon": "allow *", 2023-12-17T11:49:45.065 INFO:teuthology.orchestra.run.smithi040.stdout: "osd": "allow *" 2023-12-17T11:49:45.065 INFO:teuthology.orchestra.run.smithi040.stdout: } 2023-12-17T11:49:45.065 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2023-12-17T11:49:45.065 INFO:teuthology.orchestra.run.smithi040.stdout: { 2023-12-17T11:49:45.065 INFO:teuthology.orchestra.run.smithi040.stdout: "entity": "mds.d", 2023-12-17T11:49:45.065 INFO:teuthology.orchestra.run.smithi040.stdout: "key": "AQC/335lu3dpOBAA9oeMahnP/SF0e87WZuak9Q==", 2023-12-17T11:49:45.065 INFO:teuthology.orchestra.run.smithi040.stdout: "caps": { 2023-12-17T11:49:45.065 INFO:teuthology.orchestra.run.smithi040.stdout: "mds": "allow", 2023-12-17T11:49:45.065 INFO:teuthology.orchestra.run.smithi040.stdout: "mgr": "allow *", 2023-12-17T11:49:45.065 INFO:teuthology.orchestra.run.smithi040.stdout: "mon": "allow *", 2023-12-17T11:49:45.066 INFO:teuthology.orchestra.run.smithi040.stdout: "osd": "allow *" 2023-12-17T11:49:45.066 INFO:teuthology.orchestra.run.smithi040.stdout: } 2023-12-17T11:49:45.066 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2023-12-17T11:49:45.066 INFO:teuthology.orchestra.run.smithi040.stdout: { 2023-12-17T11:49:45.066 INFO:teuthology.orchestra.run.smithi040.stdout: "entity": "osd.0", 2023-12-17T11:49:45.066 INFO:teuthology.orchestra.run.smithi040.stdout: "key": "AQDE335l5BjwOhAACWNnZr4ORrVRzTdqHwhulQ==", 2023-12-17T11:49:45.066 INFO:teuthology.orchestra.run.smithi040.stdout: "caps": { 2023-12-17T11:49:45.066 INFO:teuthology.orchestra.run.smithi040.stdout: "mgr": "allow profile osd", 2023-12-17T11:49:45.066 INFO:teuthology.orchestra.run.smithi040.stdout: "mon": "allow profile osd", 2023-12-17T11:49:45.066 INFO:teuthology.orchestra.run.smithi040.stdout: "osd": "allow *" 2023-12-17T11:49:45.066 INFO:teuthology.orchestra.run.smithi040.stdout: } 2023-12-17T11:49:45.066 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2023-12-17T11:49:45.066 INFO:teuthology.orchestra.run.smithi040.stdout: { 2023-12-17T11:49:45.066 INFO:teuthology.orchestra.run.smithi040.stdout: "entity": "osd.1", 2023-12-17T11:49:45.067 INFO:teuthology.orchestra.run.smithi040.stdout: "key": "AQDI335lb1LxGhAA3S6fG2ua5UPxWRyyJjwmwA==", 2023-12-17T11:49:45.067 INFO:teuthology.orchestra.run.smithi040.stdout: "caps": { 2023-12-17T11:49:45.067 INFO:teuthology.orchestra.run.smithi040.stdout: "mgr": "allow profile osd", 2023-12-17T11:49:45.067 INFO:teuthology.orchestra.run.smithi040.stdout: "mon": "allow profile osd", 2023-12-17T11:49:45.067 INFO:teuthology.orchestra.run.smithi040.stdout: "osd": "allow *" 2023-12-17T11:49:45.067 INFO:teuthology.orchestra.run.smithi040.stdout: } 2023-12-17T11:49:45.067 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2023-12-17T11:49:45.067 INFO:teuthology.orchestra.run.smithi040.stdout: { 2023-12-17T11:49:45.068 INFO:teuthology.orchestra.run.smithi040.stdout: "entity": "osd.2", 2023-12-17T11:49:45.068 INFO:teuthology.orchestra.run.smithi040.stdout: "key": "AQDL335lVA+fNBAA8EmJWJjqzq2Wqo7wqNzqfw==", 2023-12-17T11:49:45.068 INFO:teuthology.orchestra.run.smithi040.stdout: "caps": { 2023-12-17T11:49:45.068 INFO:teuthology.orchestra.run.smithi040.stdout: "mgr": "allow profile osd", 2023-12-17T11:49:45.068 INFO:teuthology.orchestra.run.smithi040.stdout: "mon": "allow profile osd", 2023-12-17T11:49:45.068 INFO:teuthology.orchestra.run.smithi040.stdout: "osd": "allow *" 2023-12-17T11:49:45.068 INFO:teuthology.orchestra.run.smithi040.stdout: } 2023-12-17T11:49:45.068 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2023-12-17T11:49:45.068 INFO:teuthology.orchestra.run.smithi040.stdout: { 2023-12-17T11:49:45.068 INFO:teuthology.orchestra.run.smithi040.stdout: "entity": "osd.3", 2023-12-17T11:49:45.068 INFO:teuthology.orchestra.run.smithi040.stdout: "key": "AQDP335l7M6SExAAaBvAl5kmaHX+Db8AfYim9A==", 2023-12-17T11:49:45.068 INFO:teuthology.orchestra.run.smithi040.stdout: "caps": { 2023-12-17T11:49:45.068 INFO:teuthology.orchestra.run.smithi040.stdout: "mgr": "allow profile osd", 2023-12-17T11:49:45.068 INFO:teuthology.orchestra.run.smithi040.stdout: "mon": "allow profile osd", 2023-12-17T11:49:45.069 INFO:teuthology.orchestra.run.smithi040.stdout: "osd": "allow *" 2023-12-17T11:49:45.069 INFO:teuthology.orchestra.run.smithi040.stdout: } 2023-12-17T11:49:45.069 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2023-12-17T11:49:45.069 INFO:teuthology.orchestra.run.smithi040.stdout: { 2023-12-17T11:49:45.069 INFO:teuthology.orchestra.run.smithi040.stdout: "entity": "osd.4", 2023-12-17T11:49:45.069 INFO:teuthology.orchestra.run.smithi040.stdout: "key": "AQDW335l+9O3ERAAdpR1Sud4LOjJP69Q9UGXfA==", 2023-12-17T11:49:45.069 INFO:teuthology.orchestra.run.smithi040.stdout: "caps": { 2023-12-17T11:49:45.069 INFO:teuthology.orchestra.run.smithi040.stdout: "mgr": "allow profile osd", 2023-12-17T11:49:45.069 INFO:teuthology.orchestra.run.smithi040.stdout: "mon": "allow profile osd", 2023-12-17T11:49:45.069 INFO:teuthology.orchestra.run.smithi040.stdout: "osd": "allow *" 2023-12-17T11:49:45.069 INFO:teuthology.orchestra.run.smithi040.stdout: } 2023-12-17T11:49:45.069 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2023-12-17T11:49:45.070 INFO:teuthology.orchestra.run.smithi040.stdout: { 2023-12-17T11:49:45.070 INFO:teuthology.orchestra.run.smithi040.stdout: "entity": "osd.5", 2023-12-17T11:49:45.070 INFO:teuthology.orchestra.run.smithi040.stdout: "key": "AQDZ335l7yzcKhAA01WjGwKvT2iD4kCzdND2lA==", 2023-12-17T11:49:45.070 INFO:teuthology.orchestra.run.smithi040.stdout: "caps": { 2023-12-17T11:49:45.070 INFO:teuthology.orchestra.run.smithi040.stdout: "mgr": "allow profile osd", 2023-12-17T11:49:45.070 INFO:teuthology.orchestra.run.smithi040.stdout: "mon": "allow profile osd", 2023-12-17T11:49:45.070 INFO:teuthology.orchestra.run.smithi040.stdout: "osd": "allow *" 2023-12-17T11:49:45.070 INFO:teuthology.orchestra.run.smithi040.stdout: } 2023-12-17T11:49:45.070 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2023-12-17T11:49:45.070 INFO:teuthology.orchestra.run.smithi040.stdout: { 2023-12-17T11:49:45.070 INFO:teuthology.orchestra.run.smithi040.stdout: "entity": "osd.6", 2023-12-17T11:49:45.070 INFO:teuthology.orchestra.run.smithi040.stdout: "key": "AQDc335ll8SWNBAAZjx/5PJ1XC3W7J5N9Ago0w==", 2023-12-17T11:49:45.070 INFO:teuthology.orchestra.run.smithi040.stdout: "caps": { 2023-12-17T11:49:45.070 INFO:teuthology.orchestra.run.smithi040.stdout: "mgr": "allow profile osd", 2023-12-17T11:49:45.070 INFO:teuthology.orchestra.run.smithi040.stdout: "mon": "allow profile osd", 2023-12-17T11:49:45.071 INFO:teuthology.orchestra.run.smithi040.stdout: "osd": "allow *" 2023-12-17T11:49:45.071 INFO:teuthology.orchestra.run.smithi040.stdout: } 2023-12-17T11:49:45.071 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2023-12-17T11:49:45.071 INFO:teuthology.orchestra.run.smithi040.stdout: { 2023-12-17T11:49:45.071 INFO:teuthology.orchestra.run.smithi040.stdout: "entity": "osd.7", 2023-12-17T11:49:45.071 INFO:teuthology.orchestra.run.smithi040.stdout: "key": "AQDg335l9CHMEhAAWssX8Rz4sxBbSRMyQONxKg==", 2023-12-17T11:49:45.071 INFO:teuthology.orchestra.run.smithi040.stdout: "caps": { 2023-12-17T11:49:45.071 INFO:teuthology.orchestra.run.smithi040.stdout: "mgr": "allow profile osd", 2023-12-17T11:49:45.071 INFO:teuthology.orchestra.run.smithi040.stdout: "mon": "allow profile osd", 2023-12-17T11:49:45.071 INFO:teuthology.orchestra.run.smithi040.stdout: "osd": "allow *" 2023-12-17T11:49:45.071 INFO:teuthology.orchestra.run.smithi040.stdout: } 2023-12-17T11:49:45.071 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2023-12-17T11:49:45.072 INFO:teuthology.orchestra.run.smithi040.stdout: { 2023-12-17T11:49:45.072 INFO:teuthology.orchestra.run.smithi040.stdout: "entity": "client.0", 2023-12-17T11:49:45.072 INFO:teuthology.orchestra.run.smithi040.stdout: "key": "AQDA335l6XHnCxAAxjHOSjT8N5JpduZyqQ+KYw==", 2023-12-17T11:49:45.072 INFO:teuthology.orchestra.run.smithi040.stdout: "caps": { 2023-12-17T11:49:45.072 INFO:teuthology.orchestra.run.smithi040.stdout: "mds": "allow", 2023-12-17T11:49:45.072 INFO:teuthology.orchestra.run.smithi040.stdout: "mgr": "allow r", 2023-12-17T11:49:45.072 INFO:teuthology.orchestra.run.smithi040.stdout: "mon": "allow rw", 2023-12-17T11:49:45.072 INFO:teuthology.orchestra.run.smithi040.stdout: "osd": "allow rwx" 2023-12-17T11:49:45.072 INFO:teuthology.orchestra.run.smithi040.stdout: } 2023-12-17T11:49:45.072 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2023-12-17T11:49:45.072 INFO:teuthology.orchestra.run.smithi040.stdout: { 2023-12-17T11:49:45.072 INFO:teuthology.orchestra.run.smithi040.stdout: "entity": "client.1", 2023-12-17T11:49:45.072 INFO:teuthology.orchestra.run.smithi040.stdout: "key": "AQDA335l2dDaJBAAqotnT6fGcOq4En7mZ1fQWQ==", 2023-12-17T11:49:45.072 INFO:teuthology.orchestra.run.smithi040.stdout: "caps": { 2023-12-17T11:49:45.072 INFO:teuthology.orchestra.run.smithi040.stdout: "mds": "allow", 2023-12-17T11:49:45.073 INFO:teuthology.orchestra.run.smithi040.stdout: "mgr": "allow r", 2023-12-17T11:49:45.073 INFO:teuthology.orchestra.run.smithi040.stdout: "mon": "allow rw", 2023-12-17T11:49:45.073 INFO:teuthology.orchestra.run.smithi040.stdout: "osd": "allow rwx" 2023-12-17T11:49:45.073 INFO:teuthology.orchestra.run.smithi040.stdout: } 2023-12-17T11:49:45.073 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2023-12-17T11:49:45.073 INFO:teuthology.orchestra.run.smithi040.stdout: { 2023-12-17T11:49:45.073 INFO:teuthology.orchestra.run.smithi040.stdout: "entity": "client.2", 2023-12-17T11:49:45.073 INFO:teuthology.orchestra.run.smithi040.stdout: "key": "AQDA335lI87NGBAAZe7NcEi86g4it2cYfeHTRw==", 2023-12-17T11:49:45.073 INFO:teuthology.orchestra.run.smithi040.stdout: "caps": { 2023-12-17T11:49:45.073 INFO:teuthology.orchestra.run.smithi040.stdout: "mds": "allow", 2023-12-17T11:49:45.073 INFO:teuthology.orchestra.run.smithi040.stdout: "mgr": "allow r", 2023-12-17T11:49:45.073 INFO:teuthology.orchestra.run.smithi040.stdout: "mon": "allow rw", 2023-12-17T11:49:45.073 INFO:teuthology.orchestra.run.smithi040.stdout: "osd": "allow rwx" 2023-12-17T11:49:45.073 INFO:teuthology.orchestra.run.smithi040.stdout: } 2023-12-17T11:49:45.074 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2023-12-17T11:49:45.074 INFO:teuthology.orchestra.run.smithi040.stdout: { 2023-12-17T11:49:45.074 INFO:teuthology.orchestra.run.smithi040.stdout: "entity": "client.3", 2023-12-17T11:49:45.074 INFO:teuthology.orchestra.run.smithi040.stdout: "key": "AQDA335l2n+iLxAAadKFkVp+ELQtwaUpu1fpYQ==", 2023-12-17T11:49:45.074 INFO:teuthology.orchestra.run.smithi040.stdout: "caps": { 2023-12-17T11:49:45.074 INFO:teuthology.orchestra.run.smithi040.stdout: "mds": "allow", 2023-12-17T11:49:45.074 INFO:teuthology.orchestra.run.smithi040.stdout: "mgr": "allow r", 2023-12-17T11:49:45.074 INFO:teuthology.orchestra.run.smithi040.stdout: "mon": "allow rw", 2023-12-17T11:49:45.074 INFO:teuthology.orchestra.run.smithi040.stdout: "osd": "allow rwx" 2023-12-17T11:49:45.074 INFO:teuthology.orchestra.run.smithi040.stdout: } 2023-12-17T11:49:45.074 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2023-12-17T11:49:45.074 INFO:teuthology.orchestra.run.smithi040.stdout: { 2023-12-17T11:49:45.074 INFO:teuthology.orchestra.run.smithi040.stdout: "entity": "client.admin", 2023-12-17T11:49:45.074 INFO:teuthology.orchestra.run.smithi040.stdout: "key": "AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA==", 2023-12-17T11:49:45.074 INFO:teuthology.orchestra.run.smithi040.stdout: "caps": { 2023-12-17T11:49:45.075 INFO:teuthology.orchestra.run.smithi040.stdout: "mds": "allow *", 2023-12-17T11:49:45.075 INFO:teuthology.orchestra.run.smithi040.stdout: "mgr": "allow *", 2023-12-17T11:49:45.075 INFO:teuthology.orchestra.run.smithi040.stdout: "mon": "allow *", 2023-12-17T11:49:45.075 INFO:teuthology.orchestra.run.smithi040.stdout: "osd": "allow *" 2023-12-17T11:49:45.075 INFO:teuthology.orchestra.run.smithi040.stdout: } 2023-12-17T11:49:45.075 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2023-12-17T11:49:45.075 INFO:teuthology.orchestra.run.smithi040.stdout: { 2023-12-17T11:49:45.075 INFO:teuthology.orchestra.run.smithi040.stdout: "entity": "client.bootstrap-mds", 2023-12-17T11:49:45.075 INFO:teuthology.orchestra.run.smithi040.stdout: "key": "AQDp335lBWvcGhAA3NotJqegjNl5a8vrvuHDsw==", 2023-12-17T11:49:45.075 INFO:teuthology.orchestra.run.smithi040.stdout: "caps": { 2023-12-17T11:49:45.075 INFO:teuthology.orchestra.run.smithi040.stdout: "mon": "allow profile bootstrap-mds" 2023-12-17T11:49:45.075 INFO:teuthology.orchestra.run.smithi040.stdout: } 2023-12-17T11:49:45.075 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2023-12-17T11:49:45.075 INFO:teuthology.orchestra.run.smithi040.stdout: { 2023-12-17T11:49:45.076 INFO:teuthology.orchestra.run.smithi040.stdout: "entity": "client.bootstrap-mgr", 2023-12-17T11:49:45.076 INFO:teuthology.orchestra.run.smithi040.stdout: "key": "AQDp335lF3XcGhAADJ9Yae8OdErPrRw+RnB7WA==", 2023-12-17T11:49:45.076 INFO:teuthology.orchestra.run.smithi040.stdout: "caps": { 2023-12-17T11:49:45.076 INFO:teuthology.orchestra.run.smithi040.stdout: "mon": "allow profile bootstrap-mgr" 2023-12-17T11:49:45.076 INFO:teuthology.orchestra.run.smithi040.stdout: } 2023-12-17T11:49:45.076 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2023-12-17T11:49:45.076 INFO:teuthology.orchestra.run.smithi040.stdout: { 2023-12-17T11:49:45.076 INFO:teuthology.orchestra.run.smithi040.stdout: "entity": "client.bootstrap-osd", 2023-12-17T11:49:45.076 INFO:teuthology.orchestra.run.smithi040.stdout: "key": "AQDp335lz33cGhAALNqXDOOiJqzZKyvbaAZreg==", 2023-12-17T11:49:45.076 INFO:teuthology.orchestra.run.smithi040.stdout: "caps": { 2023-12-17T11:49:45.076 INFO:teuthology.orchestra.run.smithi040.stdout: "mon": "allow profile bootstrap-osd" 2023-12-17T11:49:45.076 INFO:teuthology.orchestra.run.smithi040.stdout: } 2023-12-17T11:49:45.076 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2023-12-17T11:49:45.076 INFO:teuthology.orchestra.run.smithi040.stdout: { 2023-12-17T11:49:45.077 INFO:teuthology.orchestra.run.smithi040.stdout: "entity": "client.bootstrap-rbd", 2023-12-17T11:49:45.077 INFO:teuthology.orchestra.run.smithi040.stdout: "key": "AQDp335lLofcGhAA8FspFxzQaoOMR/N6ws1oQQ==", 2023-12-17T11:49:45.077 INFO:teuthology.orchestra.run.smithi040.stdout: "caps": { 2023-12-17T11:49:45.077 INFO:teuthology.orchestra.run.smithi040.stdout: "mon": "allow profile bootstrap-rbd" 2023-12-17T11:49:45.077 INFO:teuthology.orchestra.run.smithi040.stdout: } 2023-12-17T11:49:45.077 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2023-12-17T11:49:45.077 INFO:teuthology.orchestra.run.smithi040.stdout: { 2023-12-17T11:49:45.077 INFO:teuthology.orchestra.run.smithi040.stdout: "entity": "client.bootstrap-rbd-mirror", 2023-12-17T11:49:45.077 INFO:teuthology.orchestra.run.smithi040.stdout: "key": "AQDp335lipLcGhAARl7hRqCV6lI5pUZ+shtNjw==", 2023-12-17T11:49:45.077 INFO:teuthology.orchestra.run.smithi040.stdout: "caps": { 2023-12-17T11:49:45.077 INFO:teuthology.orchestra.run.smithi040.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2023-12-17T11:49:45.077 INFO:teuthology.orchestra.run.smithi040.stdout: } 2023-12-17T11:49:45.078 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2023-12-17T11:49:45.078 INFO:teuthology.orchestra.run.smithi040.stdout: { 2023-12-17T11:49:45.078 INFO:teuthology.orchestra.run.smithi040.stdout: "entity": "client.bootstrap-rgw", 2023-12-17T11:49:45.078 INFO:teuthology.orchestra.run.smithi040.stdout: "key": "AQDp335lDJzcGhAAA1/0f1ljmpasX2USIku0uw==", 2023-12-17T11:49:45.078 INFO:teuthology.orchestra.run.smithi040.stdout: "caps": { 2023-12-17T11:49:45.078 INFO:teuthology.orchestra.run.smithi040.stdout: "mon": "allow profile bootstrap-rgw" 2023-12-17T11:49:45.078 INFO:teuthology.orchestra.run.smithi040.stdout: } 2023-12-17T11:49:45.078 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2023-12-17T11:49:45.078 INFO:teuthology.orchestra.run.smithi040.stdout: { 2023-12-17T11:49:45.078 INFO:teuthology.orchestra.run.smithi040.stdout: "entity": "mgr.x", 2023-12-17T11:49:45.079 INFO:teuthology.orchestra.run.smithi040.stdout: "key": "AQC+335loC8TMhAA82XLYfdL2X1wSvK1nlwEPQ==", 2023-12-17T11:49:45.079 INFO:teuthology.orchestra.run.smithi040.stdout: "caps": { 2023-12-17T11:49:45.079 INFO:teuthology.orchestra.run.smithi040.stdout: "mds": "allow *", 2023-12-17T11:49:45.079 INFO:teuthology.orchestra.run.smithi040.stdout: "mon": "allow profile mgr", 2023-12-17T11:49:45.079 INFO:teuthology.orchestra.run.smithi040.stdout: "osd": "allow *" 2023-12-17T11:49:45.079 INFO:teuthology.orchestra.run.smithi040.stdout: } 2023-12-17T11:49:45.079 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2023-12-17T11:49:45.079 INFO:teuthology.orchestra.run.smithi040.stdout: { 2023-12-17T11:49:45.079 INFO:teuthology.orchestra.run.smithi040.stdout: "entity": "mgr.y", 2023-12-17T11:49:45.079 INFO:teuthology.orchestra.run.smithi040.stdout: "key": "AQC+335lXTMfJRAAHSbPetES3R1cYacqXspUeA==", 2023-12-17T11:49:45.080 INFO:teuthology.orchestra.run.smithi040.stdout: "caps": { 2023-12-17T11:49:45.080 INFO:teuthology.orchestra.run.smithi040.stdout: "mds": "allow *", 2023-12-17T11:49:45.080 INFO:teuthology.orchestra.run.smithi040.stdout: "mon": "allow profile mgr", 2023-12-17T11:49:45.080 INFO:teuthology.orchestra.run.smithi040.stdout: "osd": "allow *" 2023-12-17T11:49:45.080 INFO:teuthology.orchestra.run.smithi040.stdout: } 2023-12-17T11:49:45.080 INFO:teuthology.orchestra.run.smithi040.stdout: } 2023-12-17T11:49:45.080 INFO:teuthology.orchestra.run.smithi040.stdout: ] 2023-12-17T11:49:45.080 INFO:teuthology.orchestra.run.smithi040.stdout:} 2023-12-17T11:49:45.082 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:45.063+0000 7fdd6159e640 1 -- 172.21.15.40:0/1904803655 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7fdd3c06ae90 msgr2=0x7fdd3c06d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:45.082 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:45.063+0000 7fdd6159e640 1 --2- 172.21.15.40:0/1904803655 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7fdd3c06ae90 0x7fdd3c06d350 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fdd4c006fd0 tx=0x7fdd4c008040 comp rx=0 tx=0).stop 2023-12-17T11:49:45.082 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:45.063+0000 7fdd6159e640 1 -- 172.21.15.40:0/1904803655 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdd5c0d0d70 msgr2=0x7fdd5c15af50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:45.082 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:45.063+0000 7fdd6159e640 1 --2- 172.21.15.40:0/1904803655 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdd5c0d0d70 0x7fdd5c15af50 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fdd44000c00 tx=0x7fdd440046c0 comp rx=0 tx=0).stop 2023-12-17T11:49:45.082 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:45.063+0000 7fdd6159e640 1 -- 172.21.15.40:0/1904803655 shutdown_connections 2023-12-17T11:49:45.082 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:45.063+0000 7fdd6159e640 1 --2- 172.21.15.40:0/1904803655 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7fdd3c06ae90 0x7fdd3c06d350 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:45.082 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:45.063+0000 7fdd6159e640 1 --2- 172.21.15.40:0/1904803655 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdd5c0d13c0 0x7fdd5c0c79b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:45.083 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:45.063+0000 7fdd6159e640 1 --2- 172.21.15.40:0/1904803655 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdd5c0d0d70 0x7fdd5c15af50 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:45.083 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:45.063+0000 7fdd6159e640 1 --2- 172.21.15.40:0/1904803655 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fdd5c0cf6a0 0x7fdd5c15a710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:45.083 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:45.063+0000 7fdd6159e640 1 -- 172.21.15.40:0/1904803655 >> 172.21.15.40:0/1904803655 conn(0x7fdd5c09c260 msgr2=0x7fdd5c0b5c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:49:45.083 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:45.063+0000 7fdd6159e640 1 -- 172.21.15.40:0/1904803655 shutdown_connections 2023-12-17T11:49:45.083 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:45.063+0000 7fdd6159e640 1 -- 172.21.15.40:0/1904803655 wait complete. 2023-12-17T11:49:45.085 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2023-12-17T11:49:45.313 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:45.311+0000 7fa918952640 1 Processor -- start 2023-12-17T11:49:45.314 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:45.311+0000 7fa918952640 1 -- start start 2023-12-17T11:49:45.316 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:45.313+0000 7fa918952640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fa9140713b0 0x7fa9140ae1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:45.316 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:45.313+0000 7fa918952640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa914070750 0x7fa9140b27e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:45.317 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:45.313+0000 7fa918952640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa914070070 con 0x7fa914159fd0 2023-12-17T11:49:45.317 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:45.313+0000 7fa918952640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9140705f0 con 0x7fa9140713b0 2023-12-17T11:49:45.317 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:45.313+0000 7fa918952640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa914070310 con 0x7fa914070750 2023-12-17T11:49:45.317 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:45.313+0000 7fa91259c640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fa9140713b0 0x7fa9140ae1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:45.317 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:45.313+0000 7fa91259c640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fa9140713b0 0x7fa9140ae1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:42516/0 (socket says 172.21.15.40:42516) 2023-12-17T11:49:45.318 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:45.313+0000 7fa91259c640 1 -- 172.21.15.40:0/1691004029 learned_addr learned my addr 172.21.15.40:0/1691004029 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-17T11:49:45.318 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:45.314+0000 7fa91359e640 1 --2- 172.21.15.40:0/1691004029 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa914070750 0x7fa9140b27e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:45.318 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:45.314+0000 7fa91259c640 1 -- 172.21.15.40:0/1691004029 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa914070750 msgr2=0x7fa9140b27e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:49:45.318 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:45.314+0000 7fa91259c640 1 --2- 172.21.15.40:0/1691004029 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa914070750 0x7fa9140b27e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:45.318 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:45.314+0000 7fa91259c640 1 -- 172.21.15.40:0/1691004029 >> v1:172.21.15.159:6789/0 conn(0x7fa914159fd0 legacy=0x7fa914070ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:49:45.318 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:45.314+0000 7fa91259c640 1 -- 172.21.15.40:0/1691004029 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9140b1d00 con 0x7fa9140713b0 2023-12-17T11:49:45.321 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:45.315+0000 7fa91259c640 1 --2- 172.21.15.40:0/1691004029 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa9140713b0 0x7fa9140ae1d0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fa9140b1700 tx=0x7fa90802b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cbd2c021433fce19 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:49:45.321 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:45.315+0000 7fa911d9b640 1 -- 172.21.15.40:0/1691004029 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa908030610 con 0x7fa9140713b0 2023-12-17T11:49:45.321 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:45.315+0000 7fa911d9b640 1 -- 172.21.15.40:0/1691004029 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa908030770 con 0x7fa9140713b0 2023-12-17T11:49:45.321 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:45.315+0000 7fa911d9b640 1 -- 172.21.15.40:0/1691004029 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa908030b00 con 0x7fa9140713b0 2023-12-17T11:49:45.321 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:45.316+0000 7fa918952640 1 -- 172.21.15.40:0/1691004029 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa9140713b0 msgr2=0x7fa9140ae1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:45.321 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:45.316+0000 7fa918952640 1 --2- 172.21.15.40:0/1691004029 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa9140713b0 0x7fa9140ae1d0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fa9140b1700 tx=0x7fa90802b960 comp rx=0 tx=0).stop 2023-12-17T11:49:45.322 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:45.316+0000 7fa918952640 1 -- 172.21.15.40:0/1691004029 shutdown_connections 2023-12-17T11:49:45.322 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:45.316+0000 7fa918952640 1 --2- 172.21.15.40:0/1691004029 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa914070750 0x7fa9140b27e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:45.322 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:45.316+0000 7fa918952640 1 --2- 172.21.15.40:0/1691004029 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa9140713b0 0x7fa9140ae1d0 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:45.322 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:45.316+0000 7fa918952640 1 -- 172.21.15.40:0/1691004029 >> 172.21.15.40:0/1691004029 conn(0x7fa9140b0860 msgr2=0x7fa9140b0c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:49:45.322 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:45.316+0000 7fa918952640 1 -- 172.21.15.40:0/1691004029 shutdown_connections 2023-12-17T11:49:45.322 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:45.316+0000 7fa918952640 1 -- 172.21.15.40:0/1691004029 wait complete. 2023-12-17T11:49:45.323 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:45.318+0000 7fa918952640 1 Processor -- start 2023-12-17T11:49:45.323 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:45.318+0000 7fa918952640 1 -- start start 2023-12-17T11:49:45.326 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:45.319+0000 7fa918952640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa914070750 0x7fa91414dd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:45.326 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:45.319+0000 7fa918952640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa9140713b0 0x7fa9141e6e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:45.326 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:45.320+0000 7fa918952640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa914159fd0 0x7fa9141e7360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:45.326 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:45.320+0000 7fa918952640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa914152ec0 con 0x7fa914159fd0 2023-12-17T11:49:45.326 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:45.320+0000 7fa918952640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa91415acd0 con 0x7fa914070750 2023-12-17T11:49:45.327 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:45.320+0000 7fa918952640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa914152900 con 0x7fa9140713b0 2023-12-17T11:49:45.327 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:45.320+0000 7fa91359e640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa914159fd0 0x7fa9141e7360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:45.327 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:45.320+0000 7fa91359e640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa914159fd0 0x7fa9141e7360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:42532/0 (socket says 172.21.15.40:42532) 2023-12-17T11:49:45.327 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:45.320+0000 7fa91359e640 1 -- 172.21.15.40:0/3408421195 learned_addr learned my addr 172.21.15.40:0/3408421195 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-17T11:49:45.327 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:45.320+0000 7fa91259c640 1 --2- 172.21.15.40:0/3408421195 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa9140713b0 0x7fa9141e6e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:45.327 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:45.320+0000 7fa91359e640 1 -- 172.21.15.40:0/3408421195 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa9140713b0 msgr2=0x7fa9141e6e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:45.327 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:45.320+0000 7fa912d9d640 1 --2- 172.21.15.40:0/3408421195 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa914070750 0x7fa91414dd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:45.328 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:45.320+0000 7fa91359e640 1 --2- 172.21.15.40:0/3408421195 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa9140713b0 0x7fa9141e6e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:45.328 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:45.320+0000 7fa91359e640 1 -- 172.21.15.40:0/3408421195 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa914070750 msgr2=0x7fa91414dd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:45.328 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:45.320+0000 7fa91359e640 1 --2- 172.21.15.40:0/3408421195 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa914070750 0x7fa91414dd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:45.328 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:45.320+0000 7fa91359e640 1 -- 172.21.15.40:0/3408421195 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9080094d0 con 0x7fa914159fd0 2023-12-17T11:49:45.328 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:45.321+0000 7fa91359e640 1 --2- 172.21.15.40:0/3408421195 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa914159fd0 0x7fa9141e7360 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fa90c00cd70 tx=0x7fa90c00a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:49:45.329 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:45.321+0000 7fa8fb7fe640 1 -- 172.21.15.40:0/3408421195 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa90c003b90 con 0x7fa914159fd0 2023-12-17T11:49:45.329 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:45.321+0000 7fa8fb7fe640 1 -- 172.21.15.40:0/3408421195 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa90c003cf0 con 0x7fa914159fd0 2023-12-17T11:49:45.329 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:45.321+0000 7fa8fb7fe640 1 -- 172.21.15.40:0/3408421195 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa90c004240 con 0x7fa914159fd0 2023-12-17T11:49:45.329 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:45.321+0000 7fa918952640 1 -- 172.21.15.40:0/3408421195 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa914152be0 con 0x7fa914159fd0 2023-12-17T11:49:45.329 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:45.321+0000 7fa918952640 1 -- 172.21.15.40:0/3408421195 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9141e5020 con 0x7fa914159fd0 2023-12-17T11:49:45.329 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:45.322+0000 7fa918952640 1 -- 172.21.15.40:0/3408421195 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa9141e5210 con 0x7fa914159fd0 2023-12-17T11:49:45.330 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:45.324+0000 7fa8fb7fe640 1 -- 172.21.15.40:0/3408421195 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fa90c0043a0 con 0x7fa914159fd0 2023-12-17T11:49:45.331 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:45.325+0000 7fa8fb7fe640 1 --2- 172.21.15.40:0/3408421195 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7fa90006ae40 0x7fa90006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:45.331 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:45.325+0000 7fa8fb7fe640 1 -- 172.21.15.40:0/3408421195 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5177+0+0 (secure 0 0 0) 0x7fa90c012070 con 0x7fa914159fd0 2023-12-17T11:49:45.331 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:45.325+0000 7fa912d9d640 1 --2- 172.21.15.40:0/3408421195 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7fa90006ae40 0x7fa90006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:45.331 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:45.327+0000 7fa912d9d640 1 --2- 172.21.15.40:0/3408421195 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7fa90006ae40 0x7fa90006d300 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fa90400a750 tx=0x7fa904008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:49:45.331 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:45.328+0000 7fa8fb7fe640 1 -- 172.21.15.40:0/3408421195 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fa90c0550b0 con 0x7fa914159fd0 2023-12-17T11:49:45.601 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:45.598+0000 7fa918952640 1 -- 172.21.15.40:0/3408421195 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) v1 -- 0x7fa9141585b0 con 0x7fa914159fd0 2023-12-17T11:49:45.606 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:45.604+0000 7fa8fb7fe640 1 -- 172.21.15.40:0/3408421195 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v3) v1 ==== 90+0+0 (secure 0 0 0) 0x7fa90c0586d0 con 0x7fa914159fd0 2023-12-17T11:49:45.609 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:45.607+0000 7fa918952640 1 -- 172.21.15.40:0/3408421195 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7fa90006ae40 msgr2=0x7fa90006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:45.609 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:45.607+0000 7fa918952640 1 --2- 172.21.15.40:0/3408421195 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7fa90006ae40 0x7fa90006d300 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fa90400a750 tx=0x7fa904008040 comp rx=0 tx=0).stop 2023-12-17T11:49:45.610 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:45.607+0000 7fa918952640 1 -- 172.21.15.40:0/3408421195 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa914159fd0 msgr2=0x7fa9141e7360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:45.610 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:45.607+0000 7fa918952640 1 --2- 172.21.15.40:0/3408421195 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa914159fd0 0x7fa9141e7360 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fa90c00cd70 tx=0x7fa90c00a660 comp rx=0 tx=0).stop 2023-12-17T11:49:45.610 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:45.607+0000 7fa918952640 1 -- 172.21.15.40:0/3408421195 shutdown_connections 2023-12-17T11:49:45.610 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:45.607+0000 7fa918952640 1 --2- 172.21.15.40:0/3408421195 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7fa90006ae40 0x7fa90006d300 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:45.610 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:45.607+0000 7fa918952640 1 --2- 172.21.15.40:0/3408421195 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa914159fd0 0x7fa9141e7360 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:45.610 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:45.607+0000 7fa918952640 1 --2- 172.21.15.40:0/3408421195 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa9140713b0 0x7fa9141e6e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:45.610 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:45.607+0000 7fa918952640 1 --2- 172.21.15.40:0/3408421195 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa914070750 0x7fa91414dd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:45.610 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:45.607+0000 7fa918952640 1 -- 172.21.15.40:0/3408421195 >> 172.21.15.40:0/3408421195 conn(0x7fa9140b0860 msgr2=0x7fa914154850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:49:45.610 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:45.607+0000 7fa918952640 1 -- 172.21.15.40:0/3408421195 shutdown_connections 2023-12-17T11:49:45.610 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:45.608+0000 7fa918952640 1 -- 172.21.15.40:0/3408421195 wait complete. 2023-12-17T11:49:45.629 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2023-12-17T11:49:45.862 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:45.860+0000 7f90cca67640 1 Processor -- start 2023-12-17T11:49:45.862 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:45.860+0000 7f90cca67640 1 -- start start 2023-12-17T11:49:45.863 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:45.861+0000 7f90cca67640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f90c80d13c0 0x7f90c80ce5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:45.863 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:45.861+0000 7f90cca67640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f90c80b0760 0x7f90c80b0bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:45.863 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:45.861+0000 7f90cca67640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90c80b2280 con 0x7f90c80d0d70 2023-12-17T11:49:45.864 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:45.861+0000 7f90cca67640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90c80cee70 con 0x7f90c80d13c0 2023-12-17T11:49:45.864 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:45.861+0000 7f90cca67640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90c80d11c0 con 0x7f90c80b0760 2023-12-17T11:49:45.865 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:45.862+0000 7f90c77fe640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f90c80d13c0 0x7f90c80ce5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:45.865 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:45.862+0000 7f90c77fe640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f90c80d13c0 0x7f90c80ce5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:42536/0 (socket says 172.21.15.40:42536) 2023-12-17T11:49:45.865 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:45.862+0000 7f90c77fe640 1 -- 172.21.15.40:0/242230749 learned_addr learned my addr 172.21.15.40:0/242230749 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-17T11:49:45.865 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:45.862+0000 7f90c6ffd640 1 --1- 172.21.15.40:0/242230749 >> v1:172.21.15.40:6789/0 conn(0x7f90c80d0d70 0x7f90c80d17a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:44562/0 (socket says 172.21.15.40:44562) 2023-12-17T11:49:45.865 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:45.862+0000 7f90c7fff640 1 --2- 172.21.15.40:0/242230749 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f90c80b0760 0x7f90c80b0bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:45.865 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:45.862+0000 7f90c77fe640 1 -- 172.21.15.40:0/242230749 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f90c80b0760 msgr2=0x7f90c80b0bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:49:45.865 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:45.862+0000 7f90c77fe640 1 --2- 172.21.15.40:0/242230749 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f90c80b0760 0x7f90c80b0bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:45.865 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:45.863+0000 7f90c77fe640 1 -- 172.21.15.40:0/242230749 >> v1:172.21.15.40:6789/0 conn(0x7f90c80d0d70 legacy=0x7f90c80d17a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:45.865 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:45.863+0000 7f90c77fe640 1 -- 172.21.15.40:0/242230749 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90c80ceb90 con 0x7f90c80d13c0 2023-12-17T11:49:45.865 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:45.863+0000 7f90c67fc640 1 -- 172.21.15.40:0/242230749 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2477542644 0 0) 0x7f90c80b2280 con 0x7f90c80d0d70 2023-12-17T11:49:45.865 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:45.863+0000 7f90c7fff640 1 --2- 172.21.15.40:0/242230749 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f90c80b0760 0x7f90c80b0bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-17T11:49:45.867 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:45.864+0000 7f90c77fe640 1 --2- 172.21.15.40:0/242230749 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f90c80d13c0 0x7f90c80ce5b0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f90b8009e50 tx=0x7f90b802bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb717e06c24fd714 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:49:45.867 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:45.864+0000 7f90c67fc640 1 -- 172.21.15.40:0/242230749 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90b802ca70 con 0x7f90c80d13c0 2023-12-17T11:49:45.867 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:45.864+0000 7f90c67fc640 1 -- 172.21.15.40:0/242230749 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90b802cbd0 con 0x7f90c80d13c0 2023-12-17T11:49:45.867 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:45.864+0000 7f90c67fc640 1 -- 172.21.15.40:0/242230749 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90b80343f0 con 0x7f90c80d13c0 2023-12-17T11:49:45.867 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:45.865+0000 7f90cca67640 1 -- 172.21.15.40:0/242230749 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f90c80d13c0 msgr2=0x7f90c80ce5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:45.867 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:45.865+0000 7f90cca67640 1 --2- 172.21.15.40:0/242230749 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f90c80d13c0 0x7f90c80ce5b0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f90b8009e50 tx=0x7f90b802bed0 comp rx=0 tx=0).stop 2023-12-17T11:49:45.867 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:45.865+0000 7f90cca67640 1 -- 172.21.15.40:0/242230749 shutdown_connections 2023-12-17T11:49:45.867 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:45.865+0000 7f90cca67640 1 --2- 172.21.15.40:0/242230749 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f90c80b0760 0x7f90c80b0bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:45.867 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:45.865+0000 7f90cca67640 1 --2- 172.21.15.40:0/242230749 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f90c80d13c0 0x7f90c80ce5b0 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:45.867 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:45.865+0000 7f90cca67640 1 -- 172.21.15.40:0/242230749 >> 172.21.15.40:0/242230749 conn(0x7f90c809c260 msgr2=0x7f90c80d2f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:49:45.868 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:45.865+0000 7f90cca67640 1 -- 172.21.15.40:0/242230749 shutdown_connections 2023-12-17T11:49:45.868 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:45.865+0000 7f90cca67640 1 -- 172.21.15.40:0/242230749 wait complete. 2023-12-17T11:49:45.868 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:45.867+0000 7f90cca67640 1 Processor -- start 2023-12-17T11:49:45.868 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:45.867+0000 7f90cca67640 1 -- start start 2023-12-17T11:49:45.870 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:45.868+0000 7f90cca67640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f90c80b0760 0x7f90c814c450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:45.870 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:45.868+0000 7f90cca67640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f90c80d0d70 0x7f90c80b2600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:45.870 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:45.868+0000 7f90cca67640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f90c80d13c0 0x7f90c809ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:45.870 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:45.868+0000 7f90cca67640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90c80cb0b0 con 0x7f90c80b0760 2023-12-17T11:49:45.870 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:45.868+0000 7f90cca67640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90c80cb950 con 0x7f90c80d13c0 2023-12-17T11:49:45.870 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:45.868+0000 7f90cca67640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90c80b2b40 con 0x7f90c80d0d70 2023-12-17T11:49:45.870 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:45.868+0000 7f90c77fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f90c80b0760 0x7f90c814c450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:45.870 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:45.868+0000 7f90c77fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f90c80b0760 0x7f90c814c450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:42540/0 (socket says 172.21.15.40:42540) 2023-12-17T11:49:45.870 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:45.868+0000 7f90c77fe640 1 -- 172.21.15.40:0/4070503933 learned_addr learned my addr 172.21.15.40:0/4070503933 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-17T11:49:45.872 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:45.868+0000 7f90c77fe640 1 -- 172.21.15.40:0/4070503933 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f90c80d0d70 msgr2=0x7f90c80b2600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:45.872 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:45.868+0000 7f90c6ffd640 1 --2- 172.21.15.40:0/4070503933 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f90c80d0d70 0x7f90c80b2600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:45.872 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:45.868+0000 7f90c7fff640 1 --2- 172.21.15.40:0/4070503933 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f90c80d13c0 0x7f90c809ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:45.872 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:45.868+0000 7f90c77fe640 1 --2- 172.21.15.40:0/4070503933 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f90c80d0d70 0x7f90c80b2600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:45.872 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:45.868+0000 7f90c77fe640 1 -- 172.21.15.40:0/4070503933 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f90c80d13c0 msgr2=0x7f90c809ccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:45.872 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:45.868+0000 7f90c77fe640 1 --2- 172.21.15.40:0/4070503933 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f90c80d13c0 0x7f90c809ccd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:45.872 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:45.869+0000 7f90c77fe640 1 -- 172.21.15.40:0/4070503933 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90b8009b30 con 0x7f90c80b0760 2023-12-17T11:49:45.872 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:45.869+0000 7f90c6ffd640 1 --2- 172.21.15.40:0/4070503933 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f90c80d0d70 0x7f90c80b2600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-17T11:49:45.872 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:45.869+0000 7f90c7fff640 1 --2- 172.21.15.40:0/4070503933 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f90c80d13c0 0x7f90c809ccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-17T11:49:45.872 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:45.869+0000 7f90c77fe640 1 --2- 172.21.15.40:0/4070503933 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f90c80b0760 0x7f90c814c450 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f90b8009f70 tx=0x7f90b8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:49:45.873 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:45.869+0000 7f90bffff640 1 -- 172.21.15.40:0/4070503933 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90b8043070 con 0x7f90c80b0760 2023-12-17T11:49:45.873 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:45.869+0000 7f90bffff640 1 -- 172.21.15.40:0/4070503933 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90b8009510 con 0x7f90c80b0760 2023-12-17T11:49:45.873 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:45.869+0000 7f90bffff640 1 -- 172.21.15.40:0/4070503933 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90b803f400 con 0x7f90c80b0760 2023-12-17T11:49:45.873 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:45.869+0000 7f90cca67640 1 -- 172.21.15.40:0/4070503933 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90c80a0360 con 0x7f90c80b0760 2023-12-17T11:49:45.873 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:45.869+0000 7f90cca67640 1 -- 172.21.15.40:0/4070503933 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90c80cb5e0 con 0x7f90c80b0760 2023-12-17T11:49:45.873 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:45.870+0000 7f90cca67640 1 -- 172.21.15.40:0/4070503933 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90c8074450 con 0x7f90c80b0760 2023-12-17T11:49:45.873 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:45.871+0000 7f90bffff640 1 -- 172.21.15.40:0/4070503933 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f90b803f580 con 0x7f90c80b0760 2023-12-17T11:49:45.874 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:45.872+0000 7f90bffff640 1 --2- 172.21.15.40:0/4070503933 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f90a806ae70 0x7f90a806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:45.874 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:45.872+0000 7f90bffff640 1 -- 172.21.15.40:0/4070503933 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f90b80ab900 con 0x7f90c80b0760 2023-12-17T11:49:45.875 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:45.873+0000 7f90c6ffd640 1 --2- 172.21.15.40:0/4070503933 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f90a806ae70 0x7f90a806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:45.876 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:45.874+0000 7f90c6ffd640 1 --2- 172.21.15.40:0/4070503933 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f90a806ae70 0x7f90a806d330 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f90c80a08f0 tx=0x7f90b0009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:49:45.878 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:45.876+0000 7f90bffff640 1 -- 172.21.15.40:0/4070503933 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f90b8076bb0 con 0x7f90c80b0760 2023-12-17T11:49:46.150 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:46.148+0000 7f90cca67640 1 -- 172.21.15.40:0/4070503933 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) v1 -- 0x7f90c80b5550 con 0x7f90c80b0760 2023-12-17T11:49:46.156 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:46.155+0000 7f90bffff640 1 -- 172.21.15.40:0/4070503933 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v4) v1 ==== 90+0+0 (secure 0 0 0) 0x7f90b807a1d0 con 0x7f90c80b0760 2023-12-17T11:49:46.160 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:46.157+0000 7f90cca67640 1 -- 172.21.15.40:0/4070503933 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f90a806ae70 msgr2=0x7f90a806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:46.160 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:46.157+0000 7f90cca67640 1 --2- 172.21.15.40:0/4070503933 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f90a806ae70 0x7f90a806d330 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f90c80a08f0 tx=0x7f90b0009040 comp rx=0 tx=0).stop 2023-12-17T11:49:46.160 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:46.157+0000 7f90cca67640 1 -- 172.21.15.40:0/4070503933 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f90c80b0760 msgr2=0x7f90c814c450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:46.160 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:46.157+0000 7f90cca67640 1 --2- 172.21.15.40:0/4070503933 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f90c80b0760 0x7f90c814c450 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f90b8009f70 tx=0x7f90b8004a40 comp rx=0 tx=0).stop 2023-12-17T11:49:46.160 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:46.157+0000 7f90cca67640 1 -- 172.21.15.40:0/4070503933 shutdown_connections 2023-12-17T11:49:46.160 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:46.157+0000 7f90cca67640 1 --2- 172.21.15.40:0/4070503933 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f90a806ae70 0x7f90a806d330 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:46.160 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:46.157+0000 7f90cca67640 1 --2- 172.21.15.40:0/4070503933 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f90c80d13c0 0x7f90c809ccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:46.160 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:46.157+0000 7f90cca67640 1 --2- 172.21.15.40:0/4070503933 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f90c80d0d70 0x7f90c80b2600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:46.160 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:46.157+0000 7f90cca67640 1 --2- 172.21.15.40:0/4070503933 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f90c80b0760 0x7f90c814c450 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:46.160 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:46.157+0000 7f90cca67640 1 -- 172.21.15.40:0/4070503933 >> 172.21.15.40:0/4070503933 conn(0x7f90c809c260 msgr2=0x7f90c80b6850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:49:46.160 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:46.158+0000 7f90cca67640 1 -- 172.21.15.40:0/4070503933 shutdown_connections 2023-12-17T11:49:46.161 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:46.158+0000 7f90cca67640 1 -- 172.21.15.40:0/4070503933 wait complete. 2023-12-17T11:49:46.180 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2023-12-17T11:49:46.401 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:46.399+0000 7fe988b1d640 1 Processor -- start 2023-12-17T11:49:46.402 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:46.399+0000 7fe988b1d640 1 -- start start 2023-12-17T11:49:46.404 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:46.401+0000 7fe988b1d640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fe9841467c0 0x7fe9840cc8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:46.404 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:46.401+0000 7fe988b1d640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7fe984146ba0 0x7fe9840cce30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:46.404 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:46.401+0000 7fe988b1d640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe98406c7e0 0x7fe98406cc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:46.405 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:46.401+0000 7fe988b1d640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9840ac860 con 0x7fe9841467c0 2023-12-17T11:49:46.405 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:46.401+0000 7fe988b1d640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe98406d510 con 0x7fe984146ba0 2023-12-17T11:49:46.405 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:46.401+0000 7fe988b1d640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe98406d7f0 con 0x7fe98406c7e0 2023-12-17T11:49:46.405 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:46.401+0000 7fe98259c640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fe9841467c0 0x7fe9840cc8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:46.405 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:46.401+0000 7fe98259c640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fe9841467c0 0x7fe9840cc8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:42542/0 (socket says 172.21.15.40:42542) 2023-12-17T11:49:46.405 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:46.401+0000 7fe98259c640 1 -- 172.21.15.40:0/1683230517 learned_addr learned my addr 172.21.15.40:0/1683230517 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-17T11:49:46.406 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:46.402+0000 7fe982d9d640 1 --2- 172.21.15.40:0/1683230517 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe98406c7e0 0x7fe98406cc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:46.406 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:46.402+0000 7fe97bfff640 1 --2- 172.21.15.40:0/1683230517 >> v2:172.21.15.159:3300/0 conn(0x7fe984146ba0 0x7fe9840cce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:46.406 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:46.402+0000 7fe98259c640 1 -- 172.21.15.40:0/1683230517 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe98406c7e0 msgr2=0x7fe98406cc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:49:46.406 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:46.402+0000 7fe98259c640 1 --2- 172.21.15.40:0/1683230517 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe98406c7e0 0x7fe98406cc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:46.406 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:46.402+0000 7fe98259c640 1 -- 172.21.15.40:0/1683230517 >> v2:172.21.15.159:3300/0 conn(0x7fe984146ba0 msgr2=0x7fe9840cce30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:49:46.406 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:46.402+0000 7fe98259c640 1 --2- 172.21.15.40:0/1683230517 >> v2:172.21.15.159:3300/0 conn(0x7fe984146ba0 0x7fe9840cce30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:46.406 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:46.402+0000 7fe98259c640 1 -- 172.21.15.40:0/1683230517 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe98406dad0 con 0x7fe9841467c0 2023-12-17T11:49:46.409 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:46.403+0000 7fe98259c640 1 --2- 172.21.15.40:0/1683230517 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe9841467c0 0x7fe9840cc8f0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fe98406b7e0 tx=0x7fe97402b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca3f939ffeeeec32 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:49:46.409 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:46.403+0000 7fe981d9b640 1 -- 172.21.15.40:0/1683230517 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe974031870 con 0x7fe9841467c0 2023-12-17T11:49:46.409 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:46.403+0000 7fe981d9b640 1 -- 172.21.15.40:0/1683230517 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9740319d0 con 0x7fe9841467c0 2023-12-17T11:49:46.410 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:46.403+0000 7fe981d9b640 1 -- 172.21.15.40:0/1683230517 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe974031d60 con 0x7fe9841467c0 2023-12-17T11:49:46.410 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:46.404+0000 7fe988b1d640 1 -- 172.21.15.40:0/1683230517 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe9841467c0 msgr2=0x7fe9840cc8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:46.410 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:46.404+0000 7fe988b1d640 1 --2- 172.21.15.40:0/1683230517 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe9841467c0 0x7fe9840cc8f0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fe98406b7e0 tx=0x7fe97402b910 comp rx=0 tx=0).stop 2023-12-17T11:49:46.410 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:46.404+0000 7fe988b1d640 1 -- 172.21.15.40:0/1683230517 shutdown_connections 2023-12-17T11:49:46.411 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:46.404+0000 7fe988b1d640 1 --2- 172.21.15.40:0/1683230517 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe98406c7e0 0x7fe98406cc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:46.411 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:46.404+0000 7fe988b1d640 1 --2- 172.21.15.40:0/1683230517 >> v2:172.21.15.159:3300/0 conn(0x7fe984146ba0 0x7fe9840cce30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:46.411 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:46.404+0000 7fe988b1d640 1 --2- 172.21.15.40:0/1683230517 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe9841467c0 0x7fe9840cc8f0 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:46.411 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:46.404+0000 7fe988b1d640 1 -- 172.21.15.40:0/1683230517 >> 172.21.15.40:0/1683230517 conn(0x7fe9840b0a90 msgr2=0x7fe9840b0e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:49:46.411 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:46.405+0000 7fe988b1d640 1 -- 172.21.15.40:0/1683230517 shutdown_connections 2023-12-17T11:49:46.411 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:46.405+0000 7fe988b1d640 1 -- 172.21.15.40:0/1683230517 wait complete. 2023-12-17T11:49:46.416 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:46.407+0000 7fe988b1d640 1 Processor -- start 2023-12-17T11:49:46.416 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:46.407+0000 7fe988b1d640 1 -- start start 2023-12-17T11:49:46.416 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:46.408+0000 7fe988b1d640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe98406c7e0 0x7fe9840ace00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:46.416 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:46.408+0000 7fe988b1d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe9841467c0 0x7fe9841e92a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:46.416 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:46.408+0000 7fe988b1d640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe984146ba0 0x7fe98413e460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:46.417 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:46.408+0000 7fe988b1d640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9841e6ff0 con 0x7fe9841467c0 2023-12-17T11:49:46.417 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:46.408+0000 7fe988b1d640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9841e72d0 con 0x7fe984146ba0 2023-12-17T11:49:46.417 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:46.408+0000 7fe988b1d640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9841e75b0 con 0x7fe98406c7e0 2023-12-17T11:49:46.417 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:46.408+0000 7fe97bfff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe9841467c0 0x7fe9841e92a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:46.417 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:46.409+0000 7fe97bfff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe9841467c0 0x7fe9841e92a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:42550/0 (socket says 172.21.15.40:42550) 2023-12-17T11:49:46.417 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:46.409+0000 7fe97bfff640 1 -- 172.21.15.40:0/3945056528 learned_addr learned my addr 172.21.15.40:0/3945056528 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-17T11:49:46.418 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:46.409+0000 7fe98259c640 1 --2- 172.21.15.40:0/3945056528 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe98406c7e0 0x7fe9840ace00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:46.418 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:46.409+0000 7fe982d9d640 1 --2- 172.21.15.40:0/3945056528 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe984146ba0 0x7fe98413e460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:46.418 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:46.409+0000 7fe97bfff640 1 -- 172.21.15.40:0/3945056528 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe98406c7e0 msgr2=0x7fe9840ace00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:46.418 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:46.409+0000 7fe97bfff640 1 --2- 172.21.15.40:0/3945056528 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe98406c7e0 0x7fe9840ace00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:46.418 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:46.409+0000 7fe97bfff640 1 -- 172.21.15.40:0/3945056528 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe984146ba0 msgr2=0x7fe98413e460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:46.418 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:46.409+0000 7fe97bfff640 1 --2- 172.21.15.40:0/3945056528 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe984146ba0 0x7fe98413e460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:46.419 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:46.409+0000 7fe97bfff640 1 -- 172.21.15.40:0/3945056528 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9740094d0 con 0x7fe9841467c0 2023-12-17T11:49:46.419 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:46.409+0000 7fe98259c640 1 --2- 172.21.15.40:0/3945056528 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe98406c7e0 0x7fe9840ace00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-17T11:49:46.419 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:46.409+0000 7fe97bfff640 1 --2- 172.21.15.40:0/3945056528 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe9841467c0 0x7fe9841e92a0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fe96c00d5f0 tx=0x7fe96c00dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:49:46.419 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:46.410+0000 7fe97affd640 1 -- 172.21.15.40:0/3945056528 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe96c0125f0 con 0x7fe9841467c0 2023-12-17T11:49:46.419 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:46.410+0000 7fe97affd640 1 -- 172.21.15.40:0/3945056528 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe96c012750 con 0x7fe9841467c0 2023-12-17T11:49:46.419 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:46.410+0000 7fe97affd640 1 -- 172.21.15.40:0/3945056528 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe96c012b00 con 0x7fe9841467c0 2023-12-17T11:49:46.420 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:46.410+0000 7fe988b1d640 1 -- 172.21.15.40:0/3945056528 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9841e7890 con 0x7fe9841467c0 2023-12-17T11:49:46.420 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:46.410+0000 7fe988b1d640 1 -- 172.21.15.40:0/3945056528 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9841e6c10 con 0x7fe9841467c0 2023-12-17T11:49:46.420 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:46.411+0000 7fe988b1d640 1 -- 172.21.15.40:0/3945056528 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9840745d0 con 0x7fe9841467c0 2023-12-17T11:49:46.420 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:46.412+0000 7fe97affd640 1 -- 172.21.15.40:0/3945056528 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fe96c012c60 con 0x7fe9841467c0 2023-12-17T11:49:46.420 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:46.413+0000 7fe97affd640 1 --2- 172.21.15.40:0/3945056528 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7fe96406ae70 0x7fe96406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:46.420 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:46.413+0000 7fe97affd640 1 -- 172.21.15.40:0/3945056528 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5177+0+0 (secure 0 0 0) 0x7fe96c089850 con 0x7fe9841467c0 2023-12-17T11:49:46.421 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:46.414+0000 7fe98259c640 1 --2- 172.21.15.40:0/3945056528 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7fe96406ae70 0x7fe96406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:46.421 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:46.415+0000 7fe98259c640 1 --2- 172.21.15.40:0/3945056528 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7fe96406ae70 0x7fe96406d330 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fe974036000 tx=0x7fe97403c040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:49:46.422 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:46.420+0000 7fe97affd640 1 -- 172.21.15.40:0/3945056528 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fe96c054a70 con 0x7fe9841467c0 2023-12-17T11:49:46.689 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:46.687+0000 7fe988b1d640 1 -- 172.21.15.40:0/3945056528 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) v1 -- 0x7fe9840cfc30 con 0x7fe9841467c0 2023-12-17T11:49:46.694 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:46.692+0000 7fe97affd640 1 -- 172.21.15.40:0/3945056528 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v5) v1 ==== 90+0+0 (secure 0 0 0) 0x7fe96c058090 con 0x7fe9841467c0 2023-12-17T11:49:46.697 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:46.694+0000 7fe988b1d640 1 -- 172.21.15.40:0/3945056528 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7fe96406ae70 msgr2=0x7fe96406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:46.697 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:46.694+0000 7fe988b1d640 1 --2- 172.21.15.40:0/3945056528 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7fe96406ae70 0x7fe96406d330 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fe974036000 tx=0x7fe97403c040 comp rx=0 tx=0).stop 2023-12-17T11:49:46.697 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:46.695+0000 7fe988b1d640 1 -- 172.21.15.40:0/3945056528 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe9841467c0 msgr2=0x7fe9841e92a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:46.697 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:46.695+0000 7fe988b1d640 1 --2- 172.21.15.40:0/3945056528 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe9841467c0 0x7fe9841e92a0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fe96c00d5f0 tx=0x7fe96c00dab0 comp rx=0 tx=0).stop 2023-12-17T11:49:46.697 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:46.695+0000 7fe988b1d640 1 -- 172.21.15.40:0/3945056528 shutdown_connections 2023-12-17T11:49:46.697 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:46.695+0000 7fe988b1d640 1 --2- 172.21.15.40:0/3945056528 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7fe96406ae70 0x7fe96406d330 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:46.697 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:46.695+0000 7fe988b1d640 1 --2- 172.21.15.40:0/3945056528 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe984146ba0 0x7fe98413e460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:46.697 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:46.695+0000 7fe988b1d640 1 --2- 172.21.15.40:0/3945056528 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe9841467c0 0x7fe9841e92a0 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:46.697 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:46.695+0000 7fe988b1d640 1 --2- 172.21.15.40:0/3945056528 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe98406c7e0 0x7fe9840ace00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:46.698 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:46.695+0000 7fe988b1d640 1 -- 172.21.15.40:0/3945056528 >> 172.21.15.40:0/3945056528 conn(0x7fe9840b0a90 msgr2=0x7fe9840b0e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:49:46.698 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:46.695+0000 7fe988b1d640 1 -- 172.21.15.40:0/3945056528 shutdown_connections 2023-12-17T11:49:46.698 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:46.695+0000 7fe988b1d640 1 -- 172.21.15.40:0/3945056528 wait complete. 2023-12-17T11:49:46.717 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2023-12-17T11:49:46.935 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:46.932+0000 7f34c3bd7640 1 Processor -- start 2023-12-17T11:49:46.935 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:46.933+0000 7f34c3bd7640 1 -- start start 2023-12-17T11:49:46.936 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:46.935+0000 7f34c3bd7640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f34bc1607f0 0x7f34bc0ce770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:46.936 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:46.935+0000 7f34c3bd7640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f34bc0cecb0 0x7f34bc0cf9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:46.936 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:46.935+0000 7f34c3bd7640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34bc0d0370 con 0x7f34bc0cff00 2023-12-17T11:49:46.936 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:46.935+0000 7f34c3bd7640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34bc0d1be0 con 0x7f34bc1607f0 2023-12-17T11:49:46.936 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:46.935+0000 7f34c3bd7640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34bc0cf110 con 0x7f34bc0cecb0 2023-12-17T11:49:46.937 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:46.935+0000 7f34c1172640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f34bc0cecb0 0x7f34bc0cf9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:46.937 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:46.935+0000 7f34c1172640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f34bc0cecb0 0x7f34bc0cf9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3301/0 says I am v2:172.21.15.40:51018/0 (socket says 172.21.15.40:51018) 2023-12-17T11:49:46.937 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:46.935+0000 7f34c1172640 1 -- 172.21.15.40:0/973503517 learned_addr learned my addr 172.21.15.40:0/973503517 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-17T11:49:46.937 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:46.935+0000 7f34c1973640 1 --2- 172.21.15.40:0/973503517 >> v2:172.21.15.159:3300/0 conn(0x7f34bc1607f0 0x7f34bc0ce770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:46.938 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:46.936+0000 7f34c1973640 1 -- 172.21.15.40:0/973503517 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f34bc0cecb0 msgr2=0x7f34bc0cf9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:49:46.938 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:46.936+0000 7f34c1973640 1 --2- 172.21.15.40:0/973503517 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f34bc0cecb0 0x7f34bc0cf9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:46.938 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:46.936+0000 7f34c1973640 1 -- 172.21.15.40:0/973503517 >> v1:172.21.15.159:6789/0 conn(0x7f34bc0cff00 legacy=0x7f34bc160ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:46.938 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:46.936+0000 7f34c1973640 1 -- 172.21.15.40:0/973503517 --> v2:172.21.15.159:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34bc0b6fe0 con 0x7f34bc1607f0 2023-12-17T11:49:46.938 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:46.936+0000 7f34c1172640 1 --2- 172.21.15.40:0/973503517 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f34bc0cecb0 0x7f34bc0cf9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-17T11:49:46.939 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:46.937+0000 7f34c1973640 1 --2- 172.21.15.40:0/973503517 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f34bc1607f0 0x7f34bc0ce770 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f34ac009dc0 tx=0x7f34ac02be00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3c2f58b8a0171183 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:49:46.940 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:46.938+0000 7f34c0971640 1 -- 172.21.15.40:0/973503517 <== mon.1 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34ac02cbb0 con 0x7f34bc1607f0 2023-12-17T11:49:46.940 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:46.938+0000 7f34c0971640 1 -- 172.21.15.40:0/973503517 <== mon.1 v2:172.21.15.159:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34ac02cd10 con 0x7f34bc1607f0 2023-12-17T11:49:46.940 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:46.938+0000 7f34c0971640 1 -- 172.21.15.40:0/973503517 <== mon.1 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34ac034660 con 0x7f34bc1607f0 2023-12-17T11:49:46.941 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:46.939+0000 7f34c3bd7640 1 -- 172.21.15.40:0/973503517 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f34bc1607f0 msgr2=0x7f34bc0ce770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:46.941 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:46.939+0000 7f34c3bd7640 1 --2- 172.21.15.40:0/973503517 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f34bc1607f0 0x7f34bc0ce770 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f34ac009dc0 tx=0x7f34ac02be00 comp rx=0 tx=0).stop 2023-12-17T11:49:46.941 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:46.939+0000 7f34c3bd7640 1 -- 172.21.15.40:0/973503517 shutdown_connections 2023-12-17T11:49:46.941 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:46.939+0000 7f34c3bd7640 1 --2- 172.21.15.40:0/973503517 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f34bc0cecb0 0x7f34bc0cf9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:46.941 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:46.939+0000 7f34c3bd7640 1 --2- 172.21.15.40:0/973503517 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f34bc1607f0 0x7f34bc0ce770 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:46.941 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:46.939+0000 7f34c3bd7640 1 -- 172.21.15.40:0/973503517 >> 172.21.15.40:0/973503517 conn(0x7f34bc09c450 msgr2=0x7f34bc0d3180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:49:46.941 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:46.939+0000 7f34c3bd7640 1 -- 172.21.15.40:0/973503517 shutdown_connections 2023-12-17T11:49:46.941 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:46.939+0000 7f34c3bd7640 1 -- 172.21.15.40:0/973503517 wait complete. 2023-12-17T11:49:46.942 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:46.941+0000 7f34c3bd7640 1 Processor -- start 2023-12-17T11:49:46.943 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:46.941+0000 7f34c3bd7640 1 -- start start 2023-12-17T11:49:46.946 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:46.942+0000 7f34c3bd7640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f34bc0cecb0 0x7f34bc0a06b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:46.946 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:46.942+0000 7f34c3bd7640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f34bc0cff00 0x7f34bc0cabe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:46.946 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:46.942+0000 7f34c3bd7640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f34bc1607f0 0x7f34bc0cb120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:46.946 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:46.942+0000 7f34c3bd7640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34bc0cb660 con 0x7f34bc0cff00 2023-12-17T11:49:46.946 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:46.942+0000 7f34c3bd7640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34bc159f60 con 0x7f34bc1607f0 2023-12-17T11:49:46.946 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:46.942+0000 7f34c3bd7640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34bc15a240 con 0x7f34bc0cecb0 2023-12-17T11:49:46.946 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:46.942+0000 7f34c1172640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f34bc0cff00 0x7f34bc0cabe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:46.946 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:46.942+0000 7f34c1172640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f34bc0cff00 0x7f34bc0cabe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:42564/0 (socket says 172.21.15.40:42564) 2023-12-17T11:49:46.946 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:46.943+0000 7f34c1172640 1 -- 172.21.15.40:0/4005438592 learned_addr learned my addr 172.21.15.40:0/4005438592 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-17T11:49:46.946 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:46.943+0000 7f34c2174640 1 --2- 172.21.15.40:0/4005438592 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f34bc1607f0 0x7f34bc0cb120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:46.946 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:46.943+0000 7f34c1973640 1 --2- 172.21.15.40:0/4005438592 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f34bc0cecb0 0x7f34bc0a06b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:46.947 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:46.943+0000 7f34c1172640 1 -- 172.21.15.40:0/4005438592 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f34bc0cecb0 msgr2=0x7f34bc0a06b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:46.947 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:46.943+0000 7f34c1172640 1 --2- 172.21.15.40:0/4005438592 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f34bc0cecb0 0x7f34bc0a06b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:46.947 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:46.943+0000 7f34c1172640 1 -- 172.21.15.40:0/4005438592 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f34bc1607f0 msgr2=0x7f34bc0cb120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:46.947 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:46.943+0000 7f34c1172640 1 --2- 172.21.15.40:0/4005438592 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f34bc1607f0 0x7f34bc0cb120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:46.947 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:46.943+0000 7f34c1172640 1 -- 172.21.15.40:0/4005438592 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34b00094d0 con 0x7f34bc0cff00 2023-12-17T11:49:46.947 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:46.943+0000 7f34c1172640 1 --2- 172.21.15.40:0/4005438592 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f34bc0cff00 0x7f34bc0cabe0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f34b000e9b0 tx=0x7f34b000ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:49:46.947 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:46.944+0000 7f34ba7fc640 1 -- 172.21.15.40:0/4005438592 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34b000c9a0 con 0x7f34bc0cff00 2023-12-17T11:49:46.947 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:46.944+0000 7f34ba7fc640 1 -- 172.21.15.40:0/4005438592 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34b000cb00 con 0x7f34bc0cff00 2023-12-17T11:49:46.947 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:46.944+0000 7f34c3bd7640 1 -- 172.21.15.40:0/4005438592 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34ac009a70 con 0x7f34bc0cff00 2023-12-17T11:49:46.947 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:46.944+0000 7f34ba7fc640 1 -- 172.21.15.40:0/4005438592 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34b000ce70 con 0x7f34bc0cff00 2023-12-17T11:49:46.947 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:46.944+0000 7f34c3bd7640 1 -- 172.21.15.40:0/4005438592 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34bc15a800 con 0x7f34bc0cff00 2023-12-17T11:49:46.948 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:46.945+0000 7f34c3bd7640 1 -- 172.21.15.40:0/4005438592 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34bc0745d0 con 0x7f34bc0cff00 2023-12-17T11:49:46.948 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:46.946+0000 7f34ba7fc640 1 -- 172.21.15.40:0/4005438592 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f34b0013470 con 0x7f34bc0cff00 2023-12-17T11:49:46.949 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:46.947+0000 7f34ba7fc640 1 --2- 172.21.15.40:0/4005438592 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f34a806ae70 0x7f34a806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:46.949 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:46.947+0000 7f34ba7fc640 1 -- 172.21.15.40:0/4005438592 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f34b0089950 con 0x7f34bc0cff00 2023-12-17T11:49:46.949 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:46.948+0000 7f34c1973640 1 --2- 172.21.15.40:0/4005438592 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f34a806ae70 0x7f34a806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:46.951 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:46.949+0000 7f34c1973640 1 --2- 172.21.15.40:0/4005438592 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f34a806ae70 0x7f34a806d330 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f34ac036000 tx=0x7f34ac030000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:49:46.953 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:46.952+0000 7f34ba7fc640 1 -- 172.21.15.40:0/4005438592 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f34b0054c00 con 0x7f34bc0cff00 2023-12-17T11:49:47.225 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:47.223+0000 7f34c3bd7640 1 -- 172.21.15.40:0/4005438592 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) v1 -- 0x7f34bc0d0730 con 0x7f34bc0cff00 2023-12-17T11:49:47.230 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:47.229+0000 7f34ba7fc640 1 -- 172.21.15.40:0/4005438592 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v6) v1 ==== 90+0+0 (secure 0 0 0) 0x7f34b00170a0 con 0x7f34bc0cff00 2023-12-17T11:49:47.233 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:47.231+0000 7f34c3bd7640 1 -- 172.21.15.40:0/4005438592 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f34a806ae70 msgr2=0x7f34a806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:47.233 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:47.231+0000 7f34c3bd7640 1 --2- 172.21.15.40:0/4005438592 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f34a806ae70 0x7f34a806d330 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f34ac036000 tx=0x7f34ac030000 comp rx=0 tx=0).stop 2023-12-17T11:49:47.233 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:47.231+0000 7f34c3bd7640 1 -- 172.21.15.40:0/4005438592 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f34bc0cff00 msgr2=0x7f34bc0cabe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:47.233 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:47.231+0000 7f34c3bd7640 1 --2- 172.21.15.40:0/4005438592 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f34bc0cff00 0x7f34bc0cabe0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f34b000e9b0 tx=0x7f34b000ee70 comp rx=0 tx=0).stop 2023-12-17T11:49:47.234 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:47.231+0000 7f34c3bd7640 1 -- 172.21.15.40:0/4005438592 shutdown_connections 2023-12-17T11:49:47.234 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:47.231+0000 7f34c3bd7640 1 --2- 172.21.15.40:0/4005438592 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f34a806ae70 0x7f34a806d330 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:47.234 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:47.231+0000 7f34c3bd7640 1 --2- 172.21.15.40:0/4005438592 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f34bc1607f0 0x7f34bc0cb120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:47.234 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:47.231+0000 7f34c3bd7640 1 --2- 172.21.15.40:0/4005438592 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f34bc0cff00 0x7f34bc0cabe0 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:47.234 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:47.231+0000 7f34c3bd7640 1 --2- 172.21.15.40:0/4005438592 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f34bc0cecb0 0x7f34bc0a06b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:47.234 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:47.231+0000 7f34c3bd7640 1 -- 172.21.15.40:0/4005438592 >> 172.21.15.40:0/4005438592 conn(0x7f34bc09c450 msgr2=0x7f34bc0b7290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:49:47.234 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:47.232+0000 7f34c3bd7640 1 -- 172.21.15.40:0/4005438592 shutdown_connections 2023-12-17T11:49:47.234 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:47.232+0000 7f34c3bd7640 1 -- 172.21.15.40:0/4005438592 wait complete. 2023-12-17T11:49:47.254 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2023-12-17T11:49:47.479 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:47.478+0000 7f965b59e640 1 Processor -- start 2023-12-17T11:49:47.479 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:47.478+0000 7f965b59e640 1 -- start start 2023-12-17T11:49:47.481 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:47.480+0000 7f965b59e640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f965c06dd00 0x7f965c071ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:47.481 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:47.480+0000 7f965b59e640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f965c0abd20 con 0x7f965c070780 2023-12-17T11:49:47.481 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:47.480+0000 7f965b59e640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f965c15d530 con 0x7f965c15d150 2023-12-17T11:49:47.481 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:47.480+0000 7f965b59e640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f965c0b2950 con 0x7f965c06dd00 2023-12-17T11:49:47.481 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:47.480+0000 7f9653fff640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f965c070780 0x7f965c06c690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:44572/0 (socket says 172.21.15.40:44572) 2023-12-17T11:49:47.481 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:47.480+0000 7f9653fff640 1 -- 172.21.15.40:0/1476398834 learned_addr learned my addr 172.21.15.40:0/1476398834 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-12-17T11:49:47.483 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:47.480+0000 7f965ad9d640 1 --2- 172.21.15.40:0/1476398834 >> v2:172.21.15.159:3300/0 conn(0x7f965c06dd00 0x7f965c071ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:47.484 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:47.480+0000 7f9659d9b640 1 -- 172.21.15.40:0/1476398834 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2130518925 0 0) 0x7f965c0abd20 con 0x7f965c070780 2023-12-17T11:49:47.484 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:47.480+0000 7f9659d9b640 1 -- 172.21.15.40:0/1476398834 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9648003520 con 0x7f965c070780 2023-12-17T11:49:47.484 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:47.480+0000 7f9659d9b640 1 -- 172.21.15.40:0/1476398834 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 63347261 0 0) 0x7f9648003520 con 0x7f965c070780 2023-12-17T11:49:47.484 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:47.480+0000 7f9659d9b640 1 -- 172.21.15.40:0/1476398834 >> v2:172.21.15.159:3300/0 conn(0x7f965c06dd00 msgr2=0x7f965c071ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:49:47.484 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:47.480+0000 7f9659d9b640 1 --2- 172.21.15.40:0/1476398834 >> v2:172.21.15.159:3300/0 conn(0x7f965c06dd00 0x7f965c071ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:47.484 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:47.480+0000 7f9659d9b640 1 -- 172.21.15.40:0/1476398834 >> v1:172.21.15.159:6789/0 conn(0x7f965c15d150 legacy=0x7f965c070070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:47.484 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:47.480+0000 7f9659d9b640 1 -- 172.21.15.40:0/1476398834 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f965c0b2c30 con 0x7f965c070780 2023-12-17T11:49:47.484 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:47.480+0000 7f9659d9b640 1 -- 172.21.15.40:0/1476398834 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2643242555 0 0) 0x7f9644001670 con 0x7f965c070780 2023-12-17T11:49:47.484 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:47.480+0000 7f9659d9b640 1 -- 172.21.15.40:0/1476398834 >> v1:172.21.15.40:6789/0 conn(0x7f965c070780 legacy=0x7f965c06c690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:47.484 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:47.481+0000 7f9659d9b640 1 --2- 172.21.15.40:0/1476398834 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f96480039c0 0x7f9648003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:47.484 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:47.481+0000 7f9659d9b640 1 --2- 172.21.15.40:0/1476398834 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f96480047c0 0x7f9648004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:47.484 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:47.481+0000 7f9659d9b640 1 --2- 172.21.15.40:0/1476398834 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9648005180 0x7f964800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:47.484 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:47.481+0000 7f9659d9b640 1 -- 172.21.15.40:0/1476398834 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f965c0b2950 con 0x7f9648005180 2023-12-17T11:49:47.485 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:47.481+0000 7f9659d9b640 1 -- 172.21.15.40:0/1476398834 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f964800c080 con 0x7f96480039c0 2023-12-17T11:49:47.485 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:47.481+0000 7f9659d9b640 1 -- 172.21.15.40:0/1476398834 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f964800c240 con 0x7f96480047c0 2023-12-17T11:49:47.485 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:47.481+0000 7f965ad9d640 1 --2- 172.21.15.40:0/1476398834 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9648005180 0x7f964800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:47.485 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:47.481+0000 7f9653fff640 1 --2- 172.21.15.40:0/1476398834 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f96480047c0 0x7f9648004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:47.485 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:47.481+0000 7f965a59c640 1 --2- 172.21.15.40:0/1476398834 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f96480039c0 0x7f9648003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:47.485 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:47.481+0000 7f965ad9d640 1 -- 172.21.15.40:0/1476398834 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f96480047c0 msgr2=0x7f9648004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:49:47.485 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:47.481+0000 7f965ad9d640 1 --2- 172.21.15.40:0/1476398834 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f96480047c0 0x7f9648004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:47.485 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:47.481+0000 7f965ad9d640 1 -- 172.21.15.40:0/1476398834 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f96480039c0 msgr2=0x7f9648003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:49:47.485 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:47.481+0000 7f965ad9d640 1 --2- 172.21.15.40:0/1476398834 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f96480039c0 0x7f9648003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:47.485 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:47.481+0000 7f965ad9d640 1 -- 172.21.15.40:0/1476398834 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9648003520 con 0x7f9648005180 2023-12-17T11:49:47.486 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:47.482+0000 7f965ad9d640 1 -- 172.21.15.40:0/1476398834 reap_dead start 2023-12-17T11:49:47.486 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:47.483+0000 7f965ad9d640 1 --2- 172.21.15.40:0/1476398834 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9648005180 0x7f964800b980 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f9654009f90 tx=0x7f96480057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb0d82e39be5a108 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:49:47.486 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:47.483+0000 7f9659d9b640 1 -- 172.21.15.40:0/1476398834 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f965402cc20 con 0x7f9648005180 2023-12-17T11:49:47.487 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:47.483+0000 7f9659d9b640 1 -- 172.21.15.40:0/1476398834 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f965400f040 con 0x7f9648005180 2023-12-17T11:49:47.487 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:47.483+0000 7f9659d9b640 1 -- 172.21.15.40:0/1476398834 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9654003990 con 0x7f9648005180 2023-12-17T11:49:47.487 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:47.483+0000 7f965b59e640 1 -- 172.21.15.40:0/1476398834 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9648005180 msgr2=0x7f964800b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:47.487 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:47.483+0000 7f965b59e640 1 --2- 172.21.15.40:0/1476398834 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9648005180 0x7f964800b980 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f9654009f90 tx=0x7f96480057f0 comp rx=0 tx=0).stop 2023-12-17T11:49:47.487 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:47.484+0000 7f965b59e640 1 -- 172.21.15.40:0/1476398834 shutdown_connections 2023-12-17T11:49:47.487 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:47.484+0000 7f965b59e640 1 --2- 172.21.15.40:0/1476398834 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9648005180 0x7f964800b980 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:47.487 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:47.484+0000 7f965b59e640 1 -- 172.21.15.40:0/1476398834 >> 172.21.15.40:0/1476398834 conn(0x7f965c0b0860 msgr2=0x7f965c0b0c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:49:47.487 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:47.484+0000 7f965b59e640 1 -- 172.21.15.40:0/1476398834 shutdown_connections 2023-12-17T11:49:47.487 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:47.484+0000 7f965b59e640 1 -- 172.21.15.40:0/1476398834 wait complete. 2023-12-17T11:49:47.488 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:47.486+0000 7f965b59e640 1 Processor -- start 2023-12-17T11:49:47.488 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:47.486+0000 7f965b59e640 1 -- start start 2023-12-17T11:49:47.489 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:47.487+0000 7f965b59e640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9648005180 0x7f965c15fa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:47.490 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:47.487+0000 7f965b59e640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f965c15d720 0x7f965c0ceca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:47.490 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:47.487+0000 7f965b59e640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f965c14a160 0x7f965c14a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:47.490 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:47.487+0000 7f965b59e640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f965c15dba0 con 0x7f965c15d720 2023-12-17T11:49:47.490 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:47.487+0000 7f965b59e640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f965c14ab20 con 0x7f965c14a160 2023-12-17T11:49:47.490 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:47.487+0000 7f965b59e640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f965c15de20 con 0x7f9648005180 2023-12-17T11:49:47.490 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:47.487+0000 7f9653fff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f965c15d720 0x7f965c0ceca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:47.490 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:47.487+0000 7f9653fff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f965c15d720 0x7f965c0ceca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:42590/0 (socket says 172.21.15.40:42590) 2023-12-17T11:49:47.490 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:47.487+0000 7f9653fff640 1 -- 172.21.15.40:0/2451848092 learned_addr learned my addr 172.21.15.40:0/2451848092 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-17T11:49:47.490 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:47.487+0000 7f965a59c640 1 --2- 172.21.15.40:0/2451848092 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9648005180 0x7f965c15fa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:47.490 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:47.487+0000 7f965ad9d640 1 --2- 172.21.15.40:0/2451848092 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f965c14a160 0x7f965c14a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:47.490 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:47.487+0000 7f9653fff640 1 -- 172.21.15.40:0/2451848092 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9648005180 msgr2=0x7f965c15fa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:47.490 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:47.487+0000 7f9653fff640 1 --2- 172.21.15.40:0/2451848092 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9648005180 0x7f965c15fa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:47.490 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:47.487+0000 7f9653fff640 1 -- 172.21.15.40:0/2451848092 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f965c14a160 msgr2=0x7f965c14a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:47.491 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:47.487+0000 7f9653fff640 1 --2- 172.21.15.40:0/2451848092 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f965c14a160 0x7f965c14a5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:47.491 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:47.487+0000 7f9653fff640 1 -- 172.21.15.40:0/2451848092 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f965c15e100 con 0x7f965c15d720 2023-12-17T11:49:47.491 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:47.488+0000 7f965ad9d640 1 --2- 172.21.15.40:0/2451848092 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f965c14a160 0x7f965c14a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-17T11:49:47.491 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:47.487+0000 7f965a59c640 1 --2- 172.21.15.40:0/2451848092 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9648005180 0x7f965c15fa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-17T11:49:47.491 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:47.488+0000 7f9653fff640 1 --2- 172.21.15.40:0/2451848092 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f965c15d720 0x7f965c0ceca0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f964400e700 tx=0x7f964400eb00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:49:47.492 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:47.488+0000 7f9652ffd640 1 -- 172.21.15.40:0/2451848092 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f964400c620 con 0x7f965c15d720 2023-12-17T11:49:47.492 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:47.488+0000 7f9652ffd640 1 -- 172.21.15.40:0/2451848092 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f964400c7a0 con 0x7f965c15d720 2023-12-17T11:49:47.492 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:47.488+0000 7f9652ffd640 1 -- 172.21.15.40:0/2451848092 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f964400cb50 con 0x7f965c15d720 2023-12-17T11:49:47.492 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:47.488+0000 7f965b59e640 1 -- 172.21.15.40:0/2451848092 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f965c15e3e0 con 0x7f965c15d720 2023-12-17T11:49:47.492 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:47.488+0000 7f965b59e640 1 -- 172.21.15.40:0/2451848092 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f965c159880 con 0x7f965c15d720 2023-12-17T11:49:47.492 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:47.489+0000 7f965b59e640 1 -- 172.21.15.40:0/2451848092 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f965c074450 con 0x7f965c15d720 2023-12-17T11:49:47.492 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:47.490+0000 7f9652ffd640 1 -- 172.21.15.40:0/2451848092 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f964400ccb0 con 0x7f965c15d720 2023-12-17T11:49:47.493 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:47.493+0000 7f9652ffd640 1 --2- 172.21.15.40:0/2451848092 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f963c06ae90 0x7f963c06d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:47.494 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:47.493+0000 7f9652ffd640 1 -- 172.21.15.40:0/2451848092 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f9644089280 con 0x7f965c15d720 2023-12-17T11:49:47.494 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:47.493+0000 7f965a59c640 1 --2- 172.21.15.40:0/2451848092 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f963c06ae90 0x7f963c06d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:47.495 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:47.493+0000 7f965a59c640 1 --2- 172.21.15.40:0/2451848092 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f963c06ae90 0x7f963c06d350 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f964c000c00 tx=0x7f964c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:49:47.497 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:47.496+0000 7f9652ffd640 1 -- 172.21.15.40:0/2451848092 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f96440545b0 con 0x7f965c15d720 2023-12-17T11:49:47.763 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:47.760+0000 7f965b59e640 1 -- 172.21.15.40:0/2451848092 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) v1 -- 0x7f965c06e1c0 con 0x7f965c15d720 2023-12-17T11:49:47.768 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:47.766+0000 7f9652ffd640 1 -- 172.21.15.40:0/2451848092 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v7) v1 ==== 97+0+0 (secure 0 0 0) 0x7f9644057bd0 con 0x7f965c15d720 2023-12-17T11:49:47.771 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:47.769+0000 7f965b59e640 1 -- 172.21.15.40:0/2451848092 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f963c06ae90 msgr2=0x7f963c06d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:47.771 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:47.769+0000 7f965b59e640 1 --2- 172.21.15.40:0/2451848092 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f963c06ae90 0x7f963c06d350 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f964c000c00 tx=0x7f964c009040 comp rx=0 tx=0).stop 2023-12-17T11:49:47.771 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:47.769+0000 7f965b59e640 1 -- 172.21.15.40:0/2451848092 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f965c15d720 msgr2=0x7f965c0ceca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:47.771 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:47.769+0000 7f965b59e640 1 --2- 172.21.15.40:0/2451848092 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f965c15d720 0x7f965c0ceca0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f964400e700 tx=0x7f964400eb00 comp rx=0 tx=0).stop 2023-12-17T11:49:47.771 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:47.769+0000 7f965b59e640 1 -- 172.21.15.40:0/2451848092 shutdown_connections 2023-12-17T11:49:47.771 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:47.769+0000 7f965b59e640 1 --2- 172.21.15.40:0/2451848092 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f963c06ae90 0x7f963c06d350 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:47.771 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:47.769+0000 7f965b59e640 1 --2- 172.21.15.40:0/2451848092 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f965c14a160 0x7f965c14a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:47.771 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:47.769+0000 7f965b59e640 1 --2- 172.21.15.40:0/2451848092 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f965c15d720 0x7f965c0ceca0 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:47.771 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:47.769+0000 7f965b59e640 1 --2- 172.21.15.40:0/2451848092 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f9648005180 0x7f965c15fa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:47.771 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:47.769+0000 7f965b59e640 1 -- 172.21.15.40:0/2451848092 >> 172.21.15.40:0/2451848092 conn(0x7f965c0b0860 msgr2=0x7f965c1614c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:49:47.771 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:47.769+0000 7f965b59e640 1 -- 172.21.15.40:0/2451848092 shutdown_connections 2023-12-17T11:49:47.771 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:47.769+0000 7f965b59e640 1 -- 172.21.15.40:0/2451848092 wait complete. 2023-12-17T11:49:47.791 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2023-12-17T11:49:48.016 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:48.015+0000 7f20ea33c640 1 Processor -- start 2023-12-17T11:49:48.016 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:48.015+0000 7f20ea33c640 1 -- start start 2023-12-17T11:49:48.018 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:48.017+0000 7f20ea33c640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f20e415e5d0 0x7f20e406bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:48.018 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:48.017+0000 7f20ea33c640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20e4071f90 con 0x7f20e4071260 2023-12-17T11:49:48.018 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:48.017+0000 7f20ea33c640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20e4072270 con 0x7f20e40ae200 2023-12-17T11:49:48.018 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:48.017+0000 7f20ea33c640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20e4070070 con 0x7f20e415e5d0 2023-12-17T11:49:48.018 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:48.017+0000 7f20e9b3b640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f20e4071260 0x7f20e40cded0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:44586/0 (socket says 172.21.15.40:44586) 2023-12-17T11:49:48.018 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:48.017+0000 7f20e9b3b640 1 -- 172.21.15.40:0/618129667 learned_addr learned my addr 172.21.15.40:0/618129667 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-12-17T11:49:48.020 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:48.017+0000 7f20e933a640 1 --2- 172.21.15.40:0/618129667 >> v2:172.21.15.159:3300/0 conn(0x7f20e415e5d0 0x7f20e406bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:48.020 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:48.017+0000 7f20dbfff640 1 -- 172.21.15.40:0/618129667 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3451129863 0 0) 0x7f20e4071f90 con 0x7f20e4071260 2023-12-17T11:49:48.020 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:48.017+0000 7f20dbfff640 1 -- 172.21.15.40:0/618129667 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f20d0003520 con 0x7f20e4071260 2023-12-17T11:49:48.020 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:48.017+0000 7f20dbfff640 1 -- 172.21.15.40:0/618129667 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 368496814 0 0) 0x7f20d0003520 con 0x7f20e4071260 2023-12-17T11:49:48.021 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:48.017+0000 7f20dbfff640 1 -- 172.21.15.40:0/618129667 >> v2:172.21.15.159:3300/0 conn(0x7f20e415e5d0 msgr2=0x7f20e406bdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:49:48.021 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:48.017+0000 7f20dbfff640 1 --2- 172.21.15.40:0/618129667 >> v2:172.21.15.159:3300/0 conn(0x7f20e415e5d0 0x7f20e406bdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:48.021 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:48.017+0000 7f20dbfff640 1 -- 172.21.15.40:0/618129667 >> v1:172.21.15.159:6789/0 conn(0x7f20e40ae200 legacy=0x7f20e4070b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:48.021 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:48.017+0000 7f20dbfff640 1 -- 172.21.15.40:0/618129667 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20e4070350 con 0x7f20e4071260 2023-12-17T11:49:48.021 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:48.017+0000 7f20dbfff640 1 -- 172.21.15.40:0/618129667 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2643242555 0 0) 0x7f20dc0019f0 con 0x7f20e4071260 2023-12-17T11:49:48.021 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:48.017+0000 7f20dbfff640 1 -- 172.21.15.40:0/618129667 >> v1:172.21.15.40:6789/0 conn(0x7f20e4071260 legacy=0x7f20e40cded0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:48.021 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:48.017+0000 7f20dbfff640 1 --2- 172.21.15.40:0/618129667 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f20d0003970 0x7f20d0003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:48.021 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:48.017+0000 7f20dbfff640 1 --2- 172.21.15.40:0/618129667 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f20d00047c0 0x7f20d0004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:48.021 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:48.017+0000 7f20dbfff640 1 --2- 172.21.15.40:0/618129667 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f20d0005180 0x7f20d000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:48.021 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:48.018+0000 7f20dbfff640 1 -- 172.21.15.40:0/618129667 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20e4070070 con 0x7f20d0005180 2023-12-17T11:49:48.021 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:48.018+0000 7f20dbfff640 1 -- 172.21.15.40:0/618129667 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20d000c120 con 0x7f20d0003970 2023-12-17T11:49:48.021 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:48.018+0000 7f20dbfff640 1 -- 172.21.15.40:0/618129667 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20d000c2e0 con 0x7f20d00047c0 2023-12-17T11:49:48.021 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:48.018+0000 7f20e9b3b640 1 --2- 172.21.15.40:0/618129667 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f20d0005180 0x7f20d000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:48.021 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:48.018+0000 7f20e933a640 1 --2- 172.21.15.40:0/618129667 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f20d0003970 0x7f20d0003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:48.022 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:48.018+0000 7f20e8b39640 1 --2- 172.21.15.40:0/618129667 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f20d00047c0 0x7f20d0004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:48.022 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:48.018+0000 7f20e9b3b640 1 -- 172.21.15.40:0/618129667 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f20d00047c0 msgr2=0x7f20d0004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:49:48.022 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:48.018+0000 7f20e9b3b640 1 --2- 172.21.15.40:0/618129667 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f20d00047c0 0x7f20d0004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:48.022 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:48.018+0000 7f20e9b3b640 1 -- 172.21.15.40:0/618129667 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f20d0003970 msgr2=0x7f20d0003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:49:48.022 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:48.018+0000 7f20e9b3b640 1 --2- 172.21.15.40:0/618129667 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f20d0003970 0x7f20d0003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:48.022 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:48.018+0000 7f20e9b3b640 1 -- 172.21.15.40:0/618129667 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20d0003520 con 0x7f20d0005180 2023-12-17T11:49:48.022 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:48.018+0000 7f20e8b39640 1 --2- 172.21.15.40:0/618129667 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f20d00047c0 0x7f20d0004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-17T11:49:48.023 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:48.019+0000 7f20e9b3b640 1 -- 172.21.15.40:0/618129667 reap_dead start 2023-12-17T11:49:48.023 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:48.020+0000 7f20e9b3b640 1 --2- 172.21.15.40:0/618129667 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f20d0005180 0x7f20d000b980 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f20dc00a830 tx=0x7f20d00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ffd892bdc7c835e server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:49:48.023 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:48.020+0000 7f20dbfff640 1 -- 172.21.15.40:0/618129667 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20dc0072d0 con 0x7f20d0005180 2023-12-17T11:49:48.023 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:48.020+0000 7f20dbfff640 1 -- 172.21.15.40:0/618129667 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20dc02f070 con 0x7f20d0005180 2023-12-17T11:49:48.023 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:48.020+0000 7f20dbfff640 1 -- 172.21.15.40:0/618129667 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20dc0076b0 con 0x7f20d0005180 2023-12-17T11:49:48.024 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:48.020+0000 7f20ea33c640 1 -- 172.21.15.40:0/618129667 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f20d0005180 msgr2=0x7f20d000b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:48.024 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:48.020+0000 7f20ea33c640 1 --2- 172.21.15.40:0/618129667 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f20d0005180 0x7f20d000b980 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f20dc00a830 tx=0x7f20d00057f0 comp rx=0 tx=0).stop 2023-12-17T11:49:48.024 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:48.020+0000 7f20ea33c640 1 -- 172.21.15.40:0/618129667 shutdown_connections 2023-12-17T11:49:48.024 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:48.020+0000 7f20ea33c640 1 --2- 172.21.15.40:0/618129667 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f20d0005180 0x7f20d000b980 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:48.024 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:48.020+0000 7f20ea33c640 1 -- 172.21.15.40:0/618129667 >> 172.21.15.40:0/618129667 conn(0x7f20e40b0860 msgr2=0x7f20e40b0c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:49:48.024 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:48.021+0000 7f20ea33c640 1 -- 172.21.15.40:0/618129667 shutdown_connections 2023-12-17T11:49:48.024 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:48.021+0000 7f20ea33c640 1 -- 172.21.15.40:0/618129667 wait complete. 2023-12-17T11:49:48.024 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:48.022+0000 7f20ea33c640 1 Processor -- start 2023-12-17T11:49:48.025 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:48.023+0000 7f20ea33c640 1 -- start start 2023-12-17T11:49:48.027 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:48.023+0000 7f20ea33c640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f20d0005180 0x7f20e40afdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:48.027 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:48.024+0000 7f20ea33c640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f20e4153140 0x7f20e41535c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:48.027 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:48.024+0000 7f20ea33c640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f20e41efb70 0x7f20e41efff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:48.027 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:48.024+0000 7f20ea33c640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20e41564f0 con 0x7f20e4153140 2023-12-17T11:49:48.027 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:48.024+0000 7f20ea33c640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20e4141390 con 0x7f20d0005180 2023-12-17T11:49:48.027 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:48.024+0000 7f20ea33c640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20e41f0530 con 0x7f20e41efb70 2023-12-17T11:49:48.027 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:48.024+0000 7f20e8b39640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f20e4153140 0x7f20e41535c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:48.027 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:48.024+0000 7f20e8b39640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f20e4153140 0x7f20e41535c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:42610/0 (socket says 172.21.15.40:42610) 2023-12-17T11:49:48.027 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:48.024+0000 7f20e8b39640 1 -- 172.21.15.40:0/3084298213 learned_addr learned my addr 172.21.15.40:0/3084298213 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-17T11:49:48.027 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:48.024+0000 7f20e933a640 1 --2- 172.21.15.40:0/3084298213 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f20d0005180 0x7f20e40afdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:48.028 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:48.024+0000 7f20e9b3b640 1 --2- 172.21.15.40:0/3084298213 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f20e41efb70 0x7f20e41efff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:48.028 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:48.024+0000 7f20e8b39640 1 -- 172.21.15.40:0/3084298213 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f20e41efb70 msgr2=0x7f20e41efff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:48.028 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:48.024+0000 7f20e8b39640 1 --2- 172.21.15.40:0/3084298213 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f20e41efb70 0x7f20e41efff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:48.028 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:48.024+0000 7f20e8b39640 1 -- 172.21.15.40:0/3084298213 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f20d0005180 msgr2=0x7f20e40afdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:48.028 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:48.024+0000 7f20e8b39640 1 --2- 172.21.15.40:0/3084298213 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f20d0005180 0x7f20e40afdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:48.028 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:48.024+0000 7f20e8b39640 1 -- 172.21.15.40:0/3084298213 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20e4155970 con 0x7f20e4153140 2023-12-17T11:49:48.028 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:48.025+0000 7f20e8b39640 1 --2- 172.21.15.40:0/3084298213 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f20e4153140 0x7f20e41535c0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f20d400d7a0 tx=0x7f20d400dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:49:48.028 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:48.025+0000 7f20d9ffb640 1 -- 172.21.15.40:0/3084298213 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20d4005270 con 0x7f20e4153140 2023-12-17T11:49:48.028 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:48.025+0000 7f20d9ffb640 1 -- 172.21.15.40:0/3084298213 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20d40053d0 con 0x7f20e4153140 2023-12-17T11:49:48.028 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:48.025+0000 7f20d9ffb640 1 -- 172.21.15.40:0/3084298213 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20d400b8f0 con 0x7f20e4153140 2023-12-17T11:49:48.028 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:48.025+0000 7f20ea33c640 1 -- 172.21.15.40:0/3084298213 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20e4155c50 con 0x7f20e4153140 2023-12-17T11:49:48.028 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:48.025+0000 7f20ea33c640 1 -- 172.21.15.40:0/3084298213 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20e4156210 con 0x7f20e4153140 2023-12-17T11:49:48.029 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:48.026+0000 7f20ea33c640 1 -- 172.21.15.40:0/3084298213 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20e4141520 con 0x7f20e4153140 2023-12-17T11:49:48.029 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:48.027+0000 7f20d9ffb640 1 -- 172.21.15.40:0/3084298213 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f20d400ba50 con 0x7f20e4153140 2023-12-17T11:49:48.030 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:48.028+0000 7f20d9ffb640 1 --2- 172.21.15.40:0/3084298213 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f20c806ae70 0x7f20c806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:48.030 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:48.028+0000 7f20d9ffb640 1 -- 172.21.15.40:0/3084298213 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f20d4089340 con 0x7f20e4153140 2023-12-17T11:49:48.030 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:48.029+0000 7f20e933a640 1 --2- 172.21.15.40:0/3084298213 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f20c806ae70 0x7f20c806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:48.031 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:48.031+0000 7f20e933a640 1 --2- 172.21.15.40:0/3084298213 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f20c806ae70 0x7f20c806d330 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f20e0009990 tx=0x7f20e0008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:49:48.034 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:48.032+0000 7f20d9ffb640 1 -- 172.21.15.40:0/3084298213 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f20d40545f0 con 0x7f20e4153140 2023-12-17T11:49:48.302 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:48.301+0000 7f20ea33c640 1 -- 172.21.15.40:0/3084298213 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) v1 -- 0x7f20e4074450 con 0x7f20e4153140 2023-12-17T11:49:48.305 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:48.303+0000 7f20d9ffb640 1 -- 172.21.15.40:0/3084298213 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v8) v1 ==== 90+0+0 (secure 0 0 0) 0x7f20d4019310 con 0x7f20e4153140 2023-12-17T11:49:48.309 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:48.307+0000 7f20ea33c640 1 -- 172.21.15.40:0/3084298213 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f20c806ae70 msgr2=0x7f20c806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:48.309 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:48.307+0000 7f20ea33c640 1 --2- 172.21.15.40:0/3084298213 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f20c806ae70 0x7f20c806d330 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f20e0009990 tx=0x7f20e0008040 comp rx=0 tx=0).stop 2023-12-17T11:49:48.309 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:48.307+0000 7f20ea33c640 1 -- 172.21.15.40:0/3084298213 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f20e4153140 msgr2=0x7f20e41535c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:48.309 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:48.307+0000 7f20ea33c640 1 --2- 172.21.15.40:0/3084298213 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f20e4153140 0x7f20e41535c0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f20d400d7a0 tx=0x7f20d400dc60 comp rx=0 tx=0).stop 2023-12-17T11:49:48.309 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:48.308+0000 7f20ea33c640 1 -- 172.21.15.40:0/3084298213 shutdown_connections 2023-12-17T11:49:48.309 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:48.308+0000 7f20ea33c640 1 --2- 172.21.15.40:0/3084298213 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f20c806ae70 0x7f20c806d330 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:48.309 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:48.308+0000 7f20ea33c640 1 --2- 172.21.15.40:0/3084298213 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f20e41efb70 0x7f20e41efff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:48.309 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:48.308+0000 7f20ea33c640 1 --2- 172.21.15.40:0/3084298213 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f20e4153140 0x7f20e41535c0 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:48.309 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:48.308+0000 7f20ea33c640 1 --2- 172.21.15.40:0/3084298213 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f20d0005180 0x7f20e40afdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:48.309 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:48.308+0000 7f20ea33c640 1 -- 172.21.15.40:0/3084298213 >> 172.21.15.40:0/3084298213 conn(0x7f20e40b0860 msgr2=0x7f20e40aeb70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:49:48.310 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:48.308+0000 7f20ea33c640 1 -- 172.21.15.40:0/3084298213 shutdown_connections 2023-12-17T11:49:48.310 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:48.308+0000 7f20ea33c640 1 -- 172.21.15.40:0/3084298213 wait complete. 2023-12-17T11:49:48.328 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-17T11:49:48.560 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:48.559+0000 7fcb3e8ad640 1 Processor -- start 2023-12-17T11:49:48.560 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:48.559+0000 7fcb3e8ad640 1 -- start start 2023-12-17T11:49:48.562 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:48.561+0000 7fcb3e8ad640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fcb3806c410 0x7fcb3815dba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:48.562 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:48.561+0000 7fcb3e8ad640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7fcb3815e0e0 0x7fcb380cc8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:48.562 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:48.561+0000 7fcb3e8ad640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb3806ca40 con 0x7fcb38157a60 2023-12-17T11:49:48.562 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:48.561+0000 7fcb3e8ad640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb3815e510 con 0x7fcb3806c410 2023-12-17T11:49:48.563 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:48.561+0000 7fcb3e8ad640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb38071cd0 con 0x7fcb3815e0e0 2023-12-17T11:49:48.563 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:48.561+0000 7fcb2f7fe640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fcb3806c410 0x7fcb3815dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:48.563 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:48.561+0000 7fcb37fff640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fcb38157a60 0x7fcb3806de20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:44596/0 (socket says 172.21.15.40:44596) 2023-12-17T11:49:48.563 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:48.561+0000 7fcb37fff640 1 -- 172.21.15.40:0/2496181952 learned_addr learned my addr 172.21.15.40:0/2496181952 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-12-17T11:49:48.563 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:48.562+0000 7fcb3ce4a640 1 --2- 172.21.15.40:0/2496181952 >> v2:172.21.15.159:3300/0 conn(0x7fcb3815e0e0 0x7fcb380cc8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:48.564 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:48.562+0000 7fcb2f7fe640 1 -- 172.21.15.40:0/2496181952 >> v2:172.21.15.159:3300/0 conn(0x7fcb3815e0e0 msgr2=0x7fcb380cc8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:49:48.564 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:48.562+0000 7fcb2f7fe640 1 --2- 172.21.15.40:0/2496181952 >> v2:172.21.15.159:3300/0 conn(0x7fcb3815e0e0 0x7fcb380cc8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:48.564 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:48.562+0000 7fcb2f7fe640 1 -- 172.21.15.40:0/2496181952 >> v1:172.21.15.40:6789/0 conn(0x7fcb38157a60 legacy=0x7fcb3806de20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:48.564 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:48.562+0000 7fcb377fe640 1 -- 172.21.15.40:0/2496181952 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2134441899 0 0) 0x7fcb3806ca40 con 0x7fcb38157a60 2023-12-17T11:49:48.564 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:48.562+0000 7fcb2f7fe640 1 -- 172.21.15.40:0/2496181952 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb38070f10 con 0x7fcb3806c410 2023-12-17T11:49:48.564 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:48.562+0000 7fcb3ce4a640 1 --2- 172.21.15.40:0/2496181952 >> v2:172.21.15.159:3300/0 conn(0x7fcb3815e0e0 0x7fcb380cc8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-17T11:49:48.565 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:48.563+0000 7fcb2f7fe640 1 --2- 172.21.15.40:0/2496181952 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcb3806c410 0x7fcb3815dba0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fcb3815eb90 tx=0x7fcb2002b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21fde924c1b3b837 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:49:48.565 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:48.563+0000 7fcb377fe640 1 -- 172.21.15.40:0/2496181952 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb2002e070 con 0x7fcb3806c410 2023-12-17T11:49:48.565 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:48.563+0000 7fcb377fe640 1 -- 172.21.15.40:0/2496181952 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb200315a0 con 0x7fcb3806c410 2023-12-17T11:49:48.565 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:48.563+0000 7fcb377fe640 1 -- 172.21.15.40:0/2496181952 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb20031930 con 0x7fcb3806c410 2023-12-17T11:49:48.565 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:48.564+0000 7fcb3e8ad640 1 -- 172.21.15.40:0/2496181952 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcb3806c410 msgr2=0x7fcb3815dba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:48.566 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:48.564+0000 7fcb3e8ad640 1 --2- 172.21.15.40:0/2496181952 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcb3806c410 0x7fcb3815dba0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fcb3815eb90 tx=0x7fcb2002b840 comp rx=0 tx=0).stop 2023-12-17T11:49:48.566 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:48.564+0000 7fcb3e8ad640 1 -- 172.21.15.40:0/2496181952 shutdown_connections 2023-12-17T11:49:48.566 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:48.564+0000 7fcb3e8ad640 1 --2- 172.21.15.40:0/2496181952 >> v2:172.21.15.159:3300/0 conn(0x7fcb3815e0e0 0x7fcb380cc8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:48.566 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:48.564+0000 7fcb3e8ad640 1 --2- 172.21.15.40:0/2496181952 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcb3806c410 0x7fcb3815dba0 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:48.566 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:48.564+0000 7fcb3e8ad640 1 -- 172.21.15.40:0/2496181952 >> 172.21.15.40:0/2496181952 conn(0x7fcb380b0a90 msgr2=0x7fcb380b0e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:49:48.566 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:48.564+0000 7fcb3e8ad640 1 -- 172.21.15.40:0/2496181952 shutdown_connections 2023-12-17T11:49:48.566 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:48.564+0000 7fcb3e8ad640 1 -- 172.21.15.40:0/2496181952 wait complete. 2023-12-17T11:49:48.567 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:48.566+0000 7fcb3e8ad640 1 Processor -- start 2023-12-17T11:49:48.567 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:48.566+0000 7fcb3e8ad640 1 -- start start 2023-12-17T11:49:48.570 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:48.567+0000 7fcb3e8ad640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fcb3806c410 0x7fcb38145740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:48.571 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:48.567+0000 7fcb3e8ad640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcb38157a60 0x7fcb3815b8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:48.571 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:48.567+0000 7fcb3e8ad640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcb3815e0e0 0x7fcb38145fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:48.571 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:48.567+0000 7fcb3e8ad640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb3815c300 con 0x7fcb38157a60 2023-12-17T11:49:48.571 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:48.567+0000 7fcb3e8ad640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb3815c5a0 con 0x7fcb3815e0e0 2023-12-17T11:49:48.571 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:48.567+0000 7fcb3e8ad640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb3815c880 con 0x7fcb3806c410 2023-12-17T11:49:48.571 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:48.567+0000 7fcb2f7fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcb38157a60 0x7fcb3815b8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:48.571 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:48.568+0000 7fcb2f7fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcb38157a60 0x7fcb3815b8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:42620/0 (socket says 172.21.15.40:42620) 2023-12-17T11:49:48.572 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:48.568+0000 7fcb2f7fe640 1 -- 172.21.15.40:0/1297197203 learned_addr learned my addr 172.21.15.40:0/1297197203 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-17T11:49:48.572 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:48.568+0000 7fcb3ce4a640 1 --2- 172.21.15.40:0/1297197203 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcb3815e0e0 0x7fcb38145fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:48.572 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:48.568+0000 7fcb37fff640 1 --2- 172.21.15.40:0/1297197203 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fcb3806c410 0x7fcb38145740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:48.572 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:48.568+0000 7fcb2f7fe640 1 -- 172.21.15.40:0/1297197203 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fcb3806c410 msgr2=0x7fcb38145740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:48.572 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:48.568+0000 7fcb2f7fe640 1 --2- 172.21.15.40:0/1297197203 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fcb3806c410 0x7fcb38145740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:48.572 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:48.568+0000 7fcb2f7fe640 1 -- 172.21.15.40:0/1297197203 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcb3815e0e0 msgr2=0x7fcb38145fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:48.572 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:48.568+0000 7fcb2f7fe640 1 --2- 172.21.15.40:0/1297197203 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcb3815e0e0 0x7fcb38145fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:48.572 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:48.568+0000 7fcb2f7fe640 1 -- 172.21.15.40:0/1297197203 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb20009400 con 0x7fcb38157a60 2023-12-17T11:49:48.573 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:48.568+0000 7fcb2f7fe640 1 --2- 172.21.15.40:0/1297197203 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcb38157a60 0x7fcb3815b8d0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fcb20009890 tx=0x7fcb200046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:49:48.573 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:48.569+0000 7fcb357fa640 1 -- 172.21.15.40:0/1297197203 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb20032900 con 0x7fcb38157a60 2023-12-17T11:49:48.573 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:48.569+0000 7fcb357fa640 1 -- 172.21.15.40:0/1297197203 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb20032a60 con 0x7fcb38157a60 2023-12-17T11:49:48.573 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:48.569+0000 7fcb357fa640 1 -- 172.21.15.40:0/1297197203 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb20032e10 con 0x7fcb38157a60 2023-12-17T11:49:48.573 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:48.569+0000 7fcb3e8ad640 1 -- 172.21.15.40:0/1297197203 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb3815cb60 con 0x7fcb38157a60 2023-12-17T11:49:48.574 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:48.569+0000 7fcb3e8ad640 1 -- 172.21.15.40:0/1297197203 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb38145c80 con 0x7fcb38157a60 2023-12-17T11:49:48.575 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:48.570+0000 7fcb3e8ad640 1 -- 172.21.15.40:0/1297197203 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb3815d080 con 0x7fcb38157a60 2023-12-17T11:49:48.576 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:48.571+0000 7fcb357fa640 1 -- 172.21.15.40:0/1297197203 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fcb2003b3f0 con 0x7fcb38157a60 2023-12-17T11:49:48.576 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:48.572+0000 7fcb357fa640 1 --2- 172.21.15.40:0/1297197203 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7fcb1806ae40 0x7fcb1806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:48.576 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:48.572+0000 7fcb357fa640 1 -- 172.21.15.40:0/1297197203 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5177+0+0 (secure 0 0 0) 0x7fcb200ab620 con 0x7fcb38157a60 2023-12-17T11:49:48.576 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:48.573+0000 7fcb37fff640 1 --2- 172.21.15.40:0/1297197203 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7fcb1806ae40 0x7fcb1806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:48.576 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:48.574+0000 7fcb37fff640 1 --2- 172.21.15.40:0/1297197203 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7fcb1806ae40 0x7fcb1806d300 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fcb280012e0 tx=0x7fcb28009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:49:48.578 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:48.577+0000 7fcb357fa640 1 -- 172.21.15.40:0/1297197203 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fcb3815d080 con 0x7fcb38157a60 2023-12-17T11:49:48.779 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:48.778+0000 7fcb3e8ad640 1 -- 172.21.15.40:0/1297197203 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcb3815d080 con 0x7fcb38157a60 2023-12-17T11:49:48.780 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:48.779+0000 7fcb357fa640 1 -- 172.21.15.40:0/1297197203 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v36) v1 ==== 74+0+13038 (secure 0 0 0) 0x7fcb3815d080 con 0x7fcb38157a60 2023-12-17T11:49:48.780 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T11:49:48.780 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":36,"fsid":"099cd35d-80d9-4ca4-8424-de13b3b03ac7","created":"2023-12-17T11:47:53.450097+0000","modified":"2023-12-17T11:49:44.514277+0000","last_up_change":"2023-12-17T11:48:05.724195+0000","last_in_change":"2023-12-17T11:47:56.956499+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-17T11:48:06.668943+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a88bfd46-63b8-48b1-9c0e-5c9cdc31bd38","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":555204741},{"type":"v1","addr":"172.21.15.40:6802","nonce":555204741}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":555204741},{"type":"v1","addr":"172.21.15.40:6807","nonce":555204741}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":555204741},{"type":"v1","addr":"172.21.15.40:6815","nonce":555204741}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6809","nonce":555204741},{"type":"v1","addr":"172.21.15.40:6812","nonce":555204741}]},"public_addr":"172.21.15.40:6802/555204741","cluster_addr":"172.21.15.40:6807/555204741","heartbeat_back_addr":"172.21.15.40:6815/555204741","heartbeat_front_addr":"172.21.15.40:6812/555204741","state":["exists","up"]},{"osd":1,"uuid":"c5d628ae-36f4-4866-802c-b162f0e90add","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6801","nonce":1221318112},{"type":"v1","addr":"172.21.15.40:6803","nonce":1221318112}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6805","nonce":1221318112},{"type":"v1","addr":"172.21.15.40:6806","nonce":1221318112}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6811","nonce":1221318112},{"type":"v1","addr":"172.21.15.40:6813","nonce":1221318112}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":1221318112},{"type":"v1","addr":"172.21.15.40:6810","nonce":1221318112}]},"public_addr":"172.21.15.40:6803/1221318112","cluster_addr":"172.21.15.40:6806/1221318112","heartbeat_back_addr":"172.21.15.40:6813/1221318112","heartbeat_front_addr":"172.21.15.40:6810/1221318112","state":["exists","up"]},{"osd":2,"uuid":"d986ad6a-af2f-47fc-9c3b-fbda27b82b73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":1959000265},{"type":"v1","addr":"172.21.15.40:6817","nonce":1959000265}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6818","nonce":1959000265},{"type":"v1","addr":"172.21.15.40:6819","nonce":1959000265}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":1959000265},{"type":"v1","addr":"172.21.15.40:6827","nonce":1959000265}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":1959000265},{"type":"v1","addr":"172.21.15.40:6822","nonce":1959000265}]},"public_addr":"172.21.15.40:6817/1959000265","cluster_addr":"172.21.15.40:6819/1959000265","heartbeat_back_addr":"172.21.15.40:6827/1959000265","heartbeat_front_addr":"172.21.15.40:6822/1959000265","state":["exists","up"]},{"osd":3,"uuid":"d79d22b7-be05-41b2-b95d-697db677fd02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6821","nonce":974040287},{"type":"v1","addr":"172.21.15.40:6823","nonce":974040287}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6825","nonce":974040287},{"type":"v1","addr":"172.21.15.40:6826","nonce":974040287}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":974040287},{"type":"v1","addr":"172.21.15.40:6831","nonce":974040287}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":974040287},{"type":"v1","addr":"172.21.15.40:6829","nonce":974040287}]},"public_addr":"172.21.15.40:6823/974040287","cluster_addr":"172.21.15.40:6826/974040287","heartbeat_back_addr":"172.21.15.40:6831/974040287","heartbeat_front_addr":"172.21.15.40:6829/974040287","state":["exists","up"]},{"osd":4,"uuid":"62a7a233-d3ea-40be-91de-180c0208d639","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6808","nonce":3937787733},{"type":"v1","addr":"172.21.15.159:6809","nonce":3937787733}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6810","nonce":3937787733},{"type":"v1","addr":"172.21.15.159:6811","nonce":3937787733}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6814","nonce":3937787733},{"type":"v1","addr":"172.21.15.159:6815","nonce":3937787733}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6812","nonce":3937787733},{"type":"v1","addr":"172.21.15.159:6813","nonce":3937787733}]},"public_addr":"172.21.15.159:6809/3937787733","cluster_addr":"172.21.15.159:6811/3937787733","heartbeat_back_addr":"172.21.15.159:6815/3937787733","heartbeat_front_addr":"172.21.15.159:6813/3937787733","state":["exists","up"]},{"osd":5,"uuid":"84629cea-dc0e-4b5e-b203-5ea963839281","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6816","nonce":3032505240},{"type":"v1","addr":"172.21.15.159:6817","nonce":3032505240}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6818","nonce":3032505240},{"type":"v1","addr":"172.21.15.159:6819","nonce":3032505240}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6822","nonce":3032505240},{"type":"v1","addr":"172.21.15.159:6823","nonce":3032505240}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6820","nonce":3032505240},{"type":"v1","addr":"172.21.15.159:6821","nonce":3032505240}]},"public_addr":"172.21.15.159:6817/3032505240","cluster_addr":"172.21.15.159:6819/3032505240","heartbeat_back_addr":"172.21.15.159:6823/3032505240","heartbeat_front_addr":"172.21.15.159:6821/3032505240","state":["exists","up"]},{"osd":6,"uuid":"4ae3af3a-1743-4070-a91d-8be5c31cdb04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6800","nonce":2411788597},{"type":"v1","addr":"172.21.15.159:6801","nonce":2411788597}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6802","nonce":2411788597},{"type":"v1","addr":"172.21.15.159:6803","nonce":2411788597}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6806","nonce":2411788597},{"type":"v1","addr":"172.21.15.159:6807","nonce":2411788597}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6804","nonce":2411788597},{"type":"v1","addr":"172.21.15.159:6805","nonce":2411788597}]},"public_addr":"172.21.15.159:6801/2411788597","cluster_addr":"172.21.15.159:6803/2411788597","heartbeat_back_addr":"172.21.15.159:6807/2411788597","heartbeat_front_addr":"172.21.15.159:6805/2411788597","state":["exists","up"]},{"osd":7,"uuid":"c1f4c7f2-8f75-4f95-bc63-a332773e3b8e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6824","nonce":478953349},{"type":"v1","addr":"172.21.15.159:6825","nonce":478953349}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6826","nonce":478953349},{"type":"v1","addr":"172.21.15.159:6827","nonce":478953349}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6830","nonce":478953349},{"type":"v1","addr":"172.21.15.159:6831","nonce":478953349}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6828","nonce":478953349},{"type":"v1","addr":"172.21.15.159:6829","nonce":478953349}]},"public_addr":"172.21.15.159:6825/478953349","cluster_addr":"172.21.15.159:6827/478953349","heartbeat_back_addr":"172.21.15.159:6831/478953349","heartbeat_front_addr":"172.21.15.159:6829/478953349","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T11:48:02.023567+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T11:48:02.278216+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T11:48:02.311843+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T11:48:01.773372+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T11:48:02.618910+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T11:48:02.361559+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T11:48:02.223997+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T11:48:02.604403+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-17T11:49:48.783 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:48.781+0000 7fcb3e8ad640 1 -- 172.21.15.40:0/1297197203 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7fcb1806ae40 msgr2=0x7fcb1806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:48.783 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:48.782+0000 7fcb3e8ad640 1 --2- 172.21.15.40:0/1297197203 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7fcb1806ae40 0x7fcb1806d300 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fcb280012e0 tx=0x7fcb28009040 comp rx=0 tx=0).stop 2023-12-17T11:49:48.783 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:48.782+0000 7fcb3e8ad640 1 -- 172.21.15.40:0/1297197203 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcb38157a60 msgr2=0x7fcb3815b8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:48.783 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:48.782+0000 7fcb3e8ad640 1 --2- 172.21.15.40:0/1297197203 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcb38157a60 0x7fcb3815b8d0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fcb20009890 tx=0x7fcb200046c0 comp rx=0 tx=0).stop 2023-12-17T11:49:48.783 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:48.782+0000 7fcb3e8ad640 1 -- 172.21.15.40:0/1297197203 shutdown_connections 2023-12-17T11:49:48.783 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:48.782+0000 7fcb3e8ad640 1 --2- 172.21.15.40:0/1297197203 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7fcb1806ae40 0x7fcb1806d300 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:48.783 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:48.782+0000 7fcb3e8ad640 1 --2- 172.21.15.40:0/1297197203 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcb3815e0e0 0x7fcb38145fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:48.783 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:48.782+0000 7fcb3e8ad640 1 --2- 172.21.15.40:0/1297197203 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcb38157a60 0x7fcb3815b8d0 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:48.784 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:48.782+0000 7fcb3e8ad640 1 --2- 172.21.15.40:0/1297197203 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fcb3806c410 0x7fcb38145740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:48.784 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:48.782+0000 7fcb3e8ad640 1 -- 172.21.15.40:0/1297197203 >> 172.21.15.40:0/1297197203 conn(0x7fcb380b0a90 msgr2=0x7fcb38153d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:49:48.784 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:48.782+0000 7fcb3e8ad640 1 -- 172.21.15.40:0/1297197203 shutdown_connections 2023-12-17T11:49:48.784 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:48.782+0000 7fcb3e8ad640 1 -- 172.21.15.40:0/1297197203 wait complete. 2023-12-17T11:49:48.802 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-17T11:48:06.668943+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-17T11:49:48.802 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-17T11:49:49.034 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:49.033+0000 7fe330b59640 1 Processor -- start 2023-12-17T11:49:49.034 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:49.033+0000 7fe330b59640 1 -- start start 2023-12-17T11:49:49.036 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:49.035+0000 7fe330b59640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe32c0ce150 0x7fe32c0ce5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:49.036 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:49.035+0000 7fe330b59640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fe32c0cedf0 0x7fe32c0cf280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:49.036 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:49.035+0000 7fe330b59640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe32c06c500 con 0x7fe32c155400 2023-12-17T11:49:49.036 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:49.035+0000 7fe330b59640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe32c0cf7c0 con 0x7fe32c0cedf0 2023-12-17T11:49:49.037 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:49.035+0000 7fe330b59640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe32c15b4a0 con 0x7fe32c0ce150 2023-12-17T11:49:49.037 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:49.035+0000 7fe32bfff640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fe32c0cedf0 0x7fe32c0cf280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:49.037 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:49.035+0000 7fe32bfff640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fe32c0cedf0 0x7fe32c0cf280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:42622/0 (socket says 172.21.15.40:42622) 2023-12-17T11:49:49.037 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:49.035+0000 7fe32b7fe640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fe32c155400 0x7fe32c06bdf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:44610/0 (socket says 172.21.15.40:44610) 2023-12-17T11:49:49.037 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:49.035+0000 7fe32bfff640 1 -- 172.21.15.40:0/933152116 learned_addr learned my addr 172.21.15.40:0/933152116 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-17T11:49:49.037 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:49.035+0000 7fe32affd640 1 --2- 172.21.15.40:0/933152116 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe32c0ce150 0x7fe32c0ce5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:49.037 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:49.036+0000 7fe32bfff640 1 -- 172.21.15.40:0/933152116 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe32c0ce150 msgr2=0x7fe32c0ce5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:49:49.038 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:49.036+0000 7fe32bfff640 1 --2- 172.21.15.40:0/933152116 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe32c0ce150 0x7fe32c0ce5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:49.038 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:49.036+0000 7fe32bfff640 1 -- 172.21.15.40:0/933152116 >> v1:172.21.15.40:6789/0 conn(0x7fe32c155400 legacy=0x7fe32c06bdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:49.038 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:49.036+0000 7fe32bfff640 1 -- 172.21.15.40:0/933152116 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe32c0adbb0 con 0x7fe32c0cedf0 2023-12-17T11:49:49.038 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:49.036+0000 7fe32a7fc640 1 -- 172.21.15.40:0/933152116 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1109244967 0 0) 0x7fe32c06c500 con 0x7fe32c155400 2023-12-17T11:49:49.038 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:49.037+0000 7fe32bfff640 1 --2- 172.21.15.40:0/933152116 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe32c0cedf0 0x7fe32c0cf280 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fe324009e50 tx=0x7fe32402bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c97a9091f58814b server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:49:49.039 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:49.038+0000 7fe32a7fc640 1 -- 172.21.15.40:0/933152116 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe32402cb00 con 0x7fe32c0cedf0 2023-12-17T11:49:49.039 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:49.038+0000 7fe32a7fc640 1 -- 172.21.15.40:0/933152116 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe32402cc60 con 0x7fe32c0cedf0 2023-12-17T11:49:49.039 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:49.038+0000 7fe32a7fc640 1 -- 172.21.15.40:0/933152116 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3240343f0 con 0x7fe32c0cedf0 2023-12-17T11:49:49.039 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:49.038+0000 7fe330b59640 1 -- 172.21.15.40:0/933152116 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe32c0cedf0 msgr2=0x7fe32c0cf280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:49.040 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:49.038+0000 7fe330b59640 1 --2- 172.21.15.40:0/933152116 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe32c0cedf0 0x7fe32c0cf280 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fe324009e50 tx=0x7fe32402bf60 comp rx=0 tx=0).stop 2023-12-17T11:49:49.040 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:49.038+0000 7fe330b59640 1 -- 172.21.15.40:0/933152116 shutdown_connections 2023-12-17T11:49:49.040 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:49.038+0000 7fe330b59640 1 --2- 172.21.15.40:0/933152116 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe32c0cedf0 0x7fe32c0cf280 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:49.040 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:49.038+0000 7fe330b59640 1 --2- 172.21.15.40:0/933152116 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe32c0ce150 0x7fe32c0ce5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:49.040 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:49.038+0000 7fe330b59640 1 -- 172.21.15.40:0/933152116 >> 172.21.15.40:0/933152116 conn(0x7fe32c06a640 msgr2=0x7fe32c06aa50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:49:49.040 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:49.038+0000 7fe330b59640 1 -- 172.21.15.40:0/933152116 shutdown_connections 2023-12-17T11:49:49.040 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:49.038+0000 7fe330b59640 1 -- 172.21.15.40:0/933152116 wait complete. 2023-12-17T11:49:49.041 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:49.040+0000 7fe330b59640 1 Processor -- start 2023-12-17T11:49:49.041 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:49.040+0000 7fe330b59640 1 -- start start 2023-12-17T11:49:49.043 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:49.041+0000 7fe330b59640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe32c0ce150 0x7fe32c1e5370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:49.043 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:49.041+0000 7fe330b59640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe32c0cedf0 0x7fe32c1464f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:49.043 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:49.041+0000 7fe330b59640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe32c155400 0x7fe32c09be00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:49.044 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:49.041+0000 7fe330b59640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe32c1e42d0 con 0x7fe32c155400 2023-12-17T11:49:49.044 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:49.041+0000 7fe330b59640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe32c1e45b0 con 0x7fe32c0ce150 2023-12-17T11:49:49.044 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:49.041+0000 7fe330b59640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe32c1e4890 con 0x7fe32c0cedf0 2023-12-17T11:49:49.044 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:49.042+0000 7fe32bfff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe32c155400 0x7fe32c09be00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:49.044 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:49.042+0000 7fe32bfff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe32c155400 0x7fe32c09be00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:42632/0 (socket says 172.21.15.40:42632) 2023-12-17T11:49:49.044 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:49.042+0000 7fe32bfff640 1 -- 172.21.15.40:0/3626418091 learned_addr learned my addr 172.21.15.40:0/3626418091 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-17T11:49:49.044 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:49.042+0000 7fe32affd640 1 --2- 172.21.15.40:0/3626418091 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe32c0cedf0 0x7fe32c1464f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:49.044 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:49.042+0000 7fe32b7fe640 1 --2- 172.21.15.40:0/3626418091 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe32c0ce150 0x7fe32c1e5370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:49.044 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:49.042+0000 7fe32bfff640 1 -- 172.21.15.40:0/3626418091 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe32c0cedf0 msgr2=0x7fe32c1464f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:49.044 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:49.042+0000 7fe32bfff640 1 --2- 172.21.15.40:0/3626418091 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe32c0cedf0 0x7fe32c1464f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:49.044 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:49.042+0000 7fe32bfff640 1 -- 172.21.15.40:0/3626418091 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe32c0ce150 msgr2=0x7fe32c1e5370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:49.044 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:49.042+0000 7fe32bfff640 1 --2- 172.21.15.40:0/3626418091 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe32c0ce150 0x7fe32c1e5370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:49.044 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:49.042+0000 7fe32bfff640 1 -- 172.21.15.40:0/3626418091 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe324009b30 con 0x7fe32c155400 2023-12-17T11:49:49.045 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:49.042+0000 7fe32bfff640 1 --2- 172.21.15.40:0/3626418091 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe32c155400 0x7fe32c09be00 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fe324009e50 tx=0x7fe324004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:49:49.045 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:49.043+0000 7fe313fff640 1 -- 172.21.15.40:0/3626418091 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe324009510 con 0x7fe32c155400 2023-12-17T11:49:49.045 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:49.043+0000 7fe313fff640 1 -- 172.21.15.40:0/3626418091 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe32403e450 con 0x7fe32c155400 2023-12-17T11:49:49.045 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:49.043+0000 7fe313fff640 1 -- 172.21.15.40:0/3626418091 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe32403e800 con 0x7fe32c155400 2023-12-17T11:49:49.046 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:49.043+0000 7fe330b59640 1 -- 172.21.15.40:0/3626418091 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe32c1e4b70 con 0x7fe32c155400 2023-12-17T11:49:49.046 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:49.043+0000 7fe330b59640 1 -- 172.21.15.40:0/3626418091 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe32c146a30 con 0x7fe32c155400 2023-12-17T11:49:49.046 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:49.044+0000 7fe330b59640 1 -- 172.21.15.40:0/3626418091 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe32c074450 con 0x7fe32c155400 2023-12-17T11:49:49.046 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:49.045+0000 7fe313fff640 1 -- 172.21.15.40:0/3626418091 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fe32403e960 con 0x7fe32c155400 2023-12-17T11:49:49.047 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:49.046+0000 7fe313fff640 1 --2- 172.21.15.40:0/3626418091 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7fe31806ae40 0x7fe31806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:49.047 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:49.046+0000 7fe313fff640 1 -- 172.21.15.40:0/3626418091 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5177+0+0 (secure 0 0 0) 0x7fe3240ac100 con 0x7fe32c155400 2023-12-17T11:49:49.047 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:49.046+0000 7fe32b7fe640 1 --2- 172.21.15.40:0/3626418091 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7fe31806ae40 0x7fe31806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:49.048 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:49.047+0000 7fe32b7fe640 1 --2- 172.21.15.40:0/3626418091 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7fe31806ae40 0x7fe31806d300 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fe31c000f60 tx=0x7fe31c007c00 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:49:49.051 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:49.050+0000 7fe313fff640 1 -- 172.21.15.40:0/3626418091 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fe324077320 con 0x7fe32c155400 2023-12-17T11:49:49.251 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:49.250+0000 7fe330b59640 1 -- 172.21.15.40:0/3626418091 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fe32c06d750 con 0x7fe32c155400 2023-12-17T11:49:49.253 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:49.252+0000 7fe313fff640 1 -- 172.21.15.40:0/3626418091 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v36) v1 ==== 93+0+10 (secure 0 0 0) 0x7fe32407a940 con 0x7fe32c155400 2023-12-17T11:49:49.253 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 1 2023-12-17T11:49:49.256 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:49.255+0000 7fe330b59640 1 -- 172.21.15.40:0/3626418091 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7fe31806ae40 msgr2=0x7fe31806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:49.256 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:49.255+0000 7fe330b59640 1 --2- 172.21.15.40:0/3626418091 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7fe31806ae40 0x7fe31806d300 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fe31c000f60 tx=0x7fe31c007c00 comp rx=0 tx=0).stop 2023-12-17T11:49:49.257 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:49.255+0000 7fe330b59640 1 -- 172.21.15.40:0/3626418091 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe32c155400 msgr2=0x7fe32c09be00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:49.257 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:49.255+0000 7fe330b59640 1 --2- 172.21.15.40:0/3626418091 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe32c155400 0x7fe32c09be00 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fe324009e50 tx=0x7fe324004a40 comp rx=0 tx=0).stop 2023-12-17T11:49:49.257 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:49.255+0000 7fe330b59640 1 -- 172.21.15.40:0/3626418091 shutdown_connections 2023-12-17T11:49:49.257 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:49.255+0000 7fe330b59640 1 --2- 172.21.15.40:0/3626418091 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7fe31806ae40 0x7fe31806d300 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:49.257 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:49.255+0000 7fe330b59640 1 --2- 172.21.15.40:0/3626418091 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe32c155400 0x7fe32c09be00 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:49.257 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:49.255+0000 7fe330b59640 1 --2- 172.21.15.40:0/3626418091 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe32c0cedf0 0x7fe32c1464f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:49.257 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:49.255+0000 7fe330b59640 1 --2- 172.21.15.40:0/3626418091 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe32c0ce150 0x7fe32c1e5370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:49.257 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:49.255+0000 7fe330b59640 1 -- 172.21.15.40:0/3626418091 >> 172.21.15.40:0/3626418091 conn(0x7fe32c06a640 msgr2=0x7fe32c0b2ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:49:49.257 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:49.255+0000 7fe330b59640 1 -- 172.21.15.40:0/3626418091 shutdown_connections 2023-12-17T11:49:49.257 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:49.255+0000 7fe330b59640 1 -- 172.21.15.40:0/3626418091 wait complete. 2023-12-17T11:49:49.277 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-12-17T11:49:49.492 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:49.491+0000 7f28b3fff640 1 Processor -- start 2023-12-17T11:49:49.492 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:49.491+0000 7f28b3fff640 1 -- start start 2023-12-17T11:49:49.497 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:49.493+0000 7f28b3fff640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f28b4071260 0x7f28b40cded0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:49.497 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:49.493+0000 7f28b3fff640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28b4071f90 con 0x7f28b415e5d0 2023-12-17T11:49:49.497 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:49.493+0000 7f28b3fff640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28b4072270 con 0x7f28b40ae200 2023-12-17T11:49:49.497 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:49.493+0000 7f28b3fff640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28b4070070 con 0x7f28b4071260 2023-12-17T11:49:49.497 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:49.493+0000 7f28b2ffd640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f28b415e5d0 0x7f28b406bdf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:44626/0 (socket says 172.21.15.40:44626) 2023-12-17T11:49:49.497 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:49.493+0000 7f28b2ffd640 1 -- 172.21.15.40:0/1037099680 learned_addr learned my addr 172.21.15.40:0/1037099680 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-12-17T11:49:49.497 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:49.494+0000 7f28b37fe640 1 --2- 172.21.15.40:0/1037099680 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f28b4071260 0x7f28b40cded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:49.497 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:49.494+0000 7f28b1ffb640 1 -- 172.21.15.40:0/1037099680 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2782874909 0 0) 0x7f28b4071f90 con 0x7f28b415e5d0 2023-12-17T11:49:49.497 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:49.494+0000 7f28b1ffb640 1 -- 172.21.15.40:0/1037099680 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f289c003520 con 0x7f28b415e5d0 2023-12-17T11:49:49.498 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:49.494+0000 7f28b1ffb640 1 -- 172.21.15.40:0/1037099680 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3295745279 0 0) 0x7f289c003520 con 0x7f28b415e5d0 2023-12-17T11:49:49.498 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:49.494+0000 7f28b1ffb640 1 -- 172.21.15.40:0/1037099680 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f28b4071260 msgr2=0x7f28b40cded0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:49:49.498 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:49.494+0000 7f28b1ffb640 1 --2- 172.21.15.40:0/1037099680 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f28b4071260 0x7f28b40cded0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:49.498 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:49.494+0000 7f28b1ffb640 1 -- 172.21.15.40:0/1037099680 >> v1:172.21.15.159:6789/0 conn(0x7f28b40ae200 legacy=0x7f28b4070b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:49.498 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:49.494+0000 7f28b1ffb640 1 -- 172.21.15.40:0/1037099680 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28b4070350 con 0x7f28b415e5d0 2023-12-17T11:49:49.498 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:49.494+0000 7f28b1ffb640 1 -- 172.21.15.40:0/1037099680 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2643242555 0 0) 0x7f28a4001670 con 0x7f28b415e5d0 2023-12-17T11:49:49.498 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:49.495+0000 7f28b1ffb640 1 -- 172.21.15.40:0/1037099680 >> v1:172.21.15.40:6789/0 conn(0x7f28b415e5d0 legacy=0x7f28b406bdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:49.498 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:49.495+0000 7f28b1ffb640 1 --2- 172.21.15.40:0/1037099680 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f28b4071260 0x7f289c0039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:49.498 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:49.495+0000 7f28b1ffb640 1 --2- 172.21.15.40:0/1037099680 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f289c003f70 0x7f289c0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:49.498 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:49.495+0000 7f28b1ffb640 1 --2- 172.21.15.40:0/1037099680 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f289c004d00 0x7f289c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:49.498 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:49.495+0000 7f28b1ffb640 1 -- 172.21.15.40:0/1037099680 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28b4070070 con 0x7f289c004d00 2023-12-17T11:49:49.498 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:49.495+0000 7f28b1ffb640 1 -- 172.21.15.40:0/1037099680 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f289c00bb70 con 0x7f289c003f70 2023-12-17T11:49:49.498 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:49.495+0000 7f28b1ffb640 1 -- 172.21.15.40:0/1037099680 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f289c00bd30 con 0x7f28b4071260 2023-12-17T11:49:49.498 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:49.495+0000 7f28b37fe640 1 --2- 172.21.15.40:0/1037099680 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f289c004d00 0x7f289c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:49.499 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:49.495+0000 7f28b27fc640 1 --2- 172.21.15.40:0/1037099680 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f289c003f70 0x7f289c0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:49.499 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:49.495+0000 7f28b2ffd640 1 --2- 172.21.15.40:0/1037099680 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f28b4071260 0x7f289c0039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:49.499 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:49.495+0000 7f28b37fe640 1 -- 172.21.15.40:0/1037099680 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f28b4071260 msgr2=0x7f289c0039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:49:49.499 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:49.495+0000 7f28b37fe640 1 --2- 172.21.15.40:0/1037099680 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f28b4071260 0x7f289c0039a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:49.499 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:49.495+0000 7f28b37fe640 1 -- 172.21.15.40:0/1037099680 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f289c003f70 msgr2=0x7f289c0047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:49:49.499 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:49.495+0000 7f28b37fe640 1 --2- 172.21.15.40:0/1037099680 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f289c003f70 0x7f289c0047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:49.499 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:49.496+0000 7f28b37fe640 1 -- 172.21.15.40:0/1037099680 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f289c003520 con 0x7f289c004d00 2023-12-17T11:49:49.499 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:49.496+0000 7f28b27fc640 1 --2- 172.21.15.40:0/1037099680 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f289c003f70 0x7f289c0047c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-17T11:49:49.500 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:49.497+0000 7f28b37fe640 1 --2- 172.21.15.40:0/1037099680 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f289c004d00 0x7f289c005180 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f28ac009fc0 tx=0x7f289c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4df44eb88d1354b server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:49:49.500 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:49.497+0000 7f28b1ffb640 1 -- 172.21.15.40:0/1037099680 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28ac02cc20 con 0x7f289c004d00 2023-12-17T11:49:49.500 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:49.497+0000 7f28b1ffb640 1 -- 172.21.15.40:0/1037099680 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28ac00f040 con 0x7f289c004d00 2023-12-17T11:49:49.500 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:49.497+0000 7f28b1ffb640 1 -- 172.21.15.40:0/1037099680 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28ac034440 con 0x7f289c004d00 2023-12-17T11:49:49.501 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:49.498+0000 7f28b3fff640 1 -- 172.21.15.40:0/1037099680 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f289c004d00 msgr2=0x7f289c005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:49.501 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:49.498+0000 7f28b3fff640 1 --2- 172.21.15.40:0/1037099680 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f289c004d00 0x7f289c005180 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f28ac009fc0 tx=0x7f289c0057f0 comp rx=0 tx=0).stop 2023-12-17T11:49:49.501 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:49.498+0000 7f28b37fe640 1 -- 172.21.15.40:0/1037099680 reap_dead start 2023-12-17T11:49:49.501 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:49.498+0000 7f28b3fff640 1 -- 172.21.15.40:0/1037099680 shutdown_connections 2023-12-17T11:49:49.501 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:49.498+0000 7f28b3fff640 1 -- 172.21.15.40:0/1037099680 >> 172.21.15.40:0/1037099680 conn(0x7f28b40b0860 msgr2=0x7f28b40b0c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:49:49.501 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:49.498+0000 7f28b3fff640 1 -- 172.21.15.40:0/1037099680 shutdown_connections 2023-12-17T11:49:49.501 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:49.498+0000 7f28b3fff640 1 -- 172.21.15.40:0/1037099680 wait complete. 2023-12-17T11:49:49.501 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:49.500+0000 7f28b3fff640 1 Processor -- start 2023-12-17T11:49:49.503 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:49.500+0000 7f28b3fff640 1 -- start start 2023-12-17T11:49:49.503 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:49.501+0000 7f28b3fff640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f289c004d00 0x7f28b41500f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:49.503 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:49.501+0000 7f28b3fff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f28b4154b60 0x7f28b415a770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:49.503 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:49.501+0000 7f28b3fff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f28b415c180 0x7f28b415c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:49.503 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:49.501+0000 7f28b3fff640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28b4150630 con 0x7f28b415c180 2023-12-17T11:49:49.503 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:49.501+0000 7f28b3fff640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28b415b0e0 con 0x7f28b4154b60 2023-12-17T11:49:49.503 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:49.501+0000 7f28b3fff640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28b415b3c0 con 0x7f289c004d00 2023-12-17T11:49:49.503 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:49.501+0000 7f28b37fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f28b415c180 0x7f28b415c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:49.503 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:49.501+0000 7f28b37fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f28b415c180 0x7f28b415c610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:42658/0 (socket says 172.21.15.40:42658) 2023-12-17T11:49:49.503 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:49.501+0000 7f28b37fe640 1 -- 172.21.15.40:0/1262612787 learned_addr learned my addr 172.21.15.40:0/1262612787 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-17T11:49:49.503 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:49.501+0000 7f28b2ffd640 1 --2- 172.21.15.40:0/1262612787 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f289c004d00 0x7f28b41500f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:49.503 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:49.501+0000 7f28b27fc640 1 --2- 172.21.15.40:0/1262612787 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f28b4154b60 0x7f28b415a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:49.503 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:49.502+0000 7f28b37fe640 1 -- 172.21.15.40:0/1262612787 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f289c004d00 msgr2=0x7f28b41500f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:49.504 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:49.502+0000 7f28b37fe640 1 --2- 172.21.15.40:0/1262612787 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f289c004d00 0x7f28b41500f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:49.504 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:49.502+0000 7f28b37fe640 1 -- 172.21.15.40:0/1262612787 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f28b4154b60 msgr2=0x7f28b415a770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:49.504 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:49.502+0000 7f28b37fe640 1 --2- 172.21.15.40:0/1262612787 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f28b4154b60 0x7f28b415a770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:49.504 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:49.502+0000 7f28b37fe640 1 -- 172.21.15.40:0/1262612787 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28b406c680 con 0x7f28b415c180 2023-12-17T11:49:49.504 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:49.502+0000 7f28b37fe640 1 --2- 172.21.15.40:0/1262612787 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f28b415c180 0x7f28b415c610 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f28ac037040 tx=0x7f28ac009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:49:49.505 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:49.502+0000 7f289b7fe640 1 -- 172.21.15.40:0/1262612787 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28ac043070 con 0x7f28b415c180 2023-12-17T11:49:49.505 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:49.502+0000 7f289b7fe640 1 -- 172.21.15.40:0/1262612787 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28ac034ad0 con 0x7f28b415c180 2023-12-17T11:49:49.505 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:49.502+0000 7f289b7fe640 1 -- 172.21.15.40:0/1262612787 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28ac034e40 con 0x7f28b415c180 2023-12-17T11:49:49.505 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:49.502+0000 7f28b3fff640 1 -- 172.21.15.40:0/1262612787 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28b415b6a0 con 0x7f28b415c180 2023-12-17T11:49:49.505 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:49.503+0000 7f28b3fff640 1 -- 172.21.15.40:0/1262612787 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28b415bc60 con 0x7f28b415c180 2023-12-17T11:49:49.505 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:49.504+0000 7f28b3fff640 1 -- 172.21.15.40:0/1262612787 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28b4074450 con 0x7f28b415c180 2023-12-17T11:49:49.505 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:49.505+0000 7f289b7fe640 1 -- 172.21.15.40:0/1262612787 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f28ac03e440 con 0x7f28b415c180 2023-12-17T11:49:49.506 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:49.505+0000 7f289b7fe640 1 --2- 172.21.15.40:0/1262612787 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f28a006ae40 0x7f28a006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:49.506 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:49.506+0000 7f289b7fe640 1 -- 172.21.15.40:0/1262612787 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f28ac0aadf0 con 0x7f28b415c180 2023-12-17T11:49:49.507 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:49.506+0000 7f28b2ffd640 1 --2- 172.21.15.40:0/1262612787 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f28a006ae40 0x7f28a006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:49.508 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:49.507+0000 7f28b2ffd640 1 --2- 172.21.15.40:0/1262612787 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f28a006ae40 0x7f28a006d300 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f28b409c550 tx=0x7f28a4009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:49:49.511 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:49.510+0000 7f289b7fe640 1 -- 172.21.15.40:0/1262612787 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f28ac0760c0 con 0x7f28b415c180 2023-12-17T11:49:49.706 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:49.705+0000 7f28b3fff640 1 -- 172.21.15.40:0/1262612787 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f28b40adfe0 con 0x7f28b415c180 2023-12-17T11:49:49.707 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:49.706+0000 7f289b7fe640 1 -- 172.21.15.40:0/1262612787 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v36) v1 ==== 84+0+65 (secure 0 0 0) 0x7f28ac039090 con 0x7f28b415c180 2023-12-17T11:49:49.707 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T11:49:49.707 INFO:teuthology.orchestra.run.smithi040.stdout:[ 2023-12-17T11:49:49.707 INFO:teuthology.orchestra.run.smithi040.stdout: { 2023-12-17T11:49:49.707 INFO:teuthology.orchestra.run.smithi040.stdout: "poolnum": 1, 2023-12-17T11:49:49.708 INFO:teuthology.orchestra.run.smithi040.stdout: "poolname": ".mgr" 2023-12-17T11:49:49.708 INFO:teuthology.orchestra.run.smithi040.stdout: } 2023-12-17T11:49:49.708 INFO:teuthology.orchestra.run.smithi040.stdout:] 2023-12-17T11:49:49.710 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:49.709+0000 7f28b3fff640 1 -- 172.21.15.40:0/1262612787 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f28a006ae40 msgr2=0x7f28a006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:49.710 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:49.709+0000 7f28b3fff640 1 --2- 172.21.15.40:0/1262612787 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f28a006ae40 0x7f28a006d300 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f28b409c550 tx=0x7f28a4009040 comp rx=0 tx=0).stop 2023-12-17T11:49:49.710 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:49.709+0000 7f28b3fff640 1 -- 172.21.15.40:0/1262612787 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f28b415c180 msgr2=0x7f28b415c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:49.710 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:49.709+0000 7f28b3fff640 1 --2- 172.21.15.40:0/1262612787 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f28b415c180 0x7f28b415c610 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f28ac037040 tx=0x7f28ac009750 comp rx=0 tx=0).stop 2023-12-17T11:49:49.710 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:49.709+0000 7f28b3fff640 1 -- 172.21.15.40:0/1262612787 shutdown_connections 2023-12-17T11:49:49.710 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:49.709+0000 7f28b3fff640 1 --2- 172.21.15.40:0/1262612787 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f28a006ae40 0x7f28a006d300 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:49.710 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:49.709+0000 7f28b3fff640 1 --2- 172.21.15.40:0/1262612787 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f28b415c180 0x7f28b415c610 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:49.711 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:49.709+0000 7f28b3fff640 1 --2- 172.21.15.40:0/1262612787 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f28b4154b60 0x7f28b415a770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:49.711 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:49.709+0000 7f28b3fff640 1 --2- 172.21.15.40:0/1262612787 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f289c004d00 0x7f28b41500f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:49.711 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:49.709+0000 7f28b3fff640 1 -- 172.21.15.40:0/1262612787 >> 172.21.15.40:0/1262612787 conn(0x7f28b40b0860 msgr2=0x7f28b40aecb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:49:49.711 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:49.709+0000 7f28b3fff640 1 -- 172.21.15.40:0/1262612787 shutdown_connections 2023-12-17T11:49:49.711 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:49.709+0000 7f28b3fff640 1 -- 172.21.15.40:0/1262612787 wait complete. 2023-12-17T11:49:49.728 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-12-17T11:49:49.729 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-12-17T11:49:49.961 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:49.960+0000 7fbb58977640 1 Processor -- start 2023-12-17T11:49:49.961 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:49.960+0000 7fbb58977640 1 -- start start 2023-12-17T11:49:49.963 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:49.961+0000 7fbb58977640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fbb540720c0 0x7fbb540b2610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:49.963 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:49.962+0000 7fbb58977640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb54071020 con 0x7fbb540cf6c0 2023-12-17T11:49:49.963 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:49.962+0000 7fbb58977640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb54071300 con 0x7fbb54159f30 2023-12-17T11:49:49.963 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:49.962+0000 7fbb58977640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb540715e0 con 0x7fbb540720c0 2023-12-17T11:49:49.963 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:49.962+0000 7fbb4bfff640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fbb540cf6c0 0x7fbb540b1f00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:44636/0 (socket says 172.21.15.40:44636) 2023-12-17T11:49:49.963 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:49.962+0000 7fbb4bfff640 1 -- 172.21.15.40:0/3254458887 learned_addr learned my addr 172.21.15.40:0/3254458887 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-12-17T11:49:49.965 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:49.962+0000 7fbb5359e640 1 --2- 172.21.15.40:0/3254458887 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fbb540720c0 0x7fbb540b2610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:49.965 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:49.963+0000 7fbb5259c640 1 -- 172.21.15.40:0/3254458887 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2287443259 0 0) 0x7fbb54071020 con 0x7fbb540cf6c0 2023-12-17T11:49:49.965 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:49.963+0000 7fbb5259c640 1 -- 172.21.15.40:0/3254458887 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbb40005730 con 0x7fbb540cf6c0 2023-12-17T11:49:49.965 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:49.963+0000 7fbb5259c640 1 -- 172.21.15.40:0/3254458887 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2592159616 0 0) 0x7fbb40005730 con 0x7fbb540cf6c0 2023-12-17T11:49:49.965 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:49.963+0000 7fbb5259c640 1 -- 172.21.15.40:0/3254458887 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fbb540720c0 msgr2=0x7fbb540b2610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:49:49.965 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:49.963+0000 7fbb5259c640 1 --2- 172.21.15.40:0/3254458887 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fbb540720c0 0x7fbb540b2610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:49.965 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:49.963+0000 7fbb5259c640 1 -- 172.21.15.40:0/3254458887 >> v1:172.21.15.159:6789/0 conn(0x7fbb54159f30 legacy=0x7fbb540cefb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:49.966 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:49.963+0000 7fbb5259c640 1 -- 172.21.15.40:0/3254458887 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb540718c0 con 0x7fbb540cf6c0 2023-12-17T11:49:49.966 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:49.963+0000 7fbb5259c640 1 -- 172.21.15.40:0/3254458887 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2643242555 0 0) 0x7fbb3c001670 con 0x7fbb540cf6c0 2023-12-17T11:49:49.966 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:49.963+0000 7fbb5259c640 1 -- 172.21.15.40:0/3254458887 >> v1:172.21.15.40:6789/0 conn(0x7fbb540cf6c0 legacy=0x7fbb540b1f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:49.966 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:49.963+0000 7fbb5259c640 1 --2- 172.21.15.40:0/3254458887 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbb40005bb0 0x7fbb40005f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:49.966 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:49.963+0000 7fbb5259c640 1 --2- 172.21.15.40:0/3254458887 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fbb540720c0 0x7fbb400069d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:49.966 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:49.963+0000 7fbb5259c640 1 --2- 172.21.15.40:0/3254458887 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbb40006f10 0x7fbb40007390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:49.966 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:49.963+0000 7fbb5259c640 1 -- 172.21.15.40:0/3254458887 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb540715e0 con 0x7fbb40005bb0 2023-12-17T11:49:49.966 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:49.963+0000 7fbb5259c640 1 -- 172.21.15.40:0/3254458887 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb4000db90 con 0x7fbb40006f10 2023-12-17T11:49:49.966 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:49.963+0000 7fbb5259c640 1 -- 172.21.15.40:0/3254458887 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb4000dd50 con 0x7fbb540720c0 2023-12-17T11:49:49.966 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:49.963+0000 7fbb52d9d640 1 --2- 172.21.15.40:0/3254458887 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbb40005bb0 0x7fbb40005f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:49.966 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:49.964+0000 7fbb5359e640 1 --2- 172.21.15.40:0/3254458887 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbb40006f10 0x7fbb40007390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:49.966 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:49.964+0000 7fbb4bfff640 1 --2- 172.21.15.40:0/3254458887 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fbb540720c0 0x7fbb400069d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:49.967 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:49.964+0000 7fbb52d9d640 1 -- 172.21.15.40:0/3254458887 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fbb540720c0 msgr2=0x7fbb400069d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:49:49.967 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:49.964+0000 7fbb52d9d640 1 --2- 172.21.15.40:0/3254458887 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fbb540720c0 0x7fbb400069d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:49.967 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:49.964+0000 7fbb52d9d640 1 -- 172.21.15.40:0/3254458887 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbb40006f10 msgr2=0x7fbb40007390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:49:49.967 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:49.964+0000 7fbb52d9d640 1 --2- 172.21.15.40:0/3254458887 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbb40006f10 0x7fbb40007390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:49.967 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:49.964+0000 7fbb52d9d640 1 -- 172.21.15.40:0/3254458887 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb40005730 con 0x7fbb40005bb0 2023-12-17T11:49:49.967 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:49.964+0000 7fbb5359e640 1 --2- 172.21.15.40:0/3254458887 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbb40006f10 0x7fbb40007390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-17T11:49:49.968 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:49.965+0000 7fbb52d9d640 1 --2- 172.21.15.40:0/3254458887 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbb40005bb0 0x7fbb40005f90 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fbb44001860 tx=0x7fbb40007a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f0495414fb5117f server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:49:49.968 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:49.965+0000 7fbb5259c640 1 -- 172.21.15.40:0/3254458887 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb44033640 con 0x7fbb40005bb0 2023-12-17T11:49:49.968 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:49.966+0000 7fbb5259c640 1 -- 172.21.15.40:0/3254458887 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb440337c0 con 0x7fbb40005bb0 2023-12-17T11:49:49.968 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:49.966+0000 7fbb5259c640 1 -- 172.21.15.40:0/3254458887 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb44033b70 con 0x7fbb40005bb0 2023-12-17T11:49:49.968 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:49.966+0000 7fbb58977640 1 -- 172.21.15.40:0/3254458887 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbb40005bb0 msgr2=0x7fbb40005f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:49.968 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:49.966+0000 7fbb58977640 1 --2- 172.21.15.40:0/3254458887 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbb40005bb0 0x7fbb40005f90 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fbb44001860 tx=0x7fbb40007a00 comp rx=0 tx=0).stop 2023-12-17T11:49:49.968 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:49.966+0000 7fbb5359e640 1 -- 172.21.15.40:0/3254458887 reap_dead start 2023-12-17T11:49:49.969 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:49.966+0000 7fbb58977640 1 -- 172.21.15.40:0/3254458887 shutdown_connections 2023-12-17T11:49:49.969 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:49.966+0000 7fbb58977640 1 -- 172.21.15.40:0/3254458887 >> 172.21.15.40:0/3254458887 conn(0x7fbb5406a880 msgr2=0x7fbb5406ac90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:49:49.969 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:49.966+0000 7fbb58977640 1 -- 172.21.15.40:0/3254458887 shutdown_connections 2023-12-17T11:49:49.969 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:49.967+0000 7fbb58977640 1 -- 172.21.15.40:0/3254458887 wait complete. 2023-12-17T11:49:49.969 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:49.968+0000 7fbb58977640 1 Processor -- start 2023-12-17T11:49:49.969 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:49.968+0000 7fbb58977640 1 -- start start 2023-12-17T11:49:49.971 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:49.969+0000 7fbb58977640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbb40005bb0 0x7fbb540cb4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:49.971 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:49.969+0000 7fbb58977640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fbb5409ad70 0x7fbb541588b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:49.971 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:49.969+0000 7fbb58977640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbb5409b1f0 0x7fbb54158df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:49.971 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:49.969+0000 7fbb58977640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb540999f0 con 0x7fbb5409b1f0 2023-12-17T11:49:49.971 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:49.969+0000 7fbb58977640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb54099cd0 con 0x7fbb40005bb0 2023-12-17T11:49:49.971 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:49.969+0000 7fbb58977640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb54099fb0 con 0x7fbb5409ad70 2023-12-17T11:49:49.971 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:49.970+0000 7fbb5359e640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbb5409b1f0 0x7fbb54158df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:49.971 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:49.970+0000 7fbb5359e640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbb5409b1f0 0x7fbb54158df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:42676/0 (socket says 172.21.15.40:42676) 2023-12-17T11:49:49.971 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:49.970+0000 7fbb5359e640 1 -- 172.21.15.40:0/3468848104 learned_addr learned my addr 172.21.15.40:0/3468848104 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-17T11:49:49.971 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:49.970+0000 7fbb52d9d640 1 --2- 172.21.15.40:0/3468848104 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbb40005bb0 0x7fbb540cb4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:49.973 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:49.970+0000 7fbb4bfff640 1 --2- 172.21.15.40:0/3468848104 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fbb5409ad70 0x7fbb541588b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:49.973 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:49.970+0000 7fbb5359e640 1 -- 172.21.15.40:0/3468848104 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fbb5409ad70 msgr2=0x7fbb541588b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:49.973 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:49.970+0000 7fbb5359e640 1 --2- 172.21.15.40:0/3468848104 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fbb5409ad70 0x7fbb541588b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:49.973 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:49.970+0000 7fbb5359e640 1 -- 172.21.15.40:0/3468848104 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbb40005bb0 msgr2=0x7fbb540cb4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:49.973 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:49.970+0000 7fbb5359e640 1 --2- 172.21.15.40:0/3468848104 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbb40005bb0 0x7fbb540cb4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:49.973 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:49.970+0000 7fbb5359e640 1 -- 172.21.15.40:0/3468848104 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb5409a290 con 0x7fbb5409b1f0 2023-12-17T11:49:49.973 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:49.971+0000 7fbb4bfff640 1 --2- 172.21.15.40:0/3468848104 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fbb5409ad70 0x7fbb541588b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-17T11:49:49.973 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:49.971+0000 7fbb5359e640 1 --2- 172.21.15.40:0/3468848104 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbb5409b1f0 0x7fbb54158df0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fbb540cdd60 tx=0x7fbb4c010590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:49:49.973 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:49.971+0000 7fbb4b7fe640 1 -- 172.21.15.40:0/3468848104 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb4c00e050 con 0x7fbb5409b1f0 2023-12-17T11:49:49.973 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:49.971+0000 7fbb4b7fe640 1 -- 172.21.15.40:0/3468848104 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb4c00f040 con 0x7fbb5409b1f0 2023-12-17T11:49:49.973 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:49.971+0000 7fbb58977640 1 -- 172.21.15.40:0/3468848104 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb5409a570 con 0x7fbb5409b1f0 2023-12-17T11:49:49.973 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:49.971+0000 7fbb4b7fe640 1 -- 172.21.15.40:0/3468848104 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb4c003990 con 0x7fbb5409b1f0 2023-12-17T11:49:49.974 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:49.971+0000 7fbb58977640 1 -- 172.21.15.40:0/3468848104 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb540cb9e0 con 0x7fbb5409b1f0 2023-12-17T11:49:49.974 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:49.973+0000 7fbb58977640 1 -- 172.21.15.40:0/3468848104 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb5409aa90 con 0x7fbb5409b1f0 2023-12-17T11:49:49.974 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:49.974+0000 7fbb4b7fe640 1 -- 172.21.15.40:0/3468848104 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fbb4c003af0 con 0x7fbb5409b1f0 2023-12-17T11:49:49.975 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:49.975+0000 7fbb4b7fe640 1 --2- 172.21.15.40:0/3468848104 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7fbb3406ae40 0x7fbb3406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:49.976 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:49.975+0000 7fbb4b7fe640 1 -- 172.21.15.40:0/3468848104 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5177+0+0 (secure 0 0 0) 0x7fbb4c089930 con 0x7fbb5409b1f0 2023-12-17T11:49:49.976 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:49.975+0000 7fbb52d9d640 1 --2- 172.21.15.40:0/3468848104 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7fbb3406ae40 0x7fbb3406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:49.977 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:49.976+0000 7fbb52d9d640 1 --2- 172.21.15.40:0/3468848104 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7fbb3406ae40 0x7fbb3406d300 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fbb44035000 tx=0x7fbb44005040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:49:49.979 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:49.979+0000 7fbb4b7fe640 1 -- 172.21.15.40:0/3468848104 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fbb5409aa90 con 0x7fbb5409b1f0 2023-12-17T11:49:50.175 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:50.174+0000 7fbb58977640 1 -- 172.21.15.40:0/3468848104 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fbb5409aa90 con 0x7fbb5409b1f0 2023-12-17T11:49:51.181 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:51.180+0000 7fbb4b7fe640 1 -- 172.21.15.40:0/3468848104 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v37) v1 ==== 138+0+0 (secure 0 0 0) 0x7fbb5409aa90 con 0x7fbb5409b1f0 2023-12-17T11:49:51.181 INFO:teuthology.orchestra.run.smithi040.stderr:pool 'cephfs_metadata' created 2023-12-17T11:49:51.185 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:51.184+0000 7fbb58977640 1 -- 172.21.15.40:0/3468848104 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7fbb3406ae40 msgr2=0x7fbb3406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:51.185 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:51.184+0000 7fbb58977640 1 --2- 172.21.15.40:0/3468848104 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7fbb3406ae40 0x7fbb3406d300 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fbb44035000 tx=0x7fbb44005040 comp rx=0 tx=0).stop 2023-12-17T11:49:51.185 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:51.184+0000 7fbb58977640 1 -- 172.21.15.40:0/3468848104 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbb5409b1f0 msgr2=0x7fbb54158df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:51.186 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:51.184+0000 7fbb58977640 1 --2- 172.21.15.40:0/3468848104 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbb5409b1f0 0x7fbb54158df0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fbb540cdd60 tx=0x7fbb4c010590 comp rx=0 tx=0).stop 2023-12-17T11:49:51.186 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:51.184+0000 7fbb58977640 1 -- 172.21.15.40:0/3468848104 shutdown_connections 2023-12-17T11:49:51.186 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:51.184+0000 7fbb58977640 1 --2- 172.21.15.40:0/3468848104 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7fbb3406ae40 0x7fbb3406d300 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:51.186 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:51.184+0000 7fbb58977640 1 --2- 172.21.15.40:0/3468848104 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbb5409b1f0 0x7fbb54158df0 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:51.186 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:51.184+0000 7fbb58977640 1 --2- 172.21.15.40:0/3468848104 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fbb5409ad70 0x7fbb541588b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:51.186 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:51.184+0000 7fbb58977640 1 --2- 172.21.15.40:0/3468848104 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbb40005bb0 0x7fbb540cb4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:51.186 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:51.184+0000 7fbb58977640 1 -- 172.21.15.40:0/3468848104 >> 172.21.15.40:0/3468848104 conn(0x7fbb5406a880 msgr2=0x7fbb540aff00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:49:51.186 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:51.184+0000 7fbb58977640 1 -- 172.21.15.40:0/3468848104 shutdown_connections 2023-12-17T11:49:51.186 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:51.184+0000 7fbb58977640 1 -- 172.21.15.40:0/3468848104 wait complete. 2023-12-17T11:49:51.213 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-12-17T11:49:51.431 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:51.430+0000 7fe129610640 1 Processor -- start 2023-12-17T11:49:51.431 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:51.430+0000 7fe129610640 1 -- start start 2023-12-17T11:49:51.433 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:51.432+0000 7fe129610640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fe1240cf9a0 0x7fe124159500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:51.433 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:51.432+0000 7fe129610640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe12415a870 con 0x7fe1240b2940 2023-12-17T11:49:51.433 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:51.432+0000 7fe129610640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1240b22c0 con 0x7fe12406e220 2023-12-17T11:49:51.433 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:51.432+0000 7fe129610640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1240713d0 con 0x7fe1240cf9a0 2023-12-17T11:49:51.435 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:51.433+0000 7fe1237fe640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fe1240b2940 0x7fe1240b2dd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:44648/0 (socket says 172.21.15.40:44648) 2023-12-17T11:49:51.435 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:51.433+0000 7fe1237fe640 1 -- 172.21.15.40:0/2643755501 learned_addr learned my addr 172.21.15.40:0/2643755501 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-12-17T11:49:51.436 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:51.433+0000 7fe11a7fc640 1 --2- 172.21.15.40:0/2643755501 >> v2:172.21.15.40:3300/0 conn(0x7fe1240cf9a0 0x7fe124159500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:51.436 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:51.434+0000 7fe1227fc640 1 -- 172.21.15.40:0/2643755501 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 782756846 0 0) 0x7fe12415a870 con 0x7fe1240b2940 2023-12-17T11:49:51.436 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:51.434+0000 7fe1227fc640 1 -- 172.21.15.40:0/2643755501 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe110003520 con 0x7fe1240b2940 2023-12-17T11:49:51.436 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:51.434+0000 7fe1227fc640 1 -- 172.21.15.40:0/2643755501 <== mon.1 v1:172.21.15.159:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3635221585 0 0) 0x7fe1240b22c0 con 0x7fe12406e220 2023-12-17T11:49:51.436 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:51.434+0000 7fe1227fc640 1 -- 172.21.15.40:0/2643755501 --> v1:172.21.15.159:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe12415a870 con 0x7fe12406e220 2023-12-17T11:49:51.436 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:51.434+0000 7fe1227fc640 1 -- 172.21.15.40:0/2643755501 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1358768804 0 0) 0x7fe110003520 con 0x7fe1240b2940 2023-12-17T11:49:51.436 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:51.434+0000 7fe1227fc640 1 -- 172.21.15.40:0/2643755501 >> v2:172.21.15.40:3300/0 conn(0x7fe1240cf9a0 msgr2=0x7fe124159500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:49:51.436 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:51.434+0000 7fe1227fc640 1 --2- 172.21.15.40:0/2643755501 >> v2:172.21.15.40:3300/0 conn(0x7fe1240cf9a0 0x7fe124159500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:51.436 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:51.434+0000 7fe1227fc640 1 -- 172.21.15.40:0/2643755501 >> v1:172.21.15.159:6789/0 conn(0x7fe12406e220 legacy=0x7fe1240cf290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:51.436 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:51.434+0000 7fe1227fc640 1 -- 172.21.15.40:0/2643755501 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe124159c60 con 0x7fe1240b2940 2023-12-17T11:49:51.437 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:51.434+0000 7fe1227fc640 1 -- 172.21.15.40:0/2643755501 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2643242555 0 0) 0x7fe11c001670 con 0x7fe1240b2940 2023-12-17T11:49:51.437 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:51.434+0000 7fe1227fc640 1 -- 172.21.15.40:0/2643755501 >> v1:172.21.15.40:6789/0 conn(0x7fe1240b2940 legacy=0x7fe1240b2dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:51.437 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:51.434+0000 7fe1227fc640 1 --2- 172.21.15.40:0/2643755501 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe110003b50 0x7fe110003f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:51.437 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:51.434+0000 7fe1227fc640 1 --2- 172.21.15.40:0/2643755501 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe1100047c0 0x7fe110004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:51.437 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:51.434+0000 7fe1227fc640 1 --2- 172.21.15.40:0/2643755501 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe110005180 0x7fe11000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:51.437 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:51.434+0000 7fe1227fc640 1 -- 172.21.15.40:0/2643755501 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1240713d0 con 0x7fe110005180 2023-12-17T11:49:51.437 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:51.434+0000 7fe1227fc640 1 -- 172.21.15.40:0/2643755501 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe11000c050 con 0x7fe1100047c0 2023-12-17T11:49:51.437 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:51.434+0000 7fe1227fc640 1 -- 172.21.15.40:0/2643755501 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe11000c210 con 0x7fe110003b50 2023-12-17T11:49:51.438 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:51.435+0000 7fe122ffd640 1 --2- 172.21.15.40:0/2643755501 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe110003b50 0x7fe110003f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:51.438 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:51.435+0000 7fe11a7fc640 1 --2- 172.21.15.40:0/2643755501 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe1100047c0 0x7fe110004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:51.438 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:51.435+0000 7fe1237fe640 1 --2- 172.21.15.40:0/2643755501 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe110005180 0x7fe11000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:51.439 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:51.436+0000 7fe122ffd640 1 -- 172.21.15.40:0/2643755501 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe1100047c0 msgr2=0x7fe110004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:49:51.439 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:51.436+0000 7fe122ffd640 1 --2- 172.21.15.40:0/2643755501 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe1100047c0 0x7fe110004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:51.439 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:51.436+0000 7fe122ffd640 1 -- 172.21.15.40:0/2643755501 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe110005180 msgr2=0x7fe11000b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:49:51.439 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:51.436+0000 7fe122ffd640 1 --2- 172.21.15.40:0/2643755501 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe110005180 0x7fe11000b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:51.439 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:51.436+0000 7fe122ffd640 1 -- 172.21.15.40:0/2643755501 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe110003520 con 0x7fe110003b50 2023-12-17T11:49:51.439 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:51.436+0000 7fe1237fe640 1 --2- 172.21.15.40:0/2643755501 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe110005180 0x7fe11000b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-17T11:49:51.439 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:51.436+0000 7fe11a7fc640 1 --2- 172.21.15.40:0/2643755501 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe1100047c0 0x7fe110004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-17T11:49:51.439 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:51.436+0000 7fe1237fe640 1 -- 172.21.15.40:0/2643755501 reap_dead start 2023-12-17T11:49:51.439 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:51.437+0000 7fe122ffd640 1 --2- 172.21.15.40:0/2643755501 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe110003b50 0x7fe110003f50 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fe114001fd0 tx=0x7fe1100057f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=869080ded7b97163 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:49:51.440 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:51.438+0000 7fe1227fc640 1 -- 172.21.15.40:0/2643755501 <== mon.2 v2:172.21.15.159:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe114003b70 con 0x7fe110003b50 2023-12-17T11:49:51.440 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:51.438+0000 7fe1227fc640 1 -- 172.21.15.40:0/2643755501 <== mon.2 v2:172.21.15.159:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe114003cd0 con 0x7fe110003b50 2023-12-17T11:49:51.440 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:51.438+0000 7fe1227fc640 1 -- 172.21.15.40:0/2643755501 <== mon.2 v2:172.21.15.159:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1140052f0 con 0x7fe110003b50 2023-12-17T11:49:51.441 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:51.438+0000 7fe129610640 1 -- 172.21.15.40:0/2643755501 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe110003b50 msgr2=0x7fe110003f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:51.441 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:51.438+0000 7fe129610640 1 --2- 172.21.15.40:0/2643755501 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe110003b50 0x7fe110003f50 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fe114001fd0 tx=0x7fe1100057f0 comp rx=0 tx=0).stop 2023-12-17T11:49:51.441 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:51.439+0000 7fe129610640 1 -- 172.21.15.40:0/2643755501 shutdown_connections 2023-12-17T11:49:51.441 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:51.439+0000 7fe129610640 1 --2- 172.21.15.40:0/2643755501 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe110003b50 0x7fe110003f50 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:51.441 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:51.439+0000 7fe129610640 1 -- 172.21.15.40:0/2643755501 >> 172.21.15.40:0/2643755501 conn(0x7fe12406a880 msgr2=0x7fe12406ac90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:49:51.441 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:51.439+0000 7fe129610640 1 -- 172.21.15.40:0/2643755501 shutdown_connections 2023-12-17T11:49:51.441 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:51.439+0000 7fe129610640 1 -- 172.21.15.40:0/2643755501 wait complete. 2023-12-17T11:49:51.441 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:51.441+0000 7fe129610640 1 Processor -- start 2023-12-17T11:49:51.442 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:51.441+0000 7fe129610640 1 -- start start 2023-12-17T11:49:51.444 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:51.442+0000 7fe129610640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe110003b50 0x7fe1241dffe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:51.444 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:51.442+0000 7fe129610640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe1240b0b60 0x7fe1240b0fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:51.444 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:51.442+0000 7fe129610640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe12413deb0 0x7fe12413e330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:51.444 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:51.442+0000 7fe129610640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1241418e0 con 0x7fe1240b0b60 2023-12-17T11:49:51.444 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:51.442+0000 7fe129610640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1240af3d0 con 0x7fe110003b50 2023-12-17T11:49:51.445 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:51.442+0000 7fe129610640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe124140cb0 con 0x7fe12413deb0 2023-12-17T11:49:51.445 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:51.442+0000 7fe11a7fc640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe1240b0b60 0x7fe1240b0fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:51.445 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:51.442+0000 7fe11a7fc640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe1240b0b60 0x7fe1240b0fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:42710/0 (socket says 172.21.15.40:42710) 2023-12-17T11:49:51.445 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:51.442+0000 7fe11a7fc640 1 -- 172.21.15.40:0/151897160 learned_addr learned my addr 172.21.15.40:0/151897160 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-17T11:49:51.445 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:51.443+0000 7fe1237fe640 1 --2- 172.21.15.40:0/151897160 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe12413deb0 0x7fe12413e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:51.445 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:51.443+0000 7fe122ffd640 1 --2- 172.21.15.40:0/151897160 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe110003b50 0x7fe1241dffe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:51.445 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:51.443+0000 7fe11a7fc640 1 -- 172.21.15.40:0/151897160 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe12413deb0 msgr2=0x7fe12413e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:51.445 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:51.443+0000 7fe11a7fc640 1 --2- 172.21.15.40:0/151897160 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe12413deb0 0x7fe12413e330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:51.445 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:51.443+0000 7fe11a7fc640 1 -- 172.21.15.40:0/151897160 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe110003b50 msgr2=0x7fe1241dffe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:51.445 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:51.443+0000 7fe11a7fc640 1 --2- 172.21.15.40:0/151897160 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe110003b50 0x7fe1241dffe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:51.445 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:51.443+0000 7fe11a7fc640 1 -- 172.21.15.40:0/151897160 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe124140f40 con 0x7fe1240b0b60 2023-12-17T11:49:51.445 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:51.443+0000 7fe1237fe640 1 --2- 172.21.15.40:0/151897160 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe12413deb0 0x7fe12413e330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-17T11:49:51.445 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:51.443+0000 7fe11a7fc640 1 --2- 172.21.15.40:0/151897160 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe1240b0b60 0x7fe1240b0fe0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7fe10c0106e0 tx=0x7fe10c010ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:49:51.446 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:51.443+0000 7fe11bfff640 1 -- 172.21.15.40:0/151897160 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe10c00ecc0 con 0x7fe1240b0b60 2023-12-17T11:49:51.446 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:51.443+0000 7fe11bfff640 1 -- 172.21.15.40:0/151897160 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe10c00ee20 con 0x7fe1240b0b60 2023-12-17T11:49:51.446 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:51.443+0000 7fe11bfff640 1 -- 172.21.15.40:0/151897160 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe10c012670 con 0x7fe1240b0b60 2023-12-17T11:49:51.446 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:51.443+0000 7fe129610640 1 -- 172.21.15.40:0/151897160 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe124141220 con 0x7fe1240b0b60 2023-12-17T11:49:51.446 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:51.444+0000 7fe129610640 1 -- 172.21.15.40:0/151897160 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1240b1520 con 0x7fe1240b0b60 2023-12-17T11:49:51.446 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:51.445+0000 7fe129610640 1 -- 172.21.15.40:0/151897160 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe124141a20 con 0x7fe1240b0b60 2023-12-17T11:49:51.447 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:51.446+0000 7fe11bfff640 1 -- 172.21.15.40:0/151897160 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fe10c0127d0 con 0x7fe1240b0b60 2023-12-17T11:49:51.448 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:51.447+0000 7fe11bfff640 1 --2- 172.21.15.40:0/151897160 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7fe10406ae70 0x7fe10406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:51.448 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:51.447+0000 7fe11bfff640 1 -- 172.21.15.40:0/151897160 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5547+0+0 (secure 0 0 0) 0x7fe10c016070 con 0x7fe1240b0b60 2023-12-17T11:49:51.448 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:51.448+0000 7fe122ffd640 1 --2- 172.21.15.40:0/151897160 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7fe10406ae70 0x7fe10406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:51.449 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:51.449+0000 7fe122ffd640 1 --2- 172.21.15.40:0/151897160 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7fe10406ae70 0x7fe10406d330 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fe114034000 tx=0x7fe114009030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:49:51.452 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:51.452+0000 7fe11bfff640 1 -- 172.21.15.40:0/151897160 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fe124141a20 con 0x7fe1240b0b60 2023-12-17T11:49:51.649 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:51.648+0000 7fe129610640 1 -- 172.21.15.40:0/151897160 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fe124141a20 con 0x7fe1240b0b60 2023-12-17T11:49:52.188 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:52.186+0000 7fe11bfff640 1 -- 172.21.15.40:0/151897160 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v38) v1 ==== 170+0+0 (secure 0 0 0) 0x7fe124141a20 con 0x7fe1240b0b60 2023-12-17T11:49:52.188 INFO:teuthology.orchestra.run.smithi040.stderr:pool 'cephfs_data' created 2023-12-17T11:49:52.191 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:52.190+0000 7fe129610640 1 -- 172.21.15.40:0/151897160 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7fe10406ae70 msgr2=0x7fe10406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:52.192 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:52.190+0000 7fe129610640 1 --2- 172.21.15.40:0/151897160 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7fe10406ae70 0x7fe10406d330 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fe114034000 tx=0x7fe114009030 comp rx=0 tx=0).stop 2023-12-17T11:49:52.192 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:52.190+0000 7fe129610640 1 -- 172.21.15.40:0/151897160 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe1240b0b60 msgr2=0x7fe1240b0fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:52.192 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:52.190+0000 7fe129610640 1 --2- 172.21.15.40:0/151897160 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe1240b0b60 0x7fe1240b0fe0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7fe10c0106e0 tx=0x7fe10c010ba0 comp rx=0 tx=0).stop 2023-12-17T11:49:52.193 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:52.191+0000 7fe129610640 1 -- 172.21.15.40:0/151897160 shutdown_connections 2023-12-17T11:49:52.193 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:52.191+0000 7fe129610640 1 --2- 172.21.15.40:0/151897160 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7fe10406ae70 0x7fe10406d330 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:52.193 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:52.191+0000 7fe129610640 1 --2- 172.21.15.40:0/151897160 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe12413deb0 0x7fe12413e330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:52.193 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:52.191+0000 7fe129610640 1 --2- 172.21.15.40:0/151897160 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe1240b0b60 0x7fe1240b0fe0 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:52.193 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:52.191+0000 7fe129610640 1 --2- 172.21.15.40:0/151897160 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe110003b50 0x7fe1241dffe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:52.193 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:52.191+0000 7fe129610640 1 -- 172.21.15.40:0/151897160 >> 172.21.15.40:0/151897160 conn(0x7fe12406a880 msgr2=0x7fe1240b36d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:49:52.193 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:52.191+0000 7fe129610640 1 -- 172.21.15.40:0/151897160 shutdown_connections 2023-12-17T11:49:52.193 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:52.191+0000 7fe129610640 1 -- 172.21.15.40:0/151897160 wait complete. 2023-12-17T11:49:52.222 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-12-17T11:49:52.420 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:52.418+0000 7f7845368640 1 Processor -- start 2023-12-17T11:49:52.420 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:52.419+0000 7f7845368640 1 -- start start 2023-12-17T11:49:52.422 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:52.421+0000 7f7845368640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f7840144420 0x7f784006a460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:52.422 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:52.421+0000 7f7845368640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f78400cd4a0 0x7f784006a9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:52.422 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:52.421+0000 7f7845368640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7840144800 con 0x7f78401449d0 2023-12-17T11:49:52.422 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:52.421+0000 7f7845368640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f784015f600 con 0x7f78400cd4a0 2023-12-17T11:49:52.422 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:52.421+0000 7f7845368640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f784015ed10 con 0x7f7840144420 2023-12-17T11:49:52.423 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:52.421+0000 7f78367fc640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f78400cd4a0 0x7f784006a9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:52.423 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:52.421+0000 7f78367fc640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f78400cd4a0 0x7f784006a9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:42714/0 (socket says 172.21.15.40:42714) 2023-12-17T11:49:52.423 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:52.421+0000 7f78367fc640 1 -- 172.21.15.40:0/1082669524 learned_addr learned my addr 172.21.15.40:0/1082669524 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-17T11:49:52.423 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:52.421+0000 7f783effd640 1 --2- 172.21.15.40:0/1082669524 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f7840144420 0x7f784006a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:52.423 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:52.422+0000 7f78367fc640 1 -- 172.21.15.40:0/1082669524 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f7840144420 msgr2=0x7f784006a460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:49:52.423 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:52.422+0000 7f78367fc640 1 --2- 172.21.15.40:0/1082669524 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f7840144420 0x7f784006a460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:52.423 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:52.422+0000 7f78367fc640 1 -- 172.21.15.40:0/1082669524 >> v1:172.21.15.159:6789/0 conn(0x7f78401449d0 legacy=0x7f784015b710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:52.423 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:52.422+0000 7f78367fc640 1 -- 172.21.15.40:0/1082669524 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78400b3320 con 0x7f78400cd4a0 2023-12-17T11:49:52.424 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:52.423+0000 7f78367fc640 1 --2- 172.21.15.40:0/1082669524 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f78400cd4a0 0x7f784006a9a0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f7828009870 tx=0x7f782802b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d71c34c99d3efa6 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:49:52.424 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:52.423+0000 7f783e7fc640 1 -- 172.21.15.40:0/1082669524 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7828031640 con 0x7f78400cd4a0 2023-12-17T11:49:52.424 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:52.423+0000 7f783e7fc640 1 -- 172.21.15.40:0/1082669524 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78280317a0 con 0x7f78400cd4a0 2023-12-17T11:49:52.424 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:52.423+0000 7f783e7fc640 1 -- 172.21.15.40:0/1082669524 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7828031b30 con 0x7f78400cd4a0 2023-12-17T11:49:52.425 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:52.424+0000 7f7845368640 1 -- 172.21.15.40:0/1082669524 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f78400cd4a0 msgr2=0x7f784006a9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:52.425 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:52.424+0000 7f7845368640 1 --2- 172.21.15.40:0/1082669524 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f78400cd4a0 0x7f784006a9a0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f7828009870 tx=0x7f782802b8f0 comp rx=0 tx=0).stop 2023-12-17T11:49:52.425 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:52.424+0000 7f7845368640 1 -- 172.21.15.40:0/1082669524 shutdown_connections 2023-12-17T11:49:52.425 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:52.424+0000 7f7845368640 1 --2- 172.21.15.40:0/1082669524 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f78400cd4a0 0x7f784006a9a0 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:52.425 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:52.424+0000 7f7845368640 1 --2- 172.21.15.40:0/1082669524 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f7840144420 0x7f784006a460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:52.425 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:52.424+0000 7f7845368640 1 -- 172.21.15.40:0/1082669524 >> 172.21.15.40:0/1082669524 conn(0x7f78400cc9b0 msgr2=0x7f78400ccd90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:49:52.426 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:52.424+0000 7f7845368640 1 -- 172.21.15.40:0/1082669524 shutdown_connections 2023-12-17T11:49:52.426 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:52.425+0000 7f7845368640 1 -- 172.21.15.40:0/1082669524 wait complete. 2023-12-17T11:49:52.427 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:52.426+0000 7f7845368640 1 Processor -- start 2023-12-17T11:49:52.427 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:52.427+0000 7f7845368640 1 -- start start 2023-12-17T11:49:52.429 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:52.428+0000 7f7845368640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f78400cd4a0 0x7f78401e4c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:52.429 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:52.428+0000 7f7845368640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7840144420 0x7f784015a340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:52.429 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:52.428+0000 7f7845368640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f78401449d0 0x7f784015a880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:52.429 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:52.428+0000 7f7845368640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78400ac980 con 0x7f78400cd4a0 2023-12-17T11:49:52.429 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:52.428+0000 7f7845368640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78400acc60 con 0x7f7840144420 2023-12-17T11:49:52.429 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:52.428+0000 7f7845368640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78400acf40 con 0x7f78401449d0 2023-12-17T11:49:52.429 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:52.428+0000 7f783effd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f78400cd4a0 0x7f78401e4c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:52.429 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:52.428+0000 7f783effd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f78400cd4a0 0x7f78401e4c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:42716/0 (socket says 172.21.15.40:42716) 2023-12-17T11:49:52.429 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:52.428+0000 7f783effd640 1 -- 172.21.15.40:0/3722719878 learned_addr learned my addr 172.21.15.40:0/3722719878 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-17T11:49:52.430 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:52.428+0000 7f783effd640 1 -- 172.21.15.40:0/3722719878 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f78401449d0 msgr2=0x7f784015a880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:52.430 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:52.428+0000 7f783effd640 1 --2- 172.21.15.40:0/3722719878 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f78401449d0 0x7f784015a880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:52.431 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:52.428+0000 7f783effd640 1 -- 172.21.15.40:0/3722719878 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7840144420 msgr2=0x7f784015a340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:52.431 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:52.428+0000 7f783effd640 1 --2- 172.21.15.40:0/3722719878 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7840144420 0x7f784015a340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:52.431 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:52.428+0000 7f783effd640 1 -- 172.21.15.40:0/3722719878 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78280094d0 con 0x7f78400cd4a0 2023-12-17T11:49:52.431 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:52.429+0000 7f783effd640 1 --2- 172.21.15.40:0/3722719878 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f78400cd4a0 0x7f78401e4c20 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f7830007e60 tx=0x7f783000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:49:52.431 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:52.429+0000 7f7837fff640 1 -- 172.21.15.40:0/3722719878 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7830014620 con 0x7f78400cd4a0 2023-12-17T11:49:52.431 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:52.429+0000 7f7837fff640 1 -- 172.21.15.40:0/3722719878 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f783000ee90 con 0x7f78400cd4a0 2023-12-17T11:49:52.431 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:52.429+0000 7f7837fff640 1 -- 172.21.15.40:0/3722719878 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78300149c0 con 0x7f78400cd4a0 2023-12-17T11:49:52.431 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:52.429+0000 7f7845368640 1 -- 172.21.15.40:0/3722719878 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78400ad220 con 0x7f78400cd4a0 2023-12-17T11:49:52.431 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:52.429+0000 7f7845368640 1 -- 172.21.15.40:0/3722719878 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78401e5160 con 0x7f78400cd4a0 2023-12-17T11:49:52.431 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:52.430+0000 7f7845368640 1 -- 172.21.15.40:0/3722719878 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78401e5350 con 0x7f78400cd4a0 2023-12-17T11:49:52.433 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:52.432+0000 7f7837fff640 1 -- 172.21.15.40:0/3722719878 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f7830014b20 con 0x7f78400cd4a0 2023-12-17T11:49:52.434 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:52.433+0000 7f7837fff640 1 --2- 172.21.15.40:0/3722719878 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f782006ae40 0x7f782006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:52.434 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:52.433+0000 7f7837fff640 1 -- 172.21.15.40:0/3722719878 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 5929+0+0 (secure 0 0 0) 0x7f783008af90 con 0x7f78400cd4a0 2023-12-17T11:49:52.434 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:52.434+0000 7f78367fc640 1 --2- 172.21.15.40:0/3722719878 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f782006ae40 0x7f782006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:52.435 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:52.435+0000 7f78367fc640 1 --2- 172.21.15.40:0/3722719878 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f782006ae40 0x7f782006d300 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f7828036000 tx=0x7f7828030000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:49:52.438 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:52.437+0000 7f7837fff640 1 -- 172.21.15.40:0/3722719878 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f7830055fb0 con 0x7f78400cd4a0 2023-12-17T11:49:52.674 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:52.672+0000 7f7845368640 1 -- 172.21.15.40:0/3722719878 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f78400ad740 con 0x7f78400cd4a0 2023-12-17T11:49:53.210 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:53.208+0000 7f7837fff640 1 -- 172.21.15.40:0/3722719878 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 5 and data pool 6 v12) v1 ==== 172+0+0 (secure 0 0 0) 0x7f78400ad740 con 0x7f78400cd4a0 2023-12-17T11:49:53.210 INFO:teuthology.orchestra.run.smithi040.stderr:new fs with metadata pool 5 and data pool 6 2023-12-17T11:49:53.213 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:53.211+0000 7f7845368640 1 -- 172.21.15.40:0/3722719878 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f782006ae40 msgr2=0x7f782006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:53.213 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:53.211+0000 7f7845368640 1 --2- 172.21.15.40:0/3722719878 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f782006ae40 0x7f782006d300 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f7828036000 tx=0x7f7828030000 comp rx=0 tx=0).stop 2023-12-17T11:49:53.213 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:53.211+0000 7f7845368640 1 -- 172.21.15.40:0/3722719878 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f78400cd4a0 msgr2=0x7f78401e4c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:53.213 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:53.211+0000 7f7845368640 1 --2- 172.21.15.40:0/3722719878 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f78400cd4a0 0x7f78401e4c20 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f7830007e60 tx=0x7f783000e4b0 comp rx=0 tx=0).stop 2023-12-17T11:49:53.214 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:53.211+0000 7f7845368640 1 -- 172.21.15.40:0/3722719878 shutdown_connections 2023-12-17T11:49:53.214 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:53.211+0000 7f7845368640 1 --2- 172.21.15.40:0/3722719878 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f782006ae40 0x7f782006d300 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:53.214 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:53.211+0000 7f7845368640 1 --2- 172.21.15.40:0/3722719878 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f78401449d0 0x7f784015a880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:53.214 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:53.211+0000 7f7845368640 1 --2- 172.21.15.40:0/3722719878 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7840144420 0x7f784015a340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:53.214 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:53.211+0000 7f7845368640 1 --2- 172.21.15.40:0/3722719878 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f78400cd4a0 0x7f78401e4c20 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:53.214 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:53.211+0000 7f7845368640 1 -- 172.21.15.40:0/3722719878 >> 172.21.15.40:0/3722719878 conn(0x7f78400cc9b0 msgr2=0x7f7840142d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:49:53.214 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:53.212+0000 7f7845368640 1 -- 172.21.15.40:0/3722719878 shutdown_connections 2023-12-17T11:49:53.214 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:53.212+0000 7f7845368640 1 -- 172.21.15.40:0/3722719878 wait complete. 2023-12-17T11:49:53.249 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-17T11:49:53.440 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:53.438+0000 7fb539627640 1 Processor -- start 2023-12-17T11:49:53.440 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:53.438+0000 7fb539627640 1 -- start start 2023-12-17T11:49:53.441 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:53.439+0000 7fb539627640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb5340ce5b0 0x7fb5340d0d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:53.441 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:53.439+0000 7fb539627640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fb5340b0760 0x7fb5340b0bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:53.441 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:53.439+0000 7fb539627640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5340b2280 con 0x7fb5340d13c0 2023-12-17T11:49:53.441 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:53.439+0000 7fb539627640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5340cee70 con 0x7fb5340b0760 2023-12-17T11:49:53.441 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:53.439+0000 7fb539627640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5340ceb90 con 0x7fb5340ce5b0 2023-12-17T11:49:53.442 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:53.440+0000 7fb538e26640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fb5340b0760 0x7fb5340b0bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:53.442 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:53.440+0000 7fb538e26640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fb5340b0760 0x7fb5340b0bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:42730/0 (socket says 172.21.15.40:42730) 2023-12-17T11:49:53.443 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:53.440+0000 7fb538e26640 1 -- 172.21.15.40:0/564661007 learned_addr learned my addr 172.21.15.40:0/564661007 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-17T11:49:53.443 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:53.440+0000 7fb52b7fe640 1 --2- 172.21.15.40:0/564661007 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb5340ce5b0 0x7fb5340d0d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:53.443 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:53.440+0000 7fb538e26640 1 -- 172.21.15.40:0/564661007 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb5340ce5b0 msgr2=0x7fb5340d0d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:49:53.443 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:53.440+0000 7fb538e26640 1 --2- 172.21.15.40:0/564661007 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb5340ce5b0 0x7fb5340d0d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:53.443 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:53.440+0000 7fb538e26640 1 -- 172.21.15.40:0/564661007 >> v1:172.21.15.159:6789/0 conn(0x7fb5340d13c0 legacy=0x7fb5340d17a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:53.443 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:53.440+0000 7fb538e26640 1 -- 172.21.15.40:0/564661007 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5340afc80 con 0x7fb5340b0760 2023-12-17T11:49:53.443 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:53.441+0000 7fb538e26640 1 --2- 172.21.15.40:0/564661007 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb5340b0760 0x7fb5340b0bf0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7fb52c009870 tx=0x7fb52c02b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b00074019b810ea8 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:49:53.444 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:53.442+0000 7fb5337fe640 1 -- 172.21.15.40:0/564661007 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb52c031640 con 0x7fb5340b0760 2023-12-17T11:49:53.444 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:53.442+0000 7fb5337fe640 1 -- 172.21.15.40:0/564661007 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb52c0317a0 con 0x7fb5340b0760 2023-12-17T11:49:53.444 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:53.442+0000 7fb5337fe640 1 -- 172.21.15.40:0/564661007 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb52c031b30 con 0x7fb5340b0760 2023-12-17T11:49:53.444 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:53.442+0000 7fb539627640 1 -- 172.21.15.40:0/564661007 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb5340b0760 msgr2=0x7fb5340b0bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:53.445 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:53.442+0000 7fb539627640 1 --2- 172.21.15.40:0/564661007 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb5340b0760 0x7fb5340b0bf0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7fb52c009870 tx=0x7fb52c02b8f0 comp rx=0 tx=0).stop 2023-12-17T11:49:53.445 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:53.442+0000 7fb539627640 1 -- 172.21.15.40:0/564661007 shutdown_connections 2023-12-17T11:49:53.445 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:53.442+0000 7fb539627640 1 --2- 172.21.15.40:0/564661007 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb5340b0760 0x7fb5340b0bf0 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:53.445 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:53.442+0000 7fb539627640 1 --2- 172.21.15.40:0/564661007 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb5340ce5b0 0x7fb5340d0d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:53.445 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:53.442+0000 7fb539627640 1 -- 172.21.15.40:0/564661007 >> 172.21.15.40:0/564661007 conn(0x7fb53409c260 msgr2=0x7fb5340d2f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:49:53.445 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:53.443+0000 7fb539627640 1 -- 172.21.15.40:0/564661007 shutdown_connections 2023-12-17T11:49:53.445 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:53.443+0000 7fb539627640 1 -- 172.21.15.40:0/564661007 wait complete. 2023-12-17T11:49:53.446 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:53.444+0000 7fb539627640 1 Processor -- start 2023-12-17T11:49:53.446 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:53.444+0000 7fb539627640 1 -- start start 2023-12-17T11:49:53.450 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:53.445+0000 7fb539627640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb5340b0760 0x7fb5340c79a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:53.450 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:53.445+0000 7fb539627640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb5340ce5b0 0x7fb5340b7bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:53.450 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:53.446+0000 7fb539627640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb5340d13c0 0x7fb5340b80f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:53.450 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:53.446+0000 7fb539627640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5340c8fb0 con 0x7fb5340d13c0 2023-12-17T11:49:53.451 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:53.446+0000 7fb539627640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5340c93d0 con 0x7fb5340ce5b0 2023-12-17T11:49:53.451 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:53.446+0000 7fb539627640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5340c8330 con 0x7fb5340b0760 2023-12-17T11:49:53.451 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:53.446+0000 7fb538e26640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb5340d13c0 0x7fb5340b80f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:53.451 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:53.446+0000 7fb538e26640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb5340d13c0 0x7fb5340b80f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:42734/0 (socket says 172.21.15.40:42734) 2023-12-17T11:49:53.451 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:53.446+0000 7fb538e26640 1 -- 172.21.15.40:0/649265327 learned_addr learned my addr 172.21.15.40:0/649265327 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-17T11:49:53.451 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:53.446+0000 7fb52b7fe640 1 --2- 172.21.15.40:0/649265327 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb5340ce5b0 0x7fb5340b7bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:53.451 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:53.446+0000 7fb538e26640 1 -- 172.21.15.40:0/649265327 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb5340b0760 msgr2=0x7fb5340c79a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:53.451 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:53.446+0000 7fb533fff640 1 --2- 172.21.15.40:0/649265327 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb5340b0760 0x7fb5340c79a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:53.451 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:53.446+0000 7fb538e26640 1 --2- 172.21.15.40:0/649265327 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb5340b0760 0x7fb5340c79a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:53.451 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:53.446+0000 7fb538e26640 1 -- 172.21.15.40:0/649265327 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb5340ce5b0 msgr2=0x7fb5340b7bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:53.451 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:53.446+0000 7fb538e26640 1 --2- 172.21.15.40:0/649265327 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb5340ce5b0 0x7fb5340b7bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:53.451 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:53.446+0000 7fb538e26640 1 -- 172.21.15.40:0/649265327 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb52c0094d0 con 0x7fb5340d13c0 2023-12-17T11:49:53.451 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:53.446+0000 7fb52b7fe640 1 --2- 172.21.15.40:0/649265327 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb5340ce5b0 0x7fb5340b7bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-17T11:49:53.452 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:53.447+0000 7fb538e26640 1 --2- 172.21.15.40:0/649265327 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb5340d13c0 0x7fb5340b80f0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7fb52c009870 tx=0x7fb52c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:49:53.452 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:53.447+0000 7fb5317fa640 1 -- 172.21.15.40:0/649265327 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb52c03a930 con 0x7fb5340d13c0 2023-12-17T11:49:53.452 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:53.447+0000 7fb5317fa640 1 -- 172.21.15.40:0/649265327 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb52c03aab0 con 0x7fb5340d13c0 2023-12-17T11:49:53.452 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:53.447+0000 7fb5317fa640 1 -- 172.21.15.40:0/649265327 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb52c03ae60 con 0x7fb5340d13c0 2023-12-17T11:49:53.452 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:53.447+0000 7fb539627640 1 -- 172.21.15.40:0/649265327 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5340c8610 con 0x7fb5340d13c0 2023-12-17T11:49:53.452 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:53.447+0000 7fb539627640 1 -- 172.21.15.40:0/649265327 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5340c8bd0 con 0x7fb5340d13c0 2023-12-17T11:49:53.453 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:53.449+0000 7fb539627640 1 -- 172.21.15.40:0/649265327 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5340c90f0 con 0x7fb5340d13c0 2023-12-17T11:49:53.453 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:53.450+0000 7fb5317fa640 1 -- 172.21.15.40:0/649265327 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fb52c02f050 con 0x7fb5340d13c0 2023-12-17T11:49:53.453 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:53.450+0000 7fb5317fa640 1 --2- 172.21.15.40:0/649265327 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7fb51406ae40 0x7fb51406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:53.453 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:53.451+0000 7fb5317fa640 1 -- 172.21.15.40:0/649265327 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fb52c0ab620 con 0x7fb5340d13c0 2023-12-17T11:49:53.453 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:53.451+0000 7fb533fff640 1 --2- 172.21.15.40:0/649265327 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7fb51406ae40 0x7fb51406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:53.454 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:53.452+0000 7fb533fff640 1 --2- 172.21.15.40:0/649265327 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7fb51406ae40 0x7fb51406d300 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fb524007fd0 tx=0x7fb524009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:49:53.457 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:53.455+0000 7fb5317fa640 1 -- 172.21.15.40:0/649265327 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fb5340c90f0 con 0x7fb5340d13c0 2023-12-17T11:49:53.653 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:53.651+0000 7fb539627640 1 -- 172.21.15.40:0/649265327 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb5340c90f0 con 0x7fb5340d13c0 2023-12-17T11:49:53.655 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:53.654+0000 7fb5317fa640 1 -- 172.21.15.40:0/649265327 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v39) v1 ==== 74+0+16763 (secure 0 0 0) 0x7fb5340c90f0 con 0x7fb5340d13c0 2023-12-17T11:49:53.656 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T11:49:53.656 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":39,"fsid":"099cd35d-80d9-4ca4-8424-de13b3b03ac7","created":"2023-12-17T11:47:53.450097+0000","modified":"2023-12-17T11:49:52.674422+0000","last_up_change":"2023-12-17T11:48:05.724195+0000","last_in_change":"2023-12-17T11:47:56.956499+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-17T11:48:06.668943+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-12-17T11:49:50.228316+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-12-17T11:49:51.700776+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a88bfd46-63b8-48b1-9c0e-5c9cdc31bd38","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":555204741},{"type":"v1","addr":"172.21.15.40:6802","nonce":555204741}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":555204741},{"type":"v1","addr":"172.21.15.40:6807","nonce":555204741}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":555204741},{"type":"v1","addr":"172.21.15.40:6815","nonce":555204741}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6809","nonce":555204741},{"type":"v1","addr":"172.21.15.40:6812","nonce":555204741}]},"public_addr":"172.21.15.40:6802/555204741","cluster_addr":"172.21.15.40:6807/555204741","heartbeat_back_addr":"172.21.15.40:6815/555204741","heartbeat_front_addr":"172.21.15.40:6812/555204741","state":["exists","up"]},{"osd":1,"uuid":"c5d628ae-36f4-4866-802c-b162f0e90add","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6801","nonce":1221318112},{"type":"v1","addr":"172.21.15.40:6803","nonce":1221318112}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6805","nonce":1221318112},{"type":"v1","addr":"172.21.15.40:6806","nonce":1221318112}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6811","nonce":1221318112},{"type":"v1","addr":"172.21.15.40:6813","nonce":1221318112}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":1221318112},{"type":"v1","addr":"172.21.15.40:6810","nonce":1221318112}]},"public_addr":"172.21.15.40:6803/1221318112","cluster_addr":"172.21.15.40:6806/1221318112","heartbeat_back_addr":"172.21.15.40:6813/1221318112","heartbeat_front_addr":"172.21.15.40:6810/1221318112","state":["exists","up"]},{"osd":2,"uuid":"d986ad6a-af2f-47fc-9c3b-fbda27b82b73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":1959000265},{"type":"v1","addr":"172.21.15.40:6817","nonce":1959000265}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6818","nonce":1959000265},{"type":"v1","addr":"172.21.15.40:6819","nonce":1959000265}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":1959000265},{"type":"v1","addr":"172.21.15.40:6827","nonce":1959000265}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":1959000265},{"type":"v1","addr":"172.21.15.40:6822","nonce":1959000265}]},"public_addr":"172.21.15.40:6817/1959000265","cluster_addr":"172.21.15.40:6819/1959000265","heartbeat_back_addr":"172.21.15.40:6827/1959000265","heartbeat_front_addr":"172.21.15.40:6822/1959000265","state":["exists","up"]},{"osd":3,"uuid":"d79d22b7-be05-41b2-b95d-697db677fd02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6821","nonce":974040287},{"type":"v1","addr":"172.21.15.40:6823","nonce":974040287}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6825","nonce":974040287},{"type":"v1","addr":"172.21.15.40:6826","nonce":974040287}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":974040287},{"type":"v1","addr":"172.21.15.40:6831","nonce":974040287}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":974040287},{"type":"v1","addr":"172.21.15.40:6829","nonce":974040287}]},"public_addr":"172.21.15.40:6823/974040287","cluster_addr":"172.21.15.40:6826/974040287","heartbeat_back_addr":"172.21.15.40:6831/974040287","heartbeat_front_addr":"172.21.15.40:6829/974040287","state":["exists","up"]},{"osd":4,"uuid":"62a7a233-d3ea-40be-91de-180c0208d639","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6808","nonce":3937787733},{"type":"v1","addr":"172.21.15.159:6809","nonce":3937787733}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6810","nonce":3937787733},{"type":"v1","addr":"172.21.15.159:6811","nonce":3937787733}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6814","nonce":3937787733},{"type":"v1","addr":"172.21.15.159:6815","nonce":3937787733}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6812","nonce":3937787733},{"type":"v1","addr":"172.21.15.159:6813","nonce":3937787733}]},"public_addr":"172.21.15.159:6809/3937787733","cluster_addr":"172.21.15.159:6811/3937787733","heartbeat_back_addr":"172.21.15.159:6815/3937787733","heartbeat_front_addr":"172.21.15.159:6813/3937787733","state":["exists","up"]},{"osd":5,"uuid":"84629cea-dc0e-4b5e-b203-5ea963839281","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6816","nonce":3032505240},{"type":"v1","addr":"172.21.15.159:6817","nonce":3032505240}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6818","nonce":3032505240},{"type":"v1","addr":"172.21.15.159:6819","nonce":3032505240}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6822","nonce":3032505240},{"type":"v1","addr":"172.21.15.159:6823","nonce":3032505240}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6820","nonce":3032505240},{"type":"v1","addr":"172.21.15.159:6821","nonce":3032505240}]},"public_addr":"172.21.15.159:6817/3032505240","cluster_addr":"172.21.15.159:6819/3032505240","heartbeat_back_addr":"172.21.15.159:6823/3032505240","heartbeat_front_addr":"172.21.15.159:6821/3032505240","state":["exists","up"]},{"osd":6,"uuid":"4ae3af3a-1743-4070-a91d-8be5c31cdb04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6800","nonce":2411788597},{"type":"v1","addr":"172.21.15.159:6801","nonce":2411788597}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6802","nonce":2411788597},{"type":"v1","addr":"172.21.15.159:6803","nonce":2411788597}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6806","nonce":2411788597},{"type":"v1","addr":"172.21.15.159:6807","nonce":2411788597}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6804","nonce":2411788597},{"type":"v1","addr":"172.21.15.159:6805","nonce":2411788597}]},"public_addr":"172.21.15.159:6801/2411788597","cluster_addr":"172.21.15.159:6803/2411788597","heartbeat_back_addr":"172.21.15.159:6807/2411788597","heartbeat_front_addr":"172.21.15.159:6805/2411788597","state":["exists","up"]},{"osd":7,"uuid":"c1f4c7f2-8f75-4f95-bc63-a332773e3b8e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6824","nonce":478953349},{"type":"v1","addr":"172.21.15.159:6825","nonce":478953349}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6826","nonce":478953349},{"type":"v1","addr":"172.21.15.159:6827","nonce":478953349}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6830","nonce":478953349},{"type":"v1","addr":"172.21.15.159:6831","nonce":478953349}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6828","nonce":478953349},{"type":"v1","addr":"172.21.15.159:6829","nonce":478953349}]},"public_addr":"172.21.15.159:6825/478953349","cluster_addr":"172.21.15.159:6827/478953349","heartbeat_back_addr":"172.21.15.159:6831/478953349","heartbeat_front_addr":"172.21.15.159:6829/478953349","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T11:48:02.023567+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T11:48:02.278216+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T11:48:02.311843+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T11:48:01.773372+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T11:48:02.618910+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T11:48:02.361559+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T11:48:02.223997+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T11:48:02.604403+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-17T11:49:53.658 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:53.656+0000 7fb539627640 1 -- 172.21.15.40:0/649265327 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7fb51406ae40 msgr2=0x7fb51406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:53.659 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:53.656+0000 7fb539627640 1 --2- 172.21.15.40:0/649265327 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7fb51406ae40 0x7fb51406d300 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fb524007fd0 tx=0x7fb524009040 comp rx=0 tx=0).stop 2023-12-17T11:49:53.659 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:53.656+0000 7fb539627640 1 -- 172.21.15.40:0/649265327 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb5340d13c0 msgr2=0x7fb5340b80f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:53.659 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:53.656+0000 7fb539627640 1 --2- 172.21.15.40:0/649265327 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb5340d13c0 0x7fb5340b80f0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7fb52c009870 tx=0x7fb52c0046c0 comp rx=0 tx=0).stop 2023-12-17T11:49:53.659 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:53.656+0000 7fb539627640 1 -- 172.21.15.40:0/649265327 shutdown_connections 2023-12-17T11:49:53.659 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:53.656+0000 7fb539627640 1 --2- 172.21.15.40:0/649265327 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7fb51406ae40 0x7fb51406d300 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:53.659 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:53.656+0000 7fb539627640 1 --2- 172.21.15.40:0/649265327 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb5340d13c0 0x7fb5340b80f0 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:53.659 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:53.656+0000 7fb539627640 1 --2- 172.21.15.40:0/649265327 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb5340ce5b0 0x7fb5340b7bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:53.659 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:53.656+0000 7fb539627640 1 --2- 172.21.15.40:0/649265327 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb5340b0760 0x7fb5340c79a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:53.659 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:53.656+0000 7fb539627640 1 -- 172.21.15.40:0/649265327 >> 172.21.15.40:0/649265327 conn(0x7fb53409c260 msgr2=0x7fb5340b5fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:49:53.659 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:53.657+0000 7fb539627640 1 -- 172.21.15.40:0/649265327 shutdown_connections 2023-12-17T11:49:53.659 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:53.657+0000 7fb539627640 1 -- 172.21.15.40:0/649265327 wait complete. 2023-12-17T11:49:53.678 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-17T11:49:53.901 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:53.898+0000 7f25829e2640 1 Processor -- start 2023-12-17T11:49:53.901 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:53.899+0000 7f25829e2640 1 -- start start 2023-12-17T11:49:53.902 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:53.900+0000 7f25829e2640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f257c0ae200 0x7f257c070b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:53.902 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:53.900+0000 7f25829e2640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f257c071f90 con 0x7f257c0abd20 2023-12-17T11:49:53.903 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:53.900+0000 7f25829e2640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f257c072270 con 0x7f257c15e5d0 2023-12-17T11:49:53.903 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:53.900+0000 7f25829e2640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f257c070070 con 0x7f257c0ae200 2023-12-17T11:49:53.903 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:53.901+0000 7f25821e1640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f257c0abd20 0x7f257c0cded0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:44652/0 (socket says 172.21.15.40:44652) 2023-12-17T11:49:53.903 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:53.901+0000 7f25821e1640 1 -- 172.21.15.40:0/3689576935 learned_addr learned my addr 172.21.15.40:0/3689576935 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-12-17T11:49:53.903 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:53.901+0000 7f25811df640 1 --2- 172.21.15.40:0/3689576935 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f257c0ae200 0x7f257c070b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:53.904 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:53.902+0000 7f25809de640 1 -- 172.21.15.40:0/3689576935 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3287942113 0 0) 0x7f257c071f90 con 0x7f257c0abd20 2023-12-17T11:49:53.904 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:53.902+0000 7f25809de640 1 -- 172.21.15.40:0/3689576935 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2568003520 con 0x7f257c0abd20 2023-12-17T11:49:53.904 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:53.902+0000 7f25809de640 1 -- 172.21.15.40:0/3689576935 <== mon.1 v1:172.21.15.159:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1463434843 0 0) 0x7f257c072270 con 0x7f257c15e5d0 2023-12-17T11:49:53.904 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:53.902+0000 7f25809de640 1 -- 172.21.15.40:0/3689576935 --> v1:172.21.15.159:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f257c071f90 con 0x7f257c15e5d0 2023-12-17T11:49:53.904 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:53.902+0000 7f25811df640 1 -- 172.21.15.40:0/3689576935 >> v1:172.21.15.159:6789/0 conn(0x7f257c15e5d0 legacy=0x7f257c06bdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:53.904 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:53.902+0000 7f25811df640 1 -- 172.21.15.40:0/3689576935 >> v1:172.21.15.40:6789/0 conn(0x7f257c0abd20 legacy=0x7f257c0cded0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:53.905 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:53.902+0000 7f25811df640 1 -- 172.21.15.40:0/3689576935 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f257c070350 con 0x7f257c0ae200 2023-12-17T11:49:53.905 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:53.903+0000 7f25811df640 1 --2- 172.21.15.40:0/3689576935 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f257c0ae200 0x7f257c070b50 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f256c0097d0 tx=0x7f256c02b8a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=21009548568fa3f6 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:49:53.906 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:53.904+0000 7f25809de640 1 -- 172.21.15.40:0/3689576935 <== mon.2 v2:172.21.15.159:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f256c031800 con 0x7f257c0ae200 2023-12-17T11:49:53.906 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:53.904+0000 7f25809de640 1 -- 172.21.15.40:0/3689576935 <== mon.2 v2:172.21.15.159:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f256c031960 con 0x7f257c0ae200 2023-12-17T11:49:53.906 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:53.904+0000 7f25809de640 1 -- 172.21.15.40:0/3689576935 <== mon.2 v2:172.21.15.159:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f256c031cf0 con 0x7f257c0ae200 2023-12-17T11:49:53.906 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:53.904+0000 7f25829e2640 1 -- 172.21.15.40:0/3689576935 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f257c0ae200 msgr2=0x7f257c070b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:53.907 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:53.904+0000 7f25829e2640 1 --2- 172.21.15.40:0/3689576935 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f257c0ae200 0x7f257c070b50 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f256c0097d0 tx=0x7f256c02b8a0 comp rx=0 tx=0).stop 2023-12-17T11:49:53.907 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:53.905+0000 7f25829e2640 1 -- 172.21.15.40:0/3689576935 shutdown_connections 2023-12-17T11:49:53.907 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:53.905+0000 7f25829e2640 1 --2- 172.21.15.40:0/3689576935 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f257c0ae200 0x7f257c070b50 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:53.907 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:53.905+0000 7f25829e2640 1 -- 172.21.15.40:0/3689576935 >> 172.21.15.40:0/3689576935 conn(0x7f257c0b0860 msgr2=0x7f257c0b0c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:49:53.907 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:53.905+0000 7f25829e2640 1 -- 172.21.15.40:0/3689576935 shutdown_connections 2023-12-17T11:49:53.907 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:53.905+0000 7f25829e2640 1 -- 172.21.15.40:0/3689576935 wait complete. 2023-12-17T11:49:53.908 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:53.906+0000 7f25829e2640 1 Processor -- start 2023-12-17T11:49:53.908 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:53.907+0000 7f25829e2640 1 -- start start 2023-12-17T11:49:53.910 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:53.907+0000 7f25829e2640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f257c0abd20 0x7f257c14b150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:53.911 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:53.908+0000 7f25829e2640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f257c0ae200 0x7f257c149560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:53.911 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:53.908+0000 7f25829e2640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f257c15e5d0 0x7f257c06c810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:53.911 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:53.908+0000 7f25829e2640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f257c154160 con 0x7f257c15e5d0 2023-12-17T11:49:53.911 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:53.908+0000 7f25829e2640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f257c14d610 con 0x7f257c0abd20 2023-12-17T11:49:53.911 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:53.908+0000 7f25829e2640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f257c14a390 con 0x7f257c0ae200 2023-12-17T11:49:53.911 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:53.908+0000 7f25821e1640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f257c15e5d0 0x7f257c06c810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:53.911 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:53.908+0000 7f25821e1640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f257c15e5d0 0x7f257c06c810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:42748/0 (socket says 172.21.15.40:42748) 2023-12-17T11:49:53.911 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:53.908+0000 7f25821e1640 1 -- 172.21.15.40:0/3054536985 learned_addr learned my addr 172.21.15.40:0/3054536985 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-17T11:49:53.911 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:53.908+0000 7f25819e0640 1 --2- 172.21.15.40:0/3054536985 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f257c0abd20 0x7f257c14b150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:53.911 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:53.908+0000 7f25821e1640 1 -- 172.21.15.40:0/3054536985 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f257c0ae200 msgr2=0x7f257c149560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:53.911 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:53.908+0000 7f25811df640 1 --2- 172.21.15.40:0/3054536985 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f257c0ae200 0x7f257c149560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:53.911 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:53.908+0000 7f25821e1640 1 --2- 172.21.15.40:0/3054536985 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f257c0ae200 0x7f257c149560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:53.911 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:53.908+0000 7f25821e1640 1 -- 172.21.15.40:0/3054536985 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f257c0abd20 msgr2=0x7f257c14b150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:53.911 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:53.908+0000 7f25821e1640 1 --2- 172.21.15.40:0/3054536985 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f257c0abd20 0x7f257c14b150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:53.912 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:53.908+0000 7f25821e1640 1 -- 172.21.15.40:0/3054536985 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f256c009400 con 0x7f257c15e5d0 2023-12-17T11:49:53.912 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:53.908+0000 7f25811df640 1 --2- 172.21.15.40:0/3054536985 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f257c0ae200 0x7f257c149560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-17T11:49:53.912 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:53.908+0000 7f25819e0640 1 --2- 172.21.15.40:0/3054536985 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f257c0abd20 0x7f257c14b150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-17T11:49:53.912 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:53.909+0000 7f25821e1640 1 --2- 172.21.15.40:0/3054536985 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f257c15e5d0 0x7f257c06c810 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f257400cbc0 tx=0x7f257400a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:49:53.913 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:53.909+0000 7f25727fc640 1 -- 172.21.15.40:0/3054536985 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f257400ace0 con 0x7f257c15e5d0 2023-12-17T11:49:53.913 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:53.909+0000 7f25727fc640 1 -- 172.21.15.40:0/3054536985 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f257400ae40 con 0x7f257c15e5d0 2023-12-17T11:49:53.913 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:53.909+0000 7f25727fc640 1 -- 172.21.15.40:0/3054536985 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2574012600 con 0x7f257c15e5d0 2023-12-17T11:49:53.913 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:53.909+0000 7f25829e2640 1 -- 172.21.15.40:0/3054536985 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f257c06c680 con 0x7f257c15e5d0 2023-12-17T11:49:53.913 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:53.909+0000 7f25829e2640 1 -- 172.21.15.40:0/3054536985 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f257c14a950 con 0x7f257c15e5d0 2023-12-17T11:49:53.914 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:53.910+0000 7f25829e2640 1 -- 172.21.15.40:0/3054536985 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f257c074450 con 0x7f257c15e5d0 2023-12-17T11:49:53.914 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:53.911+0000 7f25727fc640 1 -- 172.21.15.40:0/3054536985 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f2574012760 con 0x7f257c15e5d0 2023-12-17T11:49:53.914 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:53.912+0000 7f25727fc640 1 --2- 172.21.15.40:0/3054536985 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f256006ae70 0x7f256006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:53.914 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:53.912+0000 7f25727fc640 1 -- 172.21.15.40:0/3054536985 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f25740895f0 con 0x7f257c15e5d0 2023-12-17T11:49:53.915 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:53.913+0000 7f25819e0640 1 --2- 172.21.15.40:0/3054536985 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f256006ae70 0x7f256006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:53.916 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:53.914+0000 7f25819e0640 1 --2- 172.21.15.40:0/3054536985 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f256006ae70 0x7f256006d330 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f25780011e0 tx=0x7f2578009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:49:53.919 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:53.917+0000 7f25727fc640 1 -- 172.21.15.40:0/3054536985 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f25740546a0 con 0x7f257c15e5d0 2023-12-17T11:49:53.994 INFO:tasks.ceph.mds.d.smithi159.stderr:2023-12-17T11:49:53.992+0000 7f134caa3640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-12-17T11:49:54.116 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:54.114+0000 7f25829e2640 1 -- 172.21.15.40:0/3054536985 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f257c154df0 con 0x7f257c15e5d0 2023-12-17T11:49:54.117 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:54.115+0000 7f25727fc640 1 -- 172.21.15.40:0/3054536985 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v39) v1 ==== 74+0+16763 (secure 0 0 0) 0x7f2574057cc0 con 0x7f257c15e5d0 2023-12-17T11:49:54.118 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T11:49:54.118 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":39,"fsid":"099cd35d-80d9-4ca4-8424-de13b3b03ac7","created":"2023-12-17T11:47:53.450097+0000","modified":"2023-12-17T11:49:52.674422+0000","last_up_change":"2023-12-17T11:48:05.724195+0000","last_in_change":"2023-12-17T11:47:56.956499+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-17T11:48:06.668943+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-12-17T11:49:50.228316+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-12-17T11:49:51.700776+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a88bfd46-63b8-48b1-9c0e-5c9cdc31bd38","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":555204741},{"type":"v1","addr":"172.21.15.40:6802","nonce":555204741}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":555204741},{"type":"v1","addr":"172.21.15.40:6807","nonce":555204741}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":555204741},{"type":"v1","addr":"172.21.15.40:6815","nonce":555204741}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6809","nonce":555204741},{"type":"v1","addr":"172.21.15.40:6812","nonce":555204741}]},"public_addr":"172.21.15.40:6802/555204741","cluster_addr":"172.21.15.40:6807/555204741","heartbeat_back_addr":"172.21.15.40:6815/555204741","heartbeat_front_addr":"172.21.15.40:6812/555204741","state":["exists","up"]},{"osd":1,"uuid":"c5d628ae-36f4-4866-802c-b162f0e90add","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6801","nonce":1221318112},{"type":"v1","addr":"172.21.15.40:6803","nonce":1221318112}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6805","nonce":1221318112},{"type":"v1","addr":"172.21.15.40:6806","nonce":1221318112}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6811","nonce":1221318112},{"type":"v1","addr":"172.21.15.40:6813","nonce":1221318112}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":1221318112},{"type":"v1","addr":"172.21.15.40:6810","nonce":1221318112}]},"public_addr":"172.21.15.40:6803/1221318112","cluster_addr":"172.21.15.40:6806/1221318112","heartbeat_back_addr":"172.21.15.40:6813/1221318112","heartbeat_front_addr":"172.21.15.40:6810/1221318112","state":["exists","up"]},{"osd":2,"uuid":"d986ad6a-af2f-47fc-9c3b-fbda27b82b73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":1959000265},{"type":"v1","addr":"172.21.15.40:6817","nonce":1959000265}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6818","nonce":1959000265},{"type":"v1","addr":"172.21.15.40:6819","nonce":1959000265}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":1959000265},{"type":"v1","addr":"172.21.15.40:6827","nonce":1959000265}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":1959000265},{"type":"v1","addr":"172.21.15.40:6822","nonce":1959000265}]},"public_addr":"172.21.15.40:6817/1959000265","cluster_addr":"172.21.15.40:6819/1959000265","heartbeat_back_addr":"172.21.15.40:6827/1959000265","heartbeat_front_addr":"172.21.15.40:6822/1959000265","state":["exists","up"]},{"osd":3,"uuid":"d79d22b7-be05-41b2-b95d-697db677fd02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6821","nonce":974040287},{"type":"v1","addr":"172.21.15.40:6823","nonce":974040287}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6825","nonce":974040287},{"type":"v1","addr":"172.21.15.40:6826","nonce":974040287}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":974040287},{"type":"v1","addr":"172.21.15.40:6831","nonce":974040287}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":974040287},{"type":"v1","addr":"172.21.15.40:6829","nonce":974040287}]},"public_addr":"172.21.15.40:6823/974040287","cluster_addr":"172.21.15.40:6826/974040287","heartbeat_back_addr":"172.21.15.40:6831/974040287","heartbeat_front_addr":"172.21.15.40:6829/974040287","state":["exists","up"]},{"osd":4,"uuid":"62a7a233-d3ea-40be-91de-180c0208d639","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6808","nonce":3937787733},{"type":"v1","addr":"172.21.15.159:6809","nonce":3937787733}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6810","nonce":3937787733},{"type":"v1","addr":"172.21.15.159:6811","nonce":3937787733}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6814","nonce":3937787733},{"type":"v1","addr":"172.21.15.159:6815","nonce":3937787733}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6812","nonce":3937787733},{"type":"v1","addr":"172.21.15.159:6813","nonce":3937787733}]},"public_addr":"172.21.15.159:6809/3937787733","cluster_addr":"172.21.15.159:6811/3937787733","heartbeat_back_addr":"172.21.15.159:6815/3937787733","heartbeat_front_addr":"172.21.15.159:6813/3937787733","state":["exists","up"]},{"osd":5,"uuid":"84629cea-dc0e-4b5e-b203-5ea963839281","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6816","nonce":3032505240},{"type":"v1","addr":"172.21.15.159:6817","nonce":3032505240}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6818","nonce":3032505240},{"type":"v1","addr":"172.21.15.159:6819","nonce":3032505240}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6822","nonce":3032505240},{"type":"v1","addr":"172.21.15.159:6823","nonce":3032505240}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6820","nonce":3032505240},{"type":"v1","addr":"172.21.15.159:6821","nonce":3032505240}]},"public_addr":"172.21.15.159:6817/3032505240","cluster_addr":"172.21.15.159:6819/3032505240","heartbeat_back_addr":"172.21.15.159:6823/3032505240","heartbeat_front_addr":"172.21.15.159:6821/3032505240","state":["exists","up"]},{"osd":6,"uuid":"4ae3af3a-1743-4070-a91d-8be5c31cdb04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6800","nonce":2411788597},{"type":"v1","addr":"172.21.15.159:6801","nonce":2411788597}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6802","nonce":2411788597},{"type":"v1","addr":"172.21.15.159:6803","nonce":2411788597}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6806","nonce":2411788597},{"type":"v1","addr":"172.21.15.159:6807","nonce":2411788597}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6804","nonce":2411788597},{"type":"v1","addr":"172.21.15.159:6805","nonce":2411788597}]},"public_addr":"172.21.15.159:6801/2411788597","cluster_addr":"172.21.15.159:6803/2411788597","heartbeat_back_addr":"172.21.15.159:6807/2411788597","heartbeat_front_addr":"172.21.15.159:6805/2411788597","state":["exists","up"]},{"osd":7,"uuid":"c1f4c7f2-8f75-4f95-bc63-a332773e3b8e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6824","nonce":478953349},{"type":"v1","addr":"172.21.15.159:6825","nonce":478953349}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6826","nonce":478953349},{"type":"v1","addr":"172.21.15.159:6827","nonce":478953349}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6830","nonce":478953349},{"type":"v1","addr":"172.21.15.159:6831","nonce":478953349}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6828","nonce":478953349},{"type":"v1","addr":"172.21.15.159:6829","nonce":478953349}]},"public_addr":"172.21.15.159:6825/478953349","cluster_addr":"172.21.15.159:6827/478953349","heartbeat_back_addr":"172.21.15.159:6831/478953349","heartbeat_front_addr":"172.21.15.159:6829/478953349","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T11:48:02.023567+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T11:48:02.278216+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T11:48:02.311843+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T11:48:01.773372+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T11:48:02.618910+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T11:48:02.361559+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T11:48:02.223997+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T11:48:02.604403+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-17T11:49:54.120 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:54.118+0000 7f25829e2640 1 -- 172.21.15.40:0/3054536985 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f256006ae70 msgr2=0x7f256006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:54.120 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:54.118+0000 7f25829e2640 1 --2- 172.21.15.40:0/3054536985 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f256006ae70 0x7f256006d330 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f25780011e0 tx=0x7f2578009040 comp rx=0 tx=0).stop 2023-12-17T11:49:54.121 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:54.118+0000 7f25829e2640 1 -- 172.21.15.40:0/3054536985 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f257c15e5d0 msgr2=0x7f257c06c810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:54.121 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:54.118+0000 7f25829e2640 1 --2- 172.21.15.40:0/3054536985 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f257c15e5d0 0x7f257c06c810 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f257400cbc0 tx=0x7f257400a430 comp rx=0 tx=0).stop 2023-12-17T11:49:54.121 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:54.118+0000 7f25829e2640 1 -- 172.21.15.40:0/3054536985 shutdown_connections 2023-12-17T11:49:54.121 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:54.118+0000 7f25829e2640 1 --2- 172.21.15.40:0/3054536985 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f256006ae70 0x7f256006d330 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:54.121 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:54.118+0000 7f25829e2640 1 --2- 172.21.15.40:0/3054536985 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f257c15e5d0 0x7f257c06c810 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:54.121 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:54.118+0000 7f25829e2640 1 --2- 172.21.15.40:0/3054536985 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f257c0ae200 0x7f257c149560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:54.121 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:54.118+0000 7f25829e2640 1 --2- 172.21.15.40:0/3054536985 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f257c0abd20 0x7f257c14b150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:54.121 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:54.118+0000 7f25829e2640 1 -- 172.21.15.40:0/3054536985 >> 172.21.15.40:0/3054536985 conn(0x7f257c0b0860 msgr2=0x7f257c0aeb60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:49:54.121 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:54.118+0000 7f25829e2640 1 -- 172.21.15.40:0/3054536985 shutdown_connections 2023-12-17T11:49:54.121 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:54.118+0000 7f25829e2640 1 -- 172.21.15.40:0/3054536985 wait complete. 2023-12-17T11:49:54.140 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-12-17T11:49:54.362 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:54.360+0000 7f3509413640 1 Processor -- start 2023-12-17T11:49:54.362 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:54.360+0000 7f3509413640 1 -- start start 2023-12-17T11:49:54.364 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:54.361+0000 7f3509413640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f350415d360 0x7f35040d3660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:54.364 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:54.361+0000 7f3509413640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f35040cece0 0x7f35040d1530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:54.364 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:54.361+0000 7f3509413640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35040cdf20 con 0x7f35040d1a70 2023-12-17T11:49:54.364 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:54.361+0000 7f3509413640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35040d1f00 con 0x7f350415d360 2023-12-17T11:49:54.364 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:54.361+0000 7f3509413640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35040ce200 con 0x7f35040cece0 2023-12-17T11:49:54.365 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:54.361+0000 7f3503fff640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f350415d360 0x7f35040d3660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:54.365 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:54.361+0000 7f3503fff640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f350415d360 0x7f35040d3660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:42754/0 (socket says 172.21.15.40:42754) 2023-12-17T11:49:54.365 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:54.361+0000 7f3508c12640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f35040d1a70 0x7f3504160f80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:44662/0 (socket says 172.21.15.40:44662) 2023-12-17T11:49:54.365 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:54.361+0000 7f3503fff640 1 -- 172.21.15.40:0/827899282 learned_addr learned my addr 172.21.15.40:0/827899282 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-17T11:49:54.366 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:54.362+0000 7f35037fe640 1 --2- 172.21.15.40:0/827899282 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f35040cece0 0x7f35040d1530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:54.366 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:54.362+0000 7f3503fff640 1 -- 172.21.15.40:0/827899282 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f35040cece0 msgr2=0x7f35040d1530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:49:54.366 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:54.362+0000 7f3503fff640 1 --2- 172.21.15.40:0/827899282 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f35040cece0 0x7f35040d1530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:54.366 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:54.362+0000 7f3503fff640 1 -- 172.21.15.40:0/827899282 >> v1:172.21.15.40:6789/0 conn(0x7f35040d1a70 legacy=0x7f3504160f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:54.366 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:54.362+0000 7f3503fff640 1 -- 172.21.15.40:0/827899282 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35040ce4e0 con 0x7f350415d360 2023-12-17T11:49:54.366 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:54.362+0000 7f35037fe640 1 --2- 172.21.15.40:0/827899282 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f35040cece0 0x7f35040d1530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-17T11:49:54.368 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:54.363+0000 7f3503fff640 1 --2- 172.21.15.40:0/827899282 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f350415d360 0x7f35040d3660 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f34f4009870 tx=0x7f34f402ba10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da3bf203c22f7180 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:49:54.368 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:54.363+0000 7f3502ffd640 1 -- 172.21.15.40:0/827899282 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34f402f830 con 0x7f350415d360 2023-12-17T11:49:54.368 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:54.363+0000 7f3502ffd640 1 -- 172.21.15.40:0/827899282 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34f402f990 con 0x7f350415d360 2023-12-17T11:49:54.368 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:54.363+0000 7f3502ffd640 1 -- 172.21.15.40:0/827899282 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34f402fd20 con 0x7f350415d360 2023-12-17T11:49:54.368 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:54.364+0000 7f3509413640 1 -- 172.21.15.40:0/827899282 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f350415d360 msgr2=0x7f35040d3660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:54.369 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:54.364+0000 7f3509413640 1 --2- 172.21.15.40:0/827899282 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f350415d360 0x7f35040d3660 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f34f4009870 tx=0x7f34f402ba10 comp rx=0 tx=0).stop 2023-12-17T11:49:54.369 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:54.364+0000 7f3509413640 1 -- 172.21.15.40:0/827899282 shutdown_connections 2023-12-17T11:49:54.369 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:54.364+0000 7f3509413640 1 --2- 172.21.15.40:0/827899282 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f35040cece0 0x7f35040d1530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:54.369 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:54.364+0000 7f3509413640 1 --2- 172.21.15.40:0/827899282 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f350415d360 0x7f35040d3660 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:54.369 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:54.364+0000 7f3509413640 1 -- 172.21.15.40:0/827899282 >> 172.21.15.40:0/827899282 conn(0x7f350409c230 msgr2=0x7f35040d2f50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:49:54.369 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:54.364+0000 7f3509413640 1 -- 172.21.15.40:0/827899282 shutdown_connections 2023-12-17T11:49:54.369 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:54.364+0000 7f3509413640 1 -- 172.21.15.40:0/827899282 wait complete. 2023-12-17T11:49:54.369 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:54.366+0000 7f3509413640 1 Processor -- start 2023-12-17T11:49:54.369 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:54.366+0000 7f3509413640 1 -- start start 2023-12-17T11:49:54.371 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:54.367+0000 7f3509413640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f35040cece0 0x7f350414cbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:54.371 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:54.367+0000 7f3509413640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f35040d1a70 0x7f35040c8b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:54.371 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:54.367+0000 7f3509413640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f350415d360 0x7f35040b7b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:54.371 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:54.367+0000 7f3509413640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35040cb630 con 0x7f35040d1a70 2023-12-17T11:49:54.371 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:54.367+0000 7f3509413640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3504160870 con 0x7f35040cece0 2023-12-17T11:49:54.372 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:54.367+0000 7f3509413640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3504160030 con 0x7f350415d360 2023-12-17T11:49:54.372 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:54.367+0000 7f35037fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f35040d1a70 0x7f35040c8b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:54.372 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:54.367+0000 7f35037fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f35040d1a70 0x7f35040c8b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:42756/0 (socket says 172.21.15.40:42756) 2023-12-17T11:49:54.372 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:54.367+0000 7f35037fe640 1 -- 172.21.15.40:0/2549094745 learned_addr learned my addr 172.21.15.40:0/2549094745 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-17T11:49:54.372 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:54.368+0000 7f3503fff640 1 --2- 172.21.15.40:0/2549094745 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f35040cece0 0x7f350414cbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:54.372 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:54.368+0000 7f3508c12640 1 --2- 172.21.15.40:0/2549094745 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f350415d360 0x7f35040b7b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:54.372 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:54.368+0000 7f35037fe640 1 -- 172.21.15.40:0/2549094745 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f350415d360 msgr2=0x7f35040b7b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:54.372 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:54.368+0000 7f35037fe640 1 --2- 172.21.15.40:0/2549094745 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f350415d360 0x7f35040b7b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:54.373 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:54.368+0000 7f35037fe640 1 -- 172.21.15.40:0/2549094745 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f35040cece0 msgr2=0x7f350414cbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:54.373 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:54.368+0000 7f35037fe640 1 --2- 172.21.15.40:0/2549094745 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f35040cece0 0x7f350414cbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:54.373 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:54.368+0000 7f35037fe640 1 -- 172.21.15.40:0/2549094745 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34f40094d0 con 0x7f35040d1a70 2023-12-17T11:49:54.373 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:54.368+0000 7f3508c12640 1 --2- 172.21.15.40:0/2549094745 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f350415d360 0x7f35040b7b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-17T11:49:54.373 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:54.368+0000 7f35037fe640 1 --2- 172.21.15.40:0/2549094745 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f35040d1a70 0x7f35040c8b60 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f34ec00ce00 tx=0x7f34ec00a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:49:54.373 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:54.368+0000 7f3500ff9640 1 -- 172.21.15.40:0/2549094745 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34ec00f890 con 0x7f35040d1a70 2023-12-17T11:49:54.373 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:54.368+0000 7f3500ff9640 1 -- 172.21.15.40:0/2549094745 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34ec00f9f0 con 0x7f35040d1a70 2023-12-17T11:49:54.373 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:54.368+0000 7f3509413640 1 -- 172.21.15.40:0/2549094745 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f350414d130 con 0x7f35040d1a70 2023-12-17T11:49:54.373 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:54.368+0000 7f3500ff9640 1 -- 172.21.15.40:0/2549094745 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34ec00fdc0 con 0x7f35040d1a70 2023-12-17T11:49:54.373 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:54.369+0000 7f3509413640 1 -- 172.21.15.40:0/2549094745 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3504160590 con 0x7f35040d1a70 2023-12-17T11:49:54.374 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:54.370+0000 7f3509413640 1 -- 172.21.15.40:0/2549094745 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35040678e0 con 0x7f35040d1a70 2023-12-17T11:49:54.374 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:54.371+0000 7f3500ff9640 1 -- 172.21.15.40:0/2549094745 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f34ec00b040 con 0x7f35040d1a70 2023-12-17T11:49:54.374 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:54.372+0000 7f3500ff9640 1 --2- 172.21.15.40:0/2549094745 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f34e406ae70 0x7f34e406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:54.374 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:54.372+0000 7f3500ff9640 1 -- 172.21.15.40:0/2549094745 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f34ec08a210 con 0x7f35040d1a70 2023-12-17T11:49:54.375 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:54.373+0000 7f3503fff640 1 --2- 172.21.15.40:0/2549094745 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f34e406ae70 0x7f34e406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:54.376 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:54.374+0000 7f3503fff640 1 --2- 172.21.15.40:0/2549094745 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f34e406ae70 0x7f34e406d330 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f34f4036000 tx=0x7f34f4008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:49:54.378 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:54.376+0000 7f3500ff9640 1 -- 172.21.15.40:0/2549094745 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f34ec0550f0 con 0x7f35040d1a70 2023-12-17T11:49:54.611 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:54.609+0000 7f3509413640 1 -- 172.21.15.40:0/2549094745 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f3504074450 con 0x7f35040d1a70 2023-12-17T11:49:55.247 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:55.245+0000 7f3500ff9640 1 -- 172.21.15.40:0/2549094745 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v14) v1 ==== 118+0+0 (secure 0 0 0) 0x7f34ec058710 con 0x7f35040d1a70 2023-12-17T11:49:55.251 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:55.249+0000 7f3509413640 1 -- 172.21.15.40:0/2549094745 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f34e406ae70 msgr2=0x7f34e406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:55.251 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:55.249+0000 7f3509413640 1 --2- 172.21.15.40:0/2549094745 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f34e406ae70 0x7f34e406d330 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f34f4036000 tx=0x7f34f4008030 comp rx=0 tx=0).stop 2023-12-17T11:49:55.251 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:55.249+0000 7f3509413640 1 -- 172.21.15.40:0/2549094745 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f35040d1a70 msgr2=0x7f35040c8b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:55.251 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:55.249+0000 7f3509413640 1 --2- 172.21.15.40:0/2549094745 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f35040d1a70 0x7f35040c8b60 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f34ec00ce00 tx=0x7f34ec00a650 comp rx=0 tx=0).stop 2023-12-17T11:49:55.251 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:55.249+0000 7f3509413640 1 -- 172.21.15.40:0/2549094745 shutdown_connections 2023-12-17T11:49:55.252 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:55.249+0000 7f3509413640 1 --2- 172.21.15.40:0/2549094745 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f34e406ae70 0x7f34e406d330 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:55.252 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:55.249+0000 7f3509413640 1 --2- 172.21.15.40:0/2549094745 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f350415d360 0x7f35040b7b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:55.252 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:55.249+0000 7f3509413640 1 --2- 172.21.15.40:0/2549094745 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f35040d1a70 0x7f35040c8b60 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:55.252 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:55.249+0000 7f3509413640 1 --2- 172.21.15.40:0/2549094745 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f35040cece0 0x7f350414cbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:55.252 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:55.249+0000 7f3509413640 1 -- 172.21.15.40:0/2549094745 >> 172.21.15.40:0/2549094745 conn(0x7f350409c230 msgr2=0x7f350406c410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:49:55.252 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:55.249+0000 7f3509413640 1 -- 172.21.15.40:0/2549094745 shutdown_connections 2023-12-17T11:49:55.252 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:55.249+0000 7f3509413640 1 -- 172.21.15.40:0/2549094745 wait complete. 2023-12-17T11:49:55.273 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-12-17T11:49:55.273 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-12-17T11:49:55.503 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:55.501+0000 7facc8fa5640 1 Processor -- start 2023-12-17T11:49:55.504 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:55.501+0000 7facc8fa5640 1 -- start start 2023-12-17T11:49:55.505 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:55.503+0000 7facc8fa5640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7facc415d5f0 0x7facc40d1d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:55.505 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:55.503+0000 7facc8fa5640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7facc40d3a50 0x7facc40cfaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:55.505 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:55.503+0000 7facc8fa5640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7facc40d0480 con 0x7facc40d0030 2023-12-17T11:49:55.506 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:55.503+0000 7facc8fa5640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7facc415e620 con 0x7facc415d5f0 2023-12-17T11:49:55.506 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:55.503+0000 7facc8fa5640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7facc415ea40 con 0x7facc40d3a50 2023-12-17T11:49:55.506 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:55.503+0000 7facc259c640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7facc415d5f0 0x7facc40d1d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:55.506 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:55.503+0000 7facc2d9d640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7facc40d0030 0x7facc4161000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:45868/0 (socket says 172.21.15.40:45868) 2023-12-17T11:49:55.506 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:55.503+0000 7facc2d9d640 1 -- 172.21.15.40:0/3552799387 learned_addr learned my addr 172.21.15.40:0/3552799387 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-12-17T11:49:55.506 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:55.504+0000 7facbbfff640 1 --2- 172.21.15.40:0/3552799387 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7facc40d3a50 0x7facc40cfaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:55.507 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:55.504+0000 7facc259c640 1 -- 172.21.15.40:0/3552799387 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7facc40d3a50 msgr2=0x7facc40cfaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:49:55.507 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:55.504+0000 7facc259c640 1 --2- 172.21.15.40:0/3552799387 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7facc40d3a50 0x7facc40cfaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:55.507 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:55.504+0000 7facc259c640 1 -- 172.21.15.40:0/3552799387 >> v1:172.21.15.40:6789/0 conn(0x7facc40d0030 legacy=0x7facc4161000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:55.507 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:55.504+0000 7facc259c640 1 -- 172.21.15.40:0/3552799387 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facc40b2300 con 0x7facc415d5f0 2023-12-17T11:49:55.507 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:55.505+0000 7facc259c640 1 --2- 172.21.15.40:0/3552799387 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7facc415d5f0 0x7facc40d1d90 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7facb40097d0 tx=0x7facb402b820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9527c4c4775dee6 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:49:55.507 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:55.505+0000 7facc1d9b640 1 -- 172.21.15.40:0/3552799387 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facb4031780 con 0x7facc415d5f0 2023-12-17T11:49:55.507 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:55.506+0000 7facc1d9b640 1 -- 172.21.15.40:0/3552799387 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7facb40318e0 con 0x7facc415d5f0 2023-12-17T11:49:55.508 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:55.506+0000 7facc1d9b640 1 -- 172.21.15.40:0/3552799387 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facb4031c70 con 0x7facc415d5f0 2023-12-17T11:49:55.508 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:55.506+0000 7facc8fa5640 1 -- 172.21.15.40:0/3552799387 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7facc415d5f0 msgr2=0x7facc40d1d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:55.508 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:55.506+0000 7facc8fa5640 1 --2- 172.21.15.40:0/3552799387 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7facc415d5f0 0x7facc40d1d90 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7facb40097d0 tx=0x7facb402b820 comp rx=0 tx=0).stop 2023-12-17T11:49:55.508 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:55.506+0000 7facc8fa5640 1 -- 172.21.15.40:0/3552799387 shutdown_connections 2023-12-17T11:49:55.509 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:55.506+0000 7facc8fa5640 1 --2- 172.21.15.40:0/3552799387 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7facc40d3a50 0x7facc40cfaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:55.509 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:55.506+0000 7facc8fa5640 1 --2- 172.21.15.40:0/3552799387 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7facc415d5f0 0x7facc40d1d90 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:55.509 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:55.506+0000 7facc8fa5640 1 -- 172.21.15.40:0/3552799387 >> 172.21.15.40:0/3552799387 conn(0x7facc409c450 msgr2=0x7facc40d3120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:49:55.509 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:55.506+0000 7facc8fa5640 1 -- 172.21.15.40:0/3552799387 shutdown_connections 2023-12-17T11:49:55.509 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:55.506+0000 7facc8fa5640 1 -- 172.21.15.40:0/3552799387 wait complete. 2023-12-17T11:49:55.510 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:55.508+0000 7facc8fa5640 1 Processor -- start 2023-12-17T11:49:55.510 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:55.508+0000 7facc8fa5640 1 -- start start 2023-12-17T11:49:55.512 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:55.509+0000 7facc8fa5640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7facc40d0030 0x7facc4159080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:55.512 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:55.509+0000 7facc8fa5640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7facc40d3a50 0x7facc4147690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:55.512 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:55.509+0000 7facc8fa5640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7facc415d5f0 0x7facc41f29c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:55.512 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:55.509+0000 7facc8fa5640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facc40b7850 con 0x7facc415d5f0 2023-12-17T11:49:55.512 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:55.509+0000 7facc8fa5640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facc4147f80 con 0x7facc40d0030 2023-12-17T11:49:55.512 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:55.509+0000 7facc8fa5640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7facc4148260 con 0x7facc40d3a50 2023-12-17T11:49:55.512 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:55.510+0000 7facc2d9d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7facc415d5f0 0x7facc41f29c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:55.513 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:55.510+0000 7facc2d9d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7facc415d5f0 0x7facc41f29c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:33776/0 (socket says 172.21.15.40:33776) 2023-12-17T11:49:55.513 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:55.510+0000 7facc2d9d640 1 -- 172.21.15.40:0/3191225678 learned_addr learned my addr 172.21.15.40:0/3191225678 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-17T11:49:55.513 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:55.510+0000 7facc259c640 1 --2- 172.21.15.40:0/3191225678 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7facc40d0030 0x7facc4159080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:55.513 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:55.510+0000 7facbbfff640 1 --2- 172.21.15.40:0/3191225678 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7facc40d3a50 0x7facc4147690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:55.513 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:55.510+0000 7facc2d9d640 1 -- 172.21.15.40:0/3191225678 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7facc40d3a50 msgr2=0x7facc4147690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:55.513 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:55.510+0000 7facc2d9d640 1 --2- 172.21.15.40:0/3191225678 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7facc40d3a50 0x7facc4147690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:55.513 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:55.510+0000 7facc2d9d640 1 -- 172.21.15.40:0/3191225678 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7facc40d0030 msgr2=0x7facc4159080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:55.513 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:55.510+0000 7facc2d9d640 1 --2- 172.21.15.40:0/3191225678 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7facc40d0030 0x7facc4159080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:55.513 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:55.510+0000 7facc2d9d640 1 -- 172.21.15.40:0/3191225678 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facb4009400 con 0x7facc415d5f0 2023-12-17T11:49:55.513 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:55.510+0000 7facbbfff640 1 --2- 172.21.15.40:0/3191225678 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7facc40d3a50 0x7facc4147690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-17T11:49:55.514 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:55.511+0000 7facc2d9d640 1 --2- 172.21.15.40:0/3191225678 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7facc415d5f0 0x7facc41f29c0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7facbc00cbc0 tx=0x7facbc00a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:49:55.514 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:55.511+0000 7facbaffd640 1 -- 172.21.15.40:0/3191225678 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facbc00ad40 con 0x7facc415d5f0 2023-12-17T11:49:55.514 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:55.511+0000 7facbaffd640 1 -- 172.21.15.40:0/3191225678 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7facbc012400 con 0x7facc415d5f0 2023-12-17T11:49:55.514 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:55.511+0000 7facbaffd640 1 -- 172.21.15.40:0/3191225678 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facbc00aea0 con 0x7facc415d5f0 2023-12-17T11:49:55.514 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:55.511+0000 7facc8fa5640 1 -- 172.21.15.40:0/3191225678 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7facc40b7af0 con 0x7facc415d5f0 2023-12-17T11:49:55.514 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:55.511+0000 7facc8fa5640 1 -- 172.21.15.40:0/3191225678 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7facc4147bd0 con 0x7facc415d5f0 2023-12-17T11:49:55.515 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:55.513+0000 7facc8fa5640 1 -- 172.21.15.40:0/3191225678 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7facc40b7d10 con 0x7facc415d5f0 2023-12-17T11:49:55.515 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:55.513+0000 7facbaffd640 1 -- 172.21.15.40:0/3191225678 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7facbc007070 con 0x7facc415d5f0 2023-12-17T11:49:55.516 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:55.514+0000 7facbaffd640 1 --2- 172.21.15.40:0/3191225678 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7faca406ae40 0x7faca406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:55.516 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:55.514+0000 7facbaffd640 1 -- 172.21.15.40:0/3191225678 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6029+0+0 (secure 0 0 0) 0x7facbc089420 con 0x7facc415d5f0 2023-12-17T11:49:55.517 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:55.515+0000 7facc259c640 1 --2- 172.21.15.40:0/3191225678 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7faca406ae40 0x7faca406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:55.520 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:55.516+0000 7facc259c640 1 --2- 172.21.15.40:0/3191225678 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7faca406ae40 0x7faca406d300 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7facb4036000 tx=0x7facb403d040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:49:55.521 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:55.519+0000 7facbaffd640 1 -- 172.21.15.40:0/3191225678 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7facbc054440 con 0x7facc415d5f0 2023-12-17T11:49:55.756 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:55.754+0000 7facc8fa5640 1 -- 172.21.15.40:0/3191225678 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7facc40d0480 con 0x7facc415d5f0 2023-12-17T11:49:56.250 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:56.248+0000 7facbaffd640 1 -- 172.21.15.40:0/3191225678 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v15) v1 ==== 122+0+0 (secure 0 0 0) 0x7facc40d0480 con 0x7facc415d5f0 2023-12-17T11:49:56.254 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:56.252+0000 7facc8fa5640 1 -- 172.21.15.40:0/3191225678 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7faca406ae40 msgr2=0x7faca406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:56.255 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:56.252+0000 7facc8fa5640 1 --2- 172.21.15.40:0/3191225678 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7faca406ae40 0x7faca406d300 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7facb4036000 tx=0x7facb403d040 comp rx=0 tx=0).stop 2023-12-17T11:49:56.255 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:56.252+0000 7facc8fa5640 1 -- 172.21.15.40:0/3191225678 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7facc415d5f0 msgr2=0x7facc41f29c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:56.255 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:56.252+0000 7facc8fa5640 1 --2- 172.21.15.40:0/3191225678 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7facc415d5f0 0x7facc41f29c0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7facbc00cbc0 tx=0x7facbc00a430 comp rx=0 tx=0).stop 2023-12-17T11:49:56.256 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:56.253+0000 7facc8fa5640 1 -- 172.21.15.40:0/3191225678 shutdown_connections 2023-12-17T11:49:56.256 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:56.253+0000 7facc8fa5640 1 --2- 172.21.15.40:0/3191225678 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7faca406ae40 0x7faca406d300 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:56.256 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:56.253+0000 7facc8fa5640 1 --2- 172.21.15.40:0/3191225678 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7facc415d5f0 0x7facc41f29c0 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:56.256 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:56.253+0000 7facc8fa5640 1 --2- 172.21.15.40:0/3191225678 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7facc40d3a50 0x7facc4147690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:56.256 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:56.253+0000 7facc8fa5640 1 --2- 172.21.15.40:0/3191225678 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7facc40d0030 0x7facc4159080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:56.256 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:56.253+0000 7facc8fa5640 1 -- 172.21.15.40:0/3191225678 >> 172.21.15.40:0/3191225678 conn(0x7facc409c450 msgr2=0x7facc40cdc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:49:56.256 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:56.253+0000 7facc8fa5640 1 -- 172.21.15.40:0/3191225678 shutdown_connections 2023-12-17T11:49:56.256 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:56.253+0000 7facc8fa5640 1 -- 172.21.15.40:0/3191225678 wait complete. 2023-12-17T11:49:56.276 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-12-17T11:49:56.276 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-17T11:49:56.506 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:56.504+0000 7f33db59e640 1 Processor -- start 2023-12-17T11:49:56.507 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:56.504+0000 7f33db59e640 1 -- start start 2023-12-17T11:49:56.508 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:56.506+0000 7f33db59e640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f33dc1437b0 0x7f33dc0d0590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:56.509 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:56.506+0000 7f33db59e640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f33dc15dd80 0x7f33dc06a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:56.509 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:56.507+0000 7f33db59e640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33dc15e700 con 0x7f33dc06a460 2023-12-17T11:49:56.509 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:56.507+0000 7f33db59e640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33dc0d0170 con 0x7f33dc1437b0 2023-12-17T11:49:56.509 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:56.507+0000 7f33db59e640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33dc15e210 con 0x7f33dc15dd80 2023-12-17T11:49:56.509 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:56.507+0000 7f33d3fff640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f33dc06a460 0x7f33dc15d670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:45870/0 (socket says 172.21.15.40:45870) 2023-12-17T11:49:56.509 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:56.507+0000 7f33d3fff640 1 -- 172.21.15.40:0/3463862400 learned_addr learned my addr 172.21.15.40:0/3463862400 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-12-17T11:49:56.511 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:56.507+0000 7f33da59c640 1 --2- 172.21.15.40:0/3463862400 >> v2:172.21.15.159:3300/0 conn(0x7f33dc1437b0 0x7f33dc0d0590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:56.511 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:56.507+0000 7f33dad9d640 1 --2- 172.21.15.40:0/3463862400 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f33dc15dd80 0x7f33dc06a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:56.511 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:56.507+0000 7f33d9d9b640 1 -- 172.21.15.40:0/3463862400 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3849867305 0 0) 0x7f33dc15e700 con 0x7f33dc06a460 2023-12-17T11:49:56.511 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:56.507+0000 7f33d9d9b640 1 -- 172.21.15.40:0/3463862400 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f33c8003520 con 0x7f33dc06a460 2023-12-17T11:49:56.511 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:56.508+0000 7f33d9d9b640 1 -- 172.21.15.40:0/3463862400 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1687965919 0 0) 0x7f33c8003520 con 0x7f33dc06a460 2023-12-17T11:49:56.511 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:56.508+0000 7f33d9d9b640 1 -- 172.21.15.40:0/3463862400 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f33dc15dd80 msgr2=0x7f33dc06a8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:49:56.512 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:56.508+0000 7f33d9d9b640 1 --2- 172.21.15.40:0/3463862400 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f33dc15dd80 0x7f33dc06a8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:56.512 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:56.508+0000 7f33d9d9b640 1 -- 172.21.15.40:0/3463862400 >> v2:172.21.15.159:3300/0 conn(0x7f33dc1437b0 msgr2=0x7f33dc0d0590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:49:56.512 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:56.508+0000 7f33d9d9b640 1 --2- 172.21.15.40:0/3463862400 >> v2:172.21.15.159:3300/0 conn(0x7f33dc1437b0 0x7f33dc0d0590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:56.512 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:56.508+0000 7f33d9d9b640 1 -- 172.21.15.40:0/3463862400 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33dc06ae00 con 0x7f33dc06a460 2023-12-17T11:49:56.512 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:56.508+0000 7f33d9d9b640 1 -- 172.21.15.40:0/3463862400 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2643242555 0 0) 0x7f33c4001670 con 0x7f33dc06a460 2023-12-17T11:49:56.512 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:56.508+0000 7f33d9d9b640 1 -- 172.21.15.40:0/3463862400 >> v1:172.21.15.40:6789/0 conn(0x7f33dc06a460 legacy=0x7f33dc15d670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:56.512 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:56.508+0000 7f33d9d9b640 1 --2- 172.21.15.40:0/3463862400 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f33c8003970 0x7f33c8003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:56.512 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:56.508+0000 7f33d9d9b640 1 --2- 172.21.15.40:0/3463862400 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f33c80047c0 0x7f33c8004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:56.512 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:56.508+0000 7f33d9d9b640 1 --2- 172.21.15.40:0/3463862400 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f33dc15dd80 0x7f33c8005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:56.512 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:56.508+0000 7f33d9d9b640 1 -- 172.21.15.40:0/3463862400 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33dc0d0170 con 0x7f33c80047c0 2023-12-17T11:49:56.512 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:56.508+0000 7f33d9d9b640 1 -- 172.21.15.40:0/3463862400 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33dc15e210 con 0x7f33c8003970 2023-12-17T11:49:56.512 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:56.508+0000 7f33d9d9b640 1 -- 172.21.15.40:0/3463862400 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33c800b980 con 0x7f33dc15dd80 2023-12-17T11:49:56.512 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:56.508+0000 7f33d3fff640 1 --2- 172.21.15.40:0/3463862400 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f33c80047c0 0x7f33c8004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:56.513 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:56.508+0000 7f33da59c640 1 --2- 172.21.15.40:0/3463862400 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f33c8003970 0x7f33c8003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:56.513 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:56.509+0000 7f33dad9d640 1 --2- 172.21.15.40:0/3463862400 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f33dc15dd80 0x7f33c8005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:56.513 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:56.509+0000 7f33d3fff640 1 -- 172.21.15.40:0/3463862400 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f33dc15dd80 msgr2=0x7f33c8005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:49:56.513 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:56.509+0000 7f33d3fff640 1 --2- 172.21.15.40:0/3463862400 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f33dc15dd80 0x7f33c8005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:56.513 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:56.509+0000 7f33d3fff640 1 -- 172.21.15.40:0/3463862400 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f33c8003970 msgr2=0x7f33c8003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:49:56.513 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:56.509+0000 7f33d3fff640 1 --2- 172.21.15.40:0/3463862400 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f33c8003970 0x7f33c8003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:56.513 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:56.509+0000 7f33d3fff640 1 -- 172.21.15.40:0/3463862400 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33c8003520 con 0x7f33c80047c0 2023-12-17T11:49:56.513 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:56.509+0000 7f33dad9d640 1 --2- 172.21.15.40:0/3463862400 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f33dc15dd80 0x7f33c8005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-17T11:49:56.514 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:56.510+0000 7f33d3fff640 1 --2- 172.21.15.40:0/3463862400 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f33c80047c0 0x7f33c8004c40 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f33c400c240 tx=0x7f33c80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e66c869a24437502 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:49:56.515 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:56.510+0000 7f33d9d9b640 1 -- 172.21.15.40:0/3463862400 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33c4005ad0 con 0x7f33c80047c0 2023-12-17T11:49:56.515 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:56.510+0000 7f33d9d9b640 1 -- 172.21.15.40:0/3463862400 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33c4005c30 con 0x7f33c80047c0 2023-12-17T11:49:56.515 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:56.510+0000 7f33d9d9b640 1 -- 172.21.15.40:0/3463862400 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33c402c8d0 con 0x7f33c80047c0 2023-12-17T11:49:56.515 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:56.511+0000 7f33db59e640 1 -- 172.21.15.40:0/3463862400 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f33c80047c0 msgr2=0x7f33c8004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:56.515 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:56.511+0000 7f33db59e640 1 --2- 172.21.15.40:0/3463862400 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f33c80047c0 0x7f33c8004c40 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f33c400c240 tx=0x7f33c80057f0 comp rx=0 tx=0).stop 2023-12-17T11:49:56.515 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:56.511+0000 7f33dad9d640 1 -- 172.21.15.40:0/3463862400 reap_dead start 2023-12-17T11:49:56.515 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:56.511+0000 7f33db59e640 1 -- 172.21.15.40:0/3463862400 shutdown_connections 2023-12-17T11:49:56.515 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:56.511+0000 7f33db59e640 1 -- 172.21.15.40:0/3463862400 >> 172.21.15.40:0/3463862400 conn(0x7f33dc06b570 msgr2=0x7f33dc06b950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:49:56.515 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:56.511+0000 7f33db59e640 1 -- 172.21.15.40:0/3463862400 shutdown_connections 2023-12-17T11:49:56.515 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:56.511+0000 7f33db59e640 1 -- 172.21.15.40:0/3463862400 wait complete. 2023-12-17T11:49:56.515 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:56.513+0000 7f33db59e640 1 Processor -- start 2023-12-17T11:49:56.515 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:56.513+0000 7f33db59e640 1 -- start start 2023-12-17T11:49:56.516 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:56.514+0000 7f33db59e640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f33c80047c0 0x7f33dc0c66c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:56.516 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:56.514+0000 7f33db59e640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f33dc1411b0 0x7f33dc0ca0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:56.516 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:56.514+0000 7f33db59e640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f33dc06d0a0 0x7f33dc06d520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:56.516 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:56.514+0000 7f33db59e640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33dc0c7fb0 con 0x7f33dc06d0a0 2023-12-17T11:49:56.516 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:56.514+0000 7f33db59e640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33dc06da60 con 0x7f33c80047c0 2023-12-17T11:49:56.516 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:56.514+0000 7f33db59e640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33dc0c7370 con 0x7f33dc1411b0 2023-12-17T11:49:56.517 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:56.515+0000 7f33da59c640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f33c80047c0 0x7f33dc0c66c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:56.517 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:56.515+0000 7f33d3fff640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f33dc1411b0 0x7f33dc0ca0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:56.517 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:56.515+0000 7f33da59c640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f33c80047c0 0x7f33dc0c66c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.40:56180/0 (socket says 172.21.15.40:56180) 2023-12-17T11:49:56.518 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:56.515+0000 7f33da59c640 1 -- 172.21.15.40:0/1920957637 learned_addr learned my addr 172.21.15.40:0/1920957637 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-17T11:49:56.518 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:56.515+0000 7f33dad9d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f33dc06d0a0 0x7f33dc06d520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:56.518 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:56.515+0000 7f33dad9d640 1 -- 172.21.15.40:0/1920957637 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f33dc1411b0 msgr2=0x7f33dc0ca0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:56.518 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:56.515+0000 7f33dad9d640 1 --2- 172.21.15.40:0/1920957637 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f33dc1411b0 0x7f33dc0ca0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:56.518 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:56.515+0000 7f33dad9d640 1 -- 172.21.15.40:0/1920957637 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f33c80047c0 msgr2=0x7f33dc0c66c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:56.518 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:56.515+0000 7f33dad9d640 1 --2- 172.21.15.40:0/1920957637 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f33c80047c0 0x7f33dc0c66c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:56.519 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:56.515+0000 7f33dad9d640 1 -- 172.21.15.40:0/1920957637 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33dc0c7610 con 0x7f33dc06d0a0 2023-12-17T11:49:56.519 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:56.516+0000 7f33dad9d640 1 --2- 172.21.15.40:0/1920957637 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f33dc06d0a0 0x7f33dc06d520 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f33dc0d0bd0 tx=0x7f33d400f4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:49:56.519 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:56.516+0000 7f33d2ffd640 1 -- 172.21.15.40:0/1920957637 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33d4017400 con 0x7f33dc06d0a0 2023-12-17T11:49:56.519 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:56.516+0000 7f33d2ffd640 1 -- 172.21.15.40:0/1920957637 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33d4011040 con 0x7f33dc06d0a0 2023-12-17T11:49:56.520 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:56.516+0000 7f33db59e640 1 -- 172.21.15.40:0/1920957637 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33dc0c78f0 con 0x7f33dc06d0a0 2023-12-17T11:49:56.520 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:56.516+0000 7f33d2ffd640 1 -- 172.21.15.40:0/1920957637 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33d4017780 con 0x7f33dc06d0a0 2023-12-17T11:49:56.520 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:56.516+0000 7f33db59e640 1 -- 172.21.15.40:0/1920957637 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33dc141630 con 0x7f33dc06d0a0 2023-12-17T11:49:56.520 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:56.517+0000 7f33db59e640 1 -- 172.21.15.40:0/1920957637 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f33dc074450 con 0x7f33dc06d0a0 2023-12-17T11:49:56.520 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:56.518+0000 7f33d2ffd640 1 -- 172.21.15.40:0/1920957637 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f33d40203b0 con 0x7f33dc06d0a0 2023-12-17T11:49:56.521 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:56.519+0000 7f33d2ffd640 1 --2- 172.21.15.40:0/1920957637 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f33bc06ae40 0x7f33bc06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:56.521 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:56.519+0000 7f33d2ffd640 1 -- 172.21.15.40:0/1920957637 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f33d4089930 con 0x7f33dc06d0a0 2023-12-17T11:49:56.521 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:56.520+0000 7f33da59c640 1 --2- 172.21.15.40:0/1920957637 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f33bc06ae40 0x7f33bc06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:56.522 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:56.521+0000 7f33da59c640 1 --2- 172.21.15.40:0/1920957637 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f33bc06ae40 0x7f33bc06d300 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f33cc009b40 tx=0x7f33cc008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:49:56.525 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:56.523+0000 7f33d2ffd640 1 -- 172.21.15.40:0/1920957637 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f33d4054940 con 0x7f33dc06d0a0 2023-12-17T11:49:56.761 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:56.759+0000 7f33db59e640 1 -- 172.21.15.40:0/1920957637 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f33dc071b60 con 0x7f33dc06d0a0 2023-12-17T11:49:56.762 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:56.760+0000 7f33d2ffd640 1 -- 172.21.15.40:0/1920957637 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) v1 ==== 94+0+4919 (secure 0 0 0) 0x7f33d4057f60 con 0x7f33dc06d0a0 2023-12-17T11:49:56.763 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T11:49:56.763 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":15,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4667,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6836/2267902252","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6834","nonce":2267902252},{"type":"v1","addr":"172.21.15.159:6836","nonce":2267902252}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":4870,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/1074257695","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":1074257695},{"type":"v1","addr":"172.21.15.40:6835","nonce":1074257695}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":5286,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6833/1416509151","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6832","nonce":1416509151},{"type":"v1","addr":"172.21.15.40:6833","nonce":1416509151}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-17T11:49:52.674879+0000","modified":"2023-12-17T11:49:55.755837+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5304},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5304":{"gid":5304,"name":"d","rank":0,"incarnation":12,"state":"up:active","state_seq":4,"addr":"172.21.15.159:6837/2606646075","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6835","nonce":2606646075},{"type":"v1","addr":"172.21.15.159:6837","nonce":2606646075}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-12-17T11:49:56.763 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 15 2023-12-17T11:49:56.766 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:56.764+0000 7f33db59e640 1 -- 172.21.15.40:0/1920957637 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f33bc06ae40 msgr2=0x7f33bc06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:56.766 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:56.764+0000 7f33db59e640 1 --2- 172.21.15.40:0/1920957637 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f33bc06ae40 0x7f33bc06d300 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f33cc009b40 tx=0x7f33cc008040 comp rx=0 tx=0).stop 2023-12-17T11:49:56.766 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:56.764+0000 7f33db59e640 1 -- 172.21.15.40:0/1920957637 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f33dc06d0a0 msgr2=0x7f33dc06d520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:56.766 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:56.764+0000 7f33db59e640 1 --2- 172.21.15.40:0/1920957637 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f33dc06d0a0 0x7f33dc06d520 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f33dc0d0bd0 tx=0x7f33d400f4a0 comp rx=0 tx=0).stop 2023-12-17T11:49:56.766 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:56.764+0000 7f33db59e640 1 -- 172.21.15.40:0/1920957637 shutdown_connections 2023-12-17T11:49:56.767 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:56.764+0000 7f33db59e640 1 --2- 172.21.15.40:0/1920957637 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f33bc06ae40 0x7f33bc06d300 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:56.767 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:56.764+0000 7f33db59e640 1 --2- 172.21.15.40:0/1920957637 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f33dc06d0a0 0x7f33dc06d520 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:56.767 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:56.764+0000 7f33db59e640 1 --2- 172.21.15.40:0/1920957637 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f33dc1411b0 0x7f33dc0ca0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:56.767 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:56.764+0000 7f33db59e640 1 --2- 172.21.15.40:0/1920957637 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f33c80047c0 0x7f33dc0c66c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:56.767 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:56.764+0000 7f33db59e640 1 -- 172.21.15.40:0/1920957637 >> 172.21.15.40:0/1920957637 conn(0x7f33dc06b570 msgr2=0x7f33dc1429e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:49:56.767 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:56.764+0000 7f33db59e640 1 -- 172.21.15.40:0/1920957637 shutdown_connections 2023-12-17T11:49:56.767 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:56.764+0000 7f33db59e640 1 -- 172.21.15.40:0/1920957637 wait complete. 2023-12-17T11:49:56.784 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-17T11:49:57.004 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:57.002+0000 7fb693009640 1 Processor -- start 2023-12-17T11:49:57.004 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:57.002+0000 7fb693009640 1 -- start start 2023-12-17T11:49:57.006 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:57.003+0000 7fb693009640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb68c15d580 0x7fb68c0adc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:57.006 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:57.003+0000 7fb693009640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb68c0b07f0 con 0x7fb68c06c690 2023-12-17T11:49:57.006 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:57.004+0000 7fb693009640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb68c0b0a40 con 0x7fb68c0cfc50 2023-12-17T11:49:57.006 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:57.004+0000 7fb693009640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb68c15d960 con 0x7fb68c15d580 2023-12-17T11:49:57.006 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:57.004+0000 7fb6915a6640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fb68c06c690 0x7fb68c0b1ae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:45882/0 (socket says 172.21.15.40:45882) 2023-12-17T11:49:57.006 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:57.004+0000 7fb6915a6640 1 -- 172.21.15.40:0/2225336813 learned_addr learned my addr 172.21.15.40:0/2225336813 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-12-17T11:49:57.008 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:57.004+0000 7fb690da5640 1 --2- 172.21.15.40:0/2225336813 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb68c15d580 0x7fb68c0adc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:57.008 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:57.004+0000 7fb6837fe640 1 -- 172.21.15.40:0/2225336813 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3823224044 0 0) 0x7fb68c0b07f0 con 0x7fb68c06c690 2023-12-17T11:49:57.009 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:57.005+0000 7fb6837fe640 1 -- 172.21.15.40:0/2225336813 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb674003520 con 0x7fb68c06c690 2023-12-17T11:49:57.009 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:57.005+0000 7fb6837fe640 1 -- 172.21.15.40:0/2225336813 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 700679436 0 0) 0x7fb674003520 con 0x7fb68c06c690 2023-12-17T11:49:57.009 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:57.005+0000 7fb6837fe640 1 -- 172.21.15.40:0/2225336813 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb68c15d580 msgr2=0x7fb68c0adc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:49:57.009 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:57.005+0000 7fb6837fe640 1 --2- 172.21.15.40:0/2225336813 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb68c15d580 0x7fb68c0adc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:57.009 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:57.005+0000 7fb6837fe640 1 -- 172.21.15.40:0/2225336813 >> v1:172.21.15.159:6789/0 conn(0x7fb68c0cfc50 legacy=0x7fb68c06bf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:57.009 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:57.005+0000 7fb6837fe640 1 -- 172.21.15.40:0/2225336813 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb68c0b0d20 con 0x7fb68c06c690 2023-12-17T11:49:57.009 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:57.005+0000 7fb6837fe640 1 -- 172.21.15.40:0/2225336813 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2643242555 0 0) 0x7fb6840019f0 con 0x7fb68c06c690 2023-12-17T11:49:57.009 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:57.005+0000 7fb6837fe640 1 -- 172.21.15.40:0/2225336813 >> v1:172.21.15.40:6789/0 conn(0x7fb68c06c690 legacy=0x7fb68c0b1ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:57.009 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:57.005+0000 7fb6837fe640 1 --2- 172.21.15.40:0/2225336813 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb6740039a0 0x7fb674003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:57.009 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:57.005+0000 7fb6837fe640 1 --2- 172.21.15.40:0/2225336813 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb68c15d580 0x7fb6740047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:57.009 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:57.005+0000 7fb6837fe640 1 --2- 172.21.15.40:0/2225336813 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb674004d00 0x7fb674005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:57.009 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:57.005+0000 7fb6837fe640 1 -- 172.21.15.40:0/2225336813 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb68c15d960 con 0x7fb674004d00 2023-12-17T11:49:57.009 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:57.005+0000 7fb6837fe640 1 -- 172.21.15.40:0/2225336813 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb67400ba30 con 0x7fb6740039a0 2023-12-17T11:49:57.010 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:57.005+0000 7fb6837fe640 1 -- 172.21.15.40:0/2225336813 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb67400bbf0 con 0x7fb68c15d580 2023-12-17T11:49:57.010 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:57.005+0000 7fb6915a6640 1 --2- 172.21.15.40:0/2225336813 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb674004d00 0x7fb674005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:57.010 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:57.006+0000 7fb690da5640 1 --2- 172.21.15.40:0/2225336813 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb6740039a0 0x7fb674003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:57.010 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:57.006+0000 7fb683fff640 1 --2- 172.21.15.40:0/2225336813 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb68c15d580 0x7fb6740047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:57.010 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:57.006+0000 7fb6915a6640 1 -- 172.21.15.40:0/2225336813 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb68c15d580 msgr2=0x7fb6740047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:49:57.010 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:57.006+0000 7fb6915a6640 1 --2- 172.21.15.40:0/2225336813 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb68c15d580 0x7fb6740047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:57.010 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:57.006+0000 7fb6915a6640 1 -- 172.21.15.40:0/2225336813 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb6740039a0 msgr2=0x7fb674003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:49:57.010 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:57.006+0000 7fb6915a6640 1 --2- 172.21.15.40:0/2225336813 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb6740039a0 0x7fb674003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:57.010 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:57.006+0000 7fb6915a6640 1 -- 172.21.15.40:0/2225336813 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb674003520 con 0x7fb674004d00 2023-12-17T11:49:57.010 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:57.006+0000 7fb683fff640 1 --2- 172.21.15.40:0/2225336813 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb68c15d580 0x7fb6740047c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-17T11:49:57.010 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:57.006+0000 7fb690da5640 1 --2- 172.21.15.40:0/2225336813 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb6740039a0 0x7fb674003dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-17T11:49:57.011 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:57.007+0000 7fb6915a6640 1 --2- 172.21.15.40:0/2225336813 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb674004d00 0x7fb674005180 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fb68c0717f0 tx=0x7fb6740057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a71ff4ada99863c server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:49:57.012 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:57.008+0000 7fb6837fe640 1 -- 172.21.15.40:0/2225336813 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6840072d0 con 0x7fb674004d00 2023-12-17T11:49:57.012 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:57.008+0000 7fb6837fe640 1 -- 172.21.15.40:0/2225336813 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb68402f070 con 0x7fb674004d00 2023-12-17T11:49:57.012 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:57.008+0000 7fb6837fe640 1 -- 172.21.15.40:0/2225336813 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6840076b0 con 0x7fb674004d00 2023-12-17T11:49:57.012 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:57.008+0000 7fb693009640 1 -- 172.21.15.40:0/2225336813 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb674004d00 msgr2=0x7fb674005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:57.012 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:57.008+0000 7fb693009640 1 --2- 172.21.15.40:0/2225336813 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb674004d00 0x7fb674005180 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fb68c0717f0 tx=0x7fb6740057f0 comp rx=0 tx=0).stop 2023-12-17T11:49:57.012 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:57.008+0000 7fb6915a6640 1 -- 172.21.15.40:0/2225336813 reap_dead start 2023-12-17T11:49:57.012 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:57.008+0000 7fb693009640 1 -- 172.21.15.40:0/2225336813 shutdown_connections 2023-12-17T11:49:57.012 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:57.008+0000 7fb693009640 1 -- 172.21.15.40:0/2225336813 >> 172.21.15.40:0/2225336813 conn(0x7fb68c0d0e90 msgr2=0x7fb68c0d12a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:49:57.012 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:57.008+0000 7fb693009640 1 -- 172.21.15.40:0/2225336813 shutdown_connections 2023-12-17T11:49:57.012 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:57.008+0000 7fb693009640 1 -- 172.21.15.40:0/2225336813 wait complete. 2023-12-17T11:49:57.014 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:57.010+0000 7fb693009640 1 Processor -- start 2023-12-17T11:49:57.014 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:57.010+0000 7fb693009640 1 -- start start 2023-12-17T11:49:57.014 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:57.011+0000 7fb693009640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb674004d00 0x7fb68c0b59d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:57.014 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:57.011+0000 7fb693009640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb68c1562f0 0x7fb68c0afd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:57.014 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:57.011+0000 7fb693009640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb68c156770 0x7fb68c0b02a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:57.014 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:57.011+0000 7fb693009640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb68c0c6a80 con 0x7fb68c1562f0 2023-12-17T11:49:57.014 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:57.011+0000 7fb693009640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb68c0b5540 con 0x7fb68c156770 2023-12-17T11:49:57.014 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:57.011+0000 7fb693009640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb68c0b4930 con 0x7fb674004d00 2023-12-17T11:49:57.014 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:57.012+0000 7fb683fff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb68c1562f0 0x7fb68c0afd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:57.015 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:57.012+0000 7fb683fff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb68c1562f0 0x7fb68c0afd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:33806/0 (socket says 172.21.15.40:33806) 2023-12-17T11:49:57.015 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:57.012+0000 7fb683fff640 1 -- 172.21.15.40:0/3382950995 learned_addr learned my addr 172.21.15.40:0/3382950995 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-17T11:49:57.015 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:57.012+0000 7fb690da5640 1 --2- 172.21.15.40:0/3382950995 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb674004d00 0x7fb68c0b59d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:57.015 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:57.012+0000 7fb6915a6640 1 --2- 172.21.15.40:0/3382950995 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb68c156770 0x7fb68c0b02a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:57.015 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:57.012+0000 7fb683fff640 1 -- 172.21.15.40:0/3382950995 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb674004d00 msgr2=0x7fb68c0b59d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:57.015 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:57.012+0000 7fb683fff640 1 --2- 172.21.15.40:0/3382950995 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb674004d00 0x7fb68c0b59d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:57.015 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:57.012+0000 7fb683fff640 1 -- 172.21.15.40:0/3382950995 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb68c156770 msgr2=0x7fb68c0b02a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:57.015 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:57.012+0000 7fb683fff640 1 --2- 172.21.15.40:0/3382950995 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb68c156770 0x7fb68c0b02a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:57.015 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:57.012+0000 7fb683fff640 1 -- 172.21.15.40:0/3382950995 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb68c0b4c10 con 0x7fb68c1562f0 2023-12-17T11:49:57.016 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:57.012+0000 7fb683fff640 1 --2- 172.21.15.40:0/3382950995 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb68c1562f0 0x7fb68c0afd60 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7fb67c00d7a0 tx=0x7fb67c00dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:49:57.016 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:57.013+0000 7fb6817fa640 1 -- 172.21.15.40:0/3382950995 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb67c017070 con 0x7fb68c1562f0 2023-12-17T11:49:57.016 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:57.013+0000 7fb6817fa640 1 -- 172.21.15.40:0/3382950995 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb67c005070 con 0x7fb68c1562f0 2023-12-17T11:49:57.016 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:57.013+0000 7fb6817fa640 1 -- 172.21.15.40:0/3382950995 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb67c005420 con 0x7fb68c1562f0 2023-12-17T11:49:57.016 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:57.013+0000 7fb693009640 1 -- 172.21.15.40:0/3382950995 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb68c0b4ef0 con 0x7fb68c1562f0 2023-12-17T11:49:57.016 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:57.013+0000 7fb693009640 1 -- 172.21.15.40:0/3382950995 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb68c0b5f10 con 0x7fb68c1562f0 2023-12-17T11:49:57.016 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:57.014+0000 7fb693009640 1 -- 172.21.15.40:0/3382950995 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb68c0b56d0 con 0x7fb68c1562f0 2023-12-17T11:49:57.017 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:57.015+0000 7fb6817fa640 1 -- 172.21.15.40:0/3382950995 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fb67c007030 con 0x7fb68c1562f0 2023-12-17T11:49:57.018 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:57.016+0000 7fb6817fa640 1 --2- 172.21.15.40:0/3382950995 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7fb67806ae40 0x7fb67806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:57.018 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:57.016+0000 7fb6817fa640 1 -- 172.21.15.40:0/3382950995 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fb67c089150 con 0x7fb68c1562f0 2023-12-17T11:49:57.018 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:57.017+0000 7fb690da5640 1 --2- 172.21.15.40:0/3382950995 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7fb67806ae40 0x7fb67806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:57.020 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:57.018+0000 7fb690da5640 1 --2- 172.21.15.40:0/3382950995 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7fb67806ae40 0x7fb67806d300 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fb688009a10 tx=0x7fb688008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:49:57.022 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:57.021+0000 7fb6817fa640 1 -- 172.21.15.40:0/3382950995 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fb67c054020 con 0x7fb68c1562f0 2023-12-17T11:49:57.216 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:57.214+0000 7fb693009640 1 -- 172.21.15.40:0/3382950995 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb68c0745d0 con 0x7fb68c1562f0 2023-12-17T11:49:57.218 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:57.216+0000 7fb6817fa640 1 -- 172.21.15.40:0/3382950995 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v40) v1 ==== 74+0+16750 (secure 0 0 0) 0x7fb67c057640 con 0x7fb68c1562f0 2023-12-17T11:49:57.219 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T11:49:57.219 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":40,"fsid":"099cd35d-80d9-4ca4-8424-de13b3b03ac7","created":"2023-12-17T11:47:53.450097+0000","modified":"2023-12-17T11:49:54.208569+0000","last_up_change":"2023-12-17T11:48:05.724195+0000","last_in_change":"2023-12-17T11:47:56.956499+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-17T11:48:06.668943+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-12-17T11:49:50.228316+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-12-17T11:49:51.700776+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a88bfd46-63b8-48b1-9c0e-5c9cdc31bd38","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":555204741},{"type":"v1","addr":"172.21.15.40:6802","nonce":555204741}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":555204741},{"type":"v1","addr":"172.21.15.40:6807","nonce":555204741}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":555204741},{"type":"v1","addr":"172.21.15.40:6815","nonce":555204741}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6809","nonce":555204741},{"type":"v1","addr":"172.21.15.40:6812","nonce":555204741}]},"public_addr":"172.21.15.40:6802/555204741","cluster_addr":"172.21.15.40:6807/555204741","heartbeat_back_addr":"172.21.15.40:6815/555204741","heartbeat_front_addr":"172.21.15.40:6812/555204741","state":["exists","up"]},{"osd":1,"uuid":"c5d628ae-36f4-4866-802c-b162f0e90add","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6801","nonce":1221318112},{"type":"v1","addr":"172.21.15.40:6803","nonce":1221318112}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6805","nonce":1221318112},{"type":"v1","addr":"172.21.15.40:6806","nonce":1221318112}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6811","nonce":1221318112},{"type":"v1","addr":"172.21.15.40:6813","nonce":1221318112}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":1221318112},{"type":"v1","addr":"172.21.15.40:6810","nonce":1221318112}]},"public_addr":"172.21.15.40:6803/1221318112","cluster_addr":"172.21.15.40:6806/1221318112","heartbeat_back_addr":"172.21.15.40:6813/1221318112","heartbeat_front_addr":"172.21.15.40:6810/1221318112","state":["exists","up"]},{"osd":2,"uuid":"d986ad6a-af2f-47fc-9c3b-fbda27b82b73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":1959000265},{"type":"v1","addr":"172.21.15.40:6817","nonce":1959000265}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6818","nonce":1959000265},{"type":"v1","addr":"172.21.15.40:6819","nonce":1959000265}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":1959000265},{"type":"v1","addr":"172.21.15.40:6827","nonce":1959000265}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":1959000265},{"type":"v1","addr":"172.21.15.40:6822","nonce":1959000265}]},"public_addr":"172.21.15.40:6817/1959000265","cluster_addr":"172.21.15.40:6819/1959000265","heartbeat_back_addr":"172.21.15.40:6827/1959000265","heartbeat_front_addr":"172.21.15.40:6822/1959000265","state":["exists","up"]},{"osd":3,"uuid":"d79d22b7-be05-41b2-b95d-697db677fd02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6821","nonce":974040287},{"type":"v1","addr":"172.21.15.40:6823","nonce":974040287}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6825","nonce":974040287},{"type":"v1","addr":"172.21.15.40:6826","nonce":974040287}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":974040287},{"type":"v1","addr":"172.21.15.40:6831","nonce":974040287}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":974040287},{"type":"v1","addr":"172.21.15.40:6829","nonce":974040287}]},"public_addr":"172.21.15.40:6823/974040287","cluster_addr":"172.21.15.40:6826/974040287","heartbeat_back_addr":"172.21.15.40:6831/974040287","heartbeat_front_addr":"172.21.15.40:6829/974040287","state":["exists","up"]},{"osd":4,"uuid":"62a7a233-d3ea-40be-91de-180c0208d639","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6808","nonce":3937787733},{"type":"v1","addr":"172.21.15.159:6809","nonce":3937787733}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6810","nonce":3937787733},{"type":"v1","addr":"172.21.15.159:6811","nonce":3937787733}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6814","nonce":3937787733},{"type":"v1","addr":"172.21.15.159:6815","nonce":3937787733}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6812","nonce":3937787733},{"type":"v1","addr":"172.21.15.159:6813","nonce":3937787733}]},"public_addr":"172.21.15.159:6809/3937787733","cluster_addr":"172.21.15.159:6811/3937787733","heartbeat_back_addr":"172.21.15.159:6815/3937787733","heartbeat_front_addr":"172.21.15.159:6813/3937787733","state":["exists","up"]},{"osd":5,"uuid":"84629cea-dc0e-4b5e-b203-5ea963839281","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6816","nonce":3032505240},{"type":"v1","addr":"172.21.15.159:6817","nonce":3032505240}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6818","nonce":3032505240},{"type":"v1","addr":"172.21.15.159:6819","nonce":3032505240}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6822","nonce":3032505240},{"type":"v1","addr":"172.21.15.159:6823","nonce":3032505240}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6820","nonce":3032505240},{"type":"v1","addr":"172.21.15.159:6821","nonce":3032505240}]},"public_addr":"172.21.15.159:6817/3032505240","cluster_addr":"172.21.15.159:6819/3032505240","heartbeat_back_addr":"172.21.15.159:6823/3032505240","heartbeat_front_addr":"172.21.15.159:6821/3032505240","state":["exists","up"]},{"osd":6,"uuid":"4ae3af3a-1743-4070-a91d-8be5c31cdb04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6800","nonce":2411788597},{"type":"v1","addr":"172.21.15.159:6801","nonce":2411788597}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6802","nonce":2411788597},{"type":"v1","addr":"172.21.15.159:6803","nonce":2411788597}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6806","nonce":2411788597},{"type":"v1","addr":"172.21.15.159:6807","nonce":2411788597}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6804","nonce":2411788597},{"type":"v1","addr":"172.21.15.159:6805","nonce":2411788597}]},"public_addr":"172.21.15.159:6801/2411788597","cluster_addr":"172.21.15.159:6803/2411788597","heartbeat_back_addr":"172.21.15.159:6807/2411788597","heartbeat_front_addr":"172.21.15.159:6805/2411788597","state":["exists","up"]},{"osd":7,"uuid":"c1f4c7f2-8f75-4f95-bc63-a332773e3b8e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6824","nonce":478953349},{"type":"v1","addr":"172.21.15.159:6825","nonce":478953349}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6826","nonce":478953349},{"type":"v1","addr":"172.21.15.159:6827","nonce":478953349}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6830","nonce":478953349},{"type":"v1","addr":"172.21.15.159:6831","nonce":478953349}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6828","nonce":478953349},{"type":"v1","addr":"172.21.15.159:6829","nonce":478953349}]},"public_addr":"172.21.15.159:6825/478953349","cluster_addr":"172.21.15.159:6827/478953349","heartbeat_back_addr":"172.21.15.159:6831/478953349","heartbeat_front_addr":"172.21.15.159:6829/478953349","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T11:48:02.023567+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T11:48:02.278216+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T11:48:02.311843+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T11:48:01.773372+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T11:48:02.618910+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T11:48:02.361559+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T11:48:02.223997+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T11:48:02.604403+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-17T11:49:57.222 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:57.219+0000 7fb693009640 1 -- 172.21.15.40:0/3382950995 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7fb67806ae40 msgr2=0x7fb67806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:57.222 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:57.219+0000 7fb693009640 1 --2- 172.21.15.40:0/3382950995 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7fb67806ae40 0x7fb67806d300 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fb688009a10 tx=0x7fb688008040 comp rx=0 tx=0).stop 2023-12-17T11:49:57.222 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:57.219+0000 7fb693009640 1 -- 172.21.15.40:0/3382950995 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb68c1562f0 msgr2=0x7fb68c0afd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:57.222 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:57.219+0000 7fb693009640 1 --2- 172.21.15.40:0/3382950995 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb68c1562f0 0x7fb68c0afd60 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7fb67c00d7a0 tx=0x7fb67c00dc60 comp rx=0 tx=0).stop 2023-12-17T11:49:57.222 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:57.219+0000 7fb693009640 1 -- 172.21.15.40:0/3382950995 shutdown_connections 2023-12-17T11:49:57.222 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:57.219+0000 7fb693009640 1 --2- 172.21.15.40:0/3382950995 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7fb67806ae40 0x7fb67806d300 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:57.222 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:57.219+0000 7fb693009640 1 --2- 172.21.15.40:0/3382950995 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb68c156770 0x7fb68c0b02a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:57.222 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:57.219+0000 7fb693009640 1 --2- 172.21.15.40:0/3382950995 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb68c1562f0 0x7fb68c0afd60 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:57.222 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:57.219+0000 7fb693009640 1 --2- 172.21.15.40:0/3382950995 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb674004d00 0x7fb68c0b59d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:57.222 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:57.219+0000 7fb693009640 1 -- 172.21.15.40:0/3382950995 >> 172.21.15.40:0/3382950995 conn(0x7fb68c0d0e90 msgr2=0x7fb68c0b28e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:49:57.222 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:57.219+0000 7fb693009640 1 -- 172.21.15.40:0/3382950995 shutdown_connections 2023-12-17T11:49:57.222 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:57.219+0000 7fb693009640 1 -- 172.21.15.40:0/3382950995 wait complete. 2023-12-17T11:49:57.242 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-12-17T11:49:57.242 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-17T11:49:57.460 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:57.458+0000 7f5d462d7640 1 Processor -- start 2023-12-17T11:49:57.460 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:57.458+0000 7f5d462d7640 1 -- start start 2023-12-17T11:49:57.462 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:57.460+0000 7f5d462d7640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5d4015d390 0x7f5d400b1cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:57.462 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:57.460+0000 7f5d462d7640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f5d400d0c10 0x7f5d400b04c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:57.462 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:57.460+0000 7f5d462d7640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f5d400d1410 0x7f5d400d18a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:57.462 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:57.460+0000 7f5d462d7640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d400d1de0 con 0x7f5d400d1410 2023-12-17T11:49:57.462 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:57.460+0000 7f5d462d7640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d400ceea0 con 0x7f5d400d0c10 2023-12-17T11:49:57.462 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:57.460+0000 7f5d462d7640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d400b0a00 con 0x7f5d4015d390 2023-12-17T11:49:57.463 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:57.460+0000 7f5d45ad6640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f5d400d1410 0x7f5d400d18a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:57.463 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:57.460+0000 7f5d45ad6640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f5d400d1410 0x7f5d400d18a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:33814/0 (socket says 172.21.15.40:33814) 2023-12-17T11:49:57.463 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:57.460+0000 7f5d45ad6640 1 -- 172.21.15.40:0/3954316656 learned_addr learned my addr 172.21.15.40:0/3954316656 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-17T11:49:57.463 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:57.461+0000 7f5d452d5640 1 --2- 172.21.15.40:0/3954316656 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5d4015d390 0x7f5d400b1cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:57.463 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:57.461+0000 7f5d44ad4640 1 --2- 172.21.15.40:0/3954316656 >> v2:172.21.15.159:3300/0 conn(0x7f5d400d0c10 0x7f5d400b04c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:57.463 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:57.461+0000 7f5d45ad6640 1 -- 172.21.15.40:0/3954316656 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5d4015d390 msgr2=0x7f5d400b1cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:49:57.464 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:57.461+0000 7f5d45ad6640 1 --2- 172.21.15.40:0/3954316656 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5d4015d390 0x7f5d400b1cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:57.464 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:57.461+0000 7f5d45ad6640 1 -- 172.21.15.40:0/3954316656 >> v2:172.21.15.159:3300/0 conn(0x7f5d400d0c10 msgr2=0x7f5d400b04c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:49:57.464 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:57.461+0000 7f5d45ad6640 1 --2- 172.21.15.40:0/3954316656 >> v2:172.21.15.159:3300/0 conn(0x7f5d400d0c10 0x7f5d400b04c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:57.464 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:57.461+0000 7f5d45ad6640 1 -- 172.21.15.40:0/3954316656 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d4015d770 con 0x7f5d400d1410 2023-12-17T11:49:57.464 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:57.462+0000 7f5d45ad6640 1 --2- 172.21.15.40:0/3954316656 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5d400d1410 0x7f5d400d18a0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f5d4008bba0 tx=0x7f5d3802be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2589988dc2d72b34 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:49:57.464 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:57.462+0000 7f5d37fff640 1 -- 172.21.15.40:0/3954316656 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d3802c9e0 con 0x7f5d400d1410 2023-12-17T11:49:57.465 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:57.462+0000 7f5d37fff640 1 -- 172.21.15.40:0/3954316656 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d3802cb40 con 0x7f5d400d1410 2023-12-17T11:49:57.465 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:57.462+0000 7f5d37fff640 1 -- 172.21.15.40:0/3954316656 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d380343f0 con 0x7f5d400d1410 2023-12-17T11:49:57.465 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:57.463+0000 7f5d462d7640 1 -- 172.21.15.40:0/3954316656 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5d400d1410 msgr2=0x7f5d400d18a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:57.465 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:57.463+0000 7f5d462d7640 1 --2- 172.21.15.40:0/3954316656 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5d400d1410 0x7f5d400d18a0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f5d4008bba0 tx=0x7f5d3802be40 comp rx=0 tx=0).stop 2023-12-17T11:49:57.466 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:57.463+0000 7f5d462d7640 1 -- 172.21.15.40:0/3954316656 shutdown_connections 2023-12-17T11:49:57.466 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:57.463+0000 7f5d462d7640 1 --2- 172.21.15.40:0/3954316656 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5d400d1410 0x7f5d400d18a0 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:57.466 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:57.463+0000 7f5d462d7640 1 --2- 172.21.15.40:0/3954316656 >> v2:172.21.15.159:3300/0 conn(0x7f5d400d0c10 0x7f5d400b04c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:57.466 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:57.463+0000 7f5d462d7640 1 --2- 172.21.15.40:0/3954316656 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5d4015d390 0x7f5d400b1cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:57.466 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:57.463+0000 7f5d462d7640 1 -- 172.21.15.40:0/3954316656 >> 172.21.15.40:0/3954316656 conn(0x7f5d400d2ec0 msgr2=0x7f5d400d32d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:49:57.466 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:57.463+0000 7f5d462d7640 1 -- 172.21.15.40:0/3954316656 shutdown_connections 2023-12-17T11:49:57.466 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:57.463+0000 7f5d462d7640 1 -- 172.21.15.40:0/3954316656 wait complete. 2023-12-17T11:49:57.467 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:57.465+0000 7f5d462d7640 1 Processor -- start 2023-12-17T11:49:57.467 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:57.465+0000 7f5d462d7640 1 -- start start 2023-12-17T11:49:57.470 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:57.466+0000 7f5d462d7640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5d400d0c10 0x7f5d40158900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:57.470 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:57.466+0000 7f5d462d7640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5d400d1410 0x7f5d401f3810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:57.470 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:57.466+0000 7f5d462d7640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5d4015d390 0x7f5d4006c0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:57.470 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:57.466+0000 7f5d462d7640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d4009fa80 con 0x7f5d400d0c10 2023-12-17T11:49:57.471 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:57.466+0000 7f5d462d7640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d4009fd60 con 0x7f5d400d1410 2023-12-17T11:49:57.471 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:57.466+0000 7f5d462d7640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d400a0040 con 0x7f5d4015d390 2023-12-17T11:49:57.471 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:57.466+0000 7f5d452d5640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5d400d0c10 0x7f5d40158900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:57.471 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:57.467+0000 7f5d452d5640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5d400d0c10 0x7f5d40158900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:33816/0 (socket says 172.21.15.40:33816) 2023-12-17T11:49:57.471 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:57.467+0000 7f5d452d5640 1 -- 172.21.15.40:0/2601259319 learned_addr learned my addr 172.21.15.40:0/2601259319 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-17T11:49:57.471 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:57.467+0000 7f5d44ad4640 1 --2- 172.21.15.40:0/2601259319 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5d400d1410 0x7f5d401f3810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:57.471 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:57.467+0000 7f5d452d5640 1 -- 172.21.15.40:0/2601259319 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5d4015d390 msgr2=0x7f5d4006c0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:57.471 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:57.467+0000 7f5d452d5640 1 --2- 172.21.15.40:0/2601259319 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5d4015d390 0x7f5d4006c0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:57.471 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:57.467+0000 7f5d452d5640 1 -- 172.21.15.40:0/2601259319 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5d400d1410 msgr2=0x7f5d401f3810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:57.471 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:57.467+0000 7f5d452d5640 1 --2- 172.21.15.40:0/2601259319 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5d400d1410 0x7f5d401f3810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:57.471 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:57.467+0000 7f5d452d5640 1 -- 172.21.15.40:0/2601259319 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d38009b30 con 0x7f5d400d0c10 2023-12-17T11:49:57.471 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:57.467+0000 7f5d44ad4640 1 --2- 172.21.15.40:0/2601259319 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5d400d1410 0x7f5d401f3810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-17T11:49:57.471 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:57.467+0000 7f5d452d5640 1 --2- 172.21.15.40:0/2601259319 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5d400d0c10 0x7f5d40158900 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f5d3c00d5f0 tx=0x7f5d3c00dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:49:57.471 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:57.467+0000 7f5d35ffb640 1 -- 172.21.15.40:0/2601259319 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d3c0125f0 con 0x7f5d400d0c10 2023-12-17T11:49:57.472 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:57.468+0000 7f5d35ffb640 1 -- 172.21.15.40:0/2601259319 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d3c012750 con 0x7f5d400d0c10 2023-12-17T11:49:57.472 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:57.468+0000 7f5d35ffb640 1 -- 172.21.15.40:0/2601259319 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d3c012b00 con 0x7f5d400d0c10 2023-12-17T11:49:57.472 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:57.468+0000 7f5d462d7640 1 -- 172.21.15.40:0/2601259319 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d401f43a0 con 0x7f5d400d0c10 2023-12-17T11:49:57.472 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:57.468+0000 7f5d462d7640 1 -- 172.21.15.40:0/2601259319 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d401596e0 con 0x7f5d400d0c10 2023-12-17T11:49:57.472 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:57.469+0000 7f5d462d7640 1 -- 172.21.15.40:0/2601259319 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d401f4200 con 0x7f5d400d0c10 2023-12-17T11:49:57.472 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:57.470+0000 7f5d35ffb640 1 -- 172.21.15.40:0/2601259319 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f5d3c012c60 con 0x7f5d400d0c10 2023-12-17T11:49:57.473 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:57.471+0000 7f5d35ffb640 1 --2- 172.21.15.40:0/2601259319 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f5d2406ae40 0x7f5d2406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:57.473 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:57.471+0000 7f5d35ffb640 1 -- 172.21.15.40:0/2601259319 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f5d3c089c30 con 0x7f5d400d0c10 2023-12-17T11:49:57.475 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:57.472+0000 7f5d44ad4640 1 --2- 172.21.15.40:0/2601259319 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f5d2406ae40 0x7f5d2406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:57.475 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:57.473+0000 7f5d44ad4640 1 --2- 172.21.15.40:0/2601259319 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f5d2406ae40 0x7f5d2406d300 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f5d400d2350 tx=0x7f5d30008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:49:57.478 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:57.477+0000 7f5d35ffb640 1 -- 172.21.15.40:0/2601259319 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f5d401f4200 con 0x7f5d400d0c10 2023-12-17T11:49:57.671 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:57.669+0000 7f5d462d7640 1 -- 172.21.15.40:0/2601259319 --> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f5d400b0f10 con 0x7f5d2406ae40 2023-12-17T11:49:57.696 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:57.694+0000 7f5d35ffb640 1 -- 172.21.15.40:0/2601259319 <== mgr.4105 v2:172.21.15.159:6832/479465803 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+276475 (secure 0 0 0) 0x7f5d30009e10 con 0x7f5d2406ae40 2023-12-17T11:49:57.700 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T11:49:57.702 INFO:teuthology.orchestra.run.smithi040.stderr:dumped all 2023-12-17T11:49:57.704 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:57.700+0000 7f5d462d7640 1 -- 172.21.15.40:0/2601259319 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f5d2406ae40 msgr2=0x7f5d2406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:57.704 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:57.700+0000 7f5d462d7640 1 --2- 172.21.15.40:0/2601259319 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f5d2406ae40 0x7f5d2406d300 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f5d400d2350 tx=0x7f5d30008040 comp rx=0 tx=0).stop 2023-12-17T11:49:57.704 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:57.700+0000 7f5d462d7640 1 -- 172.21.15.40:0/2601259319 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5d400d0c10 msgr2=0x7f5d40158900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:57.704 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:57.700+0000 7f5d462d7640 1 --2- 172.21.15.40:0/2601259319 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5d400d0c10 0x7f5d40158900 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f5d3c00d5f0 tx=0x7f5d3c00dab0 comp rx=0 tx=0).stop 2023-12-17T11:49:57.704 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:57.701+0000 7f5d462d7640 1 -- 172.21.15.40:0/2601259319 shutdown_connections 2023-12-17T11:49:57.704 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:57.701+0000 7f5d462d7640 1 --2- 172.21.15.40:0/2601259319 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f5d2406ae40 0x7f5d2406d300 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:57.704 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:57.701+0000 7f5d462d7640 1 --2- 172.21.15.40:0/2601259319 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f5d4015d390 0x7f5d4006c0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:57.704 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:57.701+0000 7f5d462d7640 1 --2- 172.21.15.40:0/2601259319 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5d400d1410 0x7f5d401f3810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:57.704 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:57.701+0000 7f5d462d7640 1 --2- 172.21.15.40:0/2601259319 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5d400d0c10 0x7f5d40158900 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:57.704 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:57.701+0000 7f5d462d7640 1 -- 172.21.15.40:0/2601259319 >> 172.21.15.40:0/2601259319 conn(0x7f5d400d2ec0 msgr2=0x7f5d400afab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:49:57.704 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:57.701+0000 7f5d462d7640 1 -- 172.21.15.40:0/2601259319 shutdown_connections 2023-12-17T11:49:57.705 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:57.701+0000 7f5d462d7640 1 -- 172.21.15.40:0/2601259319 wait complete. 2023-12-17T11:49:57.722 INFO:teuthology.orchestra.run.smithi040.stdout:{"pg_ready":true,"pg_map":{"version":88,"stamp":"2023-12-17T11:49:56.631067+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":171,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":126,"ondisk_log_size":126,"up":86,"acting":86,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":30,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220668,"kb_used_data":4484,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754052,"statfs":{"total":773094113280,"available":772868149248,"internally_reserved":0,"allocated":4591616,"data_stored":2608582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":221236786},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":28,"apply_latency_ms":28,"commit_latency_ns":28000000,"apply_latency_ns":28000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.446562"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-17T11:49:52.179538+0000","last_change":"2023-12-17T11:49:52.179538+0000","last_active":"2023-12-17T11:49:52.179538+0000","last_peered":"2023-12-17T11:49:52.179538+0000","last_clean":"2023-12-17T11:49:52.179538+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-17T11:49:52.179538+0000","last_undegraded":"2023-12-17T11:49:52.179538+0000","last_fullsized":"2023-12-17T11:49:52.179538+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-17T11:49:52.179538+0000","last_change":"2023-12-17T11:49:52.179538+0000","last_active":"2023-12-17T11:49:52.179538+0000","last_peered":"2023-12-17T11:49:52.179538+0000","last_clean":"2023-12-17T11:49:52.179538+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-17T11:49:52.179538+0000","last_undegraded":"2023-12-17T11:49:52.179538+0000","last_fullsized":"2023-12-17T11:49:52.179538+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-17T11:49:52.179538+0000","last_change":"2023-12-17T11:49:52.179538+0000","last_active":"2023-12-17T11:49:52.179538+0000","last_peered":"2023-12-17T11:49:52.179538+0000","last_clean":"2023-12-17T11:49:52.179538+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-17T11:49:52.179538+0000","last_undegraded":"2023-12-17T11:49:52.179538+0000","last_fullsized":"2023-12-17T11:49:52.179538+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-17T11:49:52.179538+0000","last_change":"2023-12-17T11:49:52.179538+0000","last_active":"2023-12-17T11:49:52.179538+0000","last_peered":"2023-12-17T11:49:52.179538+0000","last_clean":"2023-12-17T11:49:52.179538+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-17T11:49:52.179538+0000","last_undegraded":"2023-12-17T11:49:52.179538+0000","last_fullsized":"2023-12-17T11:49:52.179538+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-17T11:49:52.179538+0000","last_change":"2023-12-17T11:49:52.179538+0000","last_active":"2023-12-17T11:49:52.179538+0000","last_peered":"2023-12-17T11:49:52.179538+0000","last_clean":"2023-12-17T11:49:52.179538+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-17T11:49:52.179538+0000","last_undegraded":"2023-12-17T11:49:52.179538+0000","last_fullsized":"2023-12-17T11:49:52.179538+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-17T11:49:52.179538+0000","last_change":"2023-12-17T11:49:52.179538+0000","last_active":"2023-12-17T11:49:52.179538+0000","last_peered":"2023-12-17T11:49:52.179538+0000","last_clean":"2023-12-17T11:49:52.179538+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-17T11:49:52.179538+0000","last_undegraded":"2023-12-17T11:49:52.179538+0000","last_fullsized":"2023-12-17T11:49:52.179538+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-17T11:49:52.179538+0000","last_change":"2023-12-17T11:49:52.179538+0000","last_active":"2023-12-17T11:49:52.179538+0000","last_peered":"2023-12-17T11:49:52.179538+0000","last_clean":"2023-12-17T11:49:52.179538+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-17T11:49:52.179538+0000","last_undegraded":"2023-12-17T11:49:52.179538+0000","last_fullsized":"2023-12-17T11:49:52.179538+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-17T11:49:52.179538+0000","last_change":"2023-12-17T11:49:52.179538+0000","last_active":"2023-12-17T11:49:52.179538+0000","last_peered":"2023-12-17T11:49:52.179538+0000","last_clean":"2023-12-17T11:49:52.179538+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-17T11:49:52.179538+0000","last_undegraded":"2023-12-17T11:49:52.179538+0000","last_fullsized":"2023-12-17T11:49:52.179538+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-17T11:49:52.179538+0000","last_change":"2023-12-17T11:49:52.179538+0000","last_active":"2023-12-17T11:49:52.179538+0000","last_peered":"2023-12-17T11:49:52.179538+0000","last_clean":"2023-12-17T11:49:52.179538+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-17T11:49:52.179538+0000","last_undegraded":"2023-12-17T11:49:52.179538+0000","last_fullsized":"2023-12-17T11:49:52.179538+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-17T11:49:52.179538+0000","last_change":"2023-12-17T11:49:52.179538+0000","last_active":"2023-12-17T11:49:52.179538+0000","last_peered":"2023-12-17T11:49:52.179538+0000","last_clean":"2023-12-17T11:49:52.179538+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-17T11:49:52.179538+0000","last_undegraded":"2023-12-17T11:49:52.179538+0000","last_fullsized":"2023-12-17T11:49:52.179538+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-17T11:49:52.179538+0000","last_change":"2023-12-17T11:49:52.179538+0000","last_active":"2023-12-17T11:49:52.179538+0000","last_peered":"2023-12-17T11:49:52.179538+0000","last_clean":"2023-12-17T11:49:52.179538+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-17T11:49:52.179538+0000","last_undegraded":"2023-12-17T11:49:52.179538+0000","last_fullsized":"2023-12-17T11:49:52.179538+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-17T11:49:52.179538+0000","last_change":"2023-12-17T11:49:52.179538+0000","last_active":"2023-12-17T11:49:52.179538+0000","last_peered":"2023-12-17T11:49:52.179538+0000","last_clean":"2023-12-17T11:49:52.179538+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-17T11:49:52.179538+0000","last_undegraded":"2023-12-17T11:49:52.179538+0000","last_fullsized":"2023-12-17T11:49:52.179538+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-17T11:49:52.179538+0000","last_change":"2023-12-17T11:49:52.179538+0000","last_active":"2023-12-17T11:49:52.179538+0000","last_peered":"2023-12-17T11:49:52.179538+0000","last_clean":"2023-12-17T11:49:52.179538+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-17T11:49:52.179538+0000","last_undegraded":"2023-12-17T11:49:52.179538+0000","last_fullsized":"2023-12-17T11:49:52.179538+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-17T11:49:52.179538+0000","last_change":"2023-12-17T11:49:52.179538+0000","last_active":"2023-12-17T11:49:52.179538+0000","last_peered":"2023-12-17T11:49:52.179538+0000","last_clean":"2023-12-17T11:49:52.179538+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-17T11:49:52.179538+0000","last_undegraded":"2023-12-17T11:49:52.179538+0000","last_fullsized":"2023-12-17T11:49:52.179538+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-17T11:49:52.179538+0000","last_change":"2023-12-17T11:49:52.179538+0000","last_active":"2023-12-17T11:49:52.179538+0000","last_peered":"2023-12-17T11:49:52.179538+0000","last_clean":"2023-12-17T11:49:52.179538+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-17T11:49:52.179538+0000","last_undegraded":"2023-12-17T11:49:52.179538+0000","last_fullsized":"2023-12-17T11:49:52.179538+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:55.301502+0000","last_change":"2023-12-17T11:49:53.256736+0000","last_active":"2023-12-17T11:49:55.301502+0000","last_peered":"2023-12-17T11:49:55.301502+0000","last_clean":"2023-12-17T11:49:55.301502+0000","last_became_active":"2023-12-17T11:49:53.256319+0000","last_became_peered":"2023-12-17T11:49:53.256319+0000","last_unstale":"2023-12-17T11:49:55.301502+0000","last_undegraded":"2023-12-17T11:49:55.301502+0000","last_fullsized":"2023-12-17T11:49:55.301502+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T14:49:05.628056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:55.302967+0000","last_change":"2023-12-17T11:49:53.254466+0000","last_active":"2023-12-17T11:49:55.302967+0000","last_peered":"2023-12-17T11:49:55.302967+0000","last_clean":"2023-12-17T11:49:55.302967+0000","last_became_active":"2023-12-17T11:49:53.254191+0000","last_became_peered":"2023-12-17T11:49:53.254191+0000","last_unstale":"2023-12-17T11:49:55.302967+0000","last_undegraded":"2023-12-17T11:49:55.302967+0000","last_fullsized":"2023-12-17T11:49:55.302967+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T15:34:59.184998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-17T11:49:52.179538+0000","last_change":"2023-12-17T11:49:52.179538+0000","last_active":"2023-12-17T11:49:52.179538+0000","last_peered":"2023-12-17T11:49:52.179538+0000","last_clean":"2023-12-17T11:49:52.179538+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-17T11:49:52.179538+0000","last_undegraded":"2023-12-17T11:49:52.179538+0000","last_fullsized":"2023-12-17T11:49:52.179538+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-17T11:49:52.179538+0000","last_change":"2023-12-17T11:49:52.179538+0000","last_active":"2023-12-17T11:49:52.179538+0000","last_peered":"2023-12-17T11:49:52.179538+0000","last_clean":"2023-12-17T11:49:52.179538+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-17T11:49:52.179538+0000","last_undegraded":"2023-12-17T11:49:52.179538+0000","last_fullsized":"2023-12-17T11:49:52.179538+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-17T11:49:52.179538+0000","last_change":"2023-12-17T11:49:52.179538+0000","last_active":"2023-12-17T11:49:52.179538+0000","last_peered":"2023-12-17T11:49:52.179538+0000","last_clean":"2023-12-17T11:49:52.179538+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-17T11:49:52.179538+0000","last_undegraded":"2023-12-17T11:49:52.179538+0000","last_fullsized":"2023-12-17T11:49:52.179538+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-17T11:49:52.179538+0000","last_change":"2023-12-17T11:49:52.179538+0000","last_active":"2023-12-17T11:49:52.179538+0000","last_peered":"2023-12-17T11:49:52.179538+0000","last_clean":"2023-12-17T11:49:52.179538+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-17T11:49:52.179538+0000","last_undegraded":"2023-12-17T11:49:52.179538+0000","last_fullsized":"2023-12-17T11:49:52.179538+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-17T11:49:52.179538+0000","last_change":"2023-12-17T11:49:52.179538+0000","last_active":"2023-12-17T11:49:52.179538+0000","last_peered":"2023-12-17T11:49:52.179538+0000","last_clean":"2023-12-17T11:49:52.179538+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-17T11:49:52.179538+0000","last_undegraded":"2023-12-17T11:49:52.179538+0000","last_fullsized":"2023-12-17T11:49:52.179538+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:55.301627+0000","last_change":"2023-12-17T11:49:53.235006+0000","last_active":"2023-12-17T11:49:55.301627+0000","last_peered":"2023-12-17T11:49:55.301627+0000","last_clean":"2023-12-17T11:49:55.301627+0000","last_became_active":"2023-12-17T11:49:53.232828+0000","last_became_peered":"2023-12-17T11:49:53.232828+0000","last_unstale":"2023-12-17T11:49:55.301627+0000","last_undegraded":"2023-12-17T11:49:55.301627+0000","last_fullsized":"2023-12-17T11:49:55.301627+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T21:34:46.442330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-17T11:49:52.179538+0000","last_change":"2023-12-17T11:49:52.179538+0000","last_active":"2023-12-17T11:49:52.179538+0000","last_peered":"2023-12-17T11:49:52.179538+0000","last_clean":"2023-12-17T11:49:52.179538+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-17T11:49:52.179538+0000","last_undegraded":"2023-12-17T11:49:52.179538+0000","last_fullsized":"2023-12-17T11:49:52.179538+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-17T11:49:52.179538+0000","last_change":"2023-12-17T11:49:52.179538+0000","last_active":"2023-12-17T11:49:52.179538+0000","last_peered":"2023-12-17T11:49:52.179538+0000","last_clean":"2023-12-17T11:49:52.179538+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-17T11:49:52.179538+0000","last_undegraded":"2023-12-17T11:49:52.179538+0000","last_fullsized":"2023-12-17T11:49:52.179538+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-17T11:49:52.179538+0000","last_change":"2023-12-17T11:49:52.179538+0000","last_active":"2023-12-17T11:49:52.179538+0000","last_peered":"2023-12-17T11:49:52.179538+0000","last_clean":"2023-12-17T11:49:52.179538+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-17T11:49:52.179538+0000","last_undegraded":"2023-12-17T11:49:52.179538+0000","last_fullsized":"2023-12-17T11:49:52.179538+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-17T11:49:52.179538+0000","last_change":"2023-12-17T11:49:52.179538+0000","last_active":"2023-12-17T11:49:52.179538+0000","last_peered":"2023-12-17T11:49:52.179538+0000","last_clean":"2023-12-17T11:49:52.179538+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-17T11:49:52.179538+0000","last_undegraded":"2023-12-17T11:49:52.179538+0000","last_fullsized":"2023-12-17T11:49:52.179538+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-17T11:49:52.179538+0000","last_change":"2023-12-17T11:49:52.179538+0000","last_active":"2023-12-17T11:49:52.179538+0000","last_peered":"2023-12-17T11:49:52.179538+0000","last_clean":"2023-12-17T11:49:52.179538+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-17T11:49:52.179538+0000","last_undegraded":"2023-12-17T11:49:52.179538+0000","last_fullsized":"2023-12-17T11:49:52.179538+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-17T11:49:52.179538+0000","last_change":"2023-12-17T11:49:52.179538+0000","last_active":"2023-12-17T11:49:52.179538+0000","last_peered":"2023-12-17T11:49:52.179538+0000","last_clean":"2023-12-17T11:49:52.179538+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-17T11:49:52.179538+0000","last_undegraded":"2023-12-17T11:49:52.179538+0000","last_fullsized":"2023-12-17T11:49:52.179538+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-17T11:49:52.179538+0000","last_change":"2023-12-17T11:49:52.179538+0000","last_active":"2023-12-17T11:49:52.179538+0000","last_peered":"2023-12-17T11:49:52.179538+0000","last_clean":"2023-12-17T11:49:52.179538+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-17T11:49:52.179538+0000","last_undegraded":"2023-12-17T11:49:52.179538+0000","last_fullsized":"2023-12-17T11:49:52.179538+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:55.301788+0000","last_change":"2023-12-17T11:49:53.239855+0000","last_active":"2023-12-17T11:49:55.301788+0000","last_peered":"2023-12-17T11:49:55.301788+0000","last_clean":"2023-12-17T11:49:55.301788+0000","last_became_active":"2023-12-17T11:49:53.239579+0000","last_became_peered":"2023-12-17T11:49:53.239579+0000","last_unstale":"2023-12-17T11:49:55.301788+0000","last_undegraded":"2023-12-17T11:49:55.301788+0000","last_fullsized":"2023-12-17T11:49:55.301788+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T20:29:09.996550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-17T11:49:52.179538+0000","last_change":"2023-12-17T11:49:52.179538+0000","last_active":"2023-12-17T11:49:52.179538+0000","last_peered":"2023-12-17T11:49:52.179538+0000","last_clean":"2023-12-17T11:49:52.179538+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-17T11:49:52.179538+0000","last_undegraded":"2023-12-17T11:49:52.179538+0000","last_fullsized":"2023-12-17T11:49:52.179538+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:55.302468+0000","last_change":"2023-12-17T11:49:53.245226+0000","last_active":"2023-12-17T11:49:55.302468+0000","last_peered":"2023-12-17T11:49:55.302468+0000","last_clean":"2023-12-17T11:49:55.302468+0000","last_became_active":"2023-12-17T11:49:53.243115+0000","last_became_peered":"2023-12-17T11:49:53.243115+0000","last_unstale":"2023-12-17T11:49:55.302468+0000","last_undegraded":"2023-12-17T11:49:55.302468+0000","last_fullsized":"2023-12-17T11:49:55.302468+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T15:06:34.831619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-12-17T11:49:51.190581+0000","last_change":"2023-12-17T11:49:51.190581+0000","last_active":"2023-12-17T11:49:51.168108+0000","last_peered":"2023-12-17T11:49:51.168108+0000","last_clean":"2023-12-17T11:49:51.168108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-17T11:49:51.190581+0000","last_undegraded":"2023-12-17T11:49:51.190581+0000","last_fullsized":"2023-12-17T11:49:51.190581+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_clean_scrub_stamp":"2023-12-17T11:49:51.168108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-17T11:49:52.179538+0000","last_change":"2023-12-17T11:49:52.179538+0000","last_active":"2023-12-17T11:49:52.179538+0000","last_peered":"2023-12-17T11:49:52.179538+0000","last_clean":"2023-12-17T11:49:52.179538+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-17T11:49:52.179538+0000","last_undegraded":"2023-12-17T11:49:52.179538+0000","last_fullsized":"2023-12-17T11:49:52.179538+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-12-17T11:49:51.191553+0000","last_change":"2023-12-17T11:49:51.191553+0000","last_active":"2023-12-17T11:49:51.168108+0000","last_peered":"2023-12-17T11:49:51.168108+0000","last_clean":"2023-12-17T11:49:51.168108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-17T11:49:51.191553+0000","last_undegraded":"2023-12-17T11:49:51.191553+0000","last_fullsized":"2023-12-17T11:49:51.191553+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_clean_scrub_stamp":"2023-12-17T11:49:51.168108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-17T11:49:52.179538+0000","last_change":"2023-12-17T11:49:52.179538+0000","last_active":"2023-12-17T11:49:52.179538+0000","last_peered":"2023-12-17T11:49:52.179538+0000","last_clean":"2023-12-17T11:49:52.179538+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-17T11:49:52.179538+0000","last_undegraded":"2023-12-17T11:49:52.179538+0000","last_fullsized":"2023-12-17T11:49:52.179538+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-12-17T11:49:51.197647+0000","last_change":"2023-12-17T11:49:51.197647+0000","last_active":"2023-12-17T11:49:51.168108+0000","last_peered":"2023-12-17T11:49:51.168108+0000","last_clean":"2023-12-17T11:49:51.168108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-17T11:49:51.197647+0000","last_undegraded":"2023-12-17T11:49:51.197647+0000","last_fullsized":"2023-12-17T11:49:51.197647+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_clean_scrub_stamp":"2023-12-17T11:49:51.168108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-17T11:49:52.179538+0000","last_change":"2023-12-17T11:49:52.179538+0000","last_active":"2023-12-17T11:49:52.179538+0000","last_peered":"2023-12-17T11:49:52.179538+0000","last_clean":"2023-12-17T11:49:52.179538+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-17T11:49:52.179538+0000","last_undegraded":"2023-12-17T11:49:52.179538+0000","last_fullsized":"2023-12-17T11:49:52.179538+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-12-17T11:49:51.200552+0000","last_change":"2023-12-17T11:49:51.200552+0000","last_active":"2023-12-17T11:49:51.168108+0000","last_peered":"2023-12-17T11:49:51.168108+0000","last_clean":"2023-12-17T11:49:51.168108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-17T11:49:51.200552+0000","last_undegraded":"2023-12-17T11:49:51.200552+0000","last_fullsized":"2023-12-17T11:49:51.200552+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_clean_scrub_stamp":"2023-12-17T11:49:51.168108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-17T11:49:52.179538+0000","last_change":"2023-12-17T11:49:52.179538+0000","last_active":"2023-12-17T11:49:52.179538+0000","last_peered":"2023-12-17T11:49:52.179538+0000","last_clean":"2023-12-17T11:49:52.179538+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-17T11:49:52.179538+0000","last_undegraded":"2023-12-17T11:49:52.179538+0000","last_fullsized":"2023-12-17T11:49:52.179538+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-12-17T11:49:51.196612+0000","last_change":"2023-12-17T11:49:51.196612+0000","last_active":"2023-12-17T11:49:51.168108+0000","last_peered":"2023-12-17T11:49:51.168108+0000","last_clean":"2023-12-17T11:49:51.168108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-17T11:49:51.196612+0000","last_undegraded":"2023-12-17T11:49:51.196612+0000","last_fullsized":"2023-12-17T11:49:51.196612+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_clean_scrub_stamp":"2023-12-17T11:49:51.168108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-17T11:49:52.179538+0000","last_change":"2023-12-17T11:49:52.179538+0000","last_active":"2023-12-17T11:49:52.179538+0000","last_peered":"2023-12-17T11:49:52.179538+0000","last_clean":"2023-12-17T11:49:52.179538+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-17T11:49:52.179538+0000","last_undegraded":"2023-12-17T11:49:52.179538+0000","last_fullsized":"2023-12-17T11:49:52.179538+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1a","version":"39'1","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:55.301855+0000","last_change":"2023-12-17T11:49:52.225053+0000","last_active":"2023-12-17T11:49:55.301855+0000","last_peered":"2023-12-17T11:49:55.301855+0000","last_clean":"2023-12-17T11:49:55.301855+0000","last_became_active":"2023-12-17T11:49:52.224761+0000","last_became_peered":"2023-12-17T11:49:52.224761+0000","last_unstale":"2023-12-17T11:49:55.301855+0000","last_undegraded":"2023-12-17T11:49:55.301855+0000","last_fullsized":"2023-12-17T11:49:55.301855+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_clean_scrub_stamp":"2023-12-17T11:49:51.168108+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T20:30:07.106128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-17T11:49:52.179538+0000","last_change":"2023-12-17T11:49:52.179538+0000","last_active":"2023-12-17T11:49:52.179538+0000","last_peered":"2023-12-17T11:49:52.179538+0000","last_clean":"2023-12-17T11:49:52.179538+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-17T11:49:52.179538+0000","last_undegraded":"2023-12-17T11:49:52.179538+0000","last_fullsized":"2023-12-17T11:49:52.179538+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-12-17T11:49:51.197780+0000","last_change":"2023-12-17T11:49:51.197780+0000","last_active":"2023-12-17T11:49:51.168108+0000","last_peered":"2023-12-17T11:49:51.168108+0000","last_clean":"2023-12-17T11:49:51.168108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-17T11:49:51.197780+0000","last_undegraded":"2023-12-17T11:49:51.197780+0000","last_fullsized":"2023-12-17T11:49:51.197780+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_clean_scrub_stamp":"2023-12-17T11:49:51.168108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-17T11:49:52.179538+0000","last_change":"2023-12-17T11:49:52.179538+0000","last_active":"2023-12-17T11:49:52.179538+0000","last_peered":"2023-12-17T11:49:52.179538+0000","last_clean":"2023-12-17T11:49:52.179538+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-17T11:49:52.179538+0000","last_undegraded":"2023-12-17T11:49:52.179538+0000","last_fullsized":"2023-12-17T11:49:52.179538+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-12-17T11:49:51.199281+0000","last_change":"2023-12-17T11:49:51.199281+0000","last_active":"2023-12-17T11:49:51.168108+0000","last_peered":"2023-12-17T11:49:51.168108+0000","last_clean":"2023-12-17T11:49:51.168108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-17T11:49:51.199281+0000","last_undegraded":"2023-12-17T11:49:51.199281+0000","last_fullsized":"2023-12-17T11:49:51.199281+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_clean_scrub_stamp":"2023-12-17T11:49:51.168108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-17T11:49:52.179538+0000","last_change":"2023-12-17T11:49:52.179538+0000","last_active":"2023-12-17T11:49:52.179538+0000","last_peered":"2023-12-17T11:49:52.179538+0000","last_clean":"2023-12-17T11:49:52.179538+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-17T11:49:52.179538+0000","last_undegraded":"2023-12-17T11:49:52.179538+0000","last_fullsized":"2023-12-17T11:49:52.179538+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-12-17T11:49:51.205221+0000","last_change":"2023-12-17T11:49:51.205221+0000","last_active":"2023-12-17T11:49:51.168108+0000","last_peered":"2023-12-17T11:49:51.168108+0000","last_clean":"2023-12-17T11:49:51.168108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-17T11:49:51.205221+0000","last_undegraded":"2023-12-17T11:49:51.205221+0000","last_fullsized":"2023-12-17T11:49:51.205221+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_clean_scrub_stamp":"2023-12-17T11:49:51.168108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:55.302907+0000","last_change":"2023-12-17T11:49:53.236661+0000","last_active":"2023-12-17T11:49:55.302907+0000","last_peered":"2023-12-17T11:49:55.302907+0000","last_clean":"2023-12-17T11:49:55.302907+0000","last_became_active":"2023-12-17T11:49:53.236319+0000","last_became_peered":"2023-12-17T11:49:53.236319+0000","last_unstale":"2023-12-17T11:49:55.302907+0000","last_undegraded":"2023-12-17T11:49:55.302907+0000","last_fullsized":"2023-12-17T11:49:55.302907+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T13:29:01.309715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-12-17T11:49:51.196686+0000","last_change":"2023-12-17T11:49:51.196686+0000","last_active":"2023-12-17T11:49:51.168108+0000","last_peered":"2023-12-17T11:49:51.168108+0000","last_clean":"2023-12-17T11:49:51.168108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-17T11:49:51.196686+0000","last_undegraded":"2023-12-17T11:49:51.196686+0000","last_fullsized":"2023-12-17T11:49:51.196686+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_clean_scrub_stamp":"2023-12-17T11:49:51.168108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-17T11:49:52.179538+0000","last_change":"2023-12-17T11:49:52.179538+0000","last_active":"2023-12-17T11:49:52.179538+0000","last_peered":"2023-12-17T11:49:52.179538+0000","last_clean":"2023-12-17T11:49:52.179538+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-17T11:49:52.179538+0000","last_undegraded":"2023-12-17T11:49:52.179538+0000","last_fullsized":"2023-12-17T11:49:52.179538+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-12-17T11:49:51.196727+0000","last_change":"2023-12-17T11:49:51.196727+0000","last_active":"2023-12-17T11:49:51.168108+0000","last_peered":"2023-12-17T11:49:51.168108+0000","last_clean":"2023-12-17T11:49:51.168108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-17T11:49:51.196727+0000","last_undegraded":"2023-12-17T11:49:51.196727+0000","last_fullsized":"2023-12-17T11:49:51.196727+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_clean_scrub_stamp":"2023-12-17T11:49:51.168108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-17T11:49:52.179538+0000","last_change":"2023-12-17T11:49:52.179538+0000","last_active":"2023-12-17T11:49:52.179538+0000","last_peered":"2023-12-17T11:49:52.179538+0000","last_clean":"2023-12-17T11:49:52.179538+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-17T11:49:52.179538+0000","last_undegraded":"2023-12-17T11:49:52.179538+0000","last_fullsized":"2023-12-17T11:49:52.179538+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-12-17T11:49:51.203723+0000","last_change":"2023-12-17T11:49:51.203723+0000","last_active":"2023-12-17T11:49:51.168108+0000","last_peered":"2023-12-17T11:49:51.168108+0000","last_clean":"2023-12-17T11:49:51.168108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-17T11:49:51.203723+0000","last_undegraded":"2023-12-17T11:49:51.203723+0000","last_fullsized":"2023-12-17T11:49:51.203723+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_clean_scrub_stamp":"2023-12-17T11:49:51.168108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-17T11:49:52.179538+0000","last_change":"2023-12-17T11:49:52.179538+0000","last_active":"2023-12-17T11:49:52.179538+0000","last_peered":"2023-12-17T11:49:52.179538+0000","last_clean":"2023-12-17T11:49:52.179538+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-17T11:49:52.179538+0000","last_undegraded":"2023-12-17T11:49:52.179538+0000","last_fullsized":"2023-12-17T11:49:52.179538+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-12-17T11:49:51.203877+0000","last_change":"2023-12-17T11:49:51.203877+0000","last_active":"2023-12-17T11:49:51.168108+0000","last_peered":"2023-12-17T11:49:51.168108+0000","last_clean":"2023-12-17T11:49:51.168108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-17T11:49:51.203877+0000","last_undegraded":"2023-12-17T11:49:51.203877+0000","last_fullsized":"2023-12-17T11:49:51.203877+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_clean_scrub_stamp":"2023-12-17T11:49:51.168108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-17T11:49:52.179538+0000","last_change":"2023-12-17T11:49:52.179538+0000","last_active":"2023-12-17T11:49:52.179538+0000","last_peered":"2023-12-17T11:49:52.179538+0000","last_clean":"2023-12-17T11:49:52.179538+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-17T11:49:52.179538+0000","last_undegraded":"2023-12-17T11:49:52.179538+0000","last_fullsized":"2023-12-17T11:49:52.179538+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-12-17T11:49:51.197583+0000","last_change":"2023-12-17T11:49:51.197583+0000","last_active":"2023-12-17T11:49:51.168108+0000","last_peered":"2023-12-17T11:49:51.168108+0000","last_clean":"2023-12-17T11:49:51.168108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-17T11:49:51.197583+0000","last_undegraded":"2023-12-17T11:49:51.197583+0000","last_fullsized":"2023-12-17T11:49:51.197583+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_clean_scrub_stamp":"2023-12-17T11:49:51.168108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:55.301864+0000","last_change":"2023-12-17T11:49:53.234701+0000","last_active":"2023-12-17T11:49:55.301864+0000","last_peered":"2023-12-17T11:49:55.301864+0000","last_clean":"2023-12-17T11:49:55.301864+0000","last_became_active":"2023-12-17T11:49:53.234389+0000","last_became_peered":"2023-12-17T11:49:53.234389+0000","last_unstale":"2023-12-17T11:49:55.301864+0000","last_undegraded":"2023-12-17T11:49:55.301864+0000","last_fullsized":"2023-12-17T11:49:55.301864+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T17:54:34.803705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-12-17T11:49:51.190160+0000","last_change":"2023-12-17T11:49:51.190160+0000","last_active":"2023-12-17T11:49:51.168108+0000","last_peered":"2023-12-17T11:49:51.168108+0000","last_clean":"2023-12-17T11:49:51.168108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-17T11:49:51.190160+0000","last_undegraded":"2023-12-17T11:49:51.190160+0000","last_fullsized":"2023-12-17T11:49:51.190160+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_clean_scrub_stamp":"2023-12-17T11:49:51.168108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-17T11:49:52.179538+0000","last_change":"2023-12-17T11:49:52.179538+0000","last_active":"2023-12-17T11:49:52.179538+0000","last_peered":"2023-12-17T11:49:52.179538+0000","last_clean":"2023-12-17T11:49:52.179538+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-17T11:49:52.179538+0000","last_undegraded":"2023-12-17T11:49:52.179538+0000","last_fullsized":"2023-12-17T11:49:52.179538+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.10","version":"39'8","reported_seq":20,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:55.301546+0000","last_change":"2023-12-17T11:49:52.226787+0000","last_active":"2023-12-17T11:49:55.301546+0000","last_peered":"2023-12-17T11:49:55.301546+0000","last_clean":"2023-12-17T11:49:55.301546+0000","last_became_active":"2023-12-17T11:49:52.226471+0000","last_became_peered":"2023-12-17T11:49:52.226471+0000","last_unstale":"2023-12-17T11:49:55.301546+0000","last_undegraded":"2023-12-17T11:49:55.301546+0000","last_fullsized":"2023-12-17T11:49:55.301546+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_clean_scrub_stamp":"2023-12-17T11:49:51.168108+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T17:27:58.587187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-17T11:49:52.179538+0000","last_change":"2023-12-17T11:49:52.179538+0000","last_active":"2023-12-17T11:49:52.179538+0000","last_peered":"2023-12-17T11:49:52.179538+0000","last_clean":"2023-12-17T11:49:52.179538+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-17T11:49:52.179538+0000","last_undegraded":"2023-12-17T11:49:52.179538+0000","last_fullsized":"2023-12-17T11:49:52.179538+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-12-17T11:49:51.197973+0000","last_change":"2023-12-17T11:49:51.197973+0000","last_active":"2023-12-17T11:49:51.168108+0000","last_peered":"2023-12-17T11:49:51.168108+0000","last_clean":"2023-12-17T11:49:51.168108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-17T11:49:51.197973+0000","last_undegraded":"2023-12-17T11:49:51.197973+0000","last_fullsized":"2023-12-17T11:49:51.197973+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_clean_scrub_stamp":"2023-12-17T11:49:51.168108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-17T11:49:52.179538+0000","last_change":"2023-12-17T11:49:52.179538+0000","last_active":"2023-12-17T11:49:52.179538+0000","last_peered":"2023-12-17T11:49:52.179538+0000","last_clean":"2023-12-17T11:49:52.179538+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-17T11:49:52.179538+0000","last_undegraded":"2023-12-17T11:49:52.179538+0000","last_fullsized":"2023-12-17T11:49:52.179538+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-12-17T11:49:51.199475+0000","last_change":"2023-12-17T11:49:51.199475+0000","last_active":"2023-12-17T11:49:51.168108+0000","last_peered":"2023-12-17T11:49:51.168108+0000","last_clean":"2023-12-17T11:49:51.168108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-17T11:49:51.199475+0000","last_undegraded":"2023-12-17T11:49:51.199475+0000","last_fullsized":"2023-12-17T11:49:51.199475+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_clean_scrub_stamp":"2023-12-17T11:49:51.168108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-17T11:49:52.179538+0000","last_change":"2023-12-17T11:49:52.179538+0000","last_active":"2023-12-17T11:49:52.179538+0000","last_peered":"2023-12-17T11:49:52.179538+0000","last_clean":"2023-12-17T11:49:52.179538+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-17T11:49:52.179538+0000","last_undegraded":"2023-12-17T11:49:52.179538+0000","last_fullsized":"2023-12-17T11:49:52.179538+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-12-17T11:49:51.187919+0000","last_change":"2023-12-17T11:49:51.187919+0000","last_active":"2023-12-17T11:49:51.168108+0000","last_peered":"2023-12-17T11:49:51.168108+0000","last_clean":"2023-12-17T11:49:51.168108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-17T11:49:51.187919+0000","last_undegraded":"2023-12-17T11:49:51.187919+0000","last_fullsized":"2023-12-17T11:49:51.187919+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_clean_scrub_stamp":"2023-12-17T11:49:51.168108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-17T11:49:52.179538+0000","last_change":"2023-12-17T11:49:52.179538+0000","last_active":"2023-12-17T11:49:52.179538+0000","last_peered":"2023-12-17T11:49:52.179538+0000","last_clean":"2023-12-17T11:49:52.179538+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-17T11:49:52.179538+0000","last_undegraded":"2023-12-17T11:49:52.179538+0000","last_fullsized":"2023-12-17T11:49:52.179538+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-12-17T11:49:51.198726+0000","last_change":"2023-12-17T11:49:51.198726+0000","last_active":"2023-12-17T11:49:51.168108+0000","last_peered":"2023-12-17T11:49:51.168108+0000","last_clean":"2023-12-17T11:49:51.168108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-17T11:49:51.198726+0000","last_undegraded":"2023-12-17T11:49:51.198726+0000","last_fullsized":"2023-12-17T11:49:51.198726+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_clean_scrub_stamp":"2023-12-17T11:49:51.168108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:55.301868+0000","last_change":"2023-12-17T11:49:53.232411+0000","last_active":"2023-12-17T11:49:55.301868+0000","last_peered":"2023-12-17T11:49:55.301868+0000","last_clean":"2023-12-17T11:49:55.301868+0000","last_became_active":"2023-12-17T11:49:53.232101+0000","last_became_peered":"2023-12-17T11:49:53.232101+0000","last_unstale":"2023-12-17T11:49:55.301868+0000","last_undegraded":"2023-12-17T11:49:55.301868+0000","last_fullsized":"2023-12-17T11:49:55.301868+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T11:57:59.882385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-12-17T11:49:51.187838+0000","last_change":"2023-12-17T11:49:51.187838+0000","last_active":"2023-12-17T11:49:51.168108+0000","last_peered":"2023-12-17T11:49:51.168108+0000","last_clean":"2023-12-17T11:49:51.168108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-17T11:49:51.187838+0000","last_undegraded":"2023-12-17T11:49:51.187838+0000","last_fullsized":"2023-12-17T11:49:51.187838+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_clean_scrub_stamp":"2023-12-17T11:49:51.168108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-17T11:49:52.179538+0000","last_change":"2023-12-17T11:49:52.179538+0000","last_active":"2023-12-17T11:49:52.179538+0000","last_peered":"2023-12-17T11:49:52.179538+0000","last_clean":"2023-12-17T11:49:52.179538+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-17T11:49:52.179538+0000","last_undegraded":"2023-12-17T11:49:52.179538+0000","last_fullsized":"2023-12-17T11:49:52.179538+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-12-17T11:49:51.187743+0000","last_change":"2023-12-17T11:49:51.187743+0000","last_active":"2023-12-17T11:49:51.168108+0000","last_peered":"2023-12-17T11:49:51.168108+0000","last_clean":"2023-12-17T11:49:51.168108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-17T11:49:51.187743+0000","last_undegraded":"2023-12-17T11:49:51.187743+0000","last_fullsized":"2023-12-17T11:49:51.187743+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_clean_scrub_stamp":"2023-12-17T11:49:51.168108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-17T11:49:52.179538+0000","last_change":"2023-12-17T11:49:52.179538+0000","last_active":"2023-12-17T11:49:52.179538+0000","last_peered":"2023-12-17T11:49:52.179538+0000","last_clean":"2023-12-17T11:49:52.179538+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-17T11:49:52.179538+0000","last_undegraded":"2023-12-17T11:49:52.179538+0000","last_fullsized":"2023-12-17T11:49:52.179538+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:55.301924+0000","last_change":"2023-12-17T11:49:52.229883+0000","last_active":"2023-12-17T11:49:55.301924+0000","last_peered":"2023-12-17T11:49:55.301924+0000","last_clean":"2023-12-17T11:49:55.301924+0000","last_became_active":"2023-12-17T11:49:52.229372+0000","last_became_peered":"2023-12-17T11:49:52.229372+0000","last_unstale":"2023-12-17T11:49:55.301924+0000","last_undegraded":"2023-12-17T11:49:55.301924+0000","last_fullsized":"2023-12-17T11:49:55.301924+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_clean_scrub_stamp":"2023-12-17T11:49:51.168108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T23:27:59.830582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-17T11:49:52.179538+0000","last_change":"2023-12-17T11:49:52.179538+0000","last_active":"2023-12-17T11:49:52.179538+0000","last_peered":"2023-12-17T11:49:52.179538+0000","last_clean":"2023-12-17T11:49:52.179538+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-17T11:49:52.179538+0000","last_undegraded":"2023-12-17T11:49:52.179538+0000","last_fullsized":"2023-12-17T11:49:52.179538+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-12-17T11:49:51.189256+0000","last_change":"2023-12-17T11:49:51.189256+0000","last_active":"2023-12-17T11:49:51.168108+0000","last_peered":"2023-12-17T11:49:51.168108+0000","last_clean":"2023-12-17T11:49:51.168108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-17T11:49:51.189256+0000","last_undegraded":"2023-12-17T11:49:51.189256+0000","last_fullsized":"2023-12-17T11:49:51.189256+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_clean_scrub_stamp":"2023-12-17T11:49:51.168108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-17T11:49:52.179538+0000","last_change":"2023-12-17T11:49:52.179538+0000","last_active":"2023-12-17T11:49:52.179538+0000","last_peered":"2023-12-17T11:49:52.179538+0000","last_clean":"2023-12-17T11:49:52.179538+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-17T11:49:52.179538+0000","last_undegraded":"2023-12-17T11:49:52.179538+0000","last_fullsized":"2023-12-17T11:49:52.179538+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-12-17T11:49:51.196744+0000","last_change":"2023-12-17T11:49:51.196744+0000","last_active":"2023-12-17T11:49:51.168108+0000","last_peered":"2023-12-17T11:49:51.168108+0000","last_clean":"2023-12-17T11:49:51.168108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-17T11:49:51.196744+0000","last_undegraded":"2023-12-17T11:49:51.196744+0000","last_fullsized":"2023-12-17T11:49:51.196744+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_clean_scrub_stamp":"2023-12-17T11:49:51.168108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:55.302996+0000","last_change":"2023-12-17T11:49:53.236908+0000","last_active":"2023-12-17T11:49:55.302996+0000","last_peered":"2023-12-17T11:49:55.302996+0000","last_clean":"2023-12-17T11:49:55.302996+0000","last_became_active":"2023-12-17T11:49:53.236508+0000","last_became_peered":"2023-12-17T11:49:53.236508+0000","last_unstale":"2023-12-17T11:49:55.302996+0000","last_undegraded":"2023-12-17T11:49:55.302996+0000","last_fullsized":"2023-12-17T11:49:55.302996+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T13:59:52.939825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-12-17T11:49:51.188306+0000","last_change":"2023-12-17T11:49:51.188306+0000","last_active":"2023-12-17T11:49:51.168108+0000","last_peered":"2023-12-17T11:49:51.168108+0000","last_clean":"2023-12-17T11:49:51.168108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-17T11:49:51.188306+0000","last_undegraded":"2023-12-17T11:49:51.188306+0000","last_fullsized":"2023-12-17T11:49:51.188306+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_clean_scrub_stamp":"2023-12-17T11:49:51.168108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-17T11:49:52.179538+0000","last_change":"2023-12-17T11:49:52.179538+0000","last_active":"2023-12-17T11:49:52.179538+0000","last_peered":"2023-12-17T11:49:52.179538+0000","last_clean":"2023-12-17T11:49:52.179538+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-17T11:49:52.179538+0000","last_undegraded":"2023-12-17T11:49:52.179538+0000","last_fullsized":"2023-12-17T11:49:52.179538+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-12-17T11:49:51.192569+0000","last_change":"2023-12-17T11:49:51.192569+0000","last_active":"2023-12-17T11:49:51.168108+0000","last_peered":"2023-12-17T11:49:51.168108+0000","last_clean":"2023-12-17T11:49:51.168108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-17T11:49:51.192569+0000","last_undegraded":"2023-12-17T11:49:51.192569+0000","last_fullsized":"2023-12-17T11:49:51.192569+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_clean_scrub_stamp":"2023-12-17T11:49:51.168108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-17T11:49:52.179538+0000","last_change":"2023-12-17T11:49:52.179538+0000","last_active":"2023-12-17T11:49:52.179538+0000","last_peered":"2023-12-17T11:49:52.179538+0000","last_clean":"2023-12-17T11:49:52.179538+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-17T11:49:52.179538+0000","last_undegraded":"2023-12-17T11:49:52.179538+0000","last_fullsized":"2023-12-17T11:49:52.179538+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-12-17T11:49:51.191758+0000","last_change":"2023-12-17T11:49:51.191758+0000","last_active":"2023-12-17T11:49:51.168108+0000","last_peered":"2023-12-17T11:49:51.168108+0000","last_clean":"2023-12-17T11:49:51.168108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-17T11:49:51.191758+0000","last_undegraded":"2023-12-17T11:49:51.191758+0000","last_fullsized":"2023-12-17T11:49:51.191758+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_clean_scrub_stamp":"2023-12-17T11:49:51.168108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-17T11:49:52.179538+0000","last_change":"2023-12-17T11:49:52.179538+0000","last_active":"2023-12-17T11:49:52.179538+0000","last_peered":"2023-12-17T11:49:52.179538+0000","last_clean":"2023-12-17T11:49:52.179538+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-17T11:49:52.179538+0000","last_undegraded":"2023-12-17T11:49:52.179538+0000","last_fullsized":"2023-12-17T11:49:52.179538+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-12-17T11:49:51.190239+0000","last_change":"2023-12-17T11:49:51.190239+0000","last_active":"2023-12-17T11:49:51.168108+0000","last_peered":"2023-12-17T11:49:51.168108+0000","last_clean":"2023-12-17T11:49:51.168108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-17T11:49:51.190239+0000","last_undegraded":"2023-12-17T11:49:51.190239+0000","last_fullsized":"2023-12-17T11:49:51.190239+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_clean_scrub_stamp":"2023-12-17T11:49:51.168108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-17T11:49:52.179538+0000","last_change":"2023-12-17T11:49:52.179538+0000","last_active":"2023-12-17T11:49:52.179538+0000","last_peered":"2023-12-17T11:49:52.179538+0000","last_clean":"2023-12-17T11:49:52.179538+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-17T11:49:52.179538+0000","last_undegraded":"2023-12-17T11:49:52.179538+0000","last_fullsized":"2023-12-17T11:49:52.179538+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-12-17T11:49:51.199375+0000","last_change":"2023-12-17T11:49:51.199375+0000","last_active":"2023-12-17T11:49:51.168108+0000","last_peered":"2023-12-17T11:49:51.168108+0000","last_clean":"2023-12-17T11:49:51.168108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-17T11:49:51.199375+0000","last_undegraded":"2023-12-17T11:49:51.199375+0000","last_fullsized":"2023-12-17T11:49:51.199375+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_clean_scrub_stamp":"2023-12-17T11:49:51.168108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:55.302580+0000","last_change":"2023-12-17T11:49:53.234303+0000","last_active":"2023-12-17T11:49:55.302580+0000","last_peered":"2023-12-17T11:49:55.302580+0000","last_clean":"2023-12-17T11:49:55.302580+0000","last_became_active":"2023-12-17T11:49:53.233951+0000","last_became_peered":"2023-12-17T11:49:53.233951+0000","last_unstale":"2023-12-17T11:49:55.302580+0000","last_undegraded":"2023-12-17T11:49:55.302580+0000","last_fullsized":"2023-12-17T11:49:55.302580+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T19:17:38.569694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-12-17T11:49:51.203748+0000","last_change":"2023-12-17T11:49:51.203748+0000","last_active":"2023-12-17T11:49:51.168108+0000","last_peered":"2023-12-17T11:49:51.168108+0000","last_clean":"2023-12-17T11:49:51.168108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-17T11:49:51.203748+0000","last_undegraded":"2023-12-17T11:49:51.203748+0000","last_fullsized":"2023-12-17T11:49:51.203748+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_clean_scrub_stamp":"2023-12-17T11:49:51.168108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-17T11:49:52.179538+0000","last_change":"2023-12-17T11:49:52.179538+0000","last_active":"2023-12-17T11:49:52.179538+0000","last_peered":"2023-12-17T11:49:52.179538+0000","last_clean":"2023-12-17T11:49:52.179538+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-17T11:49:52.179538+0000","last_undegraded":"2023-12-17T11:49:52.179538+0000","last_fullsized":"2023-12-17T11:49:52.179538+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:55.302520+0000","last_change":"2023-12-17T11:49:52.228110+0000","last_active":"2023-12-17T11:49:55.302520+0000","last_peered":"2023-12-17T11:49:55.302520+0000","last_clean":"2023-12-17T11:49:55.302520+0000","last_became_active":"2023-12-17T11:49:52.227851+0000","last_became_peered":"2023-12-17T11:49:52.227851+0000","last_unstale":"2023-12-17T11:49:55.302520+0000","last_undegraded":"2023-12-17T11:49:55.302520+0000","last_fullsized":"2023-12-17T11:49:55.302520+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_clean_scrub_stamp":"2023-12-17T11:49:51.168108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T18:37:20.380970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":180,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-17T11:49:53.217829+0000","last_change":"2023-12-17T11:48:07.952584+0000","last_active":"2023-12-17T11:49:53.217829+0000","last_peered":"2023-12-17T11:49:53.217829+0000","last_clean":"2023-12-17T11:49:53.217829+0000","last_became_active":"2023-12-17T11:48:07.950361+0000","last_became_peered":"2023-12-17T11:48:07.950361+0000","last_unstale":"2023-12-17T11:49:53.217829+0000","last_undegraded":"2023-12-17T11:49:53.217829+0000","last_fullsized":"2023-12-17T11:49:53.217829+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:06.728199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:06.728199+0000","last_clean_scrub_stamp":"2023-12-17T11:48:06.728199+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T12:47:55.048065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":20,"acting":20,"num_store_stats":1},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":9,"ondisk_log_size":9,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542170,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28064,"kb_used_data":1044,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343776,"statfs":{"total":96636764160,"available":96608026624,"internally_reserved":0,"allocated":1069056,"data_stored":789626,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 17 11:49:06 2023","interfaces":[{"interface":"back","average":{"1min":1.407,"5min":1.407,"15min":1.407},"min":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":8.6579999999999995,"5min":8.6579999999999995,"15min":8.6579999999999995},"last":1.159},{"interface":"front","average":{"1min":1.339,"5min":1.339,"15min":1.339},"min":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"max":{"1min":4.0830000000000002,"5min":4.0830000000000002,"15min":4.0830000000000002},"last":1.3580000000000001}]},{"osd":1,"last update":"Sun Dec 17 11:49:06 2023","interfaces":[{"interface":"back","average":{"1min":1.127,"5min":1.127,"15min":1.127},"min":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"max":{"1min":2.1539999999999999,"5min":2.1539999999999999,"15min":2.1539999999999999},"last":1.409},{"interface":"front","average":{"1min":1.413,"5min":1.413,"15min":1.413},"min":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"max":{"1min":8.7449999999999992,"5min":8.7449999999999992,"15min":8.7449999999999992},"last":0.82999999999999996}]},{"osd":2,"last update":"Sun Dec 17 11:49:06 2023","interfaces":[{"interface":"back","average":{"1min":1.4299999999999999,"5min":1.4299999999999999,"15min":1.4299999999999999},"min":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"max":{"1min":4.1239999999999997,"5min":4.1239999999999997,"15min":4.1239999999999997},"last":1.548},{"interface":"front","average":{"1min":1.3720000000000001,"5min":1.3720000000000001,"15min":1.3720000000000001},"min":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"max":{"1min":1.782,"5min":1.782,"15min":1.782},"last":1.7150000000000001}]},{"osd":3,"last update":"Sun Dec 17 11:49:06 2023","interfaces":[{"interface":"back","average":{"1min":1.298,"5min":1.298,"15min":1.298},"min":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"max":{"1min":2.5430000000000001,"5min":2.5430000000000001,"15min":2.5430000000000001},"last":1.218},{"interface":"front","average":{"1min":1.375,"5min":1.375,"15min":1.375},"min":{"1min":1.087,"5min":1.087,"15min":1.087},"max":{"1min":2.5830000000000002,"5min":2.5830000000000002,"15min":2.5830000000000002},"last":1.595}]},{"osd":4,"last update":"Sun Dec 17 11:49:06 2023","interfaces":[{"interface":"back","average":{"1min":1.3859999999999999,"5min":1.3859999999999999,"15min":1.3859999999999999},"min":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":4.0309999999999997,"5min":4.0309999999999997,"15min":4.0309999999999997},"last":1.115},{"interface":"front","average":{"1min":1.5860000000000001,"5min":1.5860000000000001,"15min":1.5860000000000001},"min":{"1min":1.2230000000000001,"5min":1.2230000000000001,"15min":1.2230000000000001},"max":{"1min":3.3220000000000001,"5min":3.3220000000000001,"15min":3.3220000000000001},"last":1.659}]},{"osd":5,"last update":"Sun Dec 17 11:49:06 2023","interfaces":[{"interface":"back","average":{"1min":1.6970000000000001,"5min":1.6970000000000001,"15min":1.6970000000000001},"min":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"max":{"1min":8.7929999999999993,"5min":8.7929999999999993,"15min":8.7929999999999993},"last":1.3109999999999999},{"interface":"front","average":{"1min":1.6859999999999999,"5min":1.6859999999999999,"15min":1.6859999999999999},"min":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"max":{"1min":5.1040000000000001,"5min":5.1040000000000001,"15min":5.1040000000000001},"last":1.6200000000000001}]},{"osd":6,"last update":"Sun Dec 17 11:49:06 2023","interfaces":[{"interface":"back","average":{"1min":1.845,"5min":1.845,"15min":1.845},"min":{"1min":1.081,"5min":1.081,"15min":1.081},"max":{"1min":8.8330000000000002,"5min":8.8330000000000002,"15min":8.8330000000000002},"last":1.498},{"interface":"front","average":{"1min":1.71,"5min":1.71,"15min":1.71},"min":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"max":{"1min":3.9590000000000001,"5min":3.9590000000000001,"15min":3.9590000000000001},"last":1.4630000000000001}]}]},{"osd":6,"up_from":14,"seq":60129542169,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27436,"kb_used_data":400,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344404,"statfs":{"total":96636764160,"available":96608669696,"internally_reserved":0,"allocated":409600,"data_stored":171129,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 17 11:49:06 2023","interfaces":[{"interface":"back","average":{"1min":1.0720000000000001,"5min":1.0720000000000001,"15min":1.0720000000000001},"min":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.5840000000000001,"5min":1.5840000000000001,"15min":1.5840000000000001},"last":0.93300000000000005},{"interface":"front","average":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"min":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"max":{"1min":1.429,"5min":1.429,"15min":1.429},"last":0.88800000000000001}]},{"osd":1,"last update":"Sun Dec 17 11:49:06 2023","interfaces":[{"interface":"back","average":{"1min":1.2689999999999999,"5min":1.2689999999999999,"15min":1.2689999999999999},"min":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"max":{"1min":1.5640000000000001,"5min":1.5640000000000001,"15min":1.5640000000000001},"last":1.3109999999999999},{"interface":"front","average":{"1min":1.3169999999999999,"5min":1.3169999999999999,"15min":1.3169999999999999},"min":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"max":{"1min":1.9359999999999999,"5min":1.9359999999999999,"15min":1.9359999999999999},"last":0.76500000000000001}]},{"osd":2,"last update":"Sun Dec 17 11:49:06 2023","interfaces":[{"interface":"back","average":{"1min":1.1970000000000001,"5min":1.1970000000000001,"15min":1.1970000000000001},"min":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":1.8740000000000001,"5min":1.8740000000000001,"15min":1.8740000000000001},"last":1.01},{"interface":"front","average":{"1min":1.296,"5min":1.296,"15min":1.296},"min":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":2.5470000000000002,"5min":2.5470000000000002,"15min":2.5470000000000002},"last":0.97499999999999998}]},{"osd":3,"last update":"Sun Dec 17 11:49:06 2023","interfaces":[{"interface":"back","average":{"1min":1.508,"5min":1.508,"15min":1.508},"min":{"1min":1.0840000000000001,"5min":1.0840000000000001,"15min":1.0840000000000001},"max":{"1min":2.4689999999999999,"5min":2.4689999999999999,"15min":2.4689999999999999},"last":1.448},{"interface":"front","average":{"1min":1.4390000000000001,"5min":1.4390000000000001,"15min":1.4390000000000001},"min":{"1min":0.88,"5min":0.88,"15min":0.88},"max":{"1min":2.0680000000000001,"5min":2.0680000000000001,"15min":2.0680000000000001},"last":1.046}]},{"osd":4,"last update":"Sun Dec 17 11:49:06 2023","interfaces":[{"interface":"back","average":{"1min":1.522,"5min":1.522,"15min":1.522},"min":{"1min":1.1419999999999999,"5min":1.1419999999999999,"15min":1.1419999999999999},"max":{"1min":2.222,"5min":2.222,"15min":2.222},"last":1.22},{"interface":"front","average":{"1min":1.4419999999999999,"5min":1.4419999999999999,"15min":1.4419999999999999},"min":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":0.90700000000000003},"max":{"1min":2.4079999999999999,"5min":2.4079999999999999,"15min":2.4079999999999999},"last":1.377}]},{"osd":5,"last update":"Sun Dec 17 11:49:06 2023","interfaces":[{"interface":"back","average":{"1min":1.548,"5min":1.548,"15min":1.548},"min":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"max":{"1min":2.3319999999999999,"5min":2.3319999999999999,"15min":2.3319999999999999},"last":1.429},{"interface":"front","average":{"1min":1.5760000000000001,"5min":1.5760000000000001,"15min":1.5760000000000001},"min":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"max":{"1min":2.6760000000000002,"5min":2.6760000000000002,"15min":2.6760000000000002},"last":1.5509999999999999}]},{"osd":7,"last update":"Sun Dec 17 11:49:06 2023","interfaces":[{"interface":"back","average":{"1min":1.419,"5min":1.419,"15min":1.419},"min":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"max":{"1min":2.1560000000000001,"5min":2.1560000000000001,"15min":2.1560000000000001},"last":1.1120000000000001},{"interface":"front","average":{"1min":1.712,"5min":1.712,"15min":1.712},"min":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"max":{"1min":2.6059999999999999,"5min":2.6059999999999999,"15min":2.6059999999999999},"last":1.625}]}]},{"osd":5,"up_from":14,"seq":60129542168,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27428,"kb_used_data":400,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344412,"statfs":{"total":96636764160,"available":96608677888,"internally_reserved":0,"allocated":409600,"data_stored":171129,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 17 11:49:09 2023","interfaces":[{"interface":"back","average":{"1min":1.101,"5min":1.101,"15min":1.101},"min":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":1.5860000000000001,"5min":1.5860000000000001,"15min":1.5860000000000001},"last":1.1599999999999999},{"interface":"front","average":{"1min":1.23,"5min":1.23,"15min":1.23},"min":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"max":{"1min":1.9419999999999999,"5min":1.9419999999999999,"15min":1.9419999999999999},"last":1.028}]},{"osd":1,"last update":"Sun Dec 17 11:49:09 2023","interfaces":[{"interface":"back","average":{"1min":1.167,"5min":1.167,"15min":1.167},"min":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"max":{"1min":1.5289999999999999,"5min":1.5289999999999999,"15min":1.5289999999999999},"last":1.4610000000000001},{"interface":"front","average":{"1min":1.216,"5min":1.216,"15min":1.216},"min":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"max":{"1min":1.8660000000000001,"5min":1.8660000000000001,"15min":1.8660000000000001},"last":1.5329999999999999}]},{"osd":2,"last update":"Sun Dec 17 11:49:09 2023","interfaces":[{"interface":"back","average":{"1min":1.3140000000000001,"5min":1.3140000000000001,"15min":1.3140000000000001},"min":{"1min":0.747,"5min":0.747,"15min":0.747},"max":{"1min":2.1589999999999998,"5min":2.1589999999999998,"15min":2.1589999999999998},"last":1.3740000000000001},{"interface":"front","average":{"1min":1.3919999999999999,"5min":1.3919999999999999,"15min":1.3919999999999999},"min":{"1min":1.0049999999999999,"5min":1.0049999999999999,"15min":1.0049999999999999},"max":{"1min":2.1379999999999999,"5min":2.1379999999999999,"15min":2.1379999999999999},"last":1.341}]},{"osd":3,"last update":"Sun Dec 17 11:49:09 2023","interfaces":[{"interface":"back","average":{"1min":1.337,"5min":1.337,"15min":1.337},"min":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"max":{"1min":2.593,"5min":2.593,"15min":2.593},"last":1.2589999999999999},{"interface":"front","average":{"1min":1.407,"5min":1.407,"15min":1.407},"min":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"max":{"1min":2.3079999999999998,"5min":2.3079999999999998,"15min":2.3079999999999998},"last":1.2130000000000001}]},{"osd":4,"last update":"Sun Dec 17 11:49:09 2023","interfaces":[{"interface":"back","average":{"1min":1.5029999999999999,"5min":1.5029999999999999,"15min":1.5029999999999999},"min":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"max":{"1min":2.5299999999999998,"5min":2.5299999999999998,"15min":2.5299999999999998},"last":0.91400000000000003},{"interface":"front","average":{"1min":1.6879999999999999,"5min":1.6879999999999999,"15min":1.6879999999999999},"min":{"1min":1.0669999999999999,"5min":1.0669999999999999,"15min":1.0669999999999999},"max":{"1min":3.9569999999999999,"5min":3.9569999999999999,"15min":3.9569999999999999},"last":1.1180000000000001}]},{"osd":6,"last update":"Sun Dec 17 11:49:09 2023","interfaces":[{"interface":"back","average":{"1min":1.6619999999999999,"5min":1.6619999999999999,"15min":1.6619999999999999},"min":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"max":{"1min":2.9849999999999999,"5min":2.9849999999999999,"15min":2.9849999999999999},"last":1.079},{"interface":"front","average":{"1min":1.6319999999999999,"5min":1.6319999999999999,"15min":1.6319999999999999},"min":{"1min":1.25,"5min":1.25,"15min":1.25},"max":{"1min":2.641,"5min":2.641,"15min":2.641},"last":1.3100000000000001}]},{"osd":7,"last update":"Sun Dec 17 11:49:09 2023","interfaces":[{"interface":"back","average":{"1min":1.8080000000000001,"5min":1.8080000000000001,"15min":1.8080000000000001},"min":{"1min":1.232,"5min":1.232,"15min":1.232},"max":{"1min":3.8570000000000002,"5min":3.8570000000000002,"15min":3.8570000000000002},"last":1.492},{"interface":"front","average":{"1min":1.827,"5min":1.827,"15min":1.827},"min":{"1min":1.137,"5min":1.137,"15min":1.137},"max":{"1min":2.8999999999999999,"5min":2.8999999999999999,"15min":2.8999999999999999},"last":1.2909999999999999}]}]},{"osd":4,"up_from":14,"seq":60129542169,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27432,"kb_used_data":412,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344408,"statfs":{"total":96636764160,"available":96608673792,"internally_reserved":0,"allocated":421888,"data_stored":177266,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 17 11:49:08 2023","interfaces":[{"interface":"back","average":{"1min":1.02,"5min":1.02,"15min":1.02},"min":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"max":{"1min":1.1890000000000001,"5min":1.1890000000000001,"15min":1.1890000000000001},"last":0.627},{"interface":"front","average":{"1min":1.167,"5min":1.167,"15min":1.167},"min":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"max":{"1min":2.6400000000000001,"5min":2.6400000000000001,"15min":2.6400000000000001},"last":1.353}]},{"osd":1,"last update":"Sun Dec 17 11:49:08 2023","interfaces":[{"interface":"back","average":{"1min":1.0960000000000001,"5min":1.0960000000000001,"15min":1.0960000000000001},"min":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"max":{"1min":1.369,"5min":1.369,"15min":1.369},"last":0.93200000000000005},{"interface":"front","average":{"1min":1.2669999999999999,"5min":1.2669999999999999,"15min":1.2669999999999999},"min":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"max":{"1min":1.631,"5min":1.631,"15min":1.631},"last":0.98699999999999999}]},{"osd":2,"last update":"Sun Dec 17 11:49:08 2023","interfaces":[{"interface":"back","average":{"1min":1.393,"5min":1.393,"15min":1.393},"min":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"max":{"1min":1.8660000000000001,"5min":1.8660000000000001,"15min":1.8660000000000001},"last":1.0289999999999999},{"interface":"front","average":{"1min":1.329,"5min":1.329,"15min":1.329},"min":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"max":{"1min":1.968,"5min":1.968,"15min":1.968},"last":1.1539999999999999}]},{"osd":3,"last update":"Sun Dec 17 11:49:08 2023","interfaces":[{"interface":"back","average":{"1min":1.4410000000000001,"5min":1.4410000000000001,"15min":1.4410000000000001},"min":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"max":{"1min":3.2290000000000001,"5min":3.2290000000000001,"15min":3.2290000000000001},"last":1.087},{"interface":"front","average":{"1min":1.496,"5min":1.496,"15min":1.496},"min":{"1min":1.1000000000000001,"5min":1.1000000000000001,"15min":1.1000000000000001},"max":{"1min":2.0169999999999999,"5min":2.0169999999999999,"15min":2.0169999999999999},"last":1.218}]},{"osd":5,"last update":"Sun Dec 17 11:49:08 2023","interfaces":[{"interface":"back","average":{"1min":1.474,"5min":1.474,"15min":1.474},"min":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"max":{"1min":2.141,"5min":2.141,"15min":2.141},"last":1.5029999999999999},{"interface":"front","average":{"1min":1.7110000000000001,"5min":1.7110000000000001,"15min":1.7110000000000001},"min":{"1min":1.2390000000000001,"5min":1.2390000000000001,"15min":1.2390000000000001},"max":{"1min":3.8220000000000001,"5min":3.8220000000000001,"15min":3.8220000000000001},"last":1.272}]},{"osd":6,"last update":"Sun Dec 17 11:49:08 2023","interfaces":[{"interface":"back","average":{"1min":1.7370000000000001,"5min":1.7370000000000001,"15min":1.7370000000000001},"min":{"1min":1.212,"5min":1.212,"15min":1.212},"max":{"1min":2.7410000000000001,"5min":2.7410000000000001,"15min":2.7410000000000001},"last":1.4450000000000001},{"interface":"front","average":{"1min":1.677,"5min":1.677,"15min":1.677},"min":{"1min":1.222,"5min":1.222,"15min":1.222},"max":{"1min":2.2989999999999999,"5min":2.2989999999999999,"15min":2.2989999999999999},"last":1.3240000000000001}]},{"osd":7,"last update":"Sun Dec 17 11:49:08 2023","interfaces":[{"interface":"back","average":{"1min":1.847,"5min":1.847,"15min":1.847},"min":{"1min":1.2749999999999999,"5min":1.2749999999999999,"15min":1.2749999999999999},"max":{"1min":3.944,"5min":3.944,"15min":3.944},"last":1.4099999999999999},{"interface":"front","average":{"1min":1.8160000000000001,"5min":1.8160000000000001,"15min":1.8160000000000001},"min":{"1min":1.4239999999999999,"5min":1.4239999999999999,"15min":1.4239999999999999},"max":{"1min":2.8809999999999998,"5min":2.8809999999999998,"15min":2.8809999999999998},"last":1.7010000000000001}]}]},{"osd":3,"up_from":14,"seq":60129542168,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27432,"kb_used_data":412,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344408,"statfs":{"total":96636764160,"available":96608673792,"internally_reserved":0,"allocated":421888,"data_stored":177266,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 17 11:49:06 2023","interfaces":[{"interface":"back","average":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.6459999999999999,"5min":1.6459999999999999,"15min":1.6459999999999999},"last":0.36199999999999999},{"interface":"front","average":{"1min":1.0700000000000001,"5min":1.0700000000000001,"15min":1.0700000000000001},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":3.5800000000000001,"5min":3.5800000000000001,"15min":3.5800000000000001},"last":0.59099999999999997}]},{"osd":1,"last update":"Sun Dec 17 11:49:06 2023","interfaces":[{"interface":"back","average":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":1.4379999999999999,"5min":1.4379999999999999,"15min":1.4379999999999999},"last":0.38400000000000001},{"interface":"front","average":{"1min":1.1519999999999999,"5min":1.1519999999999999,"15min":1.1519999999999999},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":2.085,"5min":2.085,"15min":2.085},"last":0.46999999999999997}]},{"osd":2,"last update":"Sun Dec 17 11:49:06 2023","interfaces":[{"interface":"back","average":{"1min":1.1659999999999999,"5min":1.1659999999999999,"15min":1.1659999999999999},"min":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":1.651,"5min":1.651,"15min":1.651},"last":0.77100000000000002},{"interface":"front","average":{"1min":1.2569999999999999,"5min":1.2569999999999999,"15min":1.2569999999999999},"min":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":2.1429999999999998,"5min":2.1429999999999998,"15min":2.1429999999999998},"last":0.71799999999999997}]},{"osd":4,"last update":"Sun Dec 17 11:49:06 2023","interfaces":[{"interface":"back","average":{"1min":1.4330000000000001,"5min":1.4330000000000001,"15min":1.4330000000000001},"min":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"max":{"1min":2.4870000000000001,"5min":2.4870000000000001,"15min":2.4870000000000001},"last":0.70499999999999996},{"interface":"front","average":{"1min":1.476,"5min":1.476,"15min":1.476},"min":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"max":{"1min":2.3460000000000001,"5min":2.3460000000000001,"15min":2.3460000000000001},"last":0.97399999999999998}]},{"osd":5,"last update":"Sun Dec 17 11:49:06 2023","interfaces":[{"interface":"back","average":{"1min":1.476,"5min":1.476,"15min":1.476},"min":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"max":{"1min":2.5710000000000002,"5min":2.5710000000000002,"15min":2.5710000000000002},"last":0.89000000000000001},{"interface":"front","average":{"1min":1.5,"5min":1.5,"15min":1.5},"min":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"max":{"1min":2.383,"5min":2.383,"15min":2.383},"last":0.996}]},{"osd":6,"last update":"Sun Dec 17 11:49:06 2023","interfaces":[{"interface":"back","average":{"1min":1.474,"5min":1.474,"15min":1.474},"min":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"max":{"1min":2.6179999999999999,"5min":2.6179999999999999,"15min":2.6179999999999999},"last":0.82099999999999995},{"interface":"front","average":{"1min":1.5149999999999999,"5min":1.5149999999999999,"15min":1.5149999999999999},"min":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"max":{"1min":2.7679999999999998,"5min":2.7679999999999998,"15min":2.7679999999999998},"last":0.91300000000000003}]},{"osd":7,"last update":"Sun Dec 17 11:49:06 2023","interfaces":[{"interface":"back","average":{"1min":1.581,"5min":1.581,"15min":1.581},"min":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"max":{"1min":3.7000000000000002,"5min":3.7000000000000002,"15min":3.7000000000000002},"last":0.78700000000000003},{"interface":"front","average":{"1min":1.579,"5min":1.579,"15min":1.579},"min":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":0.97099999999999997},"max":{"1min":2.427,"5min":2.427,"15min":2.427},"last":0.92200000000000004}]}]},{"osd":2,"up_from":14,"seq":60129542169,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27432,"kb_used_data":412,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344408,"statfs":{"total":96636764160,"available":96608673792,"internally_reserved":0,"allocated":421888,"data_stored":177266,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 17 11:49:07 2023","interfaces":[{"interface":"back","average":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":1.724,"5min":1.724,"15min":1.724},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.502,"5min":1.502,"15min":1.502},"last":1.337}]},{"osd":1,"last update":"Sun Dec 17 11:49:07 2023","interfaces":[{"interface":"back","average":{"1min":0.995,"5min":0.995,"15min":0.995},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.4790000000000001,"5min":1.4790000000000001,"15min":1.4790000000000001},"last":0.65500000000000003},{"interface":"front","average":{"1min":1.056,"5min":1.056,"15min":1.056},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":2.6280000000000001,"5min":2.6280000000000001,"15min":2.6280000000000001},"last":1.4470000000000001}]},{"osd":3,"last update":"Sun Dec 17 11:49:07 2023","interfaces":[{"interface":"back","average":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.476,"5min":1.476,"15min":1.476},"last":1.0269999999999999},{"interface":"front","average":{"1min":1.214,"5min":1.214,"15min":1.214},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.9670000000000001,"5min":1.9670000000000001,"15min":1.9670000000000001},"last":0.69199999999999995}]},{"osd":4,"last update":"Sun Dec 17 11:49:07 2023","interfaces":[{"interface":"back","average":{"1min":1.49,"5min":1.49,"15min":1.49},"min":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"max":{"1min":2.5750000000000002,"5min":2.5750000000000002,"15min":2.5750000000000002},"last":1.157},{"interface":"front","average":{"1min":1.3879999999999999,"5min":1.3879999999999999,"15min":1.3879999999999999},"min":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"max":{"1min":2.4940000000000002,"5min":2.4940000000000002,"15min":2.4940000000000002},"last":1.2529999999999999}]},{"osd":5,"last update":"Sun Dec 17 11:49:07 2023","interfaces":[{"interface":"back","average":{"1min":1.3240000000000001,"5min":1.3240000000000001,"15min":1.3240000000000001},"min":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"max":{"1min":2.4289999999999998,"5min":2.4289999999999998,"15min":2.4289999999999998},"last":1.1930000000000001},{"interface":"front","average":{"1min":1.5489999999999999,"5min":1.5489999999999999,"15min":1.5489999999999999},"min":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"max":{"1min":2.694,"5min":2.694,"15min":2.694},"last":0.96799999999999997}]},{"osd":6,"last update":"Sun Dec 17 11:49:07 2023","interfaces":[{"interface":"back","average":{"1min":1.472,"5min":1.472,"15min":1.472},"min":{"1min":0.748,"5min":0.748,"15min":0.748},"max":{"1min":2.7349999999999999,"5min":2.7349999999999999,"15min":2.7349999999999999},"last":1.397},{"interface":"front","average":{"1min":1.4119999999999999,"5min":1.4119999999999999,"15min":1.4119999999999999},"min":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"max":{"1min":2.468,"5min":2.468,"15min":2.468},"last":1.425}]},{"osd":7,"last update":"Sun Dec 17 11:49:07 2023","interfaces":[{"interface":"back","average":{"1min":1.554,"5min":1.554,"15min":1.554},"min":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"max":{"1min":3.379,"5min":3.379,"15min":3.379},"last":1.508},{"interface":"front","average":{"1min":1.474,"5min":1.474,"15min":1.474},"min":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"max":{"1min":2.2869999999999999,"5min":2.2869999999999999,"15min":2.2869999999999999},"last":1.3}]}]},{"osd":1,"up_from":14,"seq":60129542168,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27432,"kb_used_data":412,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344408,"statfs":{"total":96636764160,"available":96608673792,"internally_reserved":0,"allocated":421888,"data_stored":177266,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 17 11:49:08 2023","interfaces":[{"interface":"back","average":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.5249999999999999,"5min":1.5249999999999999,"15min":1.5249999999999999},"last":0.99399999999999999},{"interface":"front","average":{"1min":1.113,"5min":1.113,"15min":1.113},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":2.6360000000000001,"5min":2.6360000000000001,"15min":2.6360000000000001},"last":1.036}]},{"osd":2,"last update":"Sun Dec 17 11:49:08 2023","interfaces":[{"interface":"back","average":{"1min":1.202,"5min":1.202,"15min":1.202},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":2.8159999999999998,"5min":2.8159999999999998,"15min":2.8159999999999998},"last":0.53300000000000003},{"interface":"front","average":{"1min":1.462,"5min":1.462,"15min":1.462},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":3.101,"5min":3.101,"15min":3.101},"last":0.86499999999999999}]},{"osd":3,"last update":"Sun Dec 17 11:49:08 2023","interfaces":[{"interface":"back","average":{"1min":1.48,"5min":1.48,"15min":1.48},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":2.7890000000000001,"5min":2.7890000000000001,"15min":2.7890000000000001},"last":1.1870000000000001},{"interface":"front","average":{"1min":1.278,"5min":1.278,"15min":1.278},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":3.1400000000000001,"5min":3.1400000000000001,"15min":3.1400000000000001},"last":0.92800000000000005}]},{"osd":4,"last update":"Sun Dec 17 11:49:08 2023","interfaces":[{"interface":"back","average":{"1min":1.4350000000000001,"5min":1.4350000000000001,"15min":1.4350000000000001},"min":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":2.5289999999999999,"5min":2.5289999999999999,"15min":2.5289999999999999},"last":1.2729999999999999},{"interface":"front","average":{"1min":1.363,"5min":1.363,"15min":1.363},"min":{"1min":0.627,"5min":0.627,"15min":0.627},"max":{"1min":2.0819999999999999,"5min":2.0819999999999999,"15min":2.0819999999999999},"last":1.0169999999999999}]},{"osd":5,"last update":"Sun Dec 17 11:49:08 2023","interfaces":[{"interface":"back","average":{"1min":1.466,"5min":1.466,"15min":1.466},"min":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"max":{"1min":1.96,"5min":1.96,"15min":1.96},"last":1.1559999999999999},{"interface":"front","average":{"1min":1.573,"5min":1.573,"15min":1.573},"min":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":2.6739999999999999,"5min":2.6739999999999999,"15min":2.6739999999999999},"last":1.069}]},{"osd":6,"last update":"Sun Dec 17 11:49:08 2023","interfaces":[{"interface":"back","average":{"1min":1.627,"5min":1.627,"15min":1.627},"min":{"1min":0.754,"5min":0.754,"15min":0.754},"max":{"1min":3.016,"5min":3.016,"15min":3.016},"last":1.381},{"interface":"front","average":{"1min":1.5509999999999999,"5min":1.5509999999999999,"15min":1.5509999999999999},"min":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"max":{"1min":2.508,"5min":2.508,"15min":2.508},"last":1.2090000000000001}]},{"osd":7,"last update":"Sun Dec 17 11:49:08 2023","interfaces":[{"interface":"back","average":{"1min":1.6839999999999999,"5min":1.6839999999999999,"15min":1.6839999999999999},"min":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"max":{"1min":2.944,"5min":2.944,"15min":2.944},"last":1.1319999999999999},{"interface":"front","average":{"1min":1.7170000000000001,"5min":1.7170000000000001,"15min":1.7170000000000001},"min":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"max":{"1min":2.7709999999999999,"5min":2.7709999999999999,"15min":2.7709999999999999},"last":1.431}]}]},{"osd":0,"up_from":14,"seq":60129542168,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28012,"kb_used_data":992,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343828,"statfs":{"total":96636764160,"available":96608079872,"internally_reserved":0,"allocated":1015808,"data_stored":767634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Dec 17 11:49:06 2023","interfaces":[{"interface":"back","average":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.3899999999999999,"5min":1.3899999999999999,"15min":1.3899999999999999},"last":0.78600000000000003},{"interface":"front","average":{"1min":1.1519999999999999,"5min":1.1519999999999999,"15min":1.1519999999999999},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":1.958,"5min":1.958,"15min":1.958},"last":1.0169999999999999}]},{"osd":2,"last update":"Sun Dec 17 11:49:06 2023","interfaces":[{"interface":"back","average":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.7709999999999999,"5min":1.7709999999999999,"15min":1.7709999999999999},"last":1.1279999999999999},{"interface":"front","average":{"1min":1.2090000000000001,"5min":1.2090000000000001,"15min":1.2090000000000001},"min":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":2.2130000000000001,"5min":2.2130000000000001,"15min":2.2130000000000001},"last":1.446}]},{"osd":3,"last update":"Sun Dec 17 11:49:06 2023","interfaces":[{"interface":"back","average":{"1min":1.125,"5min":1.125,"15min":1.125},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.728,"5min":1.728,"15min":1.728},"last":1.089},{"interface":"front","average":{"1min":1.4039999999999999,"5min":1.4039999999999999,"15min":1.4039999999999999},"min":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"max":{"1min":2.4809999999999999,"5min":2.4809999999999999,"15min":2.4809999999999999},"last":1.544}]},{"osd":4,"last update":"Sun Dec 17 11:49:06 2023","interfaces":[{"interface":"back","average":{"1min":1.518,"5min":1.518,"15min":1.518},"min":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"max":{"1min":4.6710000000000003,"5min":4.6710000000000003,"15min":4.6710000000000003},"last":1.2450000000000001},{"interface":"front","average":{"1min":1.427,"5min":1.427,"15min":1.427},"min":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"max":{"1min":2.2799999999999998,"5min":2.2799999999999998,"15min":2.2799999999999998},"last":1.306}]},{"osd":5,"last update":"Sun Dec 17 11:49:06 2023","interfaces":[{"interface":"back","average":{"1min":1.5069999999999999,"5min":1.5069999999999999,"15min":1.5069999999999999},"min":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"max":{"1min":2.1349999999999998,"5min":2.1349999999999998,"15min":2.1349999999999998},"last":1.5029999999999999},{"interface":"front","average":{"1min":1.6240000000000001,"5min":1.6240000000000001,"15min":1.6240000000000001},"min":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"max":{"1min":2.6080000000000001,"5min":2.6080000000000001,"15min":2.6080000000000001},"last":1.7789999999999999}]},{"osd":6,"last update":"Sun Dec 17 11:49:06 2023","interfaces":[{"interface":"back","average":{"1min":1.5800000000000001,"5min":1.5800000000000001,"15min":1.5800000000000001},"min":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"max":{"1min":2.702,"5min":2.702,"15min":2.702},"last":1.6739999999999999},{"interface":"front","average":{"1min":1.534,"5min":1.534,"15min":1.534},"min":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"max":{"1min":2.3100000000000001,"5min":2.3100000000000001,"15min":2.3100000000000001},"last":1.72}]},{"osd":7,"last update":"Sun Dec 17 11:49:06 2023","interfaces":[{"interface":"back","average":{"1min":1.611,"5min":1.611,"15min":1.611},"min":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"max":{"1min":2.3420000000000001,"5min":2.3420000000000001,"15min":2.3420000000000001},"last":1.861},{"interface":"front","average":{"1min":1.577,"5min":1.577,"15min":1.577},"min":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"max":{"1min":2.4359999999999999,"5min":2.4359999999999999,"15min":2.4359999999999999},"last":1.641}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-17T11:49:57.727 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-17T11:49:57.996 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:57.994+0000 7f439afdb640 1 Processor -- start 2023-12-17T11:49:57.997 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:57.994+0000 7f439afdb640 1 -- start start 2023-12-17T11:49:57.998 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:57.996+0000 7f439afdb640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f43940d13c0 0x7f43940ce5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:57.998 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:57.996+0000 7f439afdb640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43940b2280 con 0x7f43940d0d70 2023-12-17T11:49:57.998 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:57.996+0000 7f439afdb640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43940cee70 con 0x7f43940b0760 2023-12-17T11:49:57.998 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:57.996+0000 7f439afdb640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43940d1190 con 0x7f43940d13c0 2023-12-17T11:49:57.998 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:57.996+0000 7f43997d8640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f43940d0d70 0x7f43940d17a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:45896/0 (socket says 172.21.15.40:45896) 2023-12-17T11:49:57.998 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:57.996+0000 7f43997d8640 1 -- 172.21.15.40:0/141446379 learned_addr learned my addr 172.21.15.40:0/141446379 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-12-17T11:49:58.000 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:57.997+0000 7f4399fd9640 1 --2- 172.21.15.40:0/141446379 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f43940d13c0 0x7f43940ce5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:58.000 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:57.997+0000 7f4398fd7640 1 -- 172.21.15.40:0/141446379 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 363069033 0 0) 0x7f43940b2280 con 0x7f43940d0d70 2023-12-17T11:49:58.000 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:57.997+0000 7f4398fd7640 1 -- 172.21.15.40:0/141446379 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4380003520 con 0x7f43940d0d70 2023-12-17T11:49:58.000 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:57.997+0000 7f4398fd7640 1 -- 172.21.15.40:0/141446379 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4252534656 0 0) 0x7f4380003520 con 0x7f43940d0d70 2023-12-17T11:49:58.000 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:57.997+0000 7f4398fd7640 1 -- 172.21.15.40:0/141446379 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f43940d13c0 msgr2=0x7f43940ce5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:49:58.000 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:57.997+0000 7f4398fd7640 1 --2- 172.21.15.40:0/141446379 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f43940d13c0 0x7f43940ce5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:58.001 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:57.997+0000 7f4398fd7640 1 -- 172.21.15.40:0/141446379 >> v1:172.21.15.159:6789/0 conn(0x7f43940b0760 legacy=0x7f43940b0bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:58.001 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:57.997+0000 7f4398fd7640 1 -- 172.21.15.40:0/141446379 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43940ceb90 con 0x7f43940d0d70 2023-12-17T11:49:58.001 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:57.997+0000 7f4398fd7640 1 -- 172.21.15.40:0/141446379 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2643242555 0 0) 0x7f4384001670 con 0x7f43940d0d70 2023-12-17T11:49:58.001 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:57.997+0000 7f4398fd7640 1 -- 172.21.15.40:0/141446379 >> v1:172.21.15.40:6789/0 conn(0x7f43940d0d70 legacy=0x7f43940d17a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:58.001 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:57.997+0000 7f4398fd7640 1 --2- 172.21.15.40:0/141446379 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f43940d13c0 0x7f43800039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:58.001 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:57.998+0000 7f4398fd7640 1 --2- 172.21.15.40:0/141446379 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4380003f20 0x7f43800047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:58.001 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:57.998+0000 7f4398fd7640 1 --2- 172.21.15.40:0/141446379 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4380004d00 0x7f4380005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:58.001 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:57.998+0000 7f4398fd7640 1 -- 172.21.15.40:0/141446379 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43940d1190 con 0x7f4380003f20 2023-12-17T11:49:58.001 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:57.998+0000 7f4398fd7640 1 -- 172.21.15.40:0/141446379 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f438000bb10 con 0x7f4380004d00 2023-12-17T11:49:58.001 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:57.998+0000 7f4398fd7640 1 -- 172.21.15.40:0/141446379 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f438000bcd0 con 0x7f43940d13c0 2023-12-17T11:49:58.001 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:57.998+0000 7f43997d8640 1 --2- 172.21.15.40:0/141446379 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4380003f20 0x7f43800047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:58.001 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:57.998+0000 7f439a7da640 1 --2- 172.21.15.40:0/141446379 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4380004d00 0x7f4380005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:58.001 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:57.998+0000 7f43997d8640 1 -- 172.21.15.40:0/141446379 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f43940d13c0 msgr2=0x7f43800039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:49:58.002 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:57.998+0000 7f43997d8640 1 --2- 172.21.15.40:0/141446379 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f43940d13c0 0x7f43800039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:58.002 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:57.998+0000 7f43997d8640 1 -- 172.21.15.40:0/141446379 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4380004d00 msgr2=0x7f4380005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:49:58.002 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:57.998+0000 7f43997d8640 1 --2- 172.21.15.40:0/141446379 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4380004d00 0x7f4380005180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:58.002 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:57.998+0000 7f43997d8640 1 -- 172.21.15.40:0/141446379 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4380003520 con 0x7f4380003f20 2023-12-17T11:49:58.003 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:57.999+0000 7f43997d8640 1 --2- 172.21.15.40:0/141446379 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4380003f20 0x7f43800047c0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f438400c190 tx=0x7f43800057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b9dc64af8147321 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:49:58.003 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:58.000+0000 7f4398fd7640 1 -- 172.21.15.40:0/141446379 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4384005ad0 con 0x7f4380003f20 2023-12-17T11:49:58.003 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:58.000+0000 7f4398fd7640 1 -- 172.21.15.40:0/141446379 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4384005c50 con 0x7f4380003f20 2023-12-17T11:49:58.003 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:58.000+0000 7f4398fd7640 1 -- 172.21.15.40:0/141446379 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f438402c8a0 con 0x7f4380003f20 2023-12-17T11:49:58.003 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:58.000+0000 7f439afdb640 1 -- 172.21.15.40:0/141446379 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4380003f20 msgr2=0x7f43800047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:58.003 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:58.000+0000 7f439afdb640 1 --2- 172.21.15.40:0/141446379 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4380003f20 0x7f43800047c0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f438400c190 tx=0x7f43800057f0 comp rx=0 tx=0).stop 2023-12-17T11:49:58.003 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:58.000+0000 7f439a7da640 1 -- 172.21.15.40:0/141446379 reap_dead start 2023-12-17T11:49:58.003 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:58.000+0000 7f439afdb640 1 -- 172.21.15.40:0/141446379 shutdown_connections 2023-12-17T11:49:58.003 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:58.000+0000 7f439afdb640 1 -- 172.21.15.40:0/141446379 >> 172.21.15.40:0/141446379 conn(0x7f439409c260 msgr2=0x7f43940d2f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:49:58.004 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:58.000+0000 7f439afdb640 1 -- 172.21.15.40:0/141446379 shutdown_connections 2023-12-17T11:49:58.004 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:58.000+0000 7f439afdb640 1 -- 172.21.15.40:0/141446379 wait complete. 2023-12-17T11:49:58.004 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:58.002+0000 7f439afdb640 1 Processor -- start 2023-12-17T11:49:58.004 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:58.002+0000 7f439afdb640 1 -- start start 2023-12-17T11:49:58.006 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:58.003+0000 7f439afdb640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4380003f20 0x7f43941f2e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:58.006 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:58.003+0000 7f439afdb640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f43940ccde0 0x7f439415a630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:58.006 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:58.003+0000 7f439afdb640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f43940cbb60 0x7f439406bbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:58.006 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:58.003+0000 7f439afdb640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43940a0b20 con 0x7f4380003f20 2023-12-17T11:49:58.006 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:58.003+0000 7f439afdb640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f439409ff10 con 0x7f43940cbb60 2023-12-17T11:49:58.006 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:58.003+0000 7f439afdb640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43940a01f0 con 0x7f43940ccde0 2023-12-17T11:49:58.006 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:58.004+0000 7f4399fd9640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4380003f20 0x7f43941f2e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:58.006 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:58.004+0000 7f4399fd9640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4380003f20 0x7f43941f2e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:33842/0 (socket says 172.21.15.40:33842) 2023-12-17T11:49:58.006 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:58.004+0000 7f4399fd9640 1 -- 172.21.15.40:0/2098452058 learned_addr learned my addr 172.21.15.40:0/2098452058 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-17T11:49:58.006 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:58.004+0000 7f4399fd9640 1 -- 172.21.15.40:0/2098452058 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f43940ccde0 msgr2=0x7f439415a630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:58.007 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:58.004+0000 7f4399fd9640 1 --2- 172.21.15.40:0/2098452058 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f43940ccde0 0x7f439415a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:58.007 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:58.004+0000 7f4399fd9640 1 -- 172.21.15.40:0/2098452058 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f43940cbb60 msgr2=0x7f439406bbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:58.007 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:58.004+0000 7f4399fd9640 1 --2- 172.21.15.40:0/2098452058 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f43940cbb60 0x7f439406bbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:58.007 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:58.004+0000 7f4399fd9640 1 -- 172.21.15.40:0/2098452058 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43940a04d0 con 0x7f4380003f20 2023-12-17T11:49:58.008 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:58.004+0000 7f4399fd9640 1 --2- 172.21.15.40:0/2098452058 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4380003f20 0x7f43941f2e60 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f439000e7c0 tx=0x7f439000ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:49:58.008 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:58.005+0000 7f438a7fc640 1 -- 172.21.15.40:0/2098452058 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f439000eed0 con 0x7f4380003f20 2023-12-17T11:49:58.008 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:58.005+0000 7f438a7fc640 1 -- 172.21.15.40:0/2098452058 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f439000c940 con 0x7f4380003f20 2023-12-17T11:49:58.008 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:58.005+0000 7f438a7fc640 1 -- 172.21.15.40:0/2098452058 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f439000ccd0 con 0x7f4380003f20 2023-12-17T11:49:58.008 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:58.005+0000 7f439afdb640 1 -- 172.21.15.40:0/2098452058 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43940a07b0 con 0x7f4380003f20 2023-12-17T11:49:58.008 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:58.005+0000 7f439afdb640 1 -- 172.21.15.40:0/2098452058 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43940cbfe0 con 0x7f4380003f20 2023-12-17T11:49:58.008 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:58.006+0000 7f439afdb640 1 -- 172.21.15.40:0/2098452058 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43940cc230 con 0x7f4380003f20 2023-12-17T11:49:58.008 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:58.007+0000 7f438a7fc640 1 -- 172.21.15.40:0/2098452058 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f4390013470 con 0x7f4380003f20 2023-12-17T11:49:58.010 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:58.008+0000 7f438a7fc640 1 --2- 172.21.15.40:0/2098452058 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f437806ae40 0x7f437806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:58.010 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:58.008+0000 7f438a7fc640 1 -- 172.21.15.40:0/2098452058 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f4390089900 con 0x7f4380003f20 2023-12-17T11:49:58.010 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:58.008+0000 7f43997d8640 1 --2- 172.21.15.40:0/2098452058 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f437806ae40 0x7f437806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:58.011 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:58.010+0000 7f43997d8640 1 --2- 172.21.15.40:0/2098452058 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f437806ae40 0x7f437806d300 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f438400c190 tx=0x7f4384007000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:49:58.014 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:58.012+0000 7f438a7fc640 1 -- 172.21.15.40:0/2098452058 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f43900547d0 con 0x7f4380003f20 2023-12-17T11:49:58.203 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:58.201+0000 7f439afdb640 1 -- 172.21.15.40:0/2098452058 --> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f43940b0240 con 0x7f437806ae40 2023-12-17T11:49:58.225 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:58.223+0000 7f438a7fc640 1 -- 172.21.15.40:0/2098452058 <== mgr.4105 v2:172.21.15.159:6832/479465803 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+276475 (secure 0 0 0) 0x7f4384001470 con 0x7f437806ae40 2023-12-17T11:49:58.229 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T11:49:58.230 INFO:teuthology.orchestra.run.smithi040.stderr:dumped all 2023-12-17T11:49:58.232 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:58.229+0000 7f439afdb640 1 -- 172.21.15.40:0/2098452058 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f437806ae40 msgr2=0x7f437806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:58.232 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:58.229+0000 7f439afdb640 1 --2- 172.21.15.40:0/2098452058 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f437806ae40 0x7f437806d300 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f438400c190 tx=0x7f4384007000 comp rx=0 tx=0).stop 2023-12-17T11:49:58.232 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:58.229+0000 7f439afdb640 1 -- 172.21.15.40:0/2098452058 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4380003f20 msgr2=0x7f43941f2e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:58.232 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:58.229+0000 7f439afdb640 1 --2- 172.21.15.40:0/2098452058 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4380003f20 0x7f43941f2e60 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f439000e7c0 tx=0x7f439000ec80 comp rx=0 tx=0).stop 2023-12-17T11:49:58.232 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:58.229+0000 7f439afdb640 1 -- 172.21.15.40:0/2098452058 shutdown_connections 2023-12-17T11:49:58.233 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:58.229+0000 7f439afdb640 1 --2- 172.21.15.40:0/2098452058 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f437806ae40 0x7f437806d300 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:58.233 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:58.229+0000 7f439afdb640 1 --2- 172.21.15.40:0/2098452058 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f43940cbb60 0x7f439406bbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:58.233 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:58.229+0000 7f439afdb640 1 --2- 172.21.15.40:0/2098452058 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f43940ccde0 0x7f439415a630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:58.233 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:58.229+0000 7f439afdb640 1 --2- 172.21.15.40:0/2098452058 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4380003f20 0x7f43941f2e60 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:58.233 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:58.229+0000 7f439afdb640 1 -- 172.21.15.40:0/2098452058 >> 172.21.15.40:0/2098452058 conn(0x7f439409c260 msgr2=0x7f43940b6650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:49:58.233 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:58.229+0000 7f439afdb640 1 -- 172.21.15.40:0/2098452058 shutdown_connections 2023-12-17T11:49:58.233 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:58.229+0000 7f439afdb640 1 -- 172.21.15.40:0/2098452058 wait complete. 2023-12-17T11:49:58.252 INFO:teuthology.orchestra.run.smithi040.stdout:{"pg_ready":true,"pg_map":{"version":88,"stamp":"2023-12-17T11:49:56.631067+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":171,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":126,"ondisk_log_size":126,"up":86,"acting":86,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":30,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220668,"kb_used_data":4484,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754052,"statfs":{"total":773094113280,"available":772868149248,"internally_reserved":0,"allocated":4591616,"data_stored":2608582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":221236786},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":28,"apply_latency_ms":28,"commit_latency_ns":28000000,"apply_latency_ns":28000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.446562"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-17T11:49:52.179538+0000","last_change":"2023-12-17T11:49:52.179538+0000","last_active":"2023-12-17T11:49:52.179538+0000","last_peered":"2023-12-17T11:49:52.179538+0000","last_clean":"2023-12-17T11:49:52.179538+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-17T11:49:52.179538+0000","last_undegraded":"2023-12-17T11:49:52.179538+0000","last_fullsized":"2023-12-17T11:49:52.179538+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-17T11:49:52.179538+0000","last_change":"2023-12-17T11:49:52.179538+0000","last_active":"2023-12-17T11:49:52.179538+0000","last_peered":"2023-12-17T11:49:52.179538+0000","last_clean":"2023-12-17T11:49:52.179538+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-17T11:49:52.179538+0000","last_undegraded":"2023-12-17T11:49:52.179538+0000","last_fullsized":"2023-12-17T11:49:52.179538+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-17T11:49:52.179538+0000","last_change":"2023-12-17T11:49:52.179538+0000","last_active":"2023-12-17T11:49:52.179538+0000","last_peered":"2023-12-17T11:49:52.179538+0000","last_clean":"2023-12-17T11:49:52.179538+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-17T11:49:52.179538+0000","last_undegraded":"2023-12-17T11:49:52.179538+0000","last_fullsized":"2023-12-17T11:49:52.179538+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-17T11:49:52.179538+0000","last_change":"2023-12-17T11:49:52.179538+0000","last_active":"2023-12-17T11:49:52.179538+0000","last_peered":"2023-12-17T11:49:52.179538+0000","last_clean":"2023-12-17T11:49:52.179538+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-17T11:49:52.179538+0000","last_undegraded":"2023-12-17T11:49:52.179538+0000","last_fullsized":"2023-12-17T11:49:52.179538+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-17T11:49:52.179538+0000","last_change":"2023-12-17T11:49:52.179538+0000","last_active":"2023-12-17T11:49:52.179538+0000","last_peered":"2023-12-17T11:49:52.179538+0000","last_clean":"2023-12-17T11:49:52.179538+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-17T11:49:52.179538+0000","last_undegraded":"2023-12-17T11:49:52.179538+0000","last_fullsized":"2023-12-17T11:49:52.179538+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-17T11:49:52.179538+0000","last_change":"2023-12-17T11:49:52.179538+0000","last_active":"2023-12-17T11:49:52.179538+0000","last_peered":"2023-12-17T11:49:52.179538+0000","last_clean":"2023-12-17T11:49:52.179538+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-17T11:49:52.179538+0000","last_undegraded":"2023-12-17T11:49:52.179538+0000","last_fullsized":"2023-12-17T11:49:52.179538+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-17T11:49:52.179538+0000","last_change":"2023-12-17T11:49:52.179538+0000","last_active":"2023-12-17T11:49:52.179538+0000","last_peered":"2023-12-17T11:49:52.179538+0000","last_clean":"2023-12-17T11:49:52.179538+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-17T11:49:52.179538+0000","last_undegraded":"2023-12-17T11:49:52.179538+0000","last_fullsized":"2023-12-17T11:49:52.179538+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-17T11:49:52.179538+0000","last_change":"2023-12-17T11:49:52.179538+0000","last_active":"2023-12-17T11:49:52.179538+0000","last_peered":"2023-12-17T11:49:52.179538+0000","last_clean":"2023-12-17T11:49:52.179538+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-17T11:49:52.179538+0000","last_undegraded":"2023-12-17T11:49:52.179538+0000","last_fullsized":"2023-12-17T11:49:52.179538+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-17T11:49:52.179538+0000","last_change":"2023-12-17T11:49:52.179538+0000","last_active":"2023-12-17T11:49:52.179538+0000","last_peered":"2023-12-17T11:49:52.179538+0000","last_clean":"2023-12-17T11:49:52.179538+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-17T11:49:52.179538+0000","last_undegraded":"2023-12-17T11:49:52.179538+0000","last_fullsized":"2023-12-17T11:49:52.179538+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-17T11:49:52.179538+0000","last_change":"2023-12-17T11:49:52.179538+0000","last_active":"2023-12-17T11:49:52.179538+0000","last_peered":"2023-12-17T11:49:52.179538+0000","last_clean":"2023-12-17T11:49:52.179538+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-17T11:49:52.179538+0000","last_undegraded":"2023-12-17T11:49:52.179538+0000","last_fullsized":"2023-12-17T11:49:52.179538+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-17T11:49:52.179538+0000","last_change":"2023-12-17T11:49:52.179538+0000","last_active":"2023-12-17T11:49:52.179538+0000","last_peered":"2023-12-17T11:49:52.179538+0000","last_clean":"2023-12-17T11:49:52.179538+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-17T11:49:52.179538+0000","last_undegraded":"2023-12-17T11:49:52.179538+0000","last_fullsized":"2023-12-17T11:49:52.179538+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-17T11:49:52.179538+0000","last_change":"2023-12-17T11:49:52.179538+0000","last_active":"2023-12-17T11:49:52.179538+0000","last_peered":"2023-12-17T11:49:52.179538+0000","last_clean":"2023-12-17T11:49:52.179538+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-17T11:49:52.179538+0000","last_undegraded":"2023-12-17T11:49:52.179538+0000","last_fullsized":"2023-12-17T11:49:52.179538+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-17T11:49:52.179538+0000","last_change":"2023-12-17T11:49:52.179538+0000","last_active":"2023-12-17T11:49:52.179538+0000","last_peered":"2023-12-17T11:49:52.179538+0000","last_clean":"2023-12-17T11:49:52.179538+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-17T11:49:52.179538+0000","last_undegraded":"2023-12-17T11:49:52.179538+0000","last_fullsized":"2023-12-17T11:49:52.179538+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-17T11:49:52.179538+0000","last_change":"2023-12-17T11:49:52.179538+0000","last_active":"2023-12-17T11:49:52.179538+0000","last_peered":"2023-12-17T11:49:52.179538+0000","last_clean":"2023-12-17T11:49:52.179538+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-17T11:49:52.179538+0000","last_undegraded":"2023-12-17T11:49:52.179538+0000","last_fullsized":"2023-12-17T11:49:52.179538+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-17T11:49:52.179538+0000","last_change":"2023-12-17T11:49:52.179538+0000","last_active":"2023-12-17T11:49:52.179538+0000","last_peered":"2023-12-17T11:49:52.179538+0000","last_clean":"2023-12-17T11:49:52.179538+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-17T11:49:52.179538+0000","last_undegraded":"2023-12-17T11:49:52.179538+0000","last_fullsized":"2023-12-17T11:49:52.179538+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:55.301502+0000","last_change":"2023-12-17T11:49:53.256736+0000","last_active":"2023-12-17T11:49:55.301502+0000","last_peered":"2023-12-17T11:49:55.301502+0000","last_clean":"2023-12-17T11:49:55.301502+0000","last_became_active":"2023-12-17T11:49:53.256319+0000","last_became_peered":"2023-12-17T11:49:53.256319+0000","last_unstale":"2023-12-17T11:49:55.301502+0000","last_undegraded":"2023-12-17T11:49:55.301502+0000","last_fullsized":"2023-12-17T11:49:55.301502+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T14:49:05.628056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:55.302967+0000","last_change":"2023-12-17T11:49:53.254466+0000","last_active":"2023-12-17T11:49:55.302967+0000","last_peered":"2023-12-17T11:49:55.302967+0000","last_clean":"2023-12-17T11:49:55.302967+0000","last_became_active":"2023-12-17T11:49:53.254191+0000","last_became_peered":"2023-12-17T11:49:53.254191+0000","last_unstale":"2023-12-17T11:49:55.302967+0000","last_undegraded":"2023-12-17T11:49:55.302967+0000","last_fullsized":"2023-12-17T11:49:55.302967+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T15:34:59.184998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-17T11:49:52.179538+0000","last_change":"2023-12-17T11:49:52.179538+0000","last_active":"2023-12-17T11:49:52.179538+0000","last_peered":"2023-12-17T11:49:52.179538+0000","last_clean":"2023-12-17T11:49:52.179538+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-17T11:49:52.179538+0000","last_undegraded":"2023-12-17T11:49:52.179538+0000","last_fullsized":"2023-12-17T11:49:52.179538+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-17T11:49:52.179538+0000","last_change":"2023-12-17T11:49:52.179538+0000","last_active":"2023-12-17T11:49:52.179538+0000","last_peered":"2023-12-17T11:49:52.179538+0000","last_clean":"2023-12-17T11:49:52.179538+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-17T11:49:52.179538+0000","last_undegraded":"2023-12-17T11:49:52.179538+0000","last_fullsized":"2023-12-17T11:49:52.179538+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-17T11:49:52.179538+0000","last_change":"2023-12-17T11:49:52.179538+0000","last_active":"2023-12-17T11:49:52.179538+0000","last_peered":"2023-12-17T11:49:52.179538+0000","last_clean":"2023-12-17T11:49:52.179538+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-17T11:49:52.179538+0000","last_undegraded":"2023-12-17T11:49:52.179538+0000","last_fullsized":"2023-12-17T11:49:52.179538+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-17T11:49:52.179538+0000","last_change":"2023-12-17T11:49:52.179538+0000","last_active":"2023-12-17T11:49:52.179538+0000","last_peered":"2023-12-17T11:49:52.179538+0000","last_clean":"2023-12-17T11:49:52.179538+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-17T11:49:52.179538+0000","last_undegraded":"2023-12-17T11:49:52.179538+0000","last_fullsized":"2023-12-17T11:49:52.179538+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-17T11:49:52.179538+0000","last_change":"2023-12-17T11:49:52.179538+0000","last_active":"2023-12-17T11:49:52.179538+0000","last_peered":"2023-12-17T11:49:52.179538+0000","last_clean":"2023-12-17T11:49:52.179538+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-17T11:49:52.179538+0000","last_undegraded":"2023-12-17T11:49:52.179538+0000","last_fullsized":"2023-12-17T11:49:52.179538+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:55.301627+0000","last_change":"2023-12-17T11:49:53.235006+0000","last_active":"2023-12-17T11:49:55.301627+0000","last_peered":"2023-12-17T11:49:55.301627+0000","last_clean":"2023-12-17T11:49:55.301627+0000","last_became_active":"2023-12-17T11:49:53.232828+0000","last_became_peered":"2023-12-17T11:49:53.232828+0000","last_unstale":"2023-12-17T11:49:55.301627+0000","last_undegraded":"2023-12-17T11:49:55.301627+0000","last_fullsized":"2023-12-17T11:49:55.301627+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T21:34:46.442330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-17T11:49:52.179538+0000","last_change":"2023-12-17T11:49:52.179538+0000","last_active":"2023-12-17T11:49:52.179538+0000","last_peered":"2023-12-17T11:49:52.179538+0000","last_clean":"2023-12-17T11:49:52.179538+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-17T11:49:52.179538+0000","last_undegraded":"2023-12-17T11:49:52.179538+0000","last_fullsized":"2023-12-17T11:49:52.179538+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-17T11:49:52.179538+0000","last_change":"2023-12-17T11:49:52.179538+0000","last_active":"2023-12-17T11:49:52.179538+0000","last_peered":"2023-12-17T11:49:52.179538+0000","last_clean":"2023-12-17T11:49:52.179538+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-17T11:49:52.179538+0000","last_undegraded":"2023-12-17T11:49:52.179538+0000","last_fullsized":"2023-12-17T11:49:52.179538+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-17T11:49:52.179538+0000","last_change":"2023-12-17T11:49:52.179538+0000","last_active":"2023-12-17T11:49:52.179538+0000","last_peered":"2023-12-17T11:49:52.179538+0000","last_clean":"2023-12-17T11:49:52.179538+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-17T11:49:52.179538+0000","last_undegraded":"2023-12-17T11:49:52.179538+0000","last_fullsized":"2023-12-17T11:49:52.179538+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-17T11:49:52.179538+0000","last_change":"2023-12-17T11:49:52.179538+0000","last_active":"2023-12-17T11:49:52.179538+0000","last_peered":"2023-12-17T11:49:52.179538+0000","last_clean":"2023-12-17T11:49:52.179538+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-17T11:49:52.179538+0000","last_undegraded":"2023-12-17T11:49:52.179538+0000","last_fullsized":"2023-12-17T11:49:52.179538+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-17T11:49:52.179538+0000","last_change":"2023-12-17T11:49:52.179538+0000","last_active":"2023-12-17T11:49:52.179538+0000","last_peered":"2023-12-17T11:49:52.179538+0000","last_clean":"2023-12-17T11:49:52.179538+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-17T11:49:52.179538+0000","last_undegraded":"2023-12-17T11:49:52.179538+0000","last_fullsized":"2023-12-17T11:49:52.179538+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-17T11:49:52.179538+0000","last_change":"2023-12-17T11:49:52.179538+0000","last_active":"2023-12-17T11:49:52.179538+0000","last_peered":"2023-12-17T11:49:52.179538+0000","last_clean":"2023-12-17T11:49:52.179538+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-17T11:49:52.179538+0000","last_undegraded":"2023-12-17T11:49:52.179538+0000","last_fullsized":"2023-12-17T11:49:52.179538+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-17T11:49:52.179538+0000","last_change":"2023-12-17T11:49:52.179538+0000","last_active":"2023-12-17T11:49:52.179538+0000","last_peered":"2023-12-17T11:49:52.179538+0000","last_clean":"2023-12-17T11:49:52.179538+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-17T11:49:52.179538+0000","last_undegraded":"2023-12-17T11:49:52.179538+0000","last_fullsized":"2023-12-17T11:49:52.179538+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:55.301788+0000","last_change":"2023-12-17T11:49:53.239855+0000","last_active":"2023-12-17T11:49:55.301788+0000","last_peered":"2023-12-17T11:49:55.301788+0000","last_clean":"2023-12-17T11:49:55.301788+0000","last_became_active":"2023-12-17T11:49:53.239579+0000","last_became_peered":"2023-12-17T11:49:53.239579+0000","last_unstale":"2023-12-17T11:49:55.301788+0000","last_undegraded":"2023-12-17T11:49:55.301788+0000","last_fullsized":"2023-12-17T11:49:55.301788+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T20:29:09.996550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-17T11:49:52.179538+0000","last_change":"2023-12-17T11:49:52.179538+0000","last_active":"2023-12-17T11:49:52.179538+0000","last_peered":"2023-12-17T11:49:52.179538+0000","last_clean":"2023-12-17T11:49:52.179538+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-17T11:49:52.179538+0000","last_undegraded":"2023-12-17T11:49:52.179538+0000","last_fullsized":"2023-12-17T11:49:52.179538+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:55.302468+0000","last_change":"2023-12-17T11:49:53.245226+0000","last_active":"2023-12-17T11:49:55.302468+0000","last_peered":"2023-12-17T11:49:55.302468+0000","last_clean":"2023-12-17T11:49:55.302468+0000","last_became_active":"2023-12-17T11:49:53.243115+0000","last_became_peered":"2023-12-17T11:49:53.243115+0000","last_unstale":"2023-12-17T11:49:55.302468+0000","last_undegraded":"2023-12-17T11:49:55.302468+0000","last_fullsized":"2023-12-17T11:49:55.302468+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T15:06:34.831619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-12-17T11:49:51.190581+0000","last_change":"2023-12-17T11:49:51.190581+0000","last_active":"2023-12-17T11:49:51.168108+0000","last_peered":"2023-12-17T11:49:51.168108+0000","last_clean":"2023-12-17T11:49:51.168108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-17T11:49:51.190581+0000","last_undegraded":"2023-12-17T11:49:51.190581+0000","last_fullsized":"2023-12-17T11:49:51.190581+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_clean_scrub_stamp":"2023-12-17T11:49:51.168108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-17T11:49:52.179538+0000","last_change":"2023-12-17T11:49:52.179538+0000","last_active":"2023-12-17T11:49:52.179538+0000","last_peered":"2023-12-17T11:49:52.179538+0000","last_clean":"2023-12-17T11:49:52.179538+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-17T11:49:52.179538+0000","last_undegraded":"2023-12-17T11:49:52.179538+0000","last_fullsized":"2023-12-17T11:49:52.179538+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-12-17T11:49:51.191553+0000","last_change":"2023-12-17T11:49:51.191553+0000","last_active":"2023-12-17T11:49:51.168108+0000","last_peered":"2023-12-17T11:49:51.168108+0000","last_clean":"2023-12-17T11:49:51.168108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-17T11:49:51.191553+0000","last_undegraded":"2023-12-17T11:49:51.191553+0000","last_fullsized":"2023-12-17T11:49:51.191553+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_clean_scrub_stamp":"2023-12-17T11:49:51.168108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-17T11:49:52.179538+0000","last_change":"2023-12-17T11:49:52.179538+0000","last_active":"2023-12-17T11:49:52.179538+0000","last_peered":"2023-12-17T11:49:52.179538+0000","last_clean":"2023-12-17T11:49:52.179538+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-17T11:49:52.179538+0000","last_undegraded":"2023-12-17T11:49:52.179538+0000","last_fullsized":"2023-12-17T11:49:52.179538+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-12-17T11:49:51.197647+0000","last_change":"2023-12-17T11:49:51.197647+0000","last_active":"2023-12-17T11:49:51.168108+0000","last_peered":"2023-12-17T11:49:51.168108+0000","last_clean":"2023-12-17T11:49:51.168108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-17T11:49:51.197647+0000","last_undegraded":"2023-12-17T11:49:51.197647+0000","last_fullsized":"2023-12-17T11:49:51.197647+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_clean_scrub_stamp":"2023-12-17T11:49:51.168108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-17T11:49:52.179538+0000","last_change":"2023-12-17T11:49:52.179538+0000","last_active":"2023-12-17T11:49:52.179538+0000","last_peered":"2023-12-17T11:49:52.179538+0000","last_clean":"2023-12-17T11:49:52.179538+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-17T11:49:52.179538+0000","last_undegraded":"2023-12-17T11:49:52.179538+0000","last_fullsized":"2023-12-17T11:49:52.179538+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-12-17T11:49:51.200552+0000","last_change":"2023-12-17T11:49:51.200552+0000","last_active":"2023-12-17T11:49:51.168108+0000","last_peered":"2023-12-17T11:49:51.168108+0000","last_clean":"2023-12-17T11:49:51.168108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-17T11:49:51.200552+0000","last_undegraded":"2023-12-17T11:49:51.200552+0000","last_fullsized":"2023-12-17T11:49:51.200552+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_clean_scrub_stamp":"2023-12-17T11:49:51.168108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-17T11:49:52.179538+0000","last_change":"2023-12-17T11:49:52.179538+0000","last_active":"2023-12-17T11:49:52.179538+0000","last_peered":"2023-12-17T11:49:52.179538+0000","last_clean":"2023-12-17T11:49:52.179538+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-17T11:49:52.179538+0000","last_undegraded":"2023-12-17T11:49:52.179538+0000","last_fullsized":"2023-12-17T11:49:52.179538+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-12-17T11:49:51.196612+0000","last_change":"2023-12-17T11:49:51.196612+0000","last_active":"2023-12-17T11:49:51.168108+0000","last_peered":"2023-12-17T11:49:51.168108+0000","last_clean":"2023-12-17T11:49:51.168108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-17T11:49:51.196612+0000","last_undegraded":"2023-12-17T11:49:51.196612+0000","last_fullsized":"2023-12-17T11:49:51.196612+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_clean_scrub_stamp":"2023-12-17T11:49:51.168108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-17T11:49:52.179538+0000","last_change":"2023-12-17T11:49:52.179538+0000","last_active":"2023-12-17T11:49:52.179538+0000","last_peered":"2023-12-17T11:49:52.179538+0000","last_clean":"2023-12-17T11:49:52.179538+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-17T11:49:52.179538+0000","last_undegraded":"2023-12-17T11:49:52.179538+0000","last_fullsized":"2023-12-17T11:49:52.179538+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1a","version":"39'1","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:55.301855+0000","last_change":"2023-12-17T11:49:52.225053+0000","last_active":"2023-12-17T11:49:55.301855+0000","last_peered":"2023-12-17T11:49:55.301855+0000","last_clean":"2023-12-17T11:49:55.301855+0000","last_became_active":"2023-12-17T11:49:52.224761+0000","last_became_peered":"2023-12-17T11:49:52.224761+0000","last_unstale":"2023-12-17T11:49:55.301855+0000","last_undegraded":"2023-12-17T11:49:55.301855+0000","last_fullsized":"2023-12-17T11:49:55.301855+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_clean_scrub_stamp":"2023-12-17T11:49:51.168108+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T20:30:07.106128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-17T11:49:52.179538+0000","last_change":"2023-12-17T11:49:52.179538+0000","last_active":"2023-12-17T11:49:52.179538+0000","last_peered":"2023-12-17T11:49:52.179538+0000","last_clean":"2023-12-17T11:49:52.179538+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-17T11:49:52.179538+0000","last_undegraded":"2023-12-17T11:49:52.179538+0000","last_fullsized":"2023-12-17T11:49:52.179538+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-12-17T11:49:51.197780+0000","last_change":"2023-12-17T11:49:51.197780+0000","last_active":"2023-12-17T11:49:51.168108+0000","last_peered":"2023-12-17T11:49:51.168108+0000","last_clean":"2023-12-17T11:49:51.168108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-17T11:49:51.197780+0000","last_undegraded":"2023-12-17T11:49:51.197780+0000","last_fullsized":"2023-12-17T11:49:51.197780+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_clean_scrub_stamp":"2023-12-17T11:49:51.168108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-17T11:49:52.179538+0000","last_change":"2023-12-17T11:49:52.179538+0000","last_active":"2023-12-17T11:49:52.179538+0000","last_peered":"2023-12-17T11:49:52.179538+0000","last_clean":"2023-12-17T11:49:52.179538+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-17T11:49:52.179538+0000","last_undegraded":"2023-12-17T11:49:52.179538+0000","last_fullsized":"2023-12-17T11:49:52.179538+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-12-17T11:49:51.199281+0000","last_change":"2023-12-17T11:49:51.199281+0000","last_active":"2023-12-17T11:49:51.168108+0000","last_peered":"2023-12-17T11:49:51.168108+0000","last_clean":"2023-12-17T11:49:51.168108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-17T11:49:51.199281+0000","last_undegraded":"2023-12-17T11:49:51.199281+0000","last_fullsized":"2023-12-17T11:49:51.199281+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_clean_scrub_stamp":"2023-12-17T11:49:51.168108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-17T11:49:52.179538+0000","last_change":"2023-12-17T11:49:52.179538+0000","last_active":"2023-12-17T11:49:52.179538+0000","last_peered":"2023-12-17T11:49:52.179538+0000","last_clean":"2023-12-17T11:49:52.179538+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-17T11:49:52.179538+0000","last_undegraded":"2023-12-17T11:49:52.179538+0000","last_fullsized":"2023-12-17T11:49:52.179538+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-12-17T11:49:51.205221+0000","last_change":"2023-12-17T11:49:51.205221+0000","last_active":"2023-12-17T11:49:51.168108+0000","last_peered":"2023-12-17T11:49:51.168108+0000","last_clean":"2023-12-17T11:49:51.168108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-17T11:49:51.205221+0000","last_undegraded":"2023-12-17T11:49:51.205221+0000","last_fullsized":"2023-12-17T11:49:51.205221+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_clean_scrub_stamp":"2023-12-17T11:49:51.168108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:55.302907+0000","last_change":"2023-12-17T11:49:53.236661+0000","last_active":"2023-12-17T11:49:55.302907+0000","last_peered":"2023-12-17T11:49:55.302907+0000","last_clean":"2023-12-17T11:49:55.302907+0000","last_became_active":"2023-12-17T11:49:53.236319+0000","last_became_peered":"2023-12-17T11:49:53.236319+0000","last_unstale":"2023-12-17T11:49:55.302907+0000","last_undegraded":"2023-12-17T11:49:55.302907+0000","last_fullsized":"2023-12-17T11:49:55.302907+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T13:29:01.309715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-12-17T11:49:51.196686+0000","last_change":"2023-12-17T11:49:51.196686+0000","last_active":"2023-12-17T11:49:51.168108+0000","last_peered":"2023-12-17T11:49:51.168108+0000","last_clean":"2023-12-17T11:49:51.168108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-17T11:49:51.196686+0000","last_undegraded":"2023-12-17T11:49:51.196686+0000","last_fullsized":"2023-12-17T11:49:51.196686+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_clean_scrub_stamp":"2023-12-17T11:49:51.168108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-17T11:49:52.179538+0000","last_change":"2023-12-17T11:49:52.179538+0000","last_active":"2023-12-17T11:49:52.179538+0000","last_peered":"2023-12-17T11:49:52.179538+0000","last_clean":"2023-12-17T11:49:52.179538+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-17T11:49:52.179538+0000","last_undegraded":"2023-12-17T11:49:52.179538+0000","last_fullsized":"2023-12-17T11:49:52.179538+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-12-17T11:49:51.196727+0000","last_change":"2023-12-17T11:49:51.196727+0000","last_active":"2023-12-17T11:49:51.168108+0000","last_peered":"2023-12-17T11:49:51.168108+0000","last_clean":"2023-12-17T11:49:51.168108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-17T11:49:51.196727+0000","last_undegraded":"2023-12-17T11:49:51.196727+0000","last_fullsized":"2023-12-17T11:49:51.196727+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_clean_scrub_stamp":"2023-12-17T11:49:51.168108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-17T11:49:52.179538+0000","last_change":"2023-12-17T11:49:52.179538+0000","last_active":"2023-12-17T11:49:52.179538+0000","last_peered":"2023-12-17T11:49:52.179538+0000","last_clean":"2023-12-17T11:49:52.179538+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-17T11:49:52.179538+0000","last_undegraded":"2023-12-17T11:49:52.179538+0000","last_fullsized":"2023-12-17T11:49:52.179538+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-12-17T11:49:51.203723+0000","last_change":"2023-12-17T11:49:51.203723+0000","last_active":"2023-12-17T11:49:51.168108+0000","last_peered":"2023-12-17T11:49:51.168108+0000","last_clean":"2023-12-17T11:49:51.168108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-17T11:49:51.203723+0000","last_undegraded":"2023-12-17T11:49:51.203723+0000","last_fullsized":"2023-12-17T11:49:51.203723+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_clean_scrub_stamp":"2023-12-17T11:49:51.168108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-17T11:49:52.179538+0000","last_change":"2023-12-17T11:49:52.179538+0000","last_active":"2023-12-17T11:49:52.179538+0000","last_peered":"2023-12-17T11:49:52.179538+0000","last_clean":"2023-12-17T11:49:52.179538+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-17T11:49:52.179538+0000","last_undegraded":"2023-12-17T11:49:52.179538+0000","last_fullsized":"2023-12-17T11:49:52.179538+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-12-17T11:49:51.203877+0000","last_change":"2023-12-17T11:49:51.203877+0000","last_active":"2023-12-17T11:49:51.168108+0000","last_peered":"2023-12-17T11:49:51.168108+0000","last_clean":"2023-12-17T11:49:51.168108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-17T11:49:51.203877+0000","last_undegraded":"2023-12-17T11:49:51.203877+0000","last_fullsized":"2023-12-17T11:49:51.203877+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_clean_scrub_stamp":"2023-12-17T11:49:51.168108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-17T11:49:52.179538+0000","last_change":"2023-12-17T11:49:52.179538+0000","last_active":"2023-12-17T11:49:52.179538+0000","last_peered":"2023-12-17T11:49:52.179538+0000","last_clean":"2023-12-17T11:49:52.179538+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-17T11:49:52.179538+0000","last_undegraded":"2023-12-17T11:49:52.179538+0000","last_fullsized":"2023-12-17T11:49:52.179538+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-12-17T11:49:51.197583+0000","last_change":"2023-12-17T11:49:51.197583+0000","last_active":"2023-12-17T11:49:51.168108+0000","last_peered":"2023-12-17T11:49:51.168108+0000","last_clean":"2023-12-17T11:49:51.168108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-17T11:49:51.197583+0000","last_undegraded":"2023-12-17T11:49:51.197583+0000","last_fullsized":"2023-12-17T11:49:51.197583+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_clean_scrub_stamp":"2023-12-17T11:49:51.168108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:55.301864+0000","last_change":"2023-12-17T11:49:53.234701+0000","last_active":"2023-12-17T11:49:55.301864+0000","last_peered":"2023-12-17T11:49:55.301864+0000","last_clean":"2023-12-17T11:49:55.301864+0000","last_became_active":"2023-12-17T11:49:53.234389+0000","last_became_peered":"2023-12-17T11:49:53.234389+0000","last_unstale":"2023-12-17T11:49:55.301864+0000","last_undegraded":"2023-12-17T11:49:55.301864+0000","last_fullsized":"2023-12-17T11:49:55.301864+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T17:54:34.803705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-12-17T11:49:51.190160+0000","last_change":"2023-12-17T11:49:51.190160+0000","last_active":"2023-12-17T11:49:51.168108+0000","last_peered":"2023-12-17T11:49:51.168108+0000","last_clean":"2023-12-17T11:49:51.168108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-17T11:49:51.190160+0000","last_undegraded":"2023-12-17T11:49:51.190160+0000","last_fullsized":"2023-12-17T11:49:51.190160+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_clean_scrub_stamp":"2023-12-17T11:49:51.168108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-17T11:49:52.179538+0000","last_change":"2023-12-17T11:49:52.179538+0000","last_active":"2023-12-17T11:49:52.179538+0000","last_peered":"2023-12-17T11:49:52.179538+0000","last_clean":"2023-12-17T11:49:52.179538+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-17T11:49:52.179538+0000","last_undegraded":"2023-12-17T11:49:52.179538+0000","last_fullsized":"2023-12-17T11:49:52.179538+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.10","version":"39'8","reported_seq":20,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:55.301546+0000","last_change":"2023-12-17T11:49:52.226787+0000","last_active":"2023-12-17T11:49:55.301546+0000","last_peered":"2023-12-17T11:49:55.301546+0000","last_clean":"2023-12-17T11:49:55.301546+0000","last_became_active":"2023-12-17T11:49:52.226471+0000","last_became_peered":"2023-12-17T11:49:52.226471+0000","last_unstale":"2023-12-17T11:49:55.301546+0000","last_undegraded":"2023-12-17T11:49:55.301546+0000","last_fullsized":"2023-12-17T11:49:55.301546+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_clean_scrub_stamp":"2023-12-17T11:49:51.168108+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T17:27:58.587187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-17T11:49:52.179538+0000","last_change":"2023-12-17T11:49:52.179538+0000","last_active":"2023-12-17T11:49:52.179538+0000","last_peered":"2023-12-17T11:49:52.179538+0000","last_clean":"2023-12-17T11:49:52.179538+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-17T11:49:52.179538+0000","last_undegraded":"2023-12-17T11:49:52.179538+0000","last_fullsized":"2023-12-17T11:49:52.179538+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-12-17T11:49:51.197973+0000","last_change":"2023-12-17T11:49:51.197973+0000","last_active":"2023-12-17T11:49:51.168108+0000","last_peered":"2023-12-17T11:49:51.168108+0000","last_clean":"2023-12-17T11:49:51.168108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-17T11:49:51.197973+0000","last_undegraded":"2023-12-17T11:49:51.197973+0000","last_fullsized":"2023-12-17T11:49:51.197973+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_clean_scrub_stamp":"2023-12-17T11:49:51.168108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-17T11:49:52.179538+0000","last_change":"2023-12-17T11:49:52.179538+0000","last_active":"2023-12-17T11:49:52.179538+0000","last_peered":"2023-12-17T11:49:52.179538+0000","last_clean":"2023-12-17T11:49:52.179538+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-17T11:49:52.179538+0000","last_undegraded":"2023-12-17T11:49:52.179538+0000","last_fullsized":"2023-12-17T11:49:52.179538+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-12-17T11:49:51.199475+0000","last_change":"2023-12-17T11:49:51.199475+0000","last_active":"2023-12-17T11:49:51.168108+0000","last_peered":"2023-12-17T11:49:51.168108+0000","last_clean":"2023-12-17T11:49:51.168108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-17T11:49:51.199475+0000","last_undegraded":"2023-12-17T11:49:51.199475+0000","last_fullsized":"2023-12-17T11:49:51.199475+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_clean_scrub_stamp":"2023-12-17T11:49:51.168108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-17T11:49:52.179538+0000","last_change":"2023-12-17T11:49:52.179538+0000","last_active":"2023-12-17T11:49:52.179538+0000","last_peered":"2023-12-17T11:49:52.179538+0000","last_clean":"2023-12-17T11:49:52.179538+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-17T11:49:52.179538+0000","last_undegraded":"2023-12-17T11:49:52.179538+0000","last_fullsized":"2023-12-17T11:49:52.179538+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-12-17T11:49:51.187919+0000","last_change":"2023-12-17T11:49:51.187919+0000","last_active":"2023-12-17T11:49:51.168108+0000","last_peered":"2023-12-17T11:49:51.168108+0000","last_clean":"2023-12-17T11:49:51.168108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-17T11:49:51.187919+0000","last_undegraded":"2023-12-17T11:49:51.187919+0000","last_fullsized":"2023-12-17T11:49:51.187919+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_clean_scrub_stamp":"2023-12-17T11:49:51.168108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-17T11:49:52.179538+0000","last_change":"2023-12-17T11:49:52.179538+0000","last_active":"2023-12-17T11:49:52.179538+0000","last_peered":"2023-12-17T11:49:52.179538+0000","last_clean":"2023-12-17T11:49:52.179538+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-17T11:49:52.179538+0000","last_undegraded":"2023-12-17T11:49:52.179538+0000","last_fullsized":"2023-12-17T11:49:52.179538+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-12-17T11:49:51.198726+0000","last_change":"2023-12-17T11:49:51.198726+0000","last_active":"2023-12-17T11:49:51.168108+0000","last_peered":"2023-12-17T11:49:51.168108+0000","last_clean":"2023-12-17T11:49:51.168108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-17T11:49:51.198726+0000","last_undegraded":"2023-12-17T11:49:51.198726+0000","last_fullsized":"2023-12-17T11:49:51.198726+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_clean_scrub_stamp":"2023-12-17T11:49:51.168108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:55.301868+0000","last_change":"2023-12-17T11:49:53.232411+0000","last_active":"2023-12-17T11:49:55.301868+0000","last_peered":"2023-12-17T11:49:55.301868+0000","last_clean":"2023-12-17T11:49:55.301868+0000","last_became_active":"2023-12-17T11:49:53.232101+0000","last_became_peered":"2023-12-17T11:49:53.232101+0000","last_unstale":"2023-12-17T11:49:55.301868+0000","last_undegraded":"2023-12-17T11:49:55.301868+0000","last_fullsized":"2023-12-17T11:49:55.301868+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T11:57:59.882385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-12-17T11:49:51.187838+0000","last_change":"2023-12-17T11:49:51.187838+0000","last_active":"2023-12-17T11:49:51.168108+0000","last_peered":"2023-12-17T11:49:51.168108+0000","last_clean":"2023-12-17T11:49:51.168108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-17T11:49:51.187838+0000","last_undegraded":"2023-12-17T11:49:51.187838+0000","last_fullsized":"2023-12-17T11:49:51.187838+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_clean_scrub_stamp":"2023-12-17T11:49:51.168108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-17T11:49:52.179538+0000","last_change":"2023-12-17T11:49:52.179538+0000","last_active":"2023-12-17T11:49:52.179538+0000","last_peered":"2023-12-17T11:49:52.179538+0000","last_clean":"2023-12-17T11:49:52.179538+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-17T11:49:52.179538+0000","last_undegraded":"2023-12-17T11:49:52.179538+0000","last_fullsized":"2023-12-17T11:49:52.179538+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-12-17T11:49:51.187743+0000","last_change":"2023-12-17T11:49:51.187743+0000","last_active":"2023-12-17T11:49:51.168108+0000","last_peered":"2023-12-17T11:49:51.168108+0000","last_clean":"2023-12-17T11:49:51.168108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-17T11:49:51.187743+0000","last_undegraded":"2023-12-17T11:49:51.187743+0000","last_fullsized":"2023-12-17T11:49:51.187743+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_clean_scrub_stamp":"2023-12-17T11:49:51.168108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-17T11:49:52.179538+0000","last_change":"2023-12-17T11:49:52.179538+0000","last_active":"2023-12-17T11:49:52.179538+0000","last_peered":"2023-12-17T11:49:52.179538+0000","last_clean":"2023-12-17T11:49:52.179538+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-17T11:49:52.179538+0000","last_undegraded":"2023-12-17T11:49:52.179538+0000","last_fullsized":"2023-12-17T11:49:52.179538+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:55.301924+0000","last_change":"2023-12-17T11:49:52.229883+0000","last_active":"2023-12-17T11:49:55.301924+0000","last_peered":"2023-12-17T11:49:55.301924+0000","last_clean":"2023-12-17T11:49:55.301924+0000","last_became_active":"2023-12-17T11:49:52.229372+0000","last_became_peered":"2023-12-17T11:49:52.229372+0000","last_unstale":"2023-12-17T11:49:55.301924+0000","last_undegraded":"2023-12-17T11:49:55.301924+0000","last_fullsized":"2023-12-17T11:49:55.301924+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_clean_scrub_stamp":"2023-12-17T11:49:51.168108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T23:27:59.830582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-17T11:49:52.179538+0000","last_change":"2023-12-17T11:49:52.179538+0000","last_active":"2023-12-17T11:49:52.179538+0000","last_peered":"2023-12-17T11:49:52.179538+0000","last_clean":"2023-12-17T11:49:52.179538+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-17T11:49:52.179538+0000","last_undegraded":"2023-12-17T11:49:52.179538+0000","last_fullsized":"2023-12-17T11:49:52.179538+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-12-17T11:49:51.189256+0000","last_change":"2023-12-17T11:49:51.189256+0000","last_active":"2023-12-17T11:49:51.168108+0000","last_peered":"2023-12-17T11:49:51.168108+0000","last_clean":"2023-12-17T11:49:51.168108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-17T11:49:51.189256+0000","last_undegraded":"2023-12-17T11:49:51.189256+0000","last_fullsized":"2023-12-17T11:49:51.189256+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_clean_scrub_stamp":"2023-12-17T11:49:51.168108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-17T11:49:52.179538+0000","last_change":"2023-12-17T11:49:52.179538+0000","last_active":"2023-12-17T11:49:52.179538+0000","last_peered":"2023-12-17T11:49:52.179538+0000","last_clean":"2023-12-17T11:49:52.179538+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-17T11:49:52.179538+0000","last_undegraded":"2023-12-17T11:49:52.179538+0000","last_fullsized":"2023-12-17T11:49:52.179538+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-12-17T11:49:51.196744+0000","last_change":"2023-12-17T11:49:51.196744+0000","last_active":"2023-12-17T11:49:51.168108+0000","last_peered":"2023-12-17T11:49:51.168108+0000","last_clean":"2023-12-17T11:49:51.168108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-17T11:49:51.196744+0000","last_undegraded":"2023-12-17T11:49:51.196744+0000","last_fullsized":"2023-12-17T11:49:51.196744+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_clean_scrub_stamp":"2023-12-17T11:49:51.168108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:55.302996+0000","last_change":"2023-12-17T11:49:53.236908+0000","last_active":"2023-12-17T11:49:55.302996+0000","last_peered":"2023-12-17T11:49:55.302996+0000","last_clean":"2023-12-17T11:49:55.302996+0000","last_became_active":"2023-12-17T11:49:53.236508+0000","last_became_peered":"2023-12-17T11:49:53.236508+0000","last_unstale":"2023-12-17T11:49:55.302996+0000","last_undegraded":"2023-12-17T11:49:55.302996+0000","last_fullsized":"2023-12-17T11:49:55.302996+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T13:59:52.939825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-12-17T11:49:51.188306+0000","last_change":"2023-12-17T11:49:51.188306+0000","last_active":"2023-12-17T11:49:51.168108+0000","last_peered":"2023-12-17T11:49:51.168108+0000","last_clean":"2023-12-17T11:49:51.168108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-17T11:49:51.188306+0000","last_undegraded":"2023-12-17T11:49:51.188306+0000","last_fullsized":"2023-12-17T11:49:51.188306+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_clean_scrub_stamp":"2023-12-17T11:49:51.168108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-17T11:49:52.179538+0000","last_change":"2023-12-17T11:49:52.179538+0000","last_active":"2023-12-17T11:49:52.179538+0000","last_peered":"2023-12-17T11:49:52.179538+0000","last_clean":"2023-12-17T11:49:52.179538+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-17T11:49:52.179538+0000","last_undegraded":"2023-12-17T11:49:52.179538+0000","last_fullsized":"2023-12-17T11:49:52.179538+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-12-17T11:49:51.192569+0000","last_change":"2023-12-17T11:49:51.192569+0000","last_active":"2023-12-17T11:49:51.168108+0000","last_peered":"2023-12-17T11:49:51.168108+0000","last_clean":"2023-12-17T11:49:51.168108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-17T11:49:51.192569+0000","last_undegraded":"2023-12-17T11:49:51.192569+0000","last_fullsized":"2023-12-17T11:49:51.192569+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_clean_scrub_stamp":"2023-12-17T11:49:51.168108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-17T11:49:52.179538+0000","last_change":"2023-12-17T11:49:52.179538+0000","last_active":"2023-12-17T11:49:52.179538+0000","last_peered":"2023-12-17T11:49:52.179538+0000","last_clean":"2023-12-17T11:49:52.179538+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-17T11:49:52.179538+0000","last_undegraded":"2023-12-17T11:49:52.179538+0000","last_fullsized":"2023-12-17T11:49:52.179538+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-12-17T11:49:51.191758+0000","last_change":"2023-12-17T11:49:51.191758+0000","last_active":"2023-12-17T11:49:51.168108+0000","last_peered":"2023-12-17T11:49:51.168108+0000","last_clean":"2023-12-17T11:49:51.168108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-17T11:49:51.191758+0000","last_undegraded":"2023-12-17T11:49:51.191758+0000","last_fullsized":"2023-12-17T11:49:51.191758+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_clean_scrub_stamp":"2023-12-17T11:49:51.168108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-17T11:49:52.179538+0000","last_change":"2023-12-17T11:49:52.179538+0000","last_active":"2023-12-17T11:49:52.179538+0000","last_peered":"2023-12-17T11:49:52.179538+0000","last_clean":"2023-12-17T11:49:52.179538+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-17T11:49:52.179538+0000","last_undegraded":"2023-12-17T11:49:52.179538+0000","last_fullsized":"2023-12-17T11:49:52.179538+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-12-17T11:49:51.190239+0000","last_change":"2023-12-17T11:49:51.190239+0000","last_active":"2023-12-17T11:49:51.168108+0000","last_peered":"2023-12-17T11:49:51.168108+0000","last_clean":"2023-12-17T11:49:51.168108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-17T11:49:51.190239+0000","last_undegraded":"2023-12-17T11:49:51.190239+0000","last_fullsized":"2023-12-17T11:49:51.190239+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_clean_scrub_stamp":"2023-12-17T11:49:51.168108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-17T11:49:52.179538+0000","last_change":"2023-12-17T11:49:52.179538+0000","last_active":"2023-12-17T11:49:52.179538+0000","last_peered":"2023-12-17T11:49:52.179538+0000","last_clean":"2023-12-17T11:49:52.179538+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-17T11:49:52.179538+0000","last_undegraded":"2023-12-17T11:49:52.179538+0000","last_fullsized":"2023-12-17T11:49:52.179538+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-12-17T11:49:51.199375+0000","last_change":"2023-12-17T11:49:51.199375+0000","last_active":"2023-12-17T11:49:51.168108+0000","last_peered":"2023-12-17T11:49:51.168108+0000","last_clean":"2023-12-17T11:49:51.168108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-17T11:49:51.199375+0000","last_undegraded":"2023-12-17T11:49:51.199375+0000","last_fullsized":"2023-12-17T11:49:51.199375+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_clean_scrub_stamp":"2023-12-17T11:49:51.168108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:55.302580+0000","last_change":"2023-12-17T11:49:53.234303+0000","last_active":"2023-12-17T11:49:55.302580+0000","last_peered":"2023-12-17T11:49:55.302580+0000","last_clean":"2023-12-17T11:49:55.302580+0000","last_became_active":"2023-12-17T11:49:53.233951+0000","last_became_peered":"2023-12-17T11:49:53.233951+0000","last_unstale":"2023-12-17T11:49:55.302580+0000","last_undegraded":"2023-12-17T11:49:55.302580+0000","last_fullsized":"2023-12-17T11:49:55.302580+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T19:17:38.569694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-12-17T11:49:51.203748+0000","last_change":"2023-12-17T11:49:51.203748+0000","last_active":"2023-12-17T11:49:51.168108+0000","last_peered":"2023-12-17T11:49:51.168108+0000","last_clean":"2023-12-17T11:49:51.168108+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-17T11:49:51.203748+0000","last_undegraded":"2023-12-17T11:49:51.203748+0000","last_fullsized":"2023-12-17T11:49:51.203748+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_clean_scrub_stamp":"2023-12-17T11:49:51.168108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-17T11:49:52.179538+0000","last_change":"2023-12-17T11:49:52.179538+0000","last_active":"2023-12-17T11:49:52.179538+0000","last_peered":"2023-12-17T11:49:52.179538+0000","last_clean":"2023-12-17T11:49:52.179538+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-17T11:49:52.179538+0000","last_undegraded":"2023-12-17T11:49:52.179538+0000","last_fullsized":"2023-12-17T11:49:52.179538+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:55.302520+0000","last_change":"2023-12-17T11:49:52.228110+0000","last_active":"2023-12-17T11:49:55.302520+0000","last_peered":"2023-12-17T11:49:55.302520+0000","last_clean":"2023-12-17T11:49:55.302520+0000","last_became_active":"2023-12-17T11:49:52.227851+0000","last_became_peered":"2023-12-17T11:49:52.227851+0000","last_unstale":"2023-12-17T11:49:55.302520+0000","last_undegraded":"2023-12-17T11:49:55.302520+0000","last_fullsized":"2023-12-17T11:49:55.302520+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_clean_scrub_stamp":"2023-12-17T11:49:51.168108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T18:37:20.380970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":180,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-17T11:49:53.217829+0000","last_change":"2023-12-17T11:48:07.952584+0000","last_active":"2023-12-17T11:49:53.217829+0000","last_peered":"2023-12-17T11:49:53.217829+0000","last_clean":"2023-12-17T11:49:53.217829+0000","last_became_active":"2023-12-17T11:48:07.950361+0000","last_became_peered":"2023-12-17T11:48:07.950361+0000","last_unstale":"2023-12-17T11:49:53.217829+0000","last_undegraded":"2023-12-17T11:49:53.217829+0000","last_fullsized":"2023-12-17T11:49:53.217829+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:06.728199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:06.728199+0000","last_clean_scrub_stamp":"2023-12-17T11:48:06.728199+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T12:47:55.048065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":20,"acting":20,"num_store_stats":1},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":9,"ondisk_log_size":9,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542170,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28064,"kb_used_data":1044,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343776,"statfs":{"total":96636764160,"available":96608026624,"internally_reserved":0,"allocated":1069056,"data_stored":789626,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 17 11:49:06 2023","interfaces":[{"interface":"back","average":{"1min":1.407,"5min":1.407,"15min":1.407},"min":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":8.6579999999999995,"5min":8.6579999999999995,"15min":8.6579999999999995},"last":1.159},{"interface":"front","average":{"1min":1.339,"5min":1.339,"15min":1.339},"min":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"max":{"1min":4.0830000000000002,"5min":4.0830000000000002,"15min":4.0830000000000002},"last":1.3580000000000001}]},{"osd":1,"last update":"Sun Dec 17 11:49:06 2023","interfaces":[{"interface":"back","average":{"1min":1.127,"5min":1.127,"15min":1.127},"min":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"max":{"1min":2.1539999999999999,"5min":2.1539999999999999,"15min":2.1539999999999999},"last":1.409},{"interface":"front","average":{"1min":1.413,"5min":1.413,"15min":1.413},"min":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"max":{"1min":8.7449999999999992,"5min":8.7449999999999992,"15min":8.7449999999999992},"last":0.82999999999999996}]},{"osd":2,"last update":"Sun Dec 17 11:49:06 2023","interfaces":[{"interface":"back","average":{"1min":1.4299999999999999,"5min":1.4299999999999999,"15min":1.4299999999999999},"min":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"max":{"1min":4.1239999999999997,"5min":4.1239999999999997,"15min":4.1239999999999997},"last":1.548},{"interface":"front","average":{"1min":1.3720000000000001,"5min":1.3720000000000001,"15min":1.3720000000000001},"min":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"max":{"1min":1.782,"5min":1.782,"15min":1.782},"last":1.7150000000000001}]},{"osd":3,"last update":"Sun Dec 17 11:49:06 2023","interfaces":[{"interface":"back","average":{"1min":1.298,"5min":1.298,"15min":1.298},"min":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"max":{"1min":2.5430000000000001,"5min":2.5430000000000001,"15min":2.5430000000000001},"last":1.218},{"interface":"front","average":{"1min":1.375,"5min":1.375,"15min":1.375},"min":{"1min":1.087,"5min":1.087,"15min":1.087},"max":{"1min":2.5830000000000002,"5min":2.5830000000000002,"15min":2.5830000000000002},"last":1.595}]},{"osd":4,"last update":"Sun Dec 17 11:49:06 2023","interfaces":[{"interface":"back","average":{"1min":1.3859999999999999,"5min":1.3859999999999999,"15min":1.3859999999999999},"min":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":4.0309999999999997,"5min":4.0309999999999997,"15min":4.0309999999999997},"last":1.115},{"interface":"front","average":{"1min":1.5860000000000001,"5min":1.5860000000000001,"15min":1.5860000000000001},"min":{"1min":1.2230000000000001,"5min":1.2230000000000001,"15min":1.2230000000000001},"max":{"1min":3.3220000000000001,"5min":3.3220000000000001,"15min":3.3220000000000001},"last":1.659}]},{"osd":5,"last update":"Sun Dec 17 11:49:06 2023","interfaces":[{"interface":"back","average":{"1min":1.6970000000000001,"5min":1.6970000000000001,"15min":1.6970000000000001},"min":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"max":{"1min":8.7929999999999993,"5min":8.7929999999999993,"15min":8.7929999999999993},"last":1.3109999999999999},{"interface":"front","average":{"1min":1.6859999999999999,"5min":1.6859999999999999,"15min":1.6859999999999999},"min":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"max":{"1min":5.1040000000000001,"5min":5.1040000000000001,"15min":5.1040000000000001},"last":1.6200000000000001}]},{"osd":6,"last update":"Sun Dec 17 11:49:06 2023","interfaces":[{"interface":"back","average":{"1min":1.845,"5min":1.845,"15min":1.845},"min":{"1min":1.081,"5min":1.081,"15min":1.081},"max":{"1min":8.8330000000000002,"5min":8.8330000000000002,"15min":8.8330000000000002},"last":1.498},{"interface":"front","average":{"1min":1.71,"5min":1.71,"15min":1.71},"min":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"max":{"1min":3.9590000000000001,"5min":3.9590000000000001,"15min":3.9590000000000001},"last":1.4630000000000001}]}]},{"osd":6,"up_from":14,"seq":60129542169,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27436,"kb_used_data":400,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344404,"statfs":{"total":96636764160,"available":96608669696,"internally_reserved":0,"allocated":409600,"data_stored":171129,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 17 11:49:06 2023","interfaces":[{"interface":"back","average":{"1min":1.0720000000000001,"5min":1.0720000000000001,"15min":1.0720000000000001},"min":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.5840000000000001,"5min":1.5840000000000001,"15min":1.5840000000000001},"last":0.93300000000000005},{"interface":"front","average":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"min":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"max":{"1min":1.429,"5min":1.429,"15min":1.429},"last":0.88800000000000001}]},{"osd":1,"last update":"Sun Dec 17 11:49:06 2023","interfaces":[{"interface":"back","average":{"1min":1.2689999999999999,"5min":1.2689999999999999,"15min":1.2689999999999999},"min":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"max":{"1min":1.5640000000000001,"5min":1.5640000000000001,"15min":1.5640000000000001},"last":1.3109999999999999},{"interface":"front","average":{"1min":1.3169999999999999,"5min":1.3169999999999999,"15min":1.3169999999999999},"min":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"max":{"1min":1.9359999999999999,"5min":1.9359999999999999,"15min":1.9359999999999999},"last":0.76500000000000001}]},{"osd":2,"last update":"Sun Dec 17 11:49:06 2023","interfaces":[{"interface":"back","average":{"1min":1.1970000000000001,"5min":1.1970000000000001,"15min":1.1970000000000001},"min":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":1.8740000000000001,"5min":1.8740000000000001,"15min":1.8740000000000001},"last":1.01},{"interface":"front","average":{"1min":1.296,"5min":1.296,"15min":1.296},"min":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":2.5470000000000002,"5min":2.5470000000000002,"15min":2.5470000000000002},"last":0.97499999999999998}]},{"osd":3,"last update":"Sun Dec 17 11:49:06 2023","interfaces":[{"interface":"back","average":{"1min":1.508,"5min":1.508,"15min":1.508},"min":{"1min":1.0840000000000001,"5min":1.0840000000000001,"15min":1.0840000000000001},"max":{"1min":2.4689999999999999,"5min":2.4689999999999999,"15min":2.4689999999999999},"last":1.448},{"interface":"front","average":{"1min":1.4390000000000001,"5min":1.4390000000000001,"15min":1.4390000000000001},"min":{"1min":0.88,"5min":0.88,"15min":0.88},"max":{"1min":2.0680000000000001,"5min":2.0680000000000001,"15min":2.0680000000000001},"last":1.046}]},{"osd":4,"last update":"Sun Dec 17 11:49:06 2023","interfaces":[{"interface":"back","average":{"1min":1.522,"5min":1.522,"15min":1.522},"min":{"1min":1.1419999999999999,"5min":1.1419999999999999,"15min":1.1419999999999999},"max":{"1min":2.222,"5min":2.222,"15min":2.222},"last":1.22},{"interface":"front","average":{"1min":1.4419999999999999,"5min":1.4419999999999999,"15min":1.4419999999999999},"min":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":0.90700000000000003},"max":{"1min":2.4079999999999999,"5min":2.4079999999999999,"15min":2.4079999999999999},"last":1.377}]},{"osd":5,"last update":"Sun Dec 17 11:49:06 2023","interfaces":[{"interface":"back","average":{"1min":1.548,"5min":1.548,"15min":1.548},"min":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"max":{"1min":2.3319999999999999,"5min":2.3319999999999999,"15min":2.3319999999999999},"last":1.429},{"interface":"front","average":{"1min":1.5760000000000001,"5min":1.5760000000000001,"15min":1.5760000000000001},"min":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"max":{"1min":2.6760000000000002,"5min":2.6760000000000002,"15min":2.6760000000000002},"last":1.5509999999999999}]},{"osd":7,"last update":"Sun Dec 17 11:49:06 2023","interfaces":[{"interface":"back","average":{"1min":1.419,"5min":1.419,"15min":1.419},"min":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"max":{"1min":2.1560000000000001,"5min":2.1560000000000001,"15min":2.1560000000000001},"last":1.1120000000000001},{"interface":"front","average":{"1min":1.712,"5min":1.712,"15min":1.712},"min":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"max":{"1min":2.6059999999999999,"5min":2.6059999999999999,"15min":2.6059999999999999},"last":1.625}]}]},{"osd":5,"up_from":14,"seq":60129542168,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27428,"kb_used_data":400,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344412,"statfs":{"total":96636764160,"available":96608677888,"internally_reserved":0,"allocated":409600,"data_stored":171129,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 17 11:49:09 2023","interfaces":[{"interface":"back","average":{"1min":1.101,"5min":1.101,"15min":1.101},"min":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":1.5860000000000001,"5min":1.5860000000000001,"15min":1.5860000000000001},"last":1.1599999999999999},{"interface":"front","average":{"1min":1.23,"5min":1.23,"15min":1.23},"min":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"max":{"1min":1.9419999999999999,"5min":1.9419999999999999,"15min":1.9419999999999999},"last":1.028}]},{"osd":1,"last update":"Sun Dec 17 11:49:09 2023","interfaces":[{"interface":"back","average":{"1min":1.167,"5min":1.167,"15min":1.167},"min":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"max":{"1min":1.5289999999999999,"5min":1.5289999999999999,"15min":1.5289999999999999},"last":1.4610000000000001},{"interface":"front","average":{"1min":1.216,"5min":1.216,"15min":1.216},"min":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"max":{"1min":1.8660000000000001,"5min":1.8660000000000001,"15min":1.8660000000000001},"last":1.5329999999999999}]},{"osd":2,"last update":"Sun Dec 17 11:49:09 2023","interfaces":[{"interface":"back","average":{"1min":1.3140000000000001,"5min":1.3140000000000001,"15min":1.3140000000000001},"min":{"1min":0.747,"5min":0.747,"15min":0.747},"max":{"1min":2.1589999999999998,"5min":2.1589999999999998,"15min":2.1589999999999998},"last":1.3740000000000001},{"interface":"front","average":{"1min":1.3919999999999999,"5min":1.3919999999999999,"15min":1.3919999999999999},"min":{"1min":1.0049999999999999,"5min":1.0049999999999999,"15min":1.0049999999999999},"max":{"1min":2.1379999999999999,"5min":2.1379999999999999,"15min":2.1379999999999999},"last":1.341}]},{"osd":3,"last update":"Sun Dec 17 11:49:09 2023","interfaces":[{"interface":"back","average":{"1min":1.337,"5min":1.337,"15min":1.337},"min":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"max":{"1min":2.593,"5min":2.593,"15min":2.593},"last":1.2589999999999999},{"interface":"front","average":{"1min":1.407,"5min":1.407,"15min":1.407},"min":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"max":{"1min":2.3079999999999998,"5min":2.3079999999999998,"15min":2.3079999999999998},"last":1.2130000000000001}]},{"osd":4,"last update":"Sun Dec 17 11:49:09 2023","interfaces":[{"interface":"back","average":{"1min":1.5029999999999999,"5min":1.5029999999999999,"15min":1.5029999999999999},"min":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"max":{"1min":2.5299999999999998,"5min":2.5299999999999998,"15min":2.5299999999999998},"last":0.91400000000000003},{"interface":"front","average":{"1min":1.6879999999999999,"5min":1.6879999999999999,"15min":1.6879999999999999},"min":{"1min":1.0669999999999999,"5min":1.0669999999999999,"15min":1.0669999999999999},"max":{"1min":3.9569999999999999,"5min":3.9569999999999999,"15min":3.9569999999999999},"last":1.1180000000000001}]},{"osd":6,"last update":"Sun Dec 17 11:49:09 2023","interfaces":[{"interface":"back","average":{"1min":1.6619999999999999,"5min":1.6619999999999999,"15min":1.6619999999999999},"min":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"max":{"1min":2.9849999999999999,"5min":2.9849999999999999,"15min":2.9849999999999999},"last":1.079},{"interface":"front","average":{"1min":1.6319999999999999,"5min":1.6319999999999999,"15min":1.6319999999999999},"min":{"1min":1.25,"5min":1.25,"15min":1.25},"max":{"1min":2.641,"5min":2.641,"15min":2.641},"last":1.3100000000000001}]},{"osd":7,"last update":"Sun Dec 17 11:49:09 2023","interfaces":[{"interface":"back","average":{"1min":1.8080000000000001,"5min":1.8080000000000001,"15min":1.8080000000000001},"min":{"1min":1.232,"5min":1.232,"15min":1.232},"max":{"1min":3.8570000000000002,"5min":3.8570000000000002,"15min":3.8570000000000002},"last":1.492},{"interface":"front","average":{"1min":1.827,"5min":1.827,"15min":1.827},"min":{"1min":1.137,"5min":1.137,"15min":1.137},"max":{"1min":2.8999999999999999,"5min":2.8999999999999999,"15min":2.8999999999999999},"last":1.2909999999999999}]}]},{"osd":4,"up_from":14,"seq":60129542169,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27432,"kb_used_data":412,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344408,"statfs":{"total":96636764160,"available":96608673792,"internally_reserved":0,"allocated":421888,"data_stored":177266,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 17 11:49:08 2023","interfaces":[{"interface":"back","average":{"1min":1.02,"5min":1.02,"15min":1.02},"min":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"max":{"1min":1.1890000000000001,"5min":1.1890000000000001,"15min":1.1890000000000001},"last":0.627},{"interface":"front","average":{"1min":1.167,"5min":1.167,"15min":1.167},"min":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"max":{"1min":2.6400000000000001,"5min":2.6400000000000001,"15min":2.6400000000000001},"last":1.353}]},{"osd":1,"last update":"Sun Dec 17 11:49:08 2023","interfaces":[{"interface":"back","average":{"1min":1.0960000000000001,"5min":1.0960000000000001,"15min":1.0960000000000001},"min":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"max":{"1min":1.369,"5min":1.369,"15min":1.369},"last":0.93200000000000005},{"interface":"front","average":{"1min":1.2669999999999999,"5min":1.2669999999999999,"15min":1.2669999999999999},"min":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"max":{"1min":1.631,"5min":1.631,"15min":1.631},"last":0.98699999999999999}]},{"osd":2,"last update":"Sun Dec 17 11:49:08 2023","interfaces":[{"interface":"back","average":{"1min":1.393,"5min":1.393,"15min":1.393},"min":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"max":{"1min":1.8660000000000001,"5min":1.8660000000000001,"15min":1.8660000000000001},"last":1.0289999999999999},{"interface":"front","average":{"1min":1.329,"5min":1.329,"15min":1.329},"min":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"max":{"1min":1.968,"5min":1.968,"15min":1.968},"last":1.1539999999999999}]},{"osd":3,"last update":"Sun Dec 17 11:49:08 2023","interfaces":[{"interface":"back","average":{"1min":1.4410000000000001,"5min":1.4410000000000001,"15min":1.4410000000000001},"min":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"max":{"1min":3.2290000000000001,"5min":3.2290000000000001,"15min":3.2290000000000001},"last":1.087},{"interface":"front","average":{"1min":1.496,"5min":1.496,"15min":1.496},"min":{"1min":1.1000000000000001,"5min":1.1000000000000001,"15min":1.1000000000000001},"max":{"1min":2.0169999999999999,"5min":2.0169999999999999,"15min":2.0169999999999999},"last":1.218}]},{"osd":5,"last update":"Sun Dec 17 11:49:08 2023","interfaces":[{"interface":"back","average":{"1min":1.474,"5min":1.474,"15min":1.474},"min":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"max":{"1min":2.141,"5min":2.141,"15min":2.141},"last":1.5029999999999999},{"interface":"front","average":{"1min":1.7110000000000001,"5min":1.7110000000000001,"15min":1.7110000000000001},"min":{"1min":1.2390000000000001,"5min":1.2390000000000001,"15min":1.2390000000000001},"max":{"1min":3.8220000000000001,"5min":3.8220000000000001,"15min":3.8220000000000001},"last":1.272}]},{"osd":6,"last update":"Sun Dec 17 11:49:08 2023","interfaces":[{"interface":"back","average":{"1min":1.7370000000000001,"5min":1.7370000000000001,"15min":1.7370000000000001},"min":{"1min":1.212,"5min":1.212,"15min":1.212},"max":{"1min":2.7410000000000001,"5min":2.7410000000000001,"15min":2.7410000000000001},"last":1.4450000000000001},{"interface":"front","average":{"1min":1.677,"5min":1.677,"15min":1.677},"min":{"1min":1.222,"5min":1.222,"15min":1.222},"max":{"1min":2.2989999999999999,"5min":2.2989999999999999,"15min":2.2989999999999999},"last":1.3240000000000001}]},{"osd":7,"last update":"Sun Dec 17 11:49:08 2023","interfaces":[{"interface":"back","average":{"1min":1.847,"5min":1.847,"15min":1.847},"min":{"1min":1.2749999999999999,"5min":1.2749999999999999,"15min":1.2749999999999999},"max":{"1min":3.944,"5min":3.944,"15min":3.944},"last":1.4099999999999999},{"interface":"front","average":{"1min":1.8160000000000001,"5min":1.8160000000000001,"15min":1.8160000000000001},"min":{"1min":1.4239999999999999,"5min":1.4239999999999999,"15min":1.4239999999999999},"max":{"1min":2.8809999999999998,"5min":2.8809999999999998,"15min":2.8809999999999998},"last":1.7010000000000001}]}]},{"osd":3,"up_from":14,"seq":60129542168,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27432,"kb_used_data":412,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344408,"statfs":{"total":96636764160,"available":96608673792,"internally_reserved":0,"allocated":421888,"data_stored":177266,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 17 11:49:06 2023","interfaces":[{"interface":"back","average":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.6459999999999999,"5min":1.6459999999999999,"15min":1.6459999999999999},"last":0.36199999999999999},{"interface":"front","average":{"1min":1.0700000000000001,"5min":1.0700000000000001,"15min":1.0700000000000001},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":3.5800000000000001,"5min":3.5800000000000001,"15min":3.5800000000000001},"last":0.59099999999999997}]},{"osd":1,"last update":"Sun Dec 17 11:49:06 2023","interfaces":[{"interface":"back","average":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":1.4379999999999999,"5min":1.4379999999999999,"15min":1.4379999999999999},"last":0.38400000000000001},{"interface":"front","average":{"1min":1.1519999999999999,"5min":1.1519999999999999,"15min":1.1519999999999999},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":2.085,"5min":2.085,"15min":2.085},"last":0.46999999999999997}]},{"osd":2,"last update":"Sun Dec 17 11:49:06 2023","interfaces":[{"interface":"back","average":{"1min":1.1659999999999999,"5min":1.1659999999999999,"15min":1.1659999999999999},"min":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":1.651,"5min":1.651,"15min":1.651},"last":0.77100000000000002},{"interface":"front","average":{"1min":1.2569999999999999,"5min":1.2569999999999999,"15min":1.2569999999999999},"min":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":2.1429999999999998,"5min":2.1429999999999998,"15min":2.1429999999999998},"last":0.71799999999999997}]},{"osd":4,"last update":"Sun Dec 17 11:49:06 2023","interfaces":[{"interface":"back","average":{"1min":1.4330000000000001,"5min":1.4330000000000001,"15min":1.4330000000000001},"min":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"max":{"1min":2.4870000000000001,"5min":2.4870000000000001,"15min":2.4870000000000001},"last":0.70499999999999996},{"interface":"front","average":{"1min":1.476,"5min":1.476,"15min":1.476},"min":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"max":{"1min":2.3460000000000001,"5min":2.3460000000000001,"15min":2.3460000000000001},"last":0.97399999999999998}]},{"osd":5,"last update":"Sun Dec 17 11:49:06 2023","interfaces":[{"interface":"back","average":{"1min":1.476,"5min":1.476,"15min":1.476},"min":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"max":{"1min":2.5710000000000002,"5min":2.5710000000000002,"15min":2.5710000000000002},"last":0.89000000000000001},{"interface":"front","average":{"1min":1.5,"5min":1.5,"15min":1.5},"min":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"max":{"1min":2.383,"5min":2.383,"15min":2.383},"last":0.996}]},{"osd":6,"last update":"Sun Dec 17 11:49:06 2023","interfaces":[{"interface":"back","average":{"1min":1.474,"5min":1.474,"15min":1.474},"min":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"max":{"1min":2.6179999999999999,"5min":2.6179999999999999,"15min":2.6179999999999999},"last":0.82099999999999995},{"interface":"front","average":{"1min":1.5149999999999999,"5min":1.5149999999999999,"15min":1.5149999999999999},"min":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"max":{"1min":2.7679999999999998,"5min":2.7679999999999998,"15min":2.7679999999999998},"last":0.91300000000000003}]},{"osd":7,"last update":"Sun Dec 17 11:49:06 2023","interfaces":[{"interface":"back","average":{"1min":1.581,"5min":1.581,"15min":1.581},"min":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"max":{"1min":3.7000000000000002,"5min":3.7000000000000002,"15min":3.7000000000000002},"last":0.78700000000000003},{"interface":"front","average":{"1min":1.579,"5min":1.579,"15min":1.579},"min":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":0.97099999999999997},"max":{"1min":2.427,"5min":2.427,"15min":2.427},"last":0.92200000000000004}]}]},{"osd":2,"up_from":14,"seq":60129542169,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27432,"kb_used_data":412,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344408,"statfs":{"total":96636764160,"available":96608673792,"internally_reserved":0,"allocated":421888,"data_stored":177266,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 17 11:49:07 2023","interfaces":[{"interface":"back","average":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":1.724,"5min":1.724,"15min":1.724},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.502,"5min":1.502,"15min":1.502},"last":1.337}]},{"osd":1,"last update":"Sun Dec 17 11:49:07 2023","interfaces":[{"interface":"back","average":{"1min":0.995,"5min":0.995,"15min":0.995},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.4790000000000001,"5min":1.4790000000000001,"15min":1.4790000000000001},"last":0.65500000000000003},{"interface":"front","average":{"1min":1.056,"5min":1.056,"15min":1.056},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":2.6280000000000001,"5min":2.6280000000000001,"15min":2.6280000000000001},"last":1.4470000000000001}]},{"osd":3,"last update":"Sun Dec 17 11:49:07 2023","interfaces":[{"interface":"back","average":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.476,"5min":1.476,"15min":1.476},"last":1.0269999999999999},{"interface":"front","average":{"1min":1.214,"5min":1.214,"15min":1.214},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.9670000000000001,"5min":1.9670000000000001,"15min":1.9670000000000001},"last":0.69199999999999995}]},{"osd":4,"last update":"Sun Dec 17 11:49:07 2023","interfaces":[{"interface":"back","average":{"1min":1.49,"5min":1.49,"15min":1.49},"min":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"max":{"1min":2.5750000000000002,"5min":2.5750000000000002,"15min":2.5750000000000002},"last":1.157},{"interface":"front","average":{"1min":1.3879999999999999,"5min":1.3879999999999999,"15min":1.3879999999999999},"min":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"max":{"1min":2.4940000000000002,"5min":2.4940000000000002,"15min":2.4940000000000002},"last":1.2529999999999999}]},{"osd":5,"last update":"Sun Dec 17 11:49:07 2023","interfaces":[{"interface":"back","average":{"1min":1.3240000000000001,"5min":1.3240000000000001,"15min":1.3240000000000001},"min":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"max":{"1min":2.4289999999999998,"5min":2.4289999999999998,"15min":2.4289999999999998},"last":1.1930000000000001},{"interface":"front","average":{"1min":1.5489999999999999,"5min":1.5489999999999999,"15min":1.5489999999999999},"min":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"max":{"1min":2.694,"5min":2.694,"15min":2.694},"last":0.96799999999999997}]},{"osd":6,"last update":"Sun Dec 17 11:49:07 2023","interfaces":[{"interface":"back","average":{"1min":1.472,"5min":1.472,"15min":1.472},"min":{"1min":0.748,"5min":0.748,"15min":0.748},"max":{"1min":2.7349999999999999,"5min":2.7349999999999999,"15min":2.7349999999999999},"last":1.397},{"interface":"front","average":{"1min":1.4119999999999999,"5min":1.4119999999999999,"15min":1.4119999999999999},"min":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"max":{"1min":2.468,"5min":2.468,"15min":2.468},"last":1.425}]},{"osd":7,"last update":"Sun Dec 17 11:49:07 2023","interfaces":[{"interface":"back","average":{"1min":1.554,"5min":1.554,"15min":1.554},"min":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"max":{"1min":3.379,"5min":3.379,"15min":3.379},"last":1.508},{"interface":"front","average":{"1min":1.474,"5min":1.474,"15min":1.474},"min":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"max":{"1min":2.2869999999999999,"5min":2.2869999999999999,"15min":2.2869999999999999},"last":1.3}]}]},{"osd":1,"up_from":14,"seq":60129542168,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27432,"kb_used_data":412,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344408,"statfs":{"total":96636764160,"available":96608673792,"internally_reserved":0,"allocated":421888,"data_stored":177266,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 17 11:49:08 2023","interfaces":[{"interface":"back","average":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.5249999999999999,"5min":1.5249999999999999,"15min":1.5249999999999999},"last":0.99399999999999999},{"interface":"front","average":{"1min":1.113,"5min":1.113,"15min":1.113},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":2.6360000000000001,"5min":2.6360000000000001,"15min":2.6360000000000001},"last":1.036}]},{"osd":2,"last update":"Sun Dec 17 11:49:08 2023","interfaces":[{"interface":"back","average":{"1min":1.202,"5min":1.202,"15min":1.202},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":2.8159999999999998,"5min":2.8159999999999998,"15min":2.8159999999999998},"last":0.53300000000000003},{"interface":"front","average":{"1min":1.462,"5min":1.462,"15min":1.462},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":3.101,"5min":3.101,"15min":3.101},"last":0.86499999999999999}]},{"osd":3,"last update":"Sun Dec 17 11:49:08 2023","interfaces":[{"interface":"back","average":{"1min":1.48,"5min":1.48,"15min":1.48},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":2.7890000000000001,"5min":2.7890000000000001,"15min":2.7890000000000001},"last":1.1870000000000001},{"interface":"front","average":{"1min":1.278,"5min":1.278,"15min":1.278},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":3.1400000000000001,"5min":3.1400000000000001,"15min":3.1400000000000001},"last":0.92800000000000005}]},{"osd":4,"last update":"Sun Dec 17 11:49:08 2023","interfaces":[{"interface":"back","average":{"1min":1.4350000000000001,"5min":1.4350000000000001,"15min":1.4350000000000001},"min":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":2.5289999999999999,"5min":2.5289999999999999,"15min":2.5289999999999999},"last":1.2729999999999999},{"interface":"front","average":{"1min":1.363,"5min":1.363,"15min":1.363},"min":{"1min":0.627,"5min":0.627,"15min":0.627},"max":{"1min":2.0819999999999999,"5min":2.0819999999999999,"15min":2.0819999999999999},"last":1.0169999999999999}]},{"osd":5,"last update":"Sun Dec 17 11:49:08 2023","interfaces":[{"interface":"back","average":{"1min":1.466,"5min":1.466,"15min":1.466},"min":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"max":{"1min":1.96,"5min":1.96,"15min":1.96},"last":1.1559999999999999},{"interface":"front","average":{"1min":1.573,"5min":1.573,"15min":1.573},"min":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":2.6739999999999999,"5min":2.6739999999999999,"15min":2.6739999999999999},"last":1.069}]},{"osd":6,"last update":"Sun Dec 17 11:49:08 2023","interfaces":[{"interface":"back","average":{"1min":1.627,"5min":1.627,"15min":1.627},"min":{"1min":0.754,"5min":0.754,"15min":0.754},"max":{"1min":3.016,"5min":3.016,"15min":3.016},"last":1.381},{"interface":"front","average":{"1min":1.5509999999999999,"5min":1.5509999999999999,"15min":1.5509999999999999},"min":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"max":{"1min":2.508,"5min":2.508,"15min":2.508},"last":1.2090000000000001}]},{"osd":7,"last update":"Sun Dec 17 11:49:08 2023","interfaces":[{"interface":"back","average":{"1min":1.6839999999999999,"5min":1.6839999999999999,"15min":1.6839999999999999},"min":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"max":{"1min":2.944,"5min":2.944,"15min":2.944},"last":1.1319999999999999},{"interface":"front","average":{"1min":1.7170000000000001,"5min":1.7170000000000001,"15min":1.7170000000000001},"min":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"max":{"1min":2.7709999999999999,"5min":2.7709999999999999,"15min":2.7709999999999999},"last":1.431}]}]},{"osd":0,"up_from":14,"seq":60129542168,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28012,"kb_used_data":992,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343828,"statfs":{"total":96636764160,"available":96608079872,"internally_reserved":0,"allocated":1015808,"data_stored":767634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Dec 17 11:49:06 2023","interfaces":[{"interface":"back","average":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.3899999999999999,"5min":1.3899999999999999,"15min":1.3899999999999999},"last":0.78600000000000003},{"interface":"front","average":{"1min":1.1519999999999999,"5min":1.1519999999999999,"15min":1.1519999999999999},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":1.958,"5min":1.958,"15min":1.958},"last":1.0169999999999999}]},{"osd":2,"last update":"Sun Dec 17 11:49:06 2023","interfaces":[{"interface":"back","average":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.7709999999999999,"5min":1.7709999999999999,"15min":1.7709999999999999},"last":1.1279999999999999},{"interface":"front","average":{"1min":1.2090000000000001,"5min":1.2090000000000001,"15min":1.2090000000000001},"min":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":2.2130000000000001,"5min":2.2130000000000001,"15min":2.2130000000000001},"last":1.446}]},{"osd":3,"last update":"Sun Dec 17 11:49:06 2023","interfaces":[{"interface":"back","average":{"1min":1.125,"5min":1.125,"15min":1.125},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.728,"5min":1.728,"15min":1.728},"last":1.089},{"interface":"front","average":{"1min":1.4039999999999999,"5min":1.4039999999999999,"15min":1.4039999999999999},"min":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"max":{"1min":2.4809999999999999,"5min":2.4809999999999999,"15min":2.4809999999999999},"last":1.544}]},{"osd":4,"last update":"Sun Dec 17 11:49:06 2023","interfaces":[{"interface":"back","average":{"1min":1.518,"5min":1.518,"15min":1.518},"min":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"max":{"1min":4.6710000000000003,"5min":4.6710000000000003,"15min":4.6710000000000003},"last":1.2450000000000001},{"interface":"front","average":{"1min":1.427,"5min":1.427,"15min":1.427},"min":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"max":{"1min":2.2799999999999998,"5min":2.2799999999999998,"15min":2.2799999999999998},"last":1.306}]},{"osd":5,"last update":"Sun Dec 17 11:49:06 2023","interfaces":[{"interface":"back","average":{"1min":1.5069999999999999,"5min":1.5069999999999999,"15min":1.5069999999999999},"min":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"max":{"1min":2.1349999999999998,"5min":2.1349999999999998,"15min":2.1349999999999998},"last":1.5029999999999999},{"interface":"front","average":{"1min":1.6240000000000001,"5min":1.6240000000000001,"15min":1.6240000000000001},"min":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"max":{"1min":2.6080000000000001,"5min":2.6080000000000001,"15min":2.6080000000000001},"last":1.7789999999999999}]},{"osd":6,"last update":"Sun Dec 17 11:49:06 2023","interfaces":[{"interface":"back","average":{"1min":1.5800000000000001,"5min":1.5800000000000001,"15min":1.5800000000000001},"min":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"max":{"1min":2.702,"5min":2.702,"15min":2.702},"last":1.6739999999999999},{"interface":"front","average":{"1min":1.534,"5min":1.534,"15min":1.534},"min":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"max":{"1min":2.3100000000000001,"5min":2.3100000000000001,"15min":2.3100000000000001},"last":1.72}]},{"osd":7,"last update":"Sun Dec 17 11:49:06 2023","interfaces":[{"interface":"back","average":{"1min":1.611,"5min":1.611,"15min":1.611},"min":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"max":{"1min":2.3420000000000001,"5min":2.3420000000000001,"15min":2.3420000000000001},"last":1.861},{"interface":"front","average":{"1min":1.577,"5min":1.577,"15min":1.577},"min":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"max":{"1min":2.4359999999999999,"5min":2.4359999999999999,"15min":2.4359999999999999},"last":1.641}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-17T11:49:58.257 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-17T11:49:58.525 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:58.523+0000 7f52d1232640 1 Processor -- start 2023-12-17T11:49:58.526 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:58.524+0000 7f52d1232640 1 -- start start 2023-12-17T11:49:58.528 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:58.525+0000 7f52d1232640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f52cc0d13c0 0x7f52cc0ce5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:58.528 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:58.525+0000 7f52d1232640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52cc0b2280 con 0x7f52cc0b0760 2023-12-17T11:49:58.528 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:58.525+0000 7f52d1232640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52cc0cee70 con 0x7f52cc0d0d70 2023-12-17T11:49:58.528 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:58.525+0000 7f52d1232640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52cc0d11c0 con 0x7f52cc0d13c0 2023-12-17T11:49:58.528 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:58.525+0000 7f52cbfff640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f52cc0d13c0 0x7f52cc0ce5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:58.528 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:58.525+0000 7f52d0a31640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f52cc0b0760 0x7f52cc0b0bb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:45912/0 (socket says 172.21.15.40:45912) 2023-12-17T11:49:58.528 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:58.525+0000 7f52d0a31640 1 -- 172.21.15.40:0/1062511126 learned_addr learned my addr 172.21.15.40:0/1062511126 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-12-17T11:49:58.528 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:58.526+0000 7f52cbfff640 1 -- 172.21.15.40:0/1062511126 >> v1:172.21.15.159:6789/0 conn(0x7f52cc0d0d70 legacy=0x7f52cc0d17a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:49:58.528 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:58.526+0000 7f52cbfff640 1 -- 172.21.15.40:0/1062511126 >> v1:172.21.15.40:6789/0 conn(0x7f52cc0b0760 legacy=0x7f52cc0b0bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:58.528 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:58.526+0000 7f52cbfff640 1 -- 172.21.15.40:0/1062511126 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52cc0ceb90 con 0x7f52cc0d13c0 2023-12-17T11:49:58.528 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:58.526+0000 7f52caffd640 1 -- 172.21.15.40:0/1062511126 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 457832481 0 0) 0x7f52cc0b2280 con 0x7f52cc0b0760 2023-12-17T11:49:58.529 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:58.527+0000 7f52cbfff640 1 --2- 172.21.15.40:0/1062511126 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f52cc0d13c0 0x7f52cc0ce5b0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f52bc009d90 tx=0x7f52bc02be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3cc2f1ce521752d1 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:49:58.529 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:58.527+0000 7f52caffd640 1 -- 172.21.15.40:0/1062511126 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52bc02cbd0 con 0x7f52cc0d13c0 2023-12-17T11:49:58.529 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:58.527+0000 7f52caffd640 1 -- 172.21.15.40:0/1062511126 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52bc02cd30 con 0x7f52cc0d13c0 2023-12-17T11:49:58.529 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:58.527+0000 7f52caffd640 1 -- 172.21.15.40:0/1062511126 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52bc02cea0 con 0x7f52cc0d13c0 2023-12-17T11:49:58.530 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:58.528+0000 7f52d1232640 1 -- 172.21.15.40:0/1062511126 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f52cc0d13c0 msgr2=0x7f52cc0ce5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:58.530 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:58.528+0000 7f52d1232640 1 --2- 172.21.15.40:0/1062511126 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f52cc0d13c0 0x7f52cc0ce5b0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f52bc009d90 tx=0x7f52bc02be20 comp rx=0 tx=0).stop 2023-12-17T11:49:58.530 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:58.528+0000 7f52d1232640 1 -- 172.21.15.40:0/1062511126 shutdown_connections 2023-12-17T11:49:58.530 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:58.528+0000 7f52d1232640 1 --2- 172.21.15.40:0/1062511126 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f52cc0d13c0 0x7f52cc0ce5b0 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:58.530 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:58.528+0000 7f52d1232640 1 -- 172.21.15.40:0/1062511126 >> 172.21.15.40:0/1062511126 conn(0x7f52cc09c260 msgr2=0x7f52cc0d2f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:49:58.530 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:58.528+0000 7f52d1232640 1 -- 172.21.15.40:0/1062511126 shutdown_connections 2023-12-17T11:49:58.530 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:58.528+0000 7f52d1232640 1 -- 172.21.15.40:0/1062511126 wait complete. 2023-12-17T11:49:58.531 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:58.530+0000 7f52d1232640 1 Processor -- start 2023-12-17T11:49:58.532 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:58.530+0000 7f52d1232640 1 -- start start 2023-12-17T11:49:58.533 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:58.531+0000 7f52d1232640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f52cc0b0760 0x7f52cc0a0770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:58.533 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:58.531+0000 7f52d1232640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f52cc0d0d70 0x7f52cc148350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:58.533 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:58.531+0000 7f52d1232640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f52cc0d13c0 0x7f52cc06b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:58.533 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:58.531+0000 7f52d1232640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52cc0a0cb0 con 0x7f52cc0b0760 2023-12-17T11:49:58.533 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:58.531+0000 7f52d1232640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52cc146310 con 0x7f52cc0d13c0 2023-12-17T11:49:58.533 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:58.531+0000 7f52d1232640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52cc148e20 con 0x7f52cc0d0d70 2023-12-17T11:49:58.534 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:58.531+0000 7f52cbfff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f52cc0b0760 0x7f52cc0a0770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:58.534 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:58.531+0000 7f52cbfff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f52cc0b0760 0x7f52cc0a0770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:33862/0 (socket says 172.21.15.40:33862) 2023-12-17T11:49:58.534 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:58.531+0000 7f52cbfff640 1 -- 172.21.15.40:0/3131618787 learned_addr learned my addr 172.21.15.40:0/3131618787 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-17T11:49:58.535 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:58.532+0000 7f52d0a31640 1 --2- 172.21.15.40:0/3131618787 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f52cc0d13c0 0x7f52cc06b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:58.535 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:58.532+0000 7f52cbfff640 1 -- 172.21.15.40:0/3131618787 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f52cc0d0d70 msgr2=0x7f52cc148350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:58.535 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:58.532+0000 7f52cbfff640 1 --2- 172.21.15.40:0/3131618787 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f52cc0d0d70 0x7f52cc148350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:58.535 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:58.532+0000 7f52cbfff640 1 -- 172.21.15.40:0/3131618787 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f52cc0d13c0 msgr2=0x7f52cc06b480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:58.535 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:58.532+0000 7f52cbfff640 1 --2- 172.21.15.40:0/3131618787 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f52cc0d13c0 0x7f52cc06b480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:58.535 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:58.532+0000 7f52cbfff640 1 -- 172.21.15.40:0/3131618787 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52bc009a70 con 0x7f52cc0b0760 2023-12-17T11:49:58.535 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:58.532+0000 7f52d0a31640 1 --2- 172.21.15.40:0/3131618787 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f52cc0d13c0 0x7f52cc06b480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-17T11:49:58.536 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:58.532+0000 7f52cbfff640 1 --2- 172.21.15.40:0/3131618787 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f52cc0b0760 0x7f52cc0a0770 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f52bc009d90 tx=0x7f52bc004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:49:58.536 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:58.532+0000 7f52c8ff9640 1 -- 172.21.15.40:0/3131618787 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52bc02cea0 con 0x7f52cc0b0760 2023-12-17T11:49:58.536 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:58.532+0000 7f52c8ff9640 1 -- 172.21.15.40:0/3131618787 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52bc02cb70 con 0x7f52cc0b0760 2023-12-17T11:49:58.536 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:58.532+0000 7f52c8ff9640 1 -- 172.21.15.40:0/3131618787 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52bc03f870 con 0x7f52cc0b0760 2023-12-17T11:49:58.536 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:58.532+0000 7f52d1232640 1 -- 172.21.15.40:0/3131618787 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52cc149100 con 0x7f52cc0b0760 2023-12-17T11:49:58.536 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:58.532+0000 7f52d1232640 1 -- 172.21.15.40:0/3131618787 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52cc146840 con 0x7f52cc0b0760 2023-12-17T11:49:58.536 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:58.534+0000 7f52d1232640 1 -- 172.21.15.40:0/3131618787 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52cc149320 con 0x7f52cc0b0760 2023-12-17T11:49:58.537 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:58.534+0000 7f52c8ff9640 1 -- 172.21.15.40:0/3131618787 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f52bc03f9d0 con 0x7f52cc0b0760 2023-12-17T11:49:58.537 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:58.535+0000 7f52c8ff9640 1 --2- 172.21.15.40:0/3131618787 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f52b806ae40 0x7f52b806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:58.537 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:58.535+0000 7f52c8ff9640 1 -- 172.21.15.40:0/3131618787 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f52bc0ac220 con 0x7f52cc0b0760 2023-12-17T11:49:58.538 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:58.536+0000 7f52cb7fe640 1 --2- 172.21.15.40:0/3131618787 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f52b806ae40 0x7f52b806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:58.539 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:58.537+0000 7f52cb7fe640 1 --2- 172.21.15.40:0/3131618787 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f52b806ae40 0x7f52b806d300 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f52cc14ca20 tx=0x7f52c00079b0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:49:58.542 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:58.540+0000 7f52c8ff9640 1 -- 172.21.15.40:0/3131618787 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f52bc077220 con 0x7f52cc0b0760 2023-12-17T11:49:58.736 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:58.734+0000 7f52d1232640 1 -- 172.21.15.40:0/3131618787 --> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f52cc0b0240 con 0x7f52b806ae40 2023-12-17T11:49:58.759 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:58.757+0000 7f52c8ff9640 1 -- 172.21.15.40:0/3131618787 <== mgr.4105 v2:172.21.15.159:6832/479465803 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286516 (secure 0 0 0) 0x7f52c0014400 con 0x7f52b806ae40 2023-12-17T11:49:58.762 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T11:49:58.765 INFO:teuthology.orchestra.run.smithi040.stderr:dumped all 2023-12-17T11:49:58.766 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:58.763+0000 7f52d1232640 1 -- 172.21.15.40:0/3131618787 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f52b806ae40 msgr2=0x7f52b806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:58.766 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:58.763+0000 7f52d1232640 1 --2- 172.21.15.40:0/3131618787 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f52b806ae40 0x7f52b806d300 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f52cc14ca20 tx=0x7f52c00079b0 comp rx=0 tx=0).stop 2023-12-17T11:49:58.766 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:58.763+0000 7f52d1232640 1 -- 172.21.15.40:0/3131618787 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f52cc0b0760 msgr2=0x7f52cc0a0770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:58.766 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:58.763+0000 7f52d1232640 1 --2- 172.21.15.40:0/3131618787 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f52cc0b0760 0x7f52cc0a0770 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f52bc009d90 tx=0x7f52bc004a40 comp rx=0 tx=0).stop 2023-12-17T11:49:58.766 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:58.764+0000 7f52d1232640 1 -- 172.21.15.40:0/3131618787 shutdown_connections 2023-12-17T11:49:58.766 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:58.764+0000 7f52d1232640 1 --2- 172.21.15.40:0/3131618787 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f52b806ae40 0x7f52b806d300 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:58.767 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:58.764+0000 7f52d1232640 1 --2- 172.21.15.40:0/3131618787 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f52cc0d13c0 0x7f52cc06b480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:58.767 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:58.764+0000 7f52d1232640 1 --2- 172.21.15.40:0/3131618787 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f52cc0d0d70 0x7f52cc148350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:58.767 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:58.764+0000 7f52d1232640 1 --2- 172.21.15.40:0/3131618787 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f52cc0b0760 0x7f52cc0a0770 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:58.767 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:58.764+0000 7f52d1232640 1 -- 172.21.15.40:0/3131618787 >> 172.21.15.40:0/3131618787 conn(0x7f52cc09c260 msgr2=0x7f52cc0b7580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:49:58.767 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:58.764+0000 7f52d1232640 1 -- 172.21.15.40:0/3131618787 shutdown_connections 2023-12-17T11:49:58.767 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:58.764+0000 7f52d1232640 1 -- 172.21.15.40:0/3131618787 wait complete. 2023-12-17T11:49:58.785 INFO:teuthology.orchestra.run.smithi040.stdout:{"pg_ready":true,"pg_map":{"version":89,"stamp":"2023-12-17T11:49:58.631727+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":190,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":225160,"kb_used_data":4808,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754749560,"statfs":{"total":773094113280,"available":772863549440,"internally_reserved":0,"allocated":4923392,"data_stored":2766164,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":225496626},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":45,"apply_latency_ms":45,"commit_latency_ns":45000000,"apply_latency_ns":45000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.440972"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:54.216027+0000","last_change":"2023-12-17T11:49:53.251801+0000","last_active":"2023-12-17T11:49:54.216027+0000","last_peered":"2023-12-17T11:49:54.216027+0000","last_clean":"2023-12-17T11:49:54.216027+0000","last_became_active":"2023-12-17T11:49:53.251221+0000","last_became_peered":"2023-12-17T11:49:53.251221+0000","last_unstale":"2023-12-17T11:49:54.216027+0000","last_undegraded":"2023-12-17T11:49:54.216027+0000","last_fullsized":"2023-12-17T11:49:54.216027+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T22:42:15.785143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:54.215843+0000","last_change":"2023-12-17T11:49:53.243478+0000","last_active":"2023-12-17T11:49:54.215843+0000","last_peered":"2023-12-17T11:49:54.215843+0000","last_clean":"2023-12-17T11:49:54.215843+0000","last_became_active":"2023-12-17T11:49:53.243179+0000","last_became_peered":"2023-12-17T11:49:53.243179+0000","last_unstale":"2023-12-17T11:49:54.215843+0000","last_undegraded":"2023-12-17T11:49:54.215843+0000","last_fullsized":"2023-12-17T11:49:54.215843+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T23:49:09.469993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:55.302203+0000","last_change":"2023-12-17T11:49:53.249501+0000","last_active":"2023-12-17T11:49:55.302203+0000","last_peered":"2023-12-17T11:49:55.302203+0000","last_clean":"2023-12-17T11:49:55.302203+0000","last_became_active":"2023-12-17T11:49:53.249212+0000","last_became_peered":"2023-12-17T11:49:53.249212+0000","last_unstale":"2023-12-17T11:49:55.302203+0000","last_undegraded":"2023-12-17T11:49:55.302203+0000","last_fullsized":"2023-12-17T11:49:55.302203+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T22:50:12.261960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:55.300617+0000","last_change":"2023-12-17T11:49:53.237486+0000","last_active":"2023-12-17T11:49:55.300617+0000","last_peered":"2023-12-17T11:49:55.300617+0000","last_clean":"2023-12-17T11:49:55.300617+0000","last_became_active":"2023-12-17T11:49:53.236766+0000","last_became_peered":"2023-12-17T11:49:53.236766+0000","last_unstale":"2023-12-17T11:49:55.300617+0000","last_undegraded":"2023-12-17T11:49:55.300617+0000","last_fullsized":"2023-12-17T11:49:55.300617+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T19:34:01.395947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:55.300273+0000","last_change":"2023-12-17T11:49:53.230175+0000","last_active":"2023-12-17T11:49:55.300273+0000","last_peered":"2023-12-17T11:49:55.300273+0000","last_clean":"2023-12-17T11:49:55.300273+0000","last_became_active":"2023-12-17T11:49:53.229756+0000","last_became_peered":"2023-12-17T11:49:53.229756+0000","last_unstale":"2023-12-17T11:49:55.300273+0000","last_undegraded":"2023-12-17T11:49:55.300273+0000","last_fullsized":"2023-12-17T11:49:55.300273+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T15:43:04.869288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:54.556742+0000","last_change":"2023-12-17T11:49:53.245040+0000","last_active":"2023-12-17T11:49:54.556742+0000","last_peered":"2023-12-17T11:49:54.556742+0000","last_clean":"2023-12-17T11:49:54.556742+0000","last_became_active":"2023-12-17T11:49:53.243989+0000","last_became_peered":"2023-12-17T11:49:53.243989+0000","last_unstale":"2023-12-17T11:49:54.556742+0000","last_undegraded":"2023-12-17T11:49:54.556742+0000","last_fullsized":"2023-12-17T11:49:54.556742+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T16:31:53.964205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:55.303516+0000","last_change":"2023-12-17T11:49:53.244506+0000","last_active":"2023-12-17T11:49:55.303516+0000","last_peered":"2023-12-17T11:49:55.303516+0000","last_clean":"2023-12-17T11:49:55.303516+0000","last_became_active":"2023-12-17T11:49:53.244244+0000","last_became_peered":"2023-12-17T11:49:53.244244+0000","last_unstale":"2023-12-17T11:49:55.303516+0000","last_undegraded":"2023-12-17T11:49:55.303516+0000","last_fullsized":"2023-12-17T11:49:55.303516+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T12:27:38.132749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:54.215326+0000","last_change":"2023-12-17T11:49:53.256713+0000","last_active":"2023-12-17T11:49:54.215326+0000","last_peered":"2023-12-17T11:49:54.215326+0000","last_clean":"2023-12-17T11:49:54.215326+0000","last_became_active":"2023-12-17T11:49:53.255850+0000","last_became_peered":"2023-12-17T11:49:53.255850+0000","last_unstale":"2023-12-17T11:49:54.215326+0000","last_undegraded":"2023-12-17T11:49:54.215326+0000","last_fullsized":"2023-12-17T11:49:54.215326+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T14:00:43.418107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:55.302135+0000","last_change":"2023-12-17T11:49:53.255007+0000","last_active":"2023-12-17T11:49:55.302135+0000","last_peered":"2023-12-17T11:49:55.302135+0000","last_clean":"2023-12-17T11:49:55.302135+0000","last_became_active":"2023-12-17T11:49:53.254750+0000","last_became_peered":"2023-12-17T11:49:53.254750+0000","last_unstale":"2023-12-17T11:49:55.302135+0000","last_undegraded":"2023-12-17T11:49:55.302135+0000","last_fullsized":"2023-12-17T11:49:55.302135+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T19:23:44.505187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:55.304578+0000","last_change":"2023-12-17T11:49:53.243885+0000","last_active":"2023-12-17T11:49:55.304578+0000","last_peered":"2023-12-17T11:49:55.304578+0000","last_clean":"2023-12-17T11:49:55.304578+0000","last_became_active":"2023-12-17T11:49:53.243586+0000","last_became_peered":"2023-12-17T11:49:53.243586+0000","last_unstale":"2023-12-17T11:49:55.304578+0000","last_undegraded":"2023-12-17T11:49:55.304578+0000","last_fullsized":"2023-12-17T11:49:55.304578+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T23:49:09.469993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:55.304683+0000","last_change":"2023-12-17T11:49:53.245071+0000","last_active":"2023-12-17T11:49:55.304683+0000","last_peered":"2023-12-17T11:49:55.304683+0000","last_clean":"2023-12-17T11:49:55.304683+0000","last_became_active":"2023-12-17T11:49:53.244696+0000","last_became_peered":"2023-12-17T11:49:53.244696+0000","last_unstale":"2023-12-17T11:49:55.304683+0000","last_undegraded":"2023-12-17T11:49:55.304683+0000","last_fullsized":"2023-12-17T11:49:55.304683+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T17:56:09.285369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:55.302165+0000","last_change":"2023-12-17T11:49:53.244437+0000","last_active":"2023-12-17T11:49:55.302165+0000","last_peered":"2023-12-17T11:49:55.302165+0000","last_clean":"2023-12-17T11:49:55.302165+0000","last_became_active":"2023-12-17T11:49:53.244158+0000","last_became_peered":"2023-12-17T11:49:53.244158+0000","last_unstale":"2023-12-17T11:49:55.302165+0000","last_undegraded":"2023-12-17T11:49:55.302165+0000","last_fullsized":"2023-12-17T11:49:55.302165+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T12:12:45.651530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:55.303911+0000","last_change":"2023-12-17T11:49:53.259954+0000","last_active":"2023-12-17T11:49:55.303911+0000","last_peered":"2023-12-17T11:49:55.303911+0000","last_clean":"2023-12-17T11:49:55.303911+0000","last_became_active":"2023-12-17T11:49:53.259683+0000","last_became_peered":"2023-12-17T11:49:53.259683+0000","last_unstale":"2023-12-17T11:49:55.303911+0000","last_undegraded":"2023-12-17T11:49:55.303911+0000","last_fullsized":"2023-12-17T11:49:55.303911+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T13:29:29.953615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:54.218414+0000","last_change":"2023-12-17T11:49:53.251388+0000","last_active":"2023-12-17T11:49:54.218414+0000","last_peered":"2023-12-17T11:49:54.218414+0000","last_clean":"2023-12-17T11:49:54.218414+0000","last_became_active":"2023-12-17T11:49:53.251182+0000","last_became_peered":"2023-12-17T11:49:53.251182+0000","last_unstale":"2023-12-17T11:49:54.218414+0000","last_undegraded":"2023-12-17T11:49:54.218414+0000","last_fullsized":"2023-12-17T11:49:54.218414+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T19:39:18.340154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:55.303846+0000","last_change":"2023-12-17T11:49:53.251484+0000","last_active":"2023-12-17T11:49:55.303846+0000","last_peered":"2023-12-17T11:49:55.303846+0000","last_clean":"2023-12-17T11:49:55.303846+0000","last_became_active":"2023-12-17T11:49:53.250825+0000","last_became_peered":"2023-12-17T11:49:53.250825+0000","last_unstale":"2023-12-17T11:49:55.303846+0000","last_undegraded":"2023-12-17T11:49:55.303846+0000","last_fullsized":"2023-12-17T11:49:55.303846+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T12:48:09.865175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:55.301502+0000","last_change":"2023-12-17T11:49:53.256736+0000","last_active":"2023-12-17T11:49:55.301502+0000","last_peered":"2023-12-17T11:49:55.301502+0000","last_clean":"2023-12-17T11:49:55.301502+0000","last_became_active":"2023-12-17T11:49:53.256319+0000","last_became_peered":"2023-12-17T11:49:53.256319+0000","last_unstale":"2023-12-17T11:49:55.301502+0000","last_undegraded":"2023-12-17T11:49:55.301502+0000","last_fullsized":"2023-12-17T11:49:55.301502+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T14:49:05.628056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:55.302967+0000","last_change":"2023-12-17T11:49:53.254466+0000","last_active":"2023-12-17T11:49:55.302967+0000","last_peered":"2023-12-17T11:49:55.302967+0000","last_clean":"2023-12-17T11:49:55.302967+0000","last_became_active":"2023-12-17T11:49:53.254191+0000","last_became_peered":"2023-12-17T11:49:53.254191+0000","last_unstale":"2023-12-17T11:49:55.302967+0000","last_undegraded":"2023-12-17T11:49:55.302967+0000","last_fullsized":"2023-12-17T11:49:55.302967+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T15:34:59.184998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:54.219676+0000","last_change":"2023-12-17T11:49:53.244371+0000","last_active":"2023-12-17T11:49:54.219676+0000","last_peered":"2023-12-17T11:49:54.219676+0000","last_clean":"2023-12-17T11:49:54.219676+0000","last_became_active":"2023-12-17T11:49:53.243288+0000","last_became_peered":"2023-12-17T11:49:53.243288+0000","last_unstale":"2023-12-17T11:49:54.219676+0000","last_undegraded":"2023-12-17T11:49:54.219676+0000","last_fullsized":"2023-12-17T11:49:54.219676+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T22:59:01.401999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:55.300850+0000","last_change":"2023-12-17T11:49:53.247133+0000","last_active":"2023-12-17T11:49:55.300850+0000","last_peered":"2023-12-17T11:49:55.300850+0000","last_clean":"2023-12-17T11:49:55.300850+0000","last_became_active":"2023-12-17T11:49:53.246863+0000","last_became_peered":"2023-12-17T11:49:53.246863+0000","last_unstale":"2023-12-17T11:49:55.300850+0000","last_undegraded":"2023-12-17T11:49:55.300850+0000","last_fullsized":"2023-12-17T11:49:55.300850+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T15:22:56.669665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:54.219126+0000","last_change":"2023-12-17T11:49:53.234246+0000","last_active":"2023-12-17T11:49:54.219126+0000","last_peered":"2023-12-17T11:49:54.219126+0000","last_clean":"2023-12-17T11:49:54.219126+0000","last_became_active":"2023-12-17T11:49:53.233971+0000","last_became_peered":"2023-12-17T11:49:53.233971+0000","last_unstale":"2023-12-17T11:49:54.219126+0000","last_undegraded":"2023-12-17T11:49:54.219126+0000","last_fullsized":"2023-12-17T11:49:54.219126+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T21:22:15.324114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:55.304097+0000","last_change":"2023-12-17T11:49:53.254631+0000","last_active":"2023-12-17T11:49:55.304097+0000","last_peered":"2023-12-17T11:49:55.304097+0000","last_clean":"2023-12-17T11:49:55.304097+0000","last_became_active":"2023-12-17T11:49:53.254246+0000","last_became_peered":"2023-12-17T11:49:53.254246+0000","last_unstale":"2023-12-17T11:49:55.304097+0000","last_undegraded":"2023-12-17T11:49:55.304097+0000","last_fullsized":"2023-12-17T11:49:55.304097+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T15:42:47.132551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:54.219970+0000","last_change":"2023-12-17T11:49:53.233281+0000","last_active":"2023-12-17T11:49:54.219970+0000","last_peered":"2023-12-17T11:49:54.219970+0000","last_clean":"2023-12-17T11:49:54.219970+0000","last_became_active":"2023-12-17T11:49:53.233006+0000","last_became_peered":"2023-12-17T11:49:53.233006+0000","last_unstale":"2023-12-17T11:49:54.219970+0000","last_undegraded":"2023-12-17T11:49:54.219970+0000","last_fullsized":"2023-12-17T11:49:54.219970+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T17:37:46.058341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:55.301627+0000","last_change":"2023-12-17T11:49:53.235006+0000","last_active":"2023-12-17T11:49:55.301627+0000","last_peered":"2023-12-17T11:49:55.301627+0000","last_clean":"2023-12-17T11:49:55.301627+0000","last_became_active":"2023-12-17T11:49:53.232828+0000","last_became_peered":"2023-12-17T11:49:53.232828+0000","last_unstale":"2023-12-17T11:49:55.301627+0000","last_undegraded":"2023-12-17T11:49:55.301627+0000","last_fullsized":"2023-12-17T11:49:55.301627+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T21:34:46.442330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:55.300810+0000","last_change":"2023-12-17T11:49:53.229937+0000","last_active":"2023-12-17T11:49:55.300810+0000","last_peered":"2023-12-17T11:49:55.300810+0000","last_clean":"2023-12-17T11:49:55.300810+0000","last_became_active":"2023-12-17T11:49:53.229360+0000","last_became_peered":"2023-12-17T11:49:53.229360+0000","last_unstale":"2023-12-17T11:49:55.300810+0000","last_undegraded":"2023-12-17T11:49:55.300810+0000","last_fullsized":"2023-12-17T11:49:55.300810+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T13:22:57.464897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:54.220001+0000","last_change":"2023-12-17T11:49:53.248140+0000","last_active":"2023-12-17T11:49:54.220001+0000","last_peered":"2023-12-17T11:49:54.220001+0000","last_clean":"2023-12-17T11:49:54.220001+0000","last_became_active":"2023-12-17T11:49:53.246139+0000","last_became_peered":"2023-12-17T11:49:53.246139+0000","last_unstale":"2023-12-17T11:49:54.220001+0000","last_undegraded":"2023-12-17T11:49:54.220001+0000","last_fullsized":"2023-12-17T11:49:54.220001+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T14:32:00.462222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:54.557357+0000","last_change":"2023-12-17T11:49:53.255892+0000","last_active":"2023-12-17T11:49:54.557357+0000","last_peered":"2023-12-17T11:49:54.557357+0000","last_clean":"2023-12-17T11:49:54.557357+0000","last_became_active":"2023-12-17T11:49:53.255307+0000","last_became_peered":"2023-12-17T11:49:53.255307+0000","last_unstale":"2023-12-17T11:49:54.557357+0000","last_undegraded":"2023-12-17T11:49:54.557357+0000","last_fullsized":"2023-12-17T11:49:54.557357+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T17:37:46.058341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:54.219290+0000","last_change":"2023-12-17T11:49:53.238527+0000","last_active":"2023-12-17T11:49:54.219290+0000","last_peered":"2023-12-17T11:49:54.219290+0000","last_clean":"2023-12-17T11:49:54.219290+0000","last_became_active":"2023-12-17T11:49:53.238260+0000","last_became_peered":"2023-12-17T11:49:53.238260+0000","last_unstale":"2023-12-17T11:49:54.219290+0000","last_undegraded":"2023-12-17T11:49:54.219290+0000","last_fullsized":"2023-12-17T11:49:54.219290+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T14:03:14.332356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:55.304415+0000","last_change":"2023-12-17T11:49:53.247243+0000","last_active":"2023-12-17T11:49:55.304415+0000","last_peered":"2023-12-17T11:49:55.304415+0000","last_clean":"2023-12-17T11:49:55.304415+0000","last_became_active":"2023-12-17T11:49:53.246983+0000","last_became_peered":"2023-12-17T11:49:53.246983+0000","last_unstale":"2023-12-17T11:49:55.304415+0000","last_undegraded":"2023-12-17T11:49:55.304415+0000","last_fullsized":"2023-12-17T11:49:55.304415+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T23:33:06.562683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:54.218870+0000","last_change":"2023-12-17T11:49:53.247287+0000","last_active":"2023-12-17T11:49:54.218870+0000","last_peered":"2023-12-17T11:49:54.218870+0000","last_clean":"2023-12-17T11:49:54.218870+0000","last_became_active":"2023-12-17T11:49:53.246995+0000","last_became_peered":"2023-12-17T11:49:53.246995+0000","last_unstale":"2023-12-17T11:49:54.218870+0000","last_undegraded":"2023-12-17T11:49:54.218870+0000","last_fullsized":"2023-12-17T11:49:54.218870+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T14:03:09.358474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:54.219180+0000","last_change":"2023-12-17T11:49:53.240901+0000","last_active":"2023-12-17T11:49:54.219180+0000","last_peered":"2023-12-17T11:49:54.219180+0000","last_clean":"2023-12-17T11:49:54.219180+0000","last_became_active":"2023-12-17T11:49:53.240589+0000","last_became_peered":"2023-12-17T11:49:53.240589+0000","last_unstale":"2023-12-17T11:49:54.219180+0000","last_undegraded":"2023-12-17T11:49:54.219180+0000","last_fullsized":"2023-12-17T11:49:54.219180+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T19:17:47.294209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:55.301788+0000","last_change":"2023-12-17T11:49:53.239855+0000","last_active":"2023-12-17T11:49:55.301788+0000","last_peered":"2023-12-17T11:49:55.301788+0000","last_clean":"2023-12-17T11:49:55.301788+0000","last_became_active":"2023-12-17T11:49:53.239579+0000","last_became_peered":"2023-12-17T11:49:53.239579+0000","last_unstale":"2023-12-17T11:49:55.301788+0000","last_undegraded":"2023-12-17T11:49:55.301788+0000","last_fullsized":"2023-12-17T11:49:55.301788+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T20:29:09.996550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:54.556835+0000","last_change":"2023-12-17T11:49:53.252543+0000","last_active":"2023-12-17T11:49:54.556835+0000","last_peered":"2023-12-17T11:49:54.556835+0000","last_clean":"2023-12-17T11:49:54.556835+0000","last_became_active":"2023-12-17T11:49:53.250790+0000","last_became_peered":"2023-12-17T11:49:53.250790+0000","last_unstale":"2023-12-17T11:49:54.556835+0000","last_undegraded":"2023-12-17T11:49:54.556835+0000","last_fullsized":"2023-12-17T11:49:54.556835+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T19:00:07.905809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:55.302468+0000","last_change":"2023-12-17T11:49:53.245226+0000","last_active":"2023-12-17T11:49:55.302468+0000","last_peered":"2023-12-17T11:49:55.302468+0000","last_clean":"2023-12-17T11:49:55.302468+0000","last_became_active":"2023-12-17T11:49:53.243115+0000","last_became_peered":"2023-12-17T11:49:53.243115+0000","last_unstale":"2023-12-17T11:49:55.302468+0000","last_undegraded":"2023-12-17T11:49:55.302468+0000","last_fullsized":"2023-12-17T11:49:55.302468+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T15:06:34.831619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"39'4","reported_seq":16,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-17T11:49:53.259894+0000","last_change":"2023-12-17T11:49:52.226944+0000","last_active":"2023-12-17T11:49:53.259894+0000","last_peered":"2023-12-17T11:49:53.259894+0000","last_clean":"2023-12-17T11:49:53.259894+0000","last_became_active":"2023-12-17T11:49:52.226659+0000","last_became_peered":"2023-12-17T11:49:52.226659+0000","last_unstale":"2023-12-17T11:49:53.259894+0000","last_undegraded":"2023-12-17T11:49:53.259894+0000","last_fullsized":"2023-12-17T11:49:53.259894+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_clean_scrub_stamp":"2023-12-17T11:49:51.168108+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T13:22:56.453467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:54.557487+0000","last_change":"2023-12-17T11:49:53.254791+0000","last_active":"2023-12-17T11:49:54.557487+0000","last_peered":"2023-12-17T11:49:54.557487+0000","last_clean":"2023-12-17T11:49:54.557487+0000","last_became_active":"2023-12-17T11:49:53.254496+0000","last_became_peered":"2023-12-17T11:49:53.254496+0000","last_unstale":"2023-12-17T11:49:54.557487+0000","last_undegraded":"2023-12-17T11:49:54.557487+0000","last_fullsized":"2023-12-17T11:49:54.557487+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T14:42:29.543380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"39'1","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-17T11:49:53.254240+0000","last_change":"2023-12-17T11:49:52.223256+0000","last_active":"2023-12-17T11:49:53.254240+0000","last_peered":"2023-12-17T11:49:53.254240+0000","last_clean":"2023-12-17T11:49:53.254240+0000","last_became_active":"2023-12-17T11:49:52.222808+0000","last_became_peered":"2023-12-17T11:49:52.222808+0000","last_unstale":"2023-12-17T11:49:53.254240+0000","last_undegraded":"2023-12-17T11:49:53.254240+0000","last_fullsized":"2023-12-17T11:49:53.254240+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_clean_scrub_stamp":"2023-12-17T11:49:51.168108+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T16:31:52.952775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:54.220368+0000","last_change":"2023-12-17T11:49:53.251178+0000","last_active":"2023-12-17T11:49:54.220368+0000","last_peered":"2023-12-17T11:49:54.220368+0000","last_clean":"2023-12-17T11:49:54.220368+0000","last_became_active":"2023-12-17T11:49:53.250223+0000","last_became_peered":"2023-12-17T11:49:53.250223+0000","last_unstale":"2023-12-17T11:49:54.220368+0000","last_undegraded":"2023-12-17T11:49:54.220368+0000","last_fullsized":"2023-12-17T11:49:54.220368+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T23:10:56.100255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"39'2","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-17T11:49:53.249819+0000","last_change":"2023-12-17T11:49:52.223879+0000","last_active":"2023-12-17T11:49:53.249819+0000","last_peered":"2023-12-17T11:49:53.249819+0000","last_clean":"2023-12-17T11:49:53.249819+0000","last_became_active":"2023-12-17T11:49:52.223602+0000","last_became_peered":"2023-12-17T11:49:52.223602+0000","last_unstale":"2023-12-17T11:49:53.249819+0000","last_undegraded":"2023-12-17T11:49:53.249819+0000","last_fullsized":"2023-12-17T11:49:53.249819+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_clean_scrub_stamp":"2023-12-17T11:49:51.168108+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T15:25:46.493177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:54.215810+0000","last_change":"2023-12-17T11:49:53.254646+0000","last_active":"2023-12-17T11:49:54.215810+0000","last_peered":"2023-12-17T11:49:54.215810+0000","last_clean":"2023-12-17T11:49:54.215810+0000","last_became_active":"2023-12-17T11:49:53.254368+0000","last_became_peered":"2023-12-17T11:49:53.254368+0000","last_unstale":"2023-12-17T11:49:54.215810+0000","last_undegraded":"2023-12-17T11:49:54.215810+0000","last_fullsized":"2023-12-17T11:49:54.215810+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T15:42:47.132551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"39'2","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-17T11:49:53.261997+0000","last_change":"2023-12-17T11:49:52.221006+0000","last_active":"2023-12-17T11:49:53.261997+0000","last_peered":"2023-12-17T11:49:53.261997+0000","last_clean":"2023-12-17T11:49:53.261997+0000","last_became_active":"2023-12-17T11:49:52.220514+0000","last_became_peered":"2023-12-17T11:49:52.220514+0000","last_unstale":"2023-12-17T11:49:53.261997+0000","last_undegraded":"2023-12-17T11:49:53.261997+0000","last_fullsized":"2023-12-17T11:49:53.261997+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_clean_scrub_stamp":"2023-12-17T11:49:51.168108+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T15:25:46.493177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:55.301494+0000","last_change":"2023-12-17T11:49:53.251737+0000","last_active":"2023-12-17T11:49:55.301494+0000","last_peered":"2023-12-17T11:49:55.301494+0000","last_clean":"2023-12-17T11:49:55.301494+0000","last_became_active":"2023-12-17T11:49:53.251458+0000","last_became_peered":"2023-12-17T11:49:53.251458+0000","last_unstale":"2023-12-17T11:49:55.301494+0000","last_undegraded":"2023-12-17T11:49:55.301494+0000","last_fullsized":"2023-12-17T11:49:55.301494+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T17:37:46.058341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"39'1","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-17T11:49:53.261144+0000","last_change":"2023-12-17T11:49:52.226918+0000","last_active":"2023-12-17T11:49:53.261144+0000","last_peered":"2023-12-17T11:49:53.261144+0000","last_clean":"2023-12-17T11:49:53.261144+0000","last_became_active":"2023-12-17T11:49:52.226455+0000","last_became_peered":"2023-12-17T11:49:52.226455+0000","last_unstale":"2023-12-17T11:49:53.261144+0000","last_undegraded":"2023-12-17T11:49:53.261144+0000","last_fullsized":"2023-12-17T11:49:53.261144+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_clean_scrub_stamp":"2023-12-17T11:49:51.168108+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T12:12:44.640100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:55.303916+0000","last_change":"2023-12-17T11:49:53.251691+0000","last_active":"2023-12-17T11:49:55.303916+0000","last_peered":"2023-12-17T11:49:55.303916+0000","last_clean":"2023-12-17T11:49:55.303916+0000","last_became_active":"2023-12-17T11:49:53.251175+0000","last_became_peered":"2023-12-17T11:49:53.251175+0000","last_unstale":"2023-12-17T11:49:55.303916+0000","last_undegraded":"2023-12-17T11:49:55.303916+0000","last_fullsized":"2023-12-17T11:49:55.303916+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T14:00:43.418107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"39'1","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:55.301855+0000","last_change":"2023-12-17T11:49:52.225053+0000","last_active":"2023-12-17T11:49:55.301855+0000","last_peered":"2023-12-17T11:49:55.301855+0000","last_clean":"2023-12-17T11:49:55.301855+0000","last_became_active":"2023-12-17T11:49:52.224761+0000","last_became_peered":"2023-12-17T11:49:52.224761+0000","last_unstale":"2023-12-17T11:49:55.301855+0000","last_undegraded":"2023-12-17T11:49:55.301855+0000","last_fullsized":"2023-12-17T11:49:55.301855+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_clean_scrub_stamp":"2023-12-17T11:49:51.168108+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T20:30:07.106128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:54.219620+0000","last_change":"2023-12-17T11:49:53.255162+0000","last_active":"2023-12-17T11:49:54.219620+0000","last_peered":"2023-12-17T11:49:54.219620+0000","last_clean":"2023-12-17T11:49:54.219620+0000","last_became_active":"2023-12-17T11:49:53.254841+0000","last_became_peered":"2023-12-17T11:49:53.254841+0000","last_unstale":"2023-12-17T11:49:54.219620+0000","last_undegraded":"2023-12-17T11:49:54.219620+0000","last_fullsized":"2023-12-17T11:49:54.219620+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T19:00:07.905809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-17T11:49:53.239765+0000","last_change":"2023-12-17T11:49:52.230598+0000","last_active":"2023-12-17T11:49:53.239765+0000","last_peered":"2023-12-17T11:49:53.239765+0000","last_clean":"2023-12-17T11:49:53.239765+0000","last_became_active":"2023-12-17T11:49:52.230298+0000","last_became_peered":"2023-12-17T11:49:52.230298+0000","last_unstale":"2023-12-17T11:49:53.239765+0000","last_undegraded":"2023-12-17T11:49:53.239765+0000","last_fullsized":"2023-12-17T11:49:53.239765+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_clean_scrub_stamp":"2023-12-17T11:49:51.168108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T22:39:30.094160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:54.215441+0000","last_change":"2023-12-17T11:49:53.249431+0000","last_active":"2023-12-17T11:49:54.215441+0000","last_peered":"2023-12-17T11:49:54.215441+0000","last_clean":"2023-12-17T11:49:54.215441+0000","last_became_active":"2023-12-17T11:49:53.248943+0000","last_became_peered":"2023-12-17T11:49:53.248943+0000","last_unstale":"2023-12-17T11:49:54.215441+0000","last_undegraded":"2023-12-17T11:49:54.215441+0000","last_fullsized":"2023-12-17T11:49:54.215441+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T16:21:14.355302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-17T11:49:53.227566+0000","last_change":"2023-12-17T11:49:52.224198+0000","last_active":"2023-12-17T11:49:53.227566+0000","last_peered":"2023-12-17T11:49:53.227566+0000","last_clean":"2023-12-17T11:49:53.227566+0000","last_became_active":"2023-12-17T11:49:52.223829+0000","last_became_peered":"2023-12-17T11:49:52.223829+0000","last_unstale":"2023-12-17T11:49:53.227566+0000","last_undegraded":"2023-12-17T11:49:53.227566+0000","last_fullsized":"2023-12-17T11:49:53.227566+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_clean_scrub_stamp":"2023-12-17T11:49:51.168108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T13:20:29.045455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:55.300657+0000","last_change":"2023-12-17T11:49:53.232883+0000","last_active":"2023-12-17T11:49:55.300657+0000","last_peered":"2023-12-17T11:49:55.300657+0000","last_clean":"2023-12-17T11:49:55.300657+0000","last_became_active":"2023-12-17T11:49:53.232629+0000","last_became_peered":"2023-12-17T11:49:53.232629+0000","last_unstale":"2023-12-17T11:49:55.300657+0000","last_undegraded":"2023-12-17T11:49:55.300657+0000","last_fullsized":"2023-12-17T11:49:55.300657+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T18:07:10.105462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-17T11:49:53.240402+0000","last_change":"2023-12-17T11:49:52.215890+0000","last_active":"2023-12-17T11:49:53.240402+0000","last_peered":"2023-12-17T11:49:53.240402+0000","last_clean":"2023-12-17T11:49:53.240402+0000","last_became_active":"2023-12-17T11:49:52.215576+0000","last_became_peered":"2023-12-17T11:49:52.215576+0000","last_unstale":"2023-12-17T11:49:53.240402+0000","last_undegraded":"2023-12-17T11:49:53.240402+0000","last_fullsized":"2023-12-17T11:49:53.240402+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_clean_scrub_stamp":"2023-12-17T11:49:51.168108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T17:03:59.637357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:55.302907+0000","last_change":"2023-12-17T11:49:53.236661+0000","last_active":"2023-12-17T11:49:55.302907+0000","last_peered":"2023-12-17T11:49:55.302907+0000","last_clean":"2023-12-17T11:49:55.302907+0000","last_became_active":"2023-12-17T11:49:53.236319+0000","last_became_peered":"2023-12-17T11:49:53.236319+0000","last_unstale":"2023-12-17T11:49:55.302907+0000","last_undegraded":"2023-12-17T11:49:55.302907+0000","last_fullsized":"2023-12-17T11:49:55.302907+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T13:29:01.309715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-17T11:49:53.251543+0000","last_change":"2023-12-17T11:49:52.233070+0000","last_active":"2023-12-17T11:49:53.251543+0000","last_peered":"2023-12-17T11:49:53.251543+0000","last_clean":"2023-12-17T11:49:53.251543+0000","last_became_active":"2023-12-17T11:49:52.232635+0000","last_became_peered":"2023-12-17T11:49:52.232635+0000","last_unstale":"2023-12-17T11:49:53.251543+0000","last_undegraded":"2023-12-17T11:49:53.251543+0000","last_fullsized":"2023-12-17T11:49:53.251543+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_clean_scrub_stamp":"2023-12-17T11:49:51.168108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T15:53:07.030004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:55.302148+0000","last_change":"2023-12-17T11:49:53.246755+0000","last_active":"2023-12-17T11:49:55.302148+0000","last_peered":"2023-12-17T11:49:55.302148+0000","last_clean":"2023-12-17T11:49:55.302148+0000","last_became_active":"2023-12-17T11:49:53.245111+0000","last_became_peered":"2023-12-17T11:49:53.245111+0000","last_unstale":"2023-12-17T11:49:55.302148+0000","last_undegraded":"2023-12-17T11:49:55.302148+0000","last_fullsized":"2023-12-17T11:49:55.302148+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T14:59:11.557660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"39'3","reported_seq":15,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-17T11:49:53.266858+0000","last_change":"2023-12-17T11:49:52.231475+0000","last_active":"2023-12-17T11:49:53.266858+0000","last_peered":"2023-12-17T11:49:53.266858+0000","last_clean":"2023-12-17T11:49:53.266858+0000","last_became_active":"2023-12-17T11:49:52.230061+0000","last_became_peered":"2023-12-17T11:49:52.230061+0000","last_unstale":"2023-12-17T11:49:53.266858+0000","last_undegraded":"2023-12-17T11:49:53.266858+0000","last_fullsized":"2023-12-17T11:49:53.266858+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_clean_scrub_stamp":"2023-12-17T11:49:51.168108+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T22:50:11.250530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:54.219863+0000","last_change":"2023-12-17T11:49:53.232224+0000","last_active":"2023-12-17T11:49:54.219863+0000","last_peered":"2023-12-17T11:49:54.219863+0000","last_clean":"2023-12-17T11:49:54.219863+0000","last_became_active":"2023-12-17T11:49:53.231963+0000","last_became_peered":"2023-12-17T11:49:53.231963+0000","last_unstale":"2023-12-17T11:49:54.219863+0000","last_undegraded":"2023-12-17T11:49:54.219863+0000","last_fullsized":"2023-12-17T11:49:54.219863+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T15:14:36.959400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"39'6","reported_seq":18,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-17T11:49:53.266491+0000","last_change":"2023-12-17T11:49:52.220583+0000","last_active":"2023-12-17T11:49:53.266491+0000","last_peered":"2023-12-17T11:49:53.266491+0000","last_clean":"2023-12-17T11:49:53.266491+0000","last_became_active":"2023-12-17T11:49:52.220304+0000","last_became_peered":"2023-12-17T11:49:52.220304+0000","last_unstale":"2023-12-17T11:49:53.266491+0000","last_undegraded":"2023-12-17T11:49:53.266491+0000","last_fullsized":"2023-12-17T11:49:53.266491+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_clean_scrub_stamp":"2023-12-17T11:49:51.168108+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T12:27:37.121319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:55.301511+0000","last_change":"2023-12-17T11:49:53.248442+0000","last_active":"2023-12-17T11:49:55.301511+0000","last_peered":"2023-12-17T11:49:55.301511+0000","last_clean":"2023-12-17T11:49:55.301511+0000","last_became_active":"2023-12-17T11:49:53.248094+0000","last_became_peered":"2023-12-17T11:49:53.248094+0000","last_unstale":"2023-12-17T11:49:55.301511+0000","last_undegraded":"2023-12-17T11:49:55.301511+0000","last_fullsized":"2023-12-17T11:49:55.301511+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T14:42:29.543380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"39'2","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-17T11:49:53.257236+0000","last_change":"2023-12-17T11:49:52.213341+0000","last_active":"2023-12-17T11:49:53.257236+0000","last_peered":"2023-12-17T11:49:53.257236+0000","last_clean":"2023-12-17T11:49:53.257236+0000","last_became_active":"2023-12-17T11:49:52.213024+0000","last_became_peered":"2023-12-17T11:49:52.213024+0000","last_unstale":"2023-12-17T11:49:53.257236+0000","last_undegraded":"2023-12-17T11:49:53.257236+0000","last_fullsized":"2023-12-17T11:49:53.257236+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_clean_scrub_stamp":"2023-12-17T11:49:51.168108+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T20:34:24.431589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:54.215271+0000","last_change":"2023-12-17T11:49:53.238931+0000","last_active":"2023-12-17T11:49:54.215271+0000","last_peered":"2023-12-17T11:49:54.215271+0000","last_clean":"2023-12-17T11:49:54.215271+0000","last_became_active":"2023-12-17T11:49:53.238641+0000","last_became_peered":"2023-12-17T11:49:53.238641+0000","last_unstale":"2023-12-17T11:49:54.215271+0000","last_undegraded":"2023-12-17T11:49:54.215271+0000","last_fullsized":"2023-12-17T11:49:54.215271+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T13:29:29.953615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-17T11:49:53.235553+0000","last_change":"2023-12-17T11:49:52.232507+0000","last_active":"2023-12-17T11:49:53.235553+0000","last_peered":"2023-12-17T11:49:53.235553+0000","last_clean":"2023-12-17T11:49:53.235553+0000","last_became_active":"2023-12-17T11:49:52.232308+0000","last_became_peered":"2023-12-17T11:49:52.232308+0000","last_unstale":"2023-12-17T11:49:53.235553+0000","last_undegraded":"2023-12-17T11:49:53.235553+0000","last_fullsized":"2023-12-17T11:49:53.235553+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_clean_scrub_stamp":"2023-12-17T11:49:51.168108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T19:17:46.282779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:55.301864+0000","last_change":"2023-12-17T11:49:53.234701+0000","last_active":"2023-12-17T11:49:55.301864+0000","last_peered":"2023-12-17T11:49:55.301864+0000","last_clean":"2023-12-17T11:49:55.301864+0000","last_became_active":"2023-12-17T11:49:53.234389+0000","last_became_peered":"2023-12-17T11:49:53.234389+0000","last_unstale":"2023-12-17T11:49:55.301864+0000","last_undegraded":"2023-12-17T11:49:55.301864+0000","last_fullsized":"2023-12-17T11:49:55.301864+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T17:54:34.803705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-17T11:49:53.225579+0000","last_change":"2023-12-17T11:49:52.226465+0000","last_active":"2023-12-17T11:49:53.225579+0000","last_peered":"2023-12-17T11:49:53.225579+0000","last_clean":"2023-12-17T11:49:53.225579+0000","last_became_active":"2023-12-17T11:49:52.226191+0000","last_became_peered":"2023-12-17T11:49:52.226191+0000","last_unstale":"2023-12-17T11:49:53.225579+0000","last_undegraded":"2023-12-17T11:49:53.225579+0000","last_fullsized":"2023-12-17T11:49:53.225579+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_clean_scrub_stamp":"2023-12-17T11:49:51.168108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T18:03:39.554935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:54.215842+0000","last_change":"2023-12-17T11:49:53.254934+0000","last_active":"2023-12-17T11:49:54.215842+0000","last_peered":"2023-12-17T11:49:54.215842+0000","last_clean":"2023-12-17T11:49:54.215842+0000","last_became_active":"2023-12-17T11:49:53.254632+0000","last_became_peered":"2023-12-17T11:49:53.254632+0000","last_unstale":"2023-12-17T11:49:54.215842+0000","last_undegraded":"2023-12-17T11:49:54.215842+0000","last_fullsized":"2023-12-17T11:49:54.215842+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T23:33:06.562683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"39'8","reported_seq":20,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:55.301546+0000","last_change":"2023-12-17T11:49:52.226787+0000","last_active":"2023-12-17T11:49:55.301546+0000","last_peered":"2023-12-17T11:49:55.301546+0000","last_clean":"2023-12-17T11:49:55.301546+0000","last_became_active":"2023-12-17T11:49:52.226471+0000","last_became_peered":"2023-12-17T11:49:52.226471+0000","last_unstale":"2023-12-17T11:49:55.301546+0000","last_undegraded":"2023-12-17T11:49:55.301546+0000","last_fullsized":"2023-12-17T11:49:55.301546+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_clean_scrub_stamp":"2023-12-17T11:49:51.168108+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T17:27:58.587187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:54.216316+0000","last_change":"2023-12-17T11:49:53.253979+0000","last_active":"2023-12-17T11:49:54.216316+0000","last_peered":"2023-12-17T11:49:54.216316+0000","last_clean":"2023-12-17T11:49:54.216316+0000","last_became_active":"2023-12-17T11:49:53.253694+0000","last_became_peered":"2023-12-17T11:49:53.253694+0000","last_unstale":"2023-12-17T11:49:54.216316+0000","last_undegraded":"2023-12-17T11:49:54.216316+0000","last_fullsized":"2023-12-17T11:49:54.216316+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T19:26:47.162716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"39'1","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-17T11:49:53.262591+0000","last_change":"2023-12-17T11:49:52.231973+0000","last_active":"2023-12-17T11:49:53.262591+0000","last_peered":"2023-12-17T11:49:53.262591+0000","last_clean":"2023-12-17T11:49:53.262591+0000","last_became_active":"2023-12-17T11:49:52.231641+0000","last_became_peered":"2023-12-17T11:49:52.231641+0000","last_unstale":"2023-12-17T11:49:53.262591+0000","last_undegraded":"2023-12-17T11:49:53.262591+0000","last_fullsized":"2023-12-17T11:49:53.262591+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_clean_scrub_stamp":"2023-12-17T11:49:51.168108+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T20:34:24.431589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:55.304764+0000","last_change":"2023-12-17T11:49:53.253141+0000","last_active":"2023-12-17T11:49:55.304764+0000","last_peered":"2023-12-17T11:49:55.304764+0000","last_clean":"2023-12-17T11:49:55.304764+0000","last_became_active":"2023-12-17T11:49:53.252532+0000","last_became_peered":"2023-12-17T11:49:53.252532+0000","last_unstale":"2023-12-17T11:49:55.304764+0000","last_undegraded":"2023-12-17T11:49:55.304764+0000","last_fullsized":"2023-12-17T11:49:55.304764+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T22:42:15.785143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"39'2","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-17T11:49:53.263293+0000","last_change":"2023-12-17T11:49:52.230858+0000","last_active":"2023-12-17T11:49:53.263293+0000","last_peered":"2023-12-17T11:49:53.263293+0000","last_clean":"2023-12-17T11:49:53.263293+0000","last_became_active":"2023-12-17T11:49:52.230281+0000","last_became_peered":"2023-12-17T11:49:52.230281+0000","last_unstale":"2023-12-17T11:49:53.263293+0000","last_undegraded":"2023-12-17T11:49:53.263293+0000","last_fullsized":"2023-12-17T11:49:53.263293+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_clean_scrub_stamp":"2023-12-17T11:49:51.168108+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T22:39:30.094160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:54.220095+0000","last_change":"2023-12-17T11:49:53.251192+0000","last_active":"2023-12-17T11:49:54.220095+0000","last_peered":"2023-12-17T11:49:54.220095+0000","last_clean":"2023-12-17T11:49:54.220095+0000","last_became_active":"2023-12-17T11:49:53.250837+0000","last_became_peered":"2023-12-17T11:49:53.250837+0000","last_unstale":"2023-12-17T11:49:54.220095+0000","last_undegraded":"2023-12-17T11:49:54.220095+0000","last_fullsized":"2023-12-17T11:49:54.220095+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T14:42:29.543380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"39'1","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-17T11:49:53.251855+0000","last_change":"2023-12-17T11:49:52.222238+0000","last_active":"2023-12-17T11:49:53.251855+0000","last_peered":"2023-12-17T11:49:53.251855+0000","last_clean":"2023-12-17T11:49:53.251855+0000","last_became_active":"2023-12-17T11:49:52.221941+0000","last_became_peered":"2023-12-17T11:49:52.221941+0000","last_unstale":"2023-12-17T11:49:53.251855+0000","last_undegraded":"2023-12-17T11:49:53.251855+0000","last_fullsized":"2023-12-17T11:49:53.251855+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_clean_scrub_stamp":"2023-12-17T11:49:51.168108+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T12:43:47.651883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:55.301176+0000","last_change":"2023-12-17T11:49:53.253162+0000","last_active":"2023-12-17T11:49:55.301176+0000","last_peered":"2023-12-17T11:49:55.301176+0000","last_clean":"2023-12-17T11:49:55.301176+0000","last_became_active":"2023-12-17T11:49:53.252770+0000","last_became_peered":"2023-12-17T11:49:53.252770+0000","last_unstale":"2023-12-17T11:49:55.301176+0000","last_undegraded":"2023-12-17T11:49:55.301176+0000","last_fullsized":"2023-12-17T11:49:55.301176+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T14:03:09.358474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-17T11:49:53.237157+0000","last_change":"2023-12-17T11:49:52.223776+0000","last_active":"2023-12-17T11:49:53.237157+0000","last_peered":"2023-12-17T11:49:53.237157+0000","last_clean":"2023-12-17T11:49:53.237157+0000","last_became_active":"2023-12-17T11:49:52.223571+0000","last_became_peered":"2023-12-17T11:49:52.223571+0000","last_unstale":"2023-12-17T11:49:53.237157+0000","last_undegraded":"2023-12-17T11:49:53.237157+0000","last_fullsized":"2023-12-17T11:49:53.237157+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_clean_scrub_stamp":"2023-12-17T11:49:51.168108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T22:59:00.390569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:55.301868+0000","last_change":"2023-12-17T11:49:53.232411+0000","last_active":"2023-12-17T11:49:55.301868+0000","last_peered":"2023-12-17T11:49:55.301868+0000","last_clean":"2023-12-17T11:49:55.301868+0000","last_became_active":"2023-12-17T11:49:53.232101+0000","last_became_peered":"2023-12-17T11:49:53.232101+0000","last_unstale":"2023-12-17T11:49:55.301868+0000","last_undegraded":"2023-12-17T11:49:55.301868+0000","last_fullsized":"2023-12-17T11:49:55.301868+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T11:57:59.882385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"39'2","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-17T11:49:53.249936+0000","last_change":"2023-12-17T11:49:52.210836+0000","last_active":"2023-12-17T11:49:53.249936+0000","last_peered":"2023-12-17T11:49:53.249936+0000","last_clean":"2023-12-17T11:49:53.249936+0000","last_became_active":"2023-12-17T11:49:52.210521+0000","last_became_peered":"2023-12-17T11:49:52.210521+0000","last_unstale":"2023-12-17T11:49:53.249936+0000","last_undegraded":"2023-12-17T11:49:53.249936+0000","last_fullsized":"2023-12-17T11:49:53.249936+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_clean_scrub_stamp":"2023-12-17T11:49:51.168108+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T17:20:36.726376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:55.301913+0000","last_change":"2023-12-17T11:49:53.243230+0000","last_active":"2023-12-17T11:49:55.301913+0000","last_peered":"2023-12-17T11:49:55.301913+0000","last_clean":"2023-12-17T11:49:55.301913+0000","last_became_active":"2023-12-17T11:49:53.242951+0000","last_became_peered":"2023-12-17T11:49:53.242951+0000","last_unstale":"2023-12-17T11:49:55.301913+0000","last_undegraded":"2023-12-17T11:49:55.301913+0000","last_fullsized":"2023-12-17T11:49:55.301913+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T18:42:00.093282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-17T11:49:53.213946+0000","last_change":"2023-12-17T11:49:52.217136+0000","last_active":"2023-12-17T11:49:53.213946+0000","last_peered":"2023-12-17T11:49:53.213946+0000","last_clean":"2023-12-17T11:49:53.213946+0000","last_became_active":"2023-12-17T11:49:52.216921+0000","last_became_peered":"2023-12-17T11:49:52.216921+0000","last_unstale":"2023-12-17T11:49:53.213946+0000","last_undegraded":"2023-12-17T11:49:53.213946+0000","last_fullsized":"2023-12-17T11:49:53.213946+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_clean_scrub_stamp":"2023-12-17T11:49:51.168108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T19:32:12.805680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:55.303952+0000","last_change":"2023-12-17T11:49:53.255643+0000","last_active":"2023-12-17T11:49:55.303952+0000","last_peered":"2023-12-17T11:49:55.303952+0000","last_clean":"2023-12-17T11:49:55.303952+0000","last_became_active":"2023-12-17T11:49:53.255379+0000","last_became_peered":"2023-12-17T11:49:53.255379+0000","last_unstale":"2023-12-17T11:49:55.303952+0000","last_undegraded":"2023-12-17T11:49:55.303952+0000","last_fullsized":"2023-12-17T11:49:55.303952+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T16:21:14.355302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:55.301924+0000","last_change":"2023-12-17T11:49:52.229883+0000","last_active":"2023-12-17T11:49:55.301924+0000","last_peered":"2023-12-17T11:49:55.301924+0000","last_clean":"2023-12-17T11:49:55.301924+0000","last_became_active":"2023-12-17T11:49:52.229372+0000","last_became_peered":"2023-12-17T11:49:52.229372+0000","last_unstale":"2023-12-17T11:49:55.301924+0000","last_undegraded":"2023-12-17T11:49:55.301924+0000","last_fullsized":"2023-12-17T11:49:55.301924+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_clean_scrub_stamp":"2023-12-17T11:49:51.168108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T23:27:59.830582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:54.216247+0000","last_change":"2023-12-17T11:49:53.249227+0000","last_active":"2023-12-17T11:49:54.216247+0000","last_peered":"2023-12-17T11:49:54.216247+0000","last_clean":"2023-12-17T11:49:54.216247+0000","last_became_active":"2023-12-17T11:49:53.248594+0000","last_became_peered":"2023-12-17T11:49:53.248594+0000","last_unstale":"2023-12-17T11:49:54.216247+0000","last_undegraded":"2023-12-17T11:49:54.216247+0000","last_fullsized":"2023-12-17T11:49:54.216247+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T14:31:17.752657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-17T11:49:53.214329+0000","last_change":"2023-12-17T11:49:52.211707+0000","last_active":"2023-12-17T11:49:53.214329+0000","last_peered":"2023-12-17T11:49:53.214329+0000","last_clean":"2023-12-17T11:49:53.214329+0000","last_became_active":"2023-12-17T11:49:52.211283+0000","last_became_peered":"2023-12-17T11:49:52.211283+0000","last_unstale":"2023-12-17T11:49:53.214329+0000","last_undegraded":"2023-12-17T11:49:53.214329+0000","last_fullsized":"2023-12-17T11:49:53.214329+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_clean_scrub_stamp":"2023-12-17T11:49:51.168108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T12:54:05.203029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:54.557245+0000","last_change":"2023-12-17T11:49:53.255235+0000","last_active":"2023-12-17T11:49:54.557245+0000","last_peered":"2023-12-17T11:49:54.557245+0000","last_clean":"2023-12-17T11:49:54.557245+0000","last_became_active":"2023-12-17T11:49:53.254570+0000","last_became_peered":"2023-12-17T11:49:53.254570+0000","last_unstale":"2023-12-17T11:49:54.557245+0000","last_undegraded":"2023-12-17T11:49:54.557245+0000","last_fullsized":"2023-12-17T11:49:54.557245+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T15:14:36.959400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"39'2","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-17T11:49:53.264259+0000","last_change":"2023-12-17T11:49:52.229686+0000","last_active":"2023-12-17T11:49:53.264259+0000","last_peered":"2023-12-17T11:49:53.264259+0000","last_clean":"2023-12-17T11:49:53.264259+0000","last_became_active":"2023-12-17T11:49:52.229401+0000","last_became_peered":"2023-12-17T11:49:52.229401+0000","last_unstale":"2023-12-17T11:49:53.264259+0000","last_undegraded":"2023-12-17T11:49:53.264259+0000","last_fullsized":"2023-12-17T11:49:53.264259+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_clean_scrub_stamp":"2023-12-17T11:49:51.168108+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T17:03:59.637357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:55.302996+0000","last_change":"2023-12-17T11:49:53.236908+0000","last_active":"2023-12-17T11:49:55.302996+0000","last_peered":"2023-12-17T11:49:55.302996+0000","last_clean":"2023-12-17T11:49:55.302996+0000","last_became_active":"2023-12-17T11:49:53.236508+0000","last_became_peered":"2023-12-17T11:49:53.236508+0000","last_unstale":"2023-12-17T11:49:55.302996+0000","last_undegraded":"2023-12-17T11:49:55.302996+0000","last_fullsized":"2023-12-17T11:49:55.302996+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T13:59:52.939825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-17T11:49:53.214338+0000","last_change":"2023-12-17T11:49:52.229067+0000","last_active":"2023-12-17T11:49:53.214338+0000","last_peered":"2023-12-17T11:49:53.214338+0000","last_clean":"2023-12-17T11:49:53.214338+0000","last_became_active":"2023-12-17T11:49:52.228704+0000","last_became_peered":"2023-12-17T11:49:52.228704+0000","last_unstale":"2023-12-17T11:49:53.214338+0000","last_undegraded":"2023-12-17T11:49:53.214338+0000","last_fullsized":"2023-12-17T11:49:53.214338+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_clean_scrub_stamp":"2023-12-17T11:49:51.168108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T16:31:06.129915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:54.215950+0000","last_change":"2023-12-17T11:49:53.246415+0000","last_active":"2023-12-17T11:49:54.215950+0000","last_peered":"2023-12-17T11:49:54.215950+0000","last_clean":"2023-12-17T11:49:54.215950+0000","last_became_active":"2023-12-17T11:49:53.246163+0000","last_became_peered":"2023-12-17T11:49:53.246163+0000","last_unstale":"2023-12-17T11:49:54.215950+0000","last_undegraded":"2023-12-17T11:49:54.215950+0000","last_fullsized":"2023-12-17T11:49:54.215950+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T17:56:09.285369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-17T11:49:53.231773+0000","last_change":"2023-12-17T11:49:52.219865+0000","last_active":"2023-12-17T11:49:53.231773+0000","last_peered":"2023-12-17T11:49:53.231773+0000","last_clean":"2023-12-17T11:49:53.231773+0000","last_became_active":"2023-12-17T11:49:52.219593+0000","last_became_peered":"2023-12-17T11:49:52.219593+0000","last_unstale":"2023-12-17T11:49:53.231773+0000","last_undegraded":"2023-12-17T11:49:53.231773+0000","last_fullsized":"2023-12-17T11:49:53.231773+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_clean_scrub_stamp":"2023-12-17T11:49:51.168108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T15:14:35.947970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:55.301732+0000","last_change":"2023-12-17T11:49:53.242876+0000","last_active":"2023-12-17T11:49:55.301732+0000","last_peered":"2023-12-17T11:49:55.301732+0000","last_clean":"2023-12-17T11:49:55.301732+0000","last_became_active":"2023-12-17T11:49:53.242568+0000","last_became_peered":"2023-12-17T11:49:53.242568+0000","last_unstale":"2023-12-17T11:49:55.301732+0000","last_undegraded":"2023-12-17T11:49:55.301732+0000","last_fullsized":"2023-12-17T11:49:55.301732+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T23:10:56.100255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-17T11:49:53.222858+0000","last_change":"2023-12-17T11:49:52.223424+0000","last_active":"2023-12-17T11:49:53.222858+0000","last_peered":"2023-12-17T11:49:53.222858+0000","last_clean":"2023-12-17T11:49:53.222858+0000","last_became_active":"2023-12-17T11:49:52.223126+0000","last_became_peered":"2023-12-17T11:49:52.223126+0000","last_unstale":"2023-12-17T11:49:53.222858+0000","last_undegraded":"2023-12-17T11:49:53.222858+0000","last_fullsized":"2023-12-17T11:49:53.222858+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_clean_scrub_stamp":"2023-12-17T11:49:51.168108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T14:31:59.450792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:54.556719+0000","last_change":"2023-12-17T11:49:53.251516+0000","last_active":"2023-12-17T11:49:54.556719+0000","last_peered":"2023-12-17T11:49:54.556719+0000","last_clean":"2023-12-17T11:49:54.556719+0000","last_became_active":"2023-12-17T11:49:53.251230+0000","last_became_peered":"2023-12-17T11:49:53.251230+0000","last_unstale":"2023-12-17T11:49:54.556719+0000","last_undegraded":"2023-12-17T11:49:54.556719+0000","last_fullsized":"2023-12-17T11:49:54.556719+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T19:39:18.340154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-17T11:49:53.227940+0000","last_change":"2023-12-17T11:49:52.219807+0000","last_active":"2023-12-17T11:49:53.227940+0000","last_peered":"2023-12-17T11:49:53.227940+0000","last_clean":"2023-12-17T11:49:53.227940+0000","last_became_active":"2023-12-17T11:49:52.219503+0000","last_became_peered":"2023-12-17T11:49:52.219503+0000","last_unstale":"2023-12-17T11:49:53.227940+0000","last_undegraded":"2023-12-17T11:49:53.227940+0000","last_fullsized":"2023-12-17T11:49:53.227940+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_clean_scrub_stamp":"2023-12-17T11:49:51.168108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T18:07:09.094032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:54.219300+0000","last_change":"2023-12-17T11:49:53.241750+0000","last_active":"2023-12-17T11:49:54.219300+0000","last_peered":"2023-12-17T11:49:54.219300+0000","last_clean":"2023-12-17T11:49:54.219300+0000","last_became_active":"2023-12-17T11:49:53.241529+0000","last_became_peered":"2023-12-17T11:49:53.241529+0000","last_unstale":"2023-12-17T11:49:54.219300+0000","last_undegraded":"2023-12-17T11:49:54.219300+0000","last_fullsized":"2023-12-17T11:49:54.219300+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T16:31:53.964205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-17T11:49:53.226908+0000","last_change":"2023-12-17T11:49:52.216579+0000","last_active":"2023-12-17T11:49:53.226908+0000","last_peered":"2023-12-17T11:49:53.226908+0000","last_clean":"2023-12-17T11:49:53.226908+0000","last_became_active":"2023-12-17T11:49:52.216265+0000","last_became_peered":"2023-12-17T11:49:52.216265+0000","last_unstale":"2023-12-17T11:49:53.226908+0000","last_undegraded":"2023-12-17T11:49:53.226908+0000","last_fullsized":"2023-12-17T11:49:53.226908+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_clean_scrub_stamp":"2023-12-17T11:49:51.168108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T14:31:59.450792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:55.302580+0000","last_change":"2023-12-17T11:49:53.234303+0000","last_active":"2023-12-17T11:49:55.302580+0000","last_peered":"2023-12-17T11:49:55.302580+0000","last_clean":"2023-12-17T11:49:55.302580+0000","last_became_active":"2023-12-17T11:49:53.233951+0000","last_became_peered":"2023-12-17T11:49:53.233951+0000","last_unstale":"2023-12-17T11:49:55.302580+0000","last_undegraded":"2023-12-17T11:49:55.302580+0000","last_fullsized":"2023-12-17T11:49:55.302580+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T19:17:38.569694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-17T11:49:53.240610+0000","last_change":"2023-12-17T11:49:52.219957+0000","last_active":"2023-12-17T11:49:53.240610+0000","last_peered":"2023-12-17T11:49:53.240610+0000","last_clean":"2023-12-17T11:49:53.240610+0000","last_became_active":"2023-12-17T11:49:52.219626+0000","last_became_peered":"2023-12-17T11:49:52.219626+0000","last_unstale":"2023-12-17T11:49:53.240610+0000","last_undegraded":"2023-12-17T11:49:53.240610+0000","last_fullsized":"2023-12-17T11:49:53.240610+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_clean_scrub_stamp":"2023-12-17T11:49:51.168108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T19:12:11.016281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:55.305069+0000","last_change":"2023-12-17T11:49:53.253151+0000","last_active":"2023-12-17T11:49:55.305069+0000","last_peered":"2023-12-17T11:49:55.305069+0000","last_clean":"2023-12-17T11:49:55.305069+0000","last_became_active":"2023-12-17T11:49:53.252842+0000","last_became_peered":"2023-12-17T11:49:53.252842+0000","last_unstale":"2023-12-17T11:49:55.305069+0000","last_undegraded":"2023-12-17T11:49:55.305069+0000","last_fullsized":"2023-12-17T11:49:55.305069+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T14:31:17.752657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:55.302520+0000","last_change":"2023-12-17T11:49:52.228110+0000","last_active":"2023-12-17T11:49:55.302520+0000","last_peered":"2023-12-17T11:49:55.302520+0000","last_clean":"2023-12-17T11:49:55.302520+0000","last_became_active":"2023-12-17T11:49:52.227851+0000","last_became_peered":"2023-12-17T11:49:52.227851+0000","last_unstale":"2023-12-17T11:49:55.302520+0000","last_undegraded":"2023-12-17T11:49:55.302520+0000","last_fullsized":"2023-12-17T11:49:55.302520+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_clean_scrub_stamp":"2023-12-17T11:49:51.168108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T18:37:20.380970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":180,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-17T11:49:53.217829+0000","last_change":"2023-12-17T11:48:07.952584+0000","last_active":"2023-12-17T11:49:53.217829+0000","last_peered":"2023-12-17T11:49:53.217829+0000","last_clean":"2023-12-17T11:49:53.217829+0000","last_became_active":"2023-12-17T11:48:07.950361+0000","last_became_peered":"2023-12-17T11:48:07.950361+0000","last_unstale":"2023-12-17T11:49:53.217829+0000","last_undegraded":"2023-12-17T11:49:53.217829+0000","last_fullsized":"2023-12-17T11:49:53.217829+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:06.728199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:06.728199+0000","last_clean_scrub_stamp":"2023-12-17T11:48:06.728199+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T12:47:55.048065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542170,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28064,"kb_used_data":1044,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343776,"statfs":{"total":96636764160,"available":96608026624,"internally_reserved":0,"allocated":1069056,"data_stored":789626,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 17 11:49:06 2023","interfaces":[{"interface":"back","average":{"1min":1.407,"5min":1.407,"15min":1.407},"min":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":8.6579999999999995,"5min":8.6579999999999995,"15min":8.6579999999999995},"last":1.159},{"interface":"front","average":{"1min":1.339,"5min":1.339,"15min":1.339},"min":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"max":{"1min":4.0830000000000002,"5min":4.0830000000000002,"15min":4.0830000000000002},"last":1.3580000000000001}]},{"osd":1,"last update":"Sun Dec 17 11:49:06 2023","interfaces":[{"interface":"back","average":{"1min":1.127,"5min":1.127,"15min":1.127},"min":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"max":{"1min":2.1539999999999999,"5min":2.1539999999999999,"15min":2.1539999999999999},"last":1.409},{"interface":"front","average":{"1min":1.413,"5min":1.413,"15min":1.413},"min":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"max":{"1min":8.7449999999999992,"5min":8.7449999999999992,"15min":8.7449999999999992},"last":0.82999999999999996}]},{"osd":2,"last update":"Sun Dec 17 11:49:06 2023","interfaces":[{"interface":"back","average":{"1min":1.4299999999999999,"5min":1.4299999999999999,"15min":1.4299999999999999},"min":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"max":{"1min":4.1239999999999997,"5min":4.1239999999999997,"15min":4.1239999999999997},"last":1.548},{"interface":"front","average":{"1min":1.3720000000000001,"5min":1.3720000000000001,"15min":1.3720000000000001},"min":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"max":{"1min":1.782,"5min":1.782,"15min":1.782},"last":1.7150000000000001}]},{"osd":3,"last update":"Sun Dec 17 11:49:06 2023","interfaces":[{"interface":"back","average":{"1min":1.298,"5min":1.298,"15min":1.298},"min":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"max":{"1min":2.5430000000000001,"5min":2.5430000000000001,"15min":2.5430000000000001},"last":1.218},{"interface":"front","average":{"1min":1.375,"5min":1.375,"15min":1.375},"min":{"1min":1.087,"5min":1.087,"15min":1.087},"max":{"1min":2.5830000000000002,"5min":2.5830000000000002,"15min":2.5830000000000002},"last":1.595}]},{"osd":4,"last update":"Sun Dec 17 11:49:06 2023","interfaces":[{"interface":"back","average":{"1min":1.3859999999999999,"5min":1.3859999999999999,"15min":1.3859999999999999},"min":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":4.0309999999999997,"5min":4.0309999999999997,"15min":4.0309999999999997},"last":1.115},{"interface":"front","average":{"1min":1.5860000000000001,"5min":1.5860000000000001,"15min":1.5860000000000001},"min":{"1min":1.2230000000000001,"5min":1.2230000000000001,"15min":1.2230000000000001},"max":{"1min":3.3220000000000001,"5min":3.3220000000000001,"15min":3.3220000000000001},"last":1.659}]},{"osd":5,"last update":"Sun Dec 17 11:49:06 2023","interfaces":[{"interface":"back","average":{"1min":1.6970000000000001,"5min":1.6970000000000001,"15min":1.6970000000000001},"min":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"max":{"1min":8.7929999999999993,"5min":8.7929999999999993,"15min":8.7929999999999993},"last":1.3109999999999999},{"interface":"front","average":{"1min":1.6859999999999999,"5min":1.6859999999999999,"15min":1.6859999999999999},"min":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"max":{"1min":5.1040000000000001,"5min":5.1040000000000001,"15min":5.1040000000000001},"last":1.6200000000000001}]},{"osd":6,"last update":"Sun Dec 17 11:49:06 2023","interfaces":[{"interface":"back","average":{"1min":1.845,"5min":1.845,"15min":1.845},"min":{"1min":1.081,"5min":1.081,"15min":1.081},"max":{"1min":8.8330000000000002,"5min":8.8330000000000002,"15min":8.8330000000000002},"last":1.498},{"interface":"front","average":{"1min":1.71,"5min":1.71,"15min":1.71},"min":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"max":{"1min":3.9590000000000001,"5min":3.9590000000000001,"15min":3.9590000000000001},"last":1.4630000000000001}]}]},{"osd":6,"up_from":14,"seq":60129542170,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27480,"kb_used_data":452,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344360,"statfs":{"total":96636764160,"available":96608624640,"internally_reserved":0,"allocated":462848,"data_stored":198158,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 17 11:49:06 2023","interfaces":[{"interface":"back","average":{"1min":1.0720000000000001,"5min":1.0720000000000001,"15min":1.0720000000000001},"min":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.5840000000000001,"5min":1.5840000000000001,"15min":1.5840000000000001},"last":1.2370000000000001},{"interface":"front","average":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"min":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"max":{"1min":1.429,"5min":1.429,"15min":1.429},"last":1.1000000000000001}]},{"osd":1,"last update":"Sun Dec 17 11:49:06 2023","interfaces":[{"interface":"back","average":{"1min":1.2689999999999999,"5min":1.2689999999999999,"15min":1.2689999999999999},"min":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"max":{"1min":1.5640000000000001,"5min":1.5640000000000001,"15min":1.5640000000000001},"last":1.2},{"interface":"front","average":{"1min":1.3169999999999999,"5min":1.3169999999999999,"15min":1.3169999999999999},"min":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"max":{"1min":1.9359999999999999,"5min":1.9359999999999999,"15min":1.9359999999999999},"last":1.0249999999999999}]},{"osd":2,"last update":"Sun Dec 17 11:49:06 2023","interfaces":[{"interface":"back","average":{"1min":1.1970000000000001,"5min":1.1970000000000001,"15min":1.1970000000000001},"min":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":1.8740000000000001,"5min":1.8740000000000001,"15min":1.8740000000000001},"last":0.96899999999999997},{"interface":"front","average":{"1min":1.296,"5min":1.296,"15min":1.296},"min":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":2.5470000000000002,"5min":2.5470000000000002,"15min":2.5470000000000002},"last":0.82499999999999996}]},{"osd":3,"last update":"Sun Dec 17 11:49:06 2023","interfaces":[{"interface":"back","average":{"1min":1.508,"5min":1.508,"15min":1.508},"min":{"1min":1.0840000000000001,"5min":1.0840000000000001,"15min":1.0840000000000001},"max":{"1min":2.4689999999999999,"5min":2.4689999999999999,"15min":2.4689999999999999},"last":1.2949999999999999},{"interface":"front","average":{"1min":1.4390000000000001,"5min":1.4390000000000001,"15min":1.4390000000000001},"min":{"1min":0.88,"5min":0.88,"15min":0.88},"max":{"1min":2.0680000000000001,"5min":2.0680000000000001,"15min":2.0680000000000001},"last":1.427}]},{"osd":4,"last update":"Sun Dec 17 11:49:06 2023","interfaces":[{"interface":"back","average":{"1min":1.522,"5min":1.522,"15min":1.522},"min":{"1min":1.1419999999999999,"5min":1.1419999999999999,"15min":1.1419999999999999},"max":{"1min":2.222,"5min":2.222,"15min":2.222},"last":1.645},{"interface":"front","average":{"1min":1.4419999999999999,"5min":1.4419999999999999,"15min":1.4419999999999999},"min":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":0.90700000000000003},"max":{"1min":2.4079999999999999,"5min":2.4079999999999999,"15min":2.4079999999999999},"last":1.486}]},{"osd":5,"last update":"Sun Dec 17 11:49:06 2023","interfaces":[{"interface":"back","average":{"1min":1.548,"5min":1.548,"15min":1.548},"min":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"max":{"1min":2.3319999999999999,"5min":2.3319999999999999,"15min":2.3319999999999999},"last":1.72},{"interface":"front","average":{"1min":1.5760000000000001,"5min":1.5760000000000001,"15min":1.5760000000000001},"min":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"max":{"1min":2.6760000000000002,"5min":2.6760000000000002,"15min":2.6760000000000002},"last":1.532}]},{"osd":7,"last update":"Sun Dec 17 11:49:06 2023","interfaces":[{"interface":"back","average":{"1min":1.419,"5min":1.419,"15min":1.419},"min":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"max":{"1min":2.1560000000000001,"5min":2.1560000000000001,"15min":2.1560000000000001},"last":1.343},{"interface":"front","average":{"1min":1.712,"5min":1.712,"15min":1.712},"min":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"max":{"1min":2.6059999999999999,"5min":2.6059999999999999,"15min":2.6059999999999999},"last":1.8700000000000001}]}]},{"osd":5,"up_from":14,"seq":60129542169,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27476,"kb_used_data":456,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344364,"statfs":{"total":96636764160,"available":96608628736,"internally_reserved":0,"allocated":466944,"data_stored":197688,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 17 11:49:09 2023","interfaces":[{"interface":"back","average":{"1min":1.101,"5min":1.101,"15min":1.101},"min":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":1.5860000000000001,"5min":1.5860000000000001,"15min":1.5860000000000001},"last":0.69999999999999996},{"interface":"front","average":{"1min":1.23,"5min":1.23,"15min":1.23},"min":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"max":{"1min":1.9419999999999999,"5min":1.9419999999999999,"15min":1.9419999999999999},"last":0.63500000000000001}]},{"osd":1,"last update":"Sun Dec 17 11:49:09 2023","interfaces":[{"interface":"back","average":{"1min":1.167,"5min":1.167,"15min":1.167},"min":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"max":{"1min":1.5289999999999999,"5min":1.5289999999999999,"15min":1.5289999999999999},"last":0.78300000000000003},{"interface":"front","average":{"1min":1.216,"5min":1.216,"15min":1.216},"min":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"max":{"1min":1.8660000000000001,"5min":1.8660000000000001,"15min":1.8660000000000001},"last":0.97399999999999998}]},{"osd":2,"last update":"Sun Dec 17 11:49:09 2023","interfaces":[{"interface":"back","average":{"1min":1.3140000000000001,"5min":1.3140000000000001,"15min":1.3140000000000001},"min":{"1min":0.747,"5min":0.747,"15min":0.747},"max":{"1min":2.1589999999999998,"5min":2.1589999999999998,"15min":2.1589999999999998},"last":0.751},{"interface":"front","average":{"1min":1.3919999999999999,"5min":1.3919999999999999,"15min":1.3919999999999999},"min":{"1min":1.0049999999999999,"5min":1.0049999999999999,"15min":1.0049999999999999},"max":{"1min":2.1379999999999999,"5min":2.1379999999999999,"15min":2.1379999999999999},"last":0.879}]},{"osd":3,"last update":"Sun Dec 17 11:49:09 2023","interfaces":[{"interface":"back","average":{"1min":1.337,"5min":1.337,"15min":1.337},"min":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"max":{"1min":2.593,"5min":2.593,"15min":2.593},"last":1.0600000000000001},{"interface":"front","average":{"1min":1.407,"5min":1.407,"15min":1.407},"min":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"max":{"1min":2.3079999999999998,"5min":2.3079999999999998,"15min":2.3079999999999998},"last":1.175}]},{"osd":4,"last update":"Sun Dec 17 11:49:09 2023","interfaces":[{"interface":"back","average":{"1min":1.5029999999999999,"5min":1.5029999999999999,"15min":1.5029999999999999},"min":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"max":{"1min":2.5299999999999998,"5min":2.5299999999999998,"15min":2.5299999999999998},"last":1.1100000000000001},{"interface":"front","average":{"1min":1.6879999999999999,"5min":1.6879999999999999,"15min":1.6879999999999999},"min":{"1min":1.0669999999999999,"5min":1.0669999999999999,"15min":1.0669999999999999},"max":{"1min":3.9569999999999999,"5min":3.9569999999999999,"15min":3.9569999999999999},"last":1.2849999999999999}]},{"osd":6,"last update":"Sun Dec 17 11:49:09 2023","interfaces":[{"interface":"back","average":{"1min":1.6619999999999999,"5min":1.6619999999999999,"15min":1.6619999999999999},"min":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"max":{"1min":2.9849999999999999,"5min":2.9849999999999999,"15min":2.9849999999999999},"last":1.6120000000000001},{"interface":"front","average":{"1min":1.6319999999999999,"5min":1.6319999999999999,"15min":1.6319999999999999},"min":{"1min":1.25,"5min":1.25,"15min":1.25},"max":{"1min":2.641,"5min":2.641,"15min":2.641},"last":1.4510000000000001}]},{"osd":7,"last update":"Sun Dec 17 11:49:09 2023","interfaces":[{"interface":"back","average":{"1min":1.8080000000000001,"5min":1.8080000000000001,"15min":1.8080000000000001},"min":{"1min":1.232,"5min":1.232,"15min":1.232},"max":{"1min":3.8570000000000002,"5min":3.8570000000000002,"15min":3.8570000000000002},"last":1.51},{"interface":"front","average":{"1min":1.827,"5min":1.827,"15min":1.827},"min":{"1min":1.137,"5min":1.137,"15min":1.137},"max":{"1min":2.8999999999999999,"5min":2.8999999999999999,"15min":2.8999999999999999},"last":1.5489999999999999}]}]},{"osd":4,"up_from":14,"seq":60129542170,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27484,"kb_used_data":456,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344356,"statfs":{"total":96636764160,"available":96608620544,"internally_reserved":0,"allocated":466944,"data_stored":198180,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 17 11:49:08 2023","interfaces":[{"interface":"back","average":{"1min":1.02,"5min":1.02,"15min":1.02},"min":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"max":{"1min":1.1890000000000001,"5min":1.1890000000000001,"15min":1.1890000000000001},"last":1.579},{"interface":"front","average":{"1min":1.167,"5min":1.167,"15min":1.167},"min":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"max":{"1min":2.6400000000000001,"5min":2.6400000000000001,"15min":2.6400000000000001},"last":0.94899999999999995}]},{"osd":1,"last update":"Sun Dec 17 11:49:08 2023","interfaces":[{"interface":"back","average":{"1min":1.0960000000000001,"5min":1.0960000000000001,"15min":1.0960000000000001},"min":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"max":{"1min":1.369,"5min":1.369,"15min":1.369},"last":1.198},{"interface":"front","average":{"1min":1.2669999999999999,"5min":1.2669999999999999,"15min":1.2669999999999999},"min":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"max":{"1min":1.631,"5min":1.631,"15min":1.631},"last":1.444}]},{"osd":2,"last update":"Sun Dec 17 11:49:08 2023","interfaces":[{"interface":"back","average":{"1min":1.393,"5min":1.393,"15min":1.393},"min":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"max":{"1min":1.8660000000000001,"5min":1.8660000000000001,"15min":1.8660000000000001},"last":0.90600000000000003},{"interface":"front","average":{"1min":1.329,"5min":1.329,"15min":1.329},"min":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"max":{"1min":1.968,"5min":1.968,"15min":1.968},"last":0.98499999999999999}]},{"osd":3,"last update":"Sun Dec 17 11:49:08 2023","interfaces":[{"interface":"back","average":{"1min":1.4410000000000001,"5min":1.4410000000000001,"15min":1.4410000000000001},"min":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"max":{"1min":3.2290000000000001,"5min":3.2290000000000001,"15min":3.2290000000000001},"last":1.1220000000000001},{"interface":"front","average":{"1min":1.496,"5min":1.496,"15min":1.496},"min":{"1min":1.1000000000000001,"5min":1.1000000000000001,"15min":1.1000000000000001},"max":{"1min":2.0169999999999999,"5min":2.0169999999999999,"15min":2.0169999999999999},"last":1.3400000000000001}]},{"osd":5,"last update":"Sun Dec 17 11:49:08 2023","interfaces":[{"interface":"back","average":{"1min":1.474,"5min":1.474,"15min":1.474},"min":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"max":{"1min":2.141,"5min":2.141,"15min":2.141},"last":1.825},{"interface":"front","average":{"1min":1.7110000000000001,"5min":1.7110000000000001,"15min":1.7110000000000001},"min":{"1min":1.2390000000000001,"5min":1.2390000000000001,"15min":1.2390000000000001},"max":{"1min":3.8220000000000001,"5min":3.8220000000000001,"15min":3.8220000000000001},"last":1.2190000000000001}]},{"osd":6,"last update":"Sun Dec 17 11:49:08 2023","interfaces":[{"interface":"back","average":{"1min":1.7370000000000001,"5min":1.7370000000000001,"15min":1.7370000000000001},"min":{"1min":1.212,"5min":1.212,"15min":1.212},"max":{"1min":2.7410000000000001,"5min":2.7410000000000001,"15min":2.7410000000000001},"last":1.0680000000000001},{"interface":"front","average":{"1min":1.677,"5min":1.677,"15min":1.677},"min":{"1min":1.222,"5min":1.222,"15min":1.222},"max":{"1min":2.2989999999999999,"5min":2.2989999999999999,"15min":2.2989999999999999},"last":1.6859999999999999}]},{"osd":7,"last update":"Sun Dec 17 11:49:08 2023","interfaces":[{"interface":"back","average":{"1min":1.847,"5min":1.847,"15min":1.847},"min":{"1min":1.2749999999999999,"5min":1.2749999999999999,"15min":1.2749999999999999},"max":{"1min":3.944,"5min":3.944,"15min":3.944},"last":1.304},{"interface":"front","average":{"1min":1.8160000000000001,"5min":1.8160000000000001,"15min":1.8160000000000001},"min":{"1min":1.4239999999999999,"5min":1.4239999999999999,"15min":1.4239999999999999},"max":{"1min":2.8809999999999998,"5min":2.8809999999999998,"15min":2.8809999999999998},"last":1.2529999999999999}]}]},{"osd":3,"up_from":14,"seq":60129542169,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27492,"kb_used_data":464,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344348,"statfs":{"total":96636764160,"available":96608612352,"internally_reserved":0,"allocated":475136,"data_stored":199222,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 17 11:49:06 2023","interfaces":[{"interface":"back","average":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.6459999999999999,"5min":1.6459999999999999,"15min":1.6459999999999999},"last":0.83699999999999997},{"interface":"front","average":{"1min":1.0700000000000001,"5min":1.0700000000000001,"15min":1.0700000000000001},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":3.5800000000000001,"5min":3.5800000000000001,"15min":3.5800000000000001},"last":0.94499999999999995}]},{"osd":1,"last update":"Sun Dec 17 11:49:06 2023","interfaces":[{"interface":"back","average":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":1.4379999999999999,"5min":1.4379999999999999,"15min":1.4379999999999999},"last":1.1419999999999999},{"interface":"front","average":{"1min":1.1519999999999999,"5min":1.1519999999999999,"15min":1.1519999999999999},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":2.085,"5min":2.085,"15min":2.085},"last":0.71599999999999997}]},{"osd":2,"last update":"Sun Dec 17 11:49:06 2023","interfaces":[{"interface":"back","average":{"1min":1.1659999999999999,"5min":1.1659999999999999,"15min":1.1659999999999999},"min":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":1.651,"5min":1.651,"15min":1.651},"last":1.383},{"interface":"front","average":{"1min":1.2569999999999999,"5min":1.2569999999999999,"15min":1.2569999999999999},"min":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":2.1429999999999998,"5min":2.1429999999999998,"15min":2.1429999999999998},"last":1.585}]},{"osd":4,"last update":"Sun Dec 17 11:49:06 2023","interfaces":[{"interface":"back","average":{"1min":1.4330000000000001,"5min":1.4330000000000001,"15min":1.4330000000000001},"min":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"max":{"1min":2.4870000000000001,"5min":2.4870000000000001,"15min":2.4870000000000001},"last":1.4199999999999999},{"interface":"front","average":{"1min":1.476,"5min":1.476,"15min":1.476},"min":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"max":{"1min":2.3460000000000001,"5min":2.3460000000000001,"15min":2.3460000000000001},"last":1.3540000000000001}]},{"osd":5,"last update":"Sun Dec 17 11:49:06 2023","interfaces":[{"interface":"back","average":{"1min":1.476,"5min":1.476,"15min":1.476},"min":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"max":{"1min":2.5710000000000002,"5min":2.5710000000000002,"15min":2.5710000000000002},"last":1.6870000000000001},{"interface":"front","average":{"1min":1.5,"5min":1.5,"15min":1.5},"min":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"max":{"1min":2.383,"5min":2.383,"15min":2.383},"last":1.329}]},{"osd":6,"last update":"Sun Dec 17 11:49:06 2023","interfaces":[{"interface":"back","average":{"1min":1.474,"5min":1.474,"15min":1.474},"min":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"max":{"1min":2.6179999999999999,"5min":2.6179999999999999,"15min":2.6179999999999999},"last":1.2669999999999999},{"interface":"front","average":{"1min":1.5149999999999999,"5min":1.5149999999999999,"15min":1.5149999999999999},"min":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"max":{"1min":2.7679999999999998,"5min":2.7679999999999998,"15min":2.7679999999999998},"last":1.542}]},{"osd":7,"last update":"Sun Dec 17 11:49:06 2023","interfaces":[{"interface":"back","average":{"1min":1.581,"5min":1.581,"15min":1.581},"min":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"max":{"1min":3.7000000000000002,"5min":3.7000000000000002,"15min":3.7000000000000002},"last":1.6379999999999999},{"interface":"front","average":{"1min":1.579,"5min":1.579,"15min":1.579},"min":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":0.97099999999999997},"max":{"1min":2.427,"5min":2.427,"15min":2.427},"last":1.486}]}]},{"osd":2,"up_from":14,"seq":60129542170,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27472,"kb_used_data":452,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344368,"statfs":{"total":96636764160,"available":96608632832,"internally_reserved":0,"allocated":462848,"data_stored":197646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 17 11:49:07 2023","interfaces":[{"interface":"back","average":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":1.724,"5min":1.724,"15min":1.724},"last":1.659},{"interface":"front","average":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.502,"5min":1.502,"15min":1.502},"last":0.90500000000000003}]},{"osd":1,"last update":"Sun Dec 17 11:49:07 2023","interfaces":[{"interface":"back","average":{"1min":0.995,"5min":0.995,"15min":0.995},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.4790000000000001,"5min":1.4790000000000001,"15min":1.4790000000000001},"last":1.232},{"interface":"front","average":{"1min":1.056,"5min":1.056,"15min":1.056},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":2.6280000000000001,"5min":2.6280000000000001,"15min":2.6280000000000001},"last":1.0800000000000001}]},{"osd":3,"last update":"Sun Dec 17 11:49:07 2023","interfaces":[{"interface":"back","average":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.476,"5min":1.476,"15min":1.476},"last":0.96799999999999997},{"interface":"front","average":{"1min":1.214,"5min":1.214,"15min":1.214},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.9670000000000001,"5min":1.9670000000000001,"15min":1.9670000000000001},"last":1.4550000000000001}]},{"osd":4,"last update":"Sun Dec 17 11:49:07 2023","interfaces":[{"interface":"back","average":{"1min":1.49,"5min":1.49,"15min":1.49},"min":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"max":{"1min":2.5750000000000002,"5min":2.5750000000000002,"15min":2.5750000000000002},"last":1.8049999999999999},{"interface":"front","average":{"1min":1.3879999999999999,"5min":1.3879999999999999,"15min":1.3879999999999999},"min":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"max":{"1min":2.4940000000000002,"5min":2.4940000000000002,"15min":2.4940000000000002},"last":1.1519999999999999}]},{"osd":5,"last update":"Sun Dec 17 11:49:07 2023","interfaces":[{"interface":"back","average":{"1min":1.3240000000000001,"5min":1.3240000000000001,"15min":1.3240000000000001},"min":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"max":{"1min":2.4289999999999998,"5min":2.4289999999999998,"15min":2.4289999999999998},"last":1.506},{"interface":"front","average":{"1min":1.5489999999999999,"5min":1.5489999999999999,"15min":1.5489999999999999},"min":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"max":{"1min":2.694,"5min":2.694,"15min":2.694},"last":1.879}]},{"osd":6,"last update":"Sun Dec 17 11:49:07 2023","interfaces":[{"interface":"back","average":{"1min":1.472,"5min":1.472,"15min":1.472},"min":{"1min":0.748,"5min":0.748,"15min":0.748},"max":{"1min":2.7349999999999999,"5min":2.7349999999999999,"15min":2.7349999999999999},"last":1.7010000000000001},{"interface":"front","average":{"1min":1.4119999999999999,"5min":1.4119999999999999,"15min":1.4119999999999999},"min":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"max":{"1min":2.468,"5min":2.468,"15min":2.468},"last":1.302}]},{"osd":7,"last update":"Sun Dec 17 11:49:07 2023","interfaces":[{"interface":"back","average":{"1min":1.554,"5min":1.554,"15min":1.554},"min":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"max":{"1min":3.379,"5min":3.379,"15min":3.379},"last":1.774},{"interface":"front","average":{"1min":1.474,"5min":1.474,"15min":1.474},"min":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"max":{"1min":2.2869999999999999,"5min":2.2869999999999999,"15min":2.2869999999999999},"last":1.742}]}]},{"osd":1,"up_from":14,"seq":60129542169,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27480,"kb_used_data":452,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344360,"statfs":{"total":96636764160,"available":96608624640,"internally_reserved":0,"allocated":462848,"data_stored":197666,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 17 11:49:08 2023","interfaces":[{"interface":"back","average":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.5249999999999999,"5min":1.5249999999999999,"15min":1.5249999999999999},"last":0.71899999999999997},{"interface":"front","average":{"1min":1.113,"5min":1.113,"15min":1.113},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":2.6360000000000001,"5min":2.6360000000000001,"15min":2.6360000000000001},"last":0.81499999999999995}]},{"osd":2,"last update":"Sun Dec 17 11:49:08 2023","interfaces":[{"interface":"back","average":{"1min":1.202,"5min":1.202,"15min":1.202},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":2.8159999999999998,"5min":2.8159999999999998,"15min":2.8159999999999998},"last":0.63300000000000001},{"interface":"front","average":{"1min":1.462,"5min":1.462,"15min":1.462},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":3.101,"5min":3.101,"15min":3.101},"last":1.083}]},{"osd":3,"last update":"Sun Dec 17 11:49:08 2023","interfaces":[{"interface":"back","average":{"1min":1.48,"5min":1.48,"15min":1.48},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":2.7890000000000001,"5min":2.7890000000000001,"15min":2.7890000000000001},"last":1.3620000000000001},{"interface":"front","average":{"1min":1.278,"5min":1.278,"15min":1.278},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":3.1400000000000001,"5min":3.1400000000000001,"15min":3.1400000000000001},"last":1.228}]},{"osd":4,"last update":"Sun Dec 17 11:49:08 2023","interfaces":[{"interface":"back","average":{"1min":1.4350000000000001,"5min":1.4350000000000001,"15min":1.4350000000000001},"min":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":2.5289999999999999,"5min":2.5289999999999999,"15min":2.5289999999999999},"last":1.718},{"interface":"front","average":{"1min":1.363,"5min":1.363,"15min":1.363},"min":{"1min":0.627,"5min":0.627,"15min":0.627},"max":{"1min":2.0819999999999999,"5min":2.0819999999999999,"15min":2.0819999999999999},"last":1.508}]},{"osd":5,"last update":"Sun Dec 17 11:49:08 2023","interfaces":[{"interface":"back","average":{"1min":1.466,"5min":1.466,"15min":1.466},"min":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"max":{"1min":1.96,"5min":1.96,"15min":1.96},"last":1.419},{"interface":"front","average":{"1min":1.573,"5min":1.573,"15min":1.573},"min":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":2.6739999999999999,"5min":2.6739999999999999,"15min":2.6739999999999999},"last":1.758}]},{"osd":6,"last update":"Sun Dec 17 11:49:08 2023","interfaces":[{"interface":"back","average":{"1min":1.627,"5min":1.627,"15min":1.627},"min":{"1min":0.754,"5min":0.754,"15min":0.754},"max":{"1min":3.016,"5min":3.016,"15min":3.016},"last":1.5780000000000001},{"interface":"front","average":{"1min":1.5509999999999999,"5min":1.5509999999999999,"15min":1.5509999999999999},"min":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"max":{"1min":2.508,"5min":2.508,"15min":2.508},"last":1.5489999999999999}]},{"osd":7,"last update":"Sun Dec 17 11:49:08 2023","interfaces":[{"interface":"back","average":{"1min":1.6839999999999999,"5min":1.6839999999999999,"15min":1.6839999999999999},"min":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"max":{"1min":2.944,"5min":2.944,"15min":2.944},"last":1.8580000000000001},{"interface":"front","average":{"1min":1.7170000000000001,"5min":1.7170000000000001,"15min":1.7170000000000001},"min":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"max":{"1min":2.7709999999999999,"5min":2.7709999999999999,"15min":2.7709999999999999},"last":1.4690000000000001}]}]},{"osd":0,"up_from":14,"seq":60129542169,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32212,"kb_used_data":1032,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339628,"statfs":{"total":96636764160,"available":96603779072,"internally_reserved":0,"allocated":1056768,"data_stored":787978,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Dec 17 11:49:06 2023","interfaces":[{"interface":"back","average":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.3899999999999999,"5min":1.3899999999999999,"15min":1.3899999999999999},"last":1.0940000000000001},{"interface":"front","average":{"1min":1.1519999999999999,"5min":1.1519999999999999,"15min":1.1519999999999999},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":1.958,"5min":1.958,"15min":1.958},"last":1.04}]},{"osd":2,"last update":"Sun Dec 17 11:49:06 2023","interfaces":[{"interface":"back","average":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.7709999999999999,"5min":1.7709999999999999,"15min":1.7709999999999999},"last":1.222},{"interface":"front","average":{"1min":1.2090000000000001,"5min":1.2090000000000001,"15min":1.2090000000000001},"min":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":2.2130000000000001,"5min":2.2130000000000001,"15min":2.2130000000000001},"last":0.92700000000000005}]},{"osd":3,"last update":"Sun Dec 17 11:49:06 2023","interfaces":[{"interface":"back","average":{"1min":1.125,"5min":1.125,"15min":1.125},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.728,"5min":1.728,"15min":1.728},"last":0.81499999999999995},{"interface":"front","average":{"1min":1.4039999999999999,"5min":1.4039999999999999,"15min":1.4039999999999999},"min":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"max":{"1min":2.4809999999999999,"5min":2.4809999999999999,"15min":2.4809999999999999},"last":1.405}]},{"osd":4,"last update":"Sun Dec 17 11:49:06 2023","interfaces":[{"interface":"back","average":{"1min":1.518,"5min":1.518,"15min":1.518},"min":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"max":{"1min":4.6710000000000003,"5min":4.6710000000000003,"15min":4.6710000000000003},"last":1.573},{"interface":"front","average":{"1min":1.427,"5min":1.427,"15min":1.427},"min":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"max":{"1min":2.2799999999999998,"5min":2.2799999999999998,"15min":2.2799999999999998},"last":1.137}]},{"osd":5,"last update":"Sun Dec 17 11:49:06 2023","interfaces":[{"interface":"back","average":{"1min":1.5069999999999999,"5min":1.5069999999999999,"15min":1.5069999999999999},"min":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"max":{"1min":2.1349999999999998,"5min":2.1349999999999998,"15min":2.1349999999999998},"last":1.266},{"interface":"front","average":{"1min":1.6240000000000001,"5min":1.6240000000000001,"15min":1.6240000000000001},"min":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"max":{"1min":2.6080000000000001,"5min":2.6080000000000001,"15min":2.6080000000000001},"last":1.625}]},{"osd":6,"last update":"Sun Dec 17 11:49:06 2023","interfaces":[{"interface":"back","average":{"1min":1.5800000000000001,"5min":1.5800000000000001,"15min":1.5800000000000001},"min":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"max":{"1min":2.702,"5min":2.702,"15min":2.702},"last":1.5489999999999999},{"interface":"front","average":{"1min":1.534,"5min":1.534,"15min":1.534},"min":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"max":{"1min":2.3100000000000001,"5min":2.3100000000000001,"15min":2.3100000000000001},"last":1.3540000000000001}]},{"osd":7,"last update":"Sun Dec 17 11:49:06 2023","interfaces":[{"interface":"back","average":{"1min":1.611,"5min":1.611,"15min":1.611},"min":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"max":{"1min":2.3420000000000001,"5min":2.3420000000000001,"15min":2.3420000000000001},"last":1.5029999999999999},{"interface":"front","average":{"1min":1.577,"5min":1.577,"15min":1.577},"min":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"max":{"1min":2.4359999999999999,"5min":2.4359999999999999,"15min":2.4359999999999999},"last":1.464}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-17T11:49:58.790 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-12-17T11:49:59.060 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:59.058+0000 7ff8516da640 1 Processor -- start 2023-12-17T11:49:59.060 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:59.058+0000 7ff8516da640 1 -- start start 2023-12-17T11:49:59.062 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:59.060+0000 7ff8516da640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff84c144860 0x7ff84c15b540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:59.062 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:59.060+0000 7ff8516da640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7ff84c0cf850 0x7ff84c0cd6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:59.062 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:59.060+0000 7ff8516da640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff84c072610 con 0x7ff84c070660 2023-12-17T11:49:59.062 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:59.060+0000 7ff8516da640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff84c070c20 con 0x7ff84c0cf850 2023-12-17T11:49:59.062 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:59.060+0000 7ff8516da640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff84c070f00 con 0x7ff84c144860 2023-12-17T11:49:59.063 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:59.060+0000 7ff84affd640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff84c144860 0x7ff84c15b540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:59.063 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:59.061+0000 7ff84b7fe640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7ff84c0cf850 0x7ff84c0cd6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:59.063 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:59.061+0000 7ff84affd640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff84c144860 0x7ff84c15b540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3301/0 says I am v2:172.21.15.40:33920/0 (socket says 172.21.15.40:33920) 2023-12-17T11:49:59.063 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:59.061+0000 7ff84affd640 1 -- 172.21.15.40:0/2502713153 learned_addr learned my addr 172.21.15.40:0/2502713153 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-17T11:49:59.063 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:59.061+0000 7ff84a7fc640 1 --1- >> v1:172.21.15.159:6789/0 conn(0x7ff84c070660 0x7ff84c0cf140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.159:6789/0 says I am v1:172.21.15.40:47064/0 (socket says 172.21.15.40:47064) 2023-12-17T11:49:59.064 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:59.061+0000 7ff84affd640 1 -- 172.21.15.40:0/2502713153 >> v2:172.21.15.159:3300/0 conn(0x7ff84c0cf850 msgr2=0x7ff84c0cd6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:49:59.064 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:59.061+0000 7ff84affd640 1 --2- 172.21.15.40:0/2502713153 >> v2:172.21.15.159:3300/0 conn(0x7ff84c0cf850 0x7ff84c0cd6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:59.064 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:59.061+0000 7ff84affd640 1 -- 172.21.15.40:0/2502713153 >> v1:172.21.15.159:6789/0 conn(0x7ff84c070660 legacy=0x7ff84c0cf140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:59.064 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:59.061+0000 7ff84affd640 1 -- 172.21.15.40:0/2502713153 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff84c0711e0 con 0x7ff84c144860 2023-12-17T11:49:59.064 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:59.063+0000 7ff84affd640 1 --2- 172.21.15.40:0/2502713153 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff84c144860 0x7ff84c15b540 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7ff83c009e50 tx=0x7ff83c02bed0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1779dc912518904b server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:49:59.065 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:59.063+0000 7ff849ffb640 1 -- 172.21.15.40:0/2502713153 <== mon.2 v2:172.21.15.159:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff83c02ca70 con 0x7ff84c144860 2023-12-17T11:49:59.065 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:59.063+0000 7ff849ffb640 1 -- 172.21.15.40:0/2502713153 <== mon.2 v2:172.21.15.159:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff83c02cbd0 con 0x7ff84c144860 2023-12-17T11:49:59.065 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:59.063+0000 7ff849ffb640 1 -- 172.21.15.40:0/2502713153 <== mon.2 v2:172.21.15.159:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff83c0343f0 con 0x7ff84c144860 2023-12-17T11:49:59.066 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:59.064+0000 7ff8516da640 1 -- 172.21.15.40:0/2502713153 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff84c144860 msgr2=0x7ff84c15b540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:59.066 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:59.064+0000 7ff8516da640 1 --2- 172.21.15.40:0/2502713153 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff84c144860 0x7ff84c15b540 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7ff83c009e50 tx=0x7ff83c02bed0 comp rx=0 tx=0).stop 2023-12-17T11:49:59.066 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:59.064+0000 7ff8516da640 1 -- 172.21.15.40:0/2502713153 shutdown_connections 2023-12-17T11:49:59.066 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:59.064+0000 7ff8516da640 1 --2- 172.21.15.40:0/2502713153 >> v2:172.21.15.159:3300/0 conn(0x7ff84c0cf850 0x7ff84c0cd6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:59.067 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:59.064+0000 7ff8516da640 1 --2- 172.21.15.40:0/2502713153 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff84c144860 0x7ff84c15b540 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:59.067 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:59.064+0000 7ff8516da640 1 -- 172.21.15.40:0/2502713153 >> 172.21.15.40:0/2502713153 conn(0x7ff84c06a880 msgr2=0x7ff84c06ac90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:49:59.067 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:59.064+0000 7ff8516da640 1 -- 172.21.15.40:0/2502713153 shutdown_connections 2023-12-17T11:49:59.067 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:59.064+0000 7ff8516da640 1 -- 172.21.15.40:0/2502713153 wait complete. 2023-12-17T11:49:59.068 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:59.066+0000 7ff8516da640 1 Processor -- start 2023-12-17T11:49:59.068 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:59.066+0000 7ff8516da640 1 -- start start 2023-12-17T11:49:59.069 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:59.067+0000 7ff8516da640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff84c070660 0x7ff84c0addd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:59.069 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:59.067+0000 7ff8516da640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff84c0cf850 0x7ff84c140770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:59.069 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:59.067+0000 7ff8516da640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff84c144860 0x7ff84c140cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:59.070 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:59.067+0000 7ff8516da640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff84c0abe90 con 0x7ff84c0cf850 2023-12-17T11:49:59.070 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:59.067+0000 7ff8516da640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff84c0abb60 con 0x7ff84c070660 2023-12-17T11:49:59.070 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:59.067+0000 7ff8516da640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff84c0ae310 con 0x7ff84c144860 2023-12-17T11:49:59.070 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:59.068+0000 7ff84a7fc640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff84c0cf850 0x7ff84c140770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:59.070 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:59.068+0000 7ff84a7fc640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff84c0cf850 0x7ff84c140770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:33872/0 (socket says 172.21.15.40:33872) 2023-12-17T11:49:59.070 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:59.068+0000 7ff84a7fc640 1 -- 172.21.15.40:0/2147983283 learned_addr learned my addr 172.21.15.40:0/2147983283 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-17T11:49:59.071 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:59.068+0000 7ff84b7fe640 1 --2- 172.21.15.40:0/2147983283 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff84c144860 0x7ff84c140cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:59.071 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:59.068+0000 7ff84affd640 1 --2- 172.21.15.40:0/2147983283 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff84c070660 0x7ff84c0addd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:59.071 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:59.068+0000 7ff84a7fc640 1 -- 172.21.15.40:0/2147983283 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff84c144860 msgr2=0x7ff84c140cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:59.071 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:59.068+0000 7ff84a7fc640 1 --2- 172.21.15.40:0/2147983283 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff84c144860 0x7ff84c140cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:59.071 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:59.068+0000 7ff84a7fc640 1 -- 172.21.15.40:0/2147983283 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff84c070660 msgr2=0x7ff84c0addd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:59.071 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:59.068+0000 7ff84a7fc640 1 --2- 172.21.15.40:0/2147983283 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff84c070660 0x7ff84c0addd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:59.071 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:59.068+0000 7ff84a7fc640 1 -- 172.21.15.40:0/2147983283 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff83c009b30 con 0x7ff84c0cf850 2023-12-17T11:49:59.071 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:59.068+0000 7ff84a7fc640 1 --2- 172.21.15.40:0/2147983283 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff84c0cf850 0x7ff84c140770 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7ff83400c4d0 tx=0x7ff83400c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:49:59.072 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:59.069+0000 7ff8437fe640 1 -- 172.21.15.40:0/2147983283 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff834007480 con 0x7ff84c0cf850 2023-12-17T11:49:59.072 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:59.069+0000 7ff8437fe640 1 -- 172.21.15.40:0/2147983283 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8340075e0 con 0x7ff84c0cf850 2023-12-17T11:49:59.072 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:59.069+0000 7ff8437fe640 1 -- 172.21.15.40:0/2147983283 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8340049e0 con 0x7ff84c0cf850 2023-12-17T11:49:59.072 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:59.069+0000 7ff8516da640 1 -- 172.21.15.40:0/2147983283 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff84c0a9d90 con 0x7ff84c0cf850 2023-12-17T11:49:59.072 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:59.069+0000 7ff8516da640 1 -- 172.21.15.40:0/2147983283 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff84c0aa350 con 0x7ff84c0cf850 2023-12-17T11:49:59.072 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:59.070+0000 7ff8516da640 1 -- 172.21.15.40:0/2147983283 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff84c074670 con 0x7ff84c0cf850 2023-12-17T11:49:59.073 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:59.071+0000 7ff8437fe640 1 -- 172.21.15.40:0/2147983283 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ff834004b40 con 0x7ff84c0cf850 2023-12-17T11:49:59.074 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:59.072+0000 7ff8437fe640 1 --2- 172.21.15.40:0/2147983283 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7ff82c06ae40 0x7ff82c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:59.074 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:59.072+0000 7ff8437fe640 1 -- 172.21.15.40:0/2147983283 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6029+0+0 (secure 0 0 0) 0x7ff8340888d0 con 0x7ff84c0cf850 2023-12-17T11:49:59.074 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:59.073+0000 7ff84affd640 1 --2- 172.21.15.40:0/2147983283 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7ff82c06ae40 0x7ff82c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:59.076 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:59.074+0000 7ff84affd640 1 --2- 172.21.15.40:0/2147983283 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7ff82c06ae40 0x7ff82c06d300 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7ff83c035000 tx=0x7ff83c030000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:49:59.079 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:59.077+0000 7ff8437fe640 1 -- 172.21.15.40:0/2147983283 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7ff834053850 con 0x7ff84c0cf850 2023-12-17T11:49:59.347 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:59.345+0000 7ff8516da640 1 -- 172.21.15.40:0/2147983283 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7ff84c06b470 con 0x7ff84c0cf850 2023-12-17T11:49:59.348 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:59.346+0000 7ff8437fe640 1 -- 172.21.15.40:0/2147983283 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1170 (secure 0 0 0) 0x7ff834018080 con 0x7ff84c0cf850 2023-12-17T11:49:59.348 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T11:49:59.349 INFO:teuthology.orchestra.run.smithi040.stdout:{"fsid":"099cd35d-80d9-4ca4-8424-de13b3b03ac7","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":125,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":40,"num_osds":8,"num_up_osds":8,"osd_up_since":1702813685,"num_in_osds":8,"osd_in_since":1702813676,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"unknown","count":54},{"state_name":"creating+peering","count":28},{"state_name":"active+clean","count":15}],"num_pgs":97,"num_pools":3,"num_objects":6,"data_bytes":590368,"bytes_used":225964032,"bytes_avail":772868149248,"bytes_total":773094113280,"unknown_pgs_ratio":0.55670100450515747,"inactive_pgs_ratio":0.28865978121757507,"write_bytes_sec":0,"read_op_per_sec":0,"write_op_per_sec":2},"fsmap":{"epoch":15,"id":2,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":2,"rank":0,"name":"d","status":"up:active","gid":5304}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":6,"modified":"2023-12-17T11:49:24.620162+0000","services":{}},"progress_events":{}} 2023-12-17T11:49:59.351 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:59.348+0000 7ff8516da640 1 -- 172.21.15.40:0/2147983283 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7ff82c06ae40 msgr2=0x7ff82c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:59.351 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:59.348+0000 7ff8516da640 1 --2- 172.21.15.40:0/2147983283 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7ff82c06ae40 0x7ff82c06d300 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7ff83c035000 tx=0x7ff83c030000 comp rx=0 tx=0).stop 2023-12-17T11:49:59.351 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:59.348+0000 7ff8516da640 1 -- 172.21.15.40:0/2147983283 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff84c0cf850 msgr2=0x7ff84c140770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:59.351 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:59.348+0000 7ff8516da640 1 --2- 172.21.15.40:0/2147983283 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff84c0cf850 0x7ff84c140770 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7ff83400c4d0 tx=0x7ff83400c990 comp rx=0 tx=0).stop 2023-12-17T11:49:59.351 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:59.348+0000 7ff8516da640 1 -- 172.21.15.40:0/2147983283 shutdown_connections 2023-12-17T11:49:59.351 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:59.348+0000 7ff8516da640 1 --2- 172.21.15.40:0/2147983283 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7ff82c06ae40 0x7ff82c06d300 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:59.351 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:59.348+0000 7ff8516da640 1 --2- 172.21.15.40:0/2147983283 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff84c144860 0x7ff84c140cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:59.351 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:59.348+0000 7ff8516da640 1 --2- 172.21.15.40:0/2147983283 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff84c0cf850 0x7ff84c140770 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:59.352 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:59.348+0000 7ff8516da640 1 --2- 172.21.15.40:0/2147983283 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff84c070660 0x7ff84c0addd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:59.352 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:59.348+0000 7ff8516da640 1 -- 172.21.15.40:0/2147983283 >> 172.21.15.40:0/2147983283 conn(0x7ff84c06a880 msgr2=0x7ff84c1438f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:49:59.352 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:59.349+0000 7ff8516da640 1 -- 172.21.15.40:0/2147983283 shutdown_connections 2023-12-17T11:49:59.352 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:59.349+0000 7ff8516da640 1 -- 172.21.15.40:0/2147983283 wait complete. 2023-12-17T11:49:59.370 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-12-17T11:49:59.370 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-17T11:49:59.599 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:59.596+0000 7fb38ec32640 1 Processor -- start 2023-12-17T11:49:59.599 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:59.597+0000 7fb38ec32640 1 -- start start 2023-12-17T11:49:59.600 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:59.598+0000 7fb38ec32640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb3880d13c0 0x7fb3880ce5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:59.600 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:59.598+0000 7fb38ec32640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3880b2280 con 0x7fb3880b0760 2023-12-17T11:49:59.601 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:59.598+0000 7fb38ec32640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3880cee70 con 0x7fb3880d0d70 2023-12-17T11:49:59.601 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:59.598+0000 7fb38ec32640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3880d1190 con 0x7fb3880d13c0 2023-12-17T11:49:59.601 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:59.599+0000 7fb38e431640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fb3880b0760 0x7fb3880b0bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:45914/0 (socket says 172.21.15.40:45914) 2023-12-17T11:49:59.601 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:59.599+0000 7fb38e431640 1 -- 172.21.15.40:0/230570746 learned_addr learned my addr 172.21.15.40:0/230570746 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-12-17T11:49:59.603 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:59.599+0000 7fb38dc30640 1 --2- 172.21.15.40:0/230570746 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb3880d13c0 0x7fb3880ce5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:59.603 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:59.599+0000 7fb38cc2e640 1 -- 172.21.15.40:0/230570746 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4258405747 0 0) 0x7fb3880b2280 con 0x7fb3880b0760 2023-12-17T11:49:59.603 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:59.599+0000 7fb38cc2e640 1 -- 172.21.15.40:0/230570746 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb374003520 con 0x7fb3880b0760 2023-12-17T11:49:59.603 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:59.600+0000 7fb38cc2e640 1 -- 172.21.15.40:0/230570746 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2328882748 0 0) 0x7fb374003520 con 0x7fb3880b0760 2023-12-17T11:49:59.603 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:59.600+0000 7fb38cc2e640 1 -- 172.21.15.40:0/230570746 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb3880d13c0 msgr2=0x7fb3880ce5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:49:59.603 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:59.600+0000 7fb38cc2e640 1 --2- 172.21.15.40:0/230570746 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb3880d13c0 0x7fb3880ce5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:59.603 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:59.600+0000 7fb38cc2e640 1 -- 172.21.15.40:0/230570746 >> v1:172.21.15.159:6789/0 conn(0x7fb3880d0d70 legacy=0x7fb3880d17a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:59.603 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:59.600+0000 7fb38cc2e640 1 -- 172.21.15.40:0/230570746 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3880ceb90 con 0x7fb3880b0760 2023-12-17T11:49:59.603 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:59.600+0000 7fb38cc2e640 1 -- 172.21.15.40:0/230570746 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2643242555 0 0) 0x7fb380001670 con 0x7fb3880b0760 2023-12-17T11:49:59.603 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:59.600+0000 7fb38cc2e640 1 -- 172.21.15.40:0/230570746 >> v1:172.21.15.40:6789/0 conn(0x7fb3880b0760 legacy=0x7fb3880b0bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:59.603 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:59.600+0000 7fb38cc2e640 1 --2- 172.21.15.40:0/230570746 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb3740039a0 0x7fb374003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:59.603 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:59.600+0000 7fb38cc2e640 1 --2- 172.21.15.40:0/230570746 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb3880d13c0 0x7fb3740047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:59.604 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:59.600+0000 7fb38cc2e640 1 --2- 172.21.15.40:0/230570746 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb374004d00 0x7fb374005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:59.604 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:59.600+0000 7fb38cc2e640 1 -- 172.21.15.40:0/230570746 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3880d1190 con 0x7fb3740039a0 2023-12-17T11:49:59.604 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:59.600+0000 7fb38cc2e640 1 -- 172.21.15.40:0/230570746 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb37400bb10 con 0x7fb374004d00 2023-12-17T11:49:59.604 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:59.600+0000 7fb38cc2e640 1 -- 172.21.15.40:0/230570746 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb37400bcd0 con 0x7fb3880d13c0 2023-12-17T11:49:59.604 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:59.600+0000 7fb38dc30640 1 --2- 172.21.15.40:0/230570746 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb3740039a0 0x7fb374003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:59.604 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:59.600+0000 7fb38e431640 1 --2- 172.21.15.40:0/230570746 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb374004d00 0x7fb374005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:59.604 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:59.601+0000 7fb38d42f640 1 --2- 172.21.15.40:0/230570746 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb3880d13c0 0x7fb3740047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:59.604 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:59.601+0000 7fb38dc30640 1 -- 172.21.15.40:0/230570746 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb3880d13c0 msgr2=0x7fb3740047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:49:59.604 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:59.601+0000 7fb38dc30640 1 --2- 172.21.15.40:0/230570746 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb3880d13c0 0x7fb3740047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:59.604 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:59.601+0000 7fb38dc30640 1 -- 172.21.15.40:0/230570746 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb374004d00 msgr2=0x7fb374005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:49:59.604 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:59.601+0000 7fb38dc30640 1 --2- 172.21.15.40:0/230570746 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb374004d00 0x7fb374005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:59.604 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:59.601+0000 7fb38dc30640 1 -- 172.21.15.40:0/230570746 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb374003520 con 0x7fb3740039a0 2023-12-17T11:49:59.605 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:59.602+0000 7fb38dc30640 1 --2- 172.21.15.40:0/230570746 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb3740039a0 0x7fb374003dc0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7fb384009fc0 tx=0x7fb3740057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=984c9096b421786a server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:49:59.606 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:59.603+0000 7fb38cc2e640 1 -- 172.21.15.40:0/230570746 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb38402cc20 con 0x7fb3740039a0 2023-12-17T11:49:59.606 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:59.603+0000 7fb38cc2e640 1 -- 172.21.15.40:0/230570746 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb38400f040 con 0x7fb3740039a0 2023-12-17T11:49:59.606 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:59.603+0000 7fb38cc2e640 1 -- 172.21.15.40:0/230570746 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb384034440 con 0x7fb3740039a0 2023-12-17T11:49:59.606 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:59.603+0000 7fb38ec32640 1 -- 172.21.15.40:0/230570746 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb3740039a0 msgr2=0x7fb374003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:59.606 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:59.603+0000 7fb38ec32640 1 --2- 172.21.15.40:0/230570746 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb3740039a0 0x7fb374003dc0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7fb384009fc0 tx=0x7fb3740057f0 comp rx=0 tx=0).stop 2023-12-17T11:49:59.606 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:59.603+0000 7fb38e431640 1 -- 172.21.15.40:0/230570746 reap_dead start 2023-12-17T11:49:59.606 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:59.603+0000 7fb38ec32640 1 -- 172.21.15.40:0/230570746 shutdown_connections 2023-12-17T11:49:59.606 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:59.603+0000 7fb38ec32640 1 -- 172.21.15.40:0/230570746 >> 172.21.15.40:0/230570746 conn(0x7fb38809c260 msgr2=0x7fb3880d2f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:49:59.606 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:59.604+0000 7fb38ec32640 1 -- 172.21.15.40:0/230570746 shutdown_connections 2023-12-17T11:49:59.606 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:59.604+0000 7fb38ec32640 1 -- 172.21.15.40:0/230570746 wait complete. 2023-12-17T11:49:59.608 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:59.605+0000 7fb38ec32640 1 Processor -- start 2023-12-17T11:49:59.608 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:59.606+0000 7fb38ec32640 1 -- start start 2023-12-17T11:49:59.612 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:59.606+0000 7fb38ec32640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb3740039a0 0x7fb3880ccb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:59.612 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:59.606+0000 7fb38ec32640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb38809cbd0 0x7fb38809d050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:59.612 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:59.607+0000 7fb38ec32640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb3880b3500 0x7fb3880b3980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:59.612 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:59.607+0000 7fb38ec32640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb38809d590 con 0x7fb38809cbd0 2023-12-17T11:49:59.612 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:59.607+0000 7fb38ec32640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3880b4b10 con 0x7fb3740039a0 2023-12-17T11:49:59.612 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:59.607+0000 7fb38ec32640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3880cd080 con 0x7fb3880b3500 2023-12-17T11:49:59.613 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:59.607+0000 7fb38d42f640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb38809cbd0 0x7fb38809d050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:59.613 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:59.607+0000 7fb38d42f640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb38809cbd0 0x7fb38809d050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:33890/0 (socket says 172.21.15.40:33890) 2023-12-17T11:49:59.613 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:59.607+0000 7fb38d42f640 1 -- 172.21.15.40:0/138456536 learned_addr learned my addr 172.21.15.40:0/138456536 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-17T11:49:59.613 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:59.607+0000 7fb38dc30640 1 --2- 172.21.15.40:0/138456536 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb3740039a0 0x7fb3880ccb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:59.613 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:59.607+0000 7fb38d42f640 1 -- 172.21.15.40:0/138456536 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb3880b3500 msgr2=0x7fb3880b3980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:59.613 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:59.607+0000 7fb38e431640 1 --2- 172.21.15.40:0/138456536 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb3880b3500 0x7fb3880b3980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:59.613 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:59.607+0000 7fb38d42f640 1 --2- 172.21.15.40:0/138456536 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb3880b3500 0x7fb3880b3980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:59.613 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:59.607+0000 7fb38d42f640 1 -- 172.21.15.40:0/138456536 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb3740039a0 msgr2=0x7fb3880ccb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:59.613 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:59.607+0000 7fb38d42f640 1 --2- 172.21.15.40:0/138456536 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb3740039a0 0x7fb3880ccb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:59.613 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:59.607+0000 7fb38d42f640 1 -- 172.21.15.40:0/138456536 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3880b4270 con 0x7fb38809cbd0 2023-12-17T11:49:59.613 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:59.607+0000 7fb38dc30640 1 --2- 172.21.15.40:0/138456536 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb3740039a0 0x7fb3880ccb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-17T11:49:59.614 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:59.607+0000 7fb38e431640 1 --2- 172.21.15.40:0/138456536 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb3880b3500 0x7fb3880b3980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-17T11:49:59.614 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:59.608+0000 7fb38d42f640 1 --2- 172.21.15.40:0/138456536 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb38809cbd0 0x7fb38809d050 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7fb37800e4c0 tx=0x7fb37800e980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:49:59.614 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:59.608+0000 7fb37e7fc640 1 -- 172.21.15.40:0/138456536 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3780052e0 con 0x7fb38809cbd0 2023-12-17T11:49:59.614 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:59.608+0000 7fb37e7fc640 1 -- 172.21.15.40:0/138456536 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb378005440 con 0x7fb38809cbd0 2023-12-17T11:49:59.614 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:59.608+0000 7fb37e7fc640 1 -- 172.21.15.40:0/138456536 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb378003830 con 0x7fb38809cbd0 2023-12-17T11:49:59.614 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:59.608+0000 7fb38ec32640 1 -- 172.21.15.40:0/138456536 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3880b4550 con 0x7fb38809cbd0 2023-12-17T11:49:59.614 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:59.608+0000 7fb38ec32640 1 -- 172.21.15.40:0/138456536 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3880ca980 con 0x7fb38809cbd0 2023-12-17T11:49:59.614 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:59.609+0000 7fb38ec32640 1 -- 172.21.15.40:0/138456536 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb3880cab40 con 0x7fb38809cbd0 2023-12-17T11:49:59.614 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:59.610+0000 7fb37e7fc640 1 -- 172.21.15.40:0/138456536 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fb378003990 con 0x7fb38809cbd0 2023-12-17T11:49:59.615 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:59.611+0000 7fb37e7fc640 1 --2- 172.21.15.40:0/138456536 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7fb36c06ae70 0x7fb36c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:49:59.615 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:59.611+0000 7fb37e7fc640 1 -- 172.21.15.40:0/138456536 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fb378089410 con 0x7fb38809cbd0 2023-12-17T11:49:59.615 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:59.612+0000 7fb38dc30640 1 --2- 172.21.15.40:0/138456536 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7fb36c06ae70 0x7fb36c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:49:59.615 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:59.613+0000 7fb38dc30640 1 --2- 172.21.15.40:0/138456536 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7fb36c06ae70 0x7fb36c06d330 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fb384036000 tx=0x7fb38402e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:49:59.617 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:59.616+0000 7fb37e7fc640 1 -- 172.21.15.40:0/138456536 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fb378054410 con 0x7fb38809cbd0 2023-12-17T11:49:59.808 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:59.806+0000 7fb38ec32640 1 -- 172.21.15.40:0/138456536 --> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fb3880b0240 con 0x7fb36c06ae70 2023-12-17T11:49:59.832 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:59.829+0000 7fb37e7fc640 1 -- 172.21.15.40:0/138456536 <== mgr.4105 v2:172.21.15.159:6832/479465803 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286516 (secure 0 0 0) 0x7fb384044090 con 0x7fb36c06ae70 2023-12-17T11:49:59.836 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T11:49:59.838 INFO:teuthology.orchestra.run.smithi040.stderr:dumped all 2023-12-17T11:49:59.839 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:59.836+0000 7fb38ec32640 1 -- 172.21.15.40:0/138456536 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7fb36c06ae70 msgr2=0x7fb36c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:59.839 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:59.836+0000 7fb38ec32640 1 --2- 172.21.15.40:0/138456536 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7fb36c06ae70 0x7fb36c06d330 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fb384036000 tx=0x7fb38402e000 comp rx=0 tx=0).stop 2023-12-17T11:49:59.839 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:59.836+0000 7fb38ec32640 1 -- 172.21.15.40:0/138456536 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb38809cbd0 msgr2=0x7fb38809d050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:49:59.839 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:59.836+0000 7fb38ec32640 1 --2- 172.21.15.40:0/138456536 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb38809cbd0 0x7fb38809d050 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7fb37800e4c0 tx=0x7fb37800e980 comp rx=0 tx=0).stop 2023-12-17T11:49:59.840 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:59.836+0000 7fb38ec32640 1 -- 172.21.15.40:0/138456536 shutdown_connections 2023-12-17T11:49:59.840 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:59.836+0000 7fb38ec32640 1 --2- 172.21.15.40:0/138456536 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7fb36c06ae70 0x7fb36c06d330 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:59.840 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:59.836+0000 7fb38ec32640 1 --2- 172.21.15.40:0/138456536 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fb3880b3500 0x7fb3880b3980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:59.840 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:59.836+0000 7fb38ec32640 1 --2- 172.21.15.40:0/138456536 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb38809cbd0 0x7fb38809d050 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:59.840 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:59.836+0000 7fb38ec32640 1 --2- 172.21.15.40:0/138456536 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb3740039a0 0x7fb3880ccb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:49:59.840 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:59.836+0000 7fb38ec32640 1 -- 172.21.15.40:0/138456536 >> 172.21.15.40:0/138456536 conn(0x7fb38809c260 msgr2=0x7fb3880b5fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:49:59.840 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:59.837+0000 7fb38ec32640 1 -- 172.21.15.40:0/138456536 shutdown_connections 2023-12-17T11:49:59.840 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:49:59.837+0000 7fb38ec32640 1 -- 172.21.15.40:0/138456536 wait complete. 2023-12-17T11:49:59.856 INFO:teuthology.orchestra.run.smithi040.stdout:{"pg_ready":true,"pg_map":{"version":89,"stamp":"2023-12-17T11:49:58.631727+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":190,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":225160,"kb_used_data":4808,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754749560,"statfs":{"total":773094113280,"available":772863549440,"internally_reserved":0,"allocated":4923392,"data_stored":2766164,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":225496626},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":45,"apply_latency_ms":45,"commit_latency_ns":45000000,"apply_latency_ns":45000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.440972"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:54.216027+0000","last_change":"2023-12-17T11:49:53.251801+0000","last_active":"2023-12-17T11:49:54.216027+0000","last_peered":"2023-12-17T11:49:54.216027+0000","last_clean":"2023-12-17T11:49:54.216027+0000","last_became_active":"2023-12-17T11:49:53.251221+0000","last_became_peered":"2023-12-17T11:49:53.251221+0000","last_unstale":"2023-12-17T11:49:54.216027+0000","last_undegraded":"2023-12-17T11:49:54.216027+0000","last_fullsized":"2023-12-17T11:49:54.216027+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T22:42:15.785143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:54.215843+0000","last_change":"2023-12-17T11:49:53.243478+0000","last_active":"2023-12-17T11:49:54.215843+0000","last_peered":"2023-12-17T11:49:54.215843+0000","last_clean":"2023-12-17T11:49:54.215843+0000","last_became_active":"2023-12-17T11:49:53.243179+0000","last_became_peered":"2023-12-17T11:49:53.243179+0000","last_unstale":"2023-12-17T11:49:54.215843+0000","last_undegraded":"2023-12-17T11:49:54.215843+0000","last_fullsized":"2023-12-17T11:49:54.215843+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T23:49:09.469993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:55.302203+0000","last_change":"2023-12-17T11:49:53.249501+0000","last_active":"2023-12-17T11:49:55.302203+0000","last_peered":"2023-12-17T11:49:55.302203+0000","last_clean":"2023-12-17T11:49:55.302203+0000","last_became_active":"2023-12-17T11:49:53.249212+0000","last_became_peered":"2023-12-17T11:49:53.249212+0000","last_unstale":"2023-12-17T11:49:55.302203+0000","last_undegraded":"2023-12-17T11:49:55.302203+0000","last_fullsized":"2023-12-17T11:49:55.302203+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T22:50:12.261960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:55.300617+0000","last_change":"2023-12-17T11:49:53.237486+0000","last_active":"2023-12-17T11:49:55.300617+0000","last_peered":"2023-12-17T11:49:55.300617+0000","last_clean":"2023-12-17T11:49:55.300617+0000","last_became_active":"2023-12-17T11:49:53.236766+0000","last_became_peered":"2023-12-17T11:49:53.236766+0000","last_unstale":"2023-12-17T11:49:55.300617+0000","last_undegraded":"2023-12-17T11:49:55.300617+0000","last_fullsized":"2023-12-17T11:49:55.300617+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T19:34:01.395947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:55.300273+0000","last_change":"2023-12-17T11:49:53.230175+0000","last_active":"2023-12-17T11:49:55.300273+0000","last_peered":"2023-12-17T11:49:55.300273+0000","last_clean":"2023-12-17T11:49:55.300273+0000","last_became_active":"2023-12-17T11:49:53.229756+0000","last_became_peered":"2023-12-17T11:49:53.229756+0000","last_unstale":"2023-12-17T11:49:55.300273+0000","last_undegraded":"2023-12-17T11:49:55.300273+0000","last_fullsized":"2023-12-17T11:49:55.300273+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T15:43:04.869288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:54.556742+0000","last_change":"2023-12-17T11:49:53.245040+0000","last_active":"2023-12-17T11:49:54.556742+0000","last_peered":"2023-12-17T11:49:54.556742+0000","last_clean":"2023-12-17T11:49:54.556742+0000","last_became_active":"2023-12-17T11:49:53.243989+0000","last_became_peered":"2023-12-17T11:49:53.243989+0000","last_unstale":"2023-12-17T11:49:54.556742+0000","last_undegraded":"2023-12-17T11:49:54.556742+0000","last_fullsized":"2023-12-17T11:49:54.556742+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T16:31:53.964205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:55.303516+0000","last_change":"2023-12-17T11:49:53.244506+0000","last_active":"2023-12-17T11:49:55.303516+0000","last_peered":"2023-12-17T11:49:55.303516+0000","last_clean":"2023-12-17T11:49:55.303516+0000","last_became_active":"2023-12-17T11:49:53.244244+0000","last_became_peered":"2023-12-17T11:49:53.244244+0000","last_unstale":"2023-12-17T11:49:55.303516+0000","last_undegraded":"2023-12-17T11:49:55.303516+0000","last_fullsized":"2023-12-17T11:49:55.303516+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T12:27:38.132749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:54.215326+0000","last_change":"2023-12-17T11:49:53.256713+0000","last_active":"2023-12-17T11:49:54.215326+0000","last_peered":"2023-12-17T11:49:54.215326+0000","last_clean":"2023-12-17T11:49:54.215326+0000","last_became_active":"2023-12-17T11:49:53.255850+0000","last_became_peered":"2023-12-17T11:49:53.255850+0000","last_unstale":"2023-12-17T11:49:54.215326+0000","last_undegraded":"2023-12-17T11:49:54.215326+0000","last_fullsized":"2023-12-17T11:49:54.215326+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T14:00:43.418107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:55.302135+0000","last_change":"2023-12-17T11:49:53.255007+0000","last_active":"2023-12-17T11:49:55.302135+0000","last_peered":"2023-12-17T11:49:55.302135+0000","last_clean":"2023-12-17T11:49:55.302135+0000","last_became_active":"2023-12-17T11:49:53.254750+0000","last_became_peered":"2023-12-17T11:49:53.254750+0000","last_unstale":"2023-12-17T11:49:55.302135+0000","last_undegraded":"2023-12-17T11:49:55.302135+0000","last_fullsized":"2023-12-17T11:49:55.302135+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T19:23:44.505187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:55.304578+0000","last_change":"2023-12-17T11:49:53.243885+0000","last_active":"2023-12-17T11:49:55.304578+0000","last_peered":"2023-12-17T11:49:55.304578+0000","last_clean":"2023-12-17T11:49:55.304578+0000","last_became_active":"2023-12-17T11:49:53.243586+0000","last_became_peered":"2023-12-17T11:49:53.243586+0000","last_unstale":"2023-12-17T11:49:55.304578+0000","last_undegraded":"2023-12-17T11:49:55.304578+0000","last_fullsized":"2023-12-17T11:49:55.304578+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T23:49:09.469993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:55.304683+0000","last_change":"2023-12-17T11:49:53.245071+0000","last_active":"2023-12-17T11:49:55.304683+0000","last_peered":"2023-12-17T11:49:55.304683+0000","last_clean":"2023-12-17T11:49:55.304683+0000","last_became_active":"2023-12-17T11:49:53.244696+0000","last_became_peered":"2023-12-17T11:49:53.244696+0000","last_unstale":"2023-12-17T11:49:55.304683+0000","last_undegraded":"2023-12-17T11:49:55.304683+0000","last_fullsized":"2023-12-17T11:49:55.304683+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T17:56:09.285369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:55.302165+0000","last_change":"2023-12-17T11:49:53.244437+0000","last_active":"2023-12-17T11:49:55.302165+0000","last_peered":"2023-12-17T11:49:55.302165+0000","last_clean":"2023-12-17T11:49:55.302165+0000","last_became_active":"2023-12-17T11:49:53.244158+0000","last_became_peered":"2023-12-17T11:49:53.244158+0000","last_unstale":"2023-12-17T11:49:55.302165+0000","last_undegraded":"2023-12-17T11:49:55.302165+0000","last_fullsized":"2023-12-17T11:49:55.302165+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T12:12:45.651530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:55.303911+0000","last_change":"2023-12-17T11:49:53.259954+0000","last_active":"2023-12-17T11:49:55.303911+0000","last_peered":"2023-12-17T11:49:55.303911+0000","last_clean":"2023-12-17T11:49:55.303911+0000","last_became_active":"2023-12-17T11:49:53.259683+0000","last_became_peered":"2023-12-17T11:49:53.259683+0000","last_unstale":"2023-12-17T11:49:55.303911+0000","last_undegraded":"2023-12-17T11:49:55.303911+0000","last_fullsized":"2023-12-17T11:49:55.303911+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T13:29:29.953615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:54.218414+0000","last_change":"2023-12-17T11:49:53.251388+0000","last_active":"2023-12-17T11:49:54.218414+0000","last_peered":"2023-12-17T11:49:54.218414+0000","last_clean":"2023-12-17T11:49:54.218414+0000","last_became_active":"2023-12-17T11:49:53.251182+0000","last_became_peered":"2023-12-17T11:49:53.251182+0000","last_unstale":"2023-12-17T11:49:54.218414+0000","last_undegraded":"2023-12-17T11:49:54.218414+0000","last_fullsized":"2023-12-17T11:49:54.218414+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T19:39:18.340154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:55.303846+0000","last_change":"2023-12-17T11:49:53.251484+0000","last_active":"2023-12-17T11:49:55.303846+0000","last_peered":"2023-12-17T11:49:55.303846+0000","last_clean":"2023-12-17T11:49:55.303846+0000","last_became_active":"2023-12-17T11:49:53.250825+0000","last_became_peered":"2023-12-17T11:49:53.250825+0000","last_unstale":"2023-12-17T11:49:55.303846+0000","last_undegraded":"2023-12-17T11:49:55.303846+0000","last_fullsized":"2023-12-17T11:49:55.303846+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T12:48:09.865175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:55.301502+0000","last_change":"2023-12-17T11:49:53.256736+0000","last_active":"2023-12-17T11:49:55.301502+0000","last_peered":"2023-12-17T11:49:55.301502+0000","last_clean":"2023-12-17T11:49:55.301502+0000","last_became_active":"2023-12-17T11:49:53.256319+0000","last_became_peered":"2023-12-17T11:49:53.256319+0000","last_unstale":"2023-12-17T11:49:55.301502+0000","last_undegraded":"2023-12-17T11:49:55.301502+0000","last_fullsized":"2023-12-17T11:49:55.301502+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T14:49:05.628056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:55.302967+0000","last_change":"2023-12-17T11:49:53.254466+0000","last_active":"2023-12-17T11:49:55.302967+0000","last_peered":"2023-12-17T11:49:55.302967+0000","last_clean":"2023-12-17T11:49:55.302967+0000","last_became_active":"2023-12-17T11:49:53.254191+0000","last_became_peered":"2023-12-17T11:49:53.254191+0000","last_unstale":"2023-12-17T11:49:55.302967+0000","last_undegraded":"2023-12-17T11:49:55.302967+0000","last_fullsized":"2023-12-17T11:49:55.302967+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T15:34:59.184998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:54.219676+0000","last_change":"2023-12-17T11:49:53.244371+0000","last_active":"2023-12-17T11:49:54.219676+0000","last_peered":"2023-12-17T11:49:54.219676+0000","last_clean":"2023-12-17T11:49:54.219676+0000","last_became_active":"2023-12-17T11:49:53.243288+0000","last_became_peered":"2023-12-17T11:49:53.243288+0000","last_unstale":"2023-12-17T11:49:54.219676+0000","last_undegraded":"2023-12-17T11:49:54.219676+0000","last_fullsized":"2023-12-17T11:49:54.219676+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T22:59:01.401999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:55.300850+0000","last_change":"2023-12-17T11:49:53.247133+0000","last_active":"2023-12-17T11:49:55.300850+0000","last_peered":"2023-12-17T11:49:55.300850+0000","last_clean":"2023-12-17T11:49:55.300850+0000","last_became_active":"2023-12-17T11:49:53.246863+0000","last_became_peered":"2023-12-17T11:49:53.246863+0000","last_unstale":"2023-12-17T11:49:55.300850+0000","last_undegraded":"2023-12-17T11:49:55.300850+0000","last_fullsized":"2023-12-17T11:49:55.300850+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T15:22:56.669665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:54.219126+0000","last_change":"2023-12-17T11:49:53.234246+0000","last_active":"2023-12-17T11:49:54.219126+0000","last_peered":"2023-12-17T11:49:54.219126+0000","last_clean":"2023-12-17T11:49:54.219126+0000","last_became_active":"2023-12-17T11:49:53.233971+0000","last_became_peered":"2023-12-17T11:49:53.233971+0000","last_unstale":"2023-12-17T11:49:54.219126+0000","last_undegraded":"2023-12-17T11:49:54.219126+0000","last_fullsized":"2023-12-17T11:49:54.219126+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T21:22:15.324114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:55.304097+0000","last_change":"2023-12-17T11:49:53.254631+0000","last_active":"2023-12-17T11:49:55.304097+0000","last_peered":"2023-12-17T11:49:55.304097+0000","last_clean":"2023-12-17T11:49:55.304097+0000","last_became_active":"2023-12-17T11:49:53.254246+0000","last_became_peered":"2023-12-17T11:49:53.254246+0000","last_unstale":"2023-12-17T11:49:55.304097+0000","last_undegraded":"2023-12-17T11:49:55.304097+0000","last_fullsized":"2023-12-17T11:49:55.304097+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T15:42:47.132551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:54.219970+0000","last_change":"2023-12-17T11:49:53.233281+0000","last_active":"2023-12-17T11:49:54.219970+0000","last_peered":"2023-12-17T11:49:54.219970+0000","last_clean":"2023-12-17T11:49:54.219970+0000","last_became_active":"2023-12-17T11:49:53.233006+0000","last_became_peered":"2023-12-17T11:49:53.233006+0000","last_unstale":"2023-12-17T11:49:54.219970+0000","last_undegraded":"2023-12-17T11:49:54.219970+0000","last_fullsized":"2023-12-17T11:49:54.219970+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T17:37:46.058341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:55.301627+0000","last_change":"2023-12-17T11:49:53.235006+0000","last_active":"2023-12-17T11:49:55.301627+0000","last_peered":"2023-12-17T11:49:55.301627+0000","last_clean":"2023-12-17T11:49:55.301627+0000","last_became_active":"2023-12-17T11:49:53.232828+0000","last_became_peered":"2023-12-17T11:49:53.232828+0000","last_unstale":"2023-12-17T11:49:55.301627+0000","last_undegraded":"2023-12-17T11:49:55.301627+0000","last_fullsized":"2023-12-17T11:49:55.301627+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T21:34:46.442330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:55.300810+0000","last_change":"2023-12-17T11:49:53.229937+0000","last_active":"2023-12-17T11:49:55.300810+0000","last_peered":"2023-12-17T11:49:55.300810+0000","last_clean":"2023-12-17T11:49:55.300810+0000","last_became_active":"2023-12-17T11:49:53.229360+0000","last_became_peered":"2023-12-17T11:49:53.229360+0000","last_unstale":"2023-12-17T11:49:55.300810+0000","last_undegraded":"2023-12-17T11:49:55.300810+0000","last_fullsized":"2023-12-17T11:49:55.300810+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T13:22:57.464897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:54.220001+0000","last_change":"2023-12-17T11:49:53.248140+0000","last_active":"2023-12-17T11:49:54.220001+0000","last_peered":"2023-12-17T11:49:54.220001+0000","last_clean":"2023-12-17T11:49:54.220001+0000","last_became_active":"2023-12-17T11:49:53.246139+0000","last_became_peered":"2023-12-17T11:49:53.246139+0000","last_unstale":"2023-12-17T11:49:54.220001+0000","last_undegraded":"2023-12-17T11:49:54.220001+0000","last_fullsized":"2023-12-17T11:49:54.220001+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T14:32:00.462222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:54.557357+0000","last_change":"2023-12-17T11:49:53.255892+0000","last_active":"2023-12-17T11:49:54.557357+0000","last_peered":"2023-12-17T11:49:54.557357+0000","last_clean":"2023-12-17T11:49:54.557357+0000","last_became_active":"2023-12-17T11:49:53.255307+0000","last_became_peered":"2023-12-17T11:49:53.255307+0000","last_unstale":"2023-12-17T11:49:54.557357+0000","last_undegraded":"2023-12-17T11:49:54.557357+0000","last_fullsized":"2023-12-17T11:49:54.557357+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T17:37:46.058341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:54.219290+0000","last_change":"2023-12-17T11:49:53.238527+0000","last_active":"2023-12-17T11:49:54.219290+0000","last_peered":"2023-12-17T11:49:54.219290+0000","last_clean":"2023-12-17T11:49:54.219290+0000","last_became_active":"2023-12-17T11:49:53.238260+0000","last_became_peered":"2023-12-17T11:49:53.238260+0000","last_unstale":"2023-12-17T11:49:54.219290+0000","last_undegraded":"2023-12-17T11:49:54.219290+0000","last_fullsized":"2023-12-17T11:49:54.219290+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T14:03:14.332356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:55.304415+0000","last_change":"2023-12-17T11:49:53.247243+0000","last_active":"2023-12-17T11:49:55.304415+0000","last_peered":"2023-12-17T11:49:55.304415+0000","last_clean":"2023-12-17T11:49:55.304415+0000","last_became_active":"2023-12-17T11:49:53.246983+0000","last_became_peered":"2023-12-17T11:49:53.246983+0000","last_unstale":"2023-12-17T11:49:55.304415+0000","last_undegraded":"2023-12-17T11:49:55.304415+0000","last_fullsized":"2023-12-17T11:49:55.304415+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T23:33:06.562683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:54.218870+0000","last_change":"2023-12-17T11:49:53.247287+0000","last_active":"2023-12-17T11:49:54.218870+0000","last_peered":"2023-12-17T11:49:54.218870+0000","last_clean":"2023-12-17T11:49:54.218870+0000","last_became_active":"2023-12-17T11:49:53.246995+0000","last_became_peered":"2023-12-17T11:49:53.246995+0000","last_unstale":"2023-12-17T11:49:54.218870+0000","last_undegraded":"2023-12-17T11:49:54.218870+0000","last_fullsized":"2023-12-17T11:49:54.218870+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T14:03:09.358474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:54.219180+0000","last_change":"2023-12-17T11:49:53.240901+0000","last_active":"2023-12-17T11:49:54.219180+0000","last_peered":"2023-12-17T11:49:54.219180+0000","last_clean":"2023-12-17T11:49:54.219180+0000","last_became_active":"2023-12-17T11:49:53.240589+0000","last_became_peered":"2023-12-17T11:49:53.240589+0000","last_unstale":"2023-12-17T11:49:54.219180+0000","last_undegraded":"2023-12-17T11:49:54.219180+0000","last_fullsized":"2023-12-17T11:49:54.219180+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T19:17:47.294209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:55.301788+0000","last_change":"2023-12-17T11:49:53.239855+0000","last_active":"2023-12-17T11:49:55.301788+0000","last_peered":"2023-12-17T11:49:55.301788+0000","last_clean":"2023-12-17T11:49:55.301788+0000","last_became_active":"2023-12-17T11:49:53.239579+0000","last_became_peered":"2023-12-17T11:49:53.239579+0000","last_unstale":"2023-12-17T11:49:55.301788+0000","last_undegraded":"2023-12-17T11:49:55.301788+0000","last_fullsized":"2023-12-17T11:49:55.301788+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T20:29:09.996550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:54.556835+0000","last_change":"2023-12-17T11:49:53.252543+0000","last_active":"2023-12-17T11:49:54.556835+0000","last_peered":"2023-12-17T11:49:54.556835+0000","last_clean":"2023-12-17T11:49:54.556835+0000","last_became_active":"2023-12-17T11:49:53.250790+0000","last_became_peered":"2023-12-17T11:49:53.250790+0000","last_unstale":"2023-12-17T11:49:54.556835+0000","last_undegraded":"2023-12-17T11:49:54.556835+0000","last_fullsized":"2023-12-17T11:49:54.556835+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T19:00:07.905809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:55.302468+0000","last_change":"2023-12-17T11:49:53.245226+0000","last_active":"2023-12-17T11:49:55.302468+0000","last_peered":"2023-12-17T11:49:55.302468+0000","last_clean":"2023-12-17T11:49:55.302468+0000","last_became_active":"2023-12-17T11:49:53.243115+0000","last_became_peered":"2023-12-17T11:49:53.243115+0000","last_unstale":"2023-12-17T11:49:55.302468+0000","last_undegraded":"2023-12-17T11:49:55.302468+0000","last_fullsized":"2023-12-17T11:49:55.302468+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T15:06:34.831619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"39'4","reported_seq":16,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-17T11:49:53.259894+0000","last_change":"2023-12-17T11:49:52.226944+0000","last_active":"2023-12-17T11:49:53.259894+0000","last_peered":"2023-12-17T11:49:53.259894+0000","last_clean":"2023-12-17T11:49:53.259894+0000","last_became_active":"2023-12-17T11:49:52.226659+0000","last_became_peered":"2023-12-17T11:49:52.226659+0000","last_unstale":"2023-12-17T11:49:53.259894+0000","last_undegraded":"2023-12-17T11:49:53.259894+0000","last_fullsized":"2023-12-17T11:49:53.259894+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_clean_scrub_stamp":"2023-12-17T11:49:51.168108+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T13:22:56.453467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:54.557487+0000","last_change":"2023-12-17T11:49:53.254791+0000","last_active":"2023-12-17T11:49:54.557487+0000","last_peered":"2023-12-17T11:49:54.557487+0000","last_clean":"2023-12-17T11:49:54.557487+0000","last_became_active":"2023-12-17T11:49:53.254496+0000","last_became_peered":"2023-12-17T11:49:53.254496+0000","last_unstale":"2023-12-17T11:49:54.557487+0000","last_undegraded":"2023-12-17T11:49:54.557487+0000","last_fullsized":"2023-12-17T11:49:54.557487+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T14:42:29.543380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"39'1","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-17T11:49:53.254240+0000","last_change":"2023-12-17T11:49:52.223256+0000","last_active":"2023-12-17T11:49:53.254240+0000","last_peered":"2023-12-17T11:49:53.254240+0000","last_clean":"2023-12-17T11:49:53.254240+0000","last_became_active":"2023-12-17T11:49:52.222808+0000","last_became_peered":"2023-12-17T11:49:52.222808+0000","last_unstale":"2023-12-17T11:49:53.254240+0000","last_undegraded":"2023-12-17T11:49:53.254240+0000","last_fullsized":"2023-12-17T11:49:53.254240+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_clean_scrub_stamp":"2023-12-17T11:49:51.168108+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T16:31:52.952775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:54.220368+0000","last_change":"2023-12-17T11:49:53.251178+0000","last_active":"2023-12-17T11:49:54.220368+0000","last_peered":"2023-12-17T11:49:54.220368+0000","last_clean":"2023-12-17T11:49:54.220368+0000","last_became_active":"2023-12-17T11:49:53.250223+0000","last_became_peered":"2023-12-17T11:49:53.250223+0000","last_unstale":"2023-12-17T11:49:54.220368+0000","last_undegraded":"2023-12-17T11:49:54.220368+0000","last_fullsized":"2023-12-17T11:49:54.220368+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T23:10:56.100255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"39'2","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-17T11:49:53.249819+0000","last_change":"2023-12-17T11:49:52.223879+0000","last_active":"2023-12-17T11:49:53.249819+0000","last_peered":"2023-12-17T11:49:53.249819+0000","last_clean":"2023-12-17T11:49:53.249819+0000","last_became_active":"2023-12-17T11:49:52.223602+0000","last_became_peered":"2023-12-17T11:49:52.223602+0000","last_unstale":"2023-12-17T11:49:53.249819+0000","last_undegraded":"2023-12-17T11:49:53.249819+0000","last_fullsized":"2023-12-17T11:49:53.249819+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_clean_scrub_stamp":"2023-12-17T11:49:51.168108+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T15:25:46.493177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:54.215810+0000","last_change":"2023-12-17T11:49:53.254646+0000","last_active":"2023-12-17T11:49:54.215810+0000","last_peered":"2023-12-17T11:49:54.215810+0000","last_clean":"2023-12-17T11:49:54.215810+0000","last_became_active":"2023-12-17T11:49:53.254368+0000","last_became_peered":"2023-12-17T11:49:53.254368+0000","last_unstale":"2023-12-17T11:49:54.215810+0000","last_undegraded":"2023-12-17T11:49:54.215810+0000","last_fullsized":"2023-12-17T11:49:54.215810+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T15:42:47.132551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"39'2","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-17T11:49:53.261997+0000","last_change":"2023-12-17T11:49:52.221006+0000","last_active":"2023-12-17T11:49:53.261997+0000","last_peered":"2023-12-17T11:49:53.261997+0000","last_clean":"2023-12-17T11:49:53.261997+0000","last_became_active":"2023-12-17T11:49:52.220514+0000","last_became_peered":"2023-12-17T11:49:52.220514+0000","last_unstale":"2023-12-17T11:49:53.261997+0000","last_undegraded":"2023-12-17T11:49:53.261997+0000","last_fullsized":"2023-12-17T11:49:53.261997+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_clean_scrub_stamp":"2023-12-17T11:49:51.168108+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T15:25:46.493177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:55.301494+0000","last_change":"2023-12-17T11:49:53.251737+0000","last_active":"2023-12-17T11:49:55.301494+0000","last_peered":"2023-12-17T11:49:55.301494+0000","last_clean":"2023-12-17T11:49:55.301494+0000","last_became_active":"2023-12-17T11:49:53.251458+0000","last_became_peered":"2023-12-17T11:49:53.251458+0000","last_unstale":"2023-12-17T11:49:55.301494+0000","last_undegraded":"2023-12-17T11:49:55.301494+0000","last_fullsized":"2023-12-17T11:49:55.301494+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T17:37:46.058341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"39'1","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-17T11:49:53.261144+0000","last_change":"2023-12-17T11:49:52.226918+0000","last_active":"2023-12-17T11:49:53.261144+0000","last_peered":"2023-12-17T11:49:53.261144+0000","last_clean":"2023-12-17T11:49:53.261144+0000","last_became_active":"2023-12-17T11:49:52.226455+0000","last_became_peered":"2023-12-17T11:49:52.226455+0000","last_unstale":"2023-12-17T11:49:53.261144+0000","last_undegraded":"2023-12-17T11:49:53.261144+0000","last_fullsized":"2023-12-17T11:49:53.261144+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_clean_scrub_stamp":"2023-12-17T11:49:51.168108+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T12:12:44.640100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:55.303916+0000","last_change":"2023-12-17T11:49:53.251691+0000","last_active":"2023-12-17T11:49:55.303916+0000","last_peered":"2023-12-17T11:49:55.303916+0000","last_clean":"2023-12-17T11:49:55.303916+0000","last_became_active":"2023-12-17T11:49:53.251175+0000","last_became_peered":"2023-12-17T11:49:53.251175+0000","last_unstale":"2023-12-17T11:49:55.303916+0000","last_undegraded":"2023-12-17T11:49:55.303916+0000","last_fullsized":"2023-12-17T11:49:55.303916+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T14:00:43.418107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"39'1","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:55.301855+0000","last_change":"2023-12-17T11:49:52.225053+0000","last_active":"2023-12-17T11:49:55.301855+0000","last_peered":"2023-12-17T11:49:55.301855+0000","last_clean":"2023-12-17T11:49:55.301855+0000","last_became_active":"2023-12-17T11:49:52.224761+0000","last_became_peered":"2023-12-17T11:49:52.224761+0000","last_unstale":"2023-12-17T11:49:55.301855+0000","last_undegraded":"2023-12-17T11:49:55.301855+0000","last_fullsized":"2023-12-17T11:49:55.301855+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_clean_scrub_stamp":"2023-12-17T11:49:51.168108+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T20:30:07.106128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:54.219620+0000","last_change":"2023-12-17T11:49:53.255162+0000","last_active":"2023-12-17T11:49:54.219620+0000","last_peered":"2023-12-17T11:49:54.219620+0000","last_clean":"2023-12-17T11:49:54.219620+0000","last_became_active":"2023-12-17T11:49:53.254841+0000","last_became_peered":"2023-12-17T11:49:53.254841+0000","last_unstale":"2023-12-17T11:49:54.219620+0000","last_undegraded":"2023-12-17T11:49:54.219620+0000","last_fullsized":"2023-12-17T11:49:54.219620+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T19:00:07.905809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-17T11:49:53.239765+0000","last_change":"2023-12-17T11:49:52.230598+0000","last_active":"2023-12-17T11:49:53.239765+0000","last_peered":"2023-12-17T11:49:53.239765+0000","last_clean":"2023-12-17T11:49:53.239765+0000","last_became_active":"2023-12-17T11:49:52.230298+0000","last_became_peered":"2023-12-17T11:49:52.230298+0000","last_unstale":"2023-12-17T11:49:53.239765+0000","last_undegraded":"2023-12-17T11:49:53.239765+0000","last_fullsized":"2023-12-17T11:49:53.239765+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_clean_scrub_stamp":"2023-12-17T11:49:51.168108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T22:39:30.094160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:54.215441+0000","last_change":"2023-12-17T11:49:53.249431+0000","last_active":"2023-12-17T11:49:54.215441+0000","last_peered":"2023-12-17T11:49:54.215441+0000","last_clean":"2023-12-17T11:49:54.215441+0000","last_became_active":"2023-12-17T11:49:53.248943+0000","last_became_peered":"2023-12-17T11:49:53.248943+0000","last_unstale":"2023-12-17T11:49:54.215441+0000","last_undegraded":"2023-12-17T11:49:54.215441+0000","last_fullsized":"2023-12-17T11:49:54.215441+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T16:21:14.355302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-17T11:49:53.227566+0000","last_change":"2023-12-17T11:49:52.224198+0000","last_active":"2023-12-17T11:49:53.227566+0000","last_peered":"2023-12-17T11:49:53.227566+0000","last_clean":"2023-12-17T11:49:53.227566+0000","last_became_active":"2023-12-17T11:49:52.223829+0000","last_became_peered":"2023-12-17T11:49:52.223829+0000","last_unstale":"2023-12-17T11:49:53.227566+0000","last_undegraded":"2023-12-17T11:49:53.227566+0000","last_fullsized":"2023-12-17T11:49:53.227566+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_clean_scrub_stamp":"2023-12-17T11:49:51.168108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T13:20:29.045455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:55.300657+0000","last_change":"2023-12-17T11:49:53.232883+0000","last_active":"2023-12-17T11:49:55.300657+0000","last_peered":"2023-12-17T11:49:55.300657+0000","last_clean":"2023-12-17T11:49:55.300657+0000","last_became_active":"2023-12-17T11:49:53.232629+0000","last_became_peered":"2023-12-17T11:49:53.232629+0000","last_unstale":"2023-12-17T11:49:55.300657+0000","last_undegraded":"2023-12-17T11:49:55.300657+0000","last_fullsized":"2023-12-17T11:49:55.300657+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T18:07:10.105462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-17T11:49:53.240402+0000","last_change":"2023-12-17T11:49:52.215890+0000","last_active":"2023-12-17T11:49:53.240402+0000","last_peered":"2023-12-17T11:49:53.240402+0000","last_clean":"2023-12-17T11:49:53.240402+0000","last_became_active":"2023-12-17T11:49:52.215576+0000","last_became_peered":"2023-12-17T11:49:52.215576+0000","last_unstale":"2023-12-17T11:49:53.240402+0000","last_undegraded":"2023-12-17T11:49:53.240402+0000","last_fullsized":"2023-12-17T11:49:53.240402+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_clean_scrub_stamp":"2023-12-17T11:49:51.168108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T17:03:59.637357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:55.302907+0000","last_change":"2023-12-17T11:49:53.236661+0000","last_active":"2023-12-17T11:49:55.302907+0000","last_peered":"2023-12-17T11:49:55.302907+0000","last_clean":"2023-12-17T11:49:55.302907+0000","last_became_active":"2023-12-17T11:49:53.236319+0000","last_became_peered":"2023-12-17T11:49:53.236319+0000","last_unstale":"2023-12-17T11:49:55.302907+0000","last_undegraded":"2023-12-17T11:49:55.302907+0000","last_fullsized":"2023-12-17T11:49:55.302907+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T13:29:01.309715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-17T11:49:53.251543+0000","last_change":"2023-12-17T11:49:52.233070+0000","last_active":"2023-12-17T11:49:53.251543+0000","last_peered":"2023-12-17T11:49:53.251543+0000","last_clean":"2023-12-17T11:49:53.251543+0000","last_became_active":"2023-12-17T11:49:52.232635+0000","last_became_peered":"2023-12-17T11:49:52.232635+0000","last_unstale":"2023-12-17T11:49:53.251543+0000","last_undegraded":"2023-12-17T11:49:53.251543+0000","last_fullsized":"2023-12-17T11:49:53.251543+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_clean_scrub_stamp":"2023-12-17T11:49:51.168108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T15:53:07.030004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:55.302148+0000","last_change":"2023-12-17T11:49:53.246755+0000","last_active":"2023-12-17T11:49:55.302148+0000","last_peered":"2023-12-17T11:49:55.302148+0000","last_clean":"2023-12-17T11:49:55.302148+0000","last_became_active":"2023-12-17T11:49:53.245111+0000","last_became_peered":"2023-12-17T11:49:53.245111+0000","last_unstale":"2023-12-17T11:49:55.302148+0000","last_undegraded":"2023-12-17T11:49:55.302148+0000","last_fullsized":"2023-12-17T11:49:55.302148+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T14:59:11.557660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"39'3","reported_seq":15,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-17T11:49:53.266858+0000","last_change":"2023-12-17T11:49:52.231475+0000","last_active":"2023-12-17T11:49:53.266858+0000","last_peered":"2023-12-17T11:49:53.266858+0000","last_clean":"2023-12-17T11:49:53.266858+0000","last_became_active":"2023-12-17T11:49:52.230061+0000","last_became_peered":"2023-12-17T11:49:52.230061+0000","last_unstale":"2023-12-17T11:49:53.266858+0000","last_undegraded":"2023-12-17T11:49:53.266858+0000","last_fullsized":"2023-12-17T11:49:53.266858+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_clean_scrub_stamp":"2023-12-17T11:49:51.168108+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T22:50:11.250530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:54.219863+0000","last_change":"2023-12-17T11:49:53.232224+0000","last_active":"2023-12-17T11:49:54.219863+0000","last_peered":"2023-12-17T11:49:54.219863+0000","last_clean":"2023-12-17T11:49:54.219863+0000","last_became_active":"2023-12-17T11:49:53.231963+0000","last_became_peered":"2023-12-17T11:49:53.231963+0000","last_unstale":"2023-12-17T11:49:54.219863+0000","last_undegraded":"2023-12-17T11:49:54.219863+0000","last_fullsized":"2023-12-17T11:49:54.219863+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T15:14:36.959400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"39'6","reported_seq":18,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-17T11:49:53.266491+0000","last_change":"2023-12-17T11:49:52.220583+0000","last_active":"2023-12-17T11:49:53.266491+0000","last_peered":"2023-12-17T11:49:53.266491+0000","last_clean":"2023-12-17T11:49:53.266491+0000","last_became_active":"2023-12-17T11:49:52.220304+0000","last_became_peered":"2023-12-17T11:49:52.220304+0000","last_unstale":"2023-12-17T11:49:53.266491+0000","last_undegraded":"2023-12-17T11:49:53.266491+0000","last_fullsized":"2023-12-17T11:49:53.266491+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_clean_scrub_stamp":"2023-12-17T11:49:51.168108+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T12:27:37.121319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:55.301511+0000","last_change":"2023-12-17T11:49:53.248442+0000","last_active":"2023-12-17T11:49:55.301511+0000","last_peered":"2023-12-17T11:49:55.301511+0000","last_clean":"2023-12-17T11:49:55.301511+0000","last_became_active":"2023-12-17T11:49:53.248094+0000","last_became_peered":"2023-12-17T11:49:53.248094+0000","last_unstale":"2023-12-17T11:49:55.301511+0000","last_undegraded":"2023-12-17T11:49:55.301511+0000","last_fullsized":"2023-12-17T11:49:55.301511+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T14:42:29.543380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"39'2","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-17T11:49:53.257236+0000","last_change":"2023-12-17T11:49:52.213341+0000","last_active":"2023-12-17T11:49:53.257236+0000","last_peered":"2023-12-17T11:49:53.257236+0000","last_clean":"2023-12-17T11:49:53.257236+0000","last_became_active":"2023-12-17T11:49:52.213024+0000","last_became_peered":"2023-12-17T11:49:52.213024+0000","last_unstale":"2023-12-17T11:49:53.257236+0000","last_undegraded":"2023-12-17T11:49:53.257236+0000","last_fullsized":"2023-12-17T11:49:53.257236+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_clean_scrub_stamp":"2023-12-17T11:49:51.168108+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T20:34:24.431589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:54.215271+0000","last_change":"2023-12-17T11:49:53.238931+0000","last_active":"2023-12-17T11:49:54.215271+0000","last_peered":"2023-12-17T11:49:54.215271+0000","last_clean":"2023-12-17T11:49:54.215271+0000","last_became_active":"2023-12-17T11:49:53.238641+0000","last_became_peered":"2023-12-17T11:49:53.238641+0000","last_unstale":"2023-12-17T11:49:54.215271+0000","last_undegraded":"2023-12-17T11:49:54.215271+0000","last_fullsized":"2023-12-17T11:49:54.215271+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T13:29:29.953615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-17T11:49:53.235553+0000","last_change":"2023-12-17T11:49:52.232507+0000","last_active":"2023-12-17T11:49:53.235553+0000","last_peered":"2023-12-17T11:49:53.235553+0000","last_clean":"2023-12-17T11:49:53.235553+0000","last_became_active":"2023-12-17T11:49:52.232308+0000","last_became_peered":"2023-12-17T11:49:52.232308+0000","last_unstale":"2023-12-17T11:49:53.235553+0000","last_undegraded":"2023-12-17T11:49:53.235553+0000","last_fullsized":"2023-12-17T11:49:53.235553+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_clean_scrub_stamp":"2023-12-17T11:49:51.168108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T19:17:46.282779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:55.301864+0000","last_change":"2023-12-17T11:49:53.234701+0000","last_active":"2023-12-17T11:49:55.301864+0000","last_peered":"2023-12-17T11:49:55.301864+0000","last_clean":"2023-12-17T11:49:55.301864+0000","last_became_active":"2023-12-17T11:49:53.234389+0000","last_became_peered":"2023-12-17T11:49:53.234389+0000","last_unstale":"2023-12-17T11:49:55.301864+0000","last_undegraded":"2023-12-17T11:49:55.301864+0000","last_fullsized":"2023-12-17T11:49:55.301864+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T17:54:34.803705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-17T11:49:53.225579+0000","last_change":"2023-12-17T11:49:52.226465+0000","last_active":"2023-12-17T11:49:53.225579+0000","last_peered":"2023-12-17T11:49:53.225579+0000","last_clean":"2023-12-17T11:49:53.225579+0000","last_became_active":"2023-12-17T11:49:52.226191+0000","last_became_peered":"2023-12-17T11:49:52.226191+0000","last_unstale":"2023-12-17T11:49:53.225579+0000","last_undegraded":"2023-12-17T11:49:53.225579+0000","last_fullsized":"2023-12-17T11:49:53.225579+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_clean_scrub_stamp":"2023-12-17T11:49:51.168108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T18:03:39.554935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:54.215842+0000","last_change":"2023-12-17T11:49:53.254934+0000","last_active":"2023-12-17T11:49:54.215842+0000","last_peered":"2023-12-17T11:49:54.215842+0000","last_clean":"2023-12-17T11:49:54.215842+0000","last_became_active":"2023-12-17T11:49:53.254632+0000","last_became_peered":"2023-12-17T11:49:53.254632+0000","last_unstale":"2023-12-17T11:49:54.215842+0000","last_undegraded":"2023-12-17T11:49:54.215842+0000","last_fullsized":"2023-12-17T11:49:54.215842+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T23:33:06.562683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"39'8","reported_seq":20,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:55.301546+0000","last_change":"2023-12-17T11:49:52.226787+0000","last_active":"2023-12-17T11:49:55.301546+0000","last_peered":"2023-12-17T11:49:55.301546+0000","last_clean":"2023-12-17T11:49:55.301546+0000","last_became_active":"2023-12-17T11:49:52.226471+0000","last_became_peered":"2023-12-17T11:49:52.226471+0000","last_unstale":"2023-12-17T11:49:55.301546+0000","last_undegraded":"2023-12-17T11:49:55.301546+0000","last_fullsized":"2023-12-17T11:49:55.301546+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_clean_scrub_stamp":"2023-12-17T11:49:51.168108+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T17:27:58.587187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:54.216316+0000","last_change":"2023-12-17T11:49:53.253979+0000","last_active":"2023-12-17T11:49:54.216316+0000","last_peered":"2023-12-17T11:49:54.216316+0000","last_clean":"2023-12-17T11:49:54.216316+0000","last_became_active":"2023-12-17T11:49:53.253694+0000","last_became_peered":"2023-12-17T11:49:53.253694+0000","last_unstale":"2023-12-17T11:49:54.216316+0000","last_undegraded":"2023-12-17T11:49:54.216316+0000","last_fullsized":"2023-12-17T11:49:54.216316+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T19:26:47.162716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"39'1","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-17T11:49:53.262591+0000","last_change":"2023-12-17T11:49:52.231973+0000","last_active":"2023-12-17T11:49:53.262591+0000","last_peered":"2023-12-17T11:49:53.262591+0000","last_clean":"2023-12-17T11:49:53.262591+0000","last_became_active":"2023-12-17T11:49:52.231641+0000","last_became_peered":"2023-12-17T11:49:52.231641+0000","last_unstale":"2023-12-17T11:49:53.262591+0000","last_undegraded":"2023-12-17T11:49:53.262591+0000","last_fullsized":"2023-12-17T11:49:53.262591+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_clean_scrub_stamp":"2023-12-17T11:49:51.168108+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T20:34:24.431589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:55.304764+0000","last_change":"2023-12-17T11:49:53.253141+0000","last_active":"2023-12-17T11:49:55.304764+0000","last_peered":"2023-12-17T11:49:55.304764+0000","last_clean":"2023-12-17T11:49:55.304764+0000","last_became_active":"2023-12-17T11:49:53.252532+0000","last_became_peered":"2023-12-17T11:49:53.252532+0000","last_unstale":"2023-12-17T11:49:55.304764+0000","last_undegraded":"2023-12-17T11:49:55.304764+0000","last_fullsized":"2023-12-17T11:49:55.304764+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T22:42:15.785143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"39'2","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-17T11:49:53.263293+0000","last_change":"2023-12-17T11:49:52.230858+0000","last_active":"2023-12-17T11:49:53.263293+0000","last_peered":"2023-12-17T11:49:53.263293+0000","last_clean":"2023-12-17T11:49:53.263293+0000","last_became_active":"2023-12-17T11:49:52.230281+0000","last_became_peered":"2023-12-17T11:49:52.230281+0000","last_unstale":"2023-12-17T11:49:53.263293+0000","last_undegraded":"2023-12-17T11:49:53.263293+0000","last_fullsized":"2023-12-17T11:49:53.263293+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_clean_scrub_stamp":"2023-12-17T11:49:51.168108+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T22:39:30.094160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:54.220095+0000","last_change":"2023-12-17T11:49:53.251192+0000","last_active":"2023-12-17T11:49:54.220095+0000","last_peered":"2023-12-17T11:49:54.220095+0000","last_clean":"2023-12-17T11:49:54.220095+0000","last_became_active":"2023-12-17T11:49:53.250837+0000","last_became_peered":"2023-12-17T11:49:53.250837+0000","last_unstale":"2023-12-17T11:49:54.220095+0000","last_undegraded":"2023-12-17T11:49:54.220095+0000","last_fullsized":"2023-12-17T11:49:54.220095+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T14:42:29.543380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"39'1","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-17T11:49:53.251855+0000","last_change":"2023-12-17T11:49:52.222238+0000","last_active":"2023-12-17T11:49:53.251855+0000","last_peered":"2023-12-17T11:49:53.251855+0000","last_clean":"2023-12-17T11:49:53.251855+0000","last_became_active":"2023-12-17T11:49:52.221941+0000","last_became_peered":"2023-12-17T11:49:52.221941+0000","last_unstale":"2023-12-17T11:49:53.251855+0000","last_undegraded":"2023-12-17T11:49:53.251855+0000","last_fullsized":"2023-12-17T11:49:53.251855+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_clean_scrub_stamp":"2023-12-17T11:49:51.168108+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T12:43:47.651883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:55.301176+0000","last_change":"2023-12-17T11:49:53.253162+0000","last_active":"2023-12-17T11:49:55.301176+0000","last_peered":"2023-12-17T11:49:55.301176+0000","last_clean":"2023-12-17T11:49:55.301176+0000","last_became_active":"2023-12-17T11:49:53.252770+0000","last_became_peered":"2023-12-17T11:49:53.252770+0000","last_unstale":"2023-12-17T11:49:55.301176+0000","last_undegraded":"2023-12-17T11:49:55.301176+0000","last_fullsized":"2023-12-17T11:49:55.301176+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T14:03:09.358474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-17T11:49:53.237157+0000","last_change":"2023-12-17T11:49:52.223776+0000","last_active":"2023-12-17T11:49:53.237157+0000","last_peered":"2023-12-17T11:49:53.237157+0000","last_clean":"2023-12-17T11:49:53.237157+0000","last_became_active":"2023-12-17T11:49:52.223571+0000","last_became_peered":"2023-12-17T11:49:52.223571+0000","last_unstale":"2023-12-17T11:49:53.237157+0000","last_undegraded":"2023-12-17T11:49:53.237157+0000","last_fullsized":"2023-12-17T11:49:53.237157+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_clean_scrub_stamp":"2023-12-17T11:49:51.168108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T22:59:00.390569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:55.301868+0000","last_change":"2023-12-17T11:49:53.232411+0000","last_active":"2023-12-17T11:49:55.301868+0000","last_peered":"2023-12-17T11:49:55.301868+0000","last_clean":"2023-12-17T11:49:55.301868+0000","last_became_active":"2023-12-17T11:49:53.232101+0000","last_became_peered":"2023-12-17T11:49:53.232101+0000","last_unstale":"2023-12-17T11:49:55.301868+0000","last_undegraded":"2023-12-17T11:49:55.301868+0000","last_fullsized":"2023-12-17T11:49:55.301868+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T11:57:59.882385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"39'2","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-17T11:49:53.249936+0000","last_change":"2023-12-17T11:49:52.210836+0000","last_active":"2023-12-17T11:49:53.249936+0000","last_peered":"2023-12-17T11:49:53.249936+0000","last_clean":"2023-12-17T11:49:53.249936+0000","last_became_active":"2023-12-17T11:49:52.210521+0000","last_became_peered":"2023-12-17T11:49:52.210521+0000","last_unstale":"2023-12-17T11:49:53.249936+0000","last_undegraded":"2023-12-17T11:49:53.249936+0000","last_fullsized":"2023-12-17T11:49:53.249936+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_clean_scrub_stamp":"2023-12-17T11:49:51.168108+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T17:20:36.726376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:55.301913+0000","last_change":"2023-12-17T11:49:53.243230+0000","last_active":"2023-12-17T11:49:55.301913+0000","last_peered":"2023-12-17T11:49:55.301913+0000","last_clean":"2023-12-17T11:49:55.301913+0000","last_became_active":"2023-12-17T11:49:53.242951+0000","last_became_peered":"2023-12-17T11:49:53.242951+0000","last_unstale":"2023-12-17T11:49:55.301913+0000","last_undegraded":"2023-12-17T11:49:55.301913+0000","last_fullsized":"2023-12-17T11:49:55.301913+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T18:42:00.093282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-17T11:49:53.213946+0000","last_change":"2023-12-17T11:49:52.217136+0000","last_active":"2023-12-17T11:49:53.213946+0000","last_peered":"2023-12-17T11:49:53.213946+0000","last_clean":"2023-12-17T11:49:53.213946+0000","last_became_active":"2023-12-17T11:49:52.216921+0000","last_became_peered":"2023-12-17T11:49:52.216921+0000","last_unstale":"2023-12-17T11:49:53.213946+0000","last_undegraded":"2023-12-17T11:49:53.213946+0000","last_fullsized":"2023-12-17T11:49:53.213946+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_clean_scrub_stamp":"2023-12-17T11:49:51.168108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T19:32:12.805680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:55.303952+0000","last_change":"2023-12-17T11:49:53.255643+0000","last_active":"2023-12-17T11:49:55.303952+0000","last_peered":"2023-12-17T11:49:55.303952+0000","last_clean":"2023-12-17T11:49:55.303952+0000","last_became_active":"2023-12-17T11:49:53.255379+0000","last_became_peered":"2023-12-17T11:49:53.255379+0000","last_unstale":"2023-12-17T11:49:55.303952+0000","last_undegraded":"2023-12-17T11:49:55.303952+0000","last_fullsized":"2023-12-17T11:49:55.303952+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T16:21:14.355302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:55.301924+0000","last_change":"2023-12-17T11:49:52.229883+0000","last_active":"2023-12-17T11:49:55.301924+0000","last_peered":"2023-12-17T11:49:55.301924+0000","last_clean":"2023-12-17T11:49:55.301924+0000","last_became_active":"2023-12-17T11:49:52.229372+0000","last_became_peered":"2023-12-17T11:49:52.229372+0000","last_unstale":"2023-12-17T11:49:55.301924+0000","last_undegraded":"2023-12-17T11:49:55.301924+0000","last_fullsized":"2023-12-17T11:49:55.301924+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_clean_scrub_stamp":"2023-12-17T11:49:51.168108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T23:27:59.830582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:54.216247+0000","last_change":"2023-12-17T11:49:53.249227+0000","last_active":"2023-12-17T11:49:54.216247+0000","last_peered":"2023-12-17T11:49:54.216247+0000","last_clean":"2023-12-17T11:49:54.216247+0000","last_became_active":"2023-12-17T11:49:53.248594+0000","last_became_peered":"2023-12-17T11:49:53.248594+0000","last_unstale":"2023-12-17T11:49:54.216247+0000","last_undegraded":"2023-12-17T11:49:54.216247+0000","last_fullsized":"2023-12-17T11:49:54.216247+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T14:31:17.752657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-17T11:49:53.214329+0000","last_change":"2023-12-17T11:49:52.211707+0000","last_active":"2023-12-17T11:49:53.214329+0000","last_peered":"2023-12-17T11:49:53.214329+0000","last_clean":"2023-12-17T11:49:53.214329+0000","last_became_active":"2023-12-17T11:49:52.211283+0000","last_became_peered":"2023-12-17T11:49:52.211283+0000","last_unstale":"2023-12-17T11:49:53.214329+0000","last_undegraded":"2023-12-17T11:49:53.214329+0000","last_fullsized":"2023-12-17T11:49:53.214329+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_clean_scrub_stamp":"2023-12-17T11:49:51.168108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T12:54:05.203029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:54.557245+0000","last_change":"2023-12-17T11:49:53.255235+0000","last_active":"2023-12-17T11:49:54.557245+0000","last_peered":"2023-12-17T11:49:54.557245+0000","last_clean":"2023-12-17T11:49:54.557245+0000","last_became_active":"2023-12-17T11:49:53.254570+0000","last_became_peered":"2023-12-17T11:49:53.254570+0000","last_unstale":"2023-12-17T11:49:54.557245+0000","last_undegraded":"2023-12-17T11:49:54.557245+0000","last_fullsized":"2023-12-17T11:49:54.557245+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T15:14:36.959400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"39'2","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-17T11:49:53.264259+0000","last_change":"2023-12-17T11:49:52.229686+0000","last_active":"2023-12-17T11:49:53.264259+0000","last_peered":"2023-12-17T11:49:53.264259+0000","last_clean":"2023-12-17T11:49:53.264259+0000","last_became_active":"2023-12-17T11:49:52.229401+0000","last_became_peered":"2023-12-17T11:49:52.229401+0000","last_unstale":"2023-12-17T11:49:53.264259+0000","last_undegraded":"2023-12-17T11:49:53.264259+0000","last_fullsized":"2023-12-17T11:49:53.264259+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_clean_scrub_stamp":"2023-12-17T11:49:51.168108+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T17:03:59.637357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:55.302996+0000","last_change":"2023-12-17T11:49:53.236908+0000","last_active":"2023-12-17T11:49:55.302996+0000","last_peered":"2023-12-17T11:49:55.302996+0000","last_clean":"2023-12-17T11:49:55.302996+0000","last_became_active":"2023-12-17T11:49:53.236508+0000","last_became_peered":"2023-12-17T11:49:53.236508+0000","last_unstale":"2023-12-17T11:49:55.302996+0000","last_undegraded":"2023-12-17T11:49:55.302996+0000","last_fullsized":"2023-12-17T11:49:55.302996+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T13:59:52.939825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-17T11:49:53.214338+0000","last_change":"2023-12-17T11:49:52.229067+0000","last_active":"2023-12-17T11:49:53.214338+0000","last_peered":"2023-12-17T11:49:53.214338+0000","last_clean":"2023-12-17T11:49:53.214338+0000","last_became_active":"2023-12-17T11:49:52.228704+0000","last_became_peered":"2023-12-17T11:49:52.228704+0000","last_unstale":"2023-12-17T11:49:53.214338+0000","last_undegraded":"2023-12-17T11:49:53.214338+0000","last_fullsized":"2023-12-17T11:49:53.214338+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_clean_scrub_stamp":"2023-12-17T11:49:51.168108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T16:31:06.129915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:54.215950+0000","last_change":"2023-12-17T11:49:53.246415+0000","last_active":"2023-12-17T11:49:54.215950+0000","last_peered":"2023-12-17T11:49:54.215950+0000","last_clean":"2023-12-17T11:49:54.215950+0000","last_became_active":"2023-12-17T11:49:53.246163+0000","last_became_peered":"2023-12-17T11:49:53.246163+0000","last_unstale":"2023-12-17T11:49:54.215950+0000","last_undegraded":"2023-12-17T11:49:54.215950+0000","last_fullsized":"2023-12-17T11:49:54.215950+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T17:56:09.285369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-17T11:49:53.231773+0000","last_change":"2023-12-17T11:49:52.219865+0000","last_active":"2023-12-17T11:49:53.231773+0000","last_peered":"2023-12-17T11:49:53.231773+0000","last_clean":"2023-12-17T11:49:53.231773+0000","last_became_active":"2023-12-17T11:49:52.219593+0000","last_became_peered":"2023-12-17T11:49:52.219593+0000","last_unstale":"2023-12-17T11:49:53.231773+0000","last_undegraded":"2023-12-17T11:49:53.231773+0000","last_fullsized":"2023-12-17T11:49:53.231773+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_clean_scrub_stamp":"2023-12-17T11:49:51.168108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T15:14:35.947970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:55.301732+0000","last_change":"2023-12-17T11:49:53.242876+0000","last_active":"2023-12-17T11:49:55.301732+0000","last_peered":"2023-12-17T11:49:55.301732+0000","last_clean":"2023-12-17T11:49:55.301732+0000","last_became_active":"2023-12-17T11:49:53.242568+0000","last_became_peered":"2023-12-17T11:49:53.242568+0000","last_unstale":"2023-12-17T11:49:55.301732+0000","last_undegraded":"2023-12-17T11:49:55.301732+0000","last_fullsized":"2023-12-17T11:49:55.301732+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T23:10:56.100255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-17T11:49:53.222858+0000","last_change":"2023-12-17T11:49:52.223424+0000","last_active":"2023-12-17T11:49:53.222858+0000","last_peered":"2023-12-17T11:49:53.222858+0000","last_clean":"2023-12-17T11:49:53.222858+0000","last_became_active":"2023-12-17T11:49:52.223126+0000","last_became_peered":"2023-12-17T11:49:52.223126+0000","last_unstale":"2023-12-17T11:49:53.222858+0000","last_undegraded":"2023-12-17T11:49:53.222858+0000","last_fullsized":"2023-12-17T11:49:53.222858+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_clean_scrub_stamp":"2023-12-17T11:49:51.168108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T14:31:59.450792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:54.556719+0000","last_change":"2023-12-17T11:49:53.251516+0000","last_active":"2023-12-17T11:49:54.556719+0000","last_peered":"2023-12-17T11:49:54.556719+0000","last_clean":"2023-12-17T11:49:54.556719+0000","last_became_active":"2023-12-17T11:49:53.251230+0000","last_became_peered":"2023-12-17T11:49:53.251230+0000","last_unstale":"2023-12-17T11:49:54.556719+0000","last_undegraded":"2023-12-17T11:49:54.556719+0000","last_fullsized":"2023-12-17T11:49:54.556719+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T19:39:18.340154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-17T11:49:53.227940+0000","last_change":"2023-12-17T11:49:52.219807+0000","last_active":"2023-12-17T11:49:53.227940+0000","last_peered":"2023-12-17T11:49:53.227940+0000","last_clean":"2023-12-17T11:49:53.227940+0000","last_became_active":"2023-12-17T11:49:52.219503+0000","last_became_peered":"2023-12-17T11:49:52.219503+0000","last_unstale":"2023-12-17T11:49:53.227940+0000","last_undegraded":"2023-12-17T11:49:53.227940+0000","last_fullsized":"2023-12-17T11:49:53.227940+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_clean_scrub_stamp":"2023-12-17T11:49:51.168108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T18:07:09.094032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:54.219300+0000","last_change":"2023-12-17T11:49:53.241750+0000","last_active":"2023-12-17T11:49:54.219300+0000","last_peered":"2023-12-17T11:49:54.219300+0000","last_clean":"2023-12-17T11:49:54.219300+0000","last_became_active":"2023-12-17T11:49:53.241529+0000","last_became_peered":"2023-12-17T11:49:53.241529+0000","last_unstale":"2023-12-17T11:49:54.219300+0000","last_undegraded":"2023-12-17T11:49:54.219300+0000","last_fullsized":"2023-12-17T11:49:54.219300+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T16:31:53.964205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-17T11:49:53.226908+0000","last_change":"2023-12-17T11:49:52.216579+0000","last_active":"2023-12-17T11:49:53.226908+0000","last_peered":"2023-12-17T11:49:53.226908+0000","last_clean":"2023-12-17T11:49:53.226908+0000","last_became_active":"2023-12-17T11:49:52.216265+0000","last_became_peered":"2023-12-17T11:49:52.216265+0000","last_unstale":"2023-12-17T11:49:53.226908+0000","last_undegraded":"2023-12-17T11:49:53.226908+0000","last_fullsized":"2023-12-17T11:49:53.226908+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_clean_scrub_stamp":"2023-12-17T11:49:51.168108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T14:31:59.450792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:55.302580+0000","last_change":"2023-12-17T11:49:53.234303+0000","last_active":"2023-12-17T11:49:55.302580+0000","last_peered":"2023-12-17T11:49:55.302580+0000","last_clean":"2023-12-17T11:49:55.302580+0000","last_became_active":"2023-12-17T11:49:53.233951+0000","last_became_peered":"2023-12-17T11:49:53.233951+0000","last_unstale":"2023-12-17T11:49:55.302580+0000","last_undegraded":"2023-12-17T11:49:55.302580+0000","last_fullsized":"2023-12-17T11:49:55.302580+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T19:17:38.569694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-17T11:49:53.240610+0000","last_change":"2023-12-17T11:49:52.219957+0000","last_active":"2023-12-17T11:49:53.240610+0000","last_peered":"2023-12-17T11:49:53.240610+0000","last_clean":"2023-12-17T11:49:53.240610+0000","last_became_active":"2023-12-17T11:49:52.219626+0000","last_became_peered":"2023-12-17T11:49:52.219626+0000","last_unstale":"2023-12-17T11:49:53.240610+0000","last_undegraded":"2023-12-17T11:49:53.240610+0000","last_fullsized":"2023-12-17T11:49:53.240610+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_clean_scrub_stamp":"2023-12-17T11:49:51.168108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T19:12:11.016281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:55.305069+0000","last_change":"2023-12-17T11:49:53.253151+0000","last_active":"2023-12-17T11:49:55.305069+0000","last_peered":"2023-12-17T11:49:55.305069+0000","last_clean":"2023-12-17T11:49:55.305069+0000","last_became_active":"2023-12-17T11:49:53.252842+0000","last_became_peered":"2023-12-17T11:49:53.252842+0000","last_unstale":"2023-12-17T11:49:55.305069+0000","last_undegraded":"2023-12-17T11:49:55.305069+0000","last_fullsized":"2023-12-17T11:49:55.305069+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T14:31:17.752657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:55.302520+0000","last_change":"2023-12-17T11:49:52.228110+0000","last_active":"2023-12-17T11:49:55.302520+0000","last_peered":"2023-12-17T11:49:55.302520+0000","last_clean":"2023-12-17T11:49:55.302520+0000","last_became_active":"2023-12-17T11:49:52.227851+0000","last_became_peered":"2023-12-17T11:49:52.227851+0000","last_unstale":"2023-12-17T11:49:55.302520+0000","last_undegraded":"2023-12-17T11:49:55.302520+0000","last_fullsized":"2023-12-17T11:49:55.302520+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_clean_scrub_stamp":"2023-12-17T11:49:51.168108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T18:37:20.380970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":180,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-17T11:49:53.217829+0000","last_change":"2023-12-17T11:48:07.952584+0000","last_active":"2023-12-17T11:49:53.217829+0000","last_peered":"2023-12-17T11:49:53.217829+0000","last_clean":"2023-12-17T11:49:53.217829+0000","last_became_active":"2023-12-17T11:48:07.950361+0000","last_became_peered":"2023-12-17T11:48:07.950361+0000","last_unstale":"2023-12-17T11:49:53.217829+0000","last_undegraded":"2023-12-17T11:49:53.217829+0000","last_fullsized":"2023-12-17T11:49:53.217829+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:06.728199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:06.728199+0000","last_clean_scrub_stamp":"2023-12-17T11:48:06.728199+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T12:47:55.048065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542170,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28064,"kb_used_data":1044,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343776,"statfs":{"total":96636764160,"available":96608026624,"internally_reserved":0,"allocated":1069056,"data_stored":789626,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 17 11:49:06 2023","interfaces":[{"interface":"back","average":{"1min":1.407,"5min":1.407,"15min":1.407},"min":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":8.6579999999999995,"5min":8.6579999999999995,"15min":8.6579999999999995},"last":1.159},{"interface":"front","average":{"1min":1.339,"5min":1.339,"15min":1.339},"min":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"max":{"1min":4.0830000000000002,"5min":4.0830000000000002,"15min":4.0830000000000002},"last":1.3580000000000001}]},{"osd":1,"last update":"Sun Dec 17 11:49:06 2023","interfaces":[{"interface":"back","average":{"1min":1.127,"5min":1.127,"15min":1.127},"min":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"max":{"1min":2.1539999999999999,"5min":2.1539999999999999,"15min":2.1539999999999999},"last":1.409},{"interface":"front","average":{"1min":1.413,"5min":1.413,"15min":1.413},"min":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"max":{"1min":8.7449999999999992,"5min":8.7449999999999992,"15min":8.7449999999999992},"last":0.82999999999999996}]},{"osd":2,"last update":"Sun Dec 17 11:49:06 2023","interfaces":[{"interface":"back","average":{"1min":1.4299999999999999,"5min":1.4299999999999999,"15min":1.4299999999999999},"min":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"max":{"1min":4.1239999999999997,"5min":4.1239999999999997,"15min":4.1239999999999997},"last":1.548},{"interface":"front","average":{"1min":1.3720000000000001,"5min":1.3720000000000001,"15min":1.3720000000000001},"min":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"max":{"1min":1.782,"5min":1.782,"15min":1.782},"last":1.7150000000000001}]},{"osd":3,"last update":"Sun Dec 17 11:49:06 2023","interfaces":[{"interface":"back","average":{"1min":1.298,"5min":1.298,"15min":1.298},"min":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"max":{"1min":2.5430000000000001,"5min":2.5430000000000001,"15min":2.5430000000000001},"last":1.218},{"interface":"front","average":{"1min":1.375,"5min":1.375,"15min":1.375},"min":{"1min":1.087,"5min":1.087,"15min":1.087},"max":{"1min":2.5830000000000002,"5min":2.5830000000000002,"15min":2.5830000000000002},"last":1.595}]},{"osd":4,"last update":"Sun Dec 17 11:49:06 2023","interfaces":[{"interface":"back","average":{"1min":1.3859999999999999,"5min":1.3859999999999999,"15min":1.3859999999999999},"min":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":4.0309999999999997,"5min":4.0309999999999997,"15min":4.0309999999999997},"last":1.115},{"interface":"front","average":{"1min":1.5860000000000001,"5min":1.5860000000000001,"15min":1.5860000000000001},"min":{"1min":1.2230000000000001,"5min":1.2230000000000001,"15min":1.2230000000000001},"max":{"1min":3.3220000000000001,"5min":3.3220000000000001,"15min":3.3220000000000001},"last":1.659}]},{"osd":5,"last update":"Sun Dec 17 11:49:06 2023","interfaces":[{"interface":"back","average":{"1min":1.6970000000000001,"5min":1.6970000000000001,"15min":1.6970000000000001},"min":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"max":{"1min":8.7929999999999993,"5min":8.7929999999999993,"15min":8.7929999999999993},"last":1.3109999999999999},{"interface":"front","average":{"1min":1.6859999999999999,"5min":1.6859999999999999,"15min":1.6859999999999999},"min":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"max":{"1min":5.1040000000000001,"5min":5.1040000000000001,"15min":5.1040000000000001},"last":1.6200000000000001}]},{"osd":6,"last update":"Sun Dec 17 11:49:06 2023","interfaces":[{"interface":"back","average":{"1min":1.845,"5min":1.845,"15min":1.845},"min":{"1min":1.081,"5min":1.081,"15min":1.081},"max":{"1min":8.8330000000000002,"5min":8.8330000000000002,"15min":8.8330000000000002},"last":1.498},{"interface":"front","average":{"1min":1.71,"5min":1.71,"15min":1.71},"min":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"max":{"1min":3.9590000000000001,"5min":3.9590000000000001,"15min":3.9590000000000001},"last":1.4630000000000001}]}]},{"osd":6,"up_from":14,"seq":60129542170,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27480,"kb_used_data":452,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344360,"statfs":{"total":96636764160,"available":96608624640,"internally_reserved":0,"allocated":462848,"data_stored":198158,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 17 11:49:06 2023","interfaces":[{"interface":"back","average":{"1min":1.0720000000000001,"5min":1.0720000000000001,"15min":1.0720000000000001},"min":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.5840000000000001,"5min":1.5840000000000001,"15min":1.5840000000000001},"last":1.2370000000000001},{"interface":"front","average":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"min":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"max":{"1min":1.429,"5min":1.429,"15min":1.429},"last":1.1000000000000001}]},{"osd":1,"last update":"Sun Dec 17 11:49:06 2023","interfaces":[{"interface":"back","average":{"1min":1.2689999999999999,"5min":1.2689999999999999,"15min":1.2689999999999999},"min":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"max":{"1min":1.5640000000000001,"5min":1.5640000000000001,"15min":1.5640000000000001},"last":1.2},{"interface":"front","average":{"1min":1.3169999999999999,"5min":1.3169999999999999,"15min":1.3169999999999999},"min":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"max":{"1min":1.9359999999999999,"5min":1.9359999999999999,"15min":1.9359999999999999},"last":1.0249999999999999}]},{"osd":2,"last update":"Sun Dec 17 11:49:06 2023","interfaces":[{"interface":"back","average":{"1min":1.1970000000000001,"5min":1.1970000000000001,"15min":1.1970000000000001},"min":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":1.8740000000000001,"5min":1.8740000000000001,"15min":1.8740000000000001},"last":0.96899999999999997},{"interface":"front","average":{"1min":1.296,"5min":1.296,"15min":1.296},"min":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":2.5470000000000002,"5min":2.5470000000000002,"15min":2.5470000000000002},"last":0.82499999999999996}]},{"osd":3,"last update":"Sun Dec 17 11:49:06 2023","interfaces":[{"interface":"back","average":{"1min":1.508,"5min":1.508,"15min":1.508},"min":{"1min":1.0840000000000001,"5min":1.0840000000000001,"15min":1.0840000000000001},"max":{"1min":2.4689999999999999,"5min":2.4689999999999999,"15min":2.4689999999999999},"last":1.2949999999999999},{"interface":"front","average":{"1min":1.4390000000000001,"5min":1.4390000000000001,"15min":1.4390000000000001},"min":{"1min":0.88,"5min":0.88,"15min":0.88},"max":{"1min":2.0680000000000001,"5min":2.0680000000000001,"15min":2.0680000000000001},"last":1.427}]},{"osd":4,"last update":"Sun Dec 17 11:49:06 2023","interfaces":[{"interface":"back","average":{"1min":1.522,"5min":1.522,"15min":1.522},"min":{"1min":1.1419999999999999,"5min":1.1419999999999999,"15min":1.1419999999999999},"max":{"1min":2.222,"5min":2.222,"15min":2.222},"last":1.645},{"interface":"front","average":{"1min":1.4419999999999999,"5min":1.4419999999999999,"15min":1.4419999999999999},"min":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":0.90700000000000003},"max":{"1min":2.4079999999999999,"5min":2.4079999999999999,"15min":2.4079999999999999},"last":1.486}]},{"osd":5,"last update":"Sun Dec 17 11:49:06 2023","interfaces":[{"interface":"back","average":{"1min":1.548,"5min":1.548,"15min":1.548},"min":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"max":{"1min":2.3319999999999999,"5min":2.3319999999999999,"15min":2.3319999999999999},"last":1.72},{"interface":"front","average":{"1min":1.5760000000000001,"5min":1.5760000000000001,"15min":1.5760000000000001},"min":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"max":{"1min":2.6760000000000002,"5min":2.6760000000000002,"15min":2.6760000000000002},"last":1.532}]},{"osd":7,"last update":"Sun Dec 17 11:49:06 2023","interfaces":[{"interface":"back","average":{"1min":1.419,"5min":1.419,"15min":1.419},"min":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"max":{"1min":2.1560000000000001,"5min":2.1560000000000001,"15min":2.1560000000000001},"last":1.343},{"interface":"front","average":{"1min":1.712,"5min":1.712,"15min":1.712},"min":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"max":{"1min":2.6059999999999999,"5min":2.6059999999999999,"15min":2.6059999999999999},"last":1.8700000000000001}]}]},{"osd":5,"up_from":14,"seq":60129542169,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27476,"kb_used_data":456,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344364,"statfs":{"total":96636764160,"available":96608628736,"internally_reserved":0,"allocated":466944,"data_stored":197688,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 17 11:49:09 2023","interfaces":[{"interface":"back","average":{"1min":1.101,"5min":1.101,"15min":1.101},"min":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":1.5860000000000001,"5min":1.5860000000000001,"15min":1.5860000000000001},"last":0.69999999999999996},{"interface":"front","average":{"1min":1.23,"5min":1.23,"15min":1.23},"min":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"max":{"1min":1.9419999999999999,"5min":1.9419999999999999,"15min":1.9419999999999999},"last":0.63500000000000001}]},{"osd":1,"last update":"Sun Dec 17 11:49:09 2023","interfaces":[{"interface":"back","average":{"1min":1.167,"5min":1.167,"15min":1.167},"min":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"max":{"1min":1.5289999999999999,"5min":1.5289999999999999,"15min":1.5289999999999999},"last":0.78300000000000003},{"interface":"front","average":{"1min":1.216,"5min":1.216,"15min":1.216},"min":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"max":{"1min":1.8660000000000001,"5min":1.8660000000000001,"15min":1.8660000000000001},"last":0.97399999999999998}]},{"osd":2,"last update":"Sun Dec 17 11:49:09 2023","interfaces":[{"interface":"back","average":{"1min":1.3140000000000001,"5min":1.3140000000000001,"15min":1.3140000000000001},"min":{"1min":0.747,"5min":0.747,"15min":0.747},"max":{"1min":2.1589999999999998,"5min":2.1589999999999998,"15min":2.1589999999999998},"last":0.751},{"interface":"front","average":{"1min":1.3919999999999999,"5min":1.3919999999999999,"15min":1.3919999999999999},"min":{"1min":1.0049999999999999,"5min":1.0049999999999999,"15min":1.0049999999999999},"max":{"1min":2.1379999999999999,"5min":2.1379999999999999,"15min":2.1379999999999999},"last":0.879}]},{"osd":3,"last update":"Sun Dec 17 11:49:09 2023","interfaces":[{"interface":"back","average":{"1min":1.337,"5min":1.337,"15min":1.337},"min":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"max":{"1min":2.593,"5min":2.593,"15min":2.593},"last":1.0600000000000001},{"interface":"front","average":{"1min":1.407,"5min":1.407,"15min":1.407},"min":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"max":{"1min":2.3079999999999998,"5min":2.3079999999999998,"15min":2.3079999999999998},"last":1.175}]},{"osd":4,"last update":"Sun Dec 17 11:49:09 2023","interfaces":[{"interface":"back","average":{"1min":1.5029999999999999,"5min":1.5029999999999999,"15min":1.5029999999999999},"min":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"max":{"1min":2.5299999999999998,"5min":2.5299999999999998,"15min":2.5299999999999998},"last":1.1100000000000001},{"interface":"front","average":{"1min":1.6879999999999999,"5min":1.6879999999999999,"15min":1.6879999999999999},"min":{"1min":1.0669999999999999,"5min":1.0669999999999999,"15min":1.0669999999999999},"max":{"1min":3.9569999999999999,"5min":3.9569999999999999,"15min":3.9569999999999999},"last":1.2849999999999999}]},{"osd":6,"last update":"Sun Dec 17 11:49:09 2023","interfaces":[{"interface":"back","average":{"1min":1.6619999999999999,"5min":1.6619999999999999,"15min":1.6619999999999999},"min":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"max":{"1min":2.9849999999999999,"5min":2.9849999999999999,"15min":2.9849999999999999},"last":1.6120000000000001},{"interface":"front","average":{"1min":1.6319999999999999,"5min":1.6319999999999999,"15min":1.6319999999999999},"min":{"1min":1.25,"5min":1.25,"15min":1.25},"max":{"1min":2.641,"5min":2.641,"15min":2.641},"last":1.4510000000000001}]},{"osd":7,"last update":"Sun Dec 17 11:49:09 2023","interfaces":[{"interface":"back","average":{"1min":1.8080000000000001,"5min":1.8080000000000001,"15min":1.8080000000000001},"min":{"1min":1.232,"5min":1.232,"15min":1.232},"max":{"1min":3.8570000000000002,"5min":3.8570000000000002,"15min":3.8570000000000002},"last":1.51},{"interface":"front","average":{"1min":1.827,"5min":1.827,"15min":1.827},"min":{"1min":1.137,"5min":1.137,"15min":1.137},"max":{"1min":2.8999999999999999,"5min":2.8999999999999999,"15min":2.8999999999999999},"last":1.5489999999999999}]}]},{"osd":4,"up_from":14,"seq":60129542170,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27484,"kb_used_data":456,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344356,"statfs":{"total":96636764160,"available":96608620544,"internally_reserved":0,"allocated":466944,"data_stored":198180,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 17 11:49:08 2023","interfaces":[{"interface":"back","average":{"1min":1.02,"5min":1.02,"15min":1.02},"min":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"max":{"1min":1.1890000000000001,"5min":1.1890000000000001,"15min":1.1890000000000001},"last":1.579},{"interface":"front","average":{"1min":1.167,"5min":1.167,"15min":1.167},"min":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"max":{"1min":2.6400000000000001,"5min":2.6400000000000001,"15min":2.6400000000000001},"last":0.94899999999999995}]},{"osd":1,"last update":"Sun Dec 17 11:49:08 2023","interfaces":[{"interface":"back","average":{"1min":1.0960000000000001,"5min":1.0960000000000001,"15min":1.0960000000000001},"min":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"max":{"1min":1.369,"5min":1.369,"15min":1.369},"last":1.198},{"interface":"front","average":{"1min":1.2669999999999999,"5min":1.2669999999999999,"15min":1.2669999999999999},"min":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"max":{"1min":1.631,"5min":1.631,"15min":1.631},"last":1.444}]},{"osd":2,"last update":"Sun Dec 17 11:49:08 2023","interfaces":[{"interface":"back","average":{"1min":1.393,"5min":1.393,"15min":1.393},"min":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"max":{"1min":1.8660000000000001,"5min":1.8660000000000001,"15min":1.8660000000000001},"last":0.90600000000000003},{"interface":"front","average":{"1min":1.329,"5min":1.329,"15min":1.329},"min":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"max":{"1min":1.968,"5min":1.968,"15min":1.968},"last":0.98499999999999999}]},{"osd":3,"last update":"Sun Dec 17 11:49:08 2023","interfaces":[{"interface":"back","average":{"1min":1.4410000000000001,"5min":1.4410000000000001,"15min":1.4410000000000001},"min":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"max":{"1min":3.2290000000000001,"5min":3.2290000000000001,"15min":3.2290000000000001},"last":1.1220000000000001},{"interface":"front","average":{"1min":1.496,"5min":1.496,"15min":1.496},"min":{"1min":1.1000000000000001,"5min":1.1000000000000001,"15min":1.1000000000000001},"max":{"1min":2.0169999999999999,"5min":2.0169999999999999,"15min":2.0169999999999999},"last":1.3400000000000001}]},{"osd":5,"last update":"Sun Dec 17 11:49:08 2023","interfaces":[{"interface":"back","average":{"1min":1.474,"5min":1.474,"15min":1.474},"min":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"max":{"1min":2.141,"5min":2.141,"15min":2.141},"last":1.825},{"interface":"front","average":{"1min":1.7110000000000001,"5min":1.7110000000000001,"15min":1.7110000000000001},"min":{"1min":1.2390000000000001,"5min":1.2390000000000001,"15min":1.2390000000000001},"max":{"1min":3.8220000000000001,"5min":3.8220000000000001,"15min":3.8220000000000001},"last":1.2190000000000001}]},{"osd":6,"last update":"Sun Dec 17 11:49:08 2023","interfaces":[{"interface":"back","average":{"1min":1.7370000000000001,"5min":1.7370000000000001,"15min":1.7370000000000001},"min":{"1min":1.212,"5min":1.212,"15min":1.212},"max":{"1min":2.7410000000000001,"5min":2.7410000000000001,"15min":2.7410000000000001},"last":1.0680000000000001},{"interface":"front","average":{"1min":1.677,"5min":1.677,"15min":1.677},"min":{"1min":1.222,"5min":1.222,"15min":1.222},"max":{"1min":2.2989999999999999,"5min":2.2989999999999999,"15min":2.2989999999999999},"last":1.6859999999999999}]},{"osd":7,"last update":"Sun Dec 17 11:49:08 2023","interfaces":[{"interface":"back","average":{"1min":1.847,"5min":1.847,"15min":1.847},"min":{"1min":1.2749999999999999,"5min":1.2749999999999999,"15min":1.2749999999999999},"max":{"1min":3.944,"5min":3.944,"15min":3.944},"last":1.304},{"interface":"front","average":{"1min":1.8160000000000001,"5min":1.8160000000000001,"15min":1.8160000000000001},"min":{"1min":1.4239999999999999,"5min":1.4239999999999999,"15min":1.4239999999999999},"max":{"1min":2.8809999999999998,"5min":2.8809999999999998,"15min":2.8809999999999998},"last":1.2529999999999999}]}]},{"osd":3,"up_from":14,"seq":60129542169,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27492,"kb_used_data":464,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344348,"statfs":{"total":96636764160,"available":96608612352,"internally_reserved":0,"allocated":475136,"data_stored":199222,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 17 11:49:06 2023","interfaces":[{"interface":"back","average":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.6459999999999999,"5min":1.6459999999999999,"15min":1.6459999999999999},"last":0.83699999999999997},{"interface":"front","average":{"1min":1.0700000000000001,"5min":1.0700000000000001,"15min":1.0700000000000001},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":3.5800000000000001,"5min":3.5800000000000001,"15min":3.5800000000000001},"last":0.94499999999999995}]},{"osd":1,"last update":"Sun Dec 17 11:49:06 2023","interfaces":[{"interface":"back","average":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":1.4379999999999999,"5min":1.4379999999999999,"15min":1.4379999999999999},"last":1.1419999999999999},{"interface":"front","average":{"1min":1.1519999999999999,"5min":1.1519999999999999,"15min":1.1519999999999999},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":2.085,"5min":2.085,"15min":2.085},"last":0.71599999999999997}]},{"osd":2,"last update":"Sun Dec 17 11:49:06 2023","interfaces":[{"interface":"back","average":{"1min":1.1659999999999999,"5min":1.1659999999999999,"15min":1.1659999999999999},"min":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":1.651,"5min":1.651,"15min":1.651},"last":1.383},{"interface":"front","average":{"1min":1.2569999999999999,"5min":1.2569999999999999,"15min":1.2569999999999999},"min":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":2.1429999999999998,"5min":2.1429999999999998,"15min":2.1429999999999998},"last":1.585}]},{"osd":4,"last update":"Sun Dec 17 11:49:06 2023","interfaces":[{"interface":"back","average":{"1min":1.4330000000000001,"5min":1.4330000000000001,"15min":1.4330000000000001},"min":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"max":{"1min":2.4870000000000001,"5min":2.4870000000000001,"15min":2.4870000000000001},"last":1.4199999999999999},{"interface":"front","average":{"1min":1.476,"5min":1.476,"15min":1.476},"min":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"max":{"1min":2.3460000000000001,"5min":2.3460000000000001,"15min":2.3460000000000001},"last":1.3540000000000001}]},{"osd":5,"last update":"Sun Dec 17 11:49:06 2023","interfaces":[{"interface":"back","average":{"1min":1.476,"5min":1.476,"15min":1.476},"min":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"max":{"1min":2.5710000000000002,"5min":2.5710000000000002,"15min":2.5710000000000002},"last":1.6870000000000001},{"interface":"front","average":{"1min":1.5,"5min":1.5,"15min":1.5},"min":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"max":{"1min":2.383,"5min":2.383,"15min":2.383},"last":1.329}]},{"osd":6,"last update":"Sun Dec 17 11:49:06 2023","interfaces":[{"interface":"back","average":{"1min":1.474,"5min":1.474,"15min":1.474},"min":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"max":{"1min":2.6179999999999999,"5min":2.6179999999999999,"15min":2.6179999999999999},"last":1.2669999999999999},{"interface":"front","average":{"1min":1.5149999999999999,"5min":1.5149999999999999,"15min":1.5149999999999999},"min":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"max":{"1min":2.7679999999999998,"5min":2.7679999999999998,"15min":2.7679999999999998},"last":1.542}]},{"osd":7,"last update":"Sun Dec 17 11:49:06 2023","interfaces":[{"interface":"back","average":{"1min":1.581,"5min":1.581,"15min":1.581},"min":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"max":{"1min":3.7000000000000002,"5min":3.7000000000000002,"15min":3.7000000000000002},"last":1.6379999999999999},{"interface":"front","average":{"1min":1.579,"5min":1.579,"15min":1.579},"min":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":0.97099999999999997},"max":{"1min":2.427,"5min":2.427,"15min":2.427},"last":1.486}]}]},{"osd":2,"up_from":14,"seq":60129542170,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27472,"kb_used_data":452,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344368,"statfs":{"total":96636764160,"available":96608632832,"internally_reserved":0,"allocated":462848,"data_stored":197646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 17 11:49:07 2023","interfaces":[{"interface":"back","average":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":1.724,"5min":1.724,"15min":1.724},"last":1.659},{"interface":"front","average":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.502,"5min":1.502,"15min":1.502},"last":0.90500000000000003}]},{"osd":1,"last update":"Sun Dec 17 11:49:07 2023","interfaces":[{"interface":"back","average":{"1min":0.995,"5min":0.995,"15min":0.995},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.4790000000000001,"5min":1.4790000000000001,"15min":1.4790000000000001},"last":1.232},{"interface":"front","average":{"1min":1.056,"5min":1.056,"15min":1.056},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":2.6280000000000001,"5min":2.6280000000000001,"15min":2.6280000000000001},"last":1.0800000000000001}]},{"osd":3,"last update":"Sun Dec 17 11:49:07 2023","interfaces":[{"interface":"back","average":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.476,"5min":1.476,"15min":1.476},"last":0.96799999999999997},{"interface":"front","average":{"1min":1.214,"5min":1.214,"15min":1.214},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.9670000000000001,"5min":1.9670000000000001,"15min":1.9670000000000001},"last":1.4550000000000001}]},{"osd":4,"last update":"Sun Dec 17 11:49:07 2023","interfaces":[{"interface":"back","average":{"1min":1.49,"5min":1.49,"15min":1.49},"min":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"max":{"1min":2.5750000000000002,"5min":2.5750000000000002,"15min":2.5750000000000002},"last":1.8049999999999999},{"interface":"front","average":{"1min":1.3879999999999999,"5min":1.3879999999999999,"15min":1.3879999999999999},"min":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"max":{"1min":2.4940000000000002,"5min":2.4940000000000002,"15min":2.4940000000000002},"last":1.1519999999999999}]},{"osd":5,"last update":"Sun Dec 17 11:49:07 2023","interfaces":[{"interface":"back","average":{"1min":1.3240000000000001,"5min":1.3240000000000001,"15min":1.3240000000000001},"min":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"max":{"1min":2.4289999999999998,"5min":2.4289999999999998,"15min":2.4289999999999998},"last":1.506},{"interface":"front","average":{"1min":1.5489999999999999,"5min":1.5489999999999999,"15min":1.5489999999999999},"min":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"max":{"1min":2.694,"5min":2.694,"15min":2.694},"last":1.879}]},{"osd":6,"last update":"Sun Dec 17 11:49:07 2023","interfaces":[{"interface":"back","average":{"1min":1.472,"5min":1.472,"15min":1.472},"min":{"1min":0.748,"5min":0.748,"15min":0.748},"max":{"1min":2.7349999999999999,"5min":2.7349999999999999,"15min":2.7349999999999999},"last":1.7010000000000001},{"interface":"front","average":{"1min":1.4119999999999999,"5min":1.4119999999999999,"15min":1.4119999999999999},"min":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"max":{"1min":2.468,"5min":2.468,"15min":2.468},"last":1.302}]},{"osd":7,"last update":"Sun Dec 17 11:49:07 2023","interfaces":[{"interface":"back","average":{"1min":1.554,"5min":1.554,"15min":1.554},"min":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"max":{"1min":3.379,"5min":3.379,"15min":3.379},"last":1.774},{"interface":"front","average":{"1min":1.474,"5min":1.474,"15min":1.474},"min":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"max":{"1min":2.2869999999999999,"5min":2.2869999999999999,"15min":2.2869999999999999},"last":1.742}]}]},{"osd":1,"up_from":14,"seq":60129542169,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27480,"kb_used_data":452,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344360,"statfs":{"total":96636764160,"available":96608624640,"internally_reserved":0,"allocated":462848,"data_stored":197666,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 17 11:49:08 2023","interfaces":[{"interface":"back","average":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.5249999999999999,"5min":1.5249999999999999,"15min":1.5249999999999999},"last":0.71899999999999997},{"interface":"front","average":{"1min":1.113,"5min":1.113,"15min":1.113},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":2.6360000000000001,"5min":2.6360000000000001,"15min":2.6360000000000001},"last":0.81499999999999995}]},{"osd":2,"last update":"Sun Dec 17 11:49:08 2023","interfaces":[{"interface":"back","average":{"1min":1.202,"5min":1.202,"15min":1.202},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":2.8159999999999998,"5min":2.8159999999999998,"15min":2.8159999999999998},"last":0.63300000000000001},{"interface":"front","average":{"1min":1.462,"5min":1.462,"15min":1.462},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":3.101,"5min":3.101,"15min":3.101},"last":1.083}]},{"osd":3,"last update":"Sun Dec 17 11:49:08 2023","interfaces":[{"interface":"back","average":{"1min":1.48,"5min":1.48,"15min":1.48},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":2.7890000000000001,"5min":2.7890000000000001,"15min":2.7890000000000001},"last":1.3620000000000001},{"interface":"front","average":{"1min":1.278,"5min":1.278,"15min":1.278},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":3.1400000000000001,"5min":3.1400000000000001,"15min":3.1400000000000001},"last":1.228}]},{"osd":4,"last update":"Sun Dec 17 11:49:08 2023","interfaces":[{"interface":"back","average":{"1min":1.4350000000000001,"5min":1.4350000000000001,"15min":1.4350000000000001},"min":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":2.5289999999999999,"5min":2.5289999999999999,"15min":2.5289999999999999},"last":1.718},{"interface":"front","average":{"1min":1.363,"5min":1.363,"15min":1.363},"min":{"1min":0.627,"5min":0.627,"15min":0.627},"max":{"1min":2.0819999999999999,"5min":2.0819999999999999,"15min":2.0819999999999999},"last":1.508}]},{"osd":5,"last update":"Sun Dec 17 11:49:08 2023","interfaces":[{"interface":"back","average":{"1min":1.466,"5min":1.466,"15min":1.466},"min":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"max":{"1min":1.96,"5min":1.96,"15min":1.96},"last":1.419},{"interface":"front","average":{"1min":1.573,"5min":1.573,"15min":1.573},"min":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":2.6739999999999999,"5min":2.6739999999999999,"15min":2.6739999999999999},"last":1.758}]},{"osd":6,"last update":"Sun Dec 17 11:49:08 2023","interfaces":[{"interface":"back","average":{"1min":1.627,"5min":1.627,"15min":1.627},"min":{"1min":0.754,"5min":0.754,"15min":0.754},"max":{"1min":3.016,"5min":3.016,"15min":3.016},"last":1.5780000000000001},{"interface":"front","average":{"1min":1.5509999999999999,"5min":1.5509999999999999,"15min":1.5509999999999999},"min":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"max":{"1min":2.508,"5min":2.508,"15min":2.508},"last":1.5489999999999999}]},{"osd":7,"last update":"Sun Dec 17 11:49:08 2023","interfaces":[{"interface":"back","average":{"1min":1.6839999999999999,"5min":1.6839999999999999,"15min":1.6839999999999999},"min":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"max":{"1min":2.944,"5min":2.944,"15min":2.944},"last":1.8580000000000001},{"interface":"front","average":{"1min":1.7170000000000001,"5min":1.7170000000000001,"15min":1.7170000000000001},"min":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"max":{"1min":2.7709999999999999,"5min":2.7709999999999999,"15min":2.7709999999999999},"last":1.4690000000000001}]}]},{"osd":0,"up_from":14,"seq":60129542169,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32212,"kb_used_data":1032,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339628,"statfs":{"total":96636764160,"available":96603779072,"internally_reserved":0,"allocated":1056768,"data_stored":787978,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Dec 17 11:49:06 2023","interfaces":[{"interface":"back","average":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.3899999999999999,"5min":1.3899999999999999,"15min":1.3899999999999999},"last":1.0940000000000001},{"interface":"front","average":{"1min":1.1519999999999999,"5min":1.1519999999999999,"15min":1.1519999999999999},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":1.958,"5min":1.958,"15min":1.958},"last":1.04}]},{"osd":2,"last update":"Sun Dec 17 11:49:06 2023","interfaces":[{"interface":"back","average":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.7709999999999999,"5min":1.7709999999999999,"15min":1.7709999999999999},"last":1.222},{"interface":"front","average":{"1min":1.2090000000000001,"5min":1.2090000000000001,"15min":1.2090000000000001},"min":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":2.2130000000000001,"5min":2.2130000000000001,"15min":2.2130000000000001},"last":0.92700000000000005}]},{"osd":3,"last update":"Sun Dec 17 11:49:06 2023","interfaces":[{"interface":"back","average":{"1min":1.125,"5min":1.125,"15min":1.125},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.728,"5min":1.728,"15min":1.728},"last":0.81499999999999995},{"interface":"front","average":{"1min":1.4039999999999999,"5min":1.4039999999999999,"15min":1.4039999999999999},"min":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"max":{"1min":2.4809999999999999,"5min":2.4809999999999999,"15min":2.4809999999999999},"last":1.405}]},{"osd":4,"last update":"Sun Dec 17 11:49:06 2023","interfaces":[{"interface":"back","average":{"1min":1.518,"5min":1.518,"15min":1.518},"min":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"max":{"1min":4.6710000000000003,"5min":4.6710000000000003,"15min":4.6710000000000003},"last":1.573},{"interface":"front","average":{"1min":1.427,"5min":1.427,"15min":1.427},"min":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"max":{"1min":2.2799999999999998,"5min":2.2799999999999998,"15min":2.2799999999999998},"last":1.137}]},{"osd":5,"last update":"Sun Dec 17 11:49:06 2023","interfaces":[{"interface":"back","average":{"1min":1.5069999999999999,"5min":1.5069999999999999,"15min":1.5069999999999999},"min":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"max":{"1min":2.1349999999999998,"5min":2.1349999999999998,"15min":2.1349999999999998},"last":1.266},{"interface":"front","average":{"1min":1.6240000000000001,"5min":1.6240000000000001,"15min":1.6240000000000001},"min":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"max":{"1min":2.6080000000000001,"5min":2.6080000000000001,"15min":2.6080000000000001},"last":1.625}]},{"osd":6,"last update":"Sun Dec 17 11:49:06 2023","interfaces":[{"interface":"back","average":{"1min":1.5800000000000001,"5min":1.5800000000000001,"15min":1.5800000000000001},"min":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"max":{"1min":2.702,"5min":2.702,"15min":2.702},"last":1.5489999999999999},{"interface":"front","average":{"1min":1.534,"5min":1.534,"15min":1.534},"min":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"max":{"1min":2.3100000000000001,"5min":2.3100000000000001,"15min":2.3100000000000001},"last":1.3540000000000001}]},{"osd":7,"last update":"Sun Dec 17 11:49:06 2023","interfaces":[{"interface":"back","average":{"1min":1.611,"5min":1.611,"15min":1.611},"min":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"max":{"1min":2.3420000000000001,"5min":2.3420000000000001,"15min":2.3420000000000001},"last":1.5029999999999999},{"interface":"front","average":{"1min":1.577,"5min":1.577,"15min":1.577},"min":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"max":{"1min":2.4359999999999999,"5min":2.4359999999999999,"15min":2.4359999999999999},"last":1.464}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-17T11:50:02.862 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-17T11:50:03.101 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:03.098+0000 7f461e928640 1 Processor -- start 2023-12-17T11:50:03.101 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:03.099+0000 7f461e928640 1 -- start start 2023-12-17T11:50:03.103 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:03.100+0000 7f461e928640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f461815d390 0x7f46180b1cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:50:03.103 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:03.100+0000 7f461e928640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f46180d0c10 0x7f46180b04c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:50:03.103 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:03.100+0000 7f461e928640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f46180d1410 0x7f46180d18a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:50:03.103 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:03.100+0000 7f461e928640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46180d1de0 con 0x7f46180d1410 2023-12-17T11:50:03.103 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:03.100+0000 7f461e928640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46180ceea0 con 0x7f461815d390 2023-12-17T11:50:03.103 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:03.100+0000 7f461e928640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46180b0a00 con 0x7f46180d0c10 2023-12-17T11:50:03.103 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:03.100+0000 7f461e127640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f46180d1410 0x7f46180d18a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:50:03.103 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:03.101+0000 7f461e127640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f46180d1410 0x7f46180d18a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:33894/0 (socket says 172.21.15.40:33894) 2023-12-17T11:50:03.103 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:03.101+0000 7f461e127640 1 -- 172.21.15.40:0/1692165569 learned_addr learned my addr 172.21.15.40:0/1692165569 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-17T11:50:03.103 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:03.101+0000 7f461d125640 1 --2- 172.21.15.40:0/1692165569 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f46180d0c10 0x7f46180b04c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:50:03.103 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:03.101+0000 7f461d926640 1 --2- 172.21.15.40:0/1692165569 >> v2:172.21.15.159:3300/0 conn(0x7f461815d390 0x7f46180b1cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:50:03.104 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:03.101+0000 7f461e127640 1 -- 172.21.15.40:0/1692165569 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f46180d0c10 msgr2=0x7f46180b04c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:50:03.104 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:03.101+0000 7f461e127640 1 --2- 172.21.15.40:0/1692165569 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f46180d0c10 0x7f46180b04c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:50:03.104 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:03.101+0000 7f461e127640 1 -- 172.21.15.40:0/1692165569 >> v2:172.21.15.159:3300/0 conn(0x7f461815d390 msgr2=0x7f46180b1cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:50:03.104 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:03.101+0000 7f461e127640 1 --2- 172.21.15.40:0/1692165569 >> v2:172.21.15.159:3300/0 conn(0x7f461815d390 0x7f46180b1cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:50:03.104 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:03.101+0000 7f461e127640 1 -- 172.21.15.40:0/1692165569 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f461815d770 con 0x7f46180d1410 2023-12-17T11:50:03.104 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:03.101+0000 7f461d125640 1 --2- 172.21.15.40:0/1692165569 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f46180d0c10 0x7f46180b04c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-17T11:50:03.105 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:03.103+0000 7f461e127640 1 --2- 172.21.15.40:0/1692165569 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f46180d1410 0x7f46180d18a0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f461808b690 tx=0x7f461002be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c790f5475d6d98b7 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:50:03.105 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:03.103+0000 7f461c924640 1 -- 172.21.15.40:0/1692165569 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f461002c9e0 con 0x7f46180d1410 2023-12-17T11:50:03.105 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:03.103+0000 7f461c924640 1 -- 172.21.15.40:0/1692165569 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f461002cb40 con 0x7f46180d1410 2023-12-17T11:50:03.105 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:03.103+0000 7f461c924640 1 -- 172.21.15.40:0/1692165569 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46100343f0 con 0x7f46180d1410 2023-12-17T11:50:03.106 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:03.104+0000 7f461e928640 1 -- 172.21.15.40:0/1692165569 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f46180d1410 msgr2=0x7f46180d18a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:50:03.106 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:03.104+0000 7f461e928640 1 --2- 172.21.15.40:0/1692165569 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f46180d1410 0x7f46180d18a0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f461808b690 tx=0x7f461002be40 comp rx=0 tx=0).stop 2023-12-17T11:50:03.106 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:03.104+0000 7f461e928640 1 -- 172.21.15.40:0/1692165569 shutdown_connections 2023-12-17T11:50:03.106 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:03.104+0000 7f461e928640 1 --2- 172.21.15.40:0/1692165569 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f46180d1410 0x7f46180d18a0 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:50:03.107 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:03.104+0000 7f461e928640 1 --2- 172.21.15.40:0/1692165569 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f46180d0c10 0x7f46180b04c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:50:03.107 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:03.104+0000 7f461e928640 1 --2- 172.21.15.40:0/1692165569 >> v2:172.21.15.159:3300/0 conn(0x7f461815d390 0x7f46180b1cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:50:03.107 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:03.104+0000 7f461e928640 1 -- 172.21.15.40:0/1692165569 >> 172.21.15.40:0/1692165569 conn(0x7f46180d2ec0 msgr2=0x7f46180d32d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:50:03.107 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:03.104+0000 7f461e928640 1 -- 172.21.15.40:0/1692165569 shutdown_connections 2023-12-17T11:50:03.107 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:03.104+0000 7f461e928640 1 -- 172.21.15.40:0/1692165569 wait complete. 2023-12-17T11:50:03.108 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:03.106+0000 7f461e928640 1 Processor -- start 2023-12-17T11:50:03.108 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:03.106+0000 7f461e928640 1 -- start start 2023-12-17T11:50:03.110 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:03.107+0000 7f461e928640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f46180d0c10 0x7f461815b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:50:03.110 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:03.107+0000 7f461e928640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f46180d1410 0x7f46180b6190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:50:03.110 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:03.107+0000 7f461e928640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f461815d390 0x7f461809f3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:50:03.111 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:03.107+0000 7f461e928640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46180b6be0 con 0x7f461815d390 2023-12-17T11:50:03.111 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:03.107+0000 7f461e928640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46180b4530 con 0x7f46180d1410 2023-12-17T11:50:03.111 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:03.107+0000 7f461e928640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46180b4810 con 0x7f46180d0c10 2023-12-17T11:50:03.111 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:03.108+0000 7f461e127640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f461815d390 0x7f461809f3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:50:03.111 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:03.108+0000 7f461e127640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f461815d390 0x7f461809f3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:33910/0 (socket says 172.21.15.40:33910) 2023-12-17T11:50:03.111 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:03.108+0000 7f461e127640 1 -- 172.21.15.40:0/3516519291 learned_addr learned my addr 172.21.15.40:0/3516519291 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-17T11:50:03.111 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:03.108+0000 7f461d926640 1 --2- 172.21.15.40:0/3516519291 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f46180d0c10 0x7f461815b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:50:03.111 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:03.108+0000 7f461d125640 1 --2- 172.21.15.40:0/3516519291 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f46180d1410 0x7f46180b6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:50:03.111 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:03.108+0000 7f461e127640 1 -- 172.21.15.40:0/3516519291 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f46180d0c10 msgr2=0x7f461815b760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:50:03.111 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:03.108+0000 7f461e127640 1 --2- 172.21.15.40:0/3516519291 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f46180d0c10 0x7f461815b760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:50:03.111 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:03.108+0000 7f461e127640 1 -- 172.21.15.40:0/3516519291 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f46180d1410 msgr2=0x7f46180b6190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:50:03.111 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:03.108+0000 7f461e127640 1 --2- 172.21.15.40:0/3516519291 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f46180d1410 0x7f46180b6190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:50:03.111 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:03.108+0000 7f461e127640 1 -- 172.21.15.40:0/3516519291 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4610009b30 con 0x7f461815d390 2023-12-17T11:50:03.111 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:03.108+0000 7f461d125640 1 --2- 172.21.15.40:0/3516519291 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f46180d1410 0x7f46180b6190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-17T11:50:03.111 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:03.109+0000 7f461e127640 1 --2- 172.21.15.40:0/3516519291 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f461815d390 0x7f461809f3a0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f4610036040 tx=0x7f4610004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:50:03.112 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:03.109+0000 7f460a7fc640 1 -- 172.21.15.40:0/3516519291 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4610009510 con 0x7f461815d390 2023-12-17T11:50:03.112 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:03.109+0000 7f460a7fc640 1 -- 172.21.15.40:0/3516519291 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f461003e450 con 0x7f461815d390 2023-12-17T11:50:03.112 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:03.109+0000 7f460a7fc640 1 -- 172.21.15.40:0/3516519291 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f461003e7e0 con 0x7f461815d390 2023-12-17T11:50:03.112 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:03.109+0000 7f461e928640 1 -- 172.21.15.40:0/3516519291 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46180b4af0 con 0x7f461815d390 2023-12-17T11:50:03.113 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:03.109+0000 7f461e928640 1 -- 172.21.15.40:0/3516519291 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46180b4220 con 0x7f461815d390 2023-12-17T11:50:03.113 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:03.110+0000 7f461e928640 1 -- 172.21.15.40:0/3516519291 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46180d23e0 con 0x7f461815d390 2023-12-17T11:50:03.113 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:03.111+0000 7f460a7fc640 1 -- 172.21.15.40:0/3516519291 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f461003e940 con 0x7f461815d390 2023-12-17T11:50:03.114 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:03.112+0000 7f460a7fc640 1 --2- 172.21.15.40:0/3516519291 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f45fc06ae40 0x7f45fc06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:50:03.114 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:03.112+0000 7f460a7fc640 1 -- 172.21.15.40:0/3516519291 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f46100ac330 con 0x7f461815d390 2023-12-17T11:50:03.115 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:03.113+0000 7f461d926640 1 --2- 172.21.15.40:0/3516519291 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f45fc06ae40 0x7f45fc06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:50:03.116 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:03.114+0000 7f461d926640 1 --2- 172.21.15.40:0/3516519291 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f45fc06ae40 0x7f45fc06d300 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f4614006fd0 tx=0x7f4614008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:50:03.118 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:03.117+0000 7f460a7fc640 1 -- 172.21.15.40:0/3516519291 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f4610077310 con 0x7f461815d390 2023-12-17T11:50:03.310 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:03.309+0000 7f461e928640 1 -- 172.21.15.40:0/3516519291 --> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f461815c480 con 0x7f45fc06ae40 2023-12-17T11:50:03.332 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:03.330+0000 7f460a7fc640 1 -- 172.21.15.40:0/3516519291 <== mgr.4105 v2:172.21.15.159:6832/479465803 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286572 (secure 0 0 0) 0x7f461815c480 con 0x7f45fc06ae40 2023-12-17T11:50:03.336 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T11:50:03.337 INFO:teuthology.orchestra.run.smithi040.stderr:dumped all 2023-12-17T11:50:03.339 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:03.335+0000 7f461e928640 1 -- 172.21.15.40:0/3516519291 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f45fc06ae40 msgr2=0x7f45fc06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:50:03.339 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:03.335+0000 7f461e928640 1 --2- 172.21.15.40:0/3516519291 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f45fc06ae40 0x7f45fc06d300 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f4614006fd0 tx=0x7f4614008040 comp rx=0 tx=0).stop 2023-12-17T11:50:03.339 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:03.335+0000 7f461e928640 1 -- 172.21.15.40:0/3516519291 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f461815d390 msgr2=0x7f461809f3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:50:03.339 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:03.335+0000 7f461e928640 1 --2- 172.21.15.40:0/3516519291 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f461815d390 0x7f461809f3a0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f4610036040 tx=0x7f4610004a40 comp rx=0 tx=0).stop 2023-12-17T11:50:03.339 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:03.335+0000 7f461e928640 1 -- 172.21.15.40:0/3516519291 shutdown_connections 2023-12-17T11:50:03.339 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:03.335+0000 7f461e928640 1 --2- 172.21.15.40:0/3516519291 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f45fc06ae40 0x7f45fc06d300 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:50:03.339 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:03.335+0000 7f461e928640 1 --2- 172.21.15.40:0/3516519291 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f461815d390 0x7f461809f3a0 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:50:03.339 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:03.335+0000 7f461e928640 1 --2- 172.21.15.40:0/3516519291 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f46180d1410 0x7f46180b6190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:50:03.339 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:03.335+0000 7f461e928640 1 --2- 172.21.15.40:0/3516519291 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f46180d0c10 0x7f461815b760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:50:03.339 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:03.335+0000 7f461e928640 1 -- 172.21.15.40:0/3516519291 >> 172.21.15.40:0/3516519291 conn(0x7f46180d2ec0 msgr2=0x7f46180afab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:50:03.339 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:03.335+0000 7f461e928640 1 -- 172.21.15.40:0/3516519291 shutdown_connections 2023-12-17T11:50:03.339 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:03.335+0000 7f461e928640 1 -- 172.21.15.40:0/3516519291 wait complete. 2023-12-17T11:50:03.356 INFO:teuthology.orchestra.run.smithi040.stdout:{"pg_ready":true,"pg_map":{"version":93,"stamp":"2023-12-17T11:50:02.633238+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":225208,"kb_used_data":4880,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754749512,"statfs":{"total":773094113280,"available":772863500288,"internally_reserved":0,"allocated":4997120,"data_stored":2803865,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":225496626},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002735"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-17T11:50:00.525487+0000","last_change":"2023-12-17T11:49:53.251801+0000","last_active":"2023-12-17T11:50:00.525487+0000","last_peered":"2023-12-17T11:50:00.525487+0000","last_clean":"2023-12-17T11:50:00.525487+0000","last_became_active":"2023-12-17T11:49:53.251221+0000","last_became_peered":"2023-12-17T11:49:53.251221+0000","last_unstale":"2023-12-17T11:50:00.525487+0000","last_undegraded":"2023-12-17T11:50:00.525487+0000","last_fullsized":"2023-12-17T11:50:00.525487+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T22:42:15.785143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-17T11:50:00.524627+0000","last_change":"2023-12-17T11:49:53.243478+0000","last_active":"2023-12-17T11:50:00.524627+0000","last_peered":"2023-12-17T11:50:00.524627+0000","last_clean":"2023-12-17T11:50:00.524627+0000","last_became_active":"2023-12-17T11:49:53.243179+0000","last_became_peered":"2023-12-17T11:49:53.243179+0000","last_unstale":"2023-12-17T11:50:00.524627+0000","last_undegraded":"2023-12-17T11:50:00.524627+0000","last_fullsized":"2023-12-17T11:50:00.524627+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T23:49:09.469993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:56.659373+0000","last_change":"2023-12-17T11:49:53.249501+0000","last_active":"2023-12-17T11:49:56.659373+0000","last_peered":"2023-12-17T11:49:56.659373+0000","last_clean":"2023-12-17T11:49:56.659373+0000","last_became_active":"2023-12-17T11:49:53.249212+0000","last_became_peered":"2023-12-17T11:49:53.249212+0000","last_unstale":"2023-12-17T11:49:56.659373+0000","last_undegraded":"2023-12-17T11:49:56.659373+0000","last_fullsized":"2023-12-17T11:49:56.659373+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T22:50:12.261960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:56.663625+0000","last_change":"2023-12-17T11:49:53.237486+0000","last_active":"2023-12-17T11:49:56.663625+0000","last_peered":"2023-12-17T11:49:56.663625+0000","last_clean":"2023-12-17T11:49:56.663625+0000","last_became_active":"2023-12-17T11:49:53.236766+0000","last_became_peered":"2023-12-17T11:49:53.236766+0000","last_unstale":"2023-12-17T11:49:56.663625+0000","last_undegraded":"2023-12-17T11:49:56.663625+0000","last_fullsized":"2023-12-17T11:49:56.663625+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T19:34:01.395947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:56.663570+0000","last_change":"2023-12-17T11:49:53.230175+0000","last_active":"2023-12-17T11:49:56.663570+0000","last_peered":"2023-12-17T11:49:56.663570+0000","last_clean":"2023-12-17T11:49:56.663570+0000","last_became_active":"2023-12-17T11:49:53.229756+0000","last_became_peered":"2023-12-17T11:49:53.229756+0000","last_unstale":"2023-12-17T11:49:56.663570+0000","last_undegraded":"2023-12-17T11:49:56.663570+0000","last_fullsized":"2023-12-17T11:49:56.663570+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T15:43:04.869288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:56.659967+0000","last_change":"2023-12-17T11:49:53.245040+0000","last_active":"2023-12-17T11:49:56.659967+0000","last_peered":"2023-12-17T11:49:56.659967+0000","last_clean":"2023-12-17T11:49:56.659967+0000","last_became_active":"2023-12-17T11:49:53.243989+0000","last_became_peered":"2023-12-17T11:49:53.243989+0000","last_unstale":"2023-12-17T11:49:56.659967+0000","last_undegraded":"2023-12-17T11:49:56.659967+0000","last_fullsized":"2023-12-17T11:49:56.659967+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T16:31:53.964205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:56.655609+0000","last_change":"2023-12-17T11:49:53.244506+0000","last_active":"2023-12-17T11:49:56.655609+0000","last_peered":"2023-12-17T11:49:56.655609+0000","last_clean":"2023-12-17T11:49:56.655609+0000","last_became_active":"2023-12-17T11:49:53.244244+0000","last_became_peered":"2023-12-17T11:49:53.244244+0000","last_unstale":"2023-12-17T11:49:56.655609+0000","last_undegraded":"2023-12-17T11:49:56.655609+0000","last_fullsized":"2023-12-17T11:49:56.655609+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T12:27:38.132749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-17T11:50:00.522397+0000","last_change":"2023-12-17T11:49:53.256713+0000","last_active":"2023-12-17T11:50:00.522397+0000","last_peered":"2023-12-17T11:50:00.522397+0000","last_clean":"2023-12-17T11:50:00.522397+0000","last_became_active":"2023-12-17T11:49:53.255850+0000","last_became_peered":"2023-12-17T11:49:53.255850+0000","last_unstale":"2023-12-17T11:50:00.522397+0000","last_undegraded":"2023-12-17T11:50:00.522397+0000","last_fullsized":"2023-12-17T11:50:00.522397+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T14:00:43.418107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:56.659436+0000","last_change":"2023-12-17T11:49:53.255007+0000","last_active":"2023-12-17T11:49:56.659436+0000","last_peered":"2023-12-17T11:49:56.659436+0000","last_clean":"2023-12-17T11:49:56.659436+0000","last_became_active":"2023-12-17T11:49:53.254750+0000","last_became_peered":"2023-12-17T11:49:53.254750+0000","last_unstale":"2023-12-17T11:49:56.659436+0000","last_undegraded":"2023-12-17T11:49:56.659436+0000","last_fullsized":"2023-12-17T11:49:56.659436+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T19:23:44.505187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:56.655871+0000","last_change":"2023-12-17T11:49:53.243885+0000","last_active":"2023-12-17T11:49:56.655871+0000","last_peered":"2023-12-17T11:49:56.655871+0000","last_clean":"2023-12-17T11:49:56.655871+0000","last_became_active":"2023-12-17T11:49:53.243586+0000","last_became_peered":"2023-12-17T11:49:53.243586+0000","last_unstale":"2023-12-17T11:49:56.655871+0000","last_undegraded":"2023-12-17T11:49:56.655871+0000","last_fullsized":"2023-12-17T11:49:56.655871+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T23:49:09.469993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:56.655817+0000","last_change":"2023-12-17T11:49:53.245071+0000","last_active":"2023-12-17T11:49:56.655817+0000","last_peered":"2023-12-17T11:49:56.655817+0000","last_clean":"2023-12-17T11:49:56.655817+0000","last_became_active":"2023-12-17T11:49:53.244696+0000","last_became_peered":"2023-12-17T11:49:53.244696+0000","last_unstale":"2023-12-17T11:49:56.655817+0000","last_undegraded":"2023-12-17T11:49:56.655817+0000","last_fullsized":"2023-12-17T11:49:56.655817+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T17:56:09.285369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:56.659352+0000","last_change":"2023-12-17T11:49:53.244437+0000","last_active":"2023-12-17T11:49:56.659352+0000","last_peered":"2023-12-17T11:49:56.659352+0000","last_clean":"2023-12-17T11:49:56.659352+0000","last_became_active":"2023-12-17T11:49:53.244158+0000","last_became_peered":"2023-12-17T11:49:53.244158+0000","last_unstale":"2023-12-17T11:49:56.659352+0000","last_undegraded":"2023-12-17T11:49:56.659352+0000","last_fullsized":"2023-12-17T11:49:56.659352+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T12:12:45.651530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:56.655738+0000","last_change":"2023-12-17T11:49:53.259954+0000","last_active":"2023-12-17T11:49:56.655738+0000","last_peered":"2023-12-17T11:49:56.655738+0000","last_clean":"2023-12-17T11:49:56.655738+0000","last_became_active":"2023-12-17T11:49:53.259683+0000","last_became_peered":"2023-12-17T11:49:53.259683+0000","last_unstale":"2023-12-17T11:49:56.655738+0000","last_undegraded":"2023-12-17T11:49:56.655738+0000","last_fullsized":"2023-12-17T11:49:56.655738+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T13:29:29.953615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-17T11:50:00.522506+0000","last_change":"2023-12-17T11:49:53.251388+0000","last_active":"2023-12-17T11:50:00.522506+0000","last_peered":"2023-12-17T11:50:00.522506+0000","last_clean":"2023-12-17T11:50:00.522506+0000","last_became_active":"2023-12-17T11:49:53.251182+0000","last_became_peered":"2023-12-17T11:49:53.251182+0000","last_unstale":"2023-12-17T11:50:00.522506+0000","last_undegraded":"2023-12-17T11:50:00.522506+0000","last_fullsized":"2023-12-17T11:50:00.522506+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T19:39:18.340154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:56.655643+0000","last_change":"2023-12-17T11:49:53.251484+0000","last_active":"2023-12-17T11:49:56.655643+0000","last_peered":"2023-12-17T11:49:56.655643+0000","last_clean":"2023-12-17T11:49:56.655643+0000","last_became_active":"2023-12-17T11:49:53.250825+0000","last_became_peered":"2023-12-17T11:49:53.250825+0000","last_unstale":"2023-12-17T11:49:56.655643+0000","last_undegraded":"2023-12-17T11:49:56.655643+0000","last_fullsized":"2023-12-17T11:49:56.655643+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T12:48:09.865175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:55.301502+0000","last_change":"2023-12-17T11:49:53.256736+0000","last_active":"2023-12-17T11:49:55.301502+0000","last_peered":"2023-12-17T11:49:55.301502+0000","last_clean":"2023-12-17T11:49:55.301502+0000","last_became_active":"2023-12-17T11:49:53.256319+0000","last_became_peered":"2023-12-17T11:49:53.256319+0000","last_unstale":"2023-12-17T11:49:55.301502+0000","last_undegraded":"2023-12-17T11:49:55.301502+0000","last_fullsized":"2023-12-17T11:49:55.301502+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T14:49:05.628056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:55.302967+0000","last_change":"2023-12-17T11:49:53.254466+0000","last_active":"2023-12-17T11:49:55.302967+0000","last_peered":"2023-12-17T11:49:55.302967+0000","last_clean":"2023-12-17T11:49:55.302967+0000","last_became_active":"2023-12-17T11:49:53.254191+0000","last_became_peered":"2023-12-17T11:49:53.254191+0000","last_unstale":"2023-12-17T11:49:55.302967+0000","last_undegraded":"2023-12-17T11:49:55.302967+0000","last_fullsized":"2023-12-17T11:49:55.302967+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T15:34:59.184998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-17T11:50:01.202677+0000","last_change":"2023-12-17T11:49:53.244371+0000","last_active":"2023-12-17T11:50:01.202677+0000","last_peered":"2023-12-17T11:50:01.202677+0000","last_clean":"2023-12-17T11:50:01.202677+0000","last_became_active":"2023-12-17T11:49:53.243288+0000","last_became_peered":"2023-12-17T11:49:53.243288+0000","last_unstale":"2023-12-17T11:50:01.202677+0000","last_undegraded":"2023-12-17T11:50:01.202677+0000","last_fullsized":"2023-12-17T11:50:01.202677+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T22:59:01.401999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:56.663668+0000","last_change":"2023-12-17T11:49:53.247133+0000","last_active":"2023-12-17T11:49:56.663668+0000","last_peered":"2023-12-17T11:49:56.663668+0000","last_clean":"2023-12-17T11:49:56.663668+0000","last_became_active":"2023-12-17T11:49:53.246863+0000","last_became_peered":"2023-12-17T11:49:53.246863+0000","last_unstale":"2023-12-17T11:49:56.663668+0000","last_undegraded":"2023-12-17T11:49:56.663668+0000","last_fullsized":"2023-12-17T11:49:56.663668+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T15:22:56.669665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-17T11:50:01.202405+0000","last_change":"2023-12-17T11:49:53.234246+0000","last_active":"2023-12-17T11:50:01.202405+0000","last_peered":"2023-12-17T11:50:01.202405+0000","last_clean":"2023-12-17T11:50:01.202405+0000","last_became_active":"2023-12-17T11:49:53.233971+0000","last_became_peered":"2023-12-17T11:49:53.233971+0000","last_unstale":"2023-12-17T11:50:01.202405+0000","last_undegraded":"2023-12-17T11:50:01.202405+0000","last_fullsized":"2023-12-17T11:50:01.202405+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T21:22:15.324114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:56.655760+0000","last_change":"2023-12-17T11:49:53.254631+0000","last_active":"2023-12-17T11:49:56.655760+0000","last_peered":"2023-12-17T11:49:56.655760+0000","last_clean":"2023-12-17T11:49:56.655760+0000","last_became_active":"2023-12-17T11:49:53.254246+0000","last_became_peered":"2023-12-17T11:49:53.254246+0000","last_unstale":"2023-12-17T11:49:56.655760+0000","last_undegraded":"2023-12-17T11:49:56.655760+0000","last_fullsized":"2023-12-17T11:49:56.655760+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T15:42:47.132551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-17T11:50:00.523985+0000","last_change":"2023-12-17T11:49:53.233281+0000","last_active":"2023-12-17T11:50:00.523985+0000","last_peered":"2023-12-17T11:50:00.523985+0000","last_clean":"2023-12-17T11:50:00.523985+0000","last_became_active":"2023-12-17T11:49:53.233006+0000","last_became_peered":"2023-12-17T11:49:53.233006+0000","last_unstale":"2023-12-17T11:50:00.523985+0000","last_undegraded":"2023-12-17T11:50:00.523985+0000","last_fullsized":"2023-12-17T11:50:00.523985+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T17:37:46.058341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:55.301627+0000","last_change":"2023-12-17T11:49:53.235006+0000","last_active":"2023-12-17T11:49:55.301627+0000","last_peered":"2023-12-17T11:49:55.301627+0000","last_clean":"2023-12-17T11:49:55.301627+0000","last_became_active":"2023-12-17T11:49:53.232828+0000","last_became_peered":"2023-12-17T11:49:53.232828+0000","last_unstale":"2023-12-17T11:49:55.301627+0000","last_undegraded":"2023-12-17T11:49:55.301627+0000","last_fullsized":"2023-12-17T11:49:55.301627+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T21:34:46.442330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:56.663503+0000","last_change":"2023-12-17T11:49:53.229937+0000","last_active":"2023-12-17T11:49:56.663503+0000","last_peered":"2023-12-17T11:49:56.663503+0000","last_clean":"2023-12-17T11:49:56.663503+0000","last_became_active":"2023-12-17T11:49:53.229360+0000","last_became_peered":"2023-12-17T11:49:53.229360+0000","last_unstale":"2023-12-17T11:49:56.663503+0000","last_undegraded":"2023-12-17T11:49:56.663503+0000","last_fullsized":"2023-12-17T11:49:56.663503+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T13:22:57.464897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-17T11:50:01.202634+0000","last_change":"2023-12-17T11:49:53.248140+0000","last_active":"2023-12-17T11:50:01.202634+0000","last_peered":"2023-12-17T11:50:01.202634+0000","last_clean":"2023-12-17T11:50:01.202634+0000","last_became_active":"2023-12-17T11:49:53.246139+0000","last_became_peered":"2023-12-17T11:49:53.246139+0000","last_unstale":"2023-12-17T11:50:01.202634+0000","last_undegraded":"2023-12-17T11:50:01.202634+0000","last_fullsized":"2023-12-17T11:50:01.202634+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T14:32:00.462222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:56.660141+0000","last_change":"2023-12-17T11:49:53.255892+0000","last_active":"2023-12-17T11:49:56.660141+0000","last_peered":"2023-12-17T11:49:56.660141+0000","last_clean":"2023-12-17T11:49:56.660141+0000","last_became_active":"2023-12-17T11:49:53.255307+0000","last_became_peered":"2023-12-17T11:49:53.255307+0000","last_unstale":"2023-12-17T11:49:56.660141+0000","last_undegraded":"2023-12-17T11:49:56.660141+0000","last_fullsized":"2023-12-17T11:49:56.660141+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T17:37:46.058341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-17T11:50:01.202692+0000","last_change":"2023-12-17T11:49:53.238527+0000","last_active":"2023-12-17T11:50:01.202692+0000","last_peered":"2023-12-17T11:50:01.202692+0000","last_clean":"2023-12-17T11:50:01.202692+0000","last_became_active":"2023-12-17T11:49:53.238260+0000","last_became_peered":"2023-12-17T11:49:53.238260+0000","last_unstale":"2023-12-17T11:50:01.202692+0000","last_undegraded":"2023-12-17T11:50:01.202692+0000","last_fullsized":"2023-12-17T11:50:01.202692+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T14:03:14.332356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:56.655796+0000","last_change":"2023-12-17T11:49:53.247243+0000","last_active":"2023-12-17T11:49:56.655796+0000","last_peered":"2023-12-17T11:49:56.655796+0000","last_clean":"2023-12-17T11:49:56.655796+0000","last_became_active":"2023-12-17T11:49:53.246983+0000","last_became_peered":"2023-12-17T11:49:53.246983+0000","last_unstale":"2023-12-17T11:49:56.655796+0000","last_undegraded":"2023-12-17T11:49:56.655796+0000","last_fullsized":"2023-12-17T11:49:56.655796+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T23:33:06.562683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-17T11:50:01.202387+0000","last_change":"2023-12-17T11:49:53.247287+0000","last_active":"2023-12-17T11:50:01.202387+0000","last_peered":"2023-12-17T11:50:01.202387+0000","last_clean":"2023-12-17T11:50:01.202387+0000","last_became_active":"2023-12-17T11:49:53.246995+0000","last_became_peered":"2023-12-17T11:49:53.246995+0000","last_unstale":"2023-12-17T11:50:01.202387+0000","last_undegraded":"2023-12-17T11:50:01.202387+0000","last_fullsized":"2023-12-17T11:50:01.202387+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T14:03:09.358474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-17T11:50:01.202183+0000","last_change":"2023-12-17T11:49:53.240901+0000","last_active":"2023-12-17T11:50:01.202183+0000","last_peered":"2023-12-17T11:50:01.202183+0000","last_clean":"2023-12-17T11:50:01.202183+0000","last_became_active":"2023-12-17T11:49:53.240589+0000","last_became_peered":"2023-12-17T11:49:53.240589+0000","last_unstale":"2023-12-17T11:50:01.202183+0000","last_undegraded":"2023-12-17T11:50:01.202183+0000","last_fullsized":"2023-12-17T11:50:01.202183+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T19:17:47.294209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:55.301788+0000","last_change":"2023-12-17T11:49:53.239855+0000","last_active":"2023-12-17T11:49:55.301788+0000","last_peered":"2023-12-17T11:49:55.301788+0000","last_clean":"2023-12-17T11:49:55.301788+0000","last_became_active":"2023-12-17T11:49:53.239579+0000","last_became_peered":"2023-12-17T11:49:53.239579+0000","last_unstale":"2023-12-17T11:49:55.301788+0000","last_undegraded":"2023-12-17T11:49:55.301788+0000","last_fullsized":"2023-12-17T11:49:55.301788+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T20:29:09.996550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:56.659898+0000","last_change":"2023-12-17T11:49:53.252543+0000","last_active":"2023-12-17T11:49:56.659898+0000","last_peered":"2023-12-17T11:49:56.659898+0000","last_clean":"2023-12-17T11:49:56.659898+0000","last_became_active":"2023-12-17T11:49:53.250790+0000","last_became_peered":"2023-12-17T11:49:53.250790+0000","last_unstale":"2023-12-17T11:49:56.659898+0000","last_undegraded":"2023-12-17T11:49:56.659898+0000","last_fullsized":"2023-12-17T11:49:56.659898+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T19:00:07.905809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:55.302468+0000","last_change":"2023-12-17T11:49:53.245226+0000","last_active":"2023-12-17T11:49:55.302468+0000","last_peered":"2023-12-17T11:49:55.302468+0000","last_clean":"2023-12-17T11:49:55.302468+0000","last_became_active":"2023-12-17T11:49:53.243115+0000","last_became_peered":"2023-12-17T11:49:53.243115+0000","last_unstale":"2023-12-17T11:49:55.302468+0000","last_undegraded":"2023-12-17T11:49:55.302468+0000","last_fullsized":"2023-12-17T11:49:55.302468+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T15:06:34.831619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"39'4","reported_seq":18,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-17T11:50:01.202725+0000","last_change":"2023-12-17T11:49:52.226944+0000","last_active":"2023-12-17T11:50:01.202725+0000","last_peered":"2023-12-17T11:50:01.202725+0000","last_clean":"2023-12-17T11:50:01.202725+0000","last_became_active":"2023-12-17T11:49:52.226659+0000","last_became_peered":"2023-12-17T11:49:52.226659+0000","last_unstale":"2023-12-17T11:50:01.202725+0000","last_undegraded":"2023-12-17T11:50:01.202725+0000","last_fullsized":"2023-12-17T11:50:01.202725+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_clean_scrub_stamp":"2023-12-17T11:49:51.168108+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T13:22:56.453467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:56.660037+0000","last_change":"2023-12-17T11:49:53.254791+0000","last_active":"2023-12-17T11:49:56.660037+0000","last_peered":"2023-12-17T11:49:56.660037+0000","last_clean":"2023-12-17T11:49:56.660037+0000","last_became_active":"2023-12-17T11:49:53.254496+0000","last_became_peered":"2023-12-17T11:49:53.254496+0000","last_unstale":"2023-12-17T11:49:56.660037+0000","last_undegraded":"2023-12-17T11:49:56.660037+0000","last_fullsized":"2023-12-17T11:49:56.660037+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T14:42:29.543380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"39'1","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:55.302292+0000","last_change":"2023-12-17T11:49:52.223256+0000","last_active":"2023-12-17T11:49:55.302292+0000","last_peered":"2023-12-17T11:49:55.302292+0000","last_clean":"2023-12-17T11:49:55.302292+0000","last_became_active":"2023-12-17T11:49:52.222808+0000","last_became_peered":"2023-12-17T11:49:52.222808+0000","last_unstale":"2023-12-17T11:49:55.302292+0000","last_undegraded":"2023-12-17T11:49:55.302292+0000","last_fullsized":"2023-12-17T11:49:55.302292+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_clean_scrub_stamp":"2023-12-17T11:49:51.168108+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T16:31:52.952775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-17T11:50:00.523143+0000","last_change":"2023-12-17T11:49:53.251178+0000","last_active":"2023-12-17T11:50:00.523143+0000","last_peered":"2023-12-17T11:50:00.523143+0000","last_clean":"2023-12-17T11:50:00.523143+0000","last_became_active":"2023-12-17T11:49:53.250223+0000","last_became_peered":"2023-12-17T11:49:53.250223+0000","last_unstale":"2023-12-17T11:50:00.523143+0000","last_undegraded":"2023-12-17T11:50:00.523143+0000","last_fullsized":"2023-12-17T11:50:00.523143+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T23:10:56.100255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"39'2","reported_seq":15,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:54.557626+0000","last_change":"2023-12-17T11:49:52.223879+0000","last_active":"2023-12-17T11:49:54.557626+0000","last_peered":"2023-12-17T11:49:54.557626+0000","last_clean":"2023-12-17T11:49:54.557626+0000","last_became_active":"2023-12-17T11:49:52.223602+0000","last_became_peered":"2023-12-17T11:49:52.223602+0000","last_unstale":"2023-12-17T11:49:54.557626+0000","last_undegraded":"2023-12-17T11:49:54.557626+0000","last_fullsized":"2023-12-17T11:49:54.557626+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_clean_scrub_stamp":"2023-12-17T11:49:51.168108+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T15:25:46.493177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-17T11:50:00.525262+0000","last_change":"2023-12-17T11:49:53.254646+0000","last_active":"2023-12-17T11:50:00.525262+0000","last_peered":"2023-12-17T11:50:00.525262+0000","last_clean":"2023-12-17T11:50:00.525262+0000","last_became_active":"2023-12-17T11:49:53.254368+0000","last_became_peered":"2023-12-17T11:49:53.254368+0000","last_unstale":"2023-12-17T11:50:00.525262+0000","last_undegraded":"2023-12-17T11:50:00.525262+0000","last_fullsized":"2023-12-17T11:50:00.525262+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T15:42:47.132551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"39'2","reported_seq":16,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-17T11:50:00.523260+0000","last_change":"2023-12-17T11:49:52.221006+0000","last_active":"2023-12-17T11:50:00.523260+0000","last_peered":"2023-12-17T11:50:00.523260+0000","last_clean":"2023-12-17T11:50:00.523260+0000","last_became_active":"2023-12-17T11:49:52.220514+0000","last_became_peered":"2023-12-17T11:49:52.220514+0000","last_unstale":"2023-12-17T11:50:00.523260+0000","last_undegraded":"2023-12-17T11:50:00.523260+0000","last_fullsized":"2023-12-17T11:50:00.523260+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_clean_scrub_stamp":"2023-12-17T11:49:51.168108+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T15:25:46.493177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:56.659192+0000","last_change":"2023-12-17T11:49:53.251737+0000","last_active":"2023-12-17T11:49:56.659192+0000","last_peered":"2023-12-17T11:49:56.659192+0000","last_clean":"2023-12-17T11:49:56.659192+0000","last_became_active":"2023-12-17T11:49:53.251458+0000","last_became_peered":"2023-12-17T11:49:53.251458+0000","last_unstale":"2023-12-17T11:49:56.659192+0000","last_undegraded":"2023-12-17T11:49:56.659192+0000","last_fullsized":"2023-12-17T11:49:56.659192+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T17:37:46.058341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"39'1","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:55.304169+0000","last_change":"2023-12-17T11:49:52.226918+0000","last_active":"2023-12-17T11:49:55.304169+0000","last_peered":"2023-12-17T11:49:55.304169+0000","last_clean":"2023-12-17T11:49:55.304169+0000","last_became_active":"2023-12-17T11:49:52.226455+0000","last_became_peered":"2023-12-17T11:49:52.226455+0000","last_unstale":"2023-12-17T11:49:55.304169+0000","last_undegraded":"2023-12-17T11:49:55.304169+0000","last_fullsized":"2023-12-17T11:49:55.304169+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_clean_scrub_stamp":"2023-12-17T11:49:51.168108+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T12:12:44.640100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:56.655694+0000","last_change":"2023-12-17T11:49:53.251691+0000","last_active":"2023-12-17T11:49:56.655694+0000","last_peered":"2023-12-17T11:49:56.655694+0000","last_clean":"2023-12-17T11:49:56.655694+0000","last_became_active":"2023-12-17T11:49:53.251175+0000","last_became_peered":"2023-12-17T11:49:53.251175+0000","last_unstale":"2023-12-17T11:49:56.655694+0000","last_undegraded":"2023-12-17T11:49:56.655694+0000","last_fullsized":"2023-12-17T11:49:56.655694+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T14:00:43.418107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"39'1","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:55.301855+0000","last_change":"2023-12-17T11:49:52.225053+0000","last_active":"2023-12-17T11:49:55.301855+0000","last_peered":"2023-12-17T11:49:55.301855+0000","last_clean":"2023-12-17T11:49:55.301855+0000","last_became_active":"2023-12-17T11:49:52.224761+0000","last_became_peered":"2023-12-17T11:49:52.224761+0000","last_unstale":"2023-12-17T11:49:55.301855+0000","last_undegraded":"2023-12-17T11:49:55.301855+0000","last_fullsized":"2023-12-17T11:49:55.301855+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_clean_scrub_stamp":"2023-12-17T11:49:51.168108+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T20:30:07.106128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":14,"reported_epoch":42,"state":"activating","last_fresh":"2023-12-17T11:50:01.545212+0000","last_change":"2023-12-17T11:50:01.545825+0000","last_active":"2023-12-17T11:50:00.523935+0000","last_peered":"2023-12-17T11:49:56.657918+0000","last_clean":"2023-12-17T11:49:56.657918+0000","last_became_active":"2023-12-17T11:49:53.254841+0000","last_became_peered":"2023-12-17T11:49:53.254841+0000","last_unstale":"2023-12-17T11:50:01.545212+0000","last_undegraded":"2023-12-17T11:50:01.545212+0000","last_fullsized":"2023-12-17T11:50:01.545212+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T19:23:44.505187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":["4","0","5"],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:54.556572+0000","last_change":"2023-12-17T11:49:52.230598+0000","last_active":"2023-12-17T11:49:54.556572+0000","last_peered":"2023-12-17T11:49:54.556572+0000","last_clean":"2023-12-17T11:49:54.556572+0000","last_became_active":"2023-12-17T11:49:52.230298+0000","last_became_peered":"2023-12-17T11:49:52.230298+0000","last_unstale":"2023-12-17T11:49:54.556572+0000","last_undegraded":"2023-12-17T11:49:54.556572+0000","last_fullsized":"2023-12-17T11:49:54.556572+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_clean_scrub_stamp":"2023-12-17T11:49:51.168108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T22:39:30.094160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-17T11:50:00.523881+0000","last_change":"2023-12-17T11:49:53.249431+0000","last_active":"2023-12-17T11:50:00.523881+0000","last_peered":"2023-12-17T11:50:00.523881+0000","last_clean":"2023-12-17T11:50:00.523881+0000","last_became_active":"2023-12-17T11:49:53.248943+0000","last_became_peered":"2023-12-17T11:49:53.248943+0000","last_unstale":"2023-12-17T11:50:00.523881+0000","last_undegraded":"2023-12-17T11:50:00.523881+0000","last_fullsized":"2023-12-17T11:50:00.523881+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T16:21:14.355302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-17T11:50:00.522481+0000","last_change":"2023-12-17T11:49:52.224198+0000","last_active":"2023-12-17T11:50:00.522481+0000","last_peered":"2023-12-17T11:50:00.522481+0000","last_clean":"2023-12-17T11:50:00.522481+0000","last_became_active":"2023-12-17T11:49:52.223829+0000","last_became_peered":"2023-12-17T11:49:52.223829+0000","last_unstale":"2023-12-17T11:50:00.522481+0000","last_undegraded":"2023-12-17T11:50:00.522481+0000","last_fullsized":"2023-12-17T11:50:00.522481+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_clean_scrub_stamp":"2023-12-17T11:49:51.168108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T13:20:29.045455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:56.663647+0000","last_change":"2023-12-17T11:49:53.232883+0000","last_active":"2023-12-17T11:49:56.663647+0000","last_peered":"2023-12-17T11:49:56.663647+0000","last_clean":"2023-12-17T11:49:56.663647+0000","last_became_active":"2023-12-17T11:49:53.232629+0000","last_became_peered":"2023-12-17T11:49:53.232629+0000","last_unstale":"2023-12-17T11:49:56.663647+0000","last_undegraded":"2023-12-17T11:49:56.663647+0000","last_fullsized":"2023-12-17T11:49:56.663647+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T18:07:10.105462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-17T11:50:00.525489+0000","last_change":"2023-12-17T11:49:52.215890+0000","last_active":"2023-12-17T11:50:00.525489+0000","last_peered":"2023-12-17T11:50:00.525489+0000","last_clean":"2023-12-17T11:50:00.525489+0000","last_became_active":"2023-12-17T11:49:52.215576+0000","last_became_peered":"2023-12-17T11:49:52.215576+0000","last_unstale":"2023-12-17T11:50:00.525489+0000","last_undegraded":"2023-12-17T11:50:00.525489+0000","last_fullsized":"2023-12-17T11:50:00.525489+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_clean_scrub_stamp":"2023-12-17T11:49:51.168108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T17:03:59.637357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:55.302907+0000","last_change":"2023-12-17T11:49:53.236661+0000","last_active":"2023-12-17T11:49:55.302907+0000","last_peered":"2023-12-17T11:49:55.302907+0000","last_clean":"2023-12-17T11:49:55.302907+0000","last_became_active":"2023-12-17T11:49:53.236319+0000","last_became_peered":"2023-12-17T11:49:53.236319+0000","last_unstale":"2023-12-17T11:49:55.302907+0000","last_undegraded":"2023-12-17T11:49:55.302907+0000","last_fullsized":"2023-12-17T11:49:55.302907+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T13:29:01.309715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:55.305000+0000","last_change":"2023-12-17T11:49:52.233070+0000","last_active":"2023-12-17T11:49:55.305000+0000","last_peered":"2023-12-17T11:49:55.305000+0000","last_clean":"2023-12-17T11:49:55.305000+0000","last_became_active":"2023-12-17T11:49:52.232635+0000","last_became_peered":"2023-12-17T11:49:52.232635+0000","last_unstale":"2023-12-17T11:49:55.305000+0000","last_undegraded":"2023-12-17T11:49:55.305000+0000","last_fullsized":"2023-12-17T11:49:55.305000+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_clean_scrub_stamp":"2023-12-17T11:49:51.168108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T15:53:07.030004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:56.659403+0000","last_change":"2023-12-17T11:49:53.246755+0000","last_active":"2023-12-17T11:49:56.659403+0000","last_peered":"2023-12-17T11:49:56.659403+0000","last_clean":"2023-12-17T11:49:56.659403+0000","last_became_active":"2023-12-17T11:49:53.245111+0000","last_became_peered":"2023-12-17T11:49:53.245111+0000","last_unstale":"2023-12-17T11:49:56.659403+0000","last_undegraded":"2023-12-17T11:49:56.659403+0000","last_fullsized":"2023-12-17T11:49:56.659403+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T14:59:11.557660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"39'3","reported_seq":16,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:55.304936+0000","last_change":"2023-12-17T11:49:52.231475+0000","last_active":"2023-12-17T11:49:55.304936+0000","last_peered":"2023-12-17T11:49:55.304936+0000","last_clean":"2023-12-17T11:49:55.304936+0000","last_became_active":"2023-12-17T11:49:52.230061+0000","last_became_peered":"2023-12-17T11:49:52.230061+0000","last_unstale":"2023-12-17T11:49:55.304936+0000","last_undegraded":"2023-12-17T11:49:55.304936+0000","last_fullsized":"2023-12-17T11:49:55.304936+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_clean_scrub_stamp":"2023-12-17T11:49:51.168108+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T22:50:11.250530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-17T11:50:00.523324+0000","last_change":"2023-12-17T11:49:53.232224+0000","last_active":"2023-12-17T11:50:00.523324+0000","last_peered":"2023-12-17T11:50:00.523324+0000","last_clean":"2023-12-17T11:50:00.523324+0000","last_became_active":"2023-12-17T11:49:53.231963+0000","last_became_peered":"2023-12-17T11:49:53.231963+0000","last_unstale":"2023-12-17T11:50:00.523324+0000","last_undegraded":"2023-12-17T11:50:00.523324+0000","last_fullsized":"2023-12-17T11:50:00.523324+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T15:14:36.959400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"39'6","reported_seq":20,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-17T11:50:00.524725+0000","last_change":"2023-12-17T11:49:52.220583+0000","last_active":"2023-12-17T11:50:00.524725+0000","last_peered":"2023-12-17T11:50:00.524725+0000","last_clean":"2023-12-17T11:50:00.524725+0000","last_became_active":"2023-12-17T11:49:52.220304+0000","last_became_peered":"2023-12-17T11:49:52.220304+0000","last_unstale":"2023-12-17T11:50:00.524725+0000","last_undegraded":"2023-12-17T11:50:00.524725+0000","last_fullsized":"2023-12-17T11:50:00.524725+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_clean_scrub_stamp":"2023-12-17T11:49:51.168108+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T12:27:37.121319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:56.659257+0000","last_change":"2023-12-17T11:49:53.248442+0000","last_active":"2023-12-17T11:49:56.659257+0000","last_peered":"2023-12-17T11:49:56.659257+0000","last_clean":"2023-12-17T11:49:56.659257+0000","last_became_active":"2023-12-17T11:49:53.248094+0000","last_became_peered":"2023-12-17T11:49:53.248094+0000","last_unstale":"2023-12-17T11:49:56.659257+0000","last_undegraded":"2023-12-17T11:49:56.659257+0000","last_fullsized":"2023-12-17T11:49:56.659257+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T14:42:29.543380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"39'2","reported_seq":16,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-17T11:50:00.524311+0000","last_change":"2023-12-17T11:49:52.213341+0000","last_active":"2023-12-17T11:50:00.524311+0000","last_peered":"2023-12-17T11:50:00.524311+0000","last_clean":"2023-12-17T11:50:00.524311+0000","last_became_active":"2023-12-17T11:49:52.213024+0000","last_became_peered":"2023-12-17T11:49:52.213024+0000","last_unstale":"2023-12-17T11:50:00.524311+0000","last_undegraded":"2023-12-17T11:50:00.524311+0000","last_fullsized":"2023-12-17T11:50:00.524311+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_clean_scrub_stamp":"2023-12-17T11:49:51.168108+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T20:34:24.431589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-17T11:50:00.522731+0000","last_change":"2023-12-17T11:49:53.238931+0000","last_active":"2023-12-17T11:50:00.522731+0000","last_peered":"2023-12-17T11:50:00.522731+0000","last_clean":"2023-12-17T11:50:00.522731+0000","last_became_active":"2023-12-17T11:49:53.238641+0000","last_became_peered":"2023-12-17T11:49:53.238641+0000","last_unstale":"2023-12-17T11:50:00.522731+0000","last_undegraded":"2023-12-17T11:50:00.522731+0000","last_fullsized":"2023-12-17T11:50:00.522731+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T13:29:29.953615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:54.556680+0000","last_change":"2023-12-17T11:49:52.232507+0000","last_active":"2023-12-17T11:49:54.556680+0000","last_peered":"2023-12-17T11:49:54.556680+0000","last_clean":"2023-12-17T11:49:54.556680+0000","last_became_active":"2023-12-17T11:49:52.232308+0000","last_became_peered":"2023-12-17T11:49:52.232308+0000","last_unstale":"2023-12-17T11:49:54.556680+0000","last_undegraded":"2023-12-17T11:49:54.556680+0000","last_fullsized":"2023-12-17T11:49:54.556680+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_clean_scrub_stamp":"2023-12-17T11:49:51.168108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T19:17:46.282779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:55.301864+0000","last_change":"2023-12-17T11:49:53.234701+0000","last_active":"2023-12-17T11:49:55.301864+0000","last_peered":"2023-12-17T11:49:55.301864+0000","last_clean":"2023-12-17T11:49:55.301864+0000","last_became_active":"2023-12-17T11:49:53.234389+0000","last_became_peered":"2023-12-17T11:49:53.234389+0000","last_unstale":"2023-12-17T11:49:55.301864+0000","last_undegraded":"2023-12-17T11:49:55.301864+0000","last_fullsized":"2023-12-17T11:49:55.301864+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T17:54:34.803705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-17T11:50:01.202070+0000","last_change":"2023-12-17T11:49:52.226465+0000","last_active":"2023-12-17T11:50:01.202070+0000","last_peered":"2023-12-17T11:50:01.202070+0000","last_clean":"2023-12-17T11:50:01.202070+0000","last_became_active":"2023-12-17T11:49:52.226191+0000","last_became_peered":"2023-12-17T11:49:52.226191+0000","last_unstale":"2023-12-17T11:50:01.202070+0000","last_undegraded":"2023-12-17T11:50:01.202070+0000","last_fullsized":"2023-12-17T11:50:01.202070+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_clean_scrub_stamp":"2023-12-17T11:49:51.168108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T18:03:39.554935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-17T11:50:00.524016+0000","last_change":"2023-12-17T11:49:53.254934+0000","last_active":"2023-12-17T11:50:00.524016+0000","last_peered":"2023-12-17T11:50:00.524016+0000","last_clean":"2023-12-17T11:50:00.524016+0000","last_became_active":"2023-12-17T11:49:53.254632+0000","last_became_peered":"2023-12-17T11:49:53.254632+0000","last_unstale":"2023-12-17T11:50:00.524016+0000","last_undegraded":"2023-12-17T11:50:00.524016+0000","last_fullsized":"2023-12-17T11:50:00.524016+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T23:33:06.562683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"39'8","reported_seq":20,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:55.301546+0000","last_change":"2023-12-17T11:49:52.226787+0000","last_active":"2023-12-17T11:49:55.301546+0000","last_peered":"2023-12-17T11:49:55.301546+0000","last_clean":"2023-12-17T11:49:55.301546+0000","last_became_active":"2023-12-17T11:49:52.226471+0000","last_became_peered":"2023-12-17T11:49:52.226471+0000","last_unstale":"2023-12-17T11:49:55.301546+0000","last_undegraded":"2023-12-17T11:49:55.301546+0000","last_fullsized":"2023-12-17T11:49:55.301546+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_clean_scrub_stamp":"2023-12-17T11:49:51.168108+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T17:27:58.587187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-17T11:50:00.524643+0000","last_change":"2023-12-17T11:49:53.253979+0000","last_active":"2023-12-17T11:50:00.524643+0000","last_peered":"2023-12-17T11:50:00.524643+0000","last_clean":"2023-12-17T11:50:00.524643+0000","last_became_active":"2023-12-17T11:49:53.253694+0000","last_became_peered":"2023-12-17T11:49:53.253694+0000","last_unstale":"2023-12-17T11:50:00.524643+0000","last_undegraded":"2023-12-17T11:50:00.524643+0000","last_fullsized":"2023-12-17T11:50:00.524643+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T19:26:47.162716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"39'1","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:55.305058+0000","last_change":"2023-12-17T11:49:52.231973+0000","last_active":"2023-12-17T11:49:55.305058+0000","last_peered":"2023-12-17T11:49:55.305058+0000","last_clean":"2023-12-17T11:49:55.305058+0000","last_became_active":"2023-12-17T11:49:52.231641+0000","last_became_peered":"2023-12-17T11:49:52.231641+0000","last_unstale":"2023-12-17T11:49:55.305058+0000","last_undegraded":"2023-12-17T11:49:55.305058+0000","last_fullsized":"2023-12-17T11:49:55.305058+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_clean_scrub_stamp":"2023-12-17T11:49:51.168108+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T20:34:24.431589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:56.655838+0000","last_change":"2023-12-17T11:49:53.253141+0000","last_active":"2023-12-17T11:49:56.655838+0000","last_peered":"2023-12-17T11:49:56.655838+0000","last_clean":"2023-12-17T11:49:56.655838+0000","last_became_active":"2023-12-17T11:49:53.252532+0000","last_became_peered":"2023-12-17T11:49:53.252532+0000","last_unstale":"2023-12-17T11:49:56.655838+0000","last_undegraded":"2023-12-17T11:49:56.655838+0000","last_fullsized":"2023-12-17T11:49:56.655838+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T22:42:15.785143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"39'2","reported_seq":16,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-17T11:50:00.523361+0000","last_change":"2023-12-17T11:49:52.230858+0000","last_active":"2023-12-17T11:50:00.523361+0000","last_peered":"2023-12-17T11:50:00.523361+0000","last_clean":"2023-12-17T11:50:00.523361+0000","last_became_active":"2023-12-17T11:49:52.230281+0000","last_became_peered":"2023-12-17T11:49:52.230281+0000","last_unstale":"2023-12-17T11:50:00.523361+0000","last_undegraded":"2023-12-17T11:50:00.523361+0000","last_fullsized":"2023-12-17T11:50:00.523361+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_clean_scrub_stamp":"2023-12-17T11:49:51.168108+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T22:39:30.094160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-17T11:50:00.523134+0000","last_change":"2023-12-17T11:49:53.251192+0000","last_active":"2023-12-17T11:50:00.523134+0000","last_peered":"2023-12-17T11:50:00.523134+0000","last_clean":"2023-12-17T11:50:00.523134+0000","last_became_active":"2023-12-17T11:49:53.250837+0000","last_became_peered":"2023-12-17T11:49:53.250837+0000","last_unstale":"2023-12-17T11:50:00.523134+0000","last_undegraded":"2023-12-17T11:50:00.523134+0000","last_fullsized":"2023-12-17T11:50:00.523134+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T14:42:29.543380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"39'1","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:55.300966+0000","last_change":"2023-12-17T11:49:52.222238+0000","last_active":"2023-12-17T11:49:55.300966+0000","last_peered":"2023-12-17T11:49:55.300966+0000","last_clean":"2023-12-17T11:49:55.300966+0000","last_became_active":"2023-12-17T11:49:52.221941+0000","last_became_peered":"2023-12-17T11:49:52.221941+0000","last_unstale":"2023-12-17T11:49:55.300966+0000","last_undegraded":"2023-12-17T11:49:55.300966+0000","last_fullsized":"2023-12-17T11:49:55.300966+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_clean_scrub_stamp":"2023-12-17T11:49:51.168108+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T12:43:47.651883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:56.663718+0000","last_change":"2023-12-17T11:49:53.253162+0000","last_active":"2023-12-17T11:49:56.663718+0000","last_peered":"2023-12-17T11:49:56.663718+0000","last_clean":"2023-12-17T11:49:56.663718+0000","last_became_active":"2023-12-17T11:49:53.252770+0000","last_became_peered":"2023-12-17T11:49:53.252770+0000","last_unstale":"2023-12-17T11:49:56.663718+0000","last_undegraded":"2023-12-17T11:49:56.663718+0000","last_fullsized":"2023-12-17T11:49:56.663718+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T14:03:09.358474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:54.557332+0000","last_change":"2023-12-17T11:49:52.223776+0000","last_active":"2023-12-17T11:49:54.557332+0000","last_peered":"2023-12-17T11:49:54.557332+0000","last_clean":"2023-12-17T11:49:54.557332+0000","last_became_active":"2023-12-17T11:49:52.223571+0000","last_became_peered":"2023-12-17T11:49:52.223571+0000","last_unstale":"2023-12-17T11:49:54.557332+0000","last_undegraded":"2023-12-17T11:49:54.557332+0000","last_fullsized":"2023-12-17T11:49:54.557332+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_clean_scrub_stamp":"2023-12-17T11:49:51.168108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T22:59:00.390569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:55.301868+0000","last_change":"2023-12-17T11:49:53.232411+0000","last_active":"2023-12-17T11:49:55.301868+0000","last_peered":"2023-12-17T11:49:55.301868+0000","last_clean":"2023-12-17T11:49:55.301868+0000","last_became_active":"2023-12-17T11:49:53.232101+0000","last_became_peered":"2023-12-17T11:49:53.232101+0000","last_unstale":"2023-12-17T11:49:55.301868+0000","last_undegraded":"2023-12-17T11:49:55.301868+0000","last_fullsized":"2023-12-17T11:49:55.301868+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T11:57:59.882385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"39'2","reported_seq":15,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:55.300347+0000","last_change":"2023-12-17T11:49:52.210836+0000","last_active":"2023-12-17T11:49:55.300347+0000","last_peered":"2023-12-17T11:49:55.300347+0000","last_clean":"2023-12-17T11:49:55.300347+0000","last_became_active":"2023-12-17T11:49:52.210521+0000","last_became_peered":"2023-12-17T11:49:52.210521+0000","last_unstale":"2023-12-17T11:49:55.300347+0000","last_undegraded":"2023-12-17T11:49:55.300347+0000","last_fullsized":"2023-12-17T11:49:55.300347+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_clean_scrub_stamp":"2023-12-17T11:49:51.168108+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T17:20:36.726376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:56.659317+0000","last_change":"2023-12-17T11:49:53.243230+0000","last_active":"2023-12-17T11:49:56.659317+0000","last_peered":"2023-12-17T11:49:56.659317+0000","last_clean":"2023-12-17T11:49:56.659317+0000","last_became_active":"2023-12-17T11:49:53.242951+0000","last_became_peered":"2023-12-17T11:49:53.242951+0000","last_unstale":"2023-12-17T11:49:56.659317+0000","last_undegraded":"2023-12-17T11:49:56.659317+0000","last_fullsized":"2023-12-17T11:49:56.659317+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T18:42:00.093282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:55.300327+0000","last_change":"2023-12-17T11:49:52.217136+0000","last_active":"2023-12-17T11:49:55.300327+0000","last_peered":"2023-12-17T11:49:55.300327+0000","last_clean":"2023-12-17T11:49:55.300327+0000","last_became_active":"2023-12-17T11:49:52.216921+0000","last_became_peered":"2023-12-17T11:49:52.216921+0000","last_unstale":"2023-12-17T11:49:55.300327+0000","last_undegraded":"2023-12-17T11:49:55.300327+0000","last_fullsized":"2023-12-17T11:49:55.300327+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_clean_scrub_stamp":"2023-12-17T11:49:51.168108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T19:32:12.805680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:56.655717+0000","last_change":"2023-12-17T11:49:53.255643+0000","last_active":"2023-12-17T11:49:56.655717+0000","last_peered":"2023-12-17T11:49:56.655717+0000","last_clean":"2023-12-17T11:49:56.655717+0000","last_became_active":"2023-12-17T11:49:53.255379+0000","last_became_peered":"2023-12-17T11:49:53.255379+0000","last_unstale":"2023-12-17T11:49:56.655717+0000","last_undegraded":"2023-12-17T11:49:56.655717+0000","last_fullsized":"2023-12-17T11:49:56.655717+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T16:21:14.355302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:55.301924+0000","last_change":"2023-12-17T11:49:52.229883+0000","last_active":"2023-12-17T11:49:55.301924+0000","last_peered":"2023-12-17T11:49:55.301924+0000","last_clean":"2023-12-17T11:49:55.301924+0000","last_became_active":"2023-12-17T11:49:52.229372+0000","last_became_peered":"2023-12-17T11:49:52.229372+0000","last_unstale":"2023-12-17T11:49:55.301924+0000","last_undegraded":"2023-12-17T11:49:55.301924+0000","last_fullsized":"2023-12-17T11:49:55.301924+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_clean_scrub_stamp":"2023-12-17T11:49:51.168108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T23:27:59.830582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-17T11:50:00.524144+0000","last_change":"2023-12-17T11:49:53.249227+0000","last_active":"2023-12-17T11:50:00.524144+0000","last_peered":"2023-12-17T11:50:00.524144+0000","last_clean":"2023-12-17T11:50:00.524144+0000","last_became_active":"2023-12-17T11:49:53.248594+0000","last_became_peered":"2023-12-17T11:49:53.248594+0000","last_unstale":"2023-12-17T11:50:00.524144+0000","last_undegraded":"2023-12-17T11:50:00.524144+0000","last_fullsized":"2023-12-17T11:50:00.524144+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T14:31:17.752657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:55.300293+0000","last_change":"2023-12-17T11:49:52.211707+0000","last_active":"2023-12-17T11:49:55.300293+0000","last_peered":"2023-12-17T11:49:55.300293+0000","last_clean":"2023-12-17T11:49:55.300293+0000","last_became_active":"2023-12-17T11:49:52.211283+0000","last_became_peered":"2023-12-17T11:49:52.211283+0000","last_unstale":"2023-12-17T11:49:55.300293+0000","last_undegraded":"2023-12-17T11:49:55.300293+0000","last_fullsized":"2023-12-17T11:49:55.300293+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_clean_scrub_stamp":"2023-12-17T11:49:51.168108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T12:54:05.203029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:56.660005+0000","last_change":"2023-12-17T11:49:53.255235+0000","last_active":"2023-12-17T11:49:56.660005+0000","last_peered":"2023-12-17T11:49:56.660005+0000","last_clean":"2023-12-17T11:49:56.660005+0000","last_became_active":"2023-12-17T11:49:53.254570+0000","last_became_peered":"2023-12-17T11:49:53.254570+0000","last_unstale":"2023-12-17T11:49:56.660005+0000","last_undegraded":"2023-12-17T11:49:56.660005+0000","last_fullsized":"2023-12-17T11:49:56.660005+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T15:14:36.959400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"39'2","reported_seq":15,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:55.305320+0000","last_change":"2023-12-17T11:49:52.229686+0000","last_active":"2023-12-17T11:49:55.305320+0000","last_peered":"2023-12-17T11:49:55.305320+0000","last_clean":"2023-12-17T11:49:55.305320+0000","last_became_active":"2023-12-17T11:49:52.229401+0000","last_became_peered":"2023-12-17T11:49:52.229401+0000","last_unstale":"2023-12-17T11:49:55.305320+0000","last_undegraded":"2023-12-17T11:49:55.305320+0000","last_fullsized":"2023-12-17T11:49:55.305320+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_clean_scrub_stamp":"2023-12-17T11:49:51.168108+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T17:03:59.637357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:55.302996+0000","last_change":"2023-12-17T11:49:53.236908+0000","last_active":"2023-12-17T11:49:55.302996+0000","last_peered":"2023-12-17T11:49:55.302996+0000","last_clean":"2023-12-17T11:49:55.302996+0000","last_became_active":"2023-12-17T11:49:53.236508+0000","last_became_peered":"2023-12-17T11:49:53.236508+0000","last_unstale":"2023-12-17T11:49:55.302996+0000","last_undegraded":"2023-12-17T11:49:55.302996+0000","last_fullsized":"2023-12-17T11:49:55.302996+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T13:59:52.939825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"40'1","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:58.273630+0000","last_change":"2023-12-17T11:49:52.229067+0000","last_active":"2023-12-17T11:49:58.273630+0000","last_peered":"2023-12-17T11:49:58.273630+0000","last_clean":"2023-12-17T11:49:58.273630+0000","last_became_active":"2023-12-17T11:49:52.228704+0000","last_became_peered":"2023-12-17T11:49:52.228704+0000","last_unstale":"2023-12-17T11:49:58.273630+0000","last_undegraded":"2023-12-17T11:49:58.273630+0000","last_fullsized":"2023-12-17T11:49:58.273630+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_clean_scrub_stamp":"2023-12-17T11:49:51.168108+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T16:31:06.129915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-17T11:50:00.524876+0000","last_change":"2023-12-17T11:49:53.246415+0000","last_active":"2023-12-17T11:50:00.524876+0000","last_peered":"2023-12-17T11:50:00.524876+0000","last_clean":"2023-12-17T11:50:00.524876+0000","last_became_active":"2023-12-17T11:49:53.246163+0000","last_became_peered":"2023-12-17T11:49:53.246163+0000","last_unstale":"2023-12-17T11:50:00.524876+0000","last_undegraded":"2023-12-17T11:50:00.524876+0000","last_fullsized":"2023-12-17T11:50:00.524876+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T17:56:09.285369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:55.302270+0000","last_change":"2023-12-17T11:49:52.219865+0000","last_active":"2023-12-17T11:49:55.302270+0000","last_peered":"2023-12-17T11:49:55.302270+0000","last_clean":"2023-12-17T11:49:55.302270+0000","last_became_active":"2023-12-17T11:49:52.219593+0000","last_became_peered":"2023-12-17T11:49:52.219593+0000","last_unstale":"2023-12-17T11:49:55.302270+0000","last_undegraded":"2023-12-17T11:49:55.302270+0000","last_fullsized":"2023-12-17T11:49:55.302270+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_clean_scrub_stamp":"2023-12-17T11:49:51.168108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T15:14:35.947970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:56.659295+0000","last_change":"2023-12-17T11:49:53.242876+0000","last_active":"2023-12-17T11:49:56.659295+0000","last_peered":"2023-12-17T11:49:56.659295+0000","last_clean":"2023-12-17T11:49:56.659295+0000","last_became_active":"2023-12-17T11:49:53.242568+0000","last_became_peered":"2023-12-17T11:49:53.242568+0000","last_unstale":"2023-12-17T11:49:56.659295+0000","last_undegraded":"2023-12-17T11:49:56.659295+0000","last_fullsized":"2023-12-17T11:49:56.659295+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T23:10:56.100255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:55.302112+0000","last_change":"2023-12-17T11:49:52.223424+0000","last_active":"2023-12-17T11:49:55.302112+0000","last_peered":"2023-12-17T11:49:55.302112+0000","last_clean":"2023-12-17T11:49:55.302112+0000","last_became_active":"2023-12-17T11:49:52.223126+0000","last_became_peered":"2023-12-17T11:49:52.223126+0000","last_unstale":"2023-12-17T11:49:55.302112+0000","last_undegraded":"2023-12-17T11:49:55.302112+0000","last_fullsized":"2023-12-17T11:49:55.302112+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_clean_scrub_stamp":"2023-12-17T11:49:51.168108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T14:31:59.450792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:56.659933+0000","last_change":"2023-12-17T11:49:53.251516+0000","last_active":"2023-12-17T11:49:56.659933+0000","last_peered":"2023-12-17T11:49:56.659933+0000","last_clean":"2023-12-17T11:49:56.659933+0000","last_became_active":"2023-12-17T11:49:53.251230+0000","last_became_peered":"2023-12-17T11:49:53.251230+0000","last_unstale":"2023-12-17T11:49:56.659933+0000","last_undegraded":"2023-12-17T11:49:56.659933+0000","last_fullsized":"2023-12-17T11:49:56.659933+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T19:39:18.340154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-17T11:50:01.202294+0000","last_change":"2023-12-17T11:49:52.219807+0000","last_active":"2023-12-17T11:50:01.202294+0000","last_peered":"2023-12-17T11:50:01.202294+0000","last_clean":"2023-12-17T11:50:01.202294+0000","last_became_active":"2023-12-17T11:49:52.219503+0000","last_became_peered":"2023-12-17T11:49:52.219503+0000","last_unstale":"2023-12-17T11:50:01.202294+0000","last_undegraded":"2023-12-17T11:50:01.202294+0000","last_fullsized":"2023-12-17T11:50:01.202294+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_clean_scrub_stamp":"2023-12-17T11:49:51.168108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T18:07:09.094032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-17T11:50:00.522740+0000","last_change":"2023-12-17T11:49:53.241750+0000","last_active":"2023-12-17T11:50:00.522740+0000","last_peered":"2023-12-17T11:50:00.522740+0000","last_clean":"2023-12-17T11:50:00.522740+0000","last_became_active":"2023-12-17T11:49:53.241529+0000","last_became_peered":"2023-12-17T11:49:53.241529+0000","last_unstale":"2023-12-17T11:50:00.522740+0000","last_undegraded":"2023-12-17T11:50:00.522740+0000","last_fullsized":"2023-12-17T11:50:00.522740+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T16:31:53.964205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-17T11:50:00.522300+0000","last_change":"2023-12-17T11:49:52.216579+0000","last_active":"2023-12-17T11:50:00.522300+0000","last_peered":"2023-12-17T11:50:00.522300+0000","last_clean":"2023-12-17T11:50:00.522300+0000","last_became_active":"2023-12-17T11:49:52.216265+0000","last_became_peered":"2023-12-17T11:49:52.216265+0000","last_unstale":"2023-12-17T11:50:00.522300+0000","last_undegraded":"2023-12-17T11:50:00.522300+0000","last_fullsized":"2023-12-17T11:50:00.522300+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_clean_scrub_stamp":"2023-12-17T11:49:51.168108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T14:31:59.450792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:55.302580+0000","last_change":"2023-12-17T11:49:53.234303+0000","last_active":"2023-12-17T11:49:55.302580+0000","last_peered":"2023-12-17T11:49:55.302580+0000","last_clean":"2023-12-17T11:49:55.302580+0000","last_became_active":"2023-12-17T11:49:53.233951+0000","last_became_peered":"2023-12-17T11:49:53.233951+0000","last_unstale":"2023-12-17T11:49:55.302580+0000","last_undegraded":"2023-12-17T11:49:55.302580+0000","last_fullsized":"2023-12-17T11:49:55.302580+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T19:17:38.569694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-17T11:50:00.522523+0000","last_change":"2023-12-17T11:49:52.219957+0000","last_active":"2023-12-17T11:50:00.522523+0000","last_peered":"2023-12-17T11:50:00.522523+0000","last_clean":"2023-12-17T11:50:00.522523+0000","last_became_active":"2023-12-17T11:49:52.219626+0000","last_became_peered":"2023-12-17T11:49:52.219626+0000","last_unstale":"2023-12-17T11:50:00.522523+0000","last_undegraded":"2023-12-17T11:50:00.522523+0000","last_fullsized":"2023-12-17T11:50:00.522523+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_clean_scrub_stamp":"2023-12-17T11:49:51.168108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T19:12:11.016281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:56.655904+0000","last_change":"2023-12-17T11:49:53.253151+0000","last_active":"2023-12-17T11:49:56.655904+0000","last_peered":"2023-12-17T11:49:56.655904+0000","last_clean":"2023-12-17T11:49:56.655904+0000","last_became_active":"2023-12-17T11:49:53.252842+0000","last_became_peered":"2023-12-17T11:49:53.252842+0000","last_unstale":"2023-12-17T11:49:56.655904+0000","last_undegraded":"2023-12-17T11:49:56.655904+0000","last_fullsized":"2023-12-17T11:49:56.655904+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T14:31:17.752657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:55.302520+0000","last_change":"2023-12-17T11:49:52.228110+0000","last_active":"2023-12-17T11:49:55.302520+0000","last_peered":"2023-12-17T11:49:55.302520+0000","last_clean":"2023-12-17T11:49:55.302520+0000","last_became_active":"2023-12-17T11:49:52.227851+0000","last_became_peered":"2023-12-17T11:49:52.227851+0000","last_unstale":"2023-12-17T11:49:55.302520+0000","last_undegraded":"2023-12-17T11:49:55.302520+0000","last_fullsized":"2023-12-17T11:49:55.302520+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_clean_scrub_stamp":"2023-12-17T11:49:51.168108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T18:37:20.380970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":180,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-17T11:49:53.217829+0000","last_change":"2023-12-17T11:48:07.952584+0000","last_active":"2023-12-17T11:49:53.217829+0000","last_peered":"2023-12-17T11:49:53.217829+0000","last_clean":"2023-12-17T11:49:53.217829+0000","last_became_active":"2023-12-17T11:48:07.950361+0000","last_became_peered":"2023-12-17T11:48:07.950361+0000","last_unstale":"2023-12-17T11:49:53.217829+0000","last_undegraded":"2023-12-17T11:49:53.217829+0000","last_fullsized":"2023-12-17T11:49:53.217829+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:06.728199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:06.728199+0000","last_clean_scrub_stamp":"2023-12-17T11:48:06.728199+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T12:47:55.048065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542171,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28064,"kb_used_data":1044,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343776,"statfs":{"total":96636764160,"available":96608026624,"internally_reserved":0,"allocated":1069056,"data_stored":789626,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 17 11:49:06 2023","interfaces":[{"interface":"back","average":{"1min":1.407,"5min":1.407,"15min":1.407},"min":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":8.6579999999999995,"5min":8.6579999999999995,"15min":8.6579999999999995},"last":1.288},{"interface":"front","average":{"1min":1.339,"5min":1.339,"15min":1.339},"min":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"max":{"1min":4.0830000000000002,"5min":4.0830000000000002,"15min":4.0830000000000002},"last":1.3360000000000001}]},{"osd":1,"last update":"Sun Dec 17 11:49:06 2023","interfaces":[{"interface":"back","average":{"1min":1.127,"5min":1.127,"15min":1.127},"min":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"max":{"1min":2.1539999999999999,"5min":2.1539999999999999,"15min":2.1539999999999999},"last":1.6850000000000001},{"interface":"front","average":{"1min":1.413,"5min":1.413,"15min":1.413},"min":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"max":{"1min":8.7449999999999992,"5min":8.7449999999999992,"15min":8.7449999999999992},"last":1.014}]},{"osd":2,"last update":"Sun Dec 17 11:49:06 2023","interfaces":[{"interface":"back","average":{"1min":1.4299999999999999,"5min":1.4299999999999999,"15min":1.4299999999999999},"min":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"max":{"1min":4.1239999999999997,"5min":4.1239999999999997,"15min":4.1239999999999997},"last":1.2130000000000001},{"interface":"front","average":{"1min":1.3720000000000001,"5min":1.3720000000000001,"15min":1.3720000000000001},"min":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"max":{"1min":1.782,"5min":1.782,"15min":1.782},"last":0.92300000000000004}]},{"osd":3,"last update":"Sun Dec 17 11:49:06 2023","interfaces":[{"interface":"back","average":{"1min":1.298,"5min":1.298,"15min":1.298},"min":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"max":{"1min":2.5430000000000001,"5min":2.5430000000000001,"15min":2.5430000000000001},"last":1.556},{"interface":"front","average":{"1min":1.375,"5min":1.375,"15min":1.375},"min":{"1min":1.087,"5min":1.087,"15min":1.087},"max":{"1min":2.5830000000000002,"5min":2.5830000000000002,"15min":2.5830000000000002},"last":1.3740000000000001}]},{"osd":4,"last update":"Sun Dec 17 11:49:06 2023","interfaces":[{"interface":"back","average":{"1min":1.3859999999999999,"5min":1.3859999999999999,"15min":1.3859999999999999},"min":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":4.0309999999999997,"5min":4.0309999999999997,"15min":4.0309999999999997},"last":1.498},{"interface":"front","average":{"1min":1.5860000000000001,"5min":1.5860000000000001,"15min":1.5860000000000001},"min":{"1min":1.2230000000000001,"5min":1.2230000000000001,"15min":1.2230000000000001},"max":{"1min":3.3220000000000001,"5min":3.3220000000000001,"15min":3.3220000000000001},"last":1.8120000000000001}]},{"osd":5,"last update":"Sun Dec 17 11:49:06 2023","interfaces":[{"interface":"back","average":{"1min":1.6970000000000001,"5min":1.6970000000000001,"15min":1.6970000000000001},"min":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"max":{"1min":8.7929999999999993,"5min":8.7929999999999993,"15min":8.7929999999999993},"last":1.4399999999999999},{"interface":"front","average":{"1min":1.6859999999999999,"5min":1.6859999999999999,"15min":1.6859999999999999},"min":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"max":{"1min":5.1040000000000001,"5min":5.1040000000000001,"15min":5.1040000000000001},"last":1.786}]},{"osd":6,"last update":"Sun Dec 17 11:49:06 2023","interfaces":[{"interface":"back","average":{"1min":1.845,"5min":1.845,"15min":1.845},"min":{"1min":1.081,"5min":1.081,"15min":1.081},"max":{"1min":8.8330000000000002,"5min":8.8330000000000002,"15min":8.8330000000000002},"last":1.6439999999999999},{"interface":"front","average":{"1min":1.71,"5min":1.71,"15min":1.71},"min":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"max":{"1min":3.9590000000000001,"5min":3.9590000000000001,"15min":3.9590000000000001},"last":1.6060000000000001}]}]},{"osd":6,"up_from":14,"seq":60129542171,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27480,"kb_used_data":452,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344360,"statfs":{"total":96636764160,"available":96608624640,"internally_reserved":0,"allocated":462848,"data_stored":198158,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 17 11:49:06 2023","interfaces":[{"interface":"back","average":{"1min":1.0720000000000001,"5min":1.0720000000000001,"15min":1.0720000000000001},"min":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.5840000000000001,"5min":1.5840000000000001,"15min":1.5840000000000001},"last":1.0169999999999999},{"interface":"front","average":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"min":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"max":{"1min":1.429,"5min":1.429,"15min":1.429},"last":1.8400000000000001}]},{"osd":1,"last update":"Sun Dec 17 11:49:06 2023","interfaces":[{"interface":"back","average":{"1min":1.2689999999999999,"5min":1.2689999999999999,"15min":1.2689999999999999},"min":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"max":{"1min":1.5640000000000001,"5min":1.5640000000000001,"15min":1.5640000000000001},"last":1.403},{"interface":"front","average":{"1min":1.3169999999999999,"5min":1.3169999999999999,"15min":1.3169999999999999},"min":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"max":{"1min":1.9359999999999999,"5min":1.9359999999999999,"15min":1.9359999999999999},"last":1.7809999999999999}]},{"osd":2,"last update":"Sun Dec 17 11:49:06 2023","interfaces":[{"interface":"back","average":{"1min":1.1970000000000001,"5min":1.1970000000000001,"15min":1.1970000000000001},"min":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":1.8740000000000001,"5min":1.8740000000000001,"15min":1.8740000000000001},"last":1.6930000000000001},{"interface":"front","average":{"1min":1.296,"5min":1.296,"15min":1.296},"min":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":2.5470000000000002,"5min":2.5470000000000002,"15min":2.5470000000000002},"last":1.29}]},{"osd":3,"last update":"Sun Dec 17 11:49:06 2023","interfaces":[{"interface":"back","average":{"1min":1.508,"5min":1.508,"15min":1.508},"min":{"1min":1.0840000000000001,"5min":1.0840000000000001,"15min":1.0840000000000001},"max":{"1min":2.4689999999999999,"5min":2.4689999999999999,"15min":2.4689999999999999},"last":1.9590000000000001},{"interface":"front","average":{"1min":1.4390000000000001,"5min":1.4390000000000001,"15min":1.4390000000000001},"min":{"1min":0.88,"5min":0.88,"15min":0.88},"max":{"1min":2.0680000000000001,"5min":2.0680000000000001,"15min":2.0680000000000001},"last":1.216}]},{"osd":4,"last update":"Sun Dec 17 11:49:06 2023","interfaces":[{"interface":"back","average":{"1min":1.522,"5min":1.522,"15min":1.522},"min":{"1min":1.1419999999999999,"5min":1.1419999999999999,"15min":1.1419999999999999},"max":{"1min":2.222,"5min":2.222,"15min":2.222},"last":1.5069999999999999},{"interface":"front","average":{"1min":1.4419999999999999,"5min":1.4419999999999999,"15min":1.4419999999999999},"min":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":0.90700000000000003},"max":{"1min":2.4079999999999999,"5min":2.4079999999999999,"15min":2.4079999999999999},"last":1.444}]},{"osd":5,"last update":"Sun Dec 17 11:49:06 2023","interfaces":[{"interface":"back","average":{"1min":1.548,"5min":1.548,"15min":1.548},"min":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"max":{"1min":2.3319999999999999,"5min":2.3319999999999999,"15min":2.3319999999999999},"last":1.6279999999999999},{"interface":"front","average":{"1min":1.5760000000000001,"5min":1.5760000000000001,"15min":1.5760000000000001},"min":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"max":{"1min":2.6760000000000002,"5min":2.6760000000000002,"15min":2.6760000000000002},"last":1.6000000000000001}]},{"osd":7,"last update":"Sun Dec 17 11:49:06 2023","interfaces":[{"interface":"back","average":{"1min":1.419,"5min":1.419,"15min":1.419},"min":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"max":{"1min":2.1560000000000001,"5min":2.1560000000000001,"15min":2.1560000000000001},"last":1.5589999999999999},{"interface":"front","average":{"1min":1.712,"5min":1.712,"15min":1.712},"min":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"max":{"1min":2.6059999999999999,"5min":2.6059999999999999,"15min":2.6059999999999999},"last":1.8919999999999999}]}]},{"osd":5,"up_from":14,"seq":60129542170,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27488,"kb_used_data":468,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344352,"statfs":{"total":96636764160,"available":96608616448,"internally_reserved":0,"allocated":479232,"data_stored":203975,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 17 11:49:09 2023","interfaces":[{"interface":"back","average":{"1min":1.101,"5min":1.101,"15min":1.101},"min":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":1.5860000000000001,"5min":1.5860000000000001,"15min":1.5860000000000001},"last":1.204},{"interface":"front","average":{"1min":1.23,"5min":1.23,"15min":1.23},"min":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"max":{"1min":1.9419999999999999,"5min":1.9419999999999999,"15min":1.9419999999999999},"last":1.0860000000000001}]},{"osd":1,"last update":"Sun Dec 17 11:49:09 2023","interfaces":[{"interface":"back","average":{"1min":1.167,"5min":1.167,"15min":1.167},"min":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"max":{"1min":1.5289999999999999,"5min":1.5289999999999999,"15min":1.5289999999999999},"last":1.6479999999999999},{"interface":"front","average":{"1min":1.216,"5min":1.216,"15min":1.216},"min":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"max":{"1min":1.8660000000000001,"5min":1.8660000000000001,"15min":1.8660000000000001},"last":1.3220000000000001}]},{"osd":2,"last update":"Sun Dec 17 11:49:09 2023","interfaces":[{"interface":"back","average":{"1min":1.3140000000000001,"5min":1.3140000000000001,"15min":1.3140000000000001},"min":{"1min":0.747,"5min":0.747,"15min":0.747},"max":{"1min":2.1589999999999998,"5min":2.1589999999999998,"15min":2.1589999999999998},"last":0.93899999999999995},{"interface":"front","average":{"1min":1.3919999999999999,"5min":1.3919999999999999,"15min":1.3919999999999999},"min":{"1min":1.0049999999999999,"5min":1.0049999999999999,"15min":1.0049999999999999},"max":{"1min":2.1379999999999999,"5min":2.1379999999999999,"15min":2.1379999999999999},"last":1.506}]},{"osd":3,"last update":"Sun Dec 17 11:49:09 2023","interfaces":[{"interface":"back","average":{"1min":1.337,"5min":1.337,"15min":1.337},"min":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"max":{"1min":2.593,"5min":2.593,"15min":2.593},"last":1.351},{"interface":"front","average":{"1min":1.407,"5min":1.407,"15min":1.407},"min":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"max":{"1min":2.3079999999999998,"5min":2.3079999999999998,"15min":2.3079999999999998},"last":1.381}]},{"osd":4,"last update":"Sun Dec 17 11:49:09 2023","interfaces":[{"interface":"back","average":{"1min":1.5029999999999999,"5min":1.5029999999999999,"15min":1.5029999999999999},"min":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"max":{"1min":2.5299999999999998,"5min":2.5299999999999998,"15min":2.5299999999999998},"last":1.4510000000000001},{"interface":"front","average":{"1min":1.6879999999999999,"5min":1.6879999999999999,"15min":1.6879999999999999},"min":{"1min":1.0669999999999999,"5min":1.0669999999999999,"15min":1.0669999999999999},"max":{"1min":3.9569999999999999,"5min":3.9569999999999999,"15min":3.9569999999999999},"last":1.1739999999999999}]},{"osd":6,"last update":"Sun Dec 17 11:49:09 2023","interfaces":[{"interface":"back","average":{"1min":1.6619999999999999,"5min":1.6619999999999999,"15min":1.6619999999999999},"min":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"max":{"1min":2.9849999999999999,"5min":2.9849999999999999,"15min":2.9849999999999999},"last":1.5900000000000001},{"interface":"front","average":{"1min":1.6319999999999999,"5min":1.6319999999999999,"15min":1.6319999999999999},"min":{"1min":1.25,"5min":1.25,"15min":1.25},"max":{"1min":2.641,"5min":2.641,"15min":2.641},"last":1.5569999999999999}]},{"osd":7,"last update":"Sun Dec 17 11:49:09 2023","interfaces":[{"interface":"back","average":{"1min":1.8080000000000001,"5min":1.8080000000000001,"15min":1.8080000000000001},"min":{"1min":1.232,"5min":1.232,"15min":1.232},"max":{"1min":3.8570000000000002,"5min":3.8570000000000002,"15min":3.8570000000000002},"last":1.2589999999999999},{"interface":"front","average":{"1min":1.827,"5min":1.827,"15min":1.827},"min":{"1min":1.137,"5min":1.137,"15min":1.137},"max":{"1min":2.8999999999999999,"5min":2.8999999999999999,"15min":2.8999999999999999},"last":1.702}]}]},{"osd":4,"up_from":14,"seq":60129542171,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27488,"kb_used_data":468,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344352,"statfs":{"total":96636764160,"available":96608616448,"internally_reserved":0,"allocated":479232,"data_stored":204467,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 17 11:49:08 2023","interfaces":[{"interface":"back","average":{"1min":1.02,"5min":1.02,"15min":1.02},"min":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"max":{"1min":1.1890000000000001,"5min":1.1890000000000001,"15min":1.1890000000000001},"last":1.3300000000000001},{"interface":"front","average":{"1min":1.167,"5min":1.167,"15min":1.167},"min":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"max":{"1min":2.6400000000000001,"5min":2.6400000000000001,"15min":2.6400000000000001},"last":0.96599999999999997}]},{"osd":1,"last update":"Sun Dec 17 11:49:08 2023","interfaces":[{"interface":"back","average":{"1min":1.0960000000000001,"5min":1.0960000000000001,"15min":1.0960000000000001},"min":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"max":{"1min":1.369,"5min":1.369,"15min":1.369},"last":1.4450000000000001},{"interface":"front","average":{"1min":1.2669999999999999,"5min":1.2669999999999999,"15min":1.2669999999999999},"min":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"max":{"1min":1.631,"5min":1.631,"15min":1.631},"last":0.88600000000000001}]},{"osd":2,"last update":"Sun Dec 17 11:49:08 2023","interfaces":[{"interface":"back","average":{"1min":1.393,"5min":1.393,"15min":1.393},"min":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"max":{"1min":1.8660000000000001,"5min":1.8660000000000001,"15min":1.8660000000000001},"last":1.2},{"interface":"front","average":{"1min":1.329,"5min":1.329,"15min":1.329},"min":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"max":{"1min":1.968,"5min":1.968,"15min":1.968},"last":1.5069999999999999}]},{"osd":3,"last update":"Sun Dec 17 11:49:08 2023","interfaces":[{"interface":"back","average":{"1min":1.4410000000000001,"5min":1.4410000000000001,"15min":1.4410000000000001},"min":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"max":{"1min":3.2290000000000001,"5min":3.2290000000000001,"15min":3.2290000000000001},"last":1.28},{"interface":"front","average":{"1min":1.496,"5min":1.496,"15min":1.496},"min":{"1min":1.1000000000000001,"5min":1.1000000000000001,"15min":1.1000000000000001},"max":{"1min":2.0169999999999999,"5min":2.0169999999999999,"15min":2.0169999999999999},"last":1.556}]},{"osd":5,"last update":"Sun Dec 17 11:49:08 2023","interfaces":[{"interface":"back","average":{"1min":1.474,"5min":1.474,"15min":1.474},"min":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"max":{"1min":2.141,"5min":2.141,"15min":2.141},"last":1.653},{"interface":"front","average":{"1min":1.7110000000000001,"5min":1.7110000000000001,"15min":1.7110000000000001},"min":{"1min":1.2390000000000001,"5min":1.2390000000000001,"15min":1.2390000000000001},"max":{"1min":3.8220000000000001,"5min":3.8220000000000001,"15min":3.8220000000000001},"last":1.3999999999999999}]},{"osd":6,"last update":"Sun Dec 17 11:49:08 2023","interfaces":[{"interface":"back","average":{"1min":1.7370000000000001,"5min":1.7370000000000001,"15min":1.7370000000000001},"min":{"1min":1.212,"5min":1.212,"15min":1.212},"max":{"1min":2.7410000000000001,"5min":2.7410000000000001,"15min":2.7410000000000001},"last":1.627},{"interface":"front","average":{"1min":1.677,"5min":1.677,"15min":1.677},"min":{"1min":1.222,"5min":1.222,"15min":1.222},"max":{"1min":2.2989999999999999,"5min":2.2989999999999999,"15min":2.2989999999999999},"last":1.726}]},{"osd":7,"last update":"Sun Dec 17 11:49:08 2023","interfaces":[{"interface":"back","average":{"1min":1.847,"5min":1.847,"15min":1.847},"min":{"1min":1.2749999999999999,"5min":1.2749999999999999,"15min":1.2749999999999999},"max":{"1min":3.944,"5min":3.944,"15min":3.944},"last":1.5960000000000001},{"interface":"front","average":{"1min":1.8160000000000001,"5min":1.8160000000000001,"15min":1.8160000000000001},"min":{"1min":1.4239999999999999,"5min":1.4239999999999999,"15min":1.4239999999999999},"max":{"1min":2.8809999999999998,"5min":2.8809999999999998,"15min":2.8809999999999998},"last":1.6830000000000001}]}]},{"osd":3,"up_from":14,"seq":60129542170,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27508,"kb_used_data":488,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344332,"statfs":{"total":96636764160,"available":96608595968,"internally_reserved":0,"allocated":499712,"data_stored":211775,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 17 11:49:06 2023","interfaces":[{"interface":"back","average":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.6459999999999999,"5min":1.6459999999999999,"15min":1.6459999999999999},"last":0.77300000000000002},{"interface":"front","average":{"1min":1.0700000000000001,"5min":1.0700000000000001,"15min":1.0700000000000001},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":3.5800000000000001,"5min":3.5800000000000001,"15min":3.5800000000000001},"last":0.45600000000000002}]},{"osd":1,"last update":"Sun Dec 17 11:49:06 2023","interfaces":[{"interface":"back","average":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":1.4379999999999999,"5min":1.4379999999999999,"15min":1.4379999999999999},"last":0.70499999999999996},{"interface":"front","average":{"1min":1.1519999999999999,"5min":1.1519999999999999,"15min":1.1519999999999999},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":2.085,"5min":2.085,"15min":2.085},"last":0.93700000000000006}]},{"osd":2,"last update":"Sun Dec 17 11:49:06 2023","interfaces":[{"interface":"back","average":{"1min":1.1659999999999999,"5min":1.1659999999999999,"15min":1.1659999999999999},"min":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":1.651,"5min":1.651,"15min":1.651},"last":1.141},{"interface":"front","average":{"1min":1.2569999999999999,"5min":1.2569999999999999,"15min":1.2569999999999999},"min":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":2.1429999999999998,"5min":2.1429999999999998,"15min":2.1429999999999998},"last":0.873}]},{"osd":4,"last update":"Sun Dec 17 11:49:06 2023","interfaces":[{"interface":"back","average":{"1min":1.4330000000000001,"5min":1.4330000000000001,"15min":1.4330000000000001},"min":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"max":{"1min":2.4870000000000001,"5min":2.4870000000000001,"15min":2.4870000000000001},"last":0.68600000000000005},{"interface":"front","average":{"1min":1.476,"5min":1.476,"15min":1.476},"min":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"max":{"1min":2.3460000000000001,"5min":2.3460000000000001,"15min":2.3460000000000001},"last":0.98399999999999999}]},{"osd":5,"last update":"Sun Dec 17 11:49:06 2023","interfaces":[{"interface":"back","average":{"1min":1.476,"5min":1.476,"15min":1.476},"min":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"max":{"1min":2.5710000000000002,"5min":2.5710000000000002,"15min":2.5710000000000002},"last":1.319},{"interface":"front","average":{"1min":1.5,"5min":1.5,"15min":1.5},"min":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"max":{"1min":2.383,"5min":2.383,"15min":2.383},"last":0.85399999999999998}]},{"osd":6,"last update":"Sun Dec 17 11:49:06 2023","interfaces":[{"interface":"back","average":{"1min":1.474,"5min":1.474,"15min":1.474},"min":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"max":{"1min":2.6179999999999999,"5min":2.6179999999999999,"15min":2.6179999999999999},"last":1.1080000000000001},{"interface":"front","average":{"1min":1.5149999999999999,"5min":1.5149999999999999,"15min":1.5149999999999999},"min":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"max":{"1min":2.7679999999999998,"5min":2.7679999999999998,"15min":2.7679999999999998},"last":1.258}]},{"osd":7,"last update":"Sun Dec 17 11:49:06 2023","interfaces":[{"interface":"back","average":{"1min":1.581,"5min":1.581,"15min":1.581},"min":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"max":{"1min":3.7000000000000002,"5min":3.7000000000000002,"15min":3.7000000000000002},"last":1.054},{"interface":"front","average":{"1min":1.579,"5min":1.579,"15min":1.579},"min":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":0.97099999999999997},"max":{"1min":2.427,"5min":2.427,"15min":2.427},"last":1.177}]}]},{"osd":2,"up_from":14,"seq":60129542171,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27472,"kb_used_data":452,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344368,"statfs":{"total":96636764160,"available":96608632832,"internally_reserved":0,"allocated":462848,"data_stored":197646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 17 11:49:07 2023","interfaces":[{"interface":"back","average":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":1.724,"5min":1.724,"15min":1.724},"last":1.0369999999999999},{"interface":"front","average":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.502,"5min":1.502,"15min":1.502},"last":0.998}]},{"osd":1,"last update":"Sun Dec 17 11:49:07 2023","interfaces":[{"interface":"back","average":{"1min":0.995,"5min":0.995,"15min":0.995},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.4790000000000001,"5min":1.4790000000000001,"15min":1.4790000000000001},"last":1.5309999999999999},{"interface":"front","average":{"1min":1.056,"5min":1.056,"15min":1.056},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":2.6280000000000001,"5min":2.6280000000000001,"15min":2.6280000000000001},"last":0.83999999999999997}]},{"osd":3,"last update":"Sun Dec 17 11:49:07 2023","interfaces":[{"interface":"back","average":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.476,"5min":1.476,"15min":1.476},"last":0.753},{"interface":"front","average":{"1min":1.214,"5min":1.214,"15min":1.214},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.9670000000000001,"5min":1.9670000000000001,"15min":1.9670000000000001},"last":1.4450000000000001}]},{"osd":4,"last update":"Sun Dec 17 11:49:07 2023","interfaces":[{"interface":"back","average":{"1min":1.49,"5min":1.49,"15min":1.49},"min":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"max":{"1min":2.5750000000000002,"5min":2.5750000000000002,"15min":2.5750000000000002},"last":1.2070000000000001},{"interface":"front","average":{"1min":1.3879999999999999,"5min":1.3879999999999999,"15min":1.3879999999999999},"min":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"max":{"1min":2.4940000000000002,"5min":2.4940000000000002,"15min":2.4940000000000002},"last":1.391}]},{"osd":5,"last update":"Sun Dec 17 11:49:07 2023","interfaces":[{"interface":"back","average":{"1min":1.3240000000000001,"5min":1.3240000000000001,"15min":1.3240000000000001},"min":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"max":{"1min":2.4289999999999998,"5min":2.4289999999999998,"15min":2.4289999999999998},"last":1.343},{"interface":"front","average":{"1min":1.5489999999999999,"5min":1.5489999999999999,"15min":1.5489999999999999},"min":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"max":{"1min":2.694,"5min":2.694,"15min":2.694},"last":1.597}]},{"osd":6,"last update":"Sun Dec 17 11:49:07 2023","interfaces":[{"interface":"back","average":{"1min":1.472,"5min":1.472,"15min":1.472},"min":{"1min":0.748,"5min":0.748,"15min":0.748},"max":{"1min":2.7349999999999999,"5min":2.7349999999999999,"15min":2.7349999999999999},"last":1.1180000000000001},{"interface":"front","average":{"1min":1.4119999999999999,"5min":1.4119999999999999,"15min":1.4119999999999999},"min":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"max":{"1min":2.468,"5min":2.468,"15min":2.468},"last":1.4950000000000001}]},{"osd":7,"last update":"Sun Dec 17 11:49:07 2023","interfaces":[{"interface":"back","average":{"1min":1.554,"5min":1.554,"15min":1.554},"min":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"max":{"1min":3.379,"5min":3.379,"15min":3.379},"last":1.23},{"interface":"front","average":{"1min":1.474,"5min":1.474,"15min":1.474},"min":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"max":{"1min":2.2869999999999999,"5min":2.2869999999999999,"15min":2.2869999999999999},"last":1.571}]}]},{"osd":1,"up_from":14,"seq":60129542170,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27484,"kb_used_data":464,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344356,"statfs":{"total":96636764160,"available":96608620544,"internally_reserved":0,"allocated":475136,"data_stored":203953,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 17 11:49:08 2023","interfaces":[{"interface":"back","average":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.5249999999999999,"5min":1.5249999999999999,"15min":1.5249999999999999},"last":1.1020000000000001},{"interface":"front","average":{"1min":1.113,"5min":1.113,"15min":1.113},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":2.6360000000000001,"5min":2.6360000000000001,"15min":2.6360000000000001},"last":0.94399999999999995}]},{"osd":2,"last update":"Sun Dec 17 11:49:08 2023","interfaces":[{"interface":"back","average":{"1min":1.202,"5min":1.202,"15min":1.202},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":2.8159999999999998,"5min":2.8159999999999998,"15min":2.8159999999999998},"last":0.67300000000000004},{"interface":"front","average":{"1min":1.462,"5min":1.462,"15min":1.462},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":3.101,"5min":3.101,"15min":3.101},"last":1.6180000000000001}]},{"osd":3,"last update":"Sun Dec 17 11:49:08 2023","interfaces":[{"interface":"back","average":{"1min":1.48,"5min":1.48,"15min":1.48},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":2.7890000000000001,"5min":2.7890000000000001,"15min":2.7890000000000001},"last":1.736},{"interface":"front","average":{"1min":1.278,"5min":1.278,"15min":1.278},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":3.1400000000000001,"5min":3.1400000000000001,"15min":3.1400000000000001},"last":1.28}]},{"osd":4,"last update":"Sun Dec 17 11:49:08 2023","interfaces":[{"interface":"back","average":{"1min":1.4350000000000001,"5min":1.4350000000000001,"15min":1.4350000000000001},"min":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":2.5289999999999999,"5min":2.5289999999999999,"15min":2.5289999999999999},"last":1.5409999999999999},{"interface":"front","average":{"1min":1.363,"5min":1.363,"15min":1.363},"min":{"1min":0.627,"5min":0.627,"15min":0.627},"max":{"1min":2.0819999999999999,"5min":2.0819999999999999,"15min":2.0819999999999999},"last":1.383}]},{"osd":5,"last update":"Sun Dec 17 11:49:08 2023","interfaces":[{"interface":"back","average":{"1min":1.466,"5min":1.466,"15min":1.466},"min":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"max":{"1min":1.96,"5min":1.96,"15min":1.96},"last":1.522},{"interface":"front","average":{"1min":1.573,"5min":1.573,"15min":1.573},"min":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":2.6739999999999999,"5min":2.6739999999999999,"15min":2.6739999999999999},"last":1.8500000000000001}]},{"osd":6,"last update":"Sun Dec 17 11:49:08 2023","interfaces":[{"interface":"back","average":{"1min":1.627,"5min":1.627,"15min":1.627},"min":{"1min":0.754,"5min":0.754,"15min":0.754},"max":{"1min":3.016,"5min":3.016,"15min":3.016},"last":2.0179999999999998},{"interface":"front","average":{"1min":1.5509999999999999,"5min":1.5509999999999999,"15min":1.5509999999999999},"min":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"max":{"1min":2.508,"5min":2.508,"15min":2.508},"last":1.458}]},{"osd":7,"last update":"Sun Dec 17 11:49:08 2023","interfaces":[{"interface":"back","average":{"1min":1.6839999999999999,"5min":1.6839999999999999,"15min":1.6839999999999999},"min":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"max":{"1min":2.944,"5min":2.944,"15min":2.944},"last":1.964},{"interface":"front","average":{"1min":1.7170000000000001,"5min":1.7170000000000001,"15min":1.7170000000000001},"min":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"max":{"1min":2.7709999999999999,"5min":2.7709999999999999,"15min":2.7709999999999999},"last":1.7949999999999999}]}]},{"osd":0,"up_from":14,"seq":60129542170,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32224,"kb_used_data":1044,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339616,"statfs":{"total":96636764160,"available":96603766784,"internally_reserved":0,"allocated":1069056,"data_stored":794265,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Dec 17 11:49:06 2023","interfaces":[{"interface":"back","average":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.3899999999999999,"5min":1.3899999999999999,"15min":1.3899999999999999},"last":0.79900000000000004},{"interface":"front","average":{"1min":1.1519999999999999,"5min":1.1519999999999999,"15min":1.1519999999999999},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":1.958,"5min":1.958,"15min":1.958},"last":1.1359999999999999}]},{"osd":2,"last update":"Sun Dec 17 11:49:06 2023","interfaces":[{"interface":"back","average":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.7709999999999999,"5min":1.7709999999999999,"15min":1.7709999999999999},"last":1.081},{"interface":"front","average":{"1min":1.2090000000000001,"5min":1.2090000000000001,"15min":1.2090000000000001},"min":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":2.2130000000000001,"5min":2.2130000000000001,"15min":2.2130000000000001},"last":1.0309999999999999}]},{"osd":3,"last update":"Sun Dec 17 11:49:06 2023","interfaces":[{"interface":"back","average":{"1min":1.125,"5min":1.125,"15min":1.125},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.728,"5min":1.728,"15min":1.728},"last":1.383},{"interface":"front","average":{"1min":1.4039999999999999,"5min":1.4039999999999999,"15min":1.4039999999999999},"min":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"max":{"1min":2.4809999999999999,"5min":2.4809999999999999,"15min":2.4809999999999999},"last":1.3400000000000001}]},{"osd":4,"last update":"Sun Dec 17 11:49:06 2023","interfaces":[{"interface":"back","average":{"1min":1.518,"5min":1.518,"15min":1.518},"min":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"max":{"1min":4.6710000000000003,"5min":4.6710000000000003,"15min":4.6710000000000003},"last":1.47},{"interface":"front","average":{"1min":1.427,"5min":1.427,"15min":1.427},"min":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"max":{"1min":2.2799999999999998,"5min":2.2799999999999998,"15min":2.2799999999999998},"last":1.1990000000000001}]},{"osd":5,"last update":"Sun Dec 17 11:49:06 2023","interfaces":[{"interface":"back","average":{"1min":1.5069999999999999,"5min":1.5069999999999999,"15min":1.5069999999999999},"min":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"max":{"1min":2.1349999999999998,"5min":2.1349999999999998,"15min":2.1349999999999998},"last":1.661},{"interface":"front","average":{"1min":1.6240000000000001,"5min":1.6240000000000001,"15min":1.6240000000000001},"min":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"max":{"1min":2.6080000000000001,"5min":2.6080000000000001,"15min":2.6080000000000001},"last":1.522}]},{"osd":6,"last update":"Sun Dec 17 11:49:06 2023","interfaces":[{"interface":"back","average":{"1min":1.5800000000000001,"5min":1.5800000000000001,"15min":1.5800000000000001},"min":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"max":{"1min":2.702,"5min":2.702,"15min":2.702},"last":1.4199999999999999},{"interface":"front","average":{"1min":1.534,"5min":1.534,"15min":1.534},"min":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"max":{"1min":2.3100000000000001,"5min":2.3100000000000001,"15min":2.3100000000000001},"last":1.702}]},{"osd":7,"last update":"Sun Dec 17 11:49:06 2023","interfaces":[{"interface":"back","average":{"1min":1.611,"5min":1.611,"15min":1.611},"min":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"max":{"1min":2.3420000000000001,"5min":2.3420000000000001,"15min":2.3420000000000001},"last":1.7969999999999999},{"interface":"front","average":{"1min":1.577,"5min":1.577,"15min":1.577},"min":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"max":{"1min":2.4359999999999999,"5min":2.4359999999999999,"15min":2.4359999999999999},"last":1.5600000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-17T11:50:03.361 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-17T11:50:03.619 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:03.616+0000 7fe663035640 1 Processor -- start 2023-12-17T11:50:03.619 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:03.617+0000 7fe663035640 1 -- start start 2023-12-17T11:50:03.620 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:03.618+0000 7fe663035640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe65c0d13c0 0x7fe65c0ce5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:50:03.621 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:03.618+0000 7fe663035640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fe65c0d0d70 0x7fe65c0d17a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:50:03.621 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:03.618+0000 7fe663035640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe65c0b2280 con 0x7fe65c0cf6a0 2023-12-17T11:50:03.621 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:03.618+0000 7fe663035640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe65c0cee70 con 0x7fe65c0d0d70 2023-12-17T11:50:03.621 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:03.618+0000 7fe663035640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe65c0d1190 con 0x7fe65c0d13c0 2023-12-17T11:50:03.621 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:03.619+0000 7fe661832640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fe65c0d0d70 0x7fe65c0d17a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:50:03.621 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:03.619+0000 7fe661832640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fe65c0d0d70 0x7fe65c0d17a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:33926/0 (socket says 172.21.15.40:33926) 2023-12-17T11:50:03.621 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:03.619+0000 7fe661832640 1 -- 172.21.15.40:0/3793943047 learned_addr learned my addr 172.21.15.40:0/3793943047 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-17T11:50:03.622 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:03.619+0000 7fe662033640 1 --2- 172.21.15.40:0/3793943047 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe65c0d13c0 0x7fe65c0ce5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:50:03.622 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:03.619+0000 7fe661832640 1 -- 172.21.15.40:0/3793943047 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe65c0d13c0 msgr2=0x7fe65c0ce5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:50:03.622 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:03.619+0000 7fe661832640 1 --2- 172.21.15.40:0/3793943047 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe65c0d13c0 0x7fe65c0ce5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:50:03.622 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:03.619+0000 7fe661832640 1 -- 172.21.15.40:0/3793943047 >> v1:172.21.15.159:6789/0 conn(0x7fe65c0cf6a0 legacy=0x7fe65c0cfb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:50:03.622 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:03.619+0000 7fe661832640 1 -- 172.21.15.40:0/3793943047 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe65c0d1ce0 con 0x7fe65c0d0d70 2023-12-17T11:50:03.622 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:03.620+0000 7fe661832640 1 --2- 172.21.15.40:0/3793943047 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe65c0d0d70 0x7fe65c0d17a0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fe650009870 tx=0x7fe65002b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5744dcab76d4ec30 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:50:03.623 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:03.621+0000 7fe661031640 1 -- 172.21.15.40:0/3793943047 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6500317c0 con 0x7fe65c0d0d70 2023-12-17T11:50:03.623 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:03.621+0000 7fe661031640 1 -- 172.21.15.40:0/3793943047 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe650031920 con 0x7fe65c0d0d70 2023-12-17T11:50:03.623 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:03.621+0000 7fe661031640 1 -- 172.21.15.40:0/3793943047 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe650031cb0 con 0x7fe65c0d0d70 2023-12-17T11:50:03.623 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:03.621+0000 7fe663035640 1 -- 172.21.15.40:0/3793943047 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe65c0d0d70 msgr2=0x7fe65c0d17a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:50:03.623 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:03.621+0000 7fe663035640 1 --2- 172.21.15.40:0/3793943047 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe65c0d0d70 0x7fe65c0d17a0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fe650009870 tx=0x7fe65002b860 comp rx=0 tx=0).stop 2023-12-17T11:50:03.624 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:03.622+0000 7fe663035640 1 -- 172.21.15.40:0/3793943047 shutdown_connections 2023-12-17T11:50:03.624 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:03.622+0000 7fe663035640 1 --2- 172.21.15.40:0/3793943047 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe65c0d0d70 0x7fe65c0d17a0 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:50:03.624 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:03.622+0000 7fe663035640 1 --2- 172.21.15.40:0/3793943047 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe65c0d13c0 0x7fe65c0ce5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:50:03.624 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:03.622+0000 7fe663035640 1 -- 172.21.15.40:0/3793943047 >> 172.21.15.40:0/3793943047 conn(0x7fe65c09c260 msgr2=0x7fe65c0d2f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:50:03.624 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:03.622+0000 7fe663035640 1 -- 172.21.15.40:0/3793943047 shutdown_connections 2023-12-17T11:50:03.624 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:03.622+0000 7fe663035640 1 -- 172.21.15.40:0/3793943047 wait complete. 2023-12-17T11:50:03.626 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:03.624+0000 7fe663035640 1 Processor -- start 2023-12-17T11:50:03.626 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:03.624+0000 7fe663035640 1 -- start start 2023-12-17T11:50:03.628 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:03.626+0000 7fe663035640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe65c0cf6a0 0x7fe65c09ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:50:03.629 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:03.626+0000 7fe663035640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe65c0d0d70 0x7fe65c1f2710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:50:03.629 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:03.626+0000 7fe663035640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe65c0d13c0 0x7fe65c1f2c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:50:03.629 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:03.626+0000 7fe663035640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe65c149bb0 con 0x7fe65c0cf6a0 2023-12-17T11:50:03.629 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:03.626+0000 7fe663035640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe65c0b52d0 con 0x7fe65c0d0d70 2023-12-17T11:50:03.629 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:03.626+0000 7fe663035640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe65c0b54e0 con 0x7fe65c0d13c0 2023-12-17T11:50:03.629 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:03.626+0000 7fe662033640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe65c0cf6a0 0x7fe65c09ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:50:03.629 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:03.626+0000 7fe662033640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe65c0cf6a0 0x7fe65c09ccd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:33930/0 (socket says 172.21.15.40:33930) 2023-12-17T11:50:03.629 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:03.626+0000 7fe662033640 1 -- 172.21.15.40:0/4119364862 learned_addr learned my addr 172.21.15.40:0/4119364862 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-17T11:50:03.629 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:03.626+0000 7fe661832640 1 --2- 172.21.15.40:0/4119364862 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe65c0d0d70 0x7fe65c1f2710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:50:03.629 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:03.626+0000 7fe662834640 1 --2- 172.21.15.40:0/4119364862 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe65c0d13c0 0x7fe65c1f2c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:50:03.629 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:03.627+0000 7fe662033640 1 -- 172.21.15.40:0/4119364862 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe65c0d13c0 msgr2=0x7fe65c1f2c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:50:03.629 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:03.627+0000 7fe662033640 1 --2- 172.21.15.40:0/4119364862 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe65c0d13c0 0x7fe65c1f2c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:50:03.630 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:03.627+0000 7fe662033640 1 -- 172.21.15.40:0/4119364862 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe65c0d0d70 msgr2=0x7fe65c1f2710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:50:03.630 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:03.627+0000 7fe662033640 1 --2- 172.21.15.40:0/4119364862 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe65c0d0d70 0x7fe65c1f2710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:50:03.630 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:03.627+0000 7fe662033640 1 -- 172.21.15.40:0/4119364862 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6500094d0 con 0x7fe65c0cf6a0 2023-12-17T11:50:03.631 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:03.627+0000 7fe662033640 1 --2- 172.21.15.40:0/4119364862 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe65c0cf6a0 0x7fe65c09ccd0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7fe64c007ef0 tx=0x7fe64c00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:50:03.631 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:03.627+0000 7fe65affd640 1 -- 172.21.15.40:0/4119364862 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe64c014620 con 0x7fe65c0cf6a0 2023-12-17T11:50:03.631 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:03.627+0000 7fe65affd640 1 -- 172.21.15.40:0/4119364862 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe64c014780 con 0x7fe65c0cf6a0 2023-12-17T11:50:03.631 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:03.627+0000 7fe65affd640 1 -- 172.21.15.40:0/4119364862 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe64c014b30 con 0x7fe65c0cf6a0 2023-12-17T11:50:03.631 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:03.627+0000 7fe663035640 1 -- 172.21.15.40:0/4119364862 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe65c0b57c0 con 0x7fe65c0cf6a0 2023-12-17T11:50:03.631 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:03.628+0000 7fe663035640 1 -- 172.21.15.40:0/4119364862 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe65c1497d0 con 0x7fe65c0cf6a0 2023-12-17T11:50:03.631 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:03.629+0000 7fe663035640 1 -- 172.21.15.40:0/4119364862 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe65c074450 con 0x7fe65c0cf6a0 2023-12-17T11:50:03.632 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:03.630+0000 7fe65affd640 1 -- 172.21.15.40:0/4119364862 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fe64c014c90 con 0x7fe65c0cf6a0 2023-12-17T11:50:03.633 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:03.631+0000 7fe65affd640 1 --2- 172.21.15.40:0/4119364862 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7fe64806ae40 0x7fe64806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:50:03.633 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:03.631+0000 7fe65affd640 1 -- 172.21.15.40:0/4119364862 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fe64c08a0e0 con 0x7fe65c0cf6a0 2023-12-17T11:50:03.634 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:03.632+0000 7fe661832640 1 --2- 172.21.15.40:0/4119364862 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7fe64806ae40 0x7fe64806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:50:03.635 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:03.633+0000 7fe661832640 1 --2- 172.21.15.40:0/4119364862 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7fe64806ae40 0x7fe64806d300 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fe650036000 tx=0x7fe65003d040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:50:03.638 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:03.636+0000 7fe65affd640 1 -- 172.21.15.40:0/4119364862 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fe64c0550c0 con 0x7fe65c0cf6a0 2023-12-17T11:50:03.827 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:03.825+0000 7fe663035640 1 -- 172.21.15.40:0/4119364862 --> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fe65c0d3820 con 0x7fe64806ae40 2023-12-17T11:50:03.849 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:03.847+0000 7fe65affd640 1 -- 172.21.15.40:0/4119364862 <== mgr.4105 v2:172.21.15.159:6832/479465803 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286572 (secure 0 0 0) 0x7fe65c0d3820 con 0x7fe64806ae40 2023-12-17T11:50:03.852 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T11:50:03.855 INFO:teuthology.orchestra.run.smithi040.stderr:dumped all 2023-12-17T11:50:03.857 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:03.855+0000 7fe663035640 1 -- 172.21.15.40:0/4119364862 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7fe64806ae40 msgr2=0x7fe64806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:50:03.857 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:03.855+0000 7fe663035640 1 --2- 172.21.15.40:0/4119364862 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7fe64806ae40 0x7fe64806d300 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fe650036000 tx=0x7fe65003d040 comp rx=0 tx=0).stop 2023-12-17T11:50:03.857 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:03.855+0000 7fe663035640 1 -- 172.21.15.40:0/4119364862 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe65c0cf6a0 msgr2=0x7fe65c09ccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:50:03.857 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:03.855+0000 7fe663035640 1 --2- 172.21.15.40:0/4119364862 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe65c0cf6a0 0x7fe65c09ccd0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7fe64c007ef0 tx=0x7fe64c00e4b0 comp rx=0 tx=0).stop 2023-12-17T11:50:03.857 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:03.855+0000 7fe663035640 1 -- 172.21.15.40:0/4119364862 shutdown_connections 2023-12-17T11:50:03.858 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:03.855+0000 7fe663035640 1 --2- 172.21.15.40:0/4119364862 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7fe64806ae40 0x7fe64806d300 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:50:03.858 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:03.855+0000 7fe663035640 1 --2- 172.21.15.40:0/4119364862 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe65c0d13c0 0x7fe65c1f2c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:50:03.858 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:03.855+0000 7fe663035640 1 --2- 172.21.15.40:0/4119364862 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe65c0d0d70 0x7fe65c1f2710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:50:03.858 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:03.855+0000 7fe663035640 1 --2- 172.21.15.40:0/4119364862 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe65c0cf6a0 0x7fe65c09ccd0 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:50:03.858 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:03.855+0000 7fe663035640 1 -- 172.21.15.40:0/4119364862 >> 172.21.15.40:0/4119364862 conn(0x7fe65c09c260 msgr2=0x7fe65c0b5b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:50:03.858 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:03.855+0000 7fe663035640 1 -- 172.21.15.40:0/4119364862 shutdown_connections 2023-12-17T11:50:03.858 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:03.855+0000 7fe663035640 1 -- 172.21.15.40:0/4119364862 wait complete. 2023-12-17T11:50:03.879 INFO:teuthology.orchestra.run.smithi040.stdout:{"pg_ready":true,"pg_map":{"version":93,"stamp":"2023-12-17T11:50:02.633238+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":225208,"kb_used_data":4880,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754749512,"statfs":{"total":773094113280,"available":772863500288,"internally_reserved":0,"allocated":4997120,"data_stored":2803865,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":225496626},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002735"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-17T11:50:00.525487+0000","last_change":"2023-12-17T11:49:53.251801+0000","last_active":"2023-12-17T11:50:00.525487+0000","last_peered":"2023-12-17T11:50:00.525487+0000","last_clean":"2023-12-17T11:50:00.525487+0000","last_became_active":"2023-12-17T11:49:53.251221+0000","last_became_peered":"2023-12-17T11:49:53.251221+0000","last_unstale":"2023-12-17T11:50:00.525487+0000","last_undegraded":"2023-12-17T11:50:00.525487+0000","last_fullsized":"2023-12-17T11:50:00.525487+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T22:42:15.785143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-17T11:50:00.524627+0000","last_change":"2023-12-17T11:49:53.243478+0000","last_active":"2023-12-17T11:50:00.524627+0000","last_peered":"2023-12-17T11:50:00.524627+0000","last_clean":"2023-12-17T11:50:00.524627+0000","last_became_active":"2023-12-17T11:49:53.243179+0000","last_became_peered":"2023-12-17T11:49:53.243179+0000","last_unstale":"2023-12-17T11:50:00.524627+0000","last_undegraded":"2023-12-17T11:50:00.524627+0000","last_fullsized":"2023-12-17T11:50:00.524627+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T23:49:09.469993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:56.659373+0000","last_change":"2023-12-17T11:49:53.249501+0000","last_active":"2023-12-17T11:49:56.659373+0000","last_peered":"2023-12-17T11:49:56.659373+0000","last_clean":"2023-12-17T11:49:56.659373+0000","last_became_active":"2023-12-17T11:49:53.249212+0000","last_became_peered":"2023-12-17T11:49:53.249212+0000","last_unstale":"2023-12-17T11:49:56.659373+0000","last_undegraded":"2023-12-17T11:49:56.659373+0000","last_fullsized":"2023-12-17T11:49:56.659373+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T22:50:12.261960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:56.663625+0000","last_change":"2023-12-17T11:49:53.237486+0000","last_active":"2023-12-17T11:49:56.663625+0000","last_peered":"2023-12-17T11:49:56.663625+0000","last_clean":"2023-12-17T11:49:56.663625+0000","last_became_active":"2023-12-17T11:49:53.236766+0000","last_became_peered":"2023-12-17T11:49:53.236766+0000","last_unstale":"2023-12-17T11:49:56.663625+0000","last_undegraded":"2023-12-17T11:49:56.663625+0000","last_fullsized":"2023-12-17T11:49:56.663625+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T19:34:01.395947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:56.663570+0000","last_change":"2023-12-17T11:49:53.230175+0000","last_active":"2023-12-17T11:49:56.663570+0000","last_peered":"2023-12-17T11:49:56.663570+0000","last_clean":"2023-12-17T11:49:56.663570+0000","last_became_active":"2023-12-17T11:49:53.229756+0000","last_became_peered":"2023-12-17T11:49:53.229756+0000","last_unstale":"2023-12-17T11:49:56.663570+0000","last_undegraded":"2023-12-17T11:49:56.663570+0000","last_fullsized":"2023-12-17T11:49:56.663570+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T15:43:04.869288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:56.659967+0000","last_change":"2023-12-17T11:49:53.245040+0000","last_active":"2023-12-17T11:49:56.659967+0000","last_peered":"2023-12-17T11:49:56.659967+0000","last_clean":"2023-12-17T11:49:56.659967+0000","last_became_active":"2023-12-17T11:49:53.243989+0000","last_became_peered":"2023-12-17T11:49:53.243989+0000","last_unstale":"2023-12-17T11:49:56.659967+0000","last_undegraded":"2023-12-17T11:49:56.659967+0000","last_fullsized":"2023-12-17T11:49:56.659967+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T16:31:53.964205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:56.655609+0000","last_change":"2023-12-17T11:49:53.244506+0000","last_active":"2023-12-17T11:49:56.655609+0000","last_peered":"2023-12-17T11:49:56.655609+0000","last_clean":"2023-12-17T11:49:56.655609+0000","last_became_active":"2023-12-17T11:49:53.244244+0000","last_became_peered":"2023-12-17T11:49:53.244244+0000","last_unstale":"2023-12-17T11:49:56.655609+0000","last_undegraded":"2023-12-17T11:49:56.655609+0000","last_fullsized":"2023-12-17T11:49:56.655609+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T12:27:38.132749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-17T11:50:00.522397+0000","last_change":"2023-12-17T11:49:53.256713+0000","last_active":"2023-12-17T11:50:00.522397+0000","last_peered":"2023-12-17T11:50:00.522397+0000","last_clean":"2023-12-17T11:50:00.522397+0000","last_became_active":"2023-12-17T11:49:53.255850+0000","last_became_peered":"2023-12-17T11:49:53.255850+0000","last_unstale":"2023-12-17T11:50:00.522397+0000","last_undegraded":"2023-12-17T11:50:00.522397+0000","last_fullsized":"2023-12-17T11:50:00.522397+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T14:00:43.418107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:56.659436+0000","last_change":"2023-12-17T11:49:53.255007+0000","last_active":"2023-12-17T11:49:56.659436+0000","last_peered":"2023-12-17T11:49:56.659436+0000","last_clean":"2023-12-17T11:49:56.659436+0000","last_became_active":"2023-12-17T11:49:53.254750+0000","last_became_peered":"2023-12-17T11:49:53.254750+0000","last_unstale":"2023-12-17T11:49:56.659436+0000","last_undegraded":"2023-12-17T11:49:56.659436+0000","last_fullsized":"2023-12-17T11:49:56.659436+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T19:23:44.505187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:56.655871+0000","last_change":"2023-12-17T11:49:53.243885+0000","last_active":"2023-12-17T11:49:56.655871+0000","last_peered":"2023-12-17T11:49:56.655871+0000","last_clean":"2023-12-17T11:49:56.655871+0000","last_became_active":"2023-12-17T11:49:53.243586+0000","last_became_peered":"2023-12-17T11:49:53.243586+0000","last_unstale":"2023-12-17T11:49:56.655871+0000","last_undegraded":"2023-12-17T11:49:56.655871+0000","last_fullsized":"2023-12-17T11:49:56.655871+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T23:49:09.469993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:56.655817+0000","last_change":"2023-12-17T11:49:53.245071+0000","last_active":"2023-12-17T11:49:56.655817+0000","last_peered":"2023-12-17T11:49:56.655817+0000","last_clean":"2023-12-17T11:49:56.655817+0000","last_became_active":"2023-12-17T11:49:53.244696+0000","last_became_peered":"2023-12-17T11:49:53.244696+0000","last_unstale":"2023-12-17T11:49:56.655817+0000","last_undegraded":"2023-12-17T11:49:56.655817+0000","last_fullsized":"2023-12-17T11:49:56.655817+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T17:56:09.285369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:56.659352+0000","last_change":"2023-12-17T11:49:53.244437+0000","last_active":"2023-12-17T11:49:56.659352+0000","last_peered":"2023-12-17T11:49:56.659352+0000","last_clean":"2023-12-17T11:49:56.659352+0000","last_became_active":"2023-12-17T11:49:53.244158+0000","last_became_peered":"2023-12-17T11:49:53.244158+0000","last_unstale":"2023-12-17T11:49:56.659352+0000","last_undegraded":"2023-12-17T11:49:56.659352+0000","last_fullsized":"2023-12-17T11:49:56.659352+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T12:12:45.651530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:56.655738+0000","last_change":"2023-12-17T11:49:53.259954+0000","last_active":"2023-12-17T11:49:56.655738+0000","last_peered":"2023-12-17T11:49:56.655738+0000","last_clean":"2023-12-17T11:49:56.655738+0000","last_became_active":"2023-12-17T11:49:53.259683+0000","last_became_peered":"2023-12-17T11:49:53.259683+0000","last_unstale":"2023-12-17T11:49:56.655738+0000","last_undegraded":"2023-12-17T11:49:56.655738+0000","last_fullsized":"2023-12-17T11:49:56.655738+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T13:29:29.953615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-17T11:50:00.522506+0000","last_change":"2023-12-17T11:49:53.251388+0000","last_active":"2023-12-17T11:50:00.522506+0000","last_peered":"2023-12-17T11:50:00.522506+0000","last_clean":"2023-12-17T11:50:00.522506+0000","last_became_active":"2023-12-17T11:49:53.251182+0000","last_became_peered":"2023-12-17T11:49:53.251182+0000","last_unstale":"2023-12-17T11:50:00.522506+0000","last_undegraded":"2023-12-17T11:50:00.522506+0000","last_fullsized":"2023-12-17T11:50:00.522506+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T19:39:18.340154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:56.655643+0000","last_change":"2023-12-17T11:49:53.251484+0000","last_active":"2023-12-17T11:49:56.655643+0000","last_peered":"2023-12-17T11:49:56.655643+0000","last_clean":"2023-12-17T11:49:56.655643+0000","last_became_active":"2023-12-17T11:49:53.250825+0000","last_became_peered":"2023-12-17T11:49:53.250825+0000","last_unstale":"2023-12-17T11:49:56.655643+0000","last_undegraded":"2023-12-17T11:49:56.655643+0000","last_fullsized":"2023-12-17T11:49:56.655643+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T12:48:09.865175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:55.301502+0000","last_change":"2023-12-17T11:49:53.256736+0000","last_active":"2023-12-17T11:49:55.301502+0000","last_peered":"2023-12-17T11:49:55.301502+0000","last_clean":"2023-12-17T11:49:55.301502+0000","last_became_active":"2023-12-17T11:49:53.256319+0000","last_became_peered":"2023-12-17T11:49:53.256319+0000","last_unstale":"2023-12-17T11:49:55.301502+0000","last_undegraded":"2023-12-17T11:49:55.301502+0000","last_fullsized":"2023-12-17T11:49:55.301502+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T14:49:05.628056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:55.302967+0000","last_change":"2023-12-17T11:49:53.254466+0000","last_active":"2023-12-17T11:49:55.302967+0000","last_peered":"2023-12-17T11:49:55.302967+0000","last_clean":"2023-12-17T11:49:55.302967+0000","last_became_active":"2023-12-17T11:49:53.254191+0000","last_became_peered":"2023-12-17T11:49:53.254191+0000","last_unstale":"2023-12-17T11:49:55.302967+0000","last_undegraded":"2023-12-17T11:49:55.302967+0000","last_fullsized":"2023-12-17T11:49:55.302967+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T15:34:59.184998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-17T11:50:01.202677+0000","last_change":"2023-12-17T11:49:53.244371+0000","last_active":"2023-12-17T11:50:01.202677+0000","last_peered":"2023-12-17T11:50:01.202677+0000","last_clean":"2023-12-17T11:50:01.202677+0000","last_became_active":"2023-12-17T11:49:53.243288+0000","last_became_peered":"2023-12-17T11:49:53.243288+0000","last_unstale":"2023-12-17T11:50:01.202677+0000","last_undegraded":"2023-12-17T11:50:01.202677+0000","last_fullsized":"2023-12-17T11:50:01.202677+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T22:59:01.401999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:56.663668+0000","last_change":"2023-12-17T11:49:53.247133+0000","last_active":"2023-12-17T11:49:56.663668+0000","last_peered":"2023-12-17T11:49:56.663668+0000","last_clean":"2023-12-17T11:49:56.663668+0000","last_became_active":"2023-12-17T11:49:53.246863+0000","last_became_peered":"2023-12-17T11:49:53.246863+0000","last_unstale":"2023-12-17T11:49:56.663668+0000","last_undegraded":"2023-12-17T11:49:56.663668+0000","last_fullsized":"2023-12-17T11:49:56.663668+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T15:22:56.669665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-17T11:50:01.202405+0000","last_change":"2023-12-17T11:49:53.234246+0000","last_active":"2023-12-17T11:50:01.202405+0000","last_peered":"2023-12-17T11:50:01.202405+0000","last_clean":"2023-12-17T11:50:01.202405+0000","last_became_active":"2023-12-17T11:49:53.233971+0000","last_became_peered":"2023-12-17T11:49:53.233971+0000","last_unstale":"2023-12-17T11:50:01.202405+0000","last_undegraded":"2023-12-17T11:50:01.202405+0000","last_fullsized":"2023-12-17T11:50:01.202405+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T21:22:15.324114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:56.655760+0000","last_change":"2023-12-17T11:49:53.254631+0000","last_active":"2023-12-17T11:49:56.655760+0000","last_peered":"2023-12-17T11:49:56.655760+0000","last_clean":"2023-12-17T11:49:56.655760+0000","last_became_active":"2023-12-17T11:49:53.254246+0000","last_became_peered":"2023-12-17T11:49:53.254246+0000","last_unstale":"2023-12-17T11:49:56.655760+0000","last_undegraded":"2023-12-17T11:49:56.655760+0000","last_fullsized":"2023-12-17T11:49:56.655760+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T15:42:47.132551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-17T11:50:00.523985+0000","last_change":"2023-12-17T11:49:53.233281+0000","last_active":"2023-12-17T11:50:00.523985+0000","last_peered":"2023-12-17T11:50:00.523985+0000","last_clean":"2023-12-17T11:50:00.523985+0000","last_became_active":"2023-12-17T11:49:53.233006+0000","last_became_peered":"2023-12-17T11:49:53.233006+0000","last_unstale":"2023-12-17T11:50:00.523985+0000","last_undegraded":"2023-12-17T11:50:00.523985+0000","last_fullsized":"2023-12-17T11:50:00.523985+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T17:37:46.058341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:55.301627+0000","last_change":"2023-12-17T11:49:53.235006+0000","last_active":"2023-12-17T11:49:55.301627+0000","last_peered":"2023-12-17T11:49:55.301627+0000","last_clean":"2023-12-17T11:49:55.301627+0000","last_became_active":"2023-12-17T11:49:53.232828+0000","last_became_peered":"2023-12-17T11:49:53.232828+0000","last_unstale":"2023-12-17T11:49:55.301627+0000","last_undegraded":"2023-12-17T11:49:55.301627+0000","last_fullsized":"2023-12-17T11:49:55.301627+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T21:34:46.442330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:56.663503+0000","last_change":"2023-12-17T11:49:53.229937+0000","last_active":"2023-12-17T11:49:56.663503+0000","last_peered":"2023-12-17T11:49:56.663503+0000","last_clean":"2023-12-17T11:49:56.663503+0000","last_became_active":"2023-12-17T11:49:53.229360+0000","last_became_peered":"2023-12-17T11:49:53.229360+0000","last_unstale":"2023-12-17T11:49:56.663503+0000","last_undegraded":"2023-12-17T11:49:56.663503+0000","last_fullsized":"2023-12-17T11:49:56.663503+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T13:22:57.464897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-17T11:50:01.202634+0000","last_change":"2023-12-17T11:49:53.248140+0000","last_active":"2023-12-17T11:50:01.202634+0000","last_peered":"2023-12-17T11:50:01.202634+0000","last_clean":"2023-12-17T11:50:01.202634+0000","last_became_active":"2023-12-17T11:49:53.246139+0000","last_became_peered":"2023-12-17T11:49:53.246139+0000","last_unstale":"2023-12-17T11:50:01.202634+0000","last_undegraded":"2023-12-17T11:50:01.202634+0000","last_fullsized":"2023-12-17T11:50:01.202634+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T14:32:00.462222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:56.660141+0000","last_change":"2023-12-17T11:49:53.255892+0000","last_active":"2023-12-17T11:49:56.660141+0000","last_peered":"2023-12-17T11:49:56.660141+0000","last_clean":"2023-12-17T11:49:56.660141+0000","last_became_active":"2023-12-17T11:49:53.255307+0000","last_became_peered":"2023-12-17T11:49:53.255307+0000","last_unstale":"2023-12-17T11:49:56.660141+0000","last_undegraded":"2023-12-17T11:49:56.660141+0000","last_fullsized":"2023-12-17T11:49:56.660141+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T17:37:46.058341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-17T11:50:01.202692+0000","last_change":"2023-12-17T11:49:53.238527+0000","last_active":"2023-12-17T11:50:01.202692+0000","last_peered":"2023-12-17T11:50:01.202692+0000","last_clean":"2023-12-17T11:50:01.202692+0000","last_became_active":"2023-12-17T11:49:53.238260+0000","last_became_peered":"2023-12-17T11:49:53.238260+0000","last_unstale":"2023-12-17T11:50:01.202692+0000","last_undegraded":"2023-12-17T11:50:01.202692+0000","last_fullsized":"2023-12-17T11:50:01.202692+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T14:03:14.332356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:56.655796+0000","last_change":"2023-12-17T11:49:53.247243+0000","last_active":"2023-12-17T11:49:56.655796+0000","last_peered":"2023-12-17T11:49:56.655796+0000","last_clean":"2023-12-17T11:49:56.655796+0000","last_became_active":"2023-12-17T11:49:53.246983+0000","last_became_peered":"2023-12-17T11:49:53.246983+0000","last_unstale":"2023-12-17T11:49:56.655796+0000","last_undegraded":"2023-12-17T11:49:56.655796+0000","last_fullsized":"2023-12-17T11:49:56.655796+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T23:33:06.562683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-17T11:50:01.202387+0000","last_change":"2023-12-17T11:49:53.247287+0000","last_active":"2023-12-17T11:50:01.202387+0000","last_peered":"2023-12-17T11:50:01.202387+0000","last_clean":"2023-12-17T11:50:01.202387+0000","last_became_active":"2023-12-17T11:49:53.246995+0000","last_became_peered":"2023-12-17T11:49:53.246995+0000","last_unstale":"2023-12-17T11:50:01.202387+0000","last_undegraded":"2023-12-17T11:50:01.202387+0000","last_fullsized":"2023-12-17T11:50:01.202387+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T14:03:09.358474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-17T11:50:01.202183+0000","last_change":"2023-12-17T11:49:53.240901+0000","last_active":"2023-12-17T11:50:01.202183+0000","last_peered":"2023-12-17T11:50:01.202183+0000","last_clean":"2023-12-17T11:50:01.202183+0000","last_became_active":"2023-12-17T11:49:53.240589+0000","last_became_peered":"2023-12-17T11:49:53.240589+0000","last_unstale":"2023-12-17T11:50:01.202183+0000","last_undegraded":"2023-12-17T11:50:01.202183+0000","last_fullsized":"2023-12-17T11:50:01.202183+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T19:17:47.294209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:55.301788+0000","last_change":"2023-12-17T11:49:53.239855+0000","last_active":"2023-12-17T11:49:55.301788+0000","last_peered":"2023-12-17T11:49:55.301788+0000","last_clean":"2023-12-17T11:49:55.301788+0000","last_became_active":"2023-12-17T11:49:53.239579+0000","last_became_peered":"2023-12-17T11:49:53.239579+0000","last_unstale":"2023-12-17T11:49:55.301788+0000","last_undegraded":"2023-12-17T11:49:55.301788+0000","last_fullsized":"2023-12-17T11:49:55.301788+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T20:29:09.996550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:56.659898+0000","last_change":"2023-12-17T11:49:53.252543+0000","last_active":"2023-12-17T11:49:56.659898+0000","last_peered":"2023-12-17T11:49:56.659898+0000","last_clean":"2023-12-17T11:49:56.659898+0000","last_became_active":"2023-12-17T11:49:53.250790+0000","last_became_peered":"2023-12-17T11:49:53.250790+0000","last_unstale":"2023-12-17T11:49:56.659898+0000","last_undegraded":"2023-12-17T11:49:56.659898+0000","last_fullsized":"2023-12-17T11:49:56.659898+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T19:00:07.905809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:55.302468+0000","last_change":"2023-12-17T11:49:53.245226+0000","last_active":"2023-12-17T11:49:55.302468+0000","last_peered":"2023-12-17T11:49:55.302468+0000","last_clean":"2023-12-17T11:49:55.302468+0000","last_became_active":"2023-12-17T11:49:53.243115+0000","last_became_peered":"2023-12-17T11:49:53.243115+0000","last_unstale":"2023-12-17T11:49:55.302468+0000","last_undegraded":"2023-12-17T11:49:55.302468+0000","last_fullsized":"2023-12-17T11:49:55.302468+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T15:06:34.831619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"39'4","reported_seq":18,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-17T11:50:01.202725+0000","last_change":"2023-12-17T11:49:52.226944+0000","last_active":"2023-12-17T11:50:01.202725+0000","last_peered":"2023-12-17T11:50:01.202725+0000","last_clean":"2023-12-17T11:50:01.202725+0000","last_became_active":"2023-12-17T11:49:52.226659+0000","last_became_peered":"2023-12-17T11:49:52.226659+0000","last_unstale":"2023-12-17T11:50:01.202725+0000","last_undegraded":"2023-12-17T11:50:01.202725+0000","last_fullsized":"2023-12-17T11:50:01.202725+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_clean_scrub_stamp":"2023-12-17T11:49:51.168108+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T13:22:56.453467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:56.660037+0000","last_change":"2023-12-17T11:49:53.254791+0000","last_active":"2023-12-17T11:49:56.660037+0000","last_peered":"2023-12-17T11:49:56.660037+0000","last_clean":"2023-12-17T11:49:56.660037+0000","last_became_active":"2023-12-17T11:49:53.254496+0000","last_became_peered":"2023-12-17T11:49:53.254496+0000","last_unstale":"2023-12-17T11:49:56.660037+0000","last_undegraded":"2023-12-17T11:49:56.660037+0000","last_fullsized":"2023-12-17T11:49:56.660037+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T14:42:29.543380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"39'1","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:55.302292+0000","last_change":"2023-12-17T11:49:52.223256+0000","last_active":"2023-12-17T11:49:55.302292+0000","last_peered":"2023-12-17T11:49:55.302292+0000","last_clean":"2023-12-17T11:49:55.302292+0000","last_became_active":"2023-12-17T11:49:52.222808+0000","last_became_peered":"2023-12-17T11:49:52.222808+0000","last_unstale":"2023-12-17T11:49:55.302292+0000","last_undegraded":"2023-12-17T11:49:55.302292+0000","last_fullsized":"2023-12-17T11:49:55.302292+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_clean_scrub_stamp":"2023-12-17T11:49:51.168108+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T16:31:52.952775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-17T11:50:00.523143+0000","last_change":"2023-12-17T11:49:53.251178+0000","last_active":"2023-12-17T11:50:00.523143+0000","last_peered":"2023-12-17T11:50:00.523143+0000","last_clean":"2023-12-17T11:50:00.523143+0000","last_became_active":"2023-12-17T11:49:53.250223+0000","last_became_peered":"2023-12-17T11:49:53.250223+0000","last_unstale":"2023-12-17T11:50:00.523143+0000","last_undegraded":"2023-12-17T11:50:00.523143+0000","last_fullsized":"2023-12-17T11:50:00.523143+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T23:10:56.100255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"39'2","reported_seq":15,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:54.557626+0000","last_change":"2023-12-17T11:49:52.223879+0000","last_active":"2023-12-17T11:49:54.557626+0000","last_peered":"2023-12-17T11:49:54.557626+0000","last_clean":"2023-12-17T11:49:54.557626+0000","last_became_active":"2023-12-17T11:49:52.223602+0000","last_became_peered":"2023-12-17T11:49:52.223602+0000","last_unstale":"2023-12-17T11:49:54.557626+0000","last_undegraded":"2023-12-17T11:49:54.557626+0000","last_fullsized":"2023-12-17T11:49:54.557626+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_clean_scrub_stamp":"2023-12-17T11:49:51.168108+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T15:25:46.493177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-17T11:50:00.525262+0000","last_change":"2023-12-17T11:49:53.254646+0000","last_active":"2023-12-17T11:50:00.525262+0000","last_peered":"2023-12-17T11:50:00.525262+0000","last_clean":"2023-12-17T11:50:00.525262+0000","last_became_active":"2023-12-17T11:49:53.254368+0000","last_became_peered":"2023-12-17T11:49:53.254368+0000","last_unstale":"2023-12-17T11:50:00.525262+0000","last_undegraded":"2023-12-17T11:50:00.525262+0000","last_fullsized":"2023-12-17T11:50:00.525262+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T15:42:47.132551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"39'2","reported_seq":16,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-17T11:50:00.523260+0000","last_change":"2023-12-17T11:49:52.221006+0000","last_active":"2023-12-17T11:50:00.523260+0000","last_peered":"2023-12-17T11:50:00.523260+0000","last_clean":"2023-12-17T11:50:00.523260+0000","last_became_active":"2023-12-17T11:49:52.220514+0000","last_became_peered":"2023-12-17T11:49:52.220514+0000","last_unstale":"2023-12-17T11:50:00.523260+0000","last_undegraded":"2023-12-17T11:50:00.523260+0000","last_fullsized":"2023-12-17T11:50:00.523260+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_clean_scrub_stamp":"2023-12-17T11:49:51.168108+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T15:25:46.493177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:56.659192+0000","last_change":"2023-12-17T11:49:53.251737+0000","last_active":"2023-12-17T11:49:56.659192+0000","last_peered":"2023-12-17T11:49:56.659192+0000","last_clean":"2023-12-17T11:49:56.659192+0000","last_became_active":"2023-12-17T11:49:53.251458+0000","last_became_peered":"2023-12-17T11:49:53.251458+0000","last_unstale":"2023-12-17T11:49:56.659192+0000","last_undegraded":"2023-12-17T11:49:56.659192+0000","last_fullsized":"2023-12-17T11:49:56.659192+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T17:37:46.058341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"39'1","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:55.304169+0000","last_change":"2023-12-17T11:49:52.226918+0000","last_active":"2023-12-17T11:49:55.304169+0000","last_peered":"2023-12-17T11:49:55.304169+0000","last_clean":"2023-12-17T11:49:55.304169+0000","last_became_active":"2023-12-17T11:49:52.226455+0000","last_became_peered":"2023-12-17T11:49:52.226455+0000","last_unstale":"2023-12-17T11:49:55.304169+0000","last_undegraded":"2023-12-17T11:49:55.304169+0000","last_fullsized":"2023-12-17T11:49:55.304169+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_clean_scrub_stamp":"2023-12-17T11:49:51.168108+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T12:12:44.640100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:56.655694+0000","last_change":"2023-12-17T11:49:53.251691+0000","last_active":"2023-12-17T11:49:56.655694+0000","last_peered":"2023-12-17T11:49:56.655694+0000","last_clean":"2023-12-17T11:49:56.655694+0000","last_became_active":"2023-12-17T11:49:53.251175+0000","last_became_peered":"2023-12-17T11:49:53.251175+0000","last_unstale":"2023-12-17T11:49:56.655694+0000","last_undegraded":"2023-12-17T11:49:56.655694+0000","last_fullsized":"2023-12-17T11:49:56.655694+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T14:00:43.418107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"39'1","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:55.301855+0000","last_change":"2023-12-17T11:49:52.225053+0000","last_active":"2023-12-17T11:49:55.301855+0000","last_peered":"2023-12-17T11:49:55.301855+0000","last_clean":"2023-12-17T11:49:55.301855+0000","last_became_active":"2023-12-17T11:49:52.224761+0000","last_became_peered":"2023-12-17T11:49:52.224761+0000","last_unstale":"2023-12-17T11:49:55.301855+0000","last_undegraded":"2023-12-17T11:49:55.301855+0000","last_fullsized":"2023-12-17T11:49:55.301855+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_clean_scrub_stamp":"2023-12-17T11:49:51.168108+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T20:30:07.106128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":14,"reported_epoch":42,"state":"activating","last_fresh":"2023-12-17T11:50:01.545212+0000","last_change":"2023-12-17T11:50:01.545825+0000","last_active":"2023-12-17T11:50:00.523935+0000","last_peered":"2023-12-17T11:49:56.657918+0000","last_clean":"2023-12-17T11:49:56.657918+0000","last_became_active":"2023-12-17T11:49:53.254841+0000","last_became_peered":"2023-12-17T11:49:53.254841+0000","last_unstale":"2023-12-17T11:50:01.545212+0000","last_undegraded":"2023-12-17T11:50:01.545212+0000","last_fullsized":"2023-12-17T11:50:01.545212+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T19:23:44.505187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":["4","0","5"],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:54.556572+0000","last_change":"2023-12-17T11:49:52.230598+0000","last_active":"2023-12-17T11:49:54.556572+0000","last_peered":"2023-12-17T11:49:54.556572+0000","last_clean":"2023-12-17T11:49:54.556572+0000","last_became_active":"2023-12-17T11:49:52.230298+0000","last_became_peered":"2023-12-17T11:49:52.230298+0000","last_unstale":"2023-12-17T11:49:54.556572+0000","last_undegraded":"2023-12-17T11:49:54.556572+0000","last_fullsized":"2023-12-17T11:49:54.556572+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_clean_scrub_stamp":"2023-12-17T11:49:51.168108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T22:39:30.094160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-17T11:50:00.523881+0000","last_change":"2023-12-17T11:49:53.249431+0000","last_active":"2023-12-17T11:50:00.523881+0000","last_peered":"2023-12-17T11:50:00.523881+0000","last_clean":"2023-12-17T11:50:00.523881+0000","last_became_active":"2023-12-17T11:49:53.248943+0000","last_became_peered":"2023-12-17T11:49:53.248943+0000","last_unstale":"2023-12-17T11:50:00.523881+0000","last_undegraded":"2023-12-17T11:50:00.523881+0000","last_fullsized":"2023-12-17T11:50:00.523881+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T16:21:14.355302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-17T11:50:00.522481+0000","last_change":"2023-12-17T11:49:52.224198+0000","last_active":"2023-12-17T11:50:00.522481+0000","last_peered":"2023-12-17T11:50:00.522481+0000","last_clean":"2023-12-17T11:50:00.522481+0000","last_became_active":"2023-12-17T11:49:52.223829+0000","last_became_peered":"2023-12-17T11:49:52.223829+0000","last_unstale":"2023-12-17T11:50:00.522481+0000","last_undegraded":"2023-12-17T11:50:00.522481+0000","last_fullsized":"2023-12-17T11:50:00.522481+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_clean_scrub_stamp":"2023-12-17T11:49:51.168108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T13:20:29.045455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:56.663647+0000","last_change":"2023-12-17T11:49:53.232883+0000","last_active":"2023-12-17T11:49:56.663647+0000","last_peered":"2023-12-17T11:49:56.663647+0000","last_clean":"2023-12-17T11:49:56.663647+0000","last_became_active":"2023-12-17T11:49:53.232629+0000","last_became_peered":"2023-12-17T11:49:53.232629+0000","last_unstale":"2023-12-17T11:49:56.663647+0000","last_undegraded":"2023-12-17T11:49:56.663647+0000","last_fullsized":"2023-12-17T11:49:56.663647+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T18:07:10.105462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-17T11:50:00.525489+0000","last_change":"2023-12-17T11:49:52.215890+0000","last_active":"2023-12-17T11:50:00.525489+0000","last_peered":"2023-12-17T11:50:00.525489+0000","last_clean":"2023-12-17T11:50:00.525489+0000","last_became_active":"2023-12-17T11:49:52.215576+0000","last_became_peered":"2023-12-17T11:49:52.215576+0000","last_unstale":"2023-12-17T11:50:00.525489+0000","last_undegraded":"2023-12-17T11:50:00.525489+0000","last_fullsized":"2023-12-17T11:50:00.525489+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_clean_scrub_stamp":"2023-12-17T11:49:51.168108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T17:03:59.637357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:55.302907+0000","last_change":"2023-12-17T11:49:53.236661+0000","last_active":"2023-12-17T11:49:55.302907+0000","last_peered":"2023-12-17T11:49:55.302907+0000","last_clean":"2023-12-17T11:49:55.302907+0000","last_became_active":"2023-12-17T11:49:53.236319+0000","last_became_peered":"2023-12-17T11:49:53.236319+0000","last_unstale":"2023-12-17T11:49:55.302907+0000","last_undegraded":"2023-12-17T11:49:55.302907+0000","last_fullsized":"2023-12-17T11:49:55.302907+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T13:29:01.309715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:55.305000+0000","last_change":"2023-12-17T11:49:52.233070+0000","last_active":"2023-12-17T11:49:55.305000+0000","last_peered":"2023-12-17T11:49:55.305000+0000","last_clean":"2023-12-17T11:49:55.305000+0000","last_became_active":"2023-12-17T11:49:52.232635+0000","last_became_peered":"2023-12-17T11:49:52.232635+0000","last_unstale":"2023-12-17T11:49:55.305000+0000","last_undegraded":"2023-12-17T11:49:55.305000+0000","last_fullsized":"2023-12-17T11:49:55.305000+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_clean_scrub_stamp":"2023-12-17T11:49:51.168108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T15:53:07.030004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:56.659403+0000","last_change":"2023-12-17T11:49:53.246755+0000","last_active":"2023-12-17T11:49:56.659403+0000","last_peered":"2023-12-17T11:49:56.659403+0000","last_clean":"2023-12-17T11:49:56.659403+0000","last_became_active":"2023-12-17T11:49:53.245111+0000","last_became_peered":"2023-12-17T11:49:53.245111+0000","last_unstale":"2023-12-17T11:49:56.659403+0000","last_undegraded":"2023-12-17T11:49:56.659403+0000","last_fullsized":"2023-12-17T11:49:56.659403+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T14:59:11.557660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"39'3","reported_seq":16,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:55.304936+0000","last_change":"2023-12-17T11:49:52.231475+0000","last_active":"2023-12-17T11:49:55.304936+0000","last_peered":"2023-12-17T11:49:55.304936+0000","last_clean":"2023-12-17T11:49:55.304936+0000","last_became_active":"2023-12-17T11:49:52.230061+0000","last_became_peered":"2023-12-17T11:49:52.230061+0000","last_unstale":"2023-12-17T11:49:55.304936+0000","last_undegraded":"2023-12-17T11:49:55.304936+0000","last_fullsized":"2023-12-17T11:49:55.304936+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_clean_scrub_stamp":"2023-12-17T11:49:51.168108+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T22:50:11.250530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-17T11:50:00.523324+0000","last_change":"2023-12-17T11:49:53.232224+0000","last_active":"2023-12-17T11:50:00.523324+0000","last_peered":"2023-12-17T11:50:00.523324+0000","last_clean":"2023-12-17T11:50:00.523324+0000","last_became_active":"2023-12-17T11:49:53.231963+0000","last_became_peered":"2023-12-17T11:49:53.231963+0000","last_unstale":"2023-12-17T11:50:00.523324+0000","last_undegraded":"2023-12-17T11:50:00.523324+0000","last_fullsized":"2023-12-17T11:50:00.523324+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T15:14:36.959400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"39'6","reported_seq":20,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-17T11:50:00.524725+0000","last_change":"2023-12-17T11:49:52.220583+0000","last_active":"2023-12-17T11:50:00.524725+0000","last_peered":"2023-12-17T11:50:00.524725+0000","last_clean":"2023-12-17T11:50:00.524725+0000","last_became_active":"2023-12-17T11:49:52.220304+0000","last_became_peered":"2023-12-17T11:49:52.220304+0000","last_unstale":"2023-12-17T11:50:00.524725+0000","last_undegraded":"2023-12-17T11:50:00.524725+0000","last_fullsized":"2023-12-17T11:50:00.524725+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_clean_scrub_stamp":"2023-12-17T11:49:51.168108+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T12:27:37.121319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:56.659257+0000","last_change":"2023-12-17T11:49:53.248442+0000","last_active":"2023-12-17T11:49:56.659257+0000","last_peered":"2023-12-17T11:49:56.659257+0000","last_clean":"2023-12-17T11:49:56.659257+0000","last_became_active":"2023-12-17T11:49:53.248094+0000","last_became_peered":"2023-12-17T11:49:53.248094+0000","last_unstale":"2023-12-17T11:49:56.659257+0000","last_undegraded":"2023-12-17T11:49:56.659257+0000","last_fullsized":"2023-12-17T11:49:56.659257+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T14:42:29.543380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"39'2","reported_seq":16,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-17T11:50:00.524311+0000","last_change":"2023-12-17T11:49:52.213341+0000","last_active":"2023-12-17T11:50:00.524311+0000","last_peered":"2023-12-17T11:50:00.524311+0000","last_clean":"2023-12-17T11:50:00.524311+0000","last_became_active":"2023-12-17T11:49:52.213024+0000","last_became_peered":"2023-12-17T11:49:52.213024+0000","last_unstale":"2023-12-17T11:50:00.524311+0000","last_undegraded":"2023-12-17T11:50:00.524311+0000","last_fullsized":"2023-12-17T11:50:00.524311+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_clean_scrub_stamp":"2023-12-17T11:49:51.168108+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T20:34:24.431589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-17T11:50:00.522731+0000","last_change":"2023-12-17T11:49:53.238931+0000","last_active":"2023-12-17T11:50:00.522731+0000","last_peered":"2023-12-17T11:50:00.522731+0000","last_clean":"2023-12-17T11:50:00.522731+0000","last_became_active":"2023-12-17T11:49:53.238641+0000","last_became_peered":"2023-12-17T11:49:53.238641+0000","last_unstale":"2023-12-17T11:50:00.522731+0000","last_undegraded":"2023-12-17T11:50:00.522731+0000","last_fullsized":"2023-12-17T11:50:00.522731+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T13:29:29.953615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:54.556680+0000","last_change":"2023-12-17T11:49:52.232507+0000","last_active":"2023-12-17T11:49:54.556680+0000","last_peered":"2023-12-17T11:49:54.556680+0000","last_clean":"2023-12-17T11:49:54.556680+0000","last_became_active":"2023-12-17T11:49:52.232308+0000","last_became_peered":"2023-12-17T11:49:52.232308+0000","last_unstale":"2023-12-17T11:49:54.556680+0000","last_undegraded":"2023-12-17T11:49:54.556680+0000","last_fullsized":"2023-12-17T11:49:54.556680+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_clean_scrub_stamp":"2023-12-17T11:49:51.168108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T19:17:46.282779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:55.301864+0000","last_change":"2023-12-17T11:49:53.234701+0000","last_active":"2023-12-17T11:49:55.301864+0000","last_peered":"2023-12-17T11:49:55.301864+0000","last_clean":"2023-12-17T11:49:55.301864+0000","last_became_active":"2023-12-17T11:49:53.234389+0000","last_became_peered":"2023-12-17T11:49:53.234389+0000","last_unstale":"2023-12-17T11:49:55.301864+0000","last_undegraded":"2023-12-17T11:49:55.301864+0000","last_fullsized":"2023-12-17T11:49:55.301864+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T17:54:34.803705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-17T11:50:01.202070+0000","last_change":"2023-12-17T11:49:52.226465+0000","last_active":"2023-12-17T11:50:01.202070+0000","last_peered":"2023-12-17T11:50:01.202070+0000","last_clean":"2023-12-17T11:50:01.202070+0000","last_became_active":"2023-12-17T11:49:52.226191+0000","last_became_peered":"2023-12-17T11:49:52.226191+0000","last_unstale":"2023-12-17T11:50:01.202070+0000","last_undegraded":"2023-12-17T11:50:01.202070+0000","last_fullsized":"2023-12-17T11:50:01.202070+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_clean_scrub_stamp":"2023-12-17T11:49:51.168108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T18:03:39.554935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-17T11:50:00.524016+0000","last_change":"2023-12-17T11:49:53.254934+0000","last_active":"2023-12-17T11:50:00.524016+0000","last_peered":"2023-12-17T11:50:00.524016+0000","last_clean":"2023-12-17T11:50:00.524016+0000","last_became_active":"2023-12-17T11:49:53.254632+0000","last_became_peered":"2023-12-17T11:49:53.254632+0000","last_unstale":"2023-12-17T11:50:00.524016+0000","last_undegraded":"2023-12-17T11:50:00.524016+0000","last_fullsized":"2023-12-17T11:50:00.524016+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T23:33:06.562683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"39'8","reported_seq":20,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:55.301546+0000","last_change":"2023-12-17T11:49:52.226787+0000","last_active":"2023-12-17T11:49:55.301546+0000","last_peered":"2023-12-17T11:49:55.301546+0000","last_clean":"2023-12-17T11:49:55.301546+0000","last_became_active":"2023-12-17T11:49:52.226471+0000","last_became_peered":"2023-12-17T11:49:52.226471+0000","last_unstale":"2023-12-17T11:49:55.301546+0000","last_undegraded":"2023-12-17T11:49:55.301546+0000","last_fullsized":"2023-12-17T11:49:55.301546+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_clean_scrub_stamp":"2023-12-17T11:49:51.168108+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T17:27:58.587187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-17T11:50:00.524643+0000","last_change":"2023-12-17T11:49:53.253979+0000","last_active":"2023-12-17T11:50:00.524643+0000","last_peered":"2023-12-17T11:50:00.524643+0000","last_clean":"2023-12-17T11:50:00.524643+0000","last_became_active":"2023-12-17T11:49:53.253694+0000","last_became_peered":"2023-12-17T11:49:53.253694+0000","last_unstale":"2023-12-17T11:50:00.524643+0000","last_undegraded":"2023-12-17T11:50:00.524643+0000","last_fullsized":"2023-12-17T11:50:00.524643+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T19:26:47.162716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"39'1","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:55.305058+0000","last_change":"2023-12-17T11:49:52.231973+0000","last_active":"2023-12-17T11:49:55.305058+0000","last_peered":"2023-12-17T11:49:55.305058+0000","last_clean":"2023-12-17T11:49:55.305058+0000","last_became_active":"2023-12-17T11:49:52.231641+0000","last_became_peered":"2023-12-17T11:49:52.231641+0000","last_unstale":"2023-12-17T11:49:55.305058+0000","last_undegraded":"2023-12-17T11:49:55.305058+0000","last_fullsized":"2023-12-17T11:49:55.305058+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_clean_scrub_stamp":"2023-12-17T11:49:51.168108+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T20:34:24.431589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:56.655838+0000","last_change":"2023-12-17T11:49:53.253141+0000","last_active":"2023-12-17T11:49:56.655838+0000","last_peered":"2023-12-17T11:49:56.655838+0000","last_clean":"2023-12-17T11:49:56.655838+0000","last_became_active":"2023-12-17T11:49:53.252532+0000","last_became_peered":"2023-12-17T11:49:53.252532+0000","last_unstale":"2023-12-17T11:49:56.655838+0000","last_undegraded":"2023-12-17T11:49:56.655838+0000","last_fullsized":"2023-12-17T11:49:56.655838+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T22:42:15.785143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"39'2","reported_seq":16,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-17T11:50:00.523361+0000","last_change":"2023-12-17T11:49:52.230858+0000","last_active":"2023-12-17T11:50:00.523361+0000","last_peered":"2023-12-17T11:50:00.523361+0000","last_clean":"2023-12-17T11:50:00.523361+0000","last_became_active":"2023-12-17T11:49:52.230281+0000","last_became_peered":"2023-12-17T11:49:52.230281+0000","last_unstale":"2023-12-17T11:50:00.523361+0000","last_undegraded":"2023-12-17T11:50:00.523361+0000","last_fullsized":"2023-12-17T11:50:00.523361+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_clean_scrub_stamp":"2023-12-17T11:49:51.168108+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T22:39:30.094160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-17T11:50:00.523134+0000","last_change":"2023-12-17T11:49:53.251192+0000","last_active":"2023-12-17T11:50:00.523134+0000","last_peered":"2023-12-17T11:50:00.523134+0000","last_clean":"2023-12-17T11:50:00.523134+0000","last_became_active":"2023-12-17T11:49:53.250837+0000","last_became_peered":"2023-12-17T11:49:53.250837+0000","last_unstale":"2023-12-17T11:50:00.523134+0000","last_undegraded":"2023-12-17T11:50:00.523134+0000","last_fullsized":"2023-12-17T11:50:00.523134+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T14:42:29.543380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"39'1","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:55.300966+0000","last_change":"2023-12-17T11:49:52.222238+0000","last_active":"2023-12-17T11:49:55.300966+0000","last_peered":"2023-12-17T11:49:55.300966+0000","last_clean":"2023-12-17T11:49:55.300966+0000","last_became_active":"2023-12-17T11:49:52.221941+0000","last_became_peered":"2023-12-17T11:49:52.221941+0000","last_unstale":"2023-12-17T11:49:55.300966+0000","last_undegraded":"2023-12-17T11:49:55.300966+0000","last_fullsized":"2023-12-17T11:49:55.300966+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_clean_scrub_stamp":"2023-12-17T11:49:51.168108+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T12:43:47.651883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:56.663718+0000","last_change":"2023-12-17T11:49:53.253162+0000","last_active":"2023-12-17T11:49:56.663718+0000","last_peered":"2023-12-17T11:49:56.663718+0000","last_clean":"2023-12-17T11:49:56.663718+0000","last_became_active":"2023-12-17T11:49:53.252770+0000","last_became_peered":"2023-12-17T11:49:53.252770+0000","last_unstale":"2023-12-17T11:49:56.663718+0000","last_undegraded":"2023-12-17T11:49:56.663718+0000","last_fullsized":"2023-12-17T11:49:56.663718+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T14:03:09.358474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:54.557332+0000","last_change":"2023-12-17T11:49:52.223776+0000","last_active":"2023-12-17T11:49:54.557332+0000","last_peered":"2023-12-17T11:49:54.557332+0000","last_clean":"2023-12-17T11:49:54.557332+0000","last_became_active":"2023-12-17T11:49:52.223571+0000","last_became_peered":"2023-12-17T11:49:52.223571+0000","last_unstale":"2023-12-17T11:49:54.557332+0000","last_undegraded":"2023-12-17T11:49:54.557332+0000","last_fullsized":"2023-12-17T11:49:54.557332+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_clean_scrub_stamp":"2023-12-17T11:49:51.168108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T22:59:00.390569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:55.301868+0000","last_change":"2023-12-17T11:49:53.232411+0000","last_active":"2023-12-17T11:49:55.301868+0000","last_peered":"2023-12-17T11:49:55.301868+0000","last_clean":"2023-12-17T11:49:55.301868+0000","last_became_active":"2023-12-17T11:49:53.232101+0000","last_became_peered":"2023-12-17T11:49:53.232101+0000","last_unstale":"2023-12-17T11:49:55.301868+0000","last_undegraded":"2023-12-17T11:49:55.301868+0000","last_fullsized":"2023-12-17T11:49:55.301868+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T11:57:59.882385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"39'2","reported_seq":15,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:55.300347+0000","last_change":"2023-12-17T11:49:52.210836+0000","last_active":"2023-12-17T11:49:55.300347+0000","last_peered":"2023-12-17T11:49:55.300347+0000","last_clean":"2023-12-17T11:49:55.300347+0000","last_became_active":"2023-12-17T11:49:52.210521+0000","last_became_peered":"2023-12-17T11:49:52.210521+0000","last_unstale":"2023-12-17T11:49:55.300347+0000","last_undegraded":"2023-12-17T11:49:55.300347+0000","last_fullsized":"2023-12-17T11:49:55.300347+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_clean_scrub_stamp":"2023-12-17T11:49:51.168108+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T17:20:36.726376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:56.659317+0000","last_change":"2023-12-17T11:49:53.243230+0000","last_active":"2023-12-17T11:49:56.659317+0000","last_peered":"2023-12-17T11:49:56.659317+0000","last_clean":"2023-12-17T11:49:56.659317+0000","last_became_active":"2023-12-17T11:49:53.242951+0000","last_became_peered":"2023-12-17T11:49:53.242951+0000","last_unstale":"2023-12-17T11:49:56.659317+0000","last_undegraded":"2023-12-17T11:49:56.659317+0000","last_fullsized":"2023-12-17T11:49:56.659317+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T18:42:00.093282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:55.300327+0000","last_change":"2023-12-17T11:49:52.217136+0000","last_active":"2023-12-17T11:49:55.300327+0000","last_peered":"2023-12-17T11:49:55.300327+0000","last_clean":"2023-12-17T11:49:55.300327+0000","last_became_active":"2023-12-17T11:49:52.216921+0000","last_became_peered":"2023-12-17T11:49:52.216921+0000","last_unstale":"2023-12-17T11:49:55.300327+0000","last_undegraded":"2023-12-17T11:49:55.300327+0000","last_fullsized":"2023-12-17T11:49:55.300327+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_clean_scrub_stamp":"2023-12-17T11:49:51.168108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T19:32:12.805680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:56.655717+0000","last_change":"2023-12-17T11:49:53.255643+0000","last_active":"2023-12-17T11:49:56.655717+0000","last_peered":"2023-12-17T11:49:56.655717+0000","last_clean":"2023-12-17T11:49:56.655717+0000","last_became_active":"2023-12-17T11:49:53.255379+0000","last_became_peered":"2023-12-17T11:49:53.255379+0000","last_unstale":"2023-12-17T11:49:56.655717+0000","last_undegraded":"2023-12-17T11:49:56.655717+0000","last_fullsized":"2023-12-17T11:49:56.655717+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T16:21:14.355302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:55.301924+0000","last_change":"2023-12-17T11:49:52.229883+0000","last_active":"2023-12-17T11:49:55.301924+0000","last_peered":"2023-12-17T11:49:55.301924+0000","last_clean":"2023-12-17T11:49:55.301924+0000","last_became_active":"2023-12-17T11:49:52.229372+0000","last_became_peered":"2023-12-17T11:49:52.229372+0000","last_unstale":"2023-12-17T11:49:55.301924+0000","last_undegraded":"2023-12-17T11:49:55.301924+0000","last_fullsized":"2023-12-17T11:49:55.301924+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_clean_scrub_stamp":"2023-12-17T11:49:51.168108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T23:27:59.830582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-17T11:50:00.524144+0000","last_change":"2023-12-17T11:49:53.249227+0000","last_active":"2023-12-17T11:50:00.524144+0000","last_peered":"2023-12-17T11:50:00.524144+0000","last_clean":"2023-12-17T11:50:00.524144+0000","last_became_active":"2023-12-17T11:49:53.248594+0000","last_became_peered":"2023-12-17T11:49:53.248594+0000","last_unstale":"2023-12-17T11:50:00.524144+0000","last_undegraded":"2023-12-17T11:50:00.524144+0000","last_fullsized":"2023-12-17T11:50:00.524144+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T14:31:17.752657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:55.300293+0000","last_change":"2023-12-17T11:49:52.211707+0000","last_active":"2023-12-17T11:49:55.300293+0000","last_peered":"2023-12-17T11:49:55.300293+0000","last_clean":"2023-12-17T11:49:55.300293+0000","last_became_active":"2023-12-17T11:49:52.211283+0000","last_became_peered":"2023-12-17T11:49:52.211283+0000","last_unstale":"2023-12-17T11:49:55.300293+0000","last_undegraded":"2023-12-17T11:49:55.300293+0000","last_fullsized":"2023-12-17T11:49:55.300293+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_clean_scrub_stamp":"2023-12-17T11:49:51.168108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T12:54:05.203029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:56.660005+0000","last_change":"2023-12-17T11:49:53.255235+0000","last_active":"2023-12-17T11:49:56.660005+0000","last_peered":"2023-12-17T11:49:56.660005+0000","last_clean":"2023-12-17T11:49:56.660005+0000","last_became_active":"2023-12-17T11:49:53.254570+0000","last_became_peered":"2023-12-17T11:49:53.254570+0000","last_unstale":"2023-12-17T11:49:56.660005+0000","last_undegraded":"2023-12-17T11:49:56.660005+0000","last_fullsized":"2023-12-17T11:49:56.660005+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T15:14:36.959400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"39'2","reported_seq":15,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:55.305320+0000","last_change":"2023-12-17T11:49:52.229686+0000","last_active":"2023-12-17T11:49:55.305320+0000","last_peered":"2023-12-17T11:49:55.305320+0000","last_clean":"2023-12-17T11:49:55.305320+0000","last_became_active":"2023-12-17T11:49:52.229401+0000","last_became_peered":"2023-12-17T11:49:52.229401+0000","last_unstale":"2023-12-17T11:49:55.305320+0000","last_undegraded":"2023-12-17T11:49:55.305320+0000","last_fullsized":"2023-12-17T11:49:55.305320+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_clean_scrub_stamp":"2023-12-17T11:49:51.168108+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T17:03:59.637357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:55.302996+0000","last_change":"2023-12-17T11:49:53.236908+0000","last_active":"2023-12-17T11:49:55.302996+0000","last_peered":"2023-12-17T11:49:55.302996+0000","last_clean":"2023-12-17T11:49:55.302996+0000","last_became_active":"2023-12-17T11:49:53.236508+0000","last_became_peered":"2023-12-17T11:49:53.236508+0000","last_unstale":"2023-12-17T11:49:55.302996+0000","last_undegraded":"2023-12-17T11:49:55.302996+0000","last_fullsized":"2023-12-17T11:49:55.302996+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T13:59:52.939825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"40'1","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:58.273630+0000","last_change":"2023-12-17T11:49:52.229067+0000","last_active":"2023-12-17T11:49:58.273630+0000","last_peered":"2023-12-17T11:49:58.273630+0000","last_clean":"2023-12-17T11:49:58.273630+0000","last_became_active":"2023-12-17T11:49:52.228704+0000","last_became_peered":"2023-12-17T11:49:52.228704+0000","last_unstale":"2023-12-17T11:49:58.273630+0000","last_undegraded":"2023-12-17T11:49:58.273630+0000","last_fullsized":"2023-12-17T11:49:58.273630+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_clean_scrub_stamp":"2023-12-17T11:49:51.168108+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T16:31:06.129915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-17T11:50:00.524876+0000","last_change":"2023-12-17T11:49:53.246415+0000","last_active":"2023-12-17T11:50:00.524876+0000","last_peered":"2023-12-17T11:50:00.524876+0000","last_clean":"2023-12-17T11:50:00.524876+0000","last_became_active":"2023-12-17T11:49:53.246163+0000","last_became_peered":"2023-12-17T11:49:53.246163+0000","last_unstale":"2023-12-17T11:50:00.524876+0000","last_undegraded":"2023-12-17T11:50:00.524876+0000","last_fullsized":"2023-12-17T11:50:00.524876+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T17:56:09.285369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:55.302270+0000","last_change":"2023-12-17T11:49:52.219865+0000","last_active":"2023-12-17T11:49:55.302270+0000","last_peered":"2023-12-17T11:49:55.302270+0000","last_clean":"2023-12-17T11:49:55.302270+0000","last_became_active":"2023-12-17T11:49:52.219593+0000","last_became_peered":"2023-12-17T11:49:52.219593+0000","last_unstale":"2023-12-17T11:49:55.302270+0000","last_undegraded":"2023-12-17T11:49:55.302270+0000","last_fullsized":"2023-12-17T11:49:55.302270+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_clean_scrub_stamp":"2023-12-17T11:49:51.168108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T15:14:35.947970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:56.659295+0000","last_change":"2023-12-17T11:49:53.242876+0000","last_active":"2023-12-17T11:49:56.659295+0000","last_peered":"2023-12-17T11:49:56.659295+0000","last_clean":"2023-12-17T11:49:56.659295+0000","last_became_active":"2023-12-17T11:49:53.242568+0000","last_became_peered":"2023-12-17T11:49:53.242568+0000","last_unstale":"2023-12-17T11:49:56.659295+0000","last_undegraded":"2023-12-17T11:49:56.659295+0000","last_fullsized":"2023-12-17T11:49:56.659295+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T23:10:56.100255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:55.302112+0000","last_change":"2023-12-17T11:49:52.223424+0000","last_active":"2023-12-17T11:49:55.302112+0000","last_peered":"2023-12-17T11:49:55.302112+0000","last_clean":"2023-12-17T11:49:55.302112+0000","last_became_active":"2023-12-17T11:49:52.223126+0000","last_became_peered":"2023-12-17T11:49:52.223126+0000","last_unstale":"2023-12-17T11:49:55.302112+0000","last_undegraded":"2023-12-17T11:49:55.302112+0000","last_fullsized":"2023-12-17T11:49:55.302112+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_clean_scrub_stamp":"2023-12-17T11:49:51.168108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T14:31:59.450792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:56.659933+0000","last_change":"2023-12-17T11:49:53.251516+0000","last_active":"2023-12-17T11:49:56.659933+0000","last_peered":"2023-12-17T11:49:56.659933+0000","last_clean":"2023-12-17T11:49:56.659933+0000","last_became_active":"2023-12-17T11:49:53.251230+0000","last_became_peered":"2023-12-17T11:49:53.251230+0000","last_unstale":"2023-12-17T11:49:56.659933+0000","last_undegraded":"2023-12-17T11:49:56.659933+0000","last_fullsized":"2023-12-17T11:49:56.659933+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T19:39:18.340154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-17T11:50:01.202294+0000","last_change":"2023-12-17T11:49:52.219807+0000","last_active":"2023-12-17T11:50:01.202294+0000","last_peered":"2023-12-17T11:50:01.202294+0000","last_clean":"2023-12-17T11:50:01.202294+0000","last_became_active":"2023-12-17T11:49:52.219503+0000","last_became_peered":"2023-12-17T11:49:52.219503+0000","last_unstale":"2023-12-17T11:50:01.202294+0000","last_undegraded":"2023-12-17T11:50:01.202294+0000","last_fullsized":"2023-12-17T11:50:01.202294+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_clean_scrub_stamp":"2023-12-17T11:49:51.168108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T18:07:09.094032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-17T11:50:00.522740+0000","last_change":"2023-12-17T11:49:53.241750+0000","last_active":"2023-12-17T11:50:00.522740+0000","last_peered":"2023-12-17T11:50:00.522740+0000","last_clean":"2023-12-17T11:50:00.522740+0000","last_became_active":"2023-12-17T11:49:53.241529+0000","last_became_peered":"2023-12-17T11:49:53.241529+0000","last_unstale":"2023-12-17T11:50:00.522740+0000","last_undegraded":"2023-12-17T11:50:00.522740+0000","last_fullsized":"2023-12-17T11:50:00.522740+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T16:31:53.964205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-17T11:50:00.522300+0000","last_change":"2023-12-17T11:49:52.216579+0000","last_active":"2023-12-17T11:50:00.522300+0000","last_peered":"2023-12-17T11:50:00.522300+0000","last_clean":"2023-12-17T11:50:00.522300+0000","last_became_active":"2023-12-17T11:49:52.216265+0000","last_became_peered":"2023-12-17T11:49:52.216265+0000","last_unstale":"2023-12-17T11:50:00.522300+0000","last_undegraded":"2023-12-17T11:50:00.522300+0000","last_fullsized":"2023-12-17T11:50:00.522300+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_clean_scrub_stamp":"2023-12-17T11:49:51.168108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T14:31:59.450792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:55.302580+0000","last_change":"2023-12-17T11:49:53.234303+0000","last_active":"2023-12-17T11:49:55.302580+0000","last_peered":"2023-12-17T11:49:55.302580+0000","last_clean":"2023-12-17T11:49:55.302580+0000","last_became_active":"2023-12-17T11:49:53.233951+0000","last_became_peered":"2023-12-17T11:49:53.233951+0000","last_unstale":"2023-12-17T11:49:55.302580+0000","last_undegraded":"2023-12-17T11:49:55.302580+0000","last_fullsized":"2023-12-17T11:49:55.302580+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T19:17:38.569694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-17T11:50:00.522523+0000","last_change":"2023-12-17T11:49:52.219957+0000","last_active":"2023-12-17T11:50:00.522523+0000","last_peered":"2023-12-17T11:50:00.522523+0000","last_clean":"2023-12-17T11:50:00.522523+0000","last_became_active":"2023-12-17T11:49:52.219626+0000","last_became_peered":"2023-12-17T11:49:52.219626+0000","last_unstale":"2023-12-17T11:50:00.522523+0000","last_undegraded":"2023-12-17T11:50:00.522523+0000","last_fullsized":"2023-12-17T11:50:00.522523+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_clean_scrub_stamp":"2023-12-17T11:49:51.168108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T19:12:11.016281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:56.655904+0000","last_change":"2023-12-17T11:49:53.253151+0000","last_active":"2023-12-17T11:49:56.655904+0000","last_peered":"2023-12-17T11:49:56.655904+0000","last_clean":"2023-12-17T11:49:56.655904+0000","last_became_active":"2023-12-17T11:49:53.252842+0000","last_became_peered":"2023-12-17T11:49:53.252842+0000","last_unstale":"2023-12-17T11:49:56.655904+0000","last_undegraded":"2023-12-17T11:49:56.655904+0000","last_fullsized":"2023-12-17T11:49:56.655904+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T14:31:17.752657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:55.302520+0000","last_change":"2023-12-17T11:49:52.228110+0000","last_active":"2023-12-17T11:49:55.302520+0000","last_peered":"2023-12-17T11:49:55.302520+0000","last_clean":"2023-12-17T11:49:55.302520+0000","last_became_active":"2023-12-17T11:49:52.227851+0000","last_became_peered":"2023-12-17T11:49:52.227851+0000","last_unstale":"2023-12-17T11:49:55.302520+0000","last_undegraded":"2023-12-17T11:49:55.302520+0000","last_fullsized":"2023-12-17T11:49:55.302520+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_clean_scrub_stamp":"2023-12-17T11:49:51.168108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T18:37:20.380970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":180,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-17T11:49:53.217829+0000","last_change":"2023-12-17T11:48:07.952584+0000","last_active":"2023-12-17T11:49:53.217829+0000","last_peered":"2023-12-17T11:49:53.217829+0000","last_clean":"2023-12-17T11:49:53.217829+0000","last_became_active":"2023-12-17T11:48:07.950361+0000","last_became_peered":"2023-12-17T11:48:07.950361+0000","last_unstale":"2023-12-17T11:49:53.217829+0000","last_undegraded":"2023-12-17T11:49:53.217829+0000","last_fullsized":"2023-12-17T11:49:53.217829+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:06.728199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:06.728199+0000","last_clean_scrub_stamp":"2023-12-17T11:48:06.728199+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T12:47:55.048065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542171,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28064,"kb_used_data":1044,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343776,"statfs":{"total":96636764160,"available":96608026624,"internally_reserved":0,"allocated":1069056,"data_stored":789626,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 17 11:49:06 2023","interfaces":[{"interface":"back","average":{"1min":1.407,"5min":1.407,"15min":1.407},"min":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":8.6579999999999995,"5min":8.6579999999999995,"15min":8.6579999999999995},"last":1.288},{"interface":"front","average":{"1min":1.339,"5min":1.339,"15min":1.339},"min":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"max":{"1min":4.0830000000000002,"5min":4.0830000000000002,"15min":4.0830000000000002},"last":1.3360000000000001}]},{"osd":1,"last update":"Sun Dec 17 11:49:06 2023","interfaces":[{"interface":"back","average":{"1min":1.127,"5min":1.127,"15min":1.127},"min":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"max":{"1min":2.1539999999999999,"5min":2.1539999999999999,"15min":2.1539999999999999},"last":1.6850000000000001},{"interface":"front","average":{"1min":1.413,"5min":1.413,"15min":1.413},"min":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"max":{"1min":8.7449999999999992,"5min":8.7449999999999992,"15min":8.7449999999999992},"last":1.014}]},{"osd":2,"last update":"Sun Dec 17 11:49:06 2023","interfaces":[{"interface":"back","average":{"1min":1.4299999999999999,"5min":1.4299999999999999,"15min":1.4299999999999999},"min":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"max":{"1min":4.1239999999999997,"5min":4.1239999999999997,"15min":4.1239999999999997},"last":1.2130000000000001},{"interface":"front","average":{"1min":1.3720000000000001,"5min":1.3720000000000001,"15min":1.3720000000000001},"min":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"max":{"1min":1.782,"5min":1.782,"15min":1.782},"last":0.92300000000000004}]},{"osd":3,"last update":"Sun Dec 17 11:49:06 2023","interfaces":[{"interface":"back","average":{"1min":1.298,"5min":1.298,"15min":1.298},"min":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"max":{"1min":2.5430000000000001,"5min":2.5430000000000001,"15min":2.5430000000000001},"last":1.556},{"interface":"front","average":{"1min":1.375,"5min":1.375,"15min":1.375},"min":{"1min":1.087,"5min":1.087,"15min":1.087},"max":{"1min":2.5830000000000002,"5min":2.5830000000000002,"15min":2.5830000000000002},"last":1.3740000000000001}]},{"osd":4,"last update":"Sun Dec 17 11:49:06 2023","interfaces":[{"interface":"back","average":{"1min":1.3859999999999999,"5min":1.3859999999999999,"15min":1.3859999999999999},"min":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":4.0309999999999997,"5min":4.0309999999999997,"15min":4.0309999999999997},"last":1.498},{"interface":"front","average":{"1min":1.5860000000000001,"5min":1.5860000000000001,"15min":1.5860000000000001},"min":{"1min":1.2230000000000001,"5min":1.2230000000000001,"15min":1.2230000000000001},"max":{"1min":3.3220000000000001,"5min":3.3220000000000001,"15min":3.3220000000000001},"last":1.8120000000000001}]},{"osd":5,"last update":"Sun Dec 17 11:49:06 2023","interfaces":[{"interface":"back","average":{"1min":1.6970000000000001,"5min":1.6970000000000001,"15min":1.6970000000000001},"min":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"max":{"1min":8.7929999999999993,"5min":8.7929999999999993,"15min":8.7929999999999993},"last":1.4399999999999999},{"interface":"front","average":{"1min":1.6859999999999999,"5min":1.6859999999999999,"15min":1.6859999999999999},"min":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"max":{"1min":5.1040000000000001,"5min":5.1040000000000001,"15min":5.1040000000000001},"last":1.786}]},{"osd":6,"last update":"Sun Dec 17 11:49:06 2023","interfaces":[{"interface":"back","average":{"1min":1.845,"5min":1.845,"15min":1.845},"min":{"1min":1.081,"5min":1.081,"15min":1.081},"max":{"1min":8.8330000000000002,"5min":8.8330000000000002,"15min":8.8330000000000002},"last":1.6439999999999999},{"interface":"front","average":{"1min":1.71,"5min":1.71,"15min":1.71},"min":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"max":{"1min":3.9590000000000001,"5min":3.9590000000000001,"15min":3.9590000000000001},"last":1.6060000000000001}]}]},{"osd":6,"up_from":14,"seq":60129542171,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27480,"kb_used_data":452,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344360,"statfs":{"total":96636764160,"available":96608624640,"internally_reserved":0,"allocated":462848,"data_stored":198158,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 17 11:49:06 2023","interfaces":[{"interface":"back","average":{"1min":1.0720000000000001,"5min":1.0720000000000001,"15min":1.0720000000000001},"min":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.5840000000000001,"5min":1.5840000000000001,"15min":1.5840000000000001},"last":1.0169999999999999},{"interface":"front","average":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"min":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"max":{"1min":1.429,"5min":1.429,"15min":1.429},"last":1.8400000000000001}]},{"osd":1,"last update":"Sun Dec 17 11:49:06 2023","interfaces":[{"interface":"back","average":{"1min":1.2689999999999999,"5min":1.2689999999999999,"15min":1.2689999999999999},"min":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"max":{"1min":1.5640000000000001,"5min":1.5640000000000001,"15min":1.5640000000000001},"last":1.403},{"interface":"front","average":{"1min":1.3169999999999999,"5min":1.3169999999999999,"15min":1.3169999999999999},"min":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"max":{"1min":1.9359999999999999,"5min":1.9359999999999999,"15min":1.9359999999999999},"last":1.7809999999999999}]},{"osd":2,"last update":"Sun Dec 17 11:49:06 2023","interfaces":[{"interface":"back","average":{"1min":1.1970000000000001,"5min":1.1970000000000001,"15min":1.1970000000000001},"min":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":1.8740000000000001,"5min":1.8740000000000001,"15min":1.8740000000000001},"last":1.6930000000000001},{"interface":"front","average":{"1min":1.296,"5min":1.296,"15min":1.296},"min":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":2.5470000000000002,"5min":2.5470000000000002,"15min":2.5470000000000002},"last":1.29}]},{"osd":3,"last update":"Sun Dec 17 11:49:06 2023","interfaces":[{"interface":"back","average":{"1min":1.508,"5min":1.508,"15min":1.508},"min":{"1min":1.0840000000000001,"5min":1.0840000000000001,"15min":1.0840000000000001},"max":{"1min":2.4689999999999999,"5min":2.4689999999999999,"15min":2.4689999999999999},"last":1.9590000000000001},{"interface":"front","average":{"1min":1.4390000000000001,"5min":1.4390000000000001,"15min":1.4390000000000001},"min":{"1min":0.88,"5min":0.88,"15min":0.88},"max":{"1min":2.0680000000000001,"5min":2.0680000000000001,"15min":2.0680000000000001},"last":1.216}]},{"osd":4,"last update":"Sun Dec 17 11:49:06 2023","interfaces":[{"interface":"back","average":{"1min":1.522,"5min":1.522,"15min":1.522},"min":{"1min":1.1419999999999999,"5min":1.1419999999999999,"15min":1.1419999999999999},"max":{"1min":2.222,"5min":2.222,"15min":2.222},"last":1.5069999999999999},{"interface":"front","average":{"1min":1.4419999999999999,"5min":1.4419999999999999,"15min":1.4419999999999999},"min":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":0.90700000000000003},"max":{"1min":2.4079999999999999,"5min":2.4079999999999999,"15min":2.4079999999999999},"last":1.444}]},{"osd":5,"last update":"Sun Dec 17 11:49:06 2023","interfaces":[{"interface":"back","average":{"1min":1.548,"5min":1.548,"15min":1.548},"min":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"max":{"1min":2.3319999999999999,"5min":2.3319999999999999,"15min":2.3319999999999999},"last":1.6279999999999999},{"interface":"front","average":{"1min":1.5760000000000001,"5min":1.5760000000000001,"15min":1.5760000000000001},"min":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"max":{"1min":2.6760000000000002,"5min":2.6760000000000002,"15min":2.6760000000000002},"last":1.6000000000000001}]},{"osd":7,"last update":"Sun Dec 17 11:49:06 2023","interfaces":[{"interface":"back","average":{"1min":1.419,"5min":1.419,"15min":1.419},"min":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"max":{"1min":2.1560000000000001,"5min":2.1560000000000001,"15min":2.1560000000000001},"last":1.5589999999999999},{"interface":"front","average":{"1min":1.712,"5min":1.712,"15min":1.712},"min":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"max":{"1min":2.6059999999999999,"5min":2.6059999999999999,"15min":2.6059999999999999},"last":1.8919999999999999}]}]},{"osd":5,"up_from":14,"seq":60129542170,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27488,"kb_used_data":468,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344352,"statfs":{"total":96636764160,"available":96608616448,"internally_reserved":0,"allocated":479232,"data_stored":203975,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 17 11:49:09 2023","interfaces":[{"interface":"back","average":{"1min":1.101,"5min":1.101,"15min":1.101},"min":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":1.5860000000000001,"5min":1.5860000000000001,"15min":1.5860000000000001},"last":1.204},{"interface":"front","average":{"1min":1.23,"5min":1.23,"15min":1.23},"min":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"max":{"1min":1.9419999999999999,"5min":1.9419999999999999,"15min":1.9419999999999999},"last":1.0860000000000001}]},{"osd":1,"last update":"Sun Dec 17 11:49:09 2023","interfaces":[{"interface":"back","average":{"1min":1.167,"5min":1.167,"15min":1.167},"min":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"max":{"1min":1.5289999999999999,"5min":1.5289999999999999,"15min":1.5289999999999999},"last":1.6479999999999999},{"interface":"front","average":{"1min":1.216,"5min":1.216,"15min":1.216},"min":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"max":{"1min":1.8660000000000001,"5min":1.8660000000000001,"15min":1.8660000000000001},"last":1.3220000000000001}]},{"osd":2,"last update":"Sun Dec 17 11:49:09 2023","interfaces":[{"interface":"back","average":{"1min":1.3140000000000001,"5min":1.3140000000000001,"15min":1.3140000000000001},"min":{"1min":0.747,"5min":0.747,"15min":0.747},"max":{"1min":2.1589999999999998,"5min":2.1589999999999998,"15min":2.1589999999999998},"last":0.93899999999999995},{"interface":"front","average":{"1min":1.3919999999999999,"5min":1.3919999999999999,"15min":1.3919999999999999},"min":{"1min":1.0049999999999999,"5min":1.0049999999999999,"15min":1.0049999999999999},"max":{"1min":2.1379999999999999,"5min":2.1379999999999999,"15min":2.1379999999999999},"last":1.506}]},{"osd":3,"last update":"Sun Dec 17 11:49:09 2023","interfaces":[{"interface":"back","average":{"1min":1.337,"5min":1.337,"15min":1.337},"min":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"max":{"1min":2.593,"5min":2.593,"15min":2.593},"last":1.351},{"interface":"front","average":{"1min":1.407,"5min":1.407,"15min":1.407},"min":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"max":{"1min":2.3079999999999998,"5min":2.3079999999999998,"15min":2.3079999999999998},"last":1.381}]},{"osd":4,"last update":"Sun Dec 17 11:49:09 2023","interfaces":[{"interface":"back","average":{"1min":1.5029999999999999,"5min":1.5029999999999999,"15min":1.5029999999999999},"min":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"max":{"1min":2.5299999999999998,"5min":2.5299999999999998,"15min":2.5299999999999998},"last":1.4510000000000001},{"interface":"front","average":{"1min":1.6879999999999999,"5min":1.6879999999999999,"15min":1.6879999999999999},"min":{"1min":1.0669999999999999,"5min":1.0669999999999999,"15min":1.0669999999999999},"max":{"1min":3.9569999999999999,"5min":3.9569999999999999,"15min":3.9569999999999999},"last":1.1739999999999999}]},{"osd":6,"last update":"Sun Dec 17 11:49:09 2023","interfaces":[{"interface":"back","average":{"1min":1.6619999999999999,"5min":1.6619999999999999,"15min":1.6619999999999999},"min":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"max":{"1min":2.9849999999999999,"5min":2.9849999999999999,"15min":2.9849999999999999},"last":1.5900000000000001},{"interface":"front","average":{"1min":1.6319999999999999,"5min":1.6319999999999999,"15min":1.6319999999999999},"min":{"1min":1.25,"5min":1.25,"15min":1.25},"max":{"1min":2.641,"5min":2.641,"15min":2.641},"last":1.5569999999999999}]},{"osd":7,"last update":"Sun Dec 17 11:49:09 2023","interfaces":[{"interface":"back","average":{"1min":1.8080000000000001,"5min":1.8080000000000001,"15min":1.8080000000000001},"min":{"1min":1.232,"5min":1.232,"15min":1.232},"max":{"1min":3.8570000000000002,"5min":3.8570000000000002,"15min":3.8570000000000002},"last":1.2589999999999999},{"interface":"front","average":{"1min":1.827,"5min":1.827,"15min":1.827},"min":{"1min":1.137,"5min":1.137,"15min":1.137},"max":{"1min":2.8999999999999999,"5min":2.8999999999999999,"15min":2.8999999999999999},"last":1.702}]}]},{"osd":4,"up_from":14,"seq":60129542171,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27488,"kb_used_data":468,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344352,"statfs":{"total":96636764160,"available":96608616448,"internally_reserved":0,"allocated":479232,"data_stored":204467,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 17 11:49:08 2023","interfaces":[{"interface":"back","average":{"1min":1.02,"5min":1.02,"15min":1.02},"min":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"max":{"1min":1.1890000000000001,"5min":1.1890000000000001,"15min":1.1890000000000001},"last":1.3300000000000001},{"interface":"front","average":{"1min":1.167,"5min":1.167,"15min":1.167},"min":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"max":{"1min":2.6400000000000001,"5min":2.6400000000000001,"15min":2.6400000000000001},"last":0.96599999999999997}]},{"osd":1,"last update":"Sun Dec 17 11:49:08 2023","interfaces":[{"interface":"back","average":{"1min":1.0960000000000001,"5min":1.0960000000000001,"15min":1.0960000000000001},"min":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"max":{"1min":1.369,"5min":1.369,"15min":1.369},"last":1.4450000000000001},{"interface":"front","average":{"1min":1.2669999999999999,"5min":1.2669999999999999,"15min":1.2669999999999999},"min":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"max":{"1min":1.631,"5min":1.631,"15min":1.631},"last":0.88600000000000001}]},{"osd":2,"last update":"Sun Dec 17 11:49:08 2023","interfaces":[{"interface":"back","average":{"1min":1.393,"5min":1.393,"15min":1.393},"min":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"max":{"1min":1.8660000000000001,"5min":1.8660000000000001,"15min":1.8660000000000001},"last":1.2},{"interface":"front","average":{"1min":1.329,"5min":1.329,"15min":1.329},"min":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"max":{"1min":1.968,"5min":1.968,"15min":1.968},"last":1.5069999999999999}]},{"osd":3,"last update":"Sun Dec 17 11:49:08 2023","interfaces":[{"interface":"back","average":{"1min":1.4410000000000001,"5min":1.4410000000000001,"15min":1.4410000000000001},"min":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"max":{"1min":3.2290000000000001,"5min":3.2290000000000001,"15min":3.2290000000000001},"last":1.28},{"interface":"front","average":{"1min":1.496,"5min":1.496,"15min":1.496},"min":{"1min":1.1000000000000001,"5min":1.1000000000000001,"15min":1.1000000000000001},"max":{"1min":2.0169999999999999,"5min":2.0169999999999999,"15min":2.0169999999999999},"last":1.556}]},{"osd":5,"last update":"Sun Dec 17 11:49:08 2023","interfaces":[{"interface":"back","average":{"1min":1.474,"5min":1.474,"15min":1.474},"min":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"max":{"1min":2.141,"5min":2.141,"15min":2.141},"last":1.653},{"interface":"front","average":{"1min":1.7110000000000001,"5min":1.7110000000000001,"15min":1.7110000000000001},"min":{"1min":1.2390000000000001,"5min":1.2390000000000001,"15min":1.2390000000000001},"max":{"1min":3.8220000000000001,"5min":3.8220000000000001,"15min":3.8220000000000001},"last":1.3999999999999999}]},{"osd":6,"last update":"Sun Dec 17 11:49:08 2023","interfaces":[{"interface":"back","average":{"1min":1.7370000000000001,"5min":1.7370000000000001,"15min":1.7370000000000001},"min":{"1min":1.212,"5min":1.212,"15min":1.212},"max":{"1min":2.7410000000000001,"5min":2.7410000000000001,"15min":2.7410000000000001},"last":1.627},{"interface":"front","average":{"1min":1.677,"5min":1.677,"15min":1.677},"min":{"1min":1.222,"5min":1.222,"15min":1.222},"max":{"1min":2.2989999999999999,"5min":2.2989999999999999,"15min":2.2989999999999999},"last":1.726}]},{"osd":7,"last update":"Sun Dec 17 11:49:08 2023","interfaces":[{"interface":"back","average":{"1min":1.847,"5min":1.847,"15min":1.847},"min":{"1min":1.2749999999999999,"5min":1.2749999999999999,"15min":1.2749999999999999},"max":{"1min":3.944,"5min":3.944,"15min":3.944},"last":1.5960000000000001},{"interface":"front","average":{"1min":1.8160000000000001,"5min":1.8160000000000001,"15min":1.8160000000000001},"min":{"1min":1.4239999999999999,"5min":1.4239999999999999,"15min":1.4239999999999999},"max":{"1min":2.8809999999999998,"5min":2.8809999999999998,"15min":2.8809999999999998},"last":1.6830000000000001}]}]},{"osd":3,"up_from":14,"seq":60129542170,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27508,"kb_used_data":488,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344332,"statfs":{"total":96636764160,"available":96608595968,"internally_reserved":0,"allocated":499712,"data_stored":211775,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 17 11:49:06 2023","interfaces":[{"interface":"back","average":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.6459999999999999,"5min":1.6459999999999999,"15min":1.6459999999999999},"last":0.77300000000000002},{"interface":"front","average":{"1min":1.0700000000000001,"5min":1.0700000000000001,"15min":1.0700000000000001},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":3.5800000000000001,"5min":3.5800000000000001,"15min":3.5800000000000001},"last":0.45600000000000002}]},{"osd":1,"last update":"Sun Dec 17 11:49:06 2023","interfaces":[{"interface":"back","average":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":1.4379999999999999,"5min":1.4379999999999999,"15min":1.4379999999999999},"last":0.70499999999999996},{"interface":"front","average":{"1min":1.1519999999999999,"5min":1.1519999999999999,"15min":1.1519999999999999},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":2.085,"5min":2.085,"15min":2.085},"last":0.93700000000000006}]},{"osd":2,"last update":"Sun Dec 17 11:49:06 2023","interfaces":[{"interface":"back","average":{"1min":1.1659999999999999,"5min":1.1659999999999999,"15min":1.1659999999999999},"min":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":1.651,"5min":1.651,"15min":1.651},"last":1.141},{"interface":"front","average":{"1min":1.2569999999999999,"5min":1.2569999999999999,"15min":1.2569999999999999},"min":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":2.1429999999999998,"5min":2.1429999999999998,"15min":2.1429999999999998},"last":0.873}]},{"osd":4,"last update":"Sun Dec 17 11:49:06 2023","interfaces":[{"interface":"back","average":{"1min":1.4330000000000001,"5min":1.4330000000000001,"15min":1.4330000000000001},"min":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"max":{"1min":2.4870000000000001,"5min":2.4870000000000001,"15min":2.4870000000000001},"last":0.68600000000000005},{"interface":"front","average":{"1min":1.476,"5min":1.476,"15min":1.476},"min":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"max":{"1min":2.3460000000000001,"5min":2.3460000000000001,"15min":2.3460000000000001},"last":0.98399999999999999}]},{"osd":5,"last update":"Sun Dec 17 11:49:06 2023","interfaces":[{"interface":"back","average":{"1min":1.476,"5min":1.476,"15min":1.476},"min":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"max":{"1min":2.5710000000000002,"5min":2.5710000000000002,"15min":2.5710000000000002},"last":1.319},{"interface":"front","average":{"1min":1.5,"5min":1.5,"15min":1.5},"min":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"max":{"1min":2.383,"5min":2.383,"15min":2.383},"last":0.85399999999999998}]},{"osd":6,"last update":"Sun Dec 17 11:49:06 2023","interfaces":[{"interface":"back","average":{"1min":1.474,"5min":1.474,"15min":1.474},"min":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"max":{"1min":2.6179999999999999,"5min":2.6179999999999999,"15min":2.6179999999999999},"last":1.1080000000000001},{"interface":"front","average":{"1min":1.5149999999999999,"5min":1.5149999999999999,"15min":1.5149999999999999},"min":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"max":{"1min":2.7679999999999998,"5min":2.7679999999999998,"15min":2.7679999999999998},"last":1.258}]},{"osd":7,"last update":"Sun Dec 17 11:49:06 2023","interfaces":[{"interface":"back","average":{"1min":1.581,"5min":1.581,"15min":1.581},"min":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"max":{"1min":3.7000000000000002,"5min":3.7000000000000002,"15min":3.7000000000000002},"last":1.054},{"interface":"front","average":{"1min":1.579,"5min":1.579,"15min":1.579},"min":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":0.97099999999999997},"max":{"1min":2.427,"5min":2.427,"15min":2.427},"last":1.177}]}]},{"osd":2,"up_from":14,"seq":60129542171,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27472,"kb_used_data":452,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344368,"statfs":{"total":96636764160,"available":96608632832,"internally_reserved":0,"allocated":462848,"data_stored":197646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 17 11:49:07 2023","interfaces":[{"interface":"back","average":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":1.724,"5min":1.724,"15min":1.724},"last":1.0369999999999999},{"interface":"front","average":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.502,"5min":1.502,"15min":1.502},"last":0.998}]},{"osd":1,"last update":"Sun Dec 17 11:49:07 2023","interfaces":[{"interface":"back","average":{"1min":0.995,"5min":0.995,"15min":0.995},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.4790000000000001,"5min":1.4790000000000001,"15min":1.4790000000000001},"last":1.5309999999999999},{"interface":"front","average":{"1min":1.056,"5min":1.056,"15min":1.056},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":2.6280000000000001,"5min":2.6280000000000001,"15min":2.6280000000000001},"last":0.83999999999999997}]},{"osd":3,"last update":"Sun Dec 17 11:49:07 2023","interfaces":[{"interface":"back","average":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.476,"5min":1.476,"15min":1.476},"last":0.753},{"interface":"front","average":{"1min":1.214,"5min":1.214,"15min":1.214},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.9670000000000001,"5min":1.9670000000000001,"15min":1.9670000000000001},"last":1.4450000000000001}]},{"osd":4,"last update":"Sun Dec 17 11:49:07 2023","interfaces":[{"interface":"back","average":{"1min":1.49,"5min":1.49,"15min":1.49},"min":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"max":{"1min":2.5750000000000002,"5min":2.5750000000000002,"15min":2.5750000000000002},"last":1.2070000000000001},{"interface":"front","average":{"1min":1.3879999999999999,"5min":1.3879999999999999,"15min":1.3879999999999999},"min":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"max":{"1min":2.4940000000000002,"5min":2.4940000000000002,"15min":2.4940000000000002},"last":1.391}]},{"osd":5,"last update":"Sun Dec 17 11:49:07 2023","interfaces":[{"interface":"back","average":{"1min":1.3240000000000001,"5min":1.3240000000000001,"15min":1.3240000000000001},"min":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"max":{"1min":2.4289999999999998,"5min":2.4289999999999998,"15min":2.4289999999999998},"last":1.343},{"interface":"front","average":{"1min":1.5489999999999999,"5min":1.5489999999999999,"15min":1.5489999999999999},"min":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"max":{"1min":2.694,"5min":2.694,"15min":2.694},"last":1.597}]},{"osd":6,"last update":"Sun Dec 17 11:49:07 2023","interfaces":[{"interface":"back","average":{"1min":1.472,"5min":1.472,"15min":1.472},"min":{"1min":0.748,"5min":0.748,"15min":0.748},"max":{"1min":2.7349999999999999,"5min":2.7349999999999999,"15min":2.7349999999999999},"last":1.1180000000000001},{"interface":"front","average":{"1min":1.4119999999999999,"5min":1.4119999999999999,"15min":1.4119999999999999},"min":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"max":{"1min":2.468,"5min":2.468,"15min":2.468},"last":1.4950000000000001}]},{"osd":7,"last update":"Sun Dec 17 11:49:07 2023","interfaces":[{"interface":"back","average":{"1min":1.554,"5min":1.554,"15min":1.554},"min":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"max":{"1min":3.379,"5min":3.379,"15min":3.379},"last":1.23},{"interface":"front","average":{"1min":1.474,"5min":1.474,"15min":1.474},"min":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"max":{"1min":2.2869999999999999,"5min":2.2869999999999999,"15min":2.2869999999999999},"last":1.571}]}]},{"osd":1,"up_from":14,"seq":60129542170,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27484,"kb_used_data":464,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344356,"statfs":{"total":96636764160,"available":96608620544,"internally_reserved":0,"allocated":475136,"data_stored":203953,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 17 11:49:08 2023","interfaces":[{"interface":"back","average":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.5249999999999999,"5min":1.5249999999999999,"15min":1.5249999999999999},"last":1.1020000000000001},{"interface":"front","average":{"1min":1.113,"5min":1.113,"15min":1.113},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":2.6360000000000001,"5min":2.6360000000000001,"15min":2.6360000000000001},"last":0.94399999999999995}]},{"osd":2,"last update":"Sun Dec 17 11:49:08 2023","interfaces":[{"interface":"back","average":{"1min":1.202,"5min":1.202,"15min":1.202},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":2.8159999999999998,"5min":2.8159999999999998,"15min":2.8159999999999998},"last":0.67300000000000004},{"interface":"front","average":{"1min":1.462,"5min":1.462,"15min":1.462},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":3.101,"5min":3.101,"15min":3.101},"last":1.6180000000000001}]},{"osd":3,"last update":"Sun Dec 17 11:49:08 2023","interfaces":[{"interface":"back","average":{"1min":1.48,"5min":1.48,"15min":1.48},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":2.7890000000000001,"5min":2.7890000000000001,"15min":2.7890000000000001},"last":1.736},{"interface":"front","average":{"1min":1.278,"5min":1.278,"15min":1.278},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":3.1400000000000001,"5min":3.1400000000000001,"15min":3.1400000000000001},"last":1.28}]},{"osd":4,"last update":"Sun Dec 17 11:49:08 2023","interfaces":[{"interface":"back","average":{"1min":1.4350000000000001,"5min":1.4350000000000001,"15min":1.4350000000000001},"min":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":2.5289999999999999,"5min":2.5289999999999999,"15min":2.5289999999999999},"last":1.5409999999999999},{"interface":"front","average":{"1min":1.363,"5min":1.363,"15min":1.363},"min":{"1min":0.627,"5min":0.627,"15min":0.627},"max":{"1min":2.0819999999999999,"5min":2.0819999999999999,"15min":2.0819999999999999},"last":1.383}]},{"osd":5,"last update":"Sun Dec 17 11:49:08 2023","interfaces":[{"interface":"back","average":{"1min":1.466,"5min":1.466,"15min":1.466},"min":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"max":{"1min":1.96,"5min":1.96,"15min":1.96},"last":1.522},{"interface":"front","average":{"1min":1.573,"5min":1.573,"15min":1.573},"min":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":2.6739999999999999,"5min":2.6739999999999999,"15min":2.6739999999999999},"last":1.8500000000000001}]},{"osd":6,"last update":"Sun Dec 17 11:49:08 2023","interfaces":[{"interface":"back","average":{"1min":1.627,"5min":1.627,"15min":1.627},"min":{"1min":0.754,"5min":0.754,"15min":0.754},"max":{"1min":3.016,"5min":3.016,"15min":3.016},"last":2.0179999999999998},{"interface":"front","average":{"1min":1.5509999999999999,"5min":1.5509999999999999,"15min":1.5509999999999999},"min":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"max":{"1min":2.508,"5min":2.508,"15min":2.508},"last":1.458}]},{"osd":7,"last update":"Sun Dec 17 11:49:08 2023","interfaces":[{"interface":"back","average":{"1min":1.6839999999999999,"5min":1.6839999999999999,"15min":1.6839999999999999},"min":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"max":{"1min":2.944,"5min":2.944,"15min":2.944},"last":1.964},{"interface":"front","average":{"1min":1.7170000000000001,"5min":1.7170000000000001,"15min":1.7170000000000001},"min":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"max":{"1min":2.7709999999999999,"5min":2.7709999999999999,"15min":2.7709999999999999},"last":1.7949999999999999}]}]},{"osd":0,"up_from":14,"seq":60129542170,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32224,"kb_used_data":1044,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339616,"statfs":{"total":96636764160,"available":96603766784,"internally_reserved":0,"allocated":1069056,"data_stored":794265,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Dec 17 11:49:06 2023","interfaces":[{"interface":"back","average":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.3899999999999999,"5min":1.3899999999999999,"15min":1.3899999999999999},"last":0.79900000000000004},{"interface":"front","average":{"1min":1.1519999999999999,"5min":1.1519999999999999,"15min":1.1519999999999999},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":1.958,"5min":1.958,"15min":1.958},"last":1.1359999999999999}]},{"osd":2,"last update":"Sun Dec 17 11:49:06 2023","interfaces":[{"interface":"back","average":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.7709999999999999,"5min":1.7709999999999999,"15min":1.7709999999999999},"last":1.081},{"interface":"front","average":{"1min":1.2090000000000001,"5min":1.2090000000000001,"15min":1.2090000000000001},"min":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":2.2130000000000001,"5min":2.2130000000000001,"15min":2.2130000000000001},"last":1.0309999999999999}]},{"osd":3,"last update":"Sun Dec 17 11:49:06 2023","interfaces":[{"interface":"back","average":{"1min":1.125,"5min":1.125,"15min":1.125},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.728,"5min":1.728,"15min":1.728},"last":1.383},{"interface":"front","average":{"1min":1.4039999999999999,"5min":1.4039999999999999,"15min":1.4039999999999999},"min":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"max":{"1min":2.4809999999999999,"5min":2.4809999999999999,"15min":2.4809999999999999},"last":1.3400000000000001}]},{"osd":4,"last update":"Sun Dec 17 11:49:06 2023","interfaces":[{"interface":"back","average":{"1min":1.518,"5min":1.518,"15min":1.518},"min":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"max":{"1min":4.6710000000000003,"5min":4.6710000000000003,"15min":4.6710000000000003},"last":1.47},{"interface":"front","average":{"1min":1.427,"5min":1.427,"15min":1.427},"min":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"max":{"1min":2.2799999999999998,"5min":2.2799999999999998,"15min":2.2799999999999998},"last":1.1990000000000001}]},{"osd":5,"last update":"Sun Dec 17 11:49:06 2023","interfaces":[{"interface":"back","average":{"1min":1.5069999999999999,"5min":1.5069999999999999,"15min":1.5069999999999999},"min":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"max":{"1min":2.1349999999999998,"5min":2.1349999999999998,"15min":2.1349999999999998},"last":1.661},{"interface":"front","average":{"1min":1.6240000000000001,"5min":1.6240000000000001,"15min":1.6240000000000001},"min":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"max":{"1min":2.6080000000000001,"5min":2.6080000000000001,"15min":2.6080000000000001},"last":1.522}]},{"osd":6,"last update":"Sun Dec 17 11:49:06 2023","interfaces":[{"interface":"back","average":{"1min":1.5800000000000001,"5min":1.5800000000000001,"15min":1.5800000000000001},"min":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"max":{"1min":2.702,"5min":2.702,"15min":2.702},"last":1.4199999999999999},{"interface":"front","average":{"1min":1.534,"5min":1.534,"15min":1.534},"min":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"max":{"1min":2.3100000000000001,"5min":2.3100000000000001,"15min":2.3100000000000001},"last":1.702}]},{"osd":7,"last update":"Sun Dec 17 11:49:06 2023","interfaces":[{"interface":"back","average":{"1min":1.611,"5min":1.611,"15min":1.611},"min":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"max":{"1min":2.3420000000000001,"5min":2.3420000000000001,"15min":2.3420000000000001},"last":1.7969999999999999},{"interface":"front","average":{"1min":1.577,"5min":1.577,"15min":1.577},"min":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"max":{"1min":2.4359999999999999,"5min":2.4359999999999999,"15min":2.4359999999999999},"last":1.5600000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-17T11:50:03.883 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1a is not active+clean 2023-12-17T11:50:03.883 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1a', 'version': "0'0", 'reported_seq': 14, 'reported_epoch': 42, 'state': 'activating', 'last_fresh': '2023-12-17T11:50:01.545212+0000', 'last_change': '2023-12-17T11:50:01.545825+0000', 'last_active': '2023-12-17T11:50:00.523935+0000', 'last_peered': '2023-12-17T11:49:56.657918+0000', 'last_clean': '2023-12-17T11:49:56.657918+0000', 'last_became_active': '2023-12-17T11:49:53.254841+0000', 'last_became_peered': '2023-12-17T11:49:53.254841+0000', 'last_unstale': '2023-12-17T11:50:01.545212+0000', 'last_undegraded': '2023-12-17T11:50:01.545212+0000', 'last_fullsized': '2023-12-17T11:50:01.545212+0000', 'mapping_epoch': 41, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 38, 'last_epoch_clean': 39, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-17T11:49:52.179538+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-17T11:49:52.179538+0000', 'last_clean_scrub_stamp': '2023-12-17T11:49:52.179538+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-18T19:23:44.505187+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': ['4', '0', '5'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-12-17T11:50:03.884 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-12-17T11:50:04.153 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:04.150+0000 7efddcaff640 1 Processor -- start 2023-12-17T11:50:04.153 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:04.151+0000 7efddcaff640 1 -- start start 2023-12-17T11:50:04.155 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:04.152+0000 7efddcaff640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7efdd8143da0 0x7efdd80cab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:50:04.155 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:04.152+0000 7efddcaff640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7efdd806cd70 0x7efdd80c90c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:50:04.155 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:04.153+0000 7efddcaff640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efdd80c9600 con 0x7efdd81439c0 2023-12-17T11:50:04.155 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:04.153+0000 7efddcaff640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efdd806c8e0 con 0x7efdd806cd70 2023-12-17T11:50:04.155 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:04.153+0000 7efddcaff640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efdd80cb140 con 0x7efdd8143da0 2023-12-17T11:50:04.156 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:04.153+0000 7efdd6ffd640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7efdd8143da0 0x7efdd80cab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:50:04.156 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:04.153+0000 7efdd7fff640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7efdd806cd70 0x7efdd80c90c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:50:04.156 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:04.153+0000 7efdd77fe640 1 --1- >> v1:172.21.15.159:6789/0 conn(0x7efdd81439c0 0x7efdd80cb450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.159:6789/0 says I am v1:172.21.15.40:47094/0 (socket says 172.21.15.40:47094) 2023-12-17T11:50:04.156 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:04.153+0000 7efdd77fe640 1 -- 172.21.15.40:0/503836111 learned_addr learned my addr 172.21.15.40:0/503836111 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-12-17T11:50:04.156 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:04.154+0000 7efdd6ffd640 1 -- 172.21.15.40:0/503836111 >> v2:172.21.15.159:3300/0 conn(0x7efdd806cd70 msgr2=0x7efdd80c90c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:50:04.156 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:04.154+0000 7efdd6ffd640 1 --2- 172.21.15.40:0/503836111 >> v2:172.21.15.159:3300/0 conn(0x7efdd806cd70 0x7efdd80c90c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:50:04.156 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:04.154+0000 7efdd6ffd640 1 -- 172.21.15.40:0/503836111 >> v1:172.21.15.159:6789/0 conn(0x7efdd81439c0 legacy=0x7efdd80cb450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:50:04.156 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:04.154+0000 7efdd6ffd640 1 -- 172.21.15.40:0/503836111 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdd806bfb0 con 0x7efdd8143da0 2023-12-17T11:50:04.157 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:04.154+0000 7efdd7fff640 1 --2- 172.21.15.40:0/503836111 >> v2:172.21.15.159:3300/0 conn(0x7efdd806cd70 0x7efdd80c90c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-17T11:50:04.157 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:04.156+0000 7efdd6ffd640 1 --2- 172.21.15.40:0/503836111 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7efdd8143da0 0x7efdd80cab40 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7efdc00097a0 tx=0x7efdc002b8b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9c51b5947f8be650 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:50:04.158 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:04.156+0000 7efdd67fc640 1 -- 172.21.15.40:0/503836111 <== mon.2 v2:172.21.15.159:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdc002d040 con 0x7efdd8143da0 2023-12-17T11:50:04.158 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:04.156+0000 7efdd67fc640 1 -- 172.21.15.40:0/503836111 <== mon.2 v2:172.21.15.159:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efdc0031810 con 0x7efdd8143da0 2023-12-17T11:50:04.158 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:04.156+0000 7efdd67fc640 1 -- 172.21.15.40:0/503836111 <== mon.2 v2:172.21.15.159:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdc0031ba0 con 0x7efdd8143da0 2023-12-17T11:50:04.159 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:04.157+0000 7efddcaff640 1 -- 172.21.15.40:0/503836111 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7efdd8143da0 msgr2=0x7efdd80cab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:50:04.159 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:04.157+0000 7efddcaff640 1 --2- 172.21.15.40:0/503836111 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7efdd8143da0 0x7efdd80cab40 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7efdc00097a0 tx=0x7efdc002b8b0 comp rx=0 tx=0).stop 2023-12-17T11:50:04.159 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:04.157+0000 7efddcaff640 1 -- 172.21.15.40:0/503836111 shutdown_connections 2023-12-17T11:50:04.159 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:04.157+0000 7efddcaff640 1 --2- 172.21.15.40:0/503836111 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7efdd8143da0 0x7efdd80cab40 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:50:04.159 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:04.157+0000 7efddcaff640 1 --2- 172.21.15.40:0/503836111 >> v2:172.21.15.159:3300/0 conn(0x7efdd806cd70 0x7efdd80c90c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:50:04.159 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:04.157+0000 7efddcaff640 1 -- 172.21.15.40:0/503836111 >> 172.21.15.40:0/503836111 conn(0x7efdd80b06c0 msgr2=0x7efdd80b0aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:50:04.159 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:04.157+0000 7efddcaff640 1 -- 172.21.15.40:0/503836111 shutdown_connections 2023-12-17T11:50:04.159 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:04.157+0000 7efddcaff640 1 -- 172.21.15.40:0/503836111 wait complete. 2023-12-17T11:50:04.161 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:04.159+0000 7efddcaff640 1 Processor -- start 2023-12-17T11:50:04.161 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:04.159+0000 7efddcaff640 1 -- start start 2023-12-17T11:50:04.162 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:04.160+0000 7efddcaff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7efdd806cd70 0x7efdd8134810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:50:04.163 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:04.160+0000 7efddcaff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efdd81439c0 0x7efdd8132510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:50:04.163 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:04.160+0000 7efddcaff640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7efdd8132a50 0x7efdd8135a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:50:04.163 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:04.160+0000 7efddcaff640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdd8133c10 con 0x7efdd81439c0 2023-12-17T11:50:04.163 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:04.160+0000 7efddcaff640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdd8132f90 con 0x7efdd806cd70 2023-12-17T11:50:04.163 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:04.160+0000 7efddcaff640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efdd8133270 con 0x7efdd8132a50 2023-12-17T11:50:04.163 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:04.160+0000 7efdd6ffd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efdd81439c0 0x7efdd8132510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:50:04.163 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:04.160+0000 7efdd6ffd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efdd81439c0 0x7efdd8132510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:33936/0 (socket says 172.21.15.40:33936) 2023-12-17T11:50:04.163 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:04.161+0000 7efdd6ffd640 1 -- 172.21.15.40:0/2641495531 learned_addr learned my addr 172.21.15.40:0/2641495531 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-17T11:50:04.163 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:04.161+0000 7efdd77fe640 1 --2- 172.21.15.40:0/2641495531 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7efdd806cd70 0x7efdd8134810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:50:04.163 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:04.161+0000 7efdd7fff640 1 --2- 172.21.15.40:0/2641495531 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7efdd8132a50 0x7efdd8135a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:50:04.165 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:04.161+0000 7efdd6ffd640 1 -- 172.21.15.40:0/2641495531 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7efdd8132a50 msgr2=0x7efdd8135a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:50:04.165 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:04.161+0000 7efdd6ffd640 1 --2- 172.21.15.40:0/2641495531 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7efdd8132a50 0x7efdd8135a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:50:04.165 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:04.161+0000 7efdd6ffd640 1 -- 172.21.15.40:0/2641495531 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7efdd806cd70 msgr2=0x7efdd8134810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:50:04.165 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:04.161+0000 7efdd6ffd640 1 --2- 172.21.15.40:0/2641495531 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7efdd806cd70 0x7efdd8134810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:50:04.165 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:04.161+0000 7efdd6ffd640 1 -- 172.21.15.40:0/2641495531 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdd0009400 con 0x7efdd81439c0 2023-12-17T11:50:04.165 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:04.161+0000 7efdd6ffd640 1 --2- 172.21.15.40:0/2641495531 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efdd81439c0 0x7efdd8132510 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7efdc0000c00 tx=0x7efdc00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:50:04.165 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:04.162+0000 7efdcffff640 1 -- 172.21.15.40:0/2641495531 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdc003ace0 con 0x7efdd81439c0 2023-12-17T11:50:04.165 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:04.162+0000 7efdcffff640 1 -- 172.21.15.40:0/2641495531 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efdc003ae40 con 0x7efdd81439c0 2023-12-17T11:50:04.165 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:04.162+0000 7efdcffff640 1 -- 172.21.15.40:0/2641495531 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdc0044630 con 0x7efdd81439c0 2023-12-17T11:50:04.165 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:04.162+0000 7efddcaff640 1 -- 172.21.15.40:0/2641495531 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efdc0009400 con 0x7efdd81439c0 2023-12-17T11:50:04.165 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:04.162+0000 7efddcaff640 1 -- 172.21.15.40:0/2641495531 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efdd8133830 con 0x7efdd81439c0 2023-12-17T11:50:04.166 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:04.163+0000 7efddcaff640 1 -- 172.21.15.40:0/2641495531 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efdd8074450 con 0x7efdd81439c0 2023-12-17T11:50:04.166 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:04.164+0000 7efdcffff640 1 -- 172.21.15.40:0/2641495531 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7efdc004d450 con 0x7efdd81439c0 2023-12-17T11:50:04.167 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:04.165+0000 7efdcffff640 1 --2- 172.21.15.40:0/2641495531 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7efdb806ae40 0x7efdb806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:50:04.167 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:04.165+0000 7efdcffff640 1 -- 172.21.15.40:0/2641495531 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6058+0+0 (secure 0 0 0) 0x7efdc00ab8e0 con 0x7efdd81439c0 2023-12-17T11:50:04.168 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:04.166+0000 7efdd77fe640 1 --2- 172.21.15.40:0/2641495531 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7efdb806ae40 0x7efdb806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:50:04.169 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:04.167+0000 7efdd77fe640 1 --2- 172.21.15.40:0/2641495531 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7efdb806ae40 0x7efdb806d300 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7efdc8005c00 tx=0x7efdc8009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:50:04.172 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:04.170+0000 7efdcffff640 1 -- 172.21.15.40:0/2641495531 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7efdc0076820 con 0x7efdd81439c0 2023-12-17T11:50:04.441 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:04.439+0000 7efddcaff640 1 -- 172.21.15.40:0/2641495531 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7efdd806da00 con 0x7efdd81439c0 2023-12-17T11:50:04.442 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:04.439+0000 7efdcffff640 1 -- 172.21.15.40:0/2641495531 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1092 (secure 0 0 0) 0x7efdc0035460 con 0x7efdd81439c0 2023-12-17T11:50:04.442 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T11:50:04.442 INFO:teuthology.orchestra.run.smithi040.stdout:{"fsid":"099cd35d-80d9-4ca4-8424-de13b3b03ac7","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":130,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":42,"num_osds":8,"num_up_osds":8,"osd_up_since":1702813685,"num_in_osds":8,"osd_in_since":1702813676,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":96},{"state_name":"activating","count":1}],"num_pgs":97,"num_pools":3,"num_objects":24,"data_bytes":592778,"bytes_used":230612992,"bytes_avail":772863500288,"bytes_total":773094113280,"inactive_pgs_ratio":0.010309278033673763,"write_bytes_sec":1791,"read_op_per_sec":0,"write_op_per_sec":5},"fsmap":{"epoch":15,"id":2,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":2,"rank":0,"name":"d","status":"up:active","gid":5304}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":6,"modified":"2023-12-17T11:49:24.620162+0000","services":{}},"progress_events":{}} 2023-12-17T11:50:04.444 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:04.442+0000 7efddcaff640 1 -- 172.21.15.40:0/2641495531 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7efdb806ae40 msgr2=0x7efdb806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:50:04.444 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:04.442+0000 7efddcaff640 1 --2- 172.21.15.40:0/2641495531 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7efdb806ae40 0x7efdb806d300 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7efdc8005c00 tx=0x7efdc8009040 comp rx=0 tx=0).stop 2023-12-17T11:50:04.444 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:04.442+0000 7efddcaff640 1 -- 172.21.15.40:0/2641495531 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efdd81439c0 msgr2=0x7efdd8132510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:50:04.444 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:04.442+0000 7efddcaff640 1 --2- 172.21.15.40:0/2641495531 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efdd81439c0 0x7efdd8132510 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7efdc0000c00 tx=0x7efdc00046c0 comp rx=0 tx=0).stop 2023-12-17T11:50:04.445 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:04.442+0000 7efddcaff640 1 -- 172.21.15.40:0/2641495531 shutdown_connections 2023-12-17T11:50:04.445 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:04.442+0000 7efddcaff640 1 --2- 172.21.15.40:0/2641495531 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7efdb806ae40 0x7efdb806d300 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:50:04.445 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:04.442+0000 7efddcaff640 1 --2- 172.21.15.40:0/2641495531 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7efdd8132a50 0x7efdd8135a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:50:04.445 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:04.442+0000 7efddcaff640 1 --2- 172.21.15.40:0/2641495531 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efdd81439c0 0x7efdd8132510 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:50:04.445 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:04.442+0000 7efddcaff640 1 --2- 172.21.15.40:0/2641495531 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7efdd806cd70 0x7efdd8134810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:50:04.445 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:04.442+0000 7efddcaff640 1 -- 172.21.15.40:0/2641495531 >> 172.21.15.40:0/2641495531 conn(0x7efdd80b06c0 msgr2=0x7efdd80aff00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:50:04.445 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:04.442+0000 7efddcaff640 1 -- 172.21.15.40:0/2641495531 shutdown_connections 2023-12-17T11:50:04.445 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:04.442+0000 7efddcaff640 1 -- 172.21.15.40:0/2641495531 wait complete. 2023-12-17T11:50:04.463 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-12-17T11:50:04.463 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-17T11:50:04.693 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:04.691+0000 7f0b5c7a9640 1 Processor -- start 2023-12-17T11:50:04.693 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:04.691+0000 7f0b5c7a9640 1 -- start start 2023-12-17T11:50:04.695 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:04.693+0000 7f0b5c7a9640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f0b54143e00 0x7f0b540b4040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:50:04.695 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:04.693+0000 7f0b5c7a9640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f0b54072180 0x7f0b540b4580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:50:04.695 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:04.693+0000 7f0b5c7a9640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b540b3bb0 con 0x7f0b5406c410 2023-12-17T11:50:04.695 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:04.693+0000 7f0b5c7a9640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b541441e0 con 0x7f0b54143e00 2023-12-17T11:50:04.695 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:04.693+0000 7f0b5c7a9640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b54072680 con 0x7f0b54072180 2023-12-17T11:50:04.696 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:04.693+0000 7f0b5a545640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f0b54143e00 0x7f0b540b4040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:50:04.696 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:04.693+0000 7f0b5a545640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f0b54143e00 0x7f0b540b4040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:33942/0 (socket says 172.21.15.40:33942) 2023-12-17T11:50:04.696 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:04.693+0000 7f0b5ad46640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f0b5406c410 0x7f0b54070690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:45922/0 (socket says 172.21.15.40:45922) 2023-12-17T11:50:04.696 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:04.693+0000 7f0b5a545640 1 -- 172.21.15.40:0/1820020147 learned_addr learned my addr 172.21.15.40:0/1820020147 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-17T11:50:04.696 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:04.694+0000 7f0b5a545640 1 -- 172.21.15.40:0/1820020147 >> v2:172.21.15.159:3300/0 conn(0x7f0b54072180 msgr2=0x7f0b540b4580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:50:04.696 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:04.694+0000 7f0b59d44640 1 --2- 172.21.15.40:0/1820020147 >> v2:172.21.15.159:3300/0 conn(0x7f0b54072180 0x7f0b540b4580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:50:04.697 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:04.694+0000 7f0b5a545640 1 --2- 172.21.15.40:0/1820020147 >> v2:172.21.15.159:3300/0 conn(0x7f0b54072180 0x7f0b540b4580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:50:04.697 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:04.694+0000 7f0b5a545640 1 -- 172.21.15.40:0/1820020147 >> v1:172.21.15.40:6789/0 conn(0x7f0b5406c410 legacy=0x7f0b54070690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:50:04.697 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:04.694+0000 7f0b5a545640 1 -- 172.21.15.40:0/1820020147 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b540b1e30 con 0x7f0b54143e00 2023-12-17T11:50:04.697 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:04.694+0000 7f0b59543640 1 -- 172.21.15.40:0/1820020147 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2214310469 0 0) 0x7f0b540b3bb0 con 0x7f0b5406c410 2023-12-17T11:50:04.697 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:04.694+0000 7f0b59d44640 1 --2- 172.21.15.40:0/1820020147 >> v2:172.21.15.159:3300/0 conn(0x7f0b54072180 0x7f0b540b4580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-17T11:50:04.698 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:04.695+0000 7f0b5a545640 1 --2- 172.21.15.40:0/1820020147 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0b54143e00 0x7f0b540b4040 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f0b54067da0 tx=0x7f0b5002b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e43648d9bf1d6df server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:50:04.698 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:04.695+0000 7f0b59543640 1 -- 172.21.15.40:0/1820020147 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b50030860 con 0x7f0b54143e00 2023-12-17T11:50:04.698 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:04.695+0000 7f0b59543640 1 -- 172.21.15.40:0/1820020147 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b500309c0 con 0x7f0b54143e00 2023-12-17T11:50:04.699 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:04.695+0000 7f0b59543640 1 -- 172.21.15.40:0/1820020147 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b50030d50 con 0x7f0b54143e00 2023-12-17T11:50:04.699 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:04.696+0000 7f0b5c7a9640 1 -- 172.21.15.40:0/1820020147 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0b54143e00 msgr2=0x7f0b540b4040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:50:04.699 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:04.696+0000 7f0b5c7a9640 1 --2- 172.21.15.40:0/1820020147 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0b54143e00 0x7f0b540b4040 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f0b54067da0 tx=0x7f0b5002b9a0 comp rx=0 tx=0).stop 2023-12-17T11:50:04.699 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:04.696+0000 7f0b5c7a9640 1 -- 172.21.15.40:0/1820020147 shutdown_connections 2023-12-17T11:50:04.699 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:04.696+0000 7f0b5c7a9640 1 --2- 172.21.15.40:0/1820020147 >> v2:172.21.15.159:3300/0 conn(0x7f0b54072180 0x7f0b540b4580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:50:04.699 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:04.696+0000 7f0b5c7a9640 1 --2- 172.21.15.40:0/1820020147 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0b54143e00 0x7f0b540b4040 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:50:04.699 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:04.696+0000 7f0b5c7a9640 1 -- 172.21.15.40:0/1820020147 >> 172.21.15.40:0/1820020147 conn(0x7f0b540b0a90 msgr2=0x7f0b540b0e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:50:04.699 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:04.696+0000 7f0b5c7a9640 1 -- 172.21.15.40:0/1820020147 shutdown_connections 2023-12-17T11:50:04.699 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:04.696+0000 7f0b5c7a9640 1 -- 172.21.15.40:0/1820020147 wait complete. 2023-12-17T11:50:04.700 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:04.699+0000 7f0b5c7a9640 1 Processor -- start 2023-12-17T11:50:04.701 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:04.699+0000 7f0b5c7a9640 1 -- start start 2023-12-17T11:50:04.702 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:04.700+0000 7f0b5c7a9640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0b5406c410 0x7f0b54134d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:50:04.702 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:04.700+0000 7f0b5c7a9640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0b54072180 0x7f0b54141cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:50:04.702 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:04.700+0000 7f0b5c7a9640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0b54143e00 0x7f0b54142210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:50:04.702 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:04.700+0000 7f0b5c7a9640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b541f2d90 con 0x7f0b5406c410 2023-12-17T11:50:04.702 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:04.700+0000 7f0b5c7a9640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b541352c0 con 0x7f0b54072180 2023-12-17T11:50:04.703 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:04.700+0000 7f0b5c7a9640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b541f2460 con 0x7f0b54143e00 2023-12-17T11:50:04.703 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:04.700+0000 7f0b5a545640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0b5406c410 0x7f0b54134d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:50:04.703 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:04.700+0000 7f0b5a545640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0b5406c410 0x7f0b54134d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:33956/0 (socket says 172.21.15.40:33956) 2023-12-17T11:50:04.703 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:04.700+0000 7f0b5a545640 1 -- 172.21.15.40:0/137817123 learned_addr learned my addr 172.21.15.40:0/137817123 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-17T11:50:04.704 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:04.701+0000 7f0b59d44640 1 --2- 172.21.15.40:0/137817123 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0b54072180 0x7f0b54141cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:50:04.704 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:04.701+0000 7f0b5a545640 1 -- 172.21.15.40:0/137817123 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0b54143e00 msgr2=0x7f0b54142210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:50:04.704 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:04.701+0000 7f0b5a545640 1 --2- 172.21.15.40:0/137817123 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0b54143e00 0x7f0b54142210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:50:04.704 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:04.701+0000 7f0b5a545640 1 -- 172.21.15.40:0/137817123 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0b54072180 msgr2=0x7f0b54141cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:50:04.704 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:04.701+0000 7f0b5a545640 1 --2- 172.21.15.40:0/137817123 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0b54072180 0x7f0b54141cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:50:04.704 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:04.701+0000 7f0b5a545640 1 -- 172.21.15.40:0/137817123 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b500094d0 con 0x7f0b5406c410 2023-12-17T11:50:04.704 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:04.701+0000 7f0b59d44640 1 --2- 172.21.15.40:0/137817123 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0b54072180 0x7f0b54141cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-17T11:50:04.704 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:04.701+0000 7f0b5a545640 1 --2- 172.21.15.40:0/137817123 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0b5406c410 0x7f0b54134d80 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f0b50009960 tx=0x7f0b500046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:50:04.704 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:04.702+0000 7f0b4affd640 1 -- 172.21.15.40:0/137817123 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b5003e070 con 0x7f0b5406c410 2023-12-17T11:50:04.705 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:04.702+0000 7f0b4affd640 1 -- 172.21.15.40:0/137817123 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b50004030 con 0x7f0b5406c410 2023-12-17T11:50:04.705 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:04.702+0000 7f0b4affd640 1 -- 172.21.15.40:0/137817123 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b500043e0 con 0x7f0b5406c410 2023-12-17T11:50:04.705 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:04.702+0000 7f0b5c7a9640 1 -- 172.21.15.40:0/137817123 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b541f2740 con 0x7f0b5406c410 2023-12-17T11:50:04.705 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:04.702+0000 7f0b5c7a9640 1 -- 172.21.15.40:0/137817123 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b5413b2a0 con 0x7f0b5406c410 2023-12-17T11:50:04.705 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:04.703+0000 7f0b5c7a9640 1 -- 172.21.15.40:0/137817123 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b540cb5e0 con 0x7f0b5406c410 2023-12-17T11:50:04.706 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:04.704+0000 7f0b4affd640 1 -- 172.21.15.40:0/137817123 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f0b50042070 con 0x7f0b5406c410 2023-12-17T11:50:04.707 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:04.705+0000 7f0b4affd640 1 --2- 172.21.15.40:0/137817123 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f0b3806ae40 0x7f0b3806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:50:04.707 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:04.705+0000 7f0b4affd640 1 -- 172.21.15.40:0/137817123 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f0b500abb60 con 0x7f0b5406c410 2023-12-17T11:50:04.707 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:04.706+0000 7f0b59d44640 1 --2- 172.21.15.40:0/137817123 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f0b3806ae40 0x7f0b3806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:50:04.708 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:04.707+0000 7f0b59d44640 1 --2- 172.21.15.40:0/137817123 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f0b3806ae40 0x7f0b3806d300 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f0b44006fd0 tx=0x7f0b44008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:50:04.711 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:04.709+0000 7f0b4affd640 1 -- 172.21.15.40:0/137817123 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f0b50076b30 con 0x7f0b5406c410 2023-12-17T11:50:04.903 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:04.901+0000 7f0b5c7a9640 1 -- 172.21.15.40:0/137817123 --> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f0b541f25d0 con 0x7f0b3806ae40 2023-12-17T11:50:04.925 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:04.923+0000 7f0b4affd640 1 -- 172.21.15.40:0/137817123 <== mgr.4105 v2:172.21.15.159:6832/479465803 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286572 (secure 0 0 0) 0x7f0b541f25d0 con 0x7f0b3806ae40 2023-12-17T11:50:04.928 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T11:50:04.930 INFO:teuthology.orchestra.run.smithi040.stderr:dumped all 2023-12-17T11:50:04.932 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:04.929+0000 7f0b5c7a9640 1 -- 172.21.15.40:0/137817123 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f0b3806ae40 msgr2=0x7f0b3806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:50:04.933 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:04.929+0000 7f0b5c7a9640 1 --2- 172.21.15.40:0/137817123 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f0b3806ae40 0x7f0b3806d300 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f0b44006fd0 tx=0x7f0b44008040 comp rx=0 tx=0).stop 2023-12-17T11:50:04.933 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:04.929+0000 7f0b5c7a9640 1 -- 172.21.15.40:0/137817123 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0b5406c410 msgr2=0x7f0b54134d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:50:04.933 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:04.929+0000 7f0b5c7a9640 1 --2- 172.21.15.40:0/137817123 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0b5406c410 0x7f0b54134d80 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f0b50009960 tx=0x7f0b500046c0 comp rx=0 tx=0).stop 2023-12-17T11:50:04.933 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:04.930+0000 7f0b5c7a9640 1 -- 172.21.15.40:0/137817123 shutdown_connections 2023-12-17T11:50:04.933 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:04.930+0000 7f0b5c7a9640 1 --2- 172.21.15.40:0/137817123 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f0b3806ae40 0x7f0b3806d300 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:50:04.933 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:04.930+0000 7f0b5c7a9640 1 --2- 172.21.15.40:0/137817123 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f0b54143e00 0x7f0b54142210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:50:04.933 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:04.930+0000 7f0b5c7a9640 1 --2- 172.21.15.40:0/137817123 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0b54072180 0x7f0b54141cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:50:04.933 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:04.930+0000 7f0b5c7a9640 1 --2- 172.21.15.40:0/137817123 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0b5406c410 0x7f0b54134d80 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:50:04.933 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:04.930+0000 7f0b5c7a9640 1 -- 172.21.15.40:0/137817123 >> 172.21.15.40:0/137817123 conn(0x7f0b540b0a90 msgr2=0x7f0b540cebf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:50:04.933 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:04.930+0000 7f0b5c7a9640 1 -- 172.21.15.40:0/137817123 shutdown_connections 2023-12-17T11:50:04.933 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:04.930+0000 7f0b5c7a9640 1 -- 172.21.15.40:0/137817123 wait complete. 2023-12-17T11:50:04.953 INFO:teuthology.orchestra.run.smithi040.stdout:{"pg_ready":true,"pg_map":{"version":94,"stamp":"2023-12-17T11:50:04.634181+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":225208,"kb_used_data":4880,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754749512,"statfs":{"total":773094113280,"available":772863500288,"internally_reserved":0,"allocated":4997120,"data_stored":2803865,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":225496626},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.003113"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-17T11:50:00.525487+0000","last_change":"2023-12-17T11:49:53.251801+0000","last_active":"2023-12-17T11:50:00.525487+0000","last_peered":"2023-12-17T11:50:00.525487+0000","last_clean":"2023-12-17T11:50:00.525487+0000","last_became_active":"2023-12-17T11:49:53.251221+0000","last_became_peered":"2023-12-17T11:49:53.251221+0000","last_unstale":"2023-12-17T11:50:00.525487+0000","last_undegraded":"2023-12-17T11:50:00.525487+0000","last_fullsized":"2023-12-17T11:50:00.525487+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T22:42:15.785143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-17T11:50:00.524627+0000","last_change":"2023-12-17T11:49:53.243478+0000","last_active":"2023-12-17T11:50:00.524627+0000","last_peered":"2023-12-17T11:50:00.524627+0000","last_clean":"2023-12-17T11:50:00.524627+0000","last_became_active":"2023-12-17T11:49:53.243179+0000","last_became_peered":"2023-12-17T11:49:53.243179+0000","last_unstale":"2023-12-17T11:50:00.524627+0000","last_undegraded":"2023-12-17T11:50:00.524627+0000","last_fullsized":"2023-12-17T11:50:00.524627+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T23:49:09.469993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:56.659373+0000","last_change":"2023-12-17T11:49:53.249501+0000","last_active":"2023-12-17T11:49:56.659373+0000","last_peered":"2023-12-17T11:49:56.659373+0000","last_clean":"2023-12-17T11:49:56.659373+0000","last_became_active":"2023-12-17T11:49:53.249212+0000","last_became_peered":"2023-12-17T11:49:53.249212+0000","last_unstale":"2023-12-17T11:49:56.659373+0000","last_undegraded":"2023-12-17T11:49:56.659373+0000","last_fullsized":"2023-12-17T11:49:56.659373+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T22:50:12.261960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:56.663625+0000","last_change":"2023-12-17T11:49:53.237486+0000","last_active":"2023-12-17T11:49:56.663625+0000","last_peered":"2023-12-17T11:49:56.663625+0000","last_clean":"2023-12-17T11:49:56.663625+0000","last_became_active":"2023-12-17T11:49:53.236766+0000","last_became_peered":"2023-12-17T11:49:53.236766+0000","last_unstale":"2023-12-17T11:49:56.663625+0000","last_undegraded":"2023-12-17T11:49:56.663625+0000","last_fullsized":"2023-12-17T11:49:56.663625+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T19:34:01.395947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:56.663570+0000","last_change":"2023-12-17T11:49:53.230175+0000","last_active":"2023-12-17T11:49:56.663570+0000","last_peered":"2023-12-17T11:49:56.663570+0000","last_clean":"2023-12-17T11:49:56.663570+0000","last_became_active":"2023-12-17T11:49:53.229756+0000","last_became_peered":"2023-12-17T11:49:53.229756+0000","last_unstale":"2023-12-17T11:49:56.663570+0000","last_undegraded":"2023-12-17T11:49:56.663570+0000","last_fullsized":"2023-12-17T11:49:56.663570+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T15:43:04.869288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:56.659967+0000","last_change":"2023-12-17T11:49:53.245040+0000","last_active":"2023-12-17T11:49:56.659967+0000","last_peered":"2023-12-17T11:49:56.659967+0000","last_clean":"2023-12-17T11:49:56.659967+0000","last_became_active":"2023-12-17T11:49:53.243989+0000","last_became_peered":"2023-12-17T11:49:53.243989+0000","last_unstale":"2023-12-17T11:49:56.659967+0000","last_undegraded":"2023-12-17T11:49:56.659967+0000","last_fullsized":"2023-12-17T11:49:56.659967+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T16:31:53.964205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:56.655609+0000","last_change":"2023-12-17T11:49:53.244506+0000","last_active":"2023-12-17T11:49:56.655609+0000","last_peered":"2023-12-17T11:49:56.655609+0000","last_clean":"2023-12-17T11:49:56.655609+0000","last_became_active":"2023-12-17T11:49:53.244244+0000","last_became_peered":"2023-12-17T11:49:53.244244+0000","last_unstale":"2023-12-17T11:49:56.655609+0000","last_undegraded":"2023-12-17T11:49:56.655609+0000","last_fullsized":"2023-12-17T11:49:56.655609+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T12:27:38.132749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-17T11:50:00.522397+0000","last_change":"2023-12-17T11:49:53.256713+0000","last_active":"2023-12-17T11:50:00.522397+0000","last_peered":"2023-12-17T11:50:00.522397+0000","last_clean":"2023-12-17T11:50:00.522397+0000","last_became_active":"2023-12-17T11:49:53.255850+0000","last_became_peered":"2023-12-17T11:49:53.255850+0000","last_unstale":"2023-12-17T11:50:00.522397+0000","last_undegraded":"2023-12-17T11:50:00.522397+0000","last_fullsized":"2023-12-17T11:50:00.522397+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T14:00:43.418107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:56.659436+0000","last_change":"2023-12-17T11:49:53.255007+0000","last_active":"2023-12-17T11:49:56.659436+0000","last_peered":"2023-12-17T11:49:56.659436+0000","last_clean":"2023-12-17T11:49:56.659436+0000","last_became_active":"2023-12-17T11:49:53.254750+0000","last_became_peered":"2023-12-17T11:49:53.254750+0000","last_unstale":"2023-12-17T11:49:56.659436+0000","last_undegraded":"2023-12-17T11:49:56.659436+0000","last_fullsized":"2023-12-17T11:49:56.659436+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T19:23:44.505187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:56.655871+0000","last_change":"2023-12-17T11:49:53.243885+0000","last_active":"2023-12-17T11:49:56.655871+0000","last_peered":"2023-12-17T11:49:56.655871+0000","last_clean":"2023-12-17T11:49:56.655871+0000","last_became_active":"2023-12-17T11:49:53.243586+0000","last_became_peered":"2023-12-17T11:49:53.243586+0000","last_unstale":"2023-12-17T11:49:56.655871+0000","last_undegraded":"2023-12-17T11:49:56.655871+0000","last_fullsized":"2023-12-17T11:49:56.655871+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T23:49:09.469993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:56.655817+0000","last_change":"2023-12-17T11:49:53.245071+0000","last_active":"2023-12-17T11:49:56.655817+0000","last_peered":"2023-12-17T11:49:56.655817+0000","last_clean":"2023-12-17T11:49:56.655817+0000","last_became_active":"2023-12-17T11:49:53.244696+0000","last_became_peered":"2023-12-17T11:49:53.244696+0000","last_unstale":"2023-12-17T11:49:56.655817+0000","last_undegraded":"2023-12-17T11:49:56.655817+0000","last_fullsized":"2023-12-17T11:49:56.655817+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T17:56:09.285369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:56.659352+0000","last_change":"2023-12-17T11:49:53.244437+0000","last_active":"2023-12-17T11:49:56.659352+0000","last_peered":"2023-12-17T11:49:56.659352+0000","last_clean":"2023-12-17T11:49:56.659352+0000","last_became_active":"2023-12-17T11:49:53.244158+0000","last_became_peered":"2023-12-17T11:49:53.244158+0000","last_unstale":"2023-12-17T11:49:56.659352+0000","last_undegraded":"2023-12-17T11:49:56.659352+0000","last_fullsized":"2023-12-17T11:49:56.659352+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T12:12:45.651530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:56.655738+0000","last_change":"2023-12-17T11:49:53.259954+0000","last_active":"2023-12-17T11:49:56.655738+0000","last_peered":"2023-12-17T11:49:56.655738+0000","last_clean":"2023-12-17T11:49:56.655738+0000","last_became_active":"2023-12-17T11:49:53.259683+0000","last_became_peered":"2023-12-17T11:49:53.259683+0000","last_unstale":"2023-12-17T11:49:56.655738+0000","last_undegraded":"2023-12-17T11:49:56.655738+0000","last_fullsized":"2023-12-17T11:49:56.655738+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T13:29:29.953615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-17T11:50:00.522506+0000","last_change":"2023-12-17T11:49:53.251388+0000","last_active":"2023-12-17T11:50:00.522506+0000","last_peered":"2023-12-17T11:50:00.522506+0000","last_clean":"2023-12-17T11:50:00.522506+0000","last_became_active":"2023-12-17T11:49:53.251182+0000","last_became_peered":"2023-12-17T11:49:53.251182+0000","last_unstale":"2023-12-17T11:50:00.522506+0000","last_undegraded":"2023-12-17T11:50:00.522506+0000","last_fullsized":"2023-12-17T11:50:00.522506+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T19:39:18.340154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:56.655643+0000","last_change":"2023-12-17T11:49:53.251484+0000","last_active":"2023-12-17T11:49:56.655643+0000","last_peered":"2023-12-17T11:49:56.655643+0000","last_clean":"2023-12-17T11:49:56.655643+0000","last_became_active":"2023-12-17T11:49:53.250825+0000","last_became_peered":"2023-12-17T11:49:53.250825+0000","last_unstale":"2023-12-17T11:49:56.655643+0000","last_undegraded":"2023-12-17T11:49:56.655643+0000","last_fullsized":"2023-12-17T11:49:56.655643+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T12:48:09.865175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:55.301502+0000","last_change":"2023-12-17T11:49:53.256736+0000","last_active":"2023-12-17T11:49:55.301502+0000","last_peered":"2023-12-17T11:49:55.301502+0000","last_clean":"2023-12-17T11:49:55.301502+0000","last_became_active":"2023-12-17T11:49:53.256319+0000","last_became_peered":"2023-12-17T11:49:53.256319+0000","last_unstale":"2023-12-17T11:49:55.301502+0000","last_undegraded":"2023-12-17T11:49:55.301502+0000","last_fullsized":"2023-12-17T11:49:55.301502+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T14:49:05.628056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:55.302967+0000","last_change":"2023-12-17T11:49:53.254466+0000","last_active":"2023-12-17T11:49:55.302967+0000","last_peered":"2023-12-17T11:49:55.302967+0000","last_clean":"2023-12-17T11:49:55.302967+0000","last_became_active":"2023-12-17T11:49:53.254191+0000","last_became_peered":"2023-12-17T11:49:53.254191+0000","last_unstale":"2023-12-17T11:49:55.302967+0000","last_undegraded":"2023-12-17T11:49:55.302967+0000","last_fullsized":"2023-12-17T11:49:55.302967+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T15:34:59.184998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-17T11:50:01.202677+0000","last_change":"2023-12-17T11:49:53.244371+0000","last_active":"2023-12-17T11:50:01.202677+0000","last_peered":"2023-12-17T11:50:01.202677+0000","last_clean":"2023-12-17T11:50:01.202677+0000","last_became_active":"2023-12-17T11:49:53.243288+0000","last_became_peered":"2023-12-17T11:49:53.243288+0000","last_unstale":"2023-12-17T11:50:01.202677+0000","last_undegraded":"2023-12-17T11:50:01.202677+0000","last_fullsized":"2023-12-17T11:50:01.202677+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T22:59:01.401999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:56.663668+0000","last_change":"2023-12-17T11:49:53.247133+0000","last_active":"2023-12-17T11:49:56.663668+0000","last_peered":"2023-12-17T11:49:56.663668+0000","last_clean":"2023-12-17T11:49:56.663668+0000","last_became_active":"2023-12-17T11:49:53.246863+0000","last_became_peered":"2023-12-17T11:49:53.246863+0000","last_unstale":"2023-12-17T11:49:56.663668+0000","last_undegraded":"2023-12-17T11:49:56.663668+0000","last_fullsized":"2023-12-17T11:49:56.663668+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T15:22:56.669665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-17T11:50:01.202405+0000","last_change":"2023-12-17T11:49:53.234246+0000","last_active":"2023-12-17T11:50:01.202405+0000","last_peered":"2023-12-17T11:50:01.202405+0000","last_clean":"2023-12-17T11:50:01.202405+0000","last_became_active":"2023-12-17T11:49:53.233971+0000","last_became_peered":"2023-12-17T11:49:53.233971+0000","last_unstale":"2023-12-17T11:50:01.202405+0000","last_undegraded":"2023-12-17T11:50:01.202405+0000","last_fullsized":"2023-12-17T11:50:01.202405+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T21:22:15.324114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:56.655760+0000","last_change":"2023-12-17T11:49:53.254631+0000","last_active":"2023-12-17T11:49:56.655760+0000","last_peered":"2023-12-17T11:49:56.655760+0000","last_clean":"2023-12-17T11:49:56.655760+0000","last_became_active":"2023-12-17T11:49:53.254246+0000","last_became_peered":"2023-12-17T11:49:53.254246+0000","last_unstale":"2023-12-17T11:49:56.655760+0000","last_undegraded":"2023-12-17T11:49:56.655760+0000","last_fullsized":"2023-12-17T11:49:56.655760+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T15:42:47.132551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-17T11:50:00.523985+0000","last_change":"2023-12-17T11:49:53.233281+0000","last_active":"2023-12-17T11:50:00.523985+0000","last_peered":"2023-12-17T11:50:00.523985+0000","last_clean":"2023-12-17T11:50:00.523985+0000","last_became_active":"2023-12-17T11:49:53.233006+0000","last_became_peered":"2023-12-17T11:49:53.233006+0000","last_unstale":"2023-12-17T11:50:00.523985+0000","last_undegraded":"2023-12-17T11:50:00.523985+0000","last_fullsized":"2023-12-17T11:50:00.523985+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T17:37:46.058341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:55.301627+0000","last_change":"2023-12-17T11:49:53.235006+0000","last_active":"2023-12-17T11:49:55.301627+0000","last_peered":"2023-12-17T11:49:55.301627+0000","last_clean":"2023-12-17T11:49:55.301627+0000","last_became_active":"2023-12-17T11:49:53.232828+0000","last_became_peered":"2023-12-17T11:49:53.232828+0000","last_unstale":"2023-12-17T11:49:55.301627+0000","last_undegraded":"2023-12-17T11:49:55.301627+0000","last_fullsized":"2023-12-17T11:49:55.301627+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T21:34:46.442330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:56.663503+0000","last_change":"2023-12-17T11:49:53.229937+0000","last_active":"2023-12-17T11:49:56.663503+0000","last_peered":"2023-12-17T11:49:56.663503+0000","last_clean":"2023-12-17T11:49:56.663503+0000","last_became_active":"2023-12-17T11:49:53.229360+0000","last_became_peered":"2023-12-17T11:49:53.229360+0000","last_unstale":"2023-12-17T11:49:56.663503+0000","last_undegraded":"2023-12-17T11:49:56.663503+0000","last_fullsized":"2023-12-17T11:49:56.663503+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T13:22:57.464897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-17T11:50:01.202634+0000","last_change":"2023-12-17T11:49:53.248140+0000","last_active":"2023-12-17T11:50:01.202634+0000","last_peered":"2023-12-17T11:50:01.202634+0000","last_clean":"2023-12-17T11:50:01.202634+0000","last_became_active":"2023-12-17T11:49:53.246139+0000","last_became_peered":"2023-12-17T11:49:53.246139+0000","last_unstale":"2023-12-17T11:50:01.202634+0000","last_undegraded":"2023-12-17T11:50:01.202634+0000","last_fullsized":"2023-12-17T11:50:01.202634+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T14:32:00.462222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:56.660141+0000","last_change":"2023-12-17T11:49:53.255892+0000","last_active":"2023-12-17T11:49:56.660141+0000","last_peered":"2023-12-17T11:49:56.660141+0000","last_clean":"2023-12-17T11:49:56.660141+0000","last_became_active":"2023-12-17T11:49:53.255307+0000","last_became_peered":"2023-12-17T11:49:53.255307+0000","last_unstale":"2023-12-17T11:49:56.660141+0000","last_undegraded":"2023-12-17T11:49:56.660141+0000","last_fullsized":"2023-12-17T11:49:56.660141+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T17:37:46.058341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-17T11:50:01.202692+0000","last_change":"2023-12-17T11:49:53.238527+0000","last_active":"2023-12-17T11:50:01.202692+0000","last_peered":"2023-12-17T11:50:01.202692+0000","last_clean":"2023-12-17T11:50:01.202692+0000","last_became_active":"2023-12-17T11:49:53.238260+0000","last_became_peered":"2023-12-17T11:49:53.238260+0000","last_unstale":"2023-12-17T11:50:01.202692+0000","last_undegraded":"2023-12-17T11:50:01.202692+0000","last_fullsized":"2023-12-17T11:50:01.202692+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T14:03:14.332356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:56.655796+0000","last_change":"2023-12-17T11:49:53.247243+0000","last_active":"2023-12-17T11:49:56.655796+0000","last_peered":"2023-12-17T11:49:56.655796+0000","last_clean":"2023-12-17T11:49:56.655796+0000","last_became_active":"2023-12-17T11:49:53.246983+0000","last_became_peered":"2023-12-17T11:49:53.246983+0000","last_unstale":"2023-12-17T11:49:56.655796+0000","last_undegraded":"2023-12-17T11:49:56.655796+0000","last_fullsized":"2023-12-17T11:49:56.655796+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T23:33:06.562683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-17T11:50:01.202387+0000","last_change":"2023-12-17T11:49:53.247287+0000","last_active":"2023-12-17T11:50:01.202387+0000","last_peered":"2023-12-17T11:50:01.202387+0000","last_clean":"2023-12-17T11:50:01.202387+0000","last_became_active":"2023-12-17T11:49:53.246995+0000","last_became_peered":"2023-12-17T11:49:53.246995+0000","last_unstale":"2023-12-17T11:50:01.202387+0000","last_undegraded":"2023-12-17T11:50:01.202387+0000","last_fullsized":"2023-12-17T11:50:01.202387+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T14:03:09.358474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-17T11:50:01.202183+0000","last_change":"2023-12-17T11:49:53.240901+0000","last_active":"2023-12-17T11:50:01.202183+0000","last_peered":"2023-12-17T11:50:01.202183+0000","last_clean":"2023-12-17T11:50:01.202183+0000","last_became_active":"2023-12-17T11:49:53.240589+0000","last_became_peered":"2023-12-17T11:49:53.240589+0000","last_unstale":"2023-12-17T11:50:01.202183+0000","last_undegraded":"2023-12-17T11:50:01.202183+0000","last_fullsized":"2023-12-17T11:50:01.202183+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T19:17:47.294209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:55.301788+0000","last_change":"2023-12-17T11:49:53.239855+0000","last_active":"2023-12-17T11:49:55.301788+0000","last_peered":"2023-12-17T11:49:55.301788+0000","last_clean":"2023-12-17T11:49:55.301788+0000","last_became_active":"2023-12-17T11:49:53.239579+0000","last_became_peered":"2023-12-17T11:49:53.239579+0000","last_unstale":"2023-12-17T11:49:55.301788+0000","last_undegraded":"2023-12-17T11:49:55.301788+0000","last_fullsized":"2023-12-17T11:49:55.301788+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T20:29:09.996550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:56.659898+0000","last_change":"2023-12-17T11:49:53.252543+0000","last_active":"2023-12-17T11:49:56.659898+0000","last_peered":"2023-12-17T11:49:56.659898+0000","last_clean":"2023-12-17T11:49:56.659898+0000","last_became_active":"2023-12-17T11:49:53.250790+0000","last_became_peered":"2023-12-17T11:49:53.250790+0000","last_unstale":"2023-12-17T11:49:56.659898+0000","last_undegraded":"2023-12-17T11:49:56.659898+0000","last_fullsized":"2023-12-17T11:49:56.659898+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T19:00:07.905809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:55.302468+0000","last_change":"2023-12-17T11:49:53.245226+0000","last_active":"2023-12-17T11:49:55.302468+0000","last_peered":"2023-12-17T11:49:55.302468+0000","last_clean":"2023-12-17T11:49:55.302468+0000","last_became_active":"2023-12-17T11:49:53.243115+0000","last_became_peered":"2023-12-17T11:49:53.243115+0000","last_unstale":"2023-12-17T11:49:55.302468+0000","last_undegraded":"2023-12-17T11:49:55.302468+0000","last_fullsized":"2023-12-17T11:49:55.302468+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T15:06:34.831619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"39'4","reported_seq":18,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-17T11:50:01.202725+0000","last_change":"2023-12-17T11:49:52.226944+0000","last_active":"2023-12-17T11:50:01.202725+0000","last_peered":"2023-12-17T11:50:01.202725+0000","last_clean":"2023-12-17T11:50:01.202725+0000","last_became_active":"2023-12-17T11:49:52.226659+0000","last_became_peered":"2023-12-17T11:49:52.226659+0000","last_unstale":"2023-12-17T11:50:01.202725+0000","last_undegraded":"2023-12-17T11:50:01.202725+0000","last_fullsized":"2023-12-17T11:50:01.202725+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_clean_scrub_stamp":"2023-12-17T11:49:51.168108+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T13:22:56.453467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:56.660037+0000","last_change":"2023-12-17T11:49:53.254791+0000","last_active":"2023-12-17T11:49:56.660037+0000","last_peered":"2023-12-17T11:49:56.660037+0000","last_clean":"2023-12-17T11:49:56.660037+0000","last_became_active":"2023-12-17T11:49:53.254496+0000","last_became_peered":"2023-12-17T11:49:53.254496+0000","last_unstale":"2023-12-17T11:49:56.660037+0000","last_undegraded":"2023-12-17T11:49:56.660037+0000","last_fullsized":"2023-12-17T11:49:56.660037+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T14:42:29.543380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"39'1","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:55.302292+0000","last_change":"2023-12-17T11:49:52.223256+0000","last_active":"2023-12-17T11:49:55.302292+0000","last_peered":"2023-12-17T11:49:55.302292+0000","last_clean":"2023-12-17T11:49:55.302292+0000","last_became_active":"2023-12-17T11:49:52.222808+0000","last_became_peered":"2023-12-17T11:49:52.222808+0000","last_unstale":"2023-12-17T11:49:55.302292+0000","last_undegraded":"2023-12-17T11:49:55.302292+0000","last_fullsized":"2023-12-17T11:49:55.302292+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_clean_scrub_stamp":"2023-12-17T11:49:51.168108+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T16:31:52.952775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-17T11:50:00.523143+0000","last_change":"2023-12-17T11:49:53.251178+0000","last_active":"2023-12-17T11:50:00.523143+0000","last_peered":"2023-12-17T11:50:00.523143+0000","last_clean":"2023-12-17T11:50:00.523143+0000","last_became_active":"2023-12-17T11:49:53.250223+0000","last_became_peered":"2023-12-17T11:49:53.250223+0000","last_unstale":"2023-12-17T11:50:00.523143+0000","last_undegraded":"2023-12-17T11:50:00.523143+0000","last_fullsized":"2023-12-17T11:50:00.523143+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T23:10:56.100255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"39'2","reported_seq":15,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:54.557626+0000","last_change":"2023-12-17T11:49:52.223879+0000","last_active":"2023-12-17T11:49:54.557626+0000","last_peered":"2023-12-17T11:49:54.557626+0000","last_clean":"2023-12-17T11:49:54.557626+0000","last_became_active":"2023-12-17T11:49:52.223602+0000","last_became_peered":"2023-12-17T11:49:52.223602+0000","last_unstale":"2023-12-17T11:49:54.557626+0000","last_undegraded":"2023-12-17T11:49:54.557626+0000","last_fullsized":"2023-12-17T11:49:54.557626+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_clean_scrub_stamp":"2023-12-17T11:49:51.168108+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T15:25:46.493177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-17T11:50:00.525262+0000","last_change":"2023-12-17T11:49:53.254646+0000","last_active":"2023-12-17T11:50:00.525262+0000","last_peered":"2023-12-17T11:50:00.525262+0000","last_clean":"2023-12-17T11:50:00.525262+0000","last_became_active":"2023-12-17T11:49:53.254368+0000","last_became_peered":"2023-12-17T11:49:53.254368+0000","last_unstale":"2023-12-17T11:50:00.525262+0000","last_undegraded":"2023-12-17T11:50:00.525262+0000","last_fullsized":"2023-12-17T11:50:00.525262+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T15:42:47.132551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"39'2","reported_seq":16,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-17T11:50:00.523260+0000","last_change":"2023-12-17T11:49:52.221006+0000","last_active":"2023-12-17T11:50:00.523260+0000","last_peered":"2023-12-17T11:50:00.523260+0000","last_clean":"2023-12-17T11:50:00.523260+0000","last_became_active":"2023-12-17T11:49:52.220514+0000","last_became_peered":"2023-12-17T11:49:52.220514+0000","last_unstale":"2023-12-17T11:50:00.523260+0000","last_undegraded":"2023-12-17T11:50:00.523260+0000","last_fullsized":"2023-12-17T11:50:00.523260+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_clean_scrub_stamp":"2023-12-17T11:49:51.168108+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T15:25:46.493177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:56.659192+0000","last_change":"2023-12-17T11:49:53.251737+0000","last_active":"2023-12-17T11:49:56.659192+0000","last_peered":"2023-12-17T11:49:56.659192+0000","last_clean":"2023-12-17T11:49:56.659192+0000","last_became_active":"2023-12-17T11:49:53.251458+0000","last_became_peered":"2023-12-17T11:49:53.251458+0000","last_unstale":"2023-12-17T11:49:56.659192+0000","last_undegraded":"2023-12-17T11:49:56.659192+0000","last_fullsized":"2023-12-17T11:49:56.659192+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T17:37:46.058341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"39'1","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:55.304169+0000","last_change":"2023-12-17T11:49:52.226918+0000","last_active":"2023-12-17T11:49:55.304169+0000","last_peered":"2023-12-17T11:49:55.304169+0000","last_clean":"2023-12-17T11:49:55.304169+0000","last_became_active":"2023-12-17T11:49:52.226455+0000","last_became_peered":"2023-12-17T11:49:52.226455+0000","last_unstale":"2023-12-17T11:49:55.304169+0000","last_undegraded":"2023-12-17T11:49:55.304169+0000","last_fullsized":"2023-12-17T11:49:55.304169+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_clean_scrub_stamp":"2023-12-17T11:49:51.168108+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T12:12:44.640100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:56.655694+0000","last_change":"2023-12-17T11:49:53.251691+0000","last_active":"2023-12-17T11:49:56.655694+0000","last_peered":"2023-12-17T11:49:56.655694+0000","last_clean":"2023-12-17T11:49:56.655694+0000","last_became_active":"2023-12-17T11:49:53.251175+0000","last_became_peered":"2023-12-17T11:49:53.251175+0000","last_unstale":"2023-12-17T11:49:56.655694+0000","last_undegraded":"2023-12-17T11:49:56.655694+0000","last_fullsized":"2023-12-17T11:49:56.655694+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T14:00:43.418107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"39'1","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:55.301855+0000","last_change":"2023-12-17T11:49:52.225053+0000","last_active":"2023-12-17T11:49:55.301855+0000","last_peered":"2023-12-17T11:49:55.301855+0000","last_clean":"2023-12-17T11:49:55.301855+0000","last_became_active":"2023-12-17T11:49:52.224761+0000","last_became_peered":"2023-12-17T11:49:52.224761+0000","last_unstale":"2023-12-17T11:49:55.301855+0000","last_undegraded":"2023-12-17T11:49:55.301855+0000","last_fullsized":"2023-12-17T11:49:55.301855+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_clean_scrub_stamp":"2023-12-17T11:49:51.168108+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T20:30:07.106128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":14,"reported_epoch":42,"state":"activating","last_fresh":"2023-12-17T11:50:01.545212+0000","last_change":"2023-12-17T11:50:01.545825+0000","last_active":"2023-12-17T11:50:00.523935+0000","last_peered":"2023-12-17T11:49:56.657918+0000","last_clean":"2023-12-17T11:49:56.657918+0000","last_became_active":"2023-12-17T11:49:53.254841+0000","last_became_peered":"2023-12-17T11:49:53.254841+0000","last_unstale":"2023-12-17T11:50:01.545212+0000","last_undegraded":"2023-12-17T11:50:01.545212+0000","last_fullsized":"2023-12-17T11:50:01.545212+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T19:23:44.505187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":["4","0","5"],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:54.556572+0000","last_change":"2023-12-17T11:49:52.230598+0000","last_active":"2023-12-17T11:49:54.556572+0000","last_peered":"2023-12-17T11:49:54.556572+0000","last_clean":"2023-12-17T11:49:54.556572+0000","last_became_active":"2023-12-17T11:49:52.230298+0000","last_became_peered":"2023-12-17T11:49:52.230298+0000","last_unstale":"2023-12-17T11:49:54.556572+0000","last_undegraded":"2023-12-17T11:49:54.556572+0000","last_fullsized":"2023-12-17T11:49:54.556572+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_clean_scrub_stamp":"2023-12-17T11:49:51.168108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T22:39:30.094160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-17T11:50:00.523881+0000","last_change":"2023-12-17T11:49:53.249431+0000","last_active":"2023-12-17T11:50:00.523881+0000","last_peered":"2023-12-17T11:50:00.523881+0000","last_clean":"2023-12-17T11:50:00.523881+0000","last_became_active":"2023-12-17T11:49:53.248943+0000","last_became_peered":"2023-12-17T11:49:53.248943+0000","last_unstale":"2023-12-17T11:50:00.523881+0000","last_undegraded":"2023-12-17T11:50:00.523881+0000","last_fullsized":"2023-12-17T11:50:00.523881+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T16:21:14.355302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-17T11:50:00.522481+0000","last_change":"2023-12-17T11:49:52.224198+0000","last_active":"2023-12-17T11:50:00.522481+0000","last_peered":"2023-12-17T11:50:00.522481+0000","last_clean":"2023-12-17T11:50:00.522481+0000","last_became_active":"2023-12-17T11:49:52.223829+0000","last_became_peered":"2023-12-17T11:49:52.223829+0000","last_unstale":"2023-12-17T11:50:00.522481+0000","last_undegraded":"2023-12-17T11:50:00.522481+0000","last_fullsized":"2023-12-17T11:50:00.522481+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_clean_scrub_stamp":"2023-12-17T11:49:51.168108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T13:20:29.045455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:56.663647+0000","last_change":"2023-12-17T11:49:53.232883+0000","last_active":"2023-12-17T11:49:56.663647+0000","last_peered":"2023-12-17T11:49:56.663647+0000","last_clean":"2023-12-17T11:49:56.663647+0000","last_became_active":"2023-12-17T11:49:53.232629+0000","last_became_peered":"2023-12-17T11:49:53.232629+0000","last_unstale":"2023-12-17T11:49:56.663647+0000","last_undegraded":"2023-12-17T11:49:56.663647+0000","last_fullsized":"2023-12-17T11:49:56.663647+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T18:07:10.105462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-17T11:50:00.525489+0000","last_change":"2023-12-17T11:49:52.215890+0000","last_active":"2023-12-17T11:50:00.525489+0000","last_peered":"2023-12-17T11:50:00.525489+0000","last_clean":"2023-12-17T11:50:00.525489+0000","last_became_active":"2023-12-17T11:49:52.215576+0000","last_became_peered":"2023-12-17T11:49:52.215576+0000","last_unstale":"2023-12-17T11:50:00.525489+0000","last_undegraded":"2023-12-17T11:50:00.525489+0000","last_fullsized":"2023-12-17T11:50:00.525489+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_clean_scrub_stamp":"2023-12-17T11:49:51.168108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T17:03:59.637357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:55.302907+0000","last_change":"2023-12-17T11:49:53.236661+0000","last_active":"2023-12-17T11:49:55.302907+0000","last_peered":"2023-12-17T11:49:55.302907+0000","last_clean":"2023-12-17T11:49:55.302907+0000","last_became_active":"2023-12-17T11:49:53.236319+0000","last_became_peered":"2023-12-17T11:49:53.236319+0000","last_unstale":"2023-12-17T11:49:55.302907+0000","last_undegraded":"2023-12-17T11:49:55.302907+0000","last_fullsized":"2023-12-17T11:49:55.302907+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T13:29:01.309715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:55.305000+0000","last_change":"2023-12-17T11:49:52.233070+0000","last_active":"2023-12-17T11:49:55.305000+0000","last_peered":"2023-12-17T11:49:55.305000+0000","last_clean":"2023-12-17T11:49:55.305000+0000","last_became_active":"2023-12-17T11:49:52.232635+0000","last_became_peered":"2023-12-17T11:49:52.232635+0000","last_unstale":"2023-12-17T11:49:55.305000+0000","last_undegraded":"2023-12-17T11:49:55.305000+0000","last_fullsized":"2023-12-17T11:49:55.305000+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_clean_scrub_stamp":"2023-12-17T11:49:51.168108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T15:53:07.030004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:56.659403+0000","last_change":"2023-12-17T11:49:53.246755+0000","last_active":"2023-12-17T11:49:56.659403+0000","last_peered":"2023-12-17T11:49:56.659403+0000","last_clean":"2023-12-17T11:49:56.659403+0000","last_became_active":"2023-12-17T11:49:53.245111+0000","last_became_peered":"2023-12-17T11:49:53.245111+0000","last_unstale":"2023-12-17T11:49:56.659403+0000","last_undegraded":"2023-12-17T11:49:56.659403+0000","last_fullsized":"2023-12-17T11:49:56.659403+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T14:59:11.557660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"39'3","reported_seq":16,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:55.304936+0000","last_change":"2023-12-17T11:49:52.231475+0000","last_active":"2023-12-17T11:49:55.304936+0000","last_peered":"2023-12-17T11:49:55.304936+0000","last_clean":"2023-12-17T11:49:55.304936+0000","last_became_active":"2023-12-17T11:49:52.230061+0000","last_became_peered":"2023-12-17T11:49:52.230061+0000","last_unstale":"2023-12-17T11:49:55.304936+0000","last_undegraded":"2023-12-17T11:49:55.304936+0000","last_fullsized":"2023-12-17T11:49:55.304936+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_clean_scrub_stamp":"2023-12-17T11:49:51.168108+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T22:50:11.250530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-17T11:50:00.523324+0000","last_change":"2023-12-17T11:49:53.232224+0000","last_active":"2023-12-17T11:50:00.523324+0000","last_peered":"2023-12-17T11:50:00.523324+0000","last_clean":"2023-12-17T11:50:00.523324+0000","last_became_active":"2023-12-17T11:49:53.231963+0000","last_became_peered":"2023-12-17T11:49:53.231963+0000","last_unstale":"2023-12-17T11:50:00.523324+0000","last_undegraded":"2023-12-17T11:50:00.523324+0000","last_fullsized":"2023-12-17T11:50:00.523324+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T15:14:36.959400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"39'6","reported_seq":20,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-17T11:50:00.524725+0000","last_change":"2023-12-17T11:49:52.220583+0000","last_active":"2023-12-17T11:50:00.524725+0000","last_peered":"2023-12-17T11:50:00.524725+0000","last_clean":"2023-12-17T11:50:00.524725+0000","last_became_active":"2023-12-17T11:49:52.220304+0000","last_became_peered":"2023-12-17T11:49:52.220304+0000","last_unstale":"2023-12-17T11:50:00.524725+0000","last_undegraded":"2023-12-17T11:50:00.524725+0000","last_fullsized":"2023-12-17T11:50:00.524725+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_clean_scrub_stamp":"2023-12-17T11:49:51.168108+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T12:27:37.121319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:56.659257+0000","last_change":"2023-12-17T11:49:53.248442+0000","last_active":"2023-12-17T11:49:56.659257+0000","last_peered":"2023-12-17T11:49:56.659257+0000","last_clean":"2023-12-17T11:49:56.659257+0000","last_became_active":"2023-12-17T11:49:53.248094+0000","last_became_peered":"2023-12-17T11:49:53.248094+0000","last_unstale":"2023-12-17T11:49:56.659257+0000","last_undegraded":"2023-12-17T11:49:56.659257+0000","last_fullsized":"2023-12-17T11:49:56.659257+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T14:42:29.543380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"39'2","reported_seq":16,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-17T11:50:00.524311+0000","last_change":"2023-12-17T11:49:52.213341+0000","last_active":"2023-12-17T11:50:00.524311+0000","last_peered":"2023-12-17T11:50:00.524311+0000","last_clean":"2023-12-17T11:50:00.524311+0000","last_became_active":"2023-12-17T11:49:52.213024+0000","last_became_peered":"2023-12-17T11:49:52.213024+0000","last_unstale":"2023-12-17T11:50:00.524311+0000","last_undegraded":"2023-12-17T11:50:00.524311+0000","last_fullsized":"2023-12-17T11:50:00.524311+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_clean_scrub_stamp":"2023-12-17T11:49:51.168108+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T20:34:24.431589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-17T11:50:00.522731+0000","last_change":"2023-12-17T11:49:53.238931+0000","last_active":"2023-12-17T11:50:00.522731+0000","last_peered":"2023-12-17T11:50:00.522731+0000","last_clean":"2023-12-17T11:50:00.522731+0000","last_became_active":"2023-12-17T11:49:53.238641+0000","last_became_peered":"2023-12-17T11:49:53.238641+0000","last_unstale":"2023-12-17T11:50:00.522731+0000","last_undegraded":"2023-12-17T11:50:00.522731+0000","last_fullsized":"2023-12-17T11:50:00.522731+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T13:29:29.953615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:54.556680+0000","last_change":"2023-12-17T11:49:52.232507+0000","last_active":"2023-12-17T11:49:54.556680+0000","last_peered":"2023-12-17T11:49:54.556680+0000","last_clean":"2023-12-17T11:49:54.556680+0000","last_became_active":"2023-12-17T11:49:52.232308+0000","last_became_peered":"2023-12-17T11:49:52.232308+0000","last_unstale":"2023-12-17T11:49:54.556680+0000","last_undegraded":"2023-12-17T11:49:54.556680+0000","last_fullsized":"2023-12-17T11:49:54.556680+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_clean_scrub_stamp":"2023-12-17T11:49:51.168108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T19:17:46.282779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:55.301864+0000","last_change":"2023-12-17T11:49:53.234701+0000","last_active":"2023-12-17T11:49:55.301864+0000","last_peered":"2023-12-17T11:49:55.301864+0000","last_clean":"2023-12-17T11:49:55.301864+0000","last_became_active":"2023-12-17T11:49:53.234389+0000","last_became_peered":"2023-12-17T11:49:53.234389+0000","last_unstale":"2023-12-17T11:49:55.301864+0000","last_undegraded":"2023-12-17T11:49:55.301864+0000","last_fullsized":"2023-12-17T11:49:55.301864+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T17:54:34.803705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-17T11:50:01.202070+0000","last_change":"2023-12-17T11:49:52.226465+0000","last_active":"2023-12-17T11:50:01.202070+0000","last_peered":"2023-12-17T11:50:01.202070+0000","last_clean":"2023-12-17T11:50:01.202070+0000","last_became_active":"2023-12-17T11:49:52.226191+0000","last_became_peered":"2023-12-17T11:49:52.226191+0000","last_unstale":"2023-12-17T11:50:01.202070+0000","last_undegraded":"2023-12-17T11:50:01.202070+0000","last_fullsized":"2023-12-17T11:50:01.202070+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_clean_scrub_stamp":"2023-12-17T11:49:51.168108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T18:03:39.554935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-17T11:50:00.524016+0000","last_change":"2023-12-17T11:49:53.254934+0000","last_active":"2023-12-17T11:50:00.524016+0000","last_peered":"2023-12-17T11:50:00.524016+0000","last_clean":"2023-12-17T11:50:00.524016+0000","last_became_active":"2023-12-17T11:49:53.254632+0000","last_became_peered":"2023-12-17T11:49:53.254632+0000","last_unstale":"2023-12-17T11:50:00.524016+0000","last_undegraded":"2023-12-17T11:50:00.524016+0000","last_fullsized":"2023-12-17T11:50:00.524016+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T23:33:06.562683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"39'8","reported_seq":20,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:55.301546+0000","last_change":"2023-12-17T11:49:52.226787+0000","last_active":"2023-12-17T11:49:55.301546+0000","last_peered":"2023-12-17T11:49:55.301546+0000","last_clean":"2023-12-17T11:49:55.301546+0000","last_became_active":"2023-12-17T11:49:52.226471+0000","last_became_peered":"2023-12-17T11:49:52.226471+0000","last_unstale":"2023-12-17T11:49:55.301546+0000","last_undegraded":"2023-12-17T11:49:55.301546+0000","last_fullsized":"2023-12-17T11:49:55.301546+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_clean_scrub_stamp":"2023-12-17T11:49:51.168108+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T17:27:58.587187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-17T11:50:00.524643+0000","last_change":"2023-12-17T11:49:53.253979+0000","last_active":"2023-12-17T11:50:00.524643+0000","last_peered":"2023-12-17T11:50:00.524643+0000","last_clean":"2023-12-17T11:50:00.524643+0000","last_became_active":"2023-12-17T11:49:53.253694+0000","last_became_peered":"2023-12-17T11:49:53.253694+0000","last_unstale":"2023-12-17T11:50:00.524643+0000","last_undegraded":"2023-12-17T11:50:00.524643+0000","last_fullsized":"2023-12-17T11:50:00.524643+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T19:26:47.162716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"39'1","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:55.305058+0000","last_change":"2023-12-17T11:49:52.231973+0000","last_active":"2023-12-17T11:49:55.305058+0000","last_peered":"2023-12-17T11:49:55.305058+0000","last_clean":"2023-12-17T11:49:55.305058+0000","last_became_active":"2023-12-17T11:49:52.231641+0000","last_became_peered":"2023-12-17T11:49:52.231641+0000","last_unstale":"2023-12-17T11:49:55.305058+0000","last_undegraded":"2023-12-17T11:49:55.305058+0000","last_fullsized":"2023-12-17T11:49:55.305058+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_clean_scrub_stamp":"2023-12-17T11:49:51.168108+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T20:34:24.431589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:56.655838+0000","last_change":"2023-12-17T11:49:53.253141+0000","last_active":"2023-12-17T11:49:56.655838+0000","last_peered":"2023-12-17T11:49:56.655838+0000","last_clean":"2023-12-17T11:49:56.655838+0000","last_became_active":"2023-12-17T11:49:53.252532+0000","last_became_peered":"2023-12-17T11:49:53.252532+0000","last_unstale":"2023-12-17T11:49:56.655838+0000","last_undegraded":"2023-12-17T11:49:56.655838+0000","last_fullsized":"2023-12-17T11:49:56.655838+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T22:42:15.785143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"39'2","reported_seq":16,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-17T11:50:00.523361+0000","last_change":"2023-12-17T11:49:52.230858+0000","last_active":"2023-12-17T11:50:00.523361+0000","last_peered":"2023-12-17T11:50:00.523361+0000","last_clean":"2023-12-17T11:50:00.523361+0000","last_became_active":"2023-12-17T11:49:52.230281+0000","last_became_peered":"2023-12-17T11:49:52.230281+0000","last_unstale":"2023-12-17T11:50:00.523361+0000","last_undegraded":"2023-12-17T11:50:00.523361+0000","last_fullsized":"2023-12-17T11:50:00.523361+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_clean_scrub_stamp":"2023-12-17T11:49:51.168108+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T22:39:30.094160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-17T11:50:00.523134+0000","last_change":"2023-12-17T11:49:53.251192+0000","last_active":"2023-12-17T11:50:00.523134+0000","last_peered":"2023-12-17T11:50:00.523134+0000","last_clean":"2023-12-17T11:50:00.523134+0000","last_became_active":"2023-12-17T11:49:53.250837+0000","last_became_peered":"2023-12-17T11:49:53.250837+0000","last_unstale":"2023-12-17T11:50:00.523134+0000","last_undegraded":"2023-12-17T11:50:00.523134+0000","last_fullsized":"2023-12-17T11:50:00.523134+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T14:42:29.543380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"39'1","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:55.300966+0000","last_change":"2023-12-17T11:49:52.222238+0000","last_active":"2023-12-17T11:49:55.300966+0000","last_peered":"2023-12-17T11:49:55.300966+0000","last_clean":"2023-12-17T11:49:55.300966+0000","last_became_active":"2023-12-17T11:49:52.221941+0000","last_became_peered":"2023-12-17T11:49:52.221941+0000","last_unstale":"2023-12-17T11:49:55.300966+0000","last_undegraded":"2023-12-17T11:49:55.300966+0000","last_fullsized":"2023-12-17T11:49:55.300966+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_clean_scrub_stamp":"2023-12-17T11:49:51.168108+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T12:43:47.651883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:56.663718+0000","last_change":"2023-12-17T11:49:53.253162+0000","last_active":"2023-12-17T11:49:56.663718+0000","last_peered":"2023-12-17T11:49:56.663718+0000","last_clean":"2023-12-17T11:49:56.663718+0000","last_became_active":"2023-12-17T11:49:53.252770+0000","last_became_peered":"2023-12-17T11:49:53.252770+0000","last_unstale":"2023-12-17T11:49:56.663718+0000","last_undegraded":"2023-12-17T11:49:56.663718+0000","last_fullsized":"2023-12-17T11:49:56.663718+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T14:03:09.358474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:54.557332+0000","last_change":"2023-12-17T11:49:52.223776+0000","last_active":"2023-12-17T11:49:54.557332+0000","last_peered":"2023-12-17T11:49:54.557332+0000","last_clean":"2023-12-17T11:49:54.557332+0000","last_became_active":"2023-12-17T11:49:52.223571+0000","last_became_peered":"2023-12-17T11:49:52.223571+0000","last_unstale":"2023-12-17T11:49:54.557332+0000","last_undegraded":"2023-12-17T11:49:54.557332+0000","last_fullsized":"2023-12-17T11:49:54.557332+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_clean_scrub_stamp":"2023-12-17T11:49:51.168108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T22:59:00.390569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:55.301868+0000","last_change":"2023-12-17T11:49:53.232411+0000","last_active":"2023-12-17T11:49:55.301868+0000","last_peered":"2023-12-17T11:49:55.301868+0000","last_clean":"2023-12-17T11:49:55.301868+0000","last_became_active":"2023-12-17T11:49:53.232101+0000","last_became_peered":"2023-12-17T11:49:53.232101+0000","last_unstale":"2023-12-17T11:49:55.301868+0000","last_undegraded":"2023-12-17T11:49:55.301868+0000","last_fullsized":"2023-12-17T11:49:55.301868+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T11:57:59.882385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"39'2","reported_seq":15,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:55.300347+0000","last_change":"2023-12-17T11:49:52.210836+0000","last_active":"2023-12-17T11:49:55.300347+0000","last_peered":"2023-12-17T11:49:55.300347+0000","last_clean":"2023-12-17T11:49:55.300347+0000","last_became_active":"2023-12-17T11:49:52.210521+0000","last_became_peered":"2023-12-17T11:49:52.210521+0000","last_unstale":"2023-12-17T11:49:55.300347+0000","last_undegraded":"2023-12-17T11:49:55.300347+0000","last_fullsized":"2023-12-17T11:49:55.300347+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_clean_scrub_stamp":"2023-12-17T11:49:51.168108+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T17:20:36.726376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:56.659317+0000","last_change":"2023-12-17T11:49:53.243230+0000","last_active":"2023-12-17T11:49:56.659317+0000","last_peered":"2023-12-17T11:49:56.659317+0000","last_clean":"2023-12-17T11:49:56.659317+0000","last_became_active":"2023-12-17T11:49:53.242951+0000","last_became_peered":"2023-12-17T11:49:53.242951+0000","last_unstale":"2023-12-17T11:49:56.659317+0000","last_undegraded":"2023-12-17T11:49:56.659317+0000","last_fullsized":"2023-12-17T11:49:56.659317+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T18:42:00.093282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:55.300327+0000","last_change":"2023-12-17T11:49:52.217136+0000","last_active":"2023-12-17T11:49:55.300327+0000","last_peered":"2023-12-17T11:49:55.300327+0000","last_clean":"2023-12-17T11:49:55.300327+0000","last_became_active":"2023-12-17T11:49:52.216921+0000","last_became_peered":"2023-12-17T11:49:52.216921+0000","last_unstale":"2023-12-17T11:49:55.300327+0000","last_undegraded":"2023-12-17T11:49:55.300327+0000","last_fullsized":"2023-12-17T11:49:55.300327+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_clean_scrub_stamp":"2023-12-17T11:49:51.168108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T19:32:12.805680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:56.655717+0000","last_change":"2023-12-17T11:49:53.255643+0000","last_active":"2023-12-17T11:49:56.655717+0000","last_peered":"2023-12-17T11:49:56.655717+0000","last_clean":"2023-12-17T11:49:56.655717+0000","last_became_active":"2023-12-17T11:49:53.255379+0000","last_became_peered":"2023-12-17T11:49:53.255379+0000","last_unstale":"2023-12-17T11:49:56.655717+0000","last_undegraded":"2023-12-17T11:49:56.655717+0000","last_fullsized":"2023-12-17T11:49:56.655717+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T16:21:14.355302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:55.301924+0000","last_change":"2023-12-17T11:49:52.229883+0000","last_active":"2023-12-17T11:49:55.301924+0000","last_peered":"2023-12-17T11:49:55.301924+0000","last_clean":"2023-12-17T11:49:55.301924+0000","last_became_active":"2023-12-17T11:49:52.229372+0000","last_became_peered":"2023-12-17T11:49:52.229372+0000","last_unstale":"2023-12-17T11:49:55.301924+0000","last_undegraded":"2023-12-17T11:49:55.301924+0000","last_fullsized":"2023-12-17T11:49:55.301924+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_clean_scrub_stamp":"2023-12-17T11:49:51.168108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T23:27:59.830582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-17T11:50:00.524144+0000","last_change":"2023-12-17T11:49:53.249227+0000","last_active":"2023-12-17T11:50:00.524144+0000","last_peered":"2023-12-17T11:50:00.524144+0000","last_clean":"2023-12-17T11:50:00.524144+0000","last_became_active":"2023-12-17T11:49:53.248594+0000","last_became_peered":"2023-12-17T11:49:53.248594+0000","last_unstale":"2023-12-17T11:50:00.524144+0000","last_undegraded":"2023-12-17T11:50:00.524144+0000","last_fullsized":"2023-12-17T11:50:00.524144+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T14:31:17.752657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:55.300293+0000","last_change":"2023-12-17T11:49:52.211707+0000","last_active":"2023-12-17T11:49:55.300293+0000","last_peered":"2023-12-17T11:49:55.300293+0000","last_clean":"2023-12-17T11:49:55.300293+0000","last_became_active":"2023-12-17T11:49:52.211283+0000","last_became_peered":"2023-12-17T11:49:52.211283+0000","last_unstale":"2023-12-17T11:49:55.300293+0000","last_undegraded":"2023-12-17T11:49:55.300293+0000","last_fullsized":"2023-12-17T11:49:55.300293+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_clean_scrub_stamp":"2023-12-17T11:49:51.168108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T12:54:05.203029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:56.660005+0000","last_change":"2023-12-17T11:49:53.255235+0000","last_active":"2023-12-17T11:49:56.660005+0000","last_peered":"2023-12-17T11:49:56.660005+0000","last_clean":"2023-12-17T11:49:56.660005+0000","last_became_active":"2023-12-17T11:49:53.254570+0000","last_became_peered":"2023-12-17T11:49:53.254570+0000","last_unstale":"2023-12-17T11:49:56.660005+0000","last_undegraded":"2023-12-17T11:49:56.660005+0000","last_fullsized":"2023-12-17T11:49:56.660005+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T15:14:36.959400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"39'2","reported_seq":15,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:55.305320+0000","last_change":"2023-12-17T11:49:52.229686+0000","last_active":"2023-12-17T11:49:55.305320+0000","last_peered":"2023-12-17T11:49:55.305320+0000","last_clean":"2023-12-17T11:49:55.305320+0000","last_became_active":"2023-12-17T11:49:52.229401+0000","last_became_peered":"2023-12-17T11:49:52.229401+0000","last_unstale":"2023-12-17T11:49:55.305320+0000","last_undegraded":"2023-12-17T11:49:55.305320+0000","last_fullsized":"2023-12-17T11:49:55.305320+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_clean_scrub_stamp":"2023-12-17T11:49:51.168108+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T17:03:59.637357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:55.302996+0000","last_change":"2023-12-17T11:49:53.236908+0000","last_active":"2023-12-17T11:49:55.302996+0000","last_peered":"2023-12-17T11:49:55.302996+0000","last_clean":"2023-12-17T11:49:55.302996+0000","last_became_active":"2023-12-17T11:49:53.236508+0000","last_became_peered":"2023-12-17T11:49:53.236508+0000","last_unstale":"2023-12-17T11:49:55.302996+0000","last_undegraded":"2023-12-17T11:49:55.302996+0000","last_fullsized":"2023-12-17T11:49:55.302996+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T13:59:52.939825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"40'1","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:58.273630+0000","last_change":"2023-12-17T11:49:52.229067+0000","last_active":"2023-12-17T11:49:58.273630+0000","last_peered":"2023-12-17T11:49:58.273630+0000","last_clean":"2023-12-17T11:49:58.273630+0000","last_became_active":"2023-12-17T11:49:52.228704+0000","last_became_peered":"2023-12-17T11:49:52.228704+0000","last_unstale":"2023-12-17T11:49:58.273630+0000","last_undegraded":"2023-12-17T11:49:58.273630+0000","last_fullsized":"2023-12-17T11:49:58.273630+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_clean_scrub_stamp":"2023-12-17T11:49:51.168108+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T16:31:06.129915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-17T11:50:00.524876+0000","last_change":"2023-12-17T11:49:53.246415+0000","last_active":"2023-12-17T11:50:00.524876+0000","last_peered":"2023-12-17T11:50:00.524876+0000","last_clean":"2023-12-17T11:50:00.524876+0000","last_became_active":"2023-12-17T11:49:53.246163+0000","last_became_peered":"2023-12-17T11:49:53.246163+0000","last_unstale":"2023-12-17T11:50:00.524876+0000","last_undegraded":"2023-12-17T11:50:00.524876+0000","last_fullsized":"2023-12-17T11:50:00.524876+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T17:56:09.285369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:55.302270+0000","last_change":"2023-12-17T11:49:52.219865+0000","last_active":"2023-12-17T11:49:55.302270+0000","last_peered":"2023-12-17T11:49:55.302270+0000","last_clean":"2023-12-17T11:49:55.302270+0000","last_became_active":"2023-12-17T11:49:52.219593+0000","last_became_peered":"2023-12-17T11:49:52.219593+0000","last_unstale":"2023-12-17T11:49:55.302270+0000","last_undegraded":"2023-12-17T11:49:55.302270+0000","last_fullsized":"2023-12-17T11:49:55.302270+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_clean_scrub_stamp":"2023-12-17T11:49:51.168108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T15:14:35.947970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:56.659295+0000","last_change":"2023-12-17T11:49:53.242876+0000","last_active":"2023-12-17T11:49:56.659295+0000","last_peered":"2023-12-17T11:49:56.659295+0000","last_clean":"2023-12-17T11:49:56.659295+0000","last_became_active":"2023-12-17T11:49:53.242568+0000","last_became_peered":"2023-12-17T11:49:53.242568+0000","last_unstale":"2023-12-17T11:49:56.659295+0000","last_undegraded":"2023-12-17T11:49:56.659295+0000","last_fullsized":"2023-12-17T11:49:56.659295+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T23:10:56.100255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:55.302112+0000","last_change":"2023-12-17T11:49:52.223424+0000","last_active":"2023-12-17T11:49:55.302112+0000","last_peered":"2023-12-17T11:49:55.302112+0000","last_clean":"2023-12-17T11:49:55.302112+0000","last_became_active":"2023-12-17T11:49:52.223126+0000","last_became_peered":"2023-12-17T11:49:52.223126+0000","last_unstale":"2023-12-17T11:49:55.302112+0000","last_undegraded":"2023-12-17T11:49:55.302112+0000","last_fullsized":"2023-12-17T11:49:55.302112+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_clean_scrub_stamp":"2023-12-17T11:49:51.168108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T14:31:59.450792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:56.659933+0000","last_change":"2023-12-17T11:49:53.251516+0000","last_active":"2023-12-17T11:49:56.659933+0000","last_peered":"2023-12-17T11:49:56.659933+0000","last_clean":"2023-12-17T11:49:56.659933+0000","last_became_active":"2023-12-17T11:49:53.251230+0000","last_became_peered":"2023-12-17T11:49:53.251230+0000","last_unstale":"2023-12-17T11:49:56.659933+0000","last_undegraded":"2023-12-17T11:49:56.659933+0000","last_fullsized":"2023-12-17T11:49:56.659933+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T19:39:18.340154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-17T11:50:01.202294+0000","last_change":"2023-12-17T11:49:52.219807+0000","last_active":"2023-12-17T11:50:01.202294+0000","last_peered":"2023-12-17T11:50:01.202294+0000","last_clean":"2023-12-17T11:50:01.202294+0000","last_became_active":"2023-12-17T11:49:52.219503+0000","last_became_peered":"2023-12-17T11:49:52.219503+0000","last_unstale":"2023-12-17T11:50:01.202294+0000","last_undegraded":"2023-12-17T11:50:01.202294+0000","last_fullsized":"2023-12-17T11:50:01.202294+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_clean_scrub_stamp":"2023-12-17T11:49:51.168108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T18:07:09.094032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-17T11:50:00.522740+0000","last_change":"2023-12-17T11:49:53.241750+0000","last_active":"2023-12-17T11:50:00.522740+0000","last_peered":"2023-12-17T11:50:00.522740+0000","last_clean":"2023-12-17T11:50:00.522740+0000","last_became_active":"2023-12-17T11:49:53.241529+0000","last_became_peered":"2023-12-17T11:49:53.241529+0000","last_unstale":"2023-12-17T11:50:00.522740+0000","last_undegraded":"2023-12-17T11:50:00.522740+0000","last_fullsized":"2023-12-17T11:50:00.522740+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T16:31:53.964205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-17T11:50:00.522300+0000","last_change":"2023-12-17T11:49:52.216579+0000","last_active":"2023-12-17T11:50:00.522300+0000","last_peered":"2023-12-17T11:50:00.522300+0000","last_clean":"2023-12-17T11:50:00.522300+0000","last_became_active":"2023-12-17T11:49:52.216265+0000","last_became_peered":"2023-12-17T11:49:52.216265+0000","last_unstale":"2023-12-17T11:50:00.522300+0000","last_undegraded":"2023-12-17T11:50:00.522300+0000","last_fullsized":"2023-12-17T11:50:00.522300+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_clean_scrub_stamp":"2023-12-17T11:49:51.168108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T14:31:59.450792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:55.302580+0000","last_change":"2023-12-17T11:49:53.234303+0000","last_active":"2023-12-17T11:49:55.302580+0000","last_peered":"2023-12-17T11:49:55.302580+0000","last_clean":"2023-12-17T11:49:55.302580+0000","last_became_active":"2023-12-17T11:49:53.233951+0000","last_became_peered":"2023-12-17T11:49:53.233951+0000","last_unstale":"2023-12-17T11:49:55.302580+0000","last_undegraded":"2023-12-17T11:49:55.302580+0000","last_fullsized":"2023-12-17T11:49:55.302580+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T19:17:38.569694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-17T11:50:00.522523+0000","last_change":"2023-12-17T11:49:52.219957+0000","last_active":"2023-12-17T11:50:00.522523+0000","last_peered":"2023-12-17T11:50:00.522523+0000","last_clean":"2023-12-17T11:50:00.522523+0000","last_became_active":"2023-12-17T11:49:52.219626+0000","last_became_peered":"2023-12-17T11:49:52.219626+0000","last_unstale":"2023-12-17T11:50:00.522523+0000","last_undegraded":"2023-12-17T11:50:00.522523+0000","last_fullsized":"2023-12-17T11:50:00.522523+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_clean_scrub_stamp":"2023-12-17T11:49:51.168108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T19:12:11.016281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:56.655904+0000","last_change":"2023-12-17T11:49:53.253151+0000","last_active":"2023-12-17T11:49:56.655904+0000","last_peered":"2023-12-17T11:49:56.655904+0000","last_clean":"2023-12-17T11:49:56.655904+0000","last_became_active":"2023-12-17T11:49:53.252842+0000","last_became_peered":"2023-12-17T11:49:53.252842+0000","last_unstale":"2023-12-17T11:49:56.655904+0000","last_undegraded":"2023-12-17T11:49:56.655904+0000","last_fullsized":"2023-12-17T11:49:56.655904+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T14:31:17.752657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:55.302520+0000","last_change":"2023-12-17T11:49:52.228110+0000","last_active":"2023-12-17T11:49:55.302520+0000","last_peered":"2023-12-17T11:49:55.302520+0000","last_clean":"2023-12-17T11:49:55.302520+0000","last_became_active":"2023-12-17T11:49:52.227851+0000","last_became_peered":"2023-12-17T11:49:52.227851+0000","last_unstale":"2023-12-17T11:49:55.302520+0000","last_undegraded":"2023-12-17T11:49:55.302520+0000","last_fullsized":"2023-12-17T11:49:55.302520+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_clean_scrub_stamp":"2023-12-17T11:49:51.168108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T18:37:20.380970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":180,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-17T11:49:53.217829+0000","last_change":"2023-12-17T11:48:07.952584+0000","last_active":"2023-12-17T11:49:53.217829+0000","last_peered":"2023-12-17T11:49:53.217829+0000","last_clean":"2023-12-17T11:49:53.217829+0000","last_became_active":"2023-12-17T11:48:07.950361+0000","last_became_peered":"2023-12-17T11:48:07.950361+0000","last_unstale":"2023-12-17T11:49:53.217829+0000","last_undegraded":"2023-12-17T11:49:53.217829+0000","last_fullsized":"2023-12-17T11:49:53.217829+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:06.728199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:06.728199+0000","last_clean_scrub_stamp":"2023-12-17T11:48:06.728199+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T12:47:55.048065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542171,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28064,"kb_used_data":1044,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343776,"statfs":{"total":96636764160,"available":96608026624,"internally_reserved":0,"allocated":1069056,"data_stored":789626,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 17 11:49:06 2023","interfaces":[{"interface":"back","average":{"1min":1.407,"5min":1.407,"15min":1.407},"min":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":8.6579999999999995,"5min":8.6579999999999995,"15min":8.6579999999999995},"last":1.288},{"interface":"front","average":{"1min":1.339,"5min":1.339,"15min":1.339},"min":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"max":{"1min":4.0830000000000002,"5min":4.0830000000000002,"15min":4.0830000000000002},"last":1.3360000000000001}]},{"osd":1,"last update":"Sun Dec 17 11:49:06 2023","interfaces":[{"interface":"back","average":{"1min":1.127,"5min":1.127,"15min":1.127},"min":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"max":{"1min":2.1539999999999999,"5min":2.1539999999999999,"15min":2.1539999999999999},"last":1.6850000000000001},{"interface":"front","average":{"1min":1.413,"5min":1.413,"15min":1.413},"min":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"max":{"1min":8.7449999999999992,"5min":8.7449999999999992,"15min":8.7449999999999992},"last":1.014}]},{"osd":2,"last update":"Sun Dec 17 11:49:06 2023","interfaces":[{"interface":"back","average":{"1min":1.4299999999999999,"5min":1.4299999999999999,"15min":1.4299999999999999},"min":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"max":{"1min":4.1239999999999997,"5min":4.1239999999999997,"15min":4.1239999999999997},"last":1.2130000000000001},{"interface":"front","average":{"1min":1.3720000000000001,"5min":1.3720000000000001,"15min":1.3720000000000001},"min":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"max":{"1min":1.782,"5min":1.782,"15min":1.782},"last":0.92300000000000004}]},{"osd":3,"last update":"Sun Dec 17 11:49:06 2023","interfaces":[{"interface":"back","average":{"1min":1.298,"5min":1.298,"15min":1.298},"min":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"max":{"1min":2.5430000000000001,"5min":2.5430000000000001,"15min":2.5430000000000001},"last":1.556},{"interface":"front","average":{"1min":1.375,"5min":1.375,"15min":1.375},"min":{"1min":1.087,"5min":1.087,"15min":1.087},"max":{"1min":2.5830000000000002,"5min":2.5830000000000002,"15min":2.5830000000000002},"last":1.3740000000000001}]},{"osd":4,"last update":"Sun Dec 17 11:49:06 2023","interfaces":[{"interface":"back","average":{"1min":1.3859999999999999,"5min":1.3859999999999999,"15min":1.3859999999999999},"min":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":4.0309999999999997,"5min":4.0309999999999997,"15min":4.0309999999999997},"last":1.498},{"interface":"front","average":{"1min":1.5860000000000001,"5min":1.5860000000000001,"15min":1.5860000000000001},"min":{"1min":1.2230000000000001,"5min":1.2230000000000001,"15min":1.2230000000000001},"max":{"1min":3.3220000000000001,"5min":3.3220000000000001,"15min":3.3220000000000001},"last":1.8120000000000001}]},{"osd":5,"last update":"Sun Dec 17 11:49:06 2023","interfaces":[{"interface":"back","average":{"1min":1.6970000000000001,"5min":1.6970000000000001,"15min":1.6970000000000001},"min":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"max":{"1min":8.7929999999999993,"5min":8.7929999999999993,"15min":8.7929999999999993},"last":1.4399999999999999},{"interface":"front","average":{"1min":1.6859999999999999,"5min":1.6859999999999999,"15min":1.6859999999999999},"min":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"max":{"1min":5.1040000000000001,"5min":5.1040000000000001,"15min":5.1040000000000001},"last":1.786}]},{"osd":6,"last update":"Sun Dec 17 11:49:06 2023","interfaces":[{"interface":"back","average":{"1min":1.845,"5min":1.845,"15min":1.845},"min":{"1min":1.081,"5min":1.081,"15min":1.081},"max":{"1min":8.8330000000000002,"5min":8.8330000000000002,"15min":8.8330000000000002},"last":1.6439999999999999},{"interface":"front","average":{"1min":1.71,"5min":1.71,"15min":1.71},"min":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"max":{"1min":3.9590000000000001,"5min":3.9590000000000001,"15min":3.9590000000000001},"last":1.6060000000000001}]}]},{"osd":6,"up_from":14,"seq":60129542171,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27480,"kb_used_data":452,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344360,"statfs":{"total":96636764160,"available":96608624640,"internally_reserved":0,"allocated":462848,"data_stored":198158,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 17 11:49:06 2023","interfaces":[{"interface":"back","average":{"1min":1.0720000000000001,"5min":1.0720000000000001,"15min":1.0720000000000001},"min":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.5840000000000001,"5min":1.5840000000000001,"15min":1.5840000000000001},"last":1.0169999999999999},{"interface":"front","average":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"min":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"max":{"1min":1.429,"5min":1.429,"15min":1.429},"last":1.8400000000000001}]},{"osd":1,"last update":"Sun Dec 17 11:49:06 2023","interfaces":[{"interface":"back","average":{"1min":1.2689999999999999,"5min":1.2689999999999999,"15min":1.2689999999999999},"min":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"max":{"1min":1.5640000000000001,"5min":1.5640000000000001,"15min":1.5640000000000001},"last":1.403},{"interface":"front","average":{"1min":1.3169999999999999,"5min":1.3169999999999999,"15min":1.3169999999999999},"min":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"max":{"1min":1.9359999999999999,"5min":1.9359999999999999,"15min":1.9359999999999999},"last":1.7809999999999999}]},{"osd":2,"last update":"Sun Dec 17 11:49:06 2023","interfaces":[{"interface":"back","average":{"1min":1.1970000000000001,"5min":1.1970000000000001,"15min":1.1970000000000001},"min":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":1.8740000000000001,"5min":1.8740000000000001,"15min":1.8740000000000001},"last":1.6930000000000001},{"interface":"front","average":{"1min":1.296,"5min":1.296,"15min":1.296},"min":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":2.5470000000000002,"5min":2.5470000000000002,"15min":2.5470000000000002},"last":1.29}]},{"osd":3,"last update":"Sun Dec 17 11:49:06 2023","interfaces":[{"interface":"back","average":{"1min":1.508,"5min":1.508,"15min":1.508},"min":{"1min":1.0840000000000001,"5min":1.0840000000000001,"15min":1.0840000000000001},"max":{"1min":2.4689999999999999,"5min":2.4689999999999999,"15min":2.4689999999999999},"last":1.9590000000000001},{"interface":"front","average":{"1min":1.4390000000000001,"5min":1.4390000000000001,"15min":1.4390000000000001},"min":{"1min":0.88,"5min":0.88,"15min":0.88},"max":{"1min":2.0680000000000001,"5min":2.0680000000000001,"15min":2.0680000000000001},"last":1.216}]},{"osd":4,"last update":"Sun Dec 17 11:49:06 2023","interfaces":[{"interface":"back","average":{"1min":1.522,"5min":1.522,"15min":1.522},"min":{"1min":1.1419999999999999,"5min":1.1419999999999999,"15min":1.1419999999999999},"max":{"1min":2.222,"5min":2.222,"15min":2.222},"last":1.5069999999999999},{"interface":"front","average":{"1min":1.4419999999999999,"5min":1.4419999999999999,"15min":1.4419999999999999},"min":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":0.90700000000000003},"max":{"1min":2.4079999999999999,"5min":2.4079999999999999,"15min":2.4079999999999999},"last":1.444}]},{"osd":5,"last update":"Sun Dec 17 11:49:06 2023","interfaces":[{"interface":"back","average":{"1min":1.548,"5min":1.548,"15min":1.548},"min":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"max":{"1min":2.3319999999999999,"5min":2.3319999999999999,"15min":2.3319999999999999},"last":1.6279999999999999},{"interface":"front","average":{"1min":1.5760000000000001,"5min":1.5760000000000001,"15min":1.5760000000000001},"min":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"max":{"1min":2.6760000000000002,"5min":2.6760000000000002,"15min":2.6760000000000002},"last":1.6000000000000001}]},{"osd":7,"last update":"Sun Dec 17 11:49:06 2023","interfaces":[{"interface":"back","average":{"1min":1.419,"5min":1.419,"15min":1.419},"min":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"max":{"1min":2.1560000000000001,"5min":2.1560000000000001,"15min":2.1560000000000001},"last":1.5589999999999999},{"interface":"front","average":{"1min":1.712,"5min":1.712,"15min":1.712},"min":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"max":{"1min":2.6059999999999999,"5min":2.6059999999999999,"15min":2.6059999999999999},"last":1.8919999999999999}]}]},{"osd":5,"up_from":14,"seq":60129542170,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27488,"kb_used_data":468,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344352,"statfs":{"total":96636764160,"available":96608616448,"internally_reserved":0,"allocated":479232,"data_stored":203975,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 17 11:49:09 2023","interfaces":[{"interface":"back","average":{"1min":1.101,"5min":1.101,"15min":1.101},"min":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":1.5860000000000001,"5min":1.5860000000000001,"15min":1.5860000000000001},"last":1.204},{"interface":"front","average":{"1min":1.23,"5min":1.23,"15min":1.23},"min":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"max":{"1min":1.9419999999999999,"5min":1.9419999999999999,"15min":1.9419999999999999},"last":1.0860000000000001}]},{"osd":1,"last update":"Sun Dec 17 11:49:09 2023","interfaces":[{"interface":"back","average":{"1min":1.167,"5min":1.167,"15min":1.167},"min":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"max":{"1min":1.5289999999999999,"5min":1.5289999999999999,"15min":1.5289999999999999},"last":1.6479999999999999},{"interface":"front","average":{"1min":1.216,"5min":1.216,"15min":1.216},"min":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"max":{"1min":1.8660000000000001,"5min":1.8660000000000001,"15min":1.8660000000000001},"last":1.3220000000000001}]},{"osd":2,"last update":"Sun Dec 17 11:49:09 2023","interfaces":[{"interface":"back","average":{"1min":1.3140000000000001,"5min":1.3140000000000001,"15min":1.3140000000000001},"min":{"1min":0.747,"5min":0.747,"15min":0.747},"max":{"1min":2.1589999999999998,"5min":2.1589999999999998,"15min":2.1589999999999998},"last":0.93899999999999995},{"interface":"front","average":{"1min":1.3919999999999999,"5min":1.3919999999999999,"15min":1.3919999999999999},"min":{"1min":1.0049999999999999,"5min":1.0049999999999999,"15min":1.0049999999999999},"max":{"1min":2.1379999999999999,"5min":2.1379999999999999,"15min":2.1379999999999999},"last":1.506}]},{"osd":3,"last update":"Sun Dec 17 11:49:09 2023","interfaces":[{"interface":"back","average":{"1min":1.337,"5min":1.337,"15min":1.337},"min":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"max":{"1min":2.593,"5min":2.593,"15min":2.593},"last":1.351},{"interface":"front","average":{"1min":1.407,"5min":1.407,"15min":1.407},"min":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"max":{"1min":2.3079999999999998,"5min":2.3079999999999998,"15min":2.3079999999999998},"last":1.381}]},{"osd":4,"last update":"Sun Dec 17 11:49:09 2023","interfaces":[{"interface":"back","average":{"1min":1.5029999999999999,"5min":1.5029999999999999,"15min":1.5029999999999999},"min":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"max":{"1min":2.5299999999999998,"5min":2.5299999999999998,"15min":2.5299999999999998},"last":1.4510000000000001},{"interface":"front","average":{"1min":1.6879999999999999,"5min":1.6879999999999999,"15min":1.6879999999999999},"min":{"1min":1.0669999999999999,"5min":1.0669999999999999,"15min":1.0669999999999999},"max":{"1min":3.9569999999999999,"5min":3.9569999999999999,"15min":3.9569999999999999},"last":1.1739999999999999}]},{"osd":6,"last update":"Sun Dec 17 11:49:09 2023","interfaces":[{"interface":"back","average":{"1min":1.6619999999999999,"5min":1.6619999999999999,"15min":1.6619999999999999},"min":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"max":{"1min":2.9849999999999999,"5min":2.9849999999999999,"15min":2.9849999999999999},"last":1.5900000000000001},{"interface":"front","average":{"1min":1.6319999999999999,"5min":1.6319999999999999,"15min":1.6319999999999999},"min":{"1min":1.25,"5min":1.25,"15min":1.25},"max":{"1min":2.641,"5min":2.641,"15min":2.641},"last":1.5569999999999999}]},{"osd":7,"last update":"Sun Dec 17 11:49:09 2023","interfaces":[{"interface":"back","average":{"1min":1.8080000000000001,"5min":1.8080000000000001,"15min":1.8080000000000001},"min":{"1min":1.232,"5min":1.232,"15min":1.232},"max":{"1min":3.8570000000000002,"5min":3.8570000000000002,"15min":3.8570000000000002},"last":1.2589999999999999},{"interface":"front","average":{"1min":1.827,"5min":1.827,"15min":1.827},"min":{"1min":1.137,"5min":1.137,"15min":1.137},"max":{"1min":2.8999999999999999,"5min":2.8999999999999999,"15min":2.8999999999999999},"last":1.702}]}]},{"osd":4,"up_from":14,"seq":60129542171,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27488,"kb_used_data":468,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344352,"statfs":{"total":96636764160,"available":96608616448,"internally_reserved":0,"allocated":479232,"data_stored":204467,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 17 11:49:08 2023","interfaces":[{"interface":"back","average":{"1min":1.02,"5min":1.02,"15min":1.02},"min":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"max":{"1min":1.1890000000000001,"5min":1.1890000000000001,"15min":1.1890000000000001},"last":1.3300000000000001},{"interface":"front","average":{"1min":1.167,"5min":1.167,"15min":1.167},"min":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"max":{"1min":2.6400000000000001,"5min":2.6400000000000001,"15min":2.6400000000000001},"last":0.96599999999999997}]},{"osd":1,"last update":"Sun Dec 17 11:49:08 2023","interfaces":[{"interface":"back","average":{"1min":1.0960000000000001,"5min":1.0960000000000001,"15min":1.0960000000000001},"min":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"max":{"1min":1.369,"5min":1.369,"15min":1.369},"last":1.4450000000000001},{"interface":"front","average":{"1min":1.2669999999999999,"5min":1.2669999999999999,"15min":1.2669999999999999},"min":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"max":{"1min":1.631,"5min":1.631,"15min":1.631},"last":0.88600000000000001}]},{"osd":2,"last update":"Sun Dec 17 11:49:08 2023","interfaces":[{"interface":"back","average":{"1min":1.393,"5min":1.393,"15min":1.393},"min":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"max":{"1min":1.8660000000000001,"5min":1.8660000000000001,"15min":1.8660000000000001},"last":1.2},{"interface":"front","average":{"1min":1.329,"5min":1.329,"15min":1.329},"min":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"max":{"1min":1.968,"5min":1.968,"15min":1.968},"last":1.5069999999999999}]},{"osd":3,"last update":"Sun Dec 17 11:49:08 2023","interfaces":[{"interface":"back","average":{"1min":1.4410000000000001,"5min":1.4410000000000001,"15min":1.4410000000000001},"min":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"max":{"1min":3.2290000000000001,"5min":3.2290000000000001,"15min":3.2290000000000001},"last":1.28},{"interface":"front","average":{"1min":1.496,"5min":1.496,"15min":1.496},"min":{"1min":1.1000000000000001,"5min":1.1000000000000001,"15min":1.1000000000000001},"max":{"1min":2.0169999999999999,"5min":2.0169999999999999,"15min":2.0169999999999999},"last":1.556}]},{"osd":5,"last update":"Sun Dec 17 11:49:08 2023","interfaces":[{"interface":"back","average":{"1min":1.474,"5min":1.474,"15min":1.474},"min":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"max":{"1min":2.141,"5min":2.141,"15min":2.141},"last":1.653},{"interface":"front","average":{"1min":1.7110000000000001,"5min":1.7110000000000001,"15min":1.7110000000000001},"min":{"1min":1.2390000000000001,"5min":1.2390000000000001,"15min":1.2390000000000001},"max":{"1min":3.8220000000000001,"5min":3.8220000000000001,"15min":3.8220000000000001},"last":1.3999999999999999}]},{"osd":6,"last update":"Sun Dec 17 11:49:08 2023","interfaces":[{"interface":"back","average":{"1min":1.7370000000000001,"5min":1.7370000000000001,"15min":1.7370000000000001},"min":{"1min":1.212,"5min":1.212,"15min":1.212},"max":{"1min":2.7410000000000001,"5min":2.7410000000000001,"15min":2.7410000000000001},"last":1.627},{"interface":"front","average":{"1min":1.677,"5min":1.677,"15min":1.677},"min":{"1min":1.222,"5min":1.222,"15min":1.222},"max":{"1min":2.2989999999999999,"5min":2.2989999999999999,"15min":2.2989999999999999},"last":1.726}]},{"osd":7,"last update":"Sun Dec 17 11:49:08 2023","interfaces":[{"interface":"back","average":{"1min":1.847,"5min":1.847,"15min":1.847},"min":{"1min":1.2749999999999999,"5min":1.2749999999999999,"15min":1.2749999999999999},"max":{"1min":3.944,"5min":3.944,"15min":3.944},"last":1.5960000000000001},{"interface":"front","average":{"1min":1.8160000000000001,"5min":1.8160000000000001,"15min":1.8160000000000001},"min":{"1min":1.4239999999999999,"5min":1.4239999999999999,"15min":1.4239999999999999},"max":{"1min":2.8809999999999998,"5min":2.8809999999999998,"15min":2.8809999999999998},"last":1.6830000000000001}]}]},{"osd":3,"up_from":14,"seq":60129542170,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27508,"kb_used_data":488,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344332,"statfs":{"total":96636764160,"available":96608595968,"internally_reserved":0,"allocated":499712,"data_stored":211775,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 17 11:49:06 2023","interfaces":[{"interface":"back","average":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.6459999999999999,"5min":1.6459999999999999,"15min":1.6459999999999999},"last":0.77300000000000002},{"interface":"front","average":{"1min":1.0700000000000001,"5min":1.0700000000000001,"15min":1.0700000000000001},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":3.5800000000000001,"5min":3.5800000000000001,"15min":3.5800000000000001},"last":0.45600000000000002}]},{"osd":1,"last update":"Sun Dec 17 11:49:06 2023","interfaces":[{"interface":"back","average":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":1.4379999999999999,"5min":1.4379999999999999,"15min":1.4379999999999999},"last":0.70499999999999996},{"interface":"front","average":{"1min":1.1519999999999999,"5min":1.1519999999999999,"15min":1.1519999999999999},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":2.085,"5min":2.085,"15min":2.085},"last":0.93700000000000006}]},{"osd":2,"last update":"Sun Dec 17 11:49:06 2023","interfaces":[{"interface":"back","average":{"1min":1.1659999999999999,"5min":1.1659999999999999,"15min":1.1659999999999999},"min":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":1.651,"5min":1.651,"15min":1.651},"last":1.141},{"interface":"front","average":{"1min":1.2569999999999999,"5min":1.2569999999999999,"15min":1.2569999999999999},"min":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":2.1429999999999998,"5min":2.1429999999999998,"15min":2.1429999999999998},"last":0.873}]},{"osd":4,"last update":"Sun Dec 17 11:49:06 2023","interfaces":[{"interface":"back","average":{"1min":1.4330000000000001,"5min":1.4330000000000001,"15min":1.4330000000000001},"min":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"max":{"1min":2.4870000000000001,"5min":2.4870000000000001,"15min":2.4870000000000001},"last":0.68600000000000005},{"interface":"front","average":{"1min":1.476,"5min":1.476,"15min":1.476},"min":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"max":{"1min":2.3460000000000001,"5min":2.3460000000000001,"15min":2.3460000000000001},"last":0.98399999999999999}]},{"osd":5,"last update":"Sun Dec 17 11:49:06 2023","interfaces":[{"interface":"back","average":{"1min":1.476,"5min":1.476,"15min":1.476},"min":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"max":{"1min":2.5710000000000002,"5min":2.5710000000000002,"15min":2.5710000000000002},"last":1.319},{"interface":"front","average":{"1min":1.5,"5min":1.5,"15min":1.5},"min":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"max":{"1min":2.383,"5min":2.383,"15min":2.383},"last":0.85399999999999998}]},{"osd":6,"last update":"Sun Dec 17 11:49:06 2023","interfaces":[{"interface":"back","average":{"1min":1.474,"5min":1.474,"15min":1.474},"min":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"max":{"1min":2.6179999999999999,"5min":2.6179999999999999,"15min":2.6179999999999999},"last":1.1080000000000001},{"interface":"front","average":{"1min":1.5149999999999999,"5min":1.5149999999999999,"15min":1.5149999999999999},"min":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"max":{"1min":2.7679999999999998,"5min":2.7679999999999998,"15min":2.7679999999999998},"last":1.258}]},{"osd":7,"last update":"Sun Dec 17 11:49:06 2023","interfaces":[{"interface":"back","average":{"1min":1.581,"5min":1.581,"15min":1.581},"min":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"max":{"1min":3.7000000000000002,"5min":3.7000000000000002,"15min":3.7000000000000002},"last":1.054},{"interface":"front","average":{"1min":1.579,"5min":1.579,"15min":1.579},"min":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":0.97099999999999997},"max":{"1min":2.427,"5min":2.427,"15min":2.427},"last":1.177}]}]},{"osd":2,"up_from":14,"seq":60129542171,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27472,"kb_used_data":452,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344368,"statfs":{"total":96636764160,"available":96608632832,"internally_reserved":0,"allocated":462848,"data_stored":197646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 17 11:49:07 2023","interfaces":[{"interface":"back","average":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":1.724,"5min":1.724,"15min":1.724},"last":1.0369999999999999},{"interface":"front","average":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.502,"5min":1.502,"15min":1.502},"last":0.998}]},{"osd":1,"last update":"Sun Dec 17 11:49:07 2023","interfaces":[{"interface":"back","average":{"1min":0.995,"5min":0.995,"15min":0.995},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.4790000000000001,"5min":1.4790000000000001,"15min":1.4790000000000001},"last":1.5309999999999999},{"interface":"front","average":{"1min":1.056,"5min":1.056,"15min":1.056},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":2.6280000000000001,"5min":2.6280000000000001,"15min":2.6280000000000001},"last":0.83999999999999997}]},{"osd":3,"last update":"Sun Dec 17 11:49:07 2023","interfaces":[{"interface":"back","average":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.476,"5min":1.476,"15min":1.476},"last":0.753},{"interface":"front","average":{"1min":1.214,"5min":1.214,"15min":1.214},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.9670000000000001,"5min":1.9670000000000001,"15min":1.9670000000000001},"last":1.4450000000000001}]},{"osd":4,"last update":"Sun Dec 17 11:49:07 2023","interfaces":[{"interface":"back","average":{"1min":1.49,"5min":1.49,"15min":1.49},"min":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"max":{"1min":2.5750000000000002,"5min":2.5750000000000002,"15min":2.5750000000000002},"last":1.2070000000000001},{"interface":"front","average":{"1min":1.3879999999999999,"5min":1.3879999999999999,"15min":1.3879999999999999},"min":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"max":{"1min":2.4940000000000002,"5min":2.4940000000000002,"15min":2.4940000000000002},"last":1.391}]},{"osd":5,"last update":"Sun Dec 17 11:49:07 2023","interfaces":[{"interface":"back","average":{"1min":1.3240000000000001,"5min":1.3240000000000001,"15min":1.3240000000000001},"min":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"max":{"1min":2.4289999999999998,"5min":2.4289999999999998,"15min":2.4289999999999998},"last":1.343},{"interface":"front","average":{"1min":1.5489999999999999,"5min":1.5489999999999999,"15min":1.5489999999999999},"min":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"max":{"1min":2.694,"5min":2.694,"15min":2.694},"last":1.597}]},{"osd":6,"last update":"Sun Dec 17 11:49:07 2023","interfaces":[{"interface":"back","average":{"1min":1.472,"5min":1.472,"15min":1.472},"min":{"1min":0.748,"5min":0.748,"15min":0.748},"max":{"1min":2.7349999999999999,"5min":2.7349999999999999,"15min":2.7349999999999999},"last":1.1180000000000001},{"interface":"front","average":{"1min":1.4119999999999999,"5min":1.4119999999999999,"15min":1.4119999999999999},"min":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"max":{"1min":2.468,"5min":2.468,"15min":2.468},"last":1.4950000000000001}]},{"osd":7,"last update":"Sun Dec 17 11:49:07 2023","interfaces":[{"interface":"back","average":{"1min":1.554,"5min":1.554,"15min":1.554},"min":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"max":{"1min":3.379,"5min":3.379,"15min":3.379},"last":1.23},{"interface":"front","average":{"1min":1.474,"5min":1.474,"15min":1.474},"min":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"max":{"1min":2.2869999999999999,"5min":2.2869999999999999,"15min":2.2869999999999999},"last":1.571}]}]},{"osd":1,"up_from":14,"seq":60129542170,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27484,"kb_used_data":464,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344356,"statfs":{"total":96636764160,"available":96608620544,"internally_reserved":0,"allocated":475136,"data_stored":203953,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 17 11:49:08 2023","interfaces":[{"interface":"back","average":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.5249999999999999,"5min":1.5249999999999999,"15min":1.5249999999999999},"last":1.1020000000000001},{"interface":"front","average":{"1min":1.113,"5min":1.113,"15min":1.113},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":2.6360000000000001,"5min":2.6360000000000001,"15min":2.6360000000000001},"last":0.94399999999999995}]},{"osd":2,"last update":"Sun Dec 17 11:49:08 2023","interfaces":[{"interface":"back","average":{"1min":1.202,"5min":1.202,"15min":1.202},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":2.8159999999999998,"5min":2.8159999999999998,"15min":2.8159999999999998},"last":0.67300000000000004},{"interface":"front","average":{"1min":1.462,"5min":1.462,"15min":1.462},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":3.101,"5min":3.101,"15min":3.101},"last":1.6180000000000001}]},{"osd":3,"last update":"Sun Dec 17 11:49:08 2023","interfaces":[{"interface":"back","average":{"1min":1.48,"5min":1.48,"15min":1.48},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":2.7890000000000001,"5min":2.7890000000000001,"15min":2.7890000000000001},"last":1.736},{"interface":"front","average":{"1min":1.278,"5min":1.278,"15min":1.278},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":3.1400000000000001,"5min":3.1400000000000001,"15min":3.1400000000000001},"last":1.28}]},{"osd":4,"last update":"Sun Dec 17 11:49:08 2023","interfaces":[{"interface":"back","average":{"1min":1.4350000000000001,"5min":1.4350000000000001,"15min":1.4350000000000001},"min":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":2.5289999999999999,"5min":2.5289999999999999,"15min":2.5289999999999999},"last":1.5409999999999999},{"interface":"front","average":{"1min":1.363,"5min":1.363,"15min":1.363},"min":{"1min":0.627,"5min":0.627,"15min":0.627},"max":{"1min":2.0819999999999999,"5min":2.0819999999999999,"15min":2.0819999999999999},"last":1.383}]},{"osd":5,"last update":"Sun Dec 17 11:49:08 2023","interfaces":[{"interface":"back","average":{"1min":1.466,"5min":1.466,"15min":1.466},"min":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"max":{"1min":1.96,"5min":1.96,"15min":1.96},"last":1.522},{"interface":"front","average":{"1min":1.573,"5min":1.573,"15min":1.573},"min":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":2.6739999999999999,"5min":2.6739999999999999,"15min":2.6739999999999999},"last":1.8500000000000001}]},{"osd":6,"last update":"Sun Dec 17 11:49:08 2023","interfaces":[{"interface":"back","average":{"1min":1.627,"5min":1.627,"15min":1.627},"min":{"1min":0.754,"5min":0.754,"15min":0.754},"max":{"1min":3.016,"5min":3.016,"15min":3.016},"last":2.0179999999999998},{"interface":"front","average":{"1min":1.5509999999999999,"5min":1.5509999999999999,"15min":1.5509999999999999},"min":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"max":{"1min":2.508,"5min":2.508,"15min":2.508},"last":1.458}]},{"osd":7,"last update":"Sun Dec 17 11:49:08 2023","interfaces":[{"interface":"back","average":{"1min":1.6839999999999999,"5min":1.6839999999999999,"15min":1.6839999999999999},"min":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"max":{"1min":2.944,"5min":2.944,"15min":2.944},"last":1.964},{"interface":"front","average":{"1min":1.7170000000000001,"5min":1.7170000000000001,"15min":1.7170000000000001},"min":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"max":{"1min":2.7709999999999999,"5min":2.7709999999999999,"15min":2.7709999999999999},"last":1.7949999999999999}]}]},{"osd":0,"up_from":14,"seq":60129542170,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32224,"kb_used_data":1044,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339616,"statfs":{"total":96636764160,"available":96603766784,"internally_reserved":0,"allocated":1069056,"data_stored":794265,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Dec 17 11:49:06 2023","interfaces":[{"interface":"back","average":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.3899999999999999,"5min":1.3899999999999999,"15min":1.3899999999999999},"last":0.79900000000000004},{"interface":"front","average":{"1min":1.1519999999999999,"5min":1.1519999999999999,"15min":1.1519999999999999},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":1.958,"5min":1.958,"15min":1.958},"last":1.1359999999999999}]},{"osd":2,"last update":"Sun Dec 17 11:49:06 2023","interfaces":[{"interface":"back","average":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.7709999999999999,"5min":1.7709999999999999,"15min":1.7709999999999999},"last":1.081},{"interface":"front","average":{"1min":1.2090000000000001,"5min":1.2090000000000001,"15min":1.2090000000000001},"min":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":2.2130000000000001,"5min":2.2130000000000001,"15min":2.2130000000000001},"last":1.0309999999999999}]},{"osd":3,"last update":"Sun Dec 17 11:49:06 2023","interfaces":[{"interface":"back","average":{"1min":1.125,"5min":1.125,"15min":1.125},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.728,"5min":1.728,"15min":1.728},"last":1.383},{"interface":"front","average":{"1min":1.4039999999999999,"5min":1.4039999999999999,"15min":1.4039999999999999},"min":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"max":{"1min":2.4809999999999999,"5min":2.4809999999999999,"15min":2.4809999999999999},"last":1.3400000000000001}]},{"osd":4,"last update":"Sun Dec 17 11:49:06 2023","interfaces":[{"interface":"back","average":{"1min":1.518,"5min":1.518,"15min":1.518},"min":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"max":{"1min":4.6710000000000003,"5min":4.6710000000000003,"15min":4.6710000000000003},"last":1.47},{"interface":"front","average":{"1min":1.427,"5min":1.427,"15min":1.427},"min":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"max":{"1min":2.2799999999999998,"5min":2.2799999999999998,"15min":2.2799999999999998},"last":1.1990000000000001}]},{"osd":5,"last update":"Sun Dec 17 11:49:06 2023","interfaces":[{"interface":"back","average":{"1min":1.5069999999999999,"5min":1.5069999999999999,"15min":1.5069999999999999},"min":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"max":{"1min":2.1349999999999998,"5min":2.1349999999999998,"15min":2.1349999999999998},"last":1.661},{"interface":"front","average":{"1min":1.6240000000000001,"5min":1.6240000000000001,"15min":1.6240000000000001},"min":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"max":{"1min":2.6080000000000001,"5min":2.6080000000000001,"15min":2.6080000000000001},"last":1.522}]},{"osd":6,"last update":"Sun Dec 17 11:49:06 2023","interfaces":[{"interface":"back","average":{"1min":1.5800000000000001,"5min":1.5800000000000001,"15min":1.5800000000000001},"min":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"max":{"1min":2.702,"5min":2.702,"15min":2.702},"last":1.4199999999999999},{"interface":"front","average":{"1min":1.534,"5min":1.534,"15min":1.534},"min":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"max":{"1min":2.3100000000000001,"5min":2.3100000000000001,"15min":2.3100000000000001},"last":1.702}]},{"osd":7,"last update":"Sun Dec 17 11:49:06 2023","interfaces":[{"interface":"back","average":{"1min":1.611,"5min":1.611,"15min":1.611},"min":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"max":{"1min":2.3420000000000001,"5min":2.3420000000000001,"15min":2.3420000000000001},"last":1.7969999999999999},{"interface":"front","average":{"1min":1.577,"5min":1.577,"15min":1.577},"min":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"max":{"1min":2.4359999999999999,"5min":2.4359999999999999,"15min":2.4359999999999999},"last":1.5600000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-17T11:50:07.440 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T11:50:07.450 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T11:50:07.959 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-17T11:50:08.195 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:08.192+0000 7f23d8d43640 1 Processor -- start 2023-12-17T11:50:08.195 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:08.192+0000 7f23d8d43640 1 -- start start 2023-12-17T11:50:08.197 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:08.194+0000 7f23d8d43640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f23d415e5d0 0x7f23d406bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:50:08.197 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:08.194+0000 7f23d8d43640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f23d40ae200 0x7f23d4070b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:50:08.197 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:08.194+0000 7f23d8d43640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f23d406c330 0x7f23d4071090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:50:08.197 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:08.194+0000 7f23d8d43640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23d4071f90 con 0x7f23d406c330 2023-12-17T11:50:08.197 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:08.194+0000 7f23d8d43640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23d4072270 con 0x7f23d40ae200 2023-12-17T11:50:08.197 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:08.194+0000 7f23d8d43640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23d4070070 con 0x7f23d415e5d0 2023-12-17T11:50:08.198 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:08.194+0000 7f23d3fff640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f23d406c330 0x7f23d4071090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:50:08.198 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:08.194+0000 7f23d3fff640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f23d406c330 0x7f23d4071090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:40706/0 (socket says 172.21.15.40:40706) 2023-12-17T11:50:08.198 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:08.194+0000 7f23d3fff640 1 -- 172.21.15.40:0/2198036891 learned_addr learned my addr 172.21.15.40:0/2198036891 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-17T11:50:08.198 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:08.195+0000 7f23d3fff640 1 -- 172.21.15.40:0/2198036891 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f23d415e5d0 msgr2=0x7f23d406bdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:50:08.198 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:08.195+0000 7f23d3fff640 1 --2- 172.21.15.40:0/2198036891 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f23d415e5d0 0x7f23d406bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:50:08.198 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:08.195+0000 7f23d3fff640 1 -- 172.21.15.40:0/2198036891 >> v2:172.21.15.159:3300/0 conn(0x7f23d40ae200 msgr2=0x7f23d4070b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:50:08.198 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:08.195+0000 7f23d3fff640 1 --2- 172.21.15.40:0/2198036891 >> v2:172.21.15.159:3300/0 conn(0x7f23d40ae200 0x7f23d4070b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:50:08.198 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:08.195+0000 7f23d3fff640 1 -- 172.21.15.40:0/2198036891 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23d4070350 con 0x7f23d406c330 2023-12-17T11:50:08.199 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:08.196+0000 7f23d3fff640 1 --2- 172.21.15.40:0/2198036891 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f23d406c330 0x7f23d4071090 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f23d406bbb0 tx=0x7f23cc02b7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10c7e22da284fc84 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:50:08.199 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:08.196+0000 7f23d27fc640 1 -- 172.21.15.40:0/2198036891 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23cc031750 con 0x7f23d406c330 2023-12-17T11:50:08.199 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:08.196+0000 7f23d27fc640 1 -- 172.21.15.40:0/2198036891 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23cc0318b0 con 0x7f23d406c330 2023-12-17T11:50:08.200 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:08.196+0000 7f23d27fc640 1 -- 172.21.15.40:0/2198036891 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23cc031c40 con 0x7f23d406c330 2023-12-17T11:50:08.200 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:08.197+0000 7f23d8d43640 1 -- 172.21.15.40:0/2198036891 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f23d406c330 msgr2=0x7f23d4071090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:50:08.200 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:08.197+0000 7f23d8d43640 1 --2- 172.21.15.40:0/2198036891 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f23d406c330 0x7f23d4071090 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f23d406bbb0 tx=0x7f23cc02b7f0 comp rx=0 tx=0).stop 2023-12-17T11:50:08.200 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:08.197+0000 7f23d8d43640 1 -- 172.21.15.40:0/2198036891 shutdown_connections 2023-12-17T11:50:08.200 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:08.197+0000 7f23d8d43640 1 --2- 172.21.15.40:0/2198036891 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f23d406c330 0x7f23d4071090 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:50:08.200 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:08.197+0000 7f23d8d43640 1 --2- 172.21.15.40:0/2198036891 >> v2:172.21.15.159:3300/0 conn(0x7f23d40ae200 0x7f23d4070b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:50:08.200 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:08.197+0000 7f23d8d43640 1 --2- 172.21.15.40:0/2198036891 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f23d415e5d0 0x7f23d406bdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:50:08.201 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:08.197+0000 7f23d8d43640 1 -- 172.21.15.40:0/2198036891 >> 172.21.15.40:0/2198036891 conn(0x7f23d40b0860 msgr2=0x7f23d40b0c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:50:08.201 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:08.197+0000 7f23d8d43640 1 -- 172.21.15.40:0/2198036891 shutdown_connections 2023-12-17T11:50:08.201 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:08.197+0000 7f23d8d43640 1 -- 172.21.15.40:0/2198036891 wait complete. 2023-12-17T11:50:08.201 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:08.199+0000 7f23d8d43640 1 Processor -- start 2023-12-17T11:50:08.201 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:08.199+0000 7f23d8d43640 1 -- start start 2023-12-17T11:50:08.202 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:08.200+0000 7f23d8d43640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f23d406c330 0x7f23d414ebc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:50:08.203 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:08.200+0000 7f23d8d43640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f23d40ae200 0x7f23d409b310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:50:08.203 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:08.200+0000 7f23d8d43640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f23d415e5d0 0x7f23d409b850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:50:08.203 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:08.200+0000 7f23d8d43640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23d409a970 con 0x7f23d415e5d0 2023-12-17T11:50:08.203 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:08.200+0000 7f23d8d43640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23d414e860 con 0x7f23d40ae200 2023-12-17T11:50:08.203 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:08.200+0000 7f23d8d43640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23d4099d60 con 0x7f23d406c330 2023-12-17T11:50:08.203 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:08.201+0000 7f23d3fff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f23d415e5d0 0x7f23d409b850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:50:08.203 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:08.201+0000 7f23d3fff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f23d415e5d0 0x7f23d409b850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:40720/0 (socket says 172.21.15.40:40720) 2023-12-17T11:50:08.203 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:08.201+0000 7f23d3fff640 1 -- 172.21.15.40:0/4147621745 learned_addr learned my addr 172.21.15.40:0/4147621745 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-17T11:50:08.204 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:08.201+0000 7f23d2ffd640 1 --2- 172.21.15.40:0/4147621745 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f23d40ae200 0x7f23d409b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:50:08.205 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:08.201+0000 7f23d37fe640 1 --2- 172.21.15.40:0/4147621745 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f23d406c330 0x7f23d414ebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:50:08.205 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:08.201+0000 7f23d3fff640 1 -- 172.21.15.40:0/4147621745 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f23d406c330 msgr2=0x7f23d414ebc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:50:08.205 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:08.201+0000 7f23d3fff640 1 --2- 172.21.15.40:0/4147621745 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f23d406c330 0x7f23d414ebc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:50:08.205 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:08.201+0000 7f23d3fff640 1 -- 172.21.15.40:0/4147621745 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f23d40ae200 msgr2=0x7f23d409b310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:50:08.205 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:08.201+0000 7f23d3fff640 1 --2- 172.21.15.40:0/4147621745 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f23d40ae200 0x7f23d409b310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:50:08.205 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:08.201+0000 7f23d3fff640 1 -- 172.21.15.40:0/4147621745 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23cc0094d0 con 0x7f23d415e5d0 2023-12-17T11:50:08.205 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:08.201+0000 7f23d2ffd640 1 --2- 172.21.15.40:0/4147621745 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f23d40ae200 0x7f23d409b310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-17T11:50:08.205 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:08.201+0000 7f23d37fe640 1 --2- 172.21.15.40:0/4147621745 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f23d406c330 0x7f23d414ebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-17T11:50:08.205 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:08.201+0000 7f23d3fff640 1 --2- 172.21.15.40:0/4147621745 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f23d415e5d0 0x7f23d409b850 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f23cc02b830 tx=0x7f23cc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:50:08.205 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:08.202+0000 7f23cbfff640 1 -- 172.21.15.40:0/4147621745 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23cc033c80 con 0x7f23d415e5d0 2023-12-17T11:50:08.205 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:08.202+0000 7f23cbfff640 1 -- 172.21.15.40:0/4147621745 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23cc033de0 con 0x7f23d415e5d0 2023-12-17T11:50:08.206 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:08.202+0000 7f23cbfff640 1 -- 172.21.15.40:0/4147621745 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23cc03d6b0 con 0x7f23d415e5d0 2023-12-17T11:50:08.206 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:08.202+0000 7f23d8d43640 1 -- 172.21.15.40:0/4147621745 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23d409a040 con 0x7f23d415e5d0 2023-12-17T11:50:08.206 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:08.202+0000 7f23d8d43640 1 -- 172.21.15.40:0/4147621745 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23d409a600 con 0x7f23d415e5d0 2023-12-17T11:50:08.206 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:08.203+0000 7f23d8d43640 1 -- 172.21.15.40:0/4147621745 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23d409a790 con 0x7f23d415e5d0 2023-12-17T11:50:08.206 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:08.204+0000 7f23cbfff640 1 -- 172.21.15.40:0/4147621745 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f23cc03a040 con 0x7f23d415e5d0 2023-12-17T11:50:08.207 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:08.205+0000 7f23cbfff640 1 --2- 172.21.15.40:0/4147621745 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f23b406ae40 0x7f23b406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:50:08.207 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:08.205+0000 7f23cbfff640 1 -- 172.21.15.40:0/4147621745 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f23cc0ab910 con 0x7f23d415e5d0 2023-12-17T11:50:08.207 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:08.206+0000 7f23d37fe640 1 --2- 172.21.15.40:0/4147621745 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f23b406ae40 0x7f23b406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:50:08.208 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:08.207+0000 7f23d37fe640 1 --2- 172.21.15.40:0/4147621745 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f23b406ae40 0x7f23b406d300 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f23c4006fd0 tx=0x7f23c4008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:50:08.211 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:08.209+0000 7f23cbfff640 1 -- 172.21.15.40:0/4147621745 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f23cc0767c0 con 0x7f23d415e5d0 2023-12-17T11:50:08.408 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:08.405+0000 7f23d8d43640 1 -- 172.21.15.40:0/4147621745 --> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f23d4071c20 con 0x7f23b406ae40 2023-12-17T11:50:08.430 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:08.428+0000 7f23cbfff640 1 -- 172.21.15.40:0/4147621745 <== mgr.4105 v2:172.21.15.159:6832/479465803 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286549 (secure 0 0 0) 0x7f23c400ae20 con 0x7f23b406ae40 2023-12-17T11:50:08.435 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T11:50:08.436 INFO:teuthology.orchestra.run.smithi040.stderr:dumped all 2023-12-17T11:50:08.440 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:08.435+0000 7f23d8d43640 1 -- 172.21.15.40:0/4147621745 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f23b406ae40 msgr2=0x7f23b406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:50:08.441 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:08.435+0000 7f23d8d43640 1 --2- 172.21.15.40:0/4147621745 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f23b406ae40 0x7f23b406d300 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f23c4006fd0 tx=0x7f23c4008040 comp rx=0 tx=0).stop 2023-12-17T11:50:08.441 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:08.435+0000 7f23d8d43640 1 -- 172.21.15.40:0/4147621745 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f23d415e5d0 msgr2=0x7f23d409b850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:50:08.441 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:08.435+0000 7f23d8d43640 1 --2- 172.21.15.40:0/4147621745 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f23d415e5d0 0x7f23d409b850 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f23cc02b830 tx=0x7f23cc0046c0 comp rx=0 tx=0).stop 2023-12-17T11:50:08.441 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:08.435+0000 7f23d8d43640 1 -- 172.21.15.40:0/4147621745 shutdown_connections 2023-12-17T11:50:08.441 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:08.435+0000 7f23d8d43640 1 --2- 172.21.15.40:0/4147621745 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f23b406ae40 0x7f23b406d300 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:50:08.441 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:08.435+0000 7f23d8d43640 1 --2- 172.21.15.40:0/4147621745 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f23d415e5d0 0x7f23d409b850 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:50:08.441 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:08.435+0000 7f23d8d43640 1 --2- 172.21.15.40:0/4147621745 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f23d40ae200 0x7f23d409b310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:50:08.441 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:08.435+0000 7f23d8d43640 1 --2- 172.21.15.40:0/4147621745 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f23d406c330 0x7f23d414ebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:50:08.442 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:08.435+0000 7f23d8d43640 1 -- 172.21.15.40:0/4147621745 >> 172.21.15.40:0/4147621745 conn(0x7f23d40b0860 msgr2=0x7f23d4150550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:50:08.442 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:08.436+0000 7f23d8d43640 1 -- 172.21.15.40:0/4147621745 shutdown_connections 2023-12-17T11:50:08.442 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:08.436+0000 7f23d8d43640 1 -- 172.21.15.40:0/4147621745 wait complete. 2023-12-17T11:50:08.460 INFO:teuthology.orchestra.run.smithi040.stdout:{"pg_ready":true,"pg_map":{"version":95,"stamp":"2023-12-17T11:50:06.634789+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":225232,"kb_used_data":4904,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754749488,"statfs":{"total":773094113280,"available":772863475712,"internally_reserved":0,"allocated":5021696,"data_stored":2816418,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":225496626},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":17,"apply_latency_ms":17,"commit_latency_ns":17000000,"apply_latency_ns":17000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.003061"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-17T11:50:00.525487+0000","last_change":"2023-12-17T11:49:53.251801+0000","last_active":"2023-12-17T11:50:00.525487+0000","last_peered":"2023-12-17T11:50:00.525487+0000","last_clean":"2023-12-17T11:50:00.525487+0000","last_became_active":"2023-12-17T11:49:53.251221+0000","last_became_peered":"2023-12-17T11:49:53.251221+0000","last_unstale":"2023-12-17T11:50:00.525487+0000","last_undegraded":"2023-12-17T11:50:00.525487+0000","last_fullsized":"2023-12-17T11:50:00.525487+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T22:42:15.785143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-17T11:50:00.524627+0000","last_change":"2023-12-17T11:49:53.243478+0000","last_active":"2023-12-17T11:50:00.524627+0000","last_peered":"2023-12-17T11:50:00.524627+0000","last_clean":"2023-12-17T11:50:00.524627+0000","last_became_active":"2023-12-17T11:49:53.243179+0000","last_became_peered":"2023-12-17T11:49:53.243179+0000","last_unstale":"2023-12-17T11:50:00.524627+0000","last_undegraded":"2023-12-17T11:50:00.524627+0000","last_fullsized":"2023-12-17T11:50:00.524627+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T23:49:09.469993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:56.659373+0000","last_change":"2023-12-17T11:49:53.249501+0000","last_active":"2023-12-17T11:49:56.659373+0000","last_peered":"2023-12-17T11:49:56.659373+0000","last_clean":"2023-12-17T11:49:56.659373+0000","last_became_active":"2023-12-17T11:49:53.249212+0000","last_became_peered":"2023-12-17T11:49:53.249212+0000","last_unstale":"2023-12-17T11:49:56.659373+0000","last_undegraded":"2023-12-17T11:49:56.659373+0000","last_fullsized":"2023-12-17T11:49:56.659373+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T22:50:12.261960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:56.663625+0000","last_change":"2023-12-17T11:49:53.237486+0000","last_active":"2023-12-17T11:49:56.663625+0000","last_peered":"2023-12-17T11:49:56.663625+0000","last_clean":"2023-12-17T11:49:56.663625+0000","last_became_active":"2023-12-17T11:49:53.236766+0000","last_became_peered":"2023-12-17T11:49:53.236766+0000","last_unstale":"2023-12-17T11:49:56.663625+0000","last_undegraded":"2023-12-17T11:49:56.663625+0000","last_fullsized":"2023-12-17T11:49:56.663625+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T19:34:01.395947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:56.663570+0000","last_change":"2023-12-17T11:49:53.230175+0000","last_active":"2023-12-17T11:49:56.663570+0000","last_peered":"2023-12-17T11:49:56.663570+0000","last_clean":"2023-12-17T11:49:56.663570+0000","last_became_active":"2023-12-17T11:49:53.229756+0000","last_became_peered":"2023-12-17T11:49:53.229756+0000","last_unstale":"2023-12-17T11:49:56.663570+0000","last_undegraded":"2023-12-17T11:49:56.663570+0000","last_fullsized":"2023-12-17T11:49:56.663570+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T15:43:04.869288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:56.659967+0000","last_change":"2023-12-17T11:49:53.245040+0000","last_active":"2023-12-17T11:49:56.659967+0000","last_peered":"2023-12-17T11:49:56.659967+0000","last_clean":"2023-12-17T11:49:56.659967+0000","last_became_active":"2023-12-17T11:49:53.243989+0000","last_became_peered":"2023-12-17T11:49:53.243989+0000","last_unstale":"2023-12-17T11:49:56.659967+0000","last_undegraded":"2023-12-17T11:49:56.659967+0000","last_fullsized":"2023-12-17T11:49:56.659967+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T16:31:53.964205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:56.655609+0000","last_change":"2023-12-17T11:49:53.244506+0000","last_active":"2023-12-17T11:49:56.655609+0000","last_peered":"2023-12-17T11:49:56.655609+0000","last_clean":"2023-12-17T11:49:56.655609+0000","last_became_active":"2023-12-17T11:49:53.244244+0000","last_became_peered":"2023-12-17T11:49:53.244244+0000","last_unstale":"2023-12-17T11:49:56.655609+0000","last_undegraded":"2023-12-17T11:49:56.655609+0000","last_fullsized":"2023-12-17T11:49:56.655609+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T12:27:38.132749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-17T11:50:00.522397+0000","last_change":"2023-12-17T11:49:53.256713+0000","last_active":"2023-12-17T11:50:00.522397+0000","last_peered":"2023-12-17T11:50:00.522397+0000","last_clean":"2023-12-17T11:50:00.522397+0000","last_became_active":"2023-12-17T11:49:53.255850+0000","last_became_peered":"2023-12-17T11:49:53.255850+0000","last_unstale":"2023-12-17T11:50:00.522397+0000","last_undegraded":"2023-12-17T11:50:00.522397+0000","last_fullsized":"2023-12-17T11:50:00.522397+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T14:00:43.418107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:56.659436+0000","last_change":"2023-12-17T11:49:53.255007+0000","last_active":"2023-12-17T11:49:56.659436+0000","last_peered":"2023-12-17T11:49:56.659436+0000","last_clean":"2023-12-17T11:49:56.659436+0000","last_became_active":"2023-12-17T11:49:53.254750+0000","last_became_peered":"2023-12-17T11:49:53.254750+0000","last_unstale":"2023-12-17T11:49:56.659436+0000","last_undegraded":"2023-12-17T11:49:56.659436+0000","last_fullsized":"2023-12-17T11:49:56.659436+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T19:23:44.505187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:56.655871+0000","last_change":"2023-12-17T11:49:53.243885+0000","last_active":"2023-12-17T11:49:56.655871+0000","last_peered":"2023-12-17T11:49:56.655871+0000","last_clean":"2023-12-17T11:49:56.655871+0000","last_became_active":"2023-12-17T11:49:53.243586+0000","last_became_peered":"2023-12-17T11:49:53.243586+0000","last_unstale":"2023-12-17T11:49:56.655871+0000","last_undegraded":"2023-12-17T11:49:56.655871+0000","last_fullsized":"2023-12-17T11:49:56.655871+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T23:49:09.469993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:56.655817+0000","last_change":"2023-12-17T11:49:53.245071+0000","last_active":"2023-12-17T11:49:56.655817+0000","last_peered":"2023-12-17T11:49:56.655817+0000","last_clean":"2023-12-17T11:49:56.655817+0000","last_became_active":"2023-12-17T11:49:53.244696+0000","last_became_peered":"2023-12-17T11:49:53.244696+0000","last_unstale":"2023-12-17T11:49:56.655817+0000","last_undegraded":"2023-12-17T11:49:56.655817+0000","last_fullsized":"2023-12-17T11:49:56.655817+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T17:56:09.285369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:56.659352+0000","last_change":"2023-12-17T11:49:53.244437+0000","last_active":"2023-12-17T11:49:56.659352+0000","last_peered":"2023-12-17T11:49:56.659352+0000","last_clean":"2023-12-17T11:49:56.659352+0000","last_became_active":"2023-12-17T11:49:53.244158+0000","last_became_peered":"2023-12-17T11:49:53.244158+0000","last_unstale":"2023-12-17T11:49:56.659352+0000","last_undegraded":"2023-12-17T11:49:56.659352+0000","last_fullsized":"2023-12-17T11:49:56.659352+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T12:12:45.651530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:56.655738+0000","last_change":"2023-12-17T11:49:53.259954+0000","last_active":"2023-12-17T11:49:56.655738+0000","last_peered":"2023-12-17T11:49:56.655738+0000","last_clean":"2023-12-17T11:49:56.655738+0000","last_became_active":"2023-12-17T11:49:53.259683+0000","last_became_peered":"2023-12-17T11:49:53.259683+0000","last_unstale":"2023-12-17T11:49:56.655738+0000","last_undegraded":"2023-12-17T11:49:56.655738+0000","last_fullsized":"2023-12-17T11:49:56.655738+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T13:29:29.953615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-17T11:50:00.522506+0000","last_change":"2023-12-17T11:49:53.251388+0000","last_active":"2023-12-17T11:50:00.522506+0000","last_peered":"2023-12-17T11:50:00.522506+0000","last_clean":"2023-12-17T11:50:00.522506+0000","last_became_active":"2023-12-17T11:49:53.251182+0000","last_became_peered":"2023-12-17T11:49:53.251182+0000","last_unstale":"2023-12-17T11:50:00.522506+0000","last_undegraded":"2023-12-17T11:50:00.522506+0000","last_fullsized":"2023-12-17T11:50:00.522506+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T19:39:18.340154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:56.655643+0000","last_change":"2023-12-17T11:49:53.251484+0000","last_active":"2023-12-17T11:49:56.655643+0000","last_peered":"2023-12-17T11:49:56.655643+0000","last_clean":"2023-12-17T11:49:56.655643+0000","last_became_active":"2023-12-17T11:49:53.250825+0000","last_became_peered":"2023-12-17T11:49:53.250825+0000","last_unstale":"2023-12-17T11:49:56.655643+0000","last_undegraded":"2023-12-17T11:49:56.655643+0000","last_fullsized":"2023-12-17T11:49:56.655643+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T12:48:09.865175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:55.795131+0000","last_change":"2023-12-17T11:49:53.256736+0000","last_active":"2023-12-17T11:49:55.795131+0000","last_peered":"2023-12-17T11:49:55.795131+0000","last_clean":"2023-12-17T11:49:55.795131+0000","last_became_active":"2023-12-17T11:49:53.256319+0000","last_became_peered":"2023-12-17T11:49:53.256319+0000","last_unstale":"2023-12-17T11:49:55.795131+0000","last_undegraded":"2023-12-17T11:49:55.795131+0000","last_fullsized":"2023-12-17T11:49:55.795131+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T14:49:05.628056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:55.795758+0000","last_change":"2023-12-17T11:49:53.254466+0000","last_active":"2023-12-17T11:49:55.795758+0000","last_peered":"2023-12-17T11:49:55.795758+0000","last_clean":"2023-12-17T11:49:55.795758+0000","last_became_active":"2023-12-17T11:49:53.254191+0000","last_became_peered":"2023-12-17T11:49:53.254191+0000","last_unstale":"2023-12-17T11:49:55.795758+0000","last_undegraded":"2023-12-17T11:49:55.795758+0000","last_fullsized":"2023-12-17T11:49:55.795758+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T15:34:59.184998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-17T11:50:01.202677+0000","last_change":"2023-12-17T11:49:53.244371+0000","last_active":"2023-12-17T11:50:01.202677+0000","last_peered":"2023-12-17T11:50:01.202677+0000","last_clean":"2023-12-17T11:50:01.202677+0000","last_became_active":"2023-12-17T11:49:53.243288+0000","last_became_peered":"2023-12-17T11:49:53.243288+0000","last_unstale":"2023-12-17T11:50:01.202677+0000","last_undegraded":"2023-12-17T11:50:01.202677+0000","last_fullsized":"2023-12-17T11:50:01.202677+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T22:59:01.401999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:56.663668+0000","last_change":"2023-12-17T11:49:53.247133+0000","last_active":"2023-12-17T11:49:56.663668+0000","last_peered":"2023-12-17T11:49:56.663668+0000","last_clean":"2023-12-17T11:49:56.663668+0000","last_became_active":"2023-12-17T11:49:53.246863+0000","last_became_peered":"2023-12-17T11:49:53.246863+0000","last_unstale":"2023-12-17T11:49:56.663668+0000","last_undegraded":"2023-12-17T11:49:56.663668+0000","last_fullsized":"2023-12-17T11:49:56.663668+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T15:22:56.669665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-17T11:50:01.202405+0000","last_change":"2023-12-17T11:49:53.234246+0000","last_active":"2023-12-17T11:50:01.202405+0000","last_peered":"2023-12-17T11:50:01.202405+0000","last_clean":"2023-12-17T11:50:01.202405+0000","last_became_active":"2023-12-17T11:49:53.233971+0000","last_became_peered":"2023-12-17T11:49:53.233971+0000","last_unstale":"2023-12-17T11:50:01.202405+0000","last_undegraded":"2023-12-17T11:50:01.202405+0000","last_fullsized":"2023-12-17T11:50:01.202405+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T21:22:15.324114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:56.655760+0000","last_change":"2023-12-17T11:49:53.254631+0000","last_active":"2023-12-17T11:49:56.655760+0000","last_peered":"2023-12-17T11:49:56.655760+0000","last_clean":"2023-12-17T11:49:56.655760+0000","last_became_active":"2023-12-17T11:49:53.254246+0000","last_became_peered":"2023-12-17T11:49:53.254246+0000","last_unstale":"2023-12-17T11:49:56.655760+0000","last_undegraded":"2023-12-17T11:49:56.655760+0000","last_fullsized":"2023-12-17T11:49:56.655760+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T15:42:47.132551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-17T11:50:00.523985+0000","last_change":"2023-12-17T11:49:53.233281+0000","last_active":"2023-12-17T11:50:00.523985+0000","last_peered":"2023-12-17T11:50:00.523985+0000","last_clean":"2023-12-17T11:50:00.523985+0000","last_became_active":"2023-12-17T11:49:53.233006+0000","last_became_peered":"2023-12-17T11:49:53.233006+0000","last_unstale":"2023-12-17T11:50:00.523985+0000","last_undegraded":"2023-12-17T11:50:00.523985+0000","last_fullsized":"2023-12-17T11:50:00.523985+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T17:37:46.058341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:55.795311+0000","last_change":"2023-12-17T11:49:53.235006+0000","last_active":"2023-12-17T11:49:55.795311+0000","last_peered":"2023-12-17T11:49:55.795311+0000","last_clean":"2023-12-17T11:49:55.795311+0000","last_became_active":"2023-12-17T11:49:53.232828+0000","last_became_peered":"2023-12-17T11:49:53.232828+0000","last_unstale":"2023-12-17T11:49:55.795311+0000","last_undegraded":"2023-12-17T11:49:55.795311+0000","last_fullsized":"2023-12-17T11:49:55.795311+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T21:34:46.442330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:56.663503+0000","last_change":"2023-12-17T11:49:53.229937+0000","last_active":"2023-12-17T11:49:56.663503+0000","last_peered":"2023-12-17T11:49:56.663503+0000","last_clean":"2023-12-17T11:49:56.663503+0000","last_became_active":"2023-12-17T11:49:53.229360+0000","last_became_peered":"2023-12-17T11:49:53.229360+0000","last_unstale":"2023-12-17T11:49:56.663503+0000","last_undegraded":"2023-12-17T11:49:56.663503+0000","last_fullsized":"2023-12-17T11:49:56.663503+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T13:22:57.464897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-17T11:50:01.202634+0000","last_change":"2023-12-17T11:49:53.248140+0000","last_active":"2023-12-17T11:50:01.202634+0000","last_peered":"2023-12-17T11:50:01.202634+0000","last_clean":"2023-12-17T11:50:01.202634+0000","last_became_active":"2023-12-17T11:49:53.246139+0000","last_became_peered":"2023-12-17T11:49:53.246139+0000","last_unstale":"2023-12-17T11:50:01.202634+0000","last_undegraded":"2023-12-17T11:50:01.202634+0000","last_fullsized":"2023-12-17T11:50:01.202634+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T14:32:00.462222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:56.660141+0000","last_change":"2023-12-17T11:49:53.255892+0000","last_active":"2023-12-17T11:49:56.660141+0000","last_peered":"2023-12-17T11:49:56.660141+0000","last_clean":"2023-12-17T11:49:56.660141+0000","last_became_active":"2023-12-17T11:49:53.255307+0000","last_became_peered":"2023-12-17T11:49:53.255307+0000","last_unstale":"2023-12-17T11:49:56.660141+0000","last_undegraded":"2023-12-17T11:49:56.660141+0000","last_fullsized":"2023-12-17T11:49:56.660141+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T17:37:46.058341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-17T11:50:01.202692+0000","last_change":"2023-12-17T11:49:53.238527+0000","last_active":"2023-12-17T11:50:01.202692+0000","last_peered":"2023-12-17T11:50:01.202692+0000","last_clean":"2023-12-17T11:50:01.202692+0000","last_became_active":"2023-12-17T11:49:53.238260+0000","last_became_peered":"2023-12-17T11:49:53.238260+0000","last_unstale":"2023-12-17T11:50:01.202692+0000","last_undegraded":"2023-12-17T11:50:01.202692+0000","last_fullsized":"2023-12-17T11:50:01.202692+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T14:03:14.332356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:56.655796+0000","last_change":"2023-12-17T11:49:53.247243+0000","last_active":"2023-12-17T11:49:56.655796+0000","last_peered":"2023-12-17T11:49:56.655796+0000","last_clean":"2023-12-17T11:49:56.655796+0000","last_became_active":"2023-12-17T11:49:53.246983+0000","last_became_peered":"2023-12-17T11:49:53.246983+0000","last_unstale":"2023-12-17T11:49:56.655796+0000","last_undegraded":"2023-12-17T11:49:56.655796+0000","last_fullsized":"2023-12-17T11:49:56.655796+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T23:33:06.562683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-17T11:50:01.202387+0000","last_change":"2023-12-17T11:49:53.247287+0000","last_active":"2023-12-17T11:50:01.202387+0000","last_peered":"2023-12-17T11:50:01.202387+0000","last_clean":"2023-12-17T11:50:01.202387+0000","last_became_active":"2023-12-17T11:49:53.246995+0000","last_became_peered":"2023-12-17T11:49:53.246995+0000","last_unstale":"2023-12-17T11:50:01.202387+0000","last_undegraded":"2023-12-17T11:50:01.202387+0000","last_fullsized":"2023-12-17T11:50:01.202387+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T14:03:09.358474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-17T11:50:01.202183+0000","last_change":"2023-12-17T11:49:53.240901+0000","last_active":"2023-12-17T11:50:01.202183+0000","last_peered":"2023-12-17T11:50:01.202183+0000","last_clean":"2023-12-17T11:50:01.202183+0000","last_became_active":"2023-12-17T11:49:53.240589+0000","last_became_peered":"2023-12-17T11:49:53.240589+0000","last_unstale":"2023-12-17T11:50:01.202183+0000","last_undegraded":"2023-12-17T11:50:01.202183+0000","last_fullsized":"2023-12-17T11:50:01.202183+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T19:17:47.294209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:55.795352+0000","last_change":"2023-12-17T11:49:53.239855+0000","last_active":"2023-12-17T11:49:55.795352+0000","last_peered":"2023-12-17T11:49:55.795352+0000","last_clean":"2023-12-17T11:49:55.795352+0000","last_became_active":"2023-12-17T11:49:53.239579+0000","last_became_peered":"2023-12-17T11:49:53.239579+0000","last_unstale":"2023-12-17T11:49:55.795352+0000","last_undegraded":"2023-12-17T11:49:55.795352+0000","last_fullsized":"2023-12-17T11:49:55.795352+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T20:29:09.996550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:56.659898+0000","last_change":"2023-12-17T11:49:53.252543+0000","last_active":"2023-12-17T11:49:56.659898+0000","last_peered":"2023-12-17T11:49:56.659898+0000","last_clean":"2023-12-17T11:49:56.659898+0000","last_became_active":"2023-12-17T11:49:53.250790+0000","last_became_peered":"2023-12-17T11:49:53.250790+0000","last_unstale":"2023-12-17T11:49:56.659898+0000","last_undegraded":"2023-12-17T11:49:56.659898+0000","last_fullsized":"2023-12-17T11:49:56.659898+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T19:00:07.905809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:55.795567+0000","last_change":"2023-12-17T11:49:53.245226+0000","last_active":"2023-12-17T11:49:55.795567+0000","last_peered":"2023-12-17T11:49:55.795567+0000","last_clean":"2023-12-17T11:49:55.795567+0000","last_became_active":"2023-12-17T11:49:53.243115+0000","last_became_peered":"2023-12-17T11:49:53.243115+0000","last_unstale":"2023-12-17T11:49:55.795567+0000","last_undegraded":"2023-12-17T11:49:55.795567+0000","last_fullsized":"2023-12-17T11:49:55.795567+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T15:06:34.831619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"39'4","reported_seq":18,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-17T11:50:01.202725+0000","last_change":"2023-12-17T11:49:52.226944+0000","last_active":"2023-12-17T11:50:01.202725+0000","last_peered":"2023-12-17T11:50:01.202725+0000","last_clean":"2023-12-17T11:50:01.202725+0000","last_became_active":"2023-12-17T11:49:52.226659+0000","last_became_peered":"2023-12-17T11:49:52.226659+0000","last_unstale":"2023-12-17T11:50:01.202725+0000","last_undegraded":"2023-12-17T11:50:01.202725+0000","last_fullsized":"2023-12-17T11:50:01.202725+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_clean_scrub_stamp":"2023-12-17T11:49:51.168108+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T13:22:56.453467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:56.660037+0000","last_change":"2023-12-17T11:49:53.254791+0000","last_active":"2023-12-17T11:49:56.660037+0000","last_peered":"2023-12-17T11:49:56.660037+0000","last_clean":"2023-12-17T11:49:56.660037+0000","last_became_active":"2023-12-17T11:49:53.254496+0000","last_became_peered":"2023-12-17T11:49:53.254496+0000","last_unstale":"2023-12-17T11:49:56.660037+0000","last_undegraded":"2023-12-17T11:49:56.660037+0000","last_fullsized":"2023-12-17T11:49:56.660037+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T14:42:29.543380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"39'1","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:55.302292+0000","last_change":"2023-12-17T11:49:52.223256+0000","last_active":"2023-12-17T11:49:55.302292+0000","last_peered":"2023-12-17T11:49:55.302292+0000","last_clean":"2023-12-17T11:49:55.302292+0000","last_became_active":"2023-12-17T11:49:52.222808+0000","last_became_peered":"2023-12-17T11:49:52.222808+0000","last_unstale":"2023-12-17T11:49:55.302292+0000","last_undegraded":"2023-12-17T11:49:55.302292+0000","last_fullsized":"2023-12-17T11:49:55.302292+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_clean_scrub_stamp":"2023-12-17T11:49:51.168108+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T16:31:52.952775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-17T11:50:00.523143+0000","last_change":"2023-12-17T11:49:53.251178+0000","last_active":"2023-12-17T11:50:00.523143+0000","last_peered":"2023-12-17T11:50:00.523143+0000","last_clean":"2023-12-17T11:50:00.523143+0000","last_became_active":"2023-12-17T11:49:53.250223+0000","last_became_peered":"2023-12-17T11:49:53.250223+0000","last_unstale":"2023-12-17T11:50:00.523143+0000","last_undegraded":"2023-12-17T11:50:00.523143+0000","last_fullsized":"2023-12-17T11:50:00.523143+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T23:10:56.100255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"39'2","reported_seq":15,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:54.557626+0000","last_change":"2023-12-17T11:49:52.223879+0000","last_active":"2023-12-17T11:49:54.557626+0000","last_peered":"2023-12-17T11:49:54.557626+0000","last_clean":"2023-12-17T11:49:54.557626+0000","last_became_active":"2023-12-17T11:49:52.223602+0000","last_became_peered":"2023-12-17T11:49:52.223602+0000","last_unstale":"2023-12-17T11:49:54.557626+0000","last_undegraded":"2023-12-17T11:49:54.557626+0000","last_fullsized":"2023-12-17T11:49:54.557626+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_clean_scrub_stamp":"2023-12-17T11:49:51.168108+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T15:25:46.493177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-17T11:50:00.525262+0000","last_change":"2023-12-17T11:49:53.254646+0000","last_active":"2023-12-17T11:50:00.525262+0000","last_peered":"2023-12-17T11:50:00.525262+0000","last_clean":"2023-12-17T11:50:00.525262+0000","last_became_active":"2023-12-17T11:49:53.254368+0000","last_became_peered":"2023-12-17T11:49:53.254368+0000","last_unstale":"2023-12-17T11:50:00.525262+0000","last_undegraded":"2023-12-17T11:50:00.525262+0000","last_fullsized":"2023-12-17T11:50:00.525262+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T15:42:47.132551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"39'2","reported_seq":16,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-17T11:50:00.523260+0000","last_change":"2023-12-17T11:49:52.221006+0000","last_active":"2023-12-17T11:50:00.523260+0000","last_peered":"2023-12-17T11:50:00.523260+0000","last_clean":"2023-12-17T11:50:00.523260+0000","last_became_active":"2023-12-17T11:49:52.220514+0000","last_became_peered":"2023-12-17T11:49:52.220514+0000","last_unstale":"2023-12-17T11:50:00.523260+0000","last_undegraded":"2023-12-17T11:50:00.523260+0000","last_fullsized":"2023-12-17T11:50:00.523260+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_clean_scrub_stamp":"2023-12-17T11:49:51.168108+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T15:25:46.493177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:56.659192+0000","last_change":"2023-12-17T11:49:53.251737+0000","last_active":"2023-12-17T11:49:56.659192+0000","last_peered":"2023-12-17T11:49:56.659192+0000","last_clean":"2023-12-17T11:49:56.659192+0000","last_became_active":"2023-12-17T11:49:53.251458+0000","last_became_peered":"2023-12-17T11:49:53.251458+0000","last_unstale":"2023-12-17T11:49:56.659192+0000","last_undegraded":"2023-12-17T11:49:56.659192+0000","last_fullsized":"2023-12-17T11:49:56.659192+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T17:37:46.058341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"39'1","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:55.304169+0000","last_change":"2023-12-17T11:49:52.226918+0000","last_active":"2023-12-17T11:49:55.304169+0000","last_peered":"2023-12-17T11:49:55.304169+0000","last_clean":"2023-12-17T11:49:55.304169+0000","last_became_active":"2023-12-17T11:49:52.226455+0000","last_became_peered":"2023-12-17T11:49:52.226455+0000","last_unstale":"2023-12-17T11:49:55.304169+0000","last_undegraded":"2023-12-17T11:49:55.304169+0000","last_fullsized":"2023-12-17T11:49:55.304169+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_clean_scrub_stamp":"2023-12-17T11:49:51.168108+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T12:12:44.640100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:56.655694+0000","last_change":"2023-12-17T11:49:53.251691+0000","last_active":"2023-12-17T11:49:56.655694+0000","last_peered":"2023-12-17T11:49:56.655694+0000","last_clean":"2023-12-17T11:49:56.655694+0000","last_became_active":"2023-12-17T11:49:53.251175+0000","last_became_peered":"2023-12-17T11:49:53.251175+0000","last_unstale":"2023-12-17T11:49:56.655694+0000","last_undegraded":"2023-12-17T11:49:56.655694+0000","last_fullsized":"2023-12-17T11:49:56.655694+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T14:00:43.418107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"39'1","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:55.795479+0000","last_change":"2023-12-17T11:49:52.225053+0000","last_active":"2023-12-17T11:49:55.795479+0000","last_peered":"2023-12-17T11:49:55.795479+0000","last_clean":"2023-12-17T11:49:55.795479+0000","last_became_active":"2023-12-17T11:49:52.224761+0000","last_became_peered":"2023-12-17T11:49:52.224761+0000","last_unstale":"2023-12-17T11:49:55.795479+0000","last_undegraded":"2023-12-17T11:49:55.795479+0000","last_fullsized":"2023-12-17T11:49:55.795479+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_clean_scrub_stamp":"2023-12-17T11:49:51.168108+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T20:30:07.106128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":14,"reported_epoch":42,"state":"activating","last_fresh":"2023-12-17T11:50:01.545212+0000","last_change":"2023-12-17T11:50:01.545825+0000","last_active":"2023-12-17T11:50:00.523935+0000","last_peered":"2023-12-17T11:49:56.657918+0000","last_clean":"2023-12-17T11:49:56.657918+0000","last_became_active":"2023-12-17T11:49:53.254841+0000","last_became_peered":"2023-12-17T11:49:53.254841+0000","last_unstale":"2023-12-17T11:50:01.545212+0000","last_undegraded":"2023-12-17T11:50:01.545212+0000","last_fullsized":"2023-12-17T11:50:01.545212+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T19:23:44.505187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":["4","0","5"],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:54.556572+0000","last_change":"2023-12-17T11:49:52.230598+0000","last_active":"2023-12-17T11:49:54.556572+0000","last_peered":"2023-12-17T11:49:54.556572+0000","last_clean":"2023-12-17T11:49:54.556572+0000","last_became_active":"2023-12-17T11:49:52.230298+0000","last_became_peered":"2023-12-17T11:49:52.230298+0000","last_unstale":"2023-12-17T11:49:54.556572+0000","last_undegraded":"2023-12-17T11:49:54.556572+0000","last_fullsized":"2023-12-17T11:49:54.556572+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_clean_scrub_stamp":"2023-12-17T11:49:51.168108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T22:39:30.094160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-17T11:50:00.523881+0000","last_change":"2023-12-17T11:49:53.249431+0000","last_active":"2023-12-17T11:50:00.523881+0000","last_peered":"2023-12-17T11:50:00.523881+0000","last_clean":"2023-12-17T11:50:00.523881+0000","last_became_active":"2023-12-17T11:49:53.248943+0000","last_became_peered":"2023-12-17T11:49:53.248943+0000","last_unstale":"2023-12-17T11:50:00.523881+0000","last_undegraded":"2023-12-17T11:50:00.523881+0000","last_fullsized":"2023-12-17T11:50:00.523881+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T16:21:14.355302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-17T11:50:00.522481+0000","last_change":"2023-12-17T11:49:52.224198+0000","last_active":"2023-12-17T11:50:00.522481+0000","last_peered":"2023-12-17T11:50:00.522481+0000","last_clean":"2023-12-17T11:50:00.522481+0000","last_became_active":"2023-12-17T11:49:52.223829+0000","last_became_peered":"2023-12-17T11:49:52.223829+0000","last_unstale":"2023-12-17T11:50:00.522481+0000","last_undegraded":"2023-12-17T11:50:00.522481+0000","last_fullsized":"2023-12-17T11:50:00.522481+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_clean_scrub_stamp":"2023-12-17T11:49:51.168108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T13:20:29.045455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:56.663647+0000","last_change":"2023-12-17T11:49:53.232883+0000","last_active":"2023-12-17T11:49:56.663647+0000","last_peered":"2023-12-17T11:49:56.663647+0000","last_clean":"2023-12-17T11:49:56.663647+0000","last_became_active":"2023-12-17T11:49:53.232629+0000","last_became_peered":"2023-12-17T11:49:53.232629+0000","last_unstale":"2023-12-17T11:49:56.663647+0000","last_undegraded":"2023-12-17T11:49:56.663647+0000","last_fullsized":"2023-12-17T11:49:56.663647+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T18:07:10.105462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-17T11:50:00.525489+0000","last_change":"2023-12-17T11:49:52.215890+0000","last_active":"2023-12-17T11:50:00.525489+0000","last_peered":"2023-12-17T11:50:00.525489+0000","last_clean":"2023-12-17T11:50:00.525489+0000","last_became_active":"2023-12-17T11:49:52.215576+0000","last_became_peered":"2023-12-17T11:49:52.215576+0000","last_unstale":"2023-12-17T11:50:00.525489+0000","last_undegraded":"2023-12-17T11:50:00.525489+0000","last_fullsized":"2023-12-17T11:50:00.525489+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_clean_scrub_stamp":"2023-12-17T11:49:51.168108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T17:03:59.637357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:55.795673+0000","last_change":"2023-12-17T11:49:53.236661+0000","last_active":"2023-12-17T11:49:55.795673+0000","last_peered":"2023-12-17T11:49:55.795673+0000","last_clean":"2023-12-17T11:49:55.795673+0000","last_became_active":"2023-12-17T11:49:53.236319+0000","last_became_peered":"2023-12-17T11:49:53.236319+0000","last_unstale":"2023-12-17T11:49:55.795673+0000","last_undegraded":"2023-12-17T11:49:55.795673+0000","last_fullsized":"2023-12-17T11:49:55.795673+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T13:29:01.309715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:55.305000+0000","last_change":"2023-12-17T11:49:52.233070+0000","last_active":"2023-12-17T11:49:55.305000+0000","last_peered":"2023-12-17T11:49:55.305000+0000","last_clean":"2023-12-17T11:49:55.305000+0000","last_became_active":"2023-12-17T11:49:52.232635+0000","last_became_peered":"2023-12-17T11:49:52.232635+0000","last_unstale":"2023-12-17T11:49:55.305000+0000","last_undegraded":"2023-12-17T11:49:55.305000+0000","last_fullsized":"2023-12-17T11:49:55.305000+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_clean_scrub_stamp":"2023-12-17T11:49:51.168108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T15:53:07.030004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:56.659403+0000","last_change":"2023-12-17T11:49:53.246755+0000","last_active":"2023-12-17T11:49:56.659403+0000","last_peered":"2023-12-17T11:49:56.659403+0000","last_clean":"2023-12-17T11:49:56.659403+0000","last_became_active":"2023-12-17T11:49:53.245111+0000","last_became_peered":"2023-12-17T11:49:53.245111+0000","last_unstale":"2023-12-17T11:49:56.659403+0000","last_undegraded":"2023-12-17T11:49:56.659403+0000","last_fullsized":"2023-12-17T11:49:56.659403+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T14:59:11.557660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"39'3","reported_seq":16,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:55.304936+0000","last_change":"2023-12-17T11:49:52.231475+0000","last_active":"2023-12-17T11:49:55.304936+0000","last_peered":"2023-12-17T11:49:55.304936+0000","last_clean":"2023-12-17T11:49:55.304936+0000","last_became_active":"2023-12-17T11:49:52.230061+0000","last_became_peered":"2023-12-17T11:49:52.230061+0000","last_unstale":"2023-12-17T11:49:55.304936+0000","last_undegraded":"2023-12-17T11:49:55.304936+0000","last_fullsized":"2023-12-17T11:49:55.304936+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_clean_scrub_stamp":"2023-12-17T11:49:51.168108+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T22:50:11.250530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-17T11:50:00.523324+0000","last_change":"2023-12-17T11:49:53.232224+0000","last_active":"2023-12-17T11:50:00.523324+0000","last_peered":"2023-12-17T11:50:00.523324+0000","last_clean":"2023-12-17T11:50:00.523324+0000","last_became_active":"2023-12-17T11:49:53.231963+0000","last_became_peered":"2023-12-17T11:49:53.231963+0000","last_unstale":"2023-12-17T11:50:00.523324+0000","last_undegraded":"2023-12-17T11:50:00.523324+0000","last_fullsized":"2023-12-17T11:50:00.523324+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T15:14:36.959400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"39'6","reported_seq":20,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-17T11:50:00.524725+0000","last_change":"2023-12-17T11:49:52.220583+0000","last_active":"2023-12-17T11:50:00.524725+0000","last_peered":"2023-12-17T11:50:00.524725+0000","last_clean":"2023-12-17T11:50:00.524725+0000","last_became_active":"2023-12-17T11:49:52.220304+0000","last_became_peered":"2023-12-17T11:49:52.220304+0000","last_unstale":"2023-12-17T11:50:00.524725+0000","last_undegraded":"2023-12-17T11:50:00.524725+0000","last_fullsized":"2023-12-17T11:50:00.524725+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_clean_scrub_stamp":"2023-12-17T11:49:51.168108+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T12:27:37.121319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:56.659257+0000","last_change":"2023-12-17T11:49:53.248442+0000","last_active":"2023-12-17T11:49:56.659257+0000","last_peered":"2023-12-17T11:49:56.659257+0000","last_clean":"2023-12-17T11:49:56.659257+0000","last_became_active":"2023-12-17T11:49:53.248094+0000","last_became_peered":"2023-12-17T11:49:53.248094+0000","last_unstale":"2023-12-17T11:49:56.659257+0000","last_undegraded":"2023-12-17T11:49:56.659257+0000","last_fullsized":"2023-12-17T11:49:56.659257+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T14:42:29.543380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"39'2","reported_seq":16,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-17T11:50:00.524311+0000","last_change":"2023-12-17T11:49:52.213341+0000","last_active":"2023-12-17T11:50:00.524311+0000","last_peered":"2023-12-17T11:50:00.524311+0000","last_clean":"2023-12-17T11:50:00.524311+0000","last_became_active":"2023-12-17T11:49:52.213024+0000","last_became_peered":"2023-12-17T11:49:52.213024+0000","last_unstale":"2023-12-17T11:50:00.524311+0000","last_undegraded":"2023-12-17T11:50:00.524311+0000","last_fullsized":"2023-12-17T11:50:00.524311+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_clean_scrub_stamp":"2023-12-17T11:49:51.168108+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T20:34:24.431589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-17T11:50:00.522731+0000","last_change":"2023-12-17T11:49:53.238931+0000","last_active":"2023-12-17T11:50:00.522731+0000","last_peered":"2023-12-17T11:50:00.522731+0000","last_clean":"2023-12-17T11:50:00.522731+0000","last_became_active":"2023-12-17T11:49:53.238641+0000","last_became_peered":"2023-12-17T11:49:53.238641+0000","last_unstale":"2023-12-17T11:50:00.522731+0000","last_undegraded":"2023-12-17T11:50:00.522731+0000","last_fullsized":"2023-12-17T11:50:00.522731+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T13:29:29.953615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:54.556680+0000","last_change":"2023-12-17T11:49:52.232507+0000","last_active":"2023-12-17T11:49:54.556680+0000","last_peered":"2023-12-17T11:49:54.556680+0000","last_clean":"2023-12-17T11:49:54.556680+0000","last_became_active":"2023-12-17T11:49:52.232308+0000","last_became_peered":"2023-12-17T11:49:52.232308+0000","last_unstale":"2023-12-17T11:49:54.556680+0000","last_undegraded":"2023-12-17T11:49:54.556680+0000","last_fullsized":"2023-12-17T11:49:54.556680+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_clean_scrub_stamp":"2023-12-17T11:49:51.168108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T19:17:46.282779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:55.795434+0000","last_change":"2023-12-17T11:49:53.234701+0000","last_active":"2023-12-17T11:49:55.795434+0000","last_peered":"2023-12-17T11:49:55.795434+0000","last_clean":"2023-12-17T11:49:55.795434+0000","last_became_active":"2023-12-17T11:49:53.234389+0000","last_became_peered":"2023-12-17T11:49:53.234389+0000","last_unstale":"2023-12-17T11:49:55.795434+0000","last_undegraded":"2023-12-17T11:49:55.795434+0000","last_fullsized":"2023-12-17T11:49:55.795434+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T17:54:34.803705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-17T11:50:01.202070+0000","last_change":"2023-12-17T11:49:52.226465+0000","last_active":"2023-12-17T11:50:01.202070+0000","last_peered":"2023-12-17T11:50:01.202070+0000","last_clean":"2023-12-17T11:50:01.202070+0000","last_became_active":"2023-12-17T11:49:52.226191+0000","last_became_peered":"2023-12-17T11:49:52.226191+0000","last_unstale":"2023-12-17T11:50:01.202070+0000","last_undegraded":"2023-12-17T11:50:01.202070+0000","last_fullsized":"2023-12-17T11:50:01.202070+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_clean_scrub_stamp":"2023-12-17T11:49:51.168108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T18:03:39.554935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-17T11:50:00.524016+0000","last_change":"2023-12-17T11:49:53.254934+0000","last_active":"2023-12-17T11:50:00.524016+0000","last_peered":"2023-12-17T11:50:00.524016+0000","last_clean":"2023-12-17T11:50:00.524016+0000","last_became_active":"2023-12-17T11:49:53.254632+0000","last_became_peered":"2023-12-17T11:49:53.254632+0000","last_unstale":"2023-12-17T11:50:00.524016+0000","last_undegraded":"2023-12-17T11:50:00.524016+0000","last_fullsized":"2023-12-17T11:50:00.524016+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T23:33:06.562683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"39'8","reported_seq":21,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:55.795188+0000","last_change":"2023-12-17T11:49:52.226787+0000","last_active":"2023-12-17T11:49:55.795188+0000","last_peered":"2023-12-17T11:49:55.795188+0000","last_clean":"2023-12-17T11:49:55.795188+0000","last_became_active":"2023-12-17T11:49:52.226471+0000","last_became_peered":"2023-12-17T11:49:52.226471+0000","last_unstale":"2023-12-17T11:49:55.795188+0000","last_undegraded":"2023-12-17T11:49:55.795188+0000","last_fullsized":"2023-12-17T11:49:55.795188+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_clean_scrub_stamp":"2023-12-17T11:49:51.168108+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T17:27:58.587187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-17T11:50:00.524643+0000","last_change":"2023-12-17T11:49:53.253979+0000","last_active":"2023-12-17T11:50:00.524643+0000","last_peered":"2023-12-17T11:50:00.524643+0000","last_clean":"2023-12-17T11:50:00.524643+0000","last_became_active":"2023-12-17T11:49:53.253694+0000","last_became_peered":"2023-12-17T11:49:53.253694+0000","last_unstale":"2023-12-17T11:50:00.524643+0000","last_undegraded":"2023-12-17T11:50:00.524643+0000","last_fullsized":"2023-12-17T11:50:00.524643+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T19:26:47.162716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"39'1","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:55.305058+0000","last_change":"2023-12-17T11:49:52.231973+0000","last_active":"2023-12-17T11:49:55.305058+0000","last_peered":"2023-12-17T11:49:55.305058+0000","last_clean":"2023-12-17T11:49:55.305058+0000","last_became_active":"2023-12-17T11:49:52.231641+0000","last_became_peered":"2023-12-17T11:49:52.231641+0000","last_unstale":"2023-12-17T11:49:55.305058+0000","last_undegraded":"2023-12-17T11:49:55.305058+0000","last_fullsized":"2023-12-17T11:49:55.305058+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_clean_scrub_stamp":"2023-12-17T11:49:51.168108+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T20:34:24.431589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:56.655838+0000","last_change":"2023-12-17T11:49:53.253141+0000","last_active":"2023-12-17T11:49:56.655838+0000","last_peered":"2023-12-17T11:49:56.655838+0000","last_clean":"2023-12-17T11:49:56.655838+0000","last_became_active":"2023-12-17T11:49:53.252532+0000","last_became_peered":"2023-12-17T11:49:53.252532+0000","last_unstale":"2023-12-17T11:49:56.655838+0000","last_undegraded":"2023-12-17T11:49:56.655838+0000","last_fullsized":"2023-12-17T11:49:56.655838+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T22:42:15.785143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"39'2","reported_seq":16,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-17T11:50:00.523361+0000","last_change":"2023-12-17T11:49:52.230858+0000","last_active":"2023-12-17T11:50:00.523361+0000","last_peered":"2023-12-17T11:50:00.523361+0000","last_clean":"2023-12-17T11:50:00.523361+0000","last_became_active":"2023-12-17T11:49:52.230281+0000","last_became_peered":"2023-12-17T11:49:52.230281+0000","last_unstale":"2023-12-17T11:50:00.523361+0000","last_undegraded":"2023-12-17T11:50:00.523361+0000","last_fullsized":"2023-12-17T11:50:00.523361+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_clean_scrub_stamp":"2023-12-17T11:49:51.168108+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T22:39:30.094160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-17T11:50:00.523134+0000","last_change":"2023-12-17T11:49:53.251192+0000","last_active":"2023-12-17T11:50:00.523134+0000","last_peered":"2023-12-17T11:50:00.523134+0000","last_clean":"2023-12-17T11:50:00.523134+0000","last_became_active":"2023-12-17T11:49:53.250837+0000","last_became_peered":"2023-12-17T11:49:53.250837+0000","last_unstale":"2023-12-17T11:50:00.523134+0000","last_undegraded":"2023-12-17T11:50:00.523134+0000","last_fullsized":"2023-12-17T11:50:00.523134+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T14:42:29.543380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"39'1","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:55.300966+0000","last_change":"2023-12-17T11:49:52.222238+0000","last_active":"2023-12-17T11:49:55.300966+0000","last_peered":"2023-12-17T11:49:55.300966+0000","last_clean":"2023-12-17T11:49:55.300966+0000","last_became_active":"2023-12-17T11:49:52.221941+0000","last_became_peered":"2023-12-17T11:49:52.221941+0000","last_unstale":"2023-12-17T11:49:55.300966+0000","last_undegraded":"2023-12-17T11:49:55.300966+0000","last_fullsized":"2023-12-17T11:49:55.300966+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_clean_scrub_stamp":"2023-12-17T11:49:51.168108+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T12:43:47.651883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:56.663718+0000","last_change":"2023-12-17T11:49:53.253162+0000","last_active":"2023-12-17T11:49:56.663718+0000","last_peered":"2023-12-17T11:49:56.663718+0000","last_clean":"2023-12-17T11:49:56.663718+0000","last_became_active":"2023-12-17T11:49:53.252770+0000","last_became_peered":"2023-12-17T11:49:53.252770+0000","last_unstale":"2023-12-17T11:49:56.663718+0000","last_undegraded":"2023-12-17T11:49:56.663718+0000","last_fullsized":"2023-12-17T11:49:56.663718+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T14:03:09.358474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:54.557332+0000","last_change":"2023-12-17T11:49:52.223776+0000","last_active":"2023-12-17T11:49:54.557332+0000","last_peered":"2023-12-17T11:49:54.557332+0000","last_clean":"2023-12-17T11:49:54.557332+0000","last_became_active":"2023-12-17T11:49:52.223571+0000","last_became_peered":"2023-12-17T11:49:52.223571+0000","last_unstale":"2023-12-17T11:49:54.557332+0000","last_undegraded":"2023-12-17T11:49:54.557332+0000","last_fullsized":"2023-12-17T11:49:54.557332+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_clean_scrub_stamp":"2023-12-17T11:49:51.168108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T22:59:00.390569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:55.795237+0000","last_change":"2023-12-17T11:49:53.232411+0000","last_active":"2023-12-17T11:49:55.795237+0000","last_peered":"2023-12-17T11:49:55.795237+0000","last_clean":"2023-12-17T11:49:55.795237+0000","last_became_active":"2023-12-17T11:49:53.232101+0000","last_became_peered":"2023-12-17T11:49:53.232101+0000","last_unstale":"2023-12-17T11:49:55.795237+0000","last_undegraded":"2023-12-17T11:49:55.795237+0000","last_fullsized":"2023-12-17T11:49:55.795237+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T11:57:59.882385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"39'2","reported_seq":15,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:55.300347+0000","last_change":"2023-12-17T11:49:52.210836+0000","last_active":"2023-12-17T11:49:55.300347+0000","last_peered":"2023-12-17T11:49:55.300347+0000","last_clean":"2023-12-17T11:49:55.300347+0000","last_became_active":"2023-12-17T11:49:52.210521+0000","last_became_peered":"2023-12-17T11:49:52.210521+0000","last_unstale":"2023-12-17T11:49:55.300347+0000","last_undegraded":"2023-12-17T11:49:55.300347+0000","last_fullsized":"2023-12-17T11:49:55.300347+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_clean_scrub_stamp":"2023-12-17T11:49:51.168108+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T17:20:36.726376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:56.659317+0000","last_change":"2023-12-17T11:49:53.243230+0000","last_active":"2023-12-17T11:49:56.659317+0000","last_peered":"2023-12-17T11:49:56.659317+0000","last_clean":"2023-12-17T11:49:56.659317+0000","last_became_active":"2023-12-17T11:49:53.242951+0000","last_became_peered":"2023-12-17T11:49:53.242951+0000","last_unstale":"2023-12-17T11:49:56.659317+0000","last_undegraded":"2023-12-17T11:49:56.659317+0000","last_fullsized":"2023-12-17T11:49:56.659317+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T18:42:00.093282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:55.300327+0000","last_change":"2023-12-17T11:49:52.217136+0000","last_active":"2023-12-17T11:49:55.300327+0000","last_peered":"2023-12-17T11:49:55.300327+0000","last_clean":"2023-12-17T11:49:55.300327+0000","last_became_active":"2023-12-17T11:49:52.216921+0000","last_became_peered":"2023-12-17T11:49:52.216921+0000","last_unstale":"2023-12-17T11:49:55.300327+0000","last_undegraded":"2023-12-17T11:49:55.300327+0000","last_fullsized":"2023-12-17T11:49:55.300327+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_clean_scrub_stamp":"2023-12-17T11:49:51.168108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T19:32:12.805680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:56.655717+0000","last_change":"2023-12-17T11:49:53.255643+0000","last_active":"2023-12-17T11:49:56.655717+0000","last_peered":"2023-12-17T11:49:56.655717+0000","last_clean":"2023-12-17T11:49:56.655717+0000","last_became_active":"2023-12-17T11:49:53.255379+0000","last_became_peered":"2023-12-17T11:49:53.255379+0000","last_unstale":"2023-12-17T11:49:56.655717+0000","last_undegraded":"2023-12-17T11:49:56.655717+0000","last_fullsized":"2023-12-17T11:49:56.655717+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T16:21:14.355302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:55.795394+0000","last_change":"2023-12-17T11:49:52.229883+0000","last_active":"2023-12-17T11:49:55.795394+0000","last_peered":"2023-12-17T11:49:55.795394+0000","last_clean":"2023-12-17T11:49:55.795394+0000","last_became_active":"2023-12-17T11:49:52.229372+0000","last_became_peered":"2023-12-17T11:49:52.229372+0000","last_unstale":"2023-12-17T11:49:55.795394+0000","last_undegraded":"2023-12-17T11:49:55.795394+0000","last_fullsized":"2023-12-17T11:49:55.795394+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_clean_scrub_stamp":"2023-12-17T11:49:51.168108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T23:27:59.830582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-17T11:50:00.524144+0000","last_change":"2023-12-17T11:49:53.249227+0000","last_active":"2023-12-17T11:50:00.524144+0000","last_peered":"2023-12-17T11:50:00.524144+0000","last_clean":"2023-12-17T11:50:00.524144+0000","last_became_active":"2023-12-17T11:49:53.248594+0000","last_became_peered":"2023-12-17T11:49:53.248594+0000","last_unstale":"2023-12-17T11:50:00.524144+0000","last_undegraded":"2023-12-17T11:50:00.524144+0000","last_fullsized":"2023-12-17T11:50:00.524144+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T14:31:17.752657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:55.300293+0000","last_change":"2023-12-17T11:49:52.211707+0000","last_active":"2023-12-17T11:49:55.300293+0000","last_peered":"2023-12-17T11:49:55.300293+0000","last_clean":"2023-12-17T11:49:55.300293+0000","last_became_active":"2023-12-17T11:49:52.211283+0000","last_became_peered":"2023-12-17T11:49:52.211283+0000","last_unstale":"2023-12-17T11:49:55.300293+0000","last_undegraded":"2023-12-17T11:49:55.300293+0000","last_fullsized":"2023-12-17T11:49:55.300293+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_clean_scrub_stamp":"2023-12-17T11:49:51.168108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T12:54:05.203029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:56.660005+0000","last_change":"2023-12-17T11:49:53.255235+0000","last_active":"2023-12-17T11:49:56.660005+0000","last_peered":"2023-12-17T11:49:56.660005+0000","last_clean":"2023-12-17T11:49:56.660005+0000","last_became_active":"2023-12-17T11:49:53.254570+0000","last_became_peered":"2023-12-17T11:49:53.254570+0000","last_unstale":"2023-12-17T11:49:56.660005+0000","last_undegraded":"2023-12-17T11:49:56.660005+0000","last_fullsized":"2023-12-17T11:49:56.660005+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T15:14:36.959400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"39'2","reported_seq":15,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:55.305320+0000","last_change":"2023-12-17T11:49:52.229686+0000","last_active":"2023-12-17T11:49:55.305320+0000","last_peered":"2023-12-17T11:49:55.305320+0000","last_clean":"2023-12-17T11:49:55.305320+0000","last_became_active":"2023-12-17T11:49:52.229401+0000","last_became_peered":"2023-12-17T11:49:52.229401+0000","last_unstale":"2023-12-17T11:49:55.305320+0000","last_undegraded":"2023-12-17T11:49:55.305320+0000","last_fullsized":"2023-12-17T11:49:55.305320+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_clean_scrub_stamp":"2023-12-17T11:49:51.168108+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T17:03:59.637357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:55.795716+0000","last_change":"2023-12-17T11:49:53.236908+0000","last_active":"2023-12-17T11:49:55.795716+0000","last_peered":"2023-12-17T11:49:55.795716+0000","last_clean":"2023-12-17T11:49:55.795716+0000","last_became_active":"2023-12-17T11:49:53.236508+0000","last_became_peered":"2023-12-17T11:49:53.236508+0000","last_unstale":"2023-12-17T11:49:55.795716+0000","last_undegraded":"2023-12-17T11:49:55.795716+0000","last_fullsized":"2023-12-17T11:49:55.795716+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T13:59:52.939825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"40'1","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:58.273630+0000","last_change":"2023-12-17T11:49:52.229067+0000","last_active":"2023-12-17T11:49:58.273630+0000","last_peered":"2023-12-17T11:49:58.273630+0000","last_clean":"2023-12-17T11:49:58.273630+0000","last_became_active":"2023-12-17T11:49:52.228704+0000","last_became_peered":"2023-12-17T11:49:52.228704+0000","last_unstale":"2023-12-17T11:49:58.273630+0000","last_undegraded":"2023-12-17T11:49:58.273630+0000","last_fullsized":"2023-12-17T11:49:58.273630+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_clean_scrub_stamp":"2023-12-17T11:49:51.168108+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T16:31:06.129915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-17T11:50:00.524876+0000","last_change":"2023-12-17T11:49:53.246415+0000","last_active":"2023-12-17T11:50:00.524876+0000","last_peered":"2023-12-17T11:50:00.524876+0000","last_clean":"2023-12-17T11:50:00.524876+0000","last_became_active":"2023-12-17T11:49:53.246163+0000","last_became_peered":"2023-12-17T11:49:53.246163+0000","last_unstale":"2023-12-17T11:50:00.524876+0000","last_undegraded":"2023-12-17T11:50:00.524876+0000","last_fullsized":"2023-12-17T11:50:00.524876+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T17:56:09.285369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:55.302270+0000","last_change":"2023-12-17T11:49:52.219865+0000","last_active":"2023-12-17T11:49:55.302270+0000","last_peered":"2023-12-17T11:49:55.302270+0000","last_clean":"2023-12-17T11:49:55.302270+0000","last_became_active":"2023-12-17T11:49:52.219593+0000","last_became_peered":"2023-12-17T11:49:52.219593+0000","last_unstale":"2023-12-17T11:49:55.302270+0000","last_undegraded":"2023-12-17T11:49:55.302270+0000","last_fullsized":"2023-12-17T11:49:55.302270+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_clean_scrub_stamp":"2023-12-17T11:49:51.168108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T15:14:35.947970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:56.659295+0000","last_change":"2023-12-17T11:49:53.242876+0000","last_active":"2023-12-17T11:49:56.659295+0000","last_peered":"2023-12-17T11:49:56.659295+0000","last_clean":"2023-12-17T11:49:56.659295+0000","last_became_active":"2023-12-17T11:49:53.242568+0000","last_became_peered":"2023-12-17T11:49:53.242568+0000","last_unstale":"2023-12-17T11:49:56.659295+0000","last_undegraded":"2023-12-17T11:49:56.659295+0000","last_fullsized":"2023-12-17T11:49:56.659295+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T23:10:56.100255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:55.302112+0000","last_change":"2023-12-17T11:49:52.223424+0000","last_active":"2023-12-17T11:49:55.302112+0000","last_peered":"2023-12-17T11:49:55.302112+0000","last_clean":"2023-12-17T11:49:55.302112+0000","last_became_active":"2023-12-17T11:49:52.223126+0000","last_became_peered":"2023-12-17T11:49:52.223126+0000","last_unstale":"2023-12-17T11:49:55.302112+0000","last_undegraded":"2023-12-17T11:49:55.302112+0000","last_fullsized":"2023-12-17T11:49:55.302112+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_clean_scrub_stamp":"2023-12-17T11:49:51.168108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T14:31:59.450792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:56.659933+0000","last_change":"2023-12-17T11:49:53.251516+0000","last_active":"2023-12-17T11:49:56.659933+0000","last_peered":"2023-12-17T11:49:56.659933+0000","last_clean":"2023-12-17T11:49:56.659933+0000","last_became_active":"2023-12-17T11:49:53.251230+0000","last_became_peered":"2023-12-17T11:49:53.251230+0000","last_unstale":"2023-12-17T11:49:56.659933+0000","last_undegraded":"2023-12-17T11:49:56.659933+0000","last_fullsized":"2023-12-17T11:49:56.659933+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T19:39:18.340154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-17T11:50:01.202294+0000","last_change":"2023-12-17T11:49:52.219807+0000","last_active":"2023-12-17T11:50:01.202294+0000","last_peered":"2023-12-17T11:50:01.202294+0000","last_clean":"2023-12-17T11:50:01.202294+0000","last_became_active":"2023-12-17T11:49:52.219503+0000","last_became_peered":"2023-12-17T11:49:52.219503+0000","last_unstale":"2023-12-17T11:50:01.202294+0000","last_undegraded":"2023-12-17T11:50:01.202294+0000","last_fullsized":"2023-12-17T11:50:01.202294+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_clean_scrub_stamp":"2023-12-17T11:49:51.168108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T18:07:09.094032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-17T11:50:00.522740+0000","last_change":"2023-12-17T11:49:53.241750+0000","last_active":"2023-12-17T11:50:00.522740+0000","last_peered":"2023-12-17T11:50:00.522740+0000","last_clean":"2023-12-17T11:50:00.522740+0000","last_became_active":"2023-12-17T11:49:53.241529+0000","last_became_peered":"2023-12-17T11:49:53.241529+0000","last_unstale":"2023-12-17T11:50:00.522740+0000","last_undegraded":"2023-12-17T11:50:00.522740+0000","last_fullsized":"2023-12-17T11:50:00.522740+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T16:31:53.964205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-17T11:50:00.522300+0000","last_change":"2023-12-17T11:49:52.216579+0000","last_active":"2023-12-17T11:50:00.522300+0000","last_peered":"2023-12-17T11:50:00.522300+0000","last_clean":"2023-12-17T11:50:00.522300+0000","last_became_active":"2023-12-17T11:49:52.216265+0000","last_became_peered":"2023-12-17T11:49:52.216265+0000","last_unstale":"2023-12-17T11:50:00.522300+0000","last_undegraded":"2023-12-17T11:50:00.522300+0000","last_fullsized":"2023-12-17T11:50:00.522300+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_clean_scrub_stamp":"2023-12-17T11:49:51.168108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T14:31:59.450792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:55.795525+0000","last_change":"2023-12-17T11:49:53.234303+0000","last_active":"2023-12-17T11:49:55.795525+0000","last_peered":"2023-12-17T11:49:55.795525+0000","last_clean":"2023-12-17T11:49:55.795525+0000","last_became_active":"2023-12-17T11:49:53.233951+0000","last_became_peered":"2023-12-17T11:49:53.233951+0000","last_unstale":"2023-12-17T11:49:55.795525+0000","last_undegraded":"2023-12-17T11:49:55.795525+0000","last_fullsized":"2023-12-17T11:49:55.795525+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T19:17:38.569694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-17T11:50:00.522523+0000","last_change":"2023-12-17T11:49:52.219957+0000","last_active":"2023-12-17T11:50:00.522523+0000","last_peered":"2023-12-17T11:50:00.522523+0000","last_clean":"2023-12-17T11:50:00.522523+0000","last_became_active":"2023-12-17T11:49:52.219626+0000","last_became_peered":"2023-12-17T11:49:52.219626+0000","last_unstale":"2023-12-17T11:50:00.522523+0000","last_undegraded":"2023-12-17T11:50:00.522523+0000","last_fullsized":"2023-12-17T11:50:00.522523+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_clean_scrub_stamp":"2023-12-17T11:49:51.168108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T19:12:11.016281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:56.655904+0000","last_change":"2023-12-17T11:49:53.253151+0000","last_active":"2023-12-17T11:49:56.655904+0000","last_peered":"2023-12-17T11:49:56.655904+0000","last_clean":"2023-12-17T11:49:56.655904+0000","last_became_active":"2023-12-17T11:49:53.252842+0000","last_became_peered":"2023-12-17T11:49:53.252842+0000","last_unstale":"2023-12-17T11:49:56.655904+0000","last_undegraded":"2023-12-17T11:49:56.655904+0000","last_fullsized":"2023-12-17T11:49:56.655904+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T14:31:17.752657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:55.795609+0000","last_change":"2023-12-17T11:49:52.228110+0000","last_active":"2023-12-17T11:49:55.795609+0000","last_peered":"2023-12-17T11:49:55.795609+0000","last_clean":"2023-12-17T11:49:55.795609+0000","last_became_active":"2023-12-17T11:49:52.227851+0000","last_became_peered":"2023-12-17T11:49:52.227851+0000","last_unstale":"2023-12-17T11:49:55.795609+0000","last_undegraded":"2023-12-17T11:49:55.795609+0000","last_fullsized":"2023-12-17T11:49:55.795609+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_clean_scrub_stamp":"2023-12-17T11:49:51.168108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T18:37:20.380970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":181,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:55.301834+0000","last_change":"2023-12-17T11:48:07.952584+0000","last_active":"2023-12-17T11:49:55.301834+0000","last_peered":"2023-12-17T11:49:55.301834+0000","last_clean":"2023-12-17T11:49:55.301834+0000","last_became_active":"2023-12-17T11:48:07.950361+0000","last_became_peered":"2023-12-17T11:48:07.950361+0000","last_unstale":"2023-12-17T11:49:55.301834+0000","last_undegraded":"2023-12-17T11:49:55.301834+0000","last_fullsized":"2023-12-17T11:49:55.301834+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:06.728199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:06.728199+0000","last_clean_scrub_stamp":"2023-12-17T11:48:06.728199+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T12:47:55.048065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542172,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28088,"kb_used_data":1068,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343752,"statfs":{"total":96636764160,"available":96608002048,"internally_reserved":0,"allocated":1093632,"data_stored":802179,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 17 11:49:06 2023","interfaces":[{"interface":"back","average":{"1min":1.407,"5min":1.407,"15min":1.407},"min":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":8.6579999999999995,"5min":8.6579999999999995,"15min":8.6579999999999995},"last":1.0669999999999999},{"interface":"front","average":{"1min":1.339,"5min":1.339,"15min":1.339},"min":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"max":{"1min":4.0830000000000002,"5min":4.0830000000000002,"15min":4.0830000000000002},"last":1.393}]},{"osd":1,"last update":"Sun Dec 17 11:49:06 2023","interfaces":[{"interface":"back","average":{"1min":1.127,"5min":1.127,"15min":1.127},"min":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"max":{"1min":2.1539999999999999,"5min":2.1539999999999999,"15min":2.1539999999999999},"last":0.94899999999999995},{"interface":"front","average":{"1min":1.413,"5min":1.413,"15min":1.413},"min":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"max":{"1min":8.7449999999999992,"5min":8.7449999999999992,"15min":8.7449999999999992},"last":1.181}]},{"osd":2,"last update":"Sun Dec 17 11:49:06 2023","interfaces":[{"interface":"back","average":{"1min":1.4299999999999999,"5min":1.4299999999999999,"15min":1.4299999999999999},"min":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"max":{"1min":4.1239999999999997,"5min":4.1239999999999997,"15min":4.1239999999999997},"last":1.234},{"interface":"front","average":{"1min":1.3720000000000001,"5min":1.3720000000000001,"15min":1.3720000000000001},"min":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"max":{"1min":1.782,"5min":1.782,"15min":1.782},"last":0.80600000000000005}]},{"osd":3,"last update":"Sun Dec 17 11:49:06 2023","interfaces":[{"interface":"back","average":{"1min":1.298,"5min":1.298,"15min":1.298},"min":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"max":{"1min":2.5430000000000001,"5min":2.5430000000000001,"15min":2.5430000000000001},"last":1.04},{"interface":"front","average":{"1min":1.375,"5min":1.375,"15min":1.375},"min":{"1min":1.087,"5min":1.087,"15min":1.087},"max":{"1min":2.5830000000000002,"5min":2.5830000000000002,"15min":2.5830000000000002},"last":1.127}]},{"osd":4,"last update":"Sun Dec 17 11:49:06 2023","interfaces":[{"interface":"back","average":{"1min":1.3859999999999999,"5min":1.3859999999999999,"15min":1.3859999999999999},"min":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":4.0309999999999997,"5min":4.0309999999999997,"15min":4.0309999999999997},"last":1.488},{"interface":"front","average":{"1min":1.5860000000000001,"5min":1.5860000000000001,"15min":1.5860000000000001},"min":{"1min":1.2230000000000001,"5min":1.2230000000000001,"15min":1.2230000000000001},"max":{"1min":3.3220000000000001,"5min":3.3220000000000001,"15min":3.3220000000000001},"last":1.3300000000000001}]},{"osd":5,"last update":"Sun Dec 17 11:49:06 2023","interfaces":[{"interface":"back","average":{"1min":1.6970000000000001,"5min":1.6970000000000001,"15min":1.6970000000000001},"min":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"max":{"1min":8.7929999999999993,"5min":8.7929999999999993,"15min":8.7929999999999993},"last":1.2929999999999999},{"interface":"front","average":{"1min":1.6859999999999999,"5min":1.6859999999999999,"15min":1.6859999999999999},"min":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"max":{"1min":5.1040000000000001,"5min":5.1040000000000001,"15min":5.1040000000000001},"last":1.5700000000000001}]},{"osd":6,"last update":"Sun Dec 17 11:49:06 2023","interfaces":[{"interface":"back","average":{"1min":1.845,"5min":1.845,"15min":1.845},"min":{"1min":1.081,"5min":1.081,"15min":1.081},"max":{"1min":8.8330000000000002,"5min":8.8330000000000002,"15min":8.8330000000000002},"last":1.3720000000000001},{"interface":"front","average":{"1min":1.71,"5min":1.71,"15min":1.71},"min":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"max":{"1min":3.9590000000000001,"5min":3.9590000000000001,"15min":3.9590000000000001},"last":1.679}]}]},{"osd":6,"up_from":14,"seq":60129542171,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27480,"kb_used_data":452,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344360,"statfs":{"total":96636764160,"available":96608624640,"internally_reserved":0,"allocated":462848,"data_stored":198158,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 17 11:49:06 2023","interfaces":[{"interface":"back","average":{"1min":1.0720000000000001,"5min":1.0720000000000001,"15min":1.0720000000000001},"min":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.5840000000000001,"5min":1.5840000000000001,"15min":1.5840000000000001},"last":1.0169999999999999},{"interface":"front","average":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"min":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"max":{"1min":1.429,"5min":1.429,"15min":1.429},"last":1.8400000000000001}]},{"osd":1,"last update":"Sun Dec 17 11:49:06 2023","interfaces":[{"interface":"back","average":{"1min":1.2689999999999999,"5min":1.2689999999999999,"15min":1.2689999999999999},"min":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"max":{"1min":1.5640000000000001,"5min":1.5640000000000001,"15min":1.5640000000000001},"last":1.403},{"interface":"front","average":{"1min":1.3169999999999999,"5min":1.3169999999999999,"15min":1.3169999999999999},"min":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"max":{"1min":1.9359999999999999,"5min":1.9359999999999999,"15min":1.9359999999999999},"last":1.7809999999999999}]},{"osd":2,"last update":"Sun Dec 17 11:49:06 2023","interfaces":[{"interface":"back","average":{"1min":1.1970000000000001,"5min":1.1970000000000001,"15min":1.1970000000000001},"min":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":1.8740000000000001,"5min":1.8740000000000001,"15min":1.8740000000000001},"last":1.6930000000000001},{"interface":"front","average":{"1min":1.296,"5min":1.296,"15min":1.296},"min":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":2.5470000000000002,"5min":2.5470000000000002,"15min":2.5470000000000002},"last":1.29}]},{"osd":3,"last update":"Sun Dec 17 11:49:06 2023","interfaces":[{"interface":"back","average":{"1min":1.508,"5min":1.508,"15min":1.508},"min":{"1min":1.0840000000000001,"5min":1.0840000000000001,"15min":1.0840000000000001},"max":{"1min":2.4689999999999999,"5min":2.4689999999999999,"15min":2.4689999999999999},"last":1.9590000000000001},{"interface":"front","average":{"1min":1.4390000000000001,"5min":1.4390000000000001,"15min":1.4390000000000001},"min":{"1min":0.88,"5min":0.88,"15min":0.88},"max":{"1min":2.0680000000000001,"5min":2.0680000000000001,"15min":2.0680000000000001},"last":1.216}]},{"osd":4,"last update":"Sun Dec 17 11:49:06 2023","interfaces":[{"interface":"back","average":{"1min":1.522,"5min":1.522,"15min":1.522},"min":{"1min":1.1419999999999999,"5min":1.1419999999999999,"15min":1.1419999999999999},"max":{"1min":2.222,"5min":2.222,"15min":2.222},"last":1.5069999999999999},{"interface":"front","average":{"1min":1.4419999999999999,"5min":1.4419999999999999,"15min":1.4419999999999999},"min":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":0.90700000000000003},"max":{"1min":2.4079999999999999,"5min":2.4079999999999999,"15min":2.4079999999999999},"last":1.444}]},{"osd":5,"last update":"Sun Dec 17 11:49:06 2023","interfaces":[{"interface":"back","average":{"1min":1.548,"5min":1.548,"15min":1.548},"min":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"max":{"1min":2.3319999999999999,"5min":2.3319999999999999,"15min":2.3319999999999999},"last":1.6279999999999999},{"interface":"front","average":{"1min":1.5760000000000001,"5min":1.5760000000000001,"15min":1.5760000000000001},"min":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"max":{"1min":2.6760000000000002,"5min":2.6760000000000002,"15min":2.6760000000000002},"last":1.6000000000000001}]},{"osd":7,"last update":"Sun Dec 17 11:49:06 2023","interfaces":[{"interface":"back","average":{"1min":1.419,"5min":1.419,"15min":1.419},"min":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"max":{"1min":2.1560000000000001,"5min":2.1560000000000001,"15min":2.1560000000000001},"last":1.5589999999999999},{"interface":"front","average":{"1min":1.712,"5min":1.712,"15min":1.712},"min":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"max":{"1min":2.6059999999999999,"5min":2.6059999999999999,"15min":2.6059999999999999},"last":1.8919999999999999}]}]},{"osd":5,"up_from":14,"seq":60129542170,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27488,"kb_used_data":468,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344352,"statfs":{"total":96636764160,"available":96608616448,"internally_reserved":0,"allocated":479232,"data_stored":203975,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 17 11:49:09 2023","interfaces":[{"interface":"back","average":{"1min":1.101,"5min":1.101,"15min":1.101},"min":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":1.5860000000000001,"5min":1.5860000000000001,"15min":1.5860000000000001},"last":1.204},{"interface":"front","average":{"1min":1.23,"5min":1.23,"15min":1.23},"min":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"max":{"1min":1.9419999999999999,"5min":1.9419999999999999,"15min":1.9419999999999999},"last":1.0860000000000001}]},{"osd":1,"last update":"Sun Dec 17 11:49:09 2023","interfaces":[{"interface":"back","average":{"1min":1.167,"5min":1.167,"15min":1.167},"min":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"max":{"1min":1.5289999999999999,"5min":1.5289999999999999,"15min":1.5289999999999999},"last":1.6479999999999999},{"interface":"front","average":{"1min":1.216,"5min":1.216,"15min":1.216},"min":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"max":{"1min":1.8660000000000001,"5min":1.8660000000000001,"15min":1.8660000000000001},"last":1.3220000000000001}]},{"osd":2,"last update":"Sun Dec 17 11:49:09 2023","interfaces":[{"interface":"back","average":{"1min":1.3140000000000001,"5min":1.3140000000000001,"15min":1.3140000000000001},"min":{"1min":0.747,"5min":0.747,"15min":0.747},"max":{"1min":2.1589999999999998,"5min":2.1589999999999998,"15min":2.1589999999999998},"last":0.93899999999999995},{"interface":"front","average":{"1min":1.3919999999999999,"5min":1.3919999999999999,"15min":1.3919999999999999},"min":{"1min":1.0049999999999999,"5min":1.0049999999999999,"15min":1.0049999999999999},"max":{"1min":2.1379999999999999,"5min":2.1379999999999999,"15min":2.1379999999999999},"last":1.506}]},{"osd":3,"last update":"Sun Dec 17 11:49:09 2023","interfaces":[{"interface":"back","average":{"1min":1.337,"5min":1.337,"15min":1.337},"min":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"max":{"1min":2.593,"5min":2.593,"15min":2.593},"last":1.351},{"interface":"front","average":{"1min":1.407,"5min":1.407,"15min":1.407},"min":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"max":{"1min":2.3079999999999998,"5min":2.3079999999999998,"15min":2.3079999999999998},"last":1.381}]},{"osd":4,"last update":"Sun Dec 17 11:49:09 2023","interfaces":[{"interface":"back","average":{"1min":1.5029999999999999,"5min":1.5029999999999999,"15min":1.5029999999999999},"min":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"max":{"1min":2.5299999999999998,"5min":2.5299999999999998,"15min":2.5299999999999998},"last":1.4510000000000001},{"interface":"front","average":{"1min":1.6879999999999999,"5min":1.6879999999999999,"15min":1.6879999999999999},"min":{"1min":1.0669999999999999,"5min":1.0669999999999999,"15min":1.0669999999999999},"max":{"1min":3.9569999999999999,"5min":3.9569999999999999,"15min":3.9569999999999999},"last":1.1739999999999999}]},{"osd":6,"last update":"Sun Dec 17 11:49:09 2023","interfaces":[{"interface":"back","average":{"1min":1.6619999999999999,"5min":1.6619999999999999,"15min":1.6619999999999999},"min":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"max":{"1min":2.9849999999999999,"5min":2.9849999999999999,"15min":2.9849999999999999},"last":1.5900000000000001},{"interface":"front","average":{"1min":1.6319999999999999,"5min":1.6319999999999999,"15min":1.6319999999999999},"min":{"1min":1.25,"5min":1.25,"15min":1.25},"max":{"1min":2.641,"5min":2.641,"15min":2.641},"last":1.5569999999999999}]},{"osd":7,"last update":"Sun Dec 17 11:49:09 2023","interfaces":[{"interface":"back","average":{"1min":1.8080000000000001,"5min":1.8080000000000001,"15min":1.8080000000000001},"min":{"1min":1.232,"5min":1.232,"15min":1.232},"max":{"1min":3.8570000000000002,"5min":3.8570000000000002,"15min":3.8570000000000002},"last":1.2589999999999999},{"interface":"front","average":{"1min":1.827,"5min":1.827,"15min":1.827},"min":{"1min":1.137,"5min":1.137,"15min":1.137},"max":{"1min":2.8999999999999999,"5min":2.8999999999999999,"15min":2.8999999999999999},"last":1.702}]}]},{"osd":4,"up_from":14,"seq":60129542171,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27488,"kb_used_data":468,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344352,"statfs":{"total":96636764160,"available":96608616448,"internally_reserved":0,"allocated":479232,"data_stored":204467,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 17 11:49:08 2023","interfaces":[{"interface":"back","average":{"1min":1.02,"5min":1.02,"15min":1.02},"min":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"max":{"1min":1.1890000000000001,"5min":1.1890000000000001,"15min":1.1890000000000001},"last":1.3300000000000001},{"interface":"front","average":{"1min":1.167,"5min":1.167,"15min":1.167},"min":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"max":{"1min":2.6400000000000001,"5min":2.6400000000000001,"15min":2.6400000000000001},"last":0.96599999999999997}]},{"osd":1,"last update":"Sun Dec 17 11:49:08 2023","interfaces":[{"interface":"back","average":{"1min":1.0960000000000001,"5min":1.0960000000000001,"15min":1.0960000000000001},"min":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"max":{"1min":1.369,"5min":1.369,"15min":1.369},"last":1.4450000000000001},{"interface":"front","average":{"1min":1.2669999999999999,"5min":1.2669999999999999,"15min":1.2669999999999999},"min":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"max":{"1min":1.631,"5min":1.631,"15min":1.631},"last":0.88600000000000001}]},{"osd":2,"last update":"Sun Dec 17 11:49:08 2023","interfaces":[{"interface":"back","average":{"1min":1.393,"5min":1.393,"15min":1.393},"min":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"max":{"1min":1.8660000000000001,"5min":1.8660000000000001,"15min":1.8660000000000001},"last":1.2},{"interface":"front","average":{"1min":1.329,"5min":1.329,"15min":1.329},"min":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"max":{"1min":1.968,"5min":1.968,"15min":1.968},"last":1.5069999999999999}]},{"osd":3,"last update":"Sun Dec 17 11:49:08 2023","interfaces":[{"interface":"back","average":{"1min":1.4410000000000001,"5min":1.4410000000000001,"15min":1.4410000000000001},"min":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"max":{"1min":3.2290000000000001,"5min":3.2290000000000001,"15min":3.2290000000000001},"last":1.28},{"interface":"front","average":{"1min":1.496,"5min":1.496,"15min":1.496},"min":{"1min":1.1000000000000001,"5min":1.1000000000000001,"15min":1.1000000000000001},"max":{"1min":2.0169999999999999,"5min":2.0169999999999999,"15min":2.0169999999999999},"last":1.556}]},{"osd":5,"last update":"Sun Dec 17 11:49:08 2023","interfaces":[{"interface":"back","average":{"1min":1.474,"5min":1.474,"15min":1.474},"min":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"max":{"1min":2.141,"5min":2.141,"15min":2.141},"last":1.653},{"interface":"front","average":{"1min":1.7110000000000001,"5min":1.7110000000000001,"15min":1.7110000000000001},"min":{"1min":1.2390000000000001,"5min":1.2390000000000001,"15min":1.2390000000000001},"max":{"1min":3.8220000000000001,"5min":3.8220000000000001,"15min":3.8220000000000001},"last":1.3999999999999999}]},{"osd":6,"last update":"Sun Dec 17 11:49:08 2023","interfaces":[{"interface":"back","average":{"1min":1.7370000000000001,"5min":1.7370000000000001,"15min":1.7370000000000001},"min":{"1min":1.212,"5min":1.212,"15min":1.212},"max":{"1min":2.7410000000000001,"5min":2.7410000000000001,"15min":2.7410000000000001},"last":1.627},{"interface":"front","average":{"1min":1.677,"5min":1.677,"15min":1.677},"min":{"1min":1.222,"5min":1.222,"15min":1.222},"max":{"1min":2.2989999999999999,"5min":2.2989999999999999,"15min":2.2989999999999999},"last":1.726}]},{"osd":7,"last update":"Sun Dec 17 11:49:08 2023","interfaces":[{"interface":"back","average":{"1min":1.847,"5min":1.847,"15min":1.847},"min":{"1min":1.2749999999999999,"5min":1.2749999999999999,"15min":1.2749999999999999},"max":{"1min":3.944,"5min":3.944,"15min":3.944},"last":1.5960000000000001},{"interface":"front","average":{"1min":1.8160000000000001,"5min":1.8160000000000001,"15min":1.8160000000000001},"min":{"1min":1.4239999999999999,"5min":1.4239999999999999,"15min":1.4239999999999999},"max":{"1min":2.8809999999999998,"5min":2.8809999999999998,"15min":2.8809999999999998},"last":1.6830000000000001}]}]},{"osd":3,"up_from":14,"seq":60129542170,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27508,"kb_used_data":488,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344332,"statfs":{"total":96636764160,"available":96608595968,"internally_reserved":0,"allocated":499712,"data_stored":211775,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 17 11:49:06 2023","interfaces":[{"interface":"back","average":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.6459999999999999,"5min":1.6459999999999999,"15min":1.6459999999999999},"last":0.77300000000000002},{"interface":"front","average":{"1min":1.0700000000000001,"5min":1.0700000000000001,"15min":1.0700000000000001},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":3.5800000000000001,"5min":3.5800000000000001,"15min":3.5800000000000001},"last":0.45600000000000002}]},{"osd":1,"last update":"Sun Dec 17 11:49:06 2023","interfaces":[{"interface":"back","average":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":1.4379999999999999,"5min":1.4379999999999999,"15min":1.4379999999999999},"last":0.70499999999999996},{"interface":"front","average":{"1min":1.1519999999999999,"5min":1.1519999999999999,"15min":1.1519999999999999},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":2.085,"5min":2.085,"15min":2.085},"last":0.93700000000000006}]},{"osd":2,"last update":"Sun Dec 17 11:49:06 2023","interfaces":[{"interface":"back","average":{"1min":1.1659999999999999,"5min":1.1659999999999999,"15min":1.1659999999999999},"min":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":1.651,"5min":1.651,"15min":1.651},"last":1.141},{"interface":"front","average":{"1min":1.2569999999999999,"5min":1.2569999999999999,"15min":1.2569999999999999},"min":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":2.1429999999999998,"5min":2.1429999999999998,"15min":2.1429999999999998},"last":0.873}]},{"osd":4,"last update":"Sun Dec 17 11:49:06 2023","interfaces":[{"interface":"back","average":{"1min":1.4330000000000001,"5min":1.4330000000000001,"15min":1.4330000000000001},"min":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"max":{"1min":2.4870000000000001,"5min":2.4870000000000001,"15min":2.4870000000000001},"last":0.68600000000000005},{"interface":"front","average":{"1min":1.476,"5min":1.476,"15min":1.476},"min":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"max":{"1min":2.3460000000000001,"5min":2.3460000000000001,"15min":2.3460000000000001},"last":0.98399999999999999}]},{"osd":5,"last update":"Sun Dec 17 11:49:06 2023","interfaces":[{"interface":"back","average":{"1min":1.476,"5min":1.476,"15min":1.476},"min":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"max":{"1min":2.5710000000000002,"5min":2.5710000000000002,"15min":2.5710000000000002},"last":1.319},{"interface":"front","average":{"1min":1.5,"5min":1.5,"15min":1.5},"min":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"max":{"1min":2.383,"5min":2.383,"15min":2.383},"last":0.85399999999999998}]},{"osd":6,"last update":"Sun Dec 17 11:49:06 2023","interfaces":[{"interface":"back","average":{"1min":1.474,"5min":1.474,"15min":1.474},"min":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"max":{"1min":2.6179999999999999,"5min":2.6179999999999999,"15min":2.6179999999999999},"last":1.1080000000000001},{"interface":"front","average":{"1min":1.5149999999999999,"5min":1.5149999999999999,"15min":1.5149999999999999},"min":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"max":{"1min":2.7679999999999998,"5min":2.7679999999999998,"15min":2.7679999999999998},"last":1.258}]},{"osd":7,"last update":"Sun Dec 17 11:49:06 2023","interfaces":[{"interface":"back","average":{"1min":1.581,"5min":1.581,"15min":1.581},"min":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"max":{"1min":3.7000000000000002,"5min":3.7000000000000002,"15min":3.7000000000000002},"last":1.054},{"interface":"front","average":{"1min":1.579,"5min":1.579,"15min":1.579},"min":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":0.97099999999999997},"max":{"1min":2.427,"5min":2.427,"15min":2.427},"last":1.177}]}]},{"osd":2,"up_from":14,"seq":60129542171,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27472,"kb_used_data":452,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344368,"statfs":{"total":96636764160,"available":96608632832,"internally_reserved":0,"allocated":462848,"data_stored":197646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 17 11:49:07 2023","interfaces":[{"interface":"back","average":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":1.724,"5min":1.724,"15min":1.724},"last":1.0369999999999999},{"interface":"front","average":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.502,"5min":1.502,"15min":1.502},"last":0.998}]},{"osd":1,"last update":"Sun Dec 17 11:49:07 2023","interfaces":[{"interface":"back","average":{"1min":0.995,"5min":0.995,"15min":0.995},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.4790000000000001,"5min":1.4790000000000001,"15min":1.4790000000000001},"last":1.5309999999999999},{"interface":"front","average":{"1min":1.056,"5min":1.056,"15min":1.056},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":2.6280000000000001,"5min":2.6280000000000001,"15min":2.6280000000000001},"last":0.83999999999999997}]},{"osd":3,"last update":"Sun Dec 17 11:49:07 2023","interfaces":[{"interface":"back","average":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.476,"5min":1.476,"15min":1.476},"last":0.753},{"interface":"front","average":{"1min":1.214,"5min":1.214,"15min":1.214},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.9670000000000001,"5min":1.9670000000000001,"15min":1.9670000000000001},"last":1.4450000000000001}]},{"osd":4,"last update":"Sun Dec 17 11:49:07 2023","interfaces":[{"interface":"back","average":{"1min":1.49,"5min":1.49,"15min":1.49},"min":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"max":{"1min":2.5750000000000002,"5min":2.5750000000000002,"15min":2.5750000000000002},"last":1.2070000000000001},{"interface":"front","average":{"1min":1.3879999999999999,"5min":1.3879999999999999,"15min":1.3879999999999999},"min":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"max":{"1min":2.4940000000000002,"5min":2.4940000000000002,"15min":2.4940000000000002},"last":1.391}]},{"osd":5,"last update":"Sun Dec 17 11:49:07 2023","interfaces":[{"interface":"back","average":{"1min":1.3240000000000001,"5min":1.3240000000000001,"15min":1.3240000000000001},"min":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"max":{"1min":2.4289999999999998,"5min":2.4289999999999998,"15min":2.4289999999999998},"last":1.343},{"interface":"front","average":{"1min":1.5489999999999999,"5min":1.5489999999999999,"15min":1.5489999999999999},"min":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"max":{"1min":2.694,"5min":2.694,"15min":2.694},"last":1.597}]},{"osd":6,"last update":"Sun Dec 17 11:49:07 2023","interfaces":[{"interface":"back","average":{"1min":1.472,"5min":1.472,"15min":1.472},"min":{"1min":0.748,"5min":0.748,"15min":0.748},"max":{"1min":2.7349999999999999,"5min":2.7349999999999999,"15min":2.7349999999999999},"last":1.1180000000000001},{"interface":"front","average":{"1min":1.4119999999999999,"5min":1.4119999999999999,"15min":1.4119999999999999},"min":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"max":{"1min":2.468,"5min":2.468,"15min":2.468},"last":1.4950000000000001}]},{"osd":7,"last update":"Sun Dec 17 11:49:07 2023","interfaces":[{"interface":"back","average":{"1min":1.554,"5min":1.554,"15min":1.554},"min":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"max":{"1min":3.379,"5min":3.379,"15min":3.379},"last":1.23},{"interface":"front","average":{"1min":1.474,"5min":1.474,"15min":1.474},"min":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"max":{"1min":2.2869999999999999,"5min":2.2869999999999999,"15min":2.2869999999999999},"last":1.571}]}]},{"osd":1,"up_from":14,"seq":60129542170,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27484,"kb_used_data":464,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344356,"statfs":{"total":96636764160,"available":96608620544,"internally_reserved":0,"allocated":475136,"data_stored":203953,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 17 11:49:08 2023","interfaces":[{"interface":"back","average":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.5249999999999999,"5min":1.5249999999999999,"15min":1.5249999999999999},"last":1.1020000000000001},{"interface":"front","average":{"1min":1.113,"5min":1.113,"15min":1.113},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":2.6360000000000001,"5min":2.6360000000000001,"15min":2.6360000000000001},"last":0.94399999999999995}]},{"osd":2,"last update":"Sun Dec 17 11:49:08 2023","interfaces":[{"interface":"back","average":{"1min":1.202,"5min":1.202,"15min":1.202},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":2.8159999999999998,"5min":2.8159999999999998,"15min":2.8159999999999998},"last":0.67300000000000004},{"interface":"front","average":{"1min":1.462,"5min":1.462,"15min":1.462},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":3.101,"5min":3.101,"15min":3.101},"last":1.6180000000000001}]},{"osd":3,"last update":"Sun Dec 17 11:49:08 2023","interfaces":[{"interface":"back","average":{"1min":1.48,"5min":1.48,"15min":1.48},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":2.7890000000000001,"5min":2.7890000000000001,"15min":2.7890000000000001},"last":1.736},{"interface":"front","average":{"1min":1.278,"5min":1.278,"15min":1.278},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":3.1400000000000001,"5min":3.1400000000000001,"15min":3.1400000000000001},"last":1.28}]},{"osd":4,"last update":"Sun Dec 17 11:49:08 2023","interfaces":[{"interface":"back","average":{"1min":1.4350000000000001,"5min":1.4350000000000001,"15min":1.4350000000000001},"min":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":2.5289999999999999,"5min":2.5289999999999999,"15min":2.5289999999999999},"last":1.5409999999999999},{"interface":"front","average":{"1min":1.363,"5min":1.363,"15min":1.363},"min":{"1min":0.627,"5min":0.627,"15min":0.627},"max":{"1min":2.0819999999999999,"5min":2.0819999999999999,"15min":2.0819999999999999},"last":1.383}]},{"osd":5,"last update":"Sun Dec 17 11:49:08 2023","interfaces":[{"interface":"back","average":{"1min":1.466,"5min":1.466,"15min":1.466},"min":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"max":{"1min":1.96,"5min":1.96,"15min":1.96},"last":1.522},{"interface":"front","average":{"1min":1.573,"5min":1.573,"15min":1.573},"min":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":2.6739999999999999,"5min":2.6739999999999999,"15min":2.6739999999999999},"last":1.8500000000000001}]},{"osd":6,"last update":"Sun Dec 17 11:49:08 2023","interfaces":[{"interface":"back","average":{"1min":1.627,"5min":1.627,"15min":1.627},"min":{"1min":0.754,"5min":0.754,"15min":0.754},"max":{"1min":3.016,"5min":3.016,"15min":3.016},"last":2.0179999999999998},{"interface":"front","average":{"1min":1.5509999999999999,"5min":1.5509999999999999,"15min":1.5509999999999999},"min":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"max":{"1min":2.508,"5min":2.508,"15min":2.508},"last":1.458}]},{"osd":7,"last update":"Sun Dec 17 11:49:08 2023","interfaces":[{"interface":"back","average":{"1min":1.6839999999999999,"5min":1.6839999999999999,"15min":1.6839999999999999},"min":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"max":{"1min":2.944,"5min":2.944,"15min":2.944},"last":1.964},{"interface":"front","average":{"1min":1.7170000000000001,"5min":1.7170000000000001,"15min":1.7170000000000001},"min":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"max":{"1min":2.7709999999999999,"5min":2.7709999999999999,"15min":2.7709999999999999},"last":1.7949999999999999}]}]},{"osd":0,"up_from":14,"seq":60129542170,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32224,"kb_used_data":1044,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339616,"statfs":{"total":96636764160,"available":96603766784,"internally_reserved":0,"allocated":1069056,"data_stored":794265,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Dec 17 11:49:06 2023","interfaces":[{"interface":"back","average":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.3899999999999999,"5min":1.3899999999999999,"15min":1.3899999999999999},"last":0.79900000000000004},{"interface":"front","average":{"1min":1.1519999999999999,"5min":1.1519999999999999,"15min":1.1519999999999999},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":1.958,"5min":1.958,"15min":1.958},"last":1.1359999999999999}]},{"osd":2,"last update":"Sun Dec 17 11:49:06 2023","interfaces":[{"interface":"back","average":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.7709999999999999,"5min":1.7709999999999999,"15min":1.7709999999999999},"last":1.081},{"interface":"front","average":{"1min":1.2090000000000001,"5min":1.2090000000000001,"15min":1.2090000000000001},"min":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":2.2130000000000001,"5min":2.2130000000000001,"15min":2.2130000000000001},"last":1.0309999999999999}]},{"osd":3,"last update":"Sun Dec 17 11:49:06 2023","interfaces":[{"interface":"back","average":{"1min":1.125,"5min":1.125,"15min":1.125},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.728,"5min":1.728,"15min":1.728},"last":1.383},{"interface":"front","average":{"1min":1.4039999999999999,"5min":1.4039999999999999,"15min":1.4039999999999999},"min":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"max":{"1min":2.4809999999999999,"5min":2.4809999999999999,"15min":2.4809999999999999},"last":1.3400000000000001}]},{"osd":4,"last update":"Sun Dec 17 11:49:06 2023","interfaces":[{"interface":"back","average":{"1min":1.518,"5min":1.518,"15min":1.518},"min":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"max":{"1min":4.6710000000000003,"5min":4.6710000000000003,"15min":4.6710000000000003},"last":1.47},{"interface":"front","average":{"1min":1.427,"5min":1.427,"15min":1.427},"min":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"max":{"1min":2.2799999999999998,"5min":2.2799999999999998,"15min":2.2799999999999998},"last":1.1990000000000001}]},{"osd":5,"last update":"Sun Dec 17 11:49:06 2023","interfaces":[{"interface":"back","average":{"1min":1.5069999999999999,"5min":1.5069999999999999,"15min":1.5069999999999999},"min":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"max":{"1min":2.1349999999999998,"5min":2.1349999999999998,"15min":2.1349999999999998},"last":1.661},{"interface":"front","average":{"1min":1.6240000000000001,"5min":1.6240000000000001,"15min":1.6240000000000001},"min":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"max":{"1min":2.6080000000000001,"5min":2.6080000000000001,"15min":2.6080000000000001},"last":1.522}]},{"osd":6,"last update":"Sun Dec 17 11:49:06 2023","interfaces":[{"interface":"back","average":{"1min":1.5800000000000001,"5min":1.5800000000000001,"15min":1.5800000000000001},"min":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"max":{"1min":2.702,"5min":2.702,"15min":2.702},"last":1.4199999999999999},{"interface":"front","average":{"1min":1.534,"5min":1.534,"15min":1.534},"min":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"max":{"1min":2.3100000000000001,"5min":2.3100000000000001,"15min":2.3100000000000001},"last":1.702}]},{"osd":7,"last update":"Sun Dec 17 11:49:06 2023","interfaces":[{"interface":"back","average":{"1min":1.611,"5min":1.611,"15min":1.611},"min":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"max":{"1min":2.3420000000000001,"5min":2.3420000000000001,"15min":2.3420000000000001},"last":1.7969999999999999},{"interface":"front","average":{"1min":1.577,"5min":1.577,"15min":1.577},"min":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"max":{"1min":2.4359999999999999,"5min":2.4359999999999999,"15min":2.4359999999999999},"last":1.5600000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-17T11:50:08.465 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-17T11:50:08.735 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:08.732+0000 7f677c71d640 1 Processor -- start 2023-12-17T11:50:08.735 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:08.732+0000 7f677c71d640 1 -- start start 2023-12-17T11:50:08.736 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:08.734+0000 7f677c71d640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f677415f260 0x7f67740ccb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:50:08.737 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:08.734+0000 7f677c71d640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f67741626b0 0x7f67740701c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:50:08.737 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:08.734+0000 7f677c71d640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6774070b60 con 0x7f6774070700 2023-12-17T11:50:08.737 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:08.734+0000 7f677c71d640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67740cd040 con 0x7f677415f260 2023-12-17T11:50:08.737 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:08.734+0000 7f677c71d640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f677415f640 con 0x7f67741626b0 2023-12-17T11:50:08.737 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:08.735+0000 7f677a4b9640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f677415f260 0x7f67740ccb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:50:08.737 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:08.735+0000 7f677acba640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f6774070700 0x7f677406c510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:47614/0 (socket says 172.21.15.40:47614) 2023-12-17T11:50:08.737 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:08.735+0000 7f677acba640 1 -- 172.21.15.40:0/2796571500 learned_addr learned my addr 172.21.15.40:0/2796571500 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-12-17T11:50:08.738 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:08.735+0000 7f6779cb8640 1 --2- 172.21.15.40:0/2796571500 >> v2:172.21.15.159:3300/0 conn(0x7f67741626b0 0x7f67740701c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:50:08.738 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:08.735+0000 7f67794b7640 1 -- 172.21.15.40:0/2796571500 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1381268254 0 0) 0x7f6774070b60 con 0x7f6774070700 2023-12-17T11:50:08.738 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:08.735+0000 7f677a4b9640 1 -- 172.21.15.40:0/2796571500 >> v2:172.21.15.159:3300/0 conn(0x7f67741626b0 msgr2=0x7f67740701c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:50:08.738 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:08.735+0000 7f677a4b9640 1 --2- 172.21.15.40:0/2796571500 >> v2:172.21.15.159:3300/0 conn(0x7f67741626b0 0x7f67740701c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:50:08.738 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:08.735+0000 7f677a4b9640 1 -- 172.21.15.40:0/2796571500 >> v1:172.21.15.40:6789/0 conn(0x7f6774070700 legacy=0x7f677406c510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:50:08.738 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:08.735+0000 7f677a4b9640 1 -- 172.21.15.40:0/2796571500 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67740cde40 con 0x7f677415f260 2023-12-17T11:50:08.739 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:08.737+0000 7f677a4b9640 1 --2- 172.21.15.40:0/2796571500 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f677415f260 0x7f67740ccb00 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f67740b5050 tx=0x7f677002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=edcc7d1b61250282 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:50:08.739 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:08.737+0000 7f67794b7640 1 -- 172.21.15.40:0/2796571500 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6770031830 con 0x7f677415f260 2023-12-17T11:50:08.739 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:08.737+0000 7f67794b7640 1 -- 172.21.15.40:0/2796571500 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6770031990 con 0x7f677415f260 2023-12-17T11:50:08.739 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:08.737+0000 7f67794b7640 1 -- 172.21.15.40:0/2796571500 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6770031d20 con 0x7f677415f260 2023-12-17T11:50:08.740 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:08.738+0000 7f677c71d640 1 -- 172.21.15.40:0/2796571500 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f677415f260 msgr2=0x7f67740ccb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:50:08.740 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:08.738+0000 7f677c71d640 1 --2- 172.21.15.40:0/2796571500 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f677415f260 0x7f67740ccb00 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f67740b5050 tx=0x7f677002b8d0 comp rx=0 tx=0).stop 2023-12-17T11:50:08.740 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:08.738+0000 7f677c71d640 1 -- 172.21.15.40:0/2796571500 shutdown_connections 2023-12-17T11:50:08.740 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:08.738+0000 7f677c71d640 1 --2- 172.21.15.40:0/2796571500 >> v2:172.21.15.159:3300/0 conn(0x7f67741626b0 0x7f67740701c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:50:08.740 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:08.738+0000 7f677c71d640 1 --2- 172.21.15.40:0/2796571500 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f677415f260 0x7f67740ccb00 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:50:08.740 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:08.738+0000 7f677c71d640 1 -- 172.21.15.40:0/2796571500 >> 172.21.15.40:0/2796571500 conn(0x7f67740b0a90 msgr2=0x7f67740b0e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:50:08.740 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:08.738+0000 7f677c71d640 1 -- 172.21.15.40:0/2796571500 shutdown_connections 2023-12-17T11:50:08.740 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:08.738+0000 7f677c71d640 1 -- 172.21.15.40:0/2796571500 wait complete. 2023-12-17T11:50:08.742 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:08.740+0000 7f677c71d640 1 Processor -- start 2023-12-17T11:50:08.742 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:08.740+0000 7f677c71d640 1 -- start start 2023-12-17T11:50:08.745 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:08.741+0000 7f677c71d640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6774070700 0x7f67740b4330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:50:08.745 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:08.741+0000 7f677c71d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f677415f260 0x7f677415a410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:50:08.745 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:08.741+0000 7f677c71d640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f67741626b0 0x7f677415a950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:50:08.745 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:08.741+0000 7f677c71d640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67740b4870 con 0x7f677415f260 2023-12-17T11:50:08.745 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:08.741+0000 7f677c71d640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f677414bd10 con 0x7f6774070700 2023-12-17T11:50:08.745 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:08.741+0000 7f677c71d640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67741fb010 con 0x7f67741626b0 2023-12-17T11:50:08.745 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:08.741+0000 7f6779cb8640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f677415f260 0x7f677415a410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:50:08.745 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:08.741+0000 7f6779cb8640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f677415f260 0x7f677415a410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:40730/0 (socket says 172.21.15.40:40730) 2023-12-17T11:50:08.746 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:08.741+0000 7f6779cb8640 1 -- 172.21.15.40:0/2168335954 learned_addr learned my addr 172.21.15.40:0/2168335954 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-17T11:50:08.746 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:08.742+0000 7f677a4b9640 1 --2- 172.21.15.40:0/2168335954 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6774070700 0x7f67740b4330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:50:08.746 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:08.742+0000 7f6779cb8640 1 -- 172.21.15.40:0/2168335954 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f67741626b0 msgr2=0x7f677415a950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:50:08.746 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:08.742+0000 7f6779cb8640 1 --2- 172.21.15.40:0/2168335954 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f67741626b0 0x7f677415a950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:50:08.746 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:08.742+0000 7f6779cb8640 1 -- 172.21.15.40:0/2168335954 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6774070700 msgr2=0x7f67740b4330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:50:08.746 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:08.742+0000 7f6779cb8640 1 --2- 172.21.15.40:0/2168335954 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6774070700 0x7f67740b4330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:50:08.746 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:08.742+0000 7f6779cb8640 1 -- 172.21.15.40:0/2168335954 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6770009400 con 0x7f677415f260 2023-12-17T11:50:08.746 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:08.742+0000 7f6779cb8640 1 --2- 172.21.15.40:0/2168335954 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f677415f260 0x7f677415a410 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f676400d5f0 tx=0x7f676400dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:50:08.746 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:08.742+0000 7f676affd640 1 -- 172.21.15.40:0/2168335954 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67640125f0 con 0x7f677415f260 2023-12-17T11:50:08.747 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:08.742+0000 7f676affd640 1 -- 172.21.15.40:0/2168335954 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6764012750 con 0x7f677415f260 2023-12-17T11:50:08.747 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:08.742+0000 7f676affd640 1 -- 172.21.15.40:0/2168335954 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6764012b00 con 0x7f677415f260 2023-12-17T11:50:08.747 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:08.742+0000 7f677c71d640 1 -- 172.21.15.40:0/2168335954 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f677414bfa0 con 0x7f677415f260 2023-12-17T11:50:08.747 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:08.743+0000 7f677c71d640 1 -- 172.21.15.40:0/2168335954 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f677414c560 con 0x7f677415f260 2023-12-17T11:50:08.748 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:08.744+0000 7f677c71d640 1 -- 172.21.15.40:0/2168335954 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f677414c720 con 0x7f677415f260 2023-12-17T11:50:08.748 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:08.745+0000 7f676affd640 1 -- 172.21.15.40:0/2168335954 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f6764012c60 con 0x7f677415f260 2023-12-17T11:50:08.748 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:08.745+0000 7f676affd640 1 --2- 172.21.15.40:0/2168335954 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f675806ae40 0x7f675806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:50:08.748 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:08.746+0000 7f676affd640 1 -- 172.21.15.40:0/2168335954 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f6764089ce0 con 0x7f677415f260 2023-12-17T11:50:08.748 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:08.746+0000 7f677a4b9640 1 --2- 172.21.15.40:0/2168335954 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f675806ae40 0x7f675806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:50:08.749 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:08.747+0000 7f677a4b9640 1 --2- 172.21.15.40:0/2168335954 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f675806ae40 0x7f675806d300 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f6770036000 tx=0x7f6770008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:50:08.752 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:08.751+0000 7f676affd640 1 -- 172.21.15.40:0/2168335954 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f6764054b90 con 0x7f677415f260 2023-12-17T11:50:08.942 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:08.940+0000 7f677c71d640 1 -- 172.21.15.40:0/2168335954 --> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f67740cd510 con 0x7f675806ae40 2023-12-17T11:50:08.965 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:08.963+0000 7f676affd640 1 -- 172.21.15.40:0/2168335954 <== mgr.4105 v2:172.21.15.159:6832/479465803 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286503 (secure 0 0 0) 0x7f6770045400 con 0x7f675806ae40 2023-12-17T11:50:08.969 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T11:50:08.971 INFO:teuthology.orchestra.run.smithi040.stderr:dumped all 2023-12-17T11:50:08.973 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:08.968+0000 7f677c71d640 1 -- 172.21.15.40:0/2168335954 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f675806ae40 msgr2=0x7f675806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:50:08.973 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:08.968+0000 7f677c71d640 1 --2- 172.21.15.40:0/2168335954 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f675806ae40 0x7f675806d300 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f6770036000 tx=0x7f6770008030 comp rx=0 tx=0).stop 2023-12-17T11:50:08.974 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:08.968+0000 7f677c71d640 1 -- 172.21.15.40:0/2168335954 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f677415f260 msgr2=0x7f677415a410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:50:08.974 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:08.968+0000 7f677c71d640 1 --2- 172.21.15.40:0/2168335954 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f677415f260 0x7f677415a410 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f676400d5f0 tx=0x7f676400dab0 comp rx=0 tx=0).stop 2023-12-17T11:50:08.974 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:08.968+0000 7f677c71d640 1 -- 172.21.15.40:0/2168335954 shutdown_connections 2023-12-17T11:50:08.974 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:08.968+0000 7f677c71d640 1 --2- 172.21.15.40:0/2168335954 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f675806ae40 0x7f675806d300 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:50:08.974 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:08.968+0000 7f677c71d640 1 --2- 172.21.15.40:0/2168335954 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f67741626b0 0x7f677415a950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:50:08.974 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:08.968+0000 7f677c71d640 1 --2- 172.21.15.40:0/2168335954 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f677415f260 0x7f677415a410 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:50:08.974 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:08.968+0000 7f677c71d640 1 --2- 172.21.15.40:0/2168335954 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6774070700 0x7f67740b4330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:50:08.974 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:08.968+0000 7f677c71d640 1 -- 172.21.15.40:0/2168335954 >> 172.21.15.40:0/2168335954 conn(0x7f67740b0a90 msgr2=0x7f677406c510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:50:08.974 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:08.969+0000 7f677c71d640 1 -- 172.21.15.40:0/2168335954 shutdown_connections 2023-12-17T11:50:08.974 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:08.969+0000 7f677c71d640 1 -- 172.21.15.40:0/2168335954 wait complete. 2023-12-17T11:50:08.989 INFO:teuthology.orchestra.run.smithi040.stdout:{"pg_ready":true,"pg_map":{"version":96,"stamp":"2023-12-17T11:50:08.635477+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":225332,"kb_used_data":5000,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754749388,"statfs":{"total":773094113280,"available":772863373312,"internally_reserved":0,"allocated":5120000,"data_stored":2866588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":225496626},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.116250"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-17T11:50:00.525487+0000","last_change":"2023-12-17T11:49:53.251801+0000","last_active":"2023-12-17T11:50:00.525487+0000","last_peered":"2023-12-17T11:50:00.525487+0000","last_clean":"2023-12-17T11:50:00.525487+0000","last_became_active":"2023-12-17T11:49:53.251221+0000","last_became_peered":"2023-12-17T11:49:53.251221+0000","last_unstale":"2023-12-17T11:50:00.525487+0000","last_undegraded":"2023-12-17T11:50:00.525487+0000","last_fullsized":"2023-12-17T11:50:00.525487+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T22:42:15.785143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-17T11:50:00.524627+0000","last_change":"2023-12-17T11:49:53.243478+0000","last_active":"2023-12-17T11:50:00.524627+0000","last_peered":"2023-12-17T11:50:00.524627+0000","last_clean":"2023-12-17T11:50:00.524627+0000","last_became_active":"2023-12-17T11:49:53.243179+0000","last_became_peered":"2023-12-17T11:49:53.243179+0000","last_unstale":"2023-12-17T11:50:00.524627+0000","last_undegraded":"2023-12-17T11:50:00.524627+0000","last_fullsized":"2023-12-17T11:50:00.524627+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T23:49:09.469993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-17T11:50:00.529653+0000","last_change":"2023-12-17T11:49:53.249501+0000","last_active":"2023-12-17T11:50:00.529653+0000","last_peered":"2023-12-17T11:50:00.529653+0000","last_clean":"2023-12-17T11:50:00.529653+0000","last_became_active":"2023-12-17T11:49:53.249212+0000","last_became_peered":"2023-12-17T11:49:53.249212+0000","last_unstale":"2023-12-17T11:50:00.529653+0000","last_undegraded":"2023-12-17T11:50:00.529653+0000","last_fullsized":"2023-12-17T11:50:00.529653+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T22:50:12.261960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-17T11:50:01.303372+0000","last_change":"2023-12-17T11:49:53.237486+0000","last_active":"2023-12-17T11:50:01.303372+0000","last_peered":"2023-12-17T11:50:01.303372+0000","last_clean":"2023-12-17T11:50:01.303372+0000","last_became_active":"2023-12-17T11:49:53.236766+0000","last_became_peered":"2023-12-17T11:49:53.236766+0000","last_unstale":"2023-12-17T11:50:01.303372+0000","last_undegraded":"2023-12-17T11:50:01.303372+0000","last_fullsized":"2023-12-17T11:50:01.303372+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T19:34:01.395947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-17T11:50:01.303292+0000","last_change":"2023-12-17T11:49:53.230175+0000","last_active":"2023-12-17T11:50:01.303292+0000","last_peered":"2023-12-17T11:50:01.303292+0000","last_clean":"2023-12-17T11:50:01.303292+0000","last_became_active":"2023-12-17T11:49:53.229756+0000","last_became_peered":"2023-12-17T11:49:53.229756+0000","last_unstale":"2023-12-17T11:50:01.303292+0000","last_undegraded":"2023-12-17T11:50:01.303292+0000","last_fullsized":"2023-12-17T11:50:01.303292+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T15:43:04.869288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-17T11:50:00.523170+0000","last_change":"2023-12-17T11:49:53.245040+0000","last_active":"2023-12-17T11:50:00.523170+0000","last_peered":"2023-12-17T11:50:00.523170+0000","last_clean":"2023-12-17T11:50:00.523170+0000","last_became_active":"2023-12-17T11:49:53.243989+0000","last_became_peered":"2023-12-17T11:49:53.243989+0000","last_unstale":"2023-12-17T11:50:00.523170+0000","last_undegraded":"2023-12-17T11:50:00.523170+0000","last_fullsized":"2023-12-17T11:50:00.523170+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T16:31:53.964205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-17T11:50:00.528791+0000","last_change":"2023-12-17T11:49:53.244506+0000","last_active":"2023-12-17T11:50:00.528791+0000","last_peered":"2023-12-17T11:50:00.528791+0000","last_clean":"2023-12-17T11:50:00.528791+0000","last_became_active":"2023-12-17T11:49:53.244244+0000","last_became_peered":"2023-12-17T11:49:53.244244+0000","last_unstale":"2023-12-17T11:50:00.528791+0000","last_undegraded":"2023-12-17T11:50:00.528791+0000","last_fullsized":"2023-12-17T11:50:00.528791+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T12:27:38.132749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-17T11:50:00.522397+0000","last_change":"2023-12-17T11:49:53.256713+0000","last_active":"2023-12-17T11:50:00.522397+0000","last_peered":"2023-12-17T11:50:00.522397+0000","last_clean":"2023-12-17T11:50:00.522397+0000","last_became_active":"2023-12-17T11:49:53.255850+0000","last_became_peered":"2023-12-17T11:49:53.255850+0000","last_unstale":"2023-12-17T11:50:00.522397+0000","last_undegraded":"2023-12-17T11:50:00.522397+0000","last_fullsized":"2023-12-17T11:50:00.522397+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T14:00:43.418107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-17T11:50:00.530083+0000","last_change":"2023-12-17T11:49:53.255007+0000","last_active":"2023-12-17T11:50:00.530083+0000","last_peered":"2023-12-17T11:50:00.530083+0000","last_clean":"2023-12-17T11:50:00.530083+0000","last_became_active":"2023-12-17T11:49:53.254750+0000","last_became_peered":"2023-12-17T11:49:53.254750+0000","last_unstale":"2023-12-17T11:50:00.530083+0000","last_undegraded":"2023-12-17T11:50:00.530083+0000","last_fullsized":"2023-12-17T11:50:00.530083+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T19:23:44.505187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-17T11:50:00.529928+0000","last_change":"2023-12-17T11:49:53.243885+0000","last_active":"2023-12-17T11:50:00.529928+0000","last_peered":"2023-12-17T11:50:00.529928+0000","last_clean":"2023-12-17T11:50:00.529928+0000","last_became_active":"2023-12-17T11:49:53.243586+0000","last_became_peered":"2023-12-17T11:49:53.243586+0000","last_unstale":"2023-12-17T11:50:00.529928+0000","last_undegraded":"2023-12-17T11:50:00.529928+0000","last_fullsized":"2023-12-17T11:50:00.529928+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T23:49:09.469993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-17T11:50:00.529560+0000","last_change":"2023-12-17T11:49:53.245071+0000","last_active":"2023-12-17T11:50:00.529560+0000","last_peered":"2023-12-17T11:50:00.529560+0000","last_clean":"2023-12-17T11:50:00.529560+0000","last_became_active":"2023-12-17T11:49:53.244696+0000","last_became_peered":"2023-12-17T11:49:53.244696+0000","last_unstale":"2023-12-17T11:50:00.529560+0000","last_undegraded":"2023-12-17T11:50:00.529560+0000","last_fullsized":"2023-12-17T11:50:00.529560+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T17:56:09.285369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-17T11:50:00.529492+0000","last_change":"2023-12-17T11:49:53.244437+0000","last_active":"2023-12-17T11:50:00.529492+0000","last_peered":"2023-12-17T11:50:00.529492+0000","last_clean":"2023-12-17T11:50:00.529492+0000","last_became_active":"2023-12-17T11:49:53.244158+0000","last_became_peered":"2023-12-17T11:49:53.244158+0000","last_unstale":"2023-12-17T11:50:00.529492+0000","last_undegraded":"2023-12-17T11:50:00.529492+0000","last_fullsized":"2023-12-17T11:50:00.529492+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T12:12:45.651530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-17T11:50:00.529005+0000","last_change":"2023-12-17T11:49:53.259954+0000","last_active":"2023-12-17T11:50:00.529005+0000","last_peered":"2023-12-17T11:50:00.529005+0000","last_clean":"2023-12-17T11:50:00.529005+0000","last_became_active":"2023-12-17T11:49:53.259683+0000","last_became_peered":"2023-12-17T11:49:53.259683+0000","last_unstale":"2023-12-17T11:50:00.529005+0000","last_undegraded":"2023-12-17T11:50:00.529005+0000","last_fullsized":"2023-12-17T11:50:00.529005+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T13:29:29.953615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-17T11:50:00.522506+0000","last_change":"2023-12-17T11:49:53.251388+0000","last_active":"2023-12-17T11:50:00.522506+0000","last_peered":"2023-12-17T11:50:00.522506+0000","last_clean":"2023-12-17T11:50:00.522506+0000","last_became_active":"2023-12-17T11:49:53.251182+0000","last_became_peered":"2023-12-17T11:49:53.251182+0000","last_unstale":"2023-12-17T11:50:00.522506+0000","last_undegraded":"2023-12-17T11:50:00.522506+0000","last_fullsized":"2023-12-17T11:50:00.522506+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T19:39:18.340154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-17T11:50:00.528861+0000","last_change":"2023-12-17T11:49:53.251484+0000","last_active":"2023-12-17T11:50:00.528861+0000","last_peered":"2023-12-17T11:50:00.528861+0000","last_clean":"2023-12-17T11:50:00.528861+0000","last_became_active":"2023-12-17T11:49:53.250825+0000","last_became_peered":"2023-12-17T11:49:53.250825+0000","last_unstale":"2023-12-17T11:50:00.528861+0000","last_undegraded":"2023-12-17T11:50:00.528861+0000","last_fullsized":"2023-12-17T11:50:00.528861+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T12:48:09.865175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:55.795131+0000","last_change":"2023-12-17T11:49:53.256736+0000","last_active":"2023-12-17T11:49:55.795131+0000","last_peered":"2023-12-17T11:49:55.795131+0000","last_clean":"2023-12-17T11:49:55.795131+0000","last_became_active":"2023-12-17T11:49:53.256319+0000","last_became_peered":"2023-12-17T11:49:53.256319+0000","last_unstale":"2023-12-17T11:49:55.795131+0000","last_undegraded":"2023-12-17T11:49:55.795131+0000","last_fullsized":"2023-12-17T11:49:55.795131+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T14:49:05.628056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:55.795758+0000","last_change":"2023-12-17T11:49:53.254466+0000","last_active":"2023-12-17T11:49:55.795758+0000","last_peered":"2023-12-17T11:49:55.795758+0000","last_clean":"2023-12-17T11:49:55.795758+0000","last_became_active":"2023-12-17T11:49:53.254191+0000","last_became_peered":"2023-12-17T11:49:53.254191+0000","last_unstale":"2023-12-17T11:49:55.795758+0000","last_undegraded":"2023-12-17T11:49:55.795758+0000","last_fullsized":"2023-12-17T11:49:55.795758+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T15:34:59.184998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-17T11:50:01.202677+0000","last_change":"2023-12-17T11:49:53.244371+0000","last_active":"2023-12-17T11:50:01.202677+0000","last_peered":"2023-12-17T11:50:01.202677+0000","last_clean":"2023-12-17T11:50:01.202677+0000","last_became_active":"2023-12-17T11:49:53.243288+0000","last_became_peered":"2023-12-17T11:49:53.243288+0000","last_unstale":"2023-12-17T11:50:01.202677+0000","last_undegraded":"2023-12-17T11:50:01.202677+0000","last_fullsized":"2023-12-17T11:50:01.202677+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T22:59:01.401999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-17T11:50:01.303607+0000","last_change":"2023-12-17T11:49:53.247133+0000","last_active":"2023-12-17T11:50:01.303607+0000","last_peered":"2023-12-17T11:50:01.303607+0000","last_clean":"2023-12-17T11:50:01.303607+0000","last_became_active":"2023-12-17T11:49:53.246863+0000","last_became_peered":"2023-12-17T11:49:53.246863+0000","last_unstale":"2023-12-17T11:50:01.303607+0000","last_undegraded":"2023-12-17T11:50:01.303607+0000","last_fullsized":"2023-12-17T11:50:01.303607+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T15:22:56.669665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-17T11:50:01.202405+0000","last_change":"2023-12-17T11:49:53.234246+0000","last_active":"2023-12-17T11:50:01.202405+0000","last_peered":"2023-12-17T11:50:01.202405+0000","last_clean":"2023-12-17T11:50:01.202405+0000","last_became_active":"2023-12-17T11:49:53.233971+0000","last_became_peered":"2023-12-17T11:49:53.233971+0000","last_unstale":"2023-12-17T11:50:01.202405+0000","last_undegraded":"2023-12-17T11:50:01.202405+0000","last_fullsized":"2023-12-17T11:50:01.202405+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T21:22:15.324114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-17T11:50:00.529542+0000","last_change":"2023-12-17T11:49:53.254631+0000","last_active":"2023-12-17T11:50:00.529542+0000","last_peered":"2023-12-17T11:50:00.529542+0000","last_clean":"2023-12-17T11:50:00.529542+0000","last_became_active":"2023-12-17T11:49:53.254246+0000","last_became_peered":"2023-12-17T11:49:53.254246+0000","last_unstale":"2023-12-17T11:50:00.529542+0000","last_undegraded":"2023-12-17T11:50:00.529542+0000","last_fullsized":"2023-12-17T11:50:00.529542+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T15:42:47.132551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-17T11:50:00.523985+0000","last_change":"2023-12-17T11:49:53.233281+0000","last_active":"2023-12-17T11:50:00.523985+0000","last_peered":"2023-12-17T11:50:00.523985+0000","last_clean":"2023-12-17T11:50:00.523985+0000","last_became_active":"2023-12-17T11:49:53.233006+0000","last_became_peered":"2023-12-17T11:49:53.233006+0000","last_unstale":"2023-12-17T11:50:00.523985+0000","last_undegraded":"2023-12-17T11:50:00.523985+0000","last_fullsized":"2023-12-17T11:50:00.523985+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T17:37:46.058341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:55.795311+0000","last_change":"2023-12-17T11:49:53.235006+0000","last_active":"2023-12-17T11:49:55.795311+0000","last_peered":"2023-12-17T11:49:55.795311+0000","last_clean":"2023-12-17T11:49:55.795311+0000","last_became_active":"2023-12-17T11:49:53.232828+0000","last_became_peered":"2023-12-17T11:49:53.232828+0000","last_unstale":"2023-12-17T11:49:55.795311+0000","last_undegraded":"2023-12-17T11:49:55.795311+0000","last_fullsized":"2023-12-17T11:49:55.795311+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T21:34:46.442330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-17T11:50:01.303767+0000","last_change":"2023-12-17T11:49:53.229937+0000","last_active":"2023-12-17T11:50:01.303767+0000","last_peered":"2023-12-17T11:50:01.303767+0000","last_clean":"2023-12-17T11:50:01.303767+0000","last_became_active":"2023-12-17T11:49:53.229360+0000","last_became_peered":"2023-12-17T11:49:53.229360+0000","last_unstale":"2023-12-17T11:50:01.303767+0000","last_undegraded":"2023-12-17T11:50:01.303767+0000","last_fullsized":"2023-12-17T11:50:01.303767+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T13:22:57.464897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-17T11:50:01.202634+0000","last_change":"2023-12-17T11:49:53.248140+0000","last_active":"2023-12-17T11:50:01.202634+0000","last_peered":"2023-12-17T11:50:01.202634+0000","last_clean":"2023-12-17T11:50:01.202634+0000","last_became_active":"2023-12-17T11:49:53.246139+0000","last_became_peered":"2023-12-17T11:49:53.246139+0000","last_unstale":"2023-12-17T11:50:01.202634+0000","last_undegraded":"2023-12-17T11:50:01.202634+0000","last_fullsized":"2023-12-17T11:50:01.202634+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T14:32:00.462222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-17T11:50:00.523471+0000","last_change":"2023-12-17T11:49:53.255892+0000","last_active":"2023-12-17T11:50:00.523471+0000","last_peered":"2023-12-17T11:50:00.523471+0000","last_clean":"2023-12-17T11:50:00.523471+0000","last_became_active":"2023-12-17T11:49:53.255307+0000","last_became_peered":"2023-12-17T11:49:53.255307+0000","last_unstale":"2023-12-17T11:50:00.523471+0000","last_undegraded":"2023-12-17T11:50:00.523471+0000","last_fullsized":"2023-12-17T11:50:00.523471+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T17:37:46.058341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-17T11:50:01.202692+0000","last_change":"2023-12-17T11:49:53.238527+0000","last_active":"2023-12-17T11:50:01.202692+0000","last_peered":"2023-12-17T11:50:01.202692+0000","last_clean":"2023-12-17T11:50:01.202692+0000","last_became_active":"2023-12-17T11:49:53.238260+0000","last_became_peered":"2023-12-17T11:49:53.238260+0000","last_unstale":"2023-12-17T11:50:01.202692+0000","last_undegraded":"2023-12-17T11:50:01.202692+0000","last_fullsized":"2023-12-17T11:50:01.202692+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T14:03:14.332356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-17T11:50:00.529245+0000","last_change":"2023-12-17T11:49:53.247243+0000","last_active":"2023-12-17T11:50:00.529245+0000","last_peered":"2023-12-17T11:50:00.529245+0000","last_clean":"2023-12-17T11:50:00.529245+0000","last_became_active":"2023-12-17T11:49:53.246983+0000","last_became_peered":"2023-12-17T11:49:53.246983+0000","last_unstale":"2023-12-17T11:50:00.529245+0000","last_undegraded":"2023-12-17T11:50:00.529245+0000","last_fullsized":"2023-12-17T11:50:00.529245+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T23:33:06.562683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-17T11:50:01.202387+0000","last_change":"2023-12-17T11:49:53.247287+0000","last_active":"2023-12-17T11:50:01.202387+0000","last_peered":"2023-12-17T11:50:01.202387+0000","last_clean":"2023-12-17T11:50:01.202387+0000","last_became_active":"2023-12-17T11:49:53.246995+0000","last_became_peered":"2023-12-17T11:49:53.246995+0000","last_unstale":"2023-12-17T11:50:01.202387+0000","last_undegraded":"2023-12-17T11:50:01.202387+0000","last_fullsized":"2023-12-17T11:50:01.202387+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T14:03:09.358474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-17T11:50:01.202183+0000","last_change":"2023-12-17T11:49:53.240901+0000","last_active":"2023-12-17T11:50:01.202183+0000","last_peered":"2023-12-17T11:50:01.202183+0000","last_clean":"2023-12-17T11:50:01.202183+0000","last_became_active":"2023-12-17T11:49:53.240589+0000","last_became_peered":"2023-12-17T11:49:53.240589+0000","last_unstale":"2023-12-17T11:50:01.202183+0000","last_undegraded":"2023-12-17T11:50:01.202183+0000","last_fullsized":"2023-12-17T11:50:01.202183+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T19:17:47.294209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:55.795352+0000","last_change":"2023-12-17T11:49:53.239855+0000","last_active":"2023-12-17T11:49:55.795352+0000","last_peered":"2023-12-17T11:49:55.795352+0000","last_clean":"2023-12-17T11:49:55.795352+0000","last_became_active":"2023-12-17T11:49:53.239579+0000","last_became_peered":"2023-12-17T11:49:53.239579+0000","last_unstale":"2023-12-17T11:49:55.795352+0000","last_undegraded":"2023-12-17T11:49:55.795352+0000","last_fullsized":"2023-12-17T11:49:55.795352+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T20:29:09.996550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-17T11:50:00.522960+0000","last_change":"2023-12-17T11:49:53.252543+0000","last_active":"2023-12-17T11:50:00.522960+0000","last_peered":"2023-12-17T11:50:00.522960+0000","last_clean":"2023-12-17T11:50:00.522960+0000","last_became_active":"2023-12-17T11:49:53.250790+0000","last_became_peered":"2023-12-17T11:49:53.250790+0000","last_unstale":"2023-12-17T11:50:00.522960+0000","last_undegraded":"2023-12-17T11:50:00.522960+0000","last_fullsized":"2023-12-17T11:50:00.522960+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T19:00:07.905809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:55.795567+0000","last_change":"2023-12-17T11:49:53.245226+0000","last_active":"2023-12-17T11:49:55.795567+0000","last_peered":"2023-12-17T11:49:55.795567+0000","last_clean":"2023-12-17T11:49:55.795567+0000","last_became_active":"2023-12-17T11:49:53.243115+0000","last_became_peered":"2023-12-17T11:49:53.243115+0000","last_unstale":"2023-12-17T11:49:55.795567+0000","last_undegraded":"2023-12-17T11:49:55.795567+0000","last_fullsized":"2023-12-17T11:49:55.795567+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T15:06:34.831619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"39'4","reported_seq":18,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-17T11:50:01.202725+0000","last_change":"2023-12-17T11:49:52.226944+0000","last_active":"2023-12-17T11:50:01.202725+0000","last_peered":"2023-12-17T11:50:01.202725+0000","last_clean":"2023-12-17T11:50:01.202725+0000","last_became_active":"2023-12-17T11:49:52.226659+0000","last_became_peered":"2023-12-17T11:49:52.226659+0000","last_unstale":"2023-12-17T11:50:01.202725+0000","last_undegraded":"2023-12-17T11:50:01.202725+0000","last_fullsized":"2023-12-17T11:50:01.202725+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_clean_scrub_stamp":"2023-12-17T11:49:51.168108+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T13:22:56.453467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-17T11:50:00.523987+0000","last_change":"2023-12-17T11:49:53.254791+0000","last_active":"2023-12-17T11:50:00.523987+0000","last_peered":"2023-12-17T11:50:00.523987+0000","last_clean":"2023-12-17T11:50:00.523987+0000","last_became_active":"2023-12-17T11:49:53.254496+0000","last_became_peered":"2023-12-17T11:49:53.254496+0000","last_unstale":"2023-12-17T11:50:00.523987+0000","last_undegraded":"2023-12-17T11:50:00.523987+0000","last_fullsized":"2023-12-17T11:50:00.523987+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T14:42:29.543380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"39'1","reported_seq":15,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-17T11:50:00.529763+0000","last_change":"2023-12-17T11:49:52.223256+0000","last_active":"2023-12-17T11:50:00.529763+0000","last_peered":"2023-12-17T11:50:00.529763+0000","last_clean":"2023-12-17T11:50:00.529763+0000","last_became_active":"2023-12-17T11:49:52.222808+0000","last_became_peered":"2023-12-17T11:49:52.222808+0000","last_unstale":"2023-12-17T11:50:00.529763+0000","last_undegraded":"2023-12-17T11:50:00.529763+0000","last_fullsized":"2023-12-17T11:50:00.529763+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_clean_scrub_stamp":"2023-12-17T11:49:51.168108+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T16:31:52.952775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-17T11:50:00.523143+0000","last_change":"2023-12-17T11:49:53.251178+0000","last_active":"2023-12-17T11:50:00.523143+0000","last_peered":"2023-12-17T11:50:00.523143+0000","last_clean":"2023-12-17T11:50:00.523143+0000","last_became_active":"2023-12-17T11:49:53.250223+0000","last_became_peered":"2023-12-17T11:49:53.250223+0000","last_unstale":"2023-12-17T11:50:00.523143+0000","last_undegraded":"2023-12-17T11:50:00.523143+0000","last_fullsized":"2023-12-17T11:50:00.523143+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T23:10:56.100255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"39'2","reported_seq":16,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-17T11:50:00.524369+0000","last_change":"2023-12-17T11:49:52.223879+0000","last_active":"2023-12-17T11:50:00.524369+0000","last_peered":"2023-12-17T11:50:00.524369+0000","last_clean":"2023-12-17T11:50:00.524369+0000","last_became_active":"2023-12-17T11:49:52.223602+0000","last_became_peered":"2023-12-17T11:49:52.223602+0000","last_unstale":"2023-12-17T11:50:00.524369+0000","last_undegraded":"2023-12-17T11:50:00.524369+0000","last_fullsized":"2023-12-17T11:50:00.524369+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_clean_scrub_stamp":"2023-12-17T11:49:51.168108+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T15:25:46.493177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-17T11:50:00.525262+0000","last_change":"2023-12-17T11:49:53.254646+0000","last_active":"2023-12-17T11:50:00.525262+0000","last_peered":"2023-12-17T11:50:00.525262+0000","last_clean":"2023-12-17T11:50:00.525262+0000","last_became_active":"2023-12-17T11:49:53.254368+0000","last_became_peered":"2023-12-17T11:49:53.254368+0000","last_unstale":"2023-12-17T11:50:00.525262+0000","last_undegraded":"2023-12-17T11:50:00.525262+0000","last_fullsized":"2023-12-17T11:50:00.525262+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T15:42:47.132551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"39'2","reported_seq":16,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-17T11:50:00.523260+0000","last_change":"2023-12-17T11:49:52.221006+0000","last_active":"2023-12-17T11:50:00.523260+0000","last_peered":"2023-12-17T11:50:00.523260+0000","last_clean":"2023-12-17T11:50:00.523260+0000","last_became_active":"2023-12-17T11:49:52.220514+0000","last_became_peered":"2023-12-17T11:49:52.220514+0000","last_unstale":"2023-12-17T11:50:00.523260+0000","last_undegraded":"2023-12-17T11:50:00.523260+0000","last_fullsized":"2023-12-17T11:50:00.523260+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_clean_scrub_stamp":"2023-12-17T11:49:51.168108+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T15:25:46.493177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-17T11:50:00.528932+0000","last_change":"2023-12-17T11:49:53.251737+0000","last_active":"2023-12-17T11:50:00.528932+0000","last_peered":"2023-12-17T11:50:00.528932+0000","last_clean":"2023-12-17T11:50:00.528932+0000","last_became_active":"2023-12-17T11:49:53.251458+0000","last_became_peered":"2023-12-17T11:49:53.251458+0000","last_unstale":"2023-12-17T11:50:00.528932+0000","last_undegraded":"2023-12-17T11:50:00.528932+0000","last_fullsized":"2023-12-17T11:50:00.528932+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T17:37:46.058341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"39'1","reported_seq":15,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-17T11:50:00.529332+0000","last_change":"2023-12-17T11:49:52.226918+0000","last_active":"2023-12-17T11:50:00.529332+0000","last_peered":"2023-12-17T11:50:00.529332+0000","last_clean":"2023-12-17T11:50:00.529332+0000","last_became_active":"2023-12-17T11:49:52.226455+0000","last_became_peered":"2023-12-17T11:49:52.226455+0000","last_unstale":"2023-12-17T11:50:00.529332+0000","last_undegraded":"2023-12-17T11:50:00.529332+0000","last_fullsized":"2023-12-17T11:50:00.529332+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_clean_scrub_stamp":"2023-12-17T11:49:51.168108+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T12:12:44.640100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-17T11:50:00.529065+0000","last_change":"2023-12-17T11:49:53.251691+0000","last_active":"2023-12-17T11:50:00.529065+0000","last_peered":"2023-12-17T11:50:00.529065+0000","last_clean":"2023-12-17T11:50:00.529065+0000","last_became_active":"2023-12-17T11:49:53.251175+0000","last_became_peered":"2023-12-17T11:49:53.251175+0000","last_unstale":"2023-12-17T11:50:00.529065+0000","last_undegraded":"2023-12-17T11:50:00.529065+0000","last_fullsized":"2023-12-17T11:50:00.529065+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T14:00:43.418107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"39'1","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:55.795479+0000","last_change":"2023-12-17T11:49:52.225053+0000","last_active":"2023-12-17T11:49:55.795479+0000","last_peered":"2023-12-17T11:49:55.795479+0000","last_clean":"2023-12-17T11:49:55.795479+0000","last_became_active":"2023-12-17T11:49:52.224761+0000","last_became_peered":"2023-12-17T11:49:52.224761+0000","last_unstale":"2023-12-17T11:49:55.795479+0000","last_undegraded":"2023-12-17T11:49:55.795479+0000","last_fullsized":"2023-12-17T11:49:55.795479+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_clean_scrub_stamp":"2023-12-17T11:49:51.168108+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T20:30:07.106128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":20,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-12-17T11:50:02.268429+0000","last_change":"2023-12-17T11:50:02.268429+0000","last_active":"2023-12-17T11:50:02.268429+0000","last_peered":"2023-12-17T11:50:02.268429+0000","last_clean":"2023-12-17T11:50:02.268429+0000","last_became_active":"2023-12-17T11:50:02.267857+0000","last_became_peered":"2023-12-17T11:50:02.267857+0000","last_unstale":"2023-12-17T11:50:02.268429+0000","last_undegraded":"2023-12-17T11:50:02.268429+0000","last_fullsized":"2023-12-17T11:50:02.268429+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T19:23:44.505187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-17T11:50:00.523140+0000","last_change":"2023-12-17T11:49:52.230598+0000","last_active":"2023-12-17T11:50:00.523140+0000","last_peered":"2023-12-17T11:50:00.523140+0000","last_clean":"2023-12-17T11:50:00.523140+0000","last_became_active":"2023-12-17T11:49:52.230298+0000","last_became_peered":"2023-12-17T11:49:52.230298+0000","last_unstale":"2023-12-17T11:50:00.523140+0000","last_undegraded":"2023-12-17T11:50:00.523140+0000","last_fullsized":"2023-12-17T11:50:00.523140+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_clean_scrub_stamp":"2023-12-17T11:49:51.168108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T22:39:30.094160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-17T11:50:00.523881+0000","last_change":"2023-12-17T11:49:53.249431+0000","last_active":"2023-12-17T11:50:00.523881+0000","last_peered":"2023-12-17T11:50:00.523881+0000","last_clean":"2023-12-17T11:50:00.523881+0000","last_became_active":"2023-12-17T11:49:53.248943+0000","last_became_peered":"2023-12-17T11:49:53.248943+0000","last_unstale":"2023-12-17T11:50:00.523881+0000","last_undegraded":"2023-12-17T11:50:00.523881+0000","last_fullsized":"2023-12-17T11:50:00.523881+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T16:21:14.355302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-17T11:50:00.522481+0000","last_change":"2023-12-17T11:49:52.224198+0000","last_active":"2023-12-17T11:50:00.522481+0000","last_peered":"2023-12-17T11:50:00.522481+0000","last_clean":"2023-12-17T11:50:00.522481+0000","last_became_active":"2023-12-17T11:49:52.223829+0000","last_became_peered":"2023-12-17T11:49:52.223829+0000","last_unstale":"2023-12-17T11:50:00.522481+0000","last_undegraded":"2023-12-17T11:50:00.522481+0000","last_fullsized":"2023-12-17T11:50:00.522481+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_clean_scrub_stamp":"2023-12-17T11:49:51.168108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T13:20:29.045455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-17T11:50:01.303367+0000","last_change":"2023-12-17T11:49:53.232883+0000","last_active":"2023-12-17T11:50:01.303367+0000","last_peered":"2023-12-17T11:50:01.303367+0000","last_clean":"2023-12-17T11:50:01.303367+0000","last_became_active":"2023-12-17T11:49:53.232629+0000","last_became_peered":"2023-12-17T11:49:53.232629+0000","last_unstale":"2023-12-17T11:50:01.303367+0000","last_undegraded":"2023-12-17T11:50:01.303367+0000","last_fullsized":"2023-12-17T11:50:01.303367+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T18:07:10.105462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-17T11:50:00.525489+0000","last_change":"2023-12-17T11:49:52.215890+0000","last_active":"2023-12-17T11:50:00.525489+0000","last_peered":"2023-12-17T11:50:00.525489+0000","last_clean":"2023-12-17T11:50:00.525489+0000","last_became_active":"2023-12-17T11:49:52.215576+0000","last_became_peered":"2023-12-17T11:49:52.215576+0000","last_unstale":"2023-12-17T11:50:00.525489+0000","last_undegraded":"2023-12-17T11:50:00.525489+0000","last_fullsized":"2023-12-17T11:50:00.525489+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_clean_scrub_stamp":"2023-12-17T11:49:51.168108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T17:03:59.637357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:55.795673+0000","last_change":"2023-12-17T11:49:53.236661+0000","last_active":"2023-12-17T11:49:55.795673+0000","last_peered":"2023-12-17T11:49:55.795673+0000","last_clean":"2023-12-17T11:49:55.795673+0000","last_became_active":"2023-12-17T11:49:53.236319+0000","last_became_peered":"2023-12-17T11:49:53.236319+0000","last_unstale":"2023-12-17T11:49:55.795673+0000","last_undegraded":"2023-12-17T11:49:55.795673+0000","last_fullsized":"2023-12-17T11:49:55.795673+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T13:29:01.309715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-17T11:50:00.530428+0000","last_change":"2023-12-17T11:49:52.233070+0000","last_active":"2023-12-17T11:50:00.530428+0000","last_peered":"2023-12-17T11:50:00.530428+0000","last_clean":"2023-12-17T11:50:00.530428+0000","last_became_active":"2023-12-17T11:49:52.232635+0000","last_became_peered":"2023-12-17T11:49:52.232635+0000","last_unstale":"2023-12-17T11:50:00.530428+0000","last_undegraded":"2023-12-17T11:50:00.530428+0000","last_fullsized":"2023-12-17T11:50:00.530428+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_clean_scrub_stamp":"2023-12-17T11:49:51.168108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T15:53:07.030004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-17T11:50:00.529654+0000","last_change":"2023-12-17T11:49:53.246755+0000","last_active":"2023-12-17T11:50:00.529654+0000","last_peered":"2023-12-17T11:50:00.529654+0000","last_clean":"2023-12-17T11:50:00.529654+0000","last_became_active":"2023-12-17T11:49:53.245111+0000","last_became_peered":"2023-12-17T11:49:53.245111+0000","last_unstale":"2023-12-17T11:50:00.529654+0000","last_undegraded":"2023-12-17T11:50:00.529654+0000","last_fullsized":"2023-12-17T11:50:00.529654+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T14:59:11.557660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"39'3","reported_seq":17,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-17T11:50:00.529919+0000","last_change":"2023-12-17T11:49:52.231475+0000","last_active":"2023-12-17T11:50:00.529919+0000","last_peered":"2023-12-17T11:50:00.529919+0000","last_clean":"2023-12-17T11:50:00.529919+0000","last_became_active":"2023-12-17T11:49:52.230061+0000","last_became_peered":"2023-12-17T11:49:52.230061+0000","last_unstale":"2023-12-17T11:50:00.529919+0000","last_undegraded":"2023-12-17T11:50:00.529919+0000","last_fullsized":"2023-12-17T11:50:00.529919+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_clean_scrub_stamp":"2023-12-17T11:49:51.168108+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T22:50:11.250530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-17T11:50:00.523324+0000","last_change":"2023-12-17T11:49:53.232224+0000","last_active":"2023-12-17T11:50:00.523324+0000","last_peered":"2023-12-17T11:50:00.523324+0000","last_clean":"2023-12-17T11:50:00.523324+0000","last_became_active":"2023-12-17T11:49:53.231963+0000","last_became_peered":"2023-12-17T11:49:53.231963+0000","last_unstale":"2023-12-17T11:50:00.523324+0000","last_undegraded":"2023-12-17T11:50:00.523324+0000","last_fullsized":"2023-12-17T11:50:00.523324+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T15:14:36.959400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"39'6","reported_seq":20,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-17T11:50:00.524725+0000","last_change":"2023-12-17T11:49:52.220583+0000","last_active":"2023-12-17T11:50:00.524725+0000","last_peered":"2023-12-17T11:50:00.524725+0000","last_clean":"2023-12-17T11:50:00.524725+0000","last_became_active":"2023-12-17T11:49:52.220304+0000","last_became_peered":"2023-12-17T11:49:52.220304+0000","last_unstale":"2023-12-17T11:50:00.524725+0000","last_undegraded":"2023-12-17T11:50:00.524725+0000","last_fullsized":"2023-12-17T11:50:00.524725+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_clean_scrub_stamp":"2023-12-17T11:49:51.168108+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T12:27:37.121319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-17T11:50:00.528938+0000","last_change":"2023-12-17T11:49:53.248442+0000","last_active":"2023-12-17T11:50:00.528938+0000","last_peered":"2023-12-17T11:50:00.528938+0000","last_clean":"2023-12-17T11:50:00.528938+0000","last_became_active":"2023-12-17T11:49:53.248094+0000","last_became_peered":"2023-12-17T11:49:53.248094+0000","last_unstale":"2023-12-17T11:50:00.528938+0000","last_undegraded":"2023-12-17T11:50:00.528938+0000","last_fullsized":"2023-12-17T11:50:00.528938+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T14:42:29.543380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"39'2","reported_seq":16,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-17T11:50:00.524311+0000","last_change":"2023-12-17T11:49:52.213341+0000","last_active":"2023-12-17T11:50:00.524311+0000","last_peered":"2023-12-17T11:50:00.524311+0000","last_clean":"2023-12-17T11:50:00.524311+0000","last_became_active":"2023-12-17T11:49:52.213024+0000","last_became_peered":"2023-12-17T11:49:52.213024+0000","last_unstale":"2023-12-17T11:50:00.524311+0000","last_undegraded":"2023-12-17T11:50:00.524311+0000","last_fullsized":"2023-12-17T11:50:00.524311+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_clean_scrub_stamp":"2023-12-17T11:49:51.168108+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T20:34:24.431589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-17T11:50:00.522731+0000","last_change":"2023-12-17T11:49:53.238931+0000","last_active":"2023-12-17T11:50:00.522731+0000","last_peered":"2023-12-17T11:50:00.522731+0000","last_clean":"2023-12-17T11:50:00.522731+0000","last_became_active":"2023-12-17T11:49:53.238641+0000","last_became_peered":"2023-12-17T11:49:53.238641+0000","last_unstale":"2023-12-17T11:50:00.522731+0000","last_undegraded":"2023-12-17T11:50:00.522731+0000","last_fullsized":"2023-12-17T11:50:00.522731+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T13:29:29.953615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-17T11:50:00.523343+0000","last_change":"2023-12-17T11:49:52.232507+0000","last_active":"2023-12-17T11:50:00.523343+0000","last_peered":"2023-12-17T11:50:00.523343+0000","last_clean":"2023-12-17T11:50:00.523343+0000","last_became_active":"2023-12-17T11:49:52.232308+0000","last_became_peered":"2023-12-17T11:49:52.232308+0000","last_unstale":"2023-12-17T11:50:00.523343+0000","last_undegraded":"2023-12-17T11:50:00.523343+0000","last_fullsized":"2023-12-17T11:50:00.523343+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_clean_scrub_stamp":"2023-12-17T11:49:51.168108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T19:17:46.282779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:55.795434+0000","last_change":"2023-12-17T11:49:53.234701+0000","last_active":"2023-12-17T11:49:55.795434+0000","last_peered":"2023-12-17T11:49:55.795434+0000","last_clean":"2023-12-17T11:49:55.795434+0000","last_became_active":"2023-12-17T11:49:53.234389+0000","last_became_peered":"2023-12-17T11:49:53.234389+0000","last_unstale":"2023-12-17T11:49:55.795434+0000","last_undegraded":"2023-12-17T11:49:55.795434+0000","last_fullsized":"2023-12-17T11:49:55.795434+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T17:54:34.803705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-17T11:50:01.202070+0000","last_change":"2023-12-17T11:49:52.226465+0000","last_active":"2023-12-17T11:50:01.202070+0000","last_peered":"2023-12-17T11:50:01.202070+0000","last_clean":"2023-12-17T11:50:01.202070+0000","last_became_active":"2023-12-17T11:49:52.226191+0000","last_became_peered":"2023-12-17T11:49:52.226191+0000","last_unstale":"2023-12-17T11:50:01.202070+0000","last_undegraded":"2023-12-17T11:50:01.202070+0000","last_fullsized":"2023-12-17T11:50:01.202070+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_clean_scrub_stamp":"2023-12-17T11:49:51.168108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T18:03:39.554935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-17T11:50:00.524016+0000","last_change":"2023-12-17T11:49:53.254934+0000","last_active":"2023-12-17T11:50:00.524016+0000","last_peered":"2023-12-17T11:50:00.524016+0000","last_clean":"2023-12-17T11:50:00.524016+0000","last_became_active":"2023-12-17T11:49:53.254632+0000","last_became_peered":"2023-12-17T11:49:53.254632+0000","last_unstale":"2023-12-17T11:50:00.524016+0000","last_undegraded":"2023-12-17T11:50:00.524016+0000","last_fullsized":"2023-12-17T11:50:00.524016+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T23:33:06.562683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"39'8","reported_seq":21,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:55.795188+0000","last_change":"2023-12-17T11:49:52.226787+0000","last_active":"2023-12-17T11:49:55.795188+0000","last_peered":"2023-12-17T11:49:55.795188+0000","last_clean":"2023-12-17T11:49:55.795188+0000","last_became_active":"2023-12-17T11:49:52.226471+0000","last_became_peered":"2023-12-17T11:49:52.226471+0000","last_unstale":"2023-12-17T11:49:55.795188+0000","last_undegraded":"2023-12-17T11:49:55.795188+0000","last_fullsized":"2023-12-17T11:49:55.795188+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_clean_scrub_stamp":"2023-12-17T11:49:51.168108+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T17:27:58.587187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-17T11:50:00.524643+0000","last_change":"2023-12-17T11:49:53.253979+0000","last_active":"2023-12-17T11:50:00.524643+0000","last_peered":"2023-12-17T11:50:00.524643+0000","last_clean":"2023-12-17T11:50:00.524643+0000","last_became_active":"2023-12-17T11:49:53.253694+0000","last_became_peered":"2023-12-17T11:49:53.253694+0000","last_unstale":"2023-12-17T11:50:00.524643+0000","last_undegraded":"2023-12-17T11:50:00.524643+0000","last_fullsized":"2023-12-17T11:50:00.524643+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T19:26:47.162716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"39'1","reported_seq":15,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-17T11:50:00.530409+0000","last_change":"2023-12-17T11:49:52.231973+0000","last_active":"2023-12-17T11:50:00.530409+0000","last_peered":"2023-12-17T11:50:00.530409+0000","last_clean":"2023-12-17T11:50:00.530409+0000","last_became_active":"2023-12-17T11:49:52.231641+0000","last_became_peered":"2023-12-17T11:49:52.231641+0000","last_unstale":"2023-12-17T11:50:00.530409+0000","last_undegraded":"2023-12-17T11:50:00.530409+0000","last_fullsized":"2023-12-17T11:50:00.530409+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_clean_scrub_stamp":"2023-12-17T11:49:51.168108+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T20:34:24.431589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-17T11:50:00.529892+0000","last_change":"2023-12-17T11:49:53.253141+0000","last_active":"2023-12-17T11:50:00.529892+0000","last_peered":"2023-12-17T11:50:00.529892+0000","last_clean":"2023-12-17T11:50:00.529892+0000","last_became_active":"2023-12-17T11:49:53.252532+0000","last_became_peered":"2023-12-17T11:49:53.252532+0000","last_unstale":"2023-12-17T11:50:00.529892+0000","last_undegraded":"2023-12-17T11:50:00.529892+0000","last_fullsized":"2023-12-17T11:50:00.529892+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T22:42:15.785143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"39'2","reported_seq":16,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-17T11:50:00.523361+0000","last_change":"2023-12-17T11:49:52.230858+0000","last_active":"2023-12-17T11:50:00.523361+0000","last_peered":"2023-12-17T11:50:00.523361+0000","last_clean":"2023-12-17T11:50:00.523361+0000","last_became_active":"2023-12-17T11:49:52.230281+0000","last_became_peered":"2023-12-17T11:49:52.230281+0000","last_unstale":"2023-12-17T11:50:00.523361+0000","last_undegraded":"2023-12-17T11:50:00.523361+0000","last_fullsized":"2023-12-17T11:50:00.523361+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_clean_scrub_stamp":"2023-12-17T11:49:51.168108+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T22:39:30.094160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-17T11:50:00.523134+0000","last_change":"2023-12-17T11:49:53.251192+0000","last_active":"2023-12-17T11:50:00.523134+0000","last_peered":"2023-12-17T11:50:00.523134+0000","last_clean":"2023-12-17T11:50:00.523134+0000","last_became_active":"2023-12-17T11:49:53.250837+0000","last_became_peered":"2023-12-17T11:49:53.250837+0000","last_unstale":"2023-12-17T11:50:00.523134+0000","last_undegraded":"2023-12-17T11:50:00.523134+0000","last_fullsized":"2023-12-17T11:50:00.523134+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T14:42:29.543380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"39'1","reported_seq":15,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-17T11:50:01.305583+0000","last_change":"2023-12-17T11:49:52.222238+0000","last_active":"2023-12-17T11:50:01.305583+0000","last_peered":"2023-12-17T11:50:01.305583+0000","last_clean":"2023-12-17T11:50:01.305583+0000","last_became_active":"2023-12-17T11:49:52.221941+0000","last_became_peered":"2023-12-17T11:49:52.221941+0000","last_unstale":"2023-12-17T11:50:01.305583+0000","last_undegraded":"2023-12-17T11:50:01.305583+0000","last_fullsized":"2023-12-17T11:50:01.305583+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_clean_scrub_stamp":"2023-12-17T11:49:51.168108+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T12:43:47.651883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-17T11:50:01.303648+0000","last_change":"2023-12-17T11:49:53.253162+0000","last_active":"2023-12-17T11:50:01.303648+0000","last_peered":"2023-12-17T11:50:01.303648+0000","last_clean":"2023-12-17T11:50:01.303648+0000","last_became_active":"2023-12-17T11:49:53.252770+0000","last_became_peered":"2023-12-17T11:49:53.252770+0000","last_unstale":"2023-12-17T11:50:01.303648+0000","last_undegraded":"2023-12-17T11:50:01.303648+0000","last_fullsized":"2023-12-17T11:50:01.303648+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T14:03:09.358474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-17T11:50:00.523470+0000","last_change":"2023-12-17T11:49:52.223776+0000","last_active":"2023-12-17T11:50:00.523470+0000","last_peered":"2023-12-17T11:50:00.523470+0000","last_clean":"2023-12-17T11:50:00.523470+0000","last_became_active":"2023-12-17T11:49:52.223571+0000","last_became_peered":"2023-12-17T11:49:52.223571+0000","last_unstale":"2023-12-17T11:50:00.523470+0000","last_undegraded":"2023-12-17T11:50:00.523470+0000","last_fullsized":"2023-12-17T11:50:00.523470+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_clean_scrub_stamp":"2023-12-17T11:49:51.168108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T22:59:00.390569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:55.795237+0000","last_change":"2023-12-17T11:49:53.232411+0000","last_active":"2023-12-17T11:49:55.795237+0000","last_peered":"2023-12-17T11:49:55.795237+0000","last_clean":"2023-12-17T11:49:55.795237+0000","last_became_active":"2023-12-17T11:49:53.232101+0000","last_became_peered":"2023-12-17T11:49:53.232101+0000","last_unstale":"2023-12-17T11:49:55.795237+0000","last_undegraded":"2023-12-17T11:49:55.795237+0000","last_fullsized":"2023-12-17T11:49:55.795237+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T11:57:59.882385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"39'2","reported_seq":16,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-17T11:50:01.305224+0000","last_change":"2023-12-17T11:49:52.210836+0000","last_active":"2023-12-17T11:50:01.305224+0000","last_peered":"2023-12-17T11:50:01.305224+0000","last_clean":"2023-12-17T11:50:01.305224+0000","last_became_active":"2023-12-17T11:49:52.210521+0000","last_became_peered":"2023-12-17T11:49:52.210521+0000","last_unstale":"2023-12-17T11:50:01.305224+0000","last_undegraded":"2023-12-17T11:50:01.305224+0000","last_fullsized":"2023-12-17T11:50:01.305224+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_clean_scrub_stamp":"2023-12-17T11:49:51.168108+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T17:20:36.726376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-17T11:50:00.528978+0000","last_change":"2023-12-17T11:49:53.243230+0000","last_active":"2023-12-17T11:50:00.528978+0000","last_peered":"2023-12-17T11:50:00.528978+0000","last_clean":"2023-12-17T11:50:00.528978+0000","last_became_active":"2023-12-17T11:49:53.242951+0000","last_became_peered":"2023-12-17T11:49:53.242951+0000","last_unstale":"2023-12-17T11:50:00.528978+0000","last_undegraded":"2023-12-17T11:50:00.528978+0000","last_fullsized":"2023-12-17T11:50:00.528978+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T18:42:00.093282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-17T11:50:01.304976+0000","last_change":"2023-12-17T11:49:52.217136+0000","last_active":"2023-12-17T11:50:01.304976+0000","last_peered":"2023-12-17T11:50:01.304976+0000","last_clean":"2023-12-17T11:50:01.304976+0000","last_became_active":"2023-12-17T11:49:52.216921+0000","last_became_peered":"2023-12-17T11:49:52.216921+0000","last_unstale":"2023-12-17T11:50:01.304976+0000","last_undegraded":"2023-12-17T11:50:01.304976+0000","last_fullsized":"2023-12-17T11:50:01.304976+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_clean_scrub_stamp":"2023-12-17T11:49:51.168108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T19:32:12.805680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-17T11:50:00.530083+0000","last_change":"2023-12-17T11:49:53.255643+0000","last_active":"2023-12-17T11:50:00.530083+0000","last_peered":"2023-12-17T11:50:00.530083+0000","last_clean":"2023-12-17T11:50:00.530083+0000","last_became_active":"2023-12-17T11:49:53.255379+0000","last_became_peered":"2023-12-17T11:49:53.255379+0000","last_unstale":"2023-12-17T11:50:00.530083+0000","last_undegraded":"2023-12-17T11:50:00.530083+0000","last_fullsized":"2023-12-17T11:50:00.530083+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T16:21:14.355302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:55.795394+0000","last_change":"2023-12-17T11:49:52.229883+0000","last_active":"2023-12-17T11:49:55.795394+0000","last_peered":"2023-12-17T11:49:55.795394+0000","last_clean":"2023-12-17T11:49:55.795394+0000","last_became_active":"2023-12-17T11:49:52.229372+0000","last_became_peered":"2023-12-17T11:49:52.229372+0000","last_unstale":"2023-12-17T11:49:55.795394+0000","last_undegraded":"2023-12-17T11:49:55.795394+0000","last_fullsized":"2023-12-17T11:49:55.795394+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_clean_scrub_stamp":"2023-12-17T11:49:51.168108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T23:27:59.830582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-17T11:50:00.524144+0000","last_change":"2023-12-17T11:49:53.249227+0000","last_active":"2023-12-17T11:50:00.524144+0000","last_peered":"2023-12-17T11:50:00.524144+0000","last_clean":"2023-12-17T11:50:00.524144+0000","last_became_active":"2023-12-17T11:49:53.248594+0000","last_became_peered":"2023-12-17T11:49:53.248594+0000","last_unstale":"2023-12-17T11:50:00.524144+0000","last_undegraded":"2023-12-17T11:50:00.524144+0000","last_fullsized":"2023-12-17T11:50:00.524144+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T14:31:17.752657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-17T11:50:01.304582+0000","last_change":"2023-12-17T11:49:52.211707+0000","last_active":"2023-12-17T11:50:01.304582+0000","last_peered":"2023-12-17T11:50:01.304582+0000","last_clean":"2023-12-17T11:50:01.304582+0000","last_became_active":"2023-12-17T11:49:52.211283+0000","last_became_peered":"2023-12-17T11:49:52.211283+0000","last_unstale":"2023-12-17T11:50:01.304582+0000","last_undegraded":"2023-12-17T11:50:01.304582+0000","last_fullsized":"2023-12-17T11:50:01.304582+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_clean_scrub_stamp":"2023-12-17T11:49:51.168108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T12:54:05.203029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-17T11:50:00.523128+0000","last_change":"2023-12-17T11:49:53.255235+0000","last_active":"2023-12-17T11:50:00.523128+0000","last_peered":"2023-12-17T11:50:00.523128+0000","last_clean":"2023-12-17T11:50:00.523128+0000","last_became_active":"2023-12-17T11:49:53.254570+0000","last_became_peered":"2023-12-17T11:49:53.254570+0000","last_unstale":"2023-12-17T11:50:00.523128+0000","last_undegraded":"2023-12-17T11:50:00.523128+0000","last_fullsized":"2023-12-17T11:50:00.523128+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T15:14:36.959400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"39'2","reported_seq":16,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-17T11:50:00.530828+0000","last_change":"2023-12-17T11:49:52.229686+0000","last_active":"2023-12-17T11:50:00.530828+0000","last_peered":"2023-12-17T11:50:00.530828+0000","last_clean":"2023-12-17T11:50:00.530828+0000","last_became_active":"2023-12-17T11:49:52.229401+0000","last_became_peered":"2023-12-17T11:49:52.229401+0000","last_unstale":"2023-12-17T11:50:00.530828+0000","last_undegraded":"2023-12-17T11:50:00.530828+0000","last_fullsized":"2023-12-17T11:50:00.530828+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_clean_scrub_stamp":"2023-12-17T11:49:51.168108+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T17:03:59.637357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:55.795716+0000","last_change":"2023-12-17T11:49:53.236908+0000","last_active":"2023-12-17T11:49:55.795716+0000","last_peered":"2023-12-17T11:49:55.795716+0000","last_clean":"2023-12-17T11:49:55.795716+0000","last_became_active":"2023-12-17T11:49:53.236508+0000","last_became_peered":"2023-12-17T11:49:53.236508+0000","last_unstale":"2023-12-17T11:49:55.795716+0000","last_undegraded":"2023-12-17T11:49:55.795716+0000","last_fullsized":"2023-12-17T11:49:55.795716+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T13:59:52.939825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"40'1","reported_seq":15,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-17T11:50:01.305637+0000","last_change":"2023-12-17T11:49:52.229067+0000","last_active":"2023-12-17T11:50:01.305637+0000","last_peered":"2023-12-17T11:50:01.305637+0000","last_clean":"2023-12-17T11:50:01.305637+0000","last_became_active":"2023-12-17T11:49:52.228704+0000","last_became_peered":"2023-12-17T11:49:52.228704+0000","last_unstale":"2023-12-17T11:50:01.305637+0000","last_undegraded":"2023-12-17T11:50:01.305637+0000","last_fullsized":"2023-12-17T11:50:01.305637+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_clean_scrub_stamp":"2023-12-17T11:49:51.168108+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T16:31:06.129915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-17T11:50:00.524876+0000","last_change":"2023-12-17T11:49:53.246415+0000","last_active":"2023-12-17T11:50:00.524876+0000","last_peered":"2023-12-17T11:50:00.524876+0000","last_clean":"2023-12-17T11:50:00.524876+0000","last_became_active":"2023-12-17T11:49:53.246163+0000","last_became_peered":"2023-12-17T11:49:53.246163+0000","last_unstale":"2023-12-17T11:50:00.524876+0000","last_undegraded":"2023-12-17T11:50:00.524876+0000","last_fullsized":"2023-12-17T11:50:00.524876+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T17:56:09.285369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-17T11:50:00.529684+0000","last_change":"2023-12-17T11:49:52.219865+0000","last_active":"2023-12-17T11:50:00.529684+0000","last_peered":"2023-12-17T11:50:00.529684+0000","last_clean":"2023-12-17T11:50:00.529684+0000","last_became_active":"2023-12-17T11:49:52.219593+0000","last_became_peered":"2023-12-17T11:49:52.219593+0000","last_unstale":"2023-12-17T11:50:00.529684+0000","last_undegraded":"2023-12-17T11:50:00.529684+0000","last_fullsized":"2023-12-17T11:50:00.529684+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_clean_scrub_stamp":"2023-12-17T11:49:51.168108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T15:14:35.947970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-17T11:50:00.529332+0000","last_change":"2023-12-17T11:49:53.242876+0000","last_active":"2023-12-17T11:50:00.529332+0000","last_peered":"2023-12-17T11:50:00.529332+0000","last_clean":"2023-12-17T11:50:00.529332+0000","last_became_active":"2023-12-17T11:49:53.242568+0000","last_became_peered":"2023-12-17T11:49:53.242568+0000","last_unstale":"2023-12-17T11:50:00.529332+0000","last_undegraded":"2023-12-17T11:50:00.529332+0000","last_fullsized":"2023-12-17T11:50:00.529332+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T23:10:56.100255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-17T11:50:00.529639+0000","last_change":"2023-12-17T11:49:52.223424+0000","last_active":"2023-12-17T11:50:00.529639+0000","last_peered":"2023-12-17T11:50:00.529639+0000","last_clean":"2023-12-17T11:50:00.529639+0000","last_became_active":"2023-12-17T11:49:52.223126+0000","last_became_peered":"2023-12-17T11:49:52.223126+0000","last_unstale":"2023-12-17T11:50:00.529639+0000","last_undegraded":"2023-12-17T11:50:00.529639+0000","last_fullsized":"2023-12-17T11:50:00.529639+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_clean_scrub_stamp":"2023-12-17T11:49:51.168108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T14:31:59.450792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-17T11:50:00.523009+0000","last_change":"2023-12-17T11:49:53.251516+0000","last_active":"2023-12-17T11:50:00.523009+0000","last_peered":"2023-12-17T11:50:00.523009+0000","last_clean":"2023-12-17T11:50:00.523009+0000","last_became_active":"2023-12-17T11:49:53.251230+0000","last_became_peered":"2023-12-17T11:49:53.251230+0000","last_unstale":"2023-12-17T11:50:00.523009+0000","last_undegraded":"2023-12-17T11:50:00.523009+0000","last_fullsized":"2023-12-17T11:50:00.523009+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T19:39:18.340154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-17T11:50:01.202294+0000","last_change":"2023-12-17T11:49:52.219807+0000","last_active":"2023-12-17T11:50:01.202294+0000","last_peered":"2023-12-17T11:50:01.202294+0000","last_clean":"2023-12-17T11:50:01.202294+0000","last_became_active":"2023-12-17T11:49:52.219503+0000","last_became_peered":"2023-12-17T11:49:52.219503+0000","last_unstale":"2023-12-17T11:50:01.202294+0000","last_undegraded":"2023-12-17T11:50:01.202294+0000","last_fullsized":"2023-12-17T11:50:01.202294+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_clean_scrub_stamp":"2023-12-17T11:49:51.168108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T18:07:09.094032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-17T11:50:00.522740+0000","last_change":"2023-12-17T11:49:53.241750+0000","last_active":"2023-12-17T11:50:00.522740+0000","last_peered":"2023-12-17T11:50:00.522740+0000","last_clean":"2023-12-17T11:50:00.522740+0000","last_became_active":"2023-12-17T11:49:53.241529+0000","last_became_peered":"2023-12-17T11:49:53.241529+0000","last_unstale":"2023-12-17T11:50:00.522740+0000","last_undegraded":"2023-12-17T11:50:00.522740+0000","last_fullsized":"2023-12-17T11:50:00.522740+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T16:31:53.964205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-17T11:50:00.522300+0000","last_change":"2023-12-17T11:49:52.216579+0000","last_active":"2023-12-17T11:50:00.522300+0000","last_peered":"2023-12-17T11:50:00.522300+0000","last_clean":"2023-12-17T11:50:00.522300+0000","last_became_active":"2023-12-17T11:49:52.216265+0000","last_became_peered":"2023-12-17T11:49:52.216265+0000","last_unstale":"2023-12-17T11:50:00.522300+0000","last_undegraded":"2023-12-17T11:50:00.522300+0000","last_fullsized":"2023-12-17T11:50:00.522300+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_clean_scrub_stamp":"2023-12-17T11:49:51.168108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T14:31:59.450792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:55.795525+0000","last_change":"2023-12-17T11:49:53.234303+0000","last_active":"2023-12-17T11:49:55.795525+0000","last_peered":"2023-12-17T11:49:55.795525+0000","last_clean":"2023-12-17T11:49:55.795525+0000","last_became_active":"2023-12-17T11:49:53.233951+0000","last_became_peered":"2023-12-17T11:49:53.233951+0000","last_unstale":"2023-12-17T11:49:55.795525+0000","last_undegraded":"2023-12-17T11:49:55.795525+0000","last_fullsized":"2023-12-17T11:49:55.795525+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T19:17:38.569694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-17T11:50:00.522523+0000","last_change":"2023-12-17T11:49:52.219957+0000","last_active":"2023-12-17T11:50:00.522523+0000","last_peered":"2023-12-17T11:50:00.522523+0000","last_clean":"2023-12-17T11:50:00.522523+0000","last_became_active":"2023-12-17T11:49:52.219626+0000","last_became_peered":"2023-12-17T11:49:52.219626+0000","last_unstale":"2023-12-17T11:50:00.522523+0000","last_undegraded":"2023-12-17T11:50:00.522523+0000","last_fullsized":"2023-12-17T11:50:00.522523+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_clean_scrub_stamp":"2023-12-17T11:49:51.168108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T19:12:11.016281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-17T11:50:00.530565+0000","last_change":"2023-12-17T11:49:53.253151+0000","last_active":"2023-12-17T11:50:00.530565+0000","last_peered":"2023-12-17T11:50:00.530565+0000","last_clean":"2023-12-17T11:50:00.530565+0000","last_became_active":"2023-12-17T11:49:53.252842+0000","last_became_peered":"2023-12-17T11:49:53.252842+0000","last_unstale":"2023-12-17T11:50:00.530565+0000","last_undegraded":"2023-12-17T11:50:00.530565+0000","last_fullsized":"2023-12-17T11:50:00.530565+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T14:31:17.752657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:55.795609+0000","last_change":"2023-12-17T11:49:52.228110+0000","last_active":"2023-12-17T11:49:55.795609+0000","last_peered":"2023-12-17T11:49:55.795609+0000","last_clean":"2023-12-17T11:49:55.795609+0000","last_became_active":"2023-12-17T11:49:52.227851+0000","last_became_peered":"2023-12-17T11:49:52.227851+0000","last_unstale":"2023-12-17T11:49:55.795609+0000","last_undegraded":"2023-12-17T11:49:55.795609+0000","last_fullsized":"2023-12-17T11:49:55.795609+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_clean_scrub_stamp":"2023-12-17T11:49:51.168108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T18:37:20.380970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":181,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:55.301834+0000","last_change":"2023-12-17T11:48:07.952584+0000","last_active":"2023-12-17T11:49:55.301834+0000","last_peered":"2023-12-17T11:49:55.301834+0000","last_clean":"2023-12-17T11:49:55.301834+0000","last_became_active":"2023-12-17T11:48:07.950361+0000","last_became_peered":"2023-12-17T11:48:07.950361+0000","last_unstale":"2023-12-17T11:49:55.301834+0000","last_undegraded":"2023-12-17T11:49:55.301834+0000","last_fullsized":"2023-12-17T11:49:55.301834+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:06.728199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:06.728199+0000","last_clean_scrub_stamp":"2023-12-17T11:48:06.728199+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T12:47:55.048065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542172,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28088,"kb_used_data":1068,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343752,"statfs":{"total":96636764160,"available":96608002048,"internally_reserved":0,"allocated":1093632,"data_stored":802179,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 17 11:49:06 2023","interfaces":[{"interface":"back","average":{"1min":1.407,"5min":1.407,"15min":1.407},"min":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":8.6579999999999995,"5min":8.6579999999999995,"15min":8.6579999999999995},"last":1.0669999999999999},{"interface":"front","average":{"1min":1.339,"5min":1.339,"15min":1.339},"min":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"max":{"1min":4.0830000000000002,"5min":4.0830000000000002,"15min":4.0830000000000002},"last":1.393}]},{"osd":1,"last update":"Sun Dec 17 11:49:06 2023","interfaces":[{"interface":"back","average":{"1min":1.127,"5min":1.127,"15min":1.127},"min":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"max":{"1min":2.1539999999999999,"5min":2.1539999999999999,"15min":2.1539999999999999},"last":0.94899999999999995},{"interface":"front","average":{"1min":1.413,"5min":1.413,"15min":1.413},"min":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"max":{"1min":8.7449999999999992,"5min":8.7449999999999992,"15min":8.7449999999999992},"last":1.181}]},{"osd":2,"last update":"Sun Dec 17 11:49:06 2023","interfaces":[{"interface":"back","average":{"1min":1.4299999999999999,"5min":1.4299999999999999,"15min":1.4299999999999999},"min":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"max":{"1min":4.1239999999999997,"5min":4.1239999999999997,"15min":4.1239999999999997},"last":1.234},{"interface":"front","average":{"1min":1.3720000000000001,"5min":1.3720000000000001,"15min":1.3720000000000001},"min":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"max":{"1min":1.782,"5min":1.782,"15min":1.782},"last":0.80600000000000005}]},{"osd":3,"last update":"Sun Dec 17 11:49:06 2023","interfaces":[{"interface":"back","average":{"1min":1.298,"5min":1.298,"15min":1.298},"min":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"max":{"1min":2.5430000000000001,"5min":2.5430000000000001,"15min":2.5430000000000001},"last":1.04},{"interface":"front","average":{"1min":1.375,"5min":1.375,"15min":1.375},"min":{"1min":1.087,"5min":1.087,"15min":1.087},"max":{"1min":2.5830000000000002,"5min":2.5830000000000002,"15min":2.5830000000000002},"last":1.127}]},{"osd":4,"last update":"Sun Dec 17 11:49:06 2023","interfaces":[{"interface":"back","average":{"1min":1.3859999999999999,"5min":1.3859999999999999,"15min":1.3859999999999999},"min":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":4.0309999999999997,"5min":4.0309999999999997,"15min":4.0309999999999997},"last":1.488},{"interface":"front","average":{"1min":1.5860000000000001,"5min":1.5860000000000001,"15min":1.5860000000000001},"min":{"1min":1.2230000000000001,"5min":1.2230000000000001,"15min":1.2230000000000001},"max":{"1min":3.3220000000000001,"5min":3.3220000000000001,"15min":3.3220000000000001},"last":1.3300000000000001}]},{"osd":5,"last update":"Sun Dec 17 11:49:06 2023","interfaces":[{"interface":"back","average":{"1min":1.6970000000000001,"5min":1.6970000000000001,"15min":1.6970000000000001},"min":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"max":{"1min":8.7929999999999993,"5min":8.7929999999999993,"15min":8.7929999999999993},"last":1.2929999999999999},{"interface":"front","average":{"1min":1.6859999999999999,"5min":1.6859999999999999,"15min":1.6859999999999999},"min":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"max":{"1min":5.1040000000000001,"5min":5.1040000000000001,"15min":5.1040000000000001},"last":1.5700000000000001}]},{"osd":6,"last update":"Sun Dec 17 11:49:06 2023","interfaces":[{"interface":"back","average":{"1min":1.845,"5min":1.845,"15min":1.845},"min":{"1min":1.081,"5min":1.081,"15min":1.081},"max":{"1min":8.8330000000000002,"5min":8.8330000000000002,"15min":8.8330000000000002},"last":1.3720000000000001},{"interface":"front","average":{"1min":1.71,"5min":1.71,"15min":1.71},"min":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"max":{"1min":3.9590000000000001,"5min":3.9590000000000001,"15min":3.9590000000000001},"last":1.679}]}]},{"osd":6,"up_from":14,"seq":60129542172,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27500,"kb_used_data":476,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344340,"statfs":{"total":96636764160,"available":96608604160,"internally_reserved":0,"allocated":487424,"data_stored":210711,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 17 11:49:06 2023","interfaces":[{"interface":"back","average":{"1min":1.0720000000000001,"5min":1.0720000000000001,"15min":1.0720000000000001},"min":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.5840000000000001,"5min":1.5840000000000001,"15min":1.5840000000000001},"last":0.96099999999999997},{"interface":"front","average":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"min":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"max":{"1min":1.429,"5min":1.429,"15min":1.429},"last":1.1659999999999999}]},{"osd":1,"last update":"Sun Dec 17 11:49:06 2023","interfaces":[{"interface":"back","average":{"1min":1.2689999999999999,"5min":1.2689999999999999,"15min":1.2689999999999999},"min":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"max":{"1min":1.5640000000000001,"5min":1.5640000000000001,"15min":1.5640000000000001},"last":1.1299999999999999},{"interface":"front","average":{"1min":1.3169999999999999,"5min":1.3169999999999999,"15min":1.3169999999999999},"min":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"max":{"1min":1.9359999999999999,"5min":1.9359999999999999,"15min":1.9359999999999999},"last":1.3380000000000001}]},{"osd":2,"last update":"Sun Dec 17 11:49:06 2023","interfaces":[{"interface":"back","average":{"1min":1.1970000000000001,"5min":1.1970000000000001,"15min":1.1970000000000001},"min":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":1.8740000000000001,"5min":1.8740000000000001,"15min":1.8740000000000001},"last":1.5},{"interface":"front","average":{"1min":1.296,"5min":1.296,"15min":1.296},"min":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":2.5470000000000002,"5min":2.5470000000000002,"15min":2.5470000000000002},"last":1.25}]},{"osd":3,"last update":"Sun Dec 17 11:49:06 2023","interfaces":[{"interface":"back","average":{"1min":1.508,"5min":1.508,"15min":1.508},"min":{"1min":1.0840000000000001,"5min":1.0840000000000001,"15min":1.0840000000000001},"max":{"1min":2.4689999999999999,"5min":2.4689999999999999,"15min":2.4689999999999999},"last":1.369},{"interface":"front","average":{"1min":1.4390000000000001,"5min":1.4390000000000001,"15min":1.4390000000000001},"min":{"1min":0.88,"5min":0.88,"15min":0.88},"max":{"1min":2.0680000000000001,"5min":2.0680000000000001,"15min":2.0680000000000001},"last":1.284}]},{"osd":4,"last update":"Sun Dec 17 11:49:06 2023","interfaces":[{"interface":"back","average":{"1min":1.522,"5min":1.522,"15min":1.522},"min":{"1min":1.1419999999999999,"5min":1.1419999999999999,"15min":1.1419999999999999},"max":{"1min":2.222,"5min":2.222,"15min":2.222},"last":1.4610000000000001},{"interface":"front","average":{"1min":1.4419999999999999,"5min":1.4419999999999999,"15min":1.4419999999999999},"min":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":0.90700000000000003},"max":{"1min":2.4079999999999999,"5min":2.4079999999999999,"15min":2.4079999999999999},"last":1.401}]},{"osd":5,"last update":"Sun Dec 17 11:49:06 2023","interfaces":[{"interface":"back","average":{"1min":1.548,"5min":1.548,"15min":1.548},"min":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"max":{"1min":2.3319999999999999,"5min":2.3319999999999999,"15min":2.3319999999999999},"last":1.2170000000000001},{"interface":"front","average":{"1min":1.5760000000000001,"5min":1.5760000000000001,"15min":1.5760000000000001},"min":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"max":{"1min":2.6760000000000002,"5min":2.6760000000000002,"15min":2.6760000000000002},"last":1.306}]},{"osd":7,"last update":"Sun Dec 17 11:49:06 2023","interfaces":[{"interface":"back","average":{"1min":1.419,"5min":1.419,"15min":1.419},"min":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"max":{"1min":2.1560000000000001,"5min":2.1560000000000001,"15min":2.1560000000000001},"last":1.022},{"interface":"front","average":{"1min":1.712,"5min":1.712,"15min":1.712},"min":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"max":{"1min":2.6059999999999999,"5min":2.6059999999999999,"15min":2.6059999999999999},"last":1.4319999999999999}]}]},{"osd":5,"up_from":14,"seq":60129542171,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27500,"kb_used_data":480,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344340,"statfs":{"total":96636764160,"available":96608604160,"internally_reserved":0,"allocated":491520,"data_stored":210241,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 17 11:49:09 2023","interfaces":[{"interface":"back","average":{"1min":1.101,"5min":1.101,"15min":1.101},"min":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":1.5860000000000001,"5min":1.5860000000000001,"15min":1.5860000000000001},"last":1.3560000000000001},{"interface":"front","average":{"1min":1.23,"5min":1.23,"15min":1.23},"min":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"max":{"1min":1.9419999999999999,"5min":1.9419999999999999,"15min":1.9419999999999999},"last":1.115}]},{"osd":1,"last update":"Sun Dec 17 11:49:09 2023","interfaces":[{"interface":"back","average":{"1min":1.167,"5min":1.167,"15min":1.167},"min":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"max":{"1min":1.5289999999999999,"5min":1.5289999999999999,"15min":1.5289999999999999},"last":0.91900000000000004},{"interface":"front","average":{"1min":1.216,"5min":1.216,"15min":1.216},"min":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"max":{"1min":1.8660000000000001,"5min":1.8660000000000001,"15min":1.8660000000000001},"last":1.179}]},{"osd":2,"last update":"Sun Dec 17 11:49:09 2023","interfaces":[{"interface":"back","average":{"1min":1.3140000000000001,"5min":1.3140000000000001,"15min":1.3140000000000001},"min":{"1min":0.747,"5min":0.747,"15min":0.747},"max":{"1min":2.1589999999999998,"5min":2.1589999999999998,"15min":2.1589999999999998},"last":0.84499999999999997},{"interface":"front","average":{"1min":1.3919999999999999,"5min":1.3919999999999999,"15min":1.3919999999999999},"min":{"1min":1.0049999999999999,"5min":1.0049999999999999,"15min":1.0049999999999999},"max":{"1min":2.1379999999999999,"5min":2.1379999999999999,"15min":2.1379999999999999},"last":1.048}]},{"osd":3,"last update":"Sun Dec 17 11:49:09 2023","interfaces":[{"interface":"back","average":{"1min":1.337,"5min":1.337,"15min":1.337},"min":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"max":{"1min":2.593,"5min":2.593,"15min":2.593},"last":0.98399999999999999},{"interface":"front","average":{"1min":1.407,"5min":1.407,"15min":1.407},"min":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"max":{"1min":2.3079999999999998,"5min":2.3079999999999998,"15min":2.3079999999999998},"last":1.2849999999999999}]},{"osd":4,"last update":"Sun Dec 17 11:49:09 2023","interfaces":[{"interface":"back","average":{"1min":1.5029999999999999,"5min":1.5029999999999999,"15min":1.5029999999999999},"min":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"max":{"1min":2.5299999999999998,"5min":2.5299999999999998,"15min":2.5299999999999998},"last":1.452},{"interface":"front","average":{"1min":1.6879999999999999,"5min":1.6879999999999999,"15min":1.6879999999999999},"min":{"1min":1.0669999999999999,"5min":1.0669999999999999,"15min":1.0669999999999999},"max":{"1min":3.9569999999999999,"5min":3.9569999999999999,"15min":3.9569999999999999},"last":1.2370000000000001}]},{"osd":6,"last update":"Sun Dec 17 11:49:09 2023","interfaces":[{"interface":"back","average":{"1min":1.6619999999999999,"5min":1.6619999999999999,"15min":1.6619999999999999},"min":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"max":{"1min":2.9849999999999999,"5min":2.9849999999999999,"15min":2.9849999999999999},"last":1.1499999999999999},{"interface":"front","average":{"1min":1.6319999999999999,"5min":1.6319999999999999,"15min":1.6319999999999999},"min":{"1min":1.25,"5min":1.25,"15min":1.25},"max":{"1min":2.641,"5min":2.641,"15min":2.641},"last":1.538}]},{"osd":7,"last update":"Sun Dec 17 11:49:09 2023","interfaces":[{"interface":"back","average":{"1min":1.8080000000000001,"5min":1.8080000000000001,"15min":1.8080000000000001},"min":{"1min":1.232,"5min":1.232,"15min":1.232},"max":{"1min":3.8570000000000002,"5min":3.8570000000000002,"15min":3.8570000000000002},"last":1.415},{"interface":"front","average":{"1min":1.827,"5min":1.827,"15min":1.827},"min":{"1min":1.137,"5min":1.137,"15min":1.137},"max":{"1min":2.8999999999999999,"5min":2.8999999999999999,"15min":2.8999999999999999},"last":1.397}]}]},{"osd":4,"up_from":14,"seq":60129542172,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27500,"kb_used_data":480,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344340,"statfs":{"total":96636764160,"available":96608604160,"internally_reserved":0,"allocated":491520,"data_stored":210733,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 17 11:49:08 2023","interfaces":[{"interface":"back","average":{"1min":1.02,"5min":1.02,"15min":1.02},"min":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"max":{"1min":1.1890000000000001,"5min":1.1890000000000001,"15min":1.1890000000000001},"last":1.024},{"interface":"front","average":{"1min":1.167,"5min":1.167,"15min":1.167},"min":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"max":{"1min":2.6400000000000001,"5min":2.6400000000000001,"15min":2.6400000000000001},"last":1.548}]},{"osd":1,"last update":"Sun Dec 17 11:49:08 2023","interfaces":[{"interface":"back","average":{"1min":1.0960000000000001,"5min":1.0960000000000001,"15min":1.0960000000000001},"min":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"max":{"1min":1.369,"5min":1.369,"15min":1.369},"last":1.4139999999999999},{"interface":"front","average":{"1min":1.2669999999999999,"5min":1.2669999999999999,"15min":1.2669999999999999},"min":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"max":{"1min":1.631,"5min":1.631,"15min":1.631},"last":1.3049999999999999}]},{"osd":2,"last update":"Sun Dec 17 11:49:08 2023","interfaces":[{"interface":"back","average":{"1min":1.393,"5min":1.393,"15min":1.393},"min":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"max":{"1min":1.8660000000000001,"5min":1.8660000000000001,"15min":1.8660000000000001},"last":1.6020000000000001},{"interface":"front","average":{"1min":1.329,"5min":1.329,"15min":1.329},"min":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"max":{"1min":1.968,"5min":1.968,"15min":1.968},"last":0.88100000000000001}]},{"osd":3,"last update":"Sun Dec 17 11:49:08 2023","interfaces":[{"interface":"back","average":{"1min":1.4410000000000001,"5min":1.4410000000000001,"15min":1.4410000000000001},"min":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"max":{"1min":3.2290000000000001,"5min":3.2290000000000001,"15min":3.2290000000000001},"last":1.1910000000000001},{"interface":"front","average":{"1min":1.496,"5min":1.496,"15min":1.496},"min":{"1min":1.1000000000000001,"5min":1.1000000000000001,"15min":1.1000000000000001},"max":{"1min":2.0169999999999999,"5min":2.0169999999999999,"15min":2.0169999999999999},"last":1.5029999999999999}]},{"osd":5,"last update":"Sun Dec 17 11:49:08 2023","interfaces":[{"interface":"back","average":{"1min":1.474,"5min":1.474,"15min":1.474},"min":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"max":{"1min":2.141,"5min":2.141,"15min":2.141},"last":1.466},{"interface":"front","average":{"1min":1.7110000000000001,"5min":1.7110000000000001,"15min":1.7110000000000001},"min":{"1min":1.2390000000000001,"5min":1.2390000000000001,"15min":1.2390000000000001},"max":{"1min":3.8220000000000001,"5min":3.8220000000000001,"15min":3.8220000000000001},"last":1.659}]},{"osd":6,"last update":"Sun Dec 17 11:49:08 2023","interfaces":[{"interface":"back","average":{"1min":1.7370000000000001,"5min":1.7370000000000001,"15min":1.7370000000000001},"min":{"1min":1.212,"5min":1.212,"15min":1.212},"max":{"1min":2.7410000000000001,"5min":2.7410000000000001,"15min":2.7410000000000001},"last":1.702},{"interface":"front","average":{"1min":1.677,"5min":1.677,"15min":1.677},"min":{"1min":1.222,"5min":1.222,"15min":1.222},"max":{"1min":2.2989999999999999,"5min":2.2989999999999999,"15min":2.2989999999999999},"last":1.53}]},{"osd":7,"last update":"Sun Dec 17 11:49:08 2023","interfaces":[{"interface":"back","average":{"1min":1.847,"5min":1.847,"15min":1.847},"min":{"1min":1.2749999999999999,"5min":1.2749999999999999,"15min":1.2749999999999999},"max":{"1min":3.944,"5min":3.944,"15min":3.944},"last":1.3680000000000001},{"interface":"front","average":{"1min":1.8160000000000001,"5min":1.8160000000000001,"15min":1.8160000000000001},"min":{"1min":1.4239999999999999,"5min":1.4239999999999999,"15min":1.4239999999999999},"max":{"1min":2.8809999999999998,"5min":2.8809999999999998,"15min":2.8809999999999998},"last":1.7589999999999999}]}]},{"osd":3,"up_from":14,"seq":60129542171,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27508,"kb_used_data":488,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344332,"statfs":{"total":96636764160,"available":96608595968,"internally_reserved":0,"allocated":499712,"data_stored":211775,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 17 11:49:06 2023","interfaces":[{"interface":"back","average":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.6459999999999999,"5min":1.6459999999999999,"15min":1.6459999999999999},"last":0.94099999999999995},{"interface":"front","average":{"1min":1.0700000000000001,"5min":1.0700000000000001,"15min":1.0700000000000001},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":3.5800000000000001,"5min":3.5800000000000001,"15min":3.5800000000000001},"last":1.387}]},{"osd":1,"last update":"Sun Dec 17 11:49:06 2023","interfaces":[{"interface":"back","average":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":1.4379999999999999,"5min":1.4379999999999999,"15min":1.4379999999999999},"last":1.2529999999999999},{"interface":"front","average":{"1min":1.1519999999999999,"5min":1.1519999999999999,"15min":1.1519999999999999},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":2.085,"5min":2.085,"15min":2.085},"last":1.125}]},{"osd":2,"last update":"Sun Dec 17 11:49:06 2023","interfaces":[{"interface":"back","average":{"1min":1.1659999999999999,"5min":1.1659999999999999,"15min":1.1659999999999999},"min":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":1.651,"5min":1.651,"15min":1.651},"last":1.506},{"interface":"front","average":{"1min":1.2569999999999999,"5min":1.2569999999999999,"15min":1.2569999999999999},"min":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":2.1429999999999998,"5min":2.1429999999999998,"15min":2.1429999999999998},"last":1.7629999999999999}]},{"osd":4,"last update":"Sun Dec 17 11:49:06 2023","interfaces":[{"interface":"back","average":{"1min":1.4330000000000001,"5min":1.4330000000000001,"15min":1.4330000000000001},"min":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"max":{"1min":2.4870000000000001,"5min":2.4870000000000001,"15min":2.4870000000000001},"last":1.6439999999999999},{"interface":"front","average":{"1min":1.476,"5min":1.476,"15min":1.476},"min":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"max":{"1min":2.3460000000000001,"5min":2.3460000000000001,"15min":2.3460000000000001},"last":1.7}]},{"osd":5,"last update":"Sun Dec 17 11:49:06 2023","interfaces":[{"interface":"back","average":{"1min":1.476,"5min":1.476,"15min":1.476},"min":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"max":{"1min":2.5710000000000002,"5min":2.5710000000000002,"15min":2.5710000000000002},"last":1.585},{"interface":"front","average":{"1min":1.5,"5min":1.5,"15min":1.5},"min":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"max":{"1min":2.383,"5min":2.383,"15min":2.383},"last":1.5549999999999999}]},{"osd":6,"last update":"Sun Dec 17 11:49:06 2023","interfaces":[{"interface":"back","average":{"1min":1.474,"5min":1.474,"15min":1.474},"min":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"max":{"1min":2.6179999999999999,"5min":2.6179999999999999,"15min":2.6179999999999999},"last":1.452},{"interface":"front","average":{"1min":1.5149999999999999,"5min":1.5149999999999999,"15min":1.5149999999999999},"min":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"max":{"1min":2.7679999999999998,"5min":2.7679999999999998,"15min":2.7679999999999998},"last":1.6739999999999999}]},{"osd":7,"last update":"Sun Dec 17 11:49:06 2023","interfaces":[{"interface":"back","average":{"1min":1.581,"5min":1.581,"15min":1.581},"min":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"max":{"1min":3.7000000000000002,"5min":3.7000000000000002,"15min":3.7000000000000002},"last":1.7370000000000001},{"interface":"front","average":{"1min":1.579,"5min":1.579,"15min":1.579},"min":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":0.97099999999999997},"max":{"1min":2.427,"5min":2.427,"15min":2.427},"last":1.619}]}]},{"osd":2,"up_from":14,"seq":60129542172,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27500,"kb_used_data":476,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344340,"statfs":{"total":96636764160,"available":96608604160,"internally_reserved":0,"allocated":487424,"data_stored":210199,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 17 11:49:07 2023","interfaces":[{"interface":"back","average":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":1.724,"5min":1.724,"15min":1.724},"last":1.0209999999999999},{"interface":"front","average":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.502,"5min":1.502,"15min":1.502},"last":0.97899999999999998}]},{"osd":1,"last update":"Sun Dec 17 11:49:07 2023","interfaces":[{"interface":"back","average":{"1min":0.995,"5min":0.995,"15min":0.995},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.4790000000000001,"5min":1.4790000000000001,"15min":1.4790000000000001},"last":0.93700000000000006},{"interface":"front","average":{"1min":1.056,"5min":1.056,"15min":1.056},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":2.6280000000000001,"5min":2.6280000000000001,"15min":2.6280000000000001},"last":1.0649999999999999}]},{"osd":3,"last update":"Sun Dec 17 11:49:07 2023","interfaces":[{"interface":"back","average":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.476,"5min":1.476,"15min":1.476},"last":0.89900000000000002},{"interface":"front","average":{"1min":1.214,"5min":1.214,"15min":1.214},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.9670000000000001,"5min":1.9670000000000001,"15min":1.9670000000000001},"last":1.093}]},{"osd":4,"last update":"Sun Dec 17 11:49:07 2023","interfaces":[{"interface":"back","average":{"1min":1.49,"5min":1.49,"15min":1.49},"min":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"max":{"1min":2.5750000000000002,"5min":2.5750000000000002,"15min":2.5750000000000002},"last":1.1519999999999999},{"interface":"front","average":{"1min":1.3879999999999999,"5min":1.3879999999999999,"15min":1.3879999999999999},"min":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"max":{"1min":2.4940000000000002,"5min":2.4940000000000002,"15min":2.4940000000000002},"last":1.173}]},{"osd":5,"last update":"Sun Dec 17 11:49:07 2023","interfaces":[{"interface":"back","average":{"1min":1.3240000000000001,"5min":1.3240000000000001,"15min":1.3240000000000001},"min":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"max":{"1min":2.4289999999999998,"5min":2.4289999999999998,"15min":2.4289999999999998},"last":1.004},{"interface":"front","average":{"1min":1.5489999999999999,"5min":1.5489999999999999,"15min":1.5489999999999999},"min":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"max":{"1min":2.694,"5min":2.694,"15min":2.694},"last":1.2030000000000001}]},{"osd":6,"last update":"Sun Dec 17 11:49:07 2023","interfaces":[{"interface":"back","average":{"1min":1.472,"5min":1.472,"15min":1.472},"min":{"1min":0.748,"5min":0.748,"15min":0.748},"max":{"1min":2.7349999999999999,"5min":2.7349999999999999,"15min":2.7349999999999999},"last":1.1200000000000001},{"interface":"front","average":{"1min":1.4119999999999999,"5min":1.4119999999999999,"15min":1.4119999999999999},"min":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"max":{"1min":2.468,"5min":2.468,"15min":2.468},"last":1.298}]},{"osd":7,"last update":"Sun Dec 17 11:49:07 2023","interfaces":[{"interface":"back","average":{"1min":1.554,"5min":1.554,"15min":1.554},"min":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"max":{"1min":3.379,"5min":3.379,"15min":3.379},"last":1.2270000000000001},{"interface":"front","average":{"1min":1.474,"5min":1.474,"15min":1.474},"min":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"max":{"1min":2.2869999999999999,"5min":2.2869999999999999,"15min":2.2869999999999999},"last":1.369}]}]},{"osd":1,"up_from":14,"seq":60129542171,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27496,"kb_used_data":476,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344344,"statfs":{"total":96636764160,"available":96608608256,"internally_reserved":0,"allocated":487424,"data_stored":210219,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 17 11:49:08 2023","interfaces":[{"interface":"back","average":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.5249999999999999,"5min":1.5249999999999999,"15min":1.5249999999999999},"last":0.76200000000000001},{"interface":"front","average":{"1min":1.113,"5min":1.113,"15min":1.113},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":2.6360000000000001,"5min":2.6360000000000001,"15min":2.6360000000000001},"last":1.0589999999999999}]},{"osd":2,"last update":"Sun Dec 17 11:49:08 2023","interfaces":[{"interface":"back","average":{"1min":1.202,"5min":1.202,"15min":1.202},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":2.8159999999999998,"5min":2.8159999999999998,"15min":2.8159999999999998},"last":1.3899999999999999},{"interface":"front","average":{"1min":1.462,"5min":1.462,"15min":1.462},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":3.101,"5min":3.101,"15min":3.101},"last":0.97199999999999998}]},{"osd":3,"last update":"Sun Dec 17 11:49:08 2023","interfaces":[{"interface":"back","average":{"1min":1.48,"5min":1.48,"15min":1.48},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":2.7890000000000001,"5min":2.7890000000000001,"15min":2.7890000000000001},"last":1.74},{"interface":"front","average":{"1min":1.278,"5min":1.278,"15min":1.278},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":3.1400000000000001,"5min":3.1400000000000001,"15min":3.1400000000000001},"last":1.282}]},{"osd":4,"last update":"Sun Dec 17 11:49:08 2023","interfaces":[{"interface":"back","average":{"1min":1.4350000000000001,"5min":1.4350000000000001,"15min":1.4350000000000001},"min":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":2.5289999999999999,"5min":2.5289999999999999,"15min":2.5289999999999999},"last":1.609},{"interface":"front","average":{"1min":1.363,"5min":1.363,"15min":1.363},"min":{"1min":0.627,"5min":0.627,"15min":0.627},"max":{"1min":2.0819999999999999,"5min":2.0819999999999999,"15min":2.0819999999999999},"last":1.679}]},{"osd":5,"last update":"Sun Dec 17 11:49:08 2023","interfaces":[{"interface":"back","average":{"1min":1.466,"5min":1.466,"15min":1.466},"min":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"max":{"1min":1.96,"5min":1.96,"15min":1.96},"last":1.962},{"interface":"front","average":{"1min":1.573,"5min":1.573,"15min":1.573},"min":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":2.6739999999999999,"5min":2.6739999999999999,"15min":2.6739999999999999},"last":1.4610000000000001}]},{"osd":6,"last update":"Sun Dec 17 11:49:08 2023","interfaces":[{"interface":"back","average":{"1min":1.627,"5min":1.627,"15min":1.627},"min":{"1min":0.754,"5min":0.754,"15min":0.754},"max":{"1min":3.016,"5min":3.016,"15min":3.016},"last":1.8620000000000001},{"interface":"front","average":{"1min":1.5509999999999999,"5min":1.5509999999999999,"15min":1.5509999999999999},"min":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"max":{"1min":2.508,"5min":2.508,"15min":2.508},"last":1.8120000000000001}]},{"osd":7,"last update":"Sun Dec 17 11:49:08 2023","interfaces":[{"interface":"back","average":{"1min":1.6839999999999999,"5min":1.6839999999999999,"15min":1.6839999999999999},"min":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"max":{"1min":2.944,"5min":2.944,"15min":2.944},"last":1.9079999999999999},{"interface":"front","average":{"1min":1.7170000000000001,"5min":1.7170000000000001,"15min":1.7170000000000001},"min":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"max":{"1min":2.7709999999999999,"5min":2.7709999999999999,"15min":2.7709999999999999},"last":2.02}]}]},{"osd":0,"up_from":14,"seq":60129542171,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32240,"kb_used_data":1056,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339600,"statfs":{"total":96636764160,"available":96603750400,"internally_reserved":0,"allocated":1081344,"data_stored":800531,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Dec 17 11:49:06 2023","interfaces":[{"interface":"back","average":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.3899999999999999,"5min":1.3899999999999999,"15min":1.3899999999999999},"last":0.74199999999999999},{"interface":"front","average":{"1min":1.1519999999999999,"5min":1.1519999999999999,"15min":1.1519999999999999},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":1.958,"5min":1.958,"15min":1.958},"last":1.0449999999999999}]},{"osd":2,"last update":"Sun Dec 17 11:49:06 2023","interfaces":[{"interface":"back","average":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.7709999999999999,"5min":1.7709999999999999,"15min":1.7709999999999999},"last":0.86599999999999999},{"interface":"front","average":{"1min":1.2090000000000001,"5min":1.2090000000000001,"15min":1.2090000000000001},"min":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":2.2130000000000001,"5min":2.2130000000000001,"15min":2.2130000000000001},"last":1.1299999999999999}]},{"osd":3,"last update":"Sun Dec 17 11:49:06 2023","interfaces":[{"interface":"back","average":{"1min":1.125,"5min":1.125,"15min":1.125},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.728,"5min":1.728,"15min":1.728},"last":0.81999999999999995},{"interface":"front","average":{"1min":1.4039999999999999,"5min":1.4039999999999999,"15min":1.4039999999999999},"min":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"max":{"1min":2.4809999999999999,"5min":2.4809999999999999,"15min":2.4809999999999999},"last":0.97999999999999998}]},{"osd":4,"last update":"Sun Dec 17 11:49:06 2023","interfaces":[{"interface":"back","average":{"1min":1.518,"5min":1.518,"15min":1.518},"min":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"max":{"1min":4.6710000000000003,"5min":4.6710000000000003,"15min":4.6710000000000003},"last":1.325},{"interface":"front","average":{"1min":1.427,"5min":1.427,"15min":1.427},"min":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"max":{"1min":2.2799999999999998,"5min":2.2799999999999998,"15min":2.2799999999999998},"last":1.4079999999999999}]},{"osd":5,"last update":"Sun Dec 17 11:49:06 2023","interfaces":[{"interface":"back","average":{"1min":1.5069999999999999,"5min":1.5069999999999999,"15min":1.5069999999999999},"min":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"max":{"1min":2.1349999999999998,"5min":2.1349999999999998,"15min":2.1349999999999998},"last":1.5409999999999999},{"interface":"front","average":{"1min":1.6240000000000001,"5min":1.6240000000000001,"15min":1.6240000000000001},"min":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"max":{"1min":2.6080000000000001,"5min":2.6080000000000001,"15min":2.6080000000000001},"last":1.4610000000000001}]},{"osd":6,"last update":"Sun Dec 17 11:49:06 2023","interfaces":[{"interface":"back","average":{"1min":1.5800000000000001,"5min":1.5800000000000001,"15min":1.5800000000000001},"min":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"max":{"1min":2.702,"5min":2.702,"15min":2.702},"last":1.262},{"interface":"front","average":{"1min":1.534,"5min":1.534,"15min":1.534},"min":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"max":{"1min":2.3100000000000001,"5min":2.3100000000000001,"15min":2.3100000000000001},"last":1.6180000000000001}]},{"osd":7,"last update":"Sun Dec 17 11:49:06 2023","interfaces":[{"interface":"back","average":{"1min":1.611,"5min":1.611,"15min":1.611},"min":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"max":{"1min":2.3420000000000001,"5min":2.3420000000000001,"15min":2.3420000000000001},"last":1.504},{"interface":"front","average":{"1min":1.577,"5min":1.577,"15min":1.577},"min":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"max":{"1min":2.4359999999999999,"5min":2.4359999999999999,"15min":2.4359999999999999},"last":1.6699999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-17T11:50:08.995 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-12-17T11:50:09.254 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:09.252+0000 7f361b106640 1 Processor -- start 2023-12-17T11:50:09.254 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:09.252+0000 7f361b106640 1 -- start start 2023-12-17T11:50:09.256 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:09.254+0000 7f361b106640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f361415d370 0x7f361415d750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:50:09.256 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:09.254+0000 7f361b106640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f36140b40d0 0x7f36140d0dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:50:09.256 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:09.254+0000 7f361b106640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36140d01b0 con 0x7f36140d15d0 2023-12-17T11:50:09.256 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:09.254+0000 7f361b106640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36140cffc0 con 0x7f36140b40d0 2023-12-17T11:50:09.256 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:09.254+0000 7f361b106640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36140d0490 con 0x7f361415d370 2023-12-17T11:50:09.257 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:09.255+0000 7f361a104640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f361415d370 0x7f361415d750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:50:09.257 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:09.255+0000 7f361a104640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f361415d370 0x7f361415d750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3301/0 says I am v2:172.21.15.40:42472/0 (socket says 172.21.15.40:42472) 2023-12-17T11:50:09.257 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:09.255+0000 7f361a104640 1 -- 172.21.15.40:0/2146813155 learned_addr learned my addr 172.21.15.40:0/2146813155 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-17T11:50:09.257 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:09.255+0000 7f3619903640 1 --2- 172.21.15.40:0/2146813155 >> v2:172.21.15.159:3300/0 conn(0x7f36140b40d0 0x7f36140d0dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:50:09.257 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:09.256+0000 7f361a104640 1 -- 172.21.15.40:0/2146813155 >> v2:172.21.15.159:3300/0 conn(0x7f36140b40d0 msgr2=0x7f36140d0dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:50:09.260 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:09.256+0000 7f361a104640 1 --2- 172.21.15.40:0/2146813155 >> v2:172.21.15.159:3300/0 conn(0x7f36140b40d0 0x7f36140d0dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:50:09.260 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:09.256+0000 7f361a104640 1 -- 172.21.15.40:0/2146813155 >> v1:172.21.15.159:6789/0 conn(0x7f36140d15d0 legacy=0x7f36140d1a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:50:09.261 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:09.256+0000 7f361a104640 1 -- 172.21.15.40:0/2146813155 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36140d0770 con 0x7f361415d370 2023-12-17T11:50:09.262 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:09.257+0000 7f361a104640 1 --2- 172.21.15.40:0/2146813155 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f361415d370 0x7f361415d750 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f3610009870 tx=0x7f361002b8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dd04b13b4a1020e6 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:50:09.262 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:09.258+0000 7f3619102640 1 -- 172.21.15.40:0/2146813155 <== mon.2 v2:172.21.15.159:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3610031640 con 0x7f361415d370 2023-12-17T11:50:09.262 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:09.258+0000 7f3619102640 1 -- 172.21.15.40:0/2146813155 <== mon.2 v2:172.21.15.159:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36100317a0 con 0x7f361415d370 2023-12-17T11:50:09.262 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:09.258+0000 7f3619102640 1 -- 172.21.15.40:0/2146813155 <== mon.2 v2:172.21.15.159:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3610031b30 con 0x7f361415d370 2023-12-17T11:50:09.262 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:09.258+0000 7f361b106640 1 -- 172.21.15.40:0/2146813155 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f361415d370 msgr2=0x7f361415d750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:50:09.262 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:09.258+0000 7f361b106640 1 --2- 172.21.15.40:0/2146813155 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f361415d370 0x7f361415d750 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f3610009870 tx=0x7f361002b8f0 comp rx=0 tx=0).stop 2023-12-17T11:50:09.262 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:09.259+0000 7f361b106640 1 -- 172.21.15.40:0/2146813155 shutdown_connections 2023-12-17T11:50:09.262 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:09.259+0000 7f361b106640 1 --2- 172.21.15.40:0/2146813155 >> v2:172.21.15.159:3300/0 conn(0x7f36140b40d0 0x7f36140d0dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:50:09.262 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:09.259+0000 7f361b106640 1 --2- 172.21.15.40:0/2146813155 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f361415d370 0x7f361415d750 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:50:09.263 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:09.259+0000 7f361b106640 1 -- 172.21.15.40:0/2146813155 >> 172.21.15.40:0/2146813155 conn(0x7f36140d2ff0 msgr2=0x7f36140d3400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:50:09.263 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:09.259+0000 7f361b106640 1 -- 172.21.15.40:0/2146813155 shutdown_connections 2023-12-17T11:50:09.263 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:09.259+0000 7f361b106640 1 -- 172.21.15.40:0/2146813155 wait complete. 2023-12-17T11:50:09.265 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:09.260+0000 7f361b106640 1 Processor -- start 2023-12-17T11:50:09.265 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:09.261+0000 7f361b106640 1 -- start start 2023-12-17T11:50:09.265 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:09.262+0000 7f361b106640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f36140b40d0 0x7f36140c9570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:50:09.265 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:09.262+0000 7f361b106640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f36140d15d0 0x7f36141f2560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:50:09.265 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:09.262+0000 7f361b106640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f361415d370 0x7f36140ccca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:50:09.265 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:09.262+0000 7f361b106640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36140c9ab0 con 0x7f36140b40d0 2023-12-17T11:50:09.265 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:09.262+0000 7f361b106640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36140c84d0 con 0x7f36140d15d0 2023-12-17T11:50:09.265 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:09.262+0000 7f361b106640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36140c87b0 con 0x7f361415d370 2023-12-17T11:50:09.265 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:09.262+0000 7f361a104640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f36140b40d0 0x7f36140c9570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:50:09.265 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:09.262+0000 7f361a104640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f36140b40d0 0x7f36140c9570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:40736/0 (socket says 172.21.15.40:40736) 2023-12-17T11:50:09.265 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:09.262+0000 7f361a104640 1 -- 172.21.15.40:0/2943581010 learned_addr learned my addr 172.21.15.40:0/2943581010 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-17T11:50:09.265 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:09.262+0000 7f361a905640 1 --2- 172.21.15.40:0/2943581010 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f361415d370 0x7f36140ccca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:50:09.266 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:09.262+0000 7f361a104640 1 -- 172.21.15.40:0/2943581010 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f361415d370 msgr2=0x7f36140ccca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:50:09.266 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:09.262+0000 7f361a104640 1 --2- 172.21.15.40:0/2943581010 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f361415d370 0x7f36140ccca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:50:09.266 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:09.262+0000 7f361a104640 1 -- 172.21.15.40:0/2943581010 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f36140d15d0 msgr2=0x7f36141f2560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:50:09.266 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:09.262+0000 7f3619903640 1 --2- 172.21.15.40:0/2943581010 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f36140d15d0 0x7f36141f2560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:50:09.266 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:09.263+0000 7f361a104640 1 --2- 172.21.15.40:0/2943581010 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f36140d15d0 0x7f36141f2560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:50:09.266 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:09.263+0000 7f361a104640 1 -- 172.21.15.40:0/2943581010 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36100094d0 con 0x7f36140b40d0 2023-12-17T11:50:09.266 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:09.263+0000 7f361a905640 1 --2- 172.21.15.40:0/2943581010 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f361415d370 0x7f36140ccca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-17T11:50:09.266 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:09.263+0000 7f361a104640 1 --2- 172.21.15.40:0/2943581010 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f36140b40d0 0x7f36140c9570 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f3610000c00 tx=0x7f36100046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:50:09.267 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:09.263+0000 7f360affd640 1 -- 172.21.15.40:0/2943581010 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f361003a930 con 0x7f36140b40d0 2023-12-17T11:50:09.267 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:09.263+0000 7f360affd640 1 -- 172.21.15.40:0/2943581010 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f361003aa90 con 0x7f36140b40d0 2023-12-17T11:50:09.267 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:09.263+0000 7f361b106640 1 -- 172.21.15.40:0/2943581010 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36140c8a90 con 0x7f36140b40d0 2023-12-17T11:50:09.267 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:09.263+0000 7f360affd640 1 -- 172.21.15.40:0/2943581010 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f361003ae40 con 0x7f36140b40d0 2023-12-17T11:50:09.267 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:09.263+0000 7f361b106640 1 -- 172.21.15.40:0/2943581010 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36140c9050 con 0x7f36140b40d0 2023-12-17T11:50:09.267 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:09.265+0000 7f361b106640 1 -- 172.21.15.40:0/2943581010 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3614067910 con 0x7f36140b40d0 2023-12-17T11:50:09.267 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:09.266+0000 7f360affd640 1 -- 172.21.15.40:0/2943581010 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f361002f050 con 0x7f36140b40d0 2023-12-17T11:50:09.268 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:09.266+0000 7f360affd640 1 --2- 172.21.15.40:0/2943581010 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f35f806ae40 0x7f35f806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:50:09.268 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:09.267+0000 7f360affd640 1 -- 172.21.15.40:0/2943581010 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f36100ab500 con 0x7f36140b40d0 2023-12-17T11:50:09.269 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:09.267+0000 7f3619903640 1 --2- 172.21.15.40:0/2943581010 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f35f806ae40 0x7f35f806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:50:09.270 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:09.268+0000 7f3619903640 1 --2- 172.21.15.40:0/2943581010 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f35f806ae40 0x7f35f806d300 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f36141f6180 tx=0x7f3604008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:50:09.273 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:09.271+0000 7f360affd640 1 -- 172.21.15.40:0/2943581010 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f3610076450 con 0x7f36140b40d0 2023-12-17T11:50:09.542 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:09.540+0000 7f361b106640 1 -- 172.21.15.40:0/2943581010 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f3614074450 con 0x7f36140b40d0 2023-12-17T11:50:09.543 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:09.541+0000 7f360affd640 1 -- 172.21.15.40:0/2943581010 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1009 (secure 0 0 0) 0x7f3610079a70 con 0x7f36140b40d0 2023-12-17T11:50:09.543 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T11:50:09.543 INFO:teuthology.orchestra.run.smithi040.stdout:{"fsid":"099cd35d-80d9-4ca4-8424-de13b3b03ac7","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":136,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":42,"num_osds":8,"num_up_osds":8,"osd_up_since":1702813685,"num_in_osds":8,"osd_in_since":1702813676,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":24,"data_bytes":592778,"bytes_used":230739968,"bytes_avail":772863373312,"bytes_total":773094113280,"write_bytes_sec":0,"read_op_per_sec":0,"write_op_per_sec":0},"fsmap":{"epoch":15,"id":2,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":2,"rank":0,"name":"d","status":"up:active","gid":5304}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":6,"modified":"2023-12-17T11:49:24.620162+0000","services":{}},"progress_events":{}} 2023-12-17T11:50:09.546 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:09.544+0000 7f361b106640 1 -- 172.21.15.40:0/2943581010 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f35f806ae40 msgr2=0x7f35f806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:50:09.546 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:09.544+0000 7f361b106640 1 --2- 172.21.15.40:0/2943581010 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f35f806ae40 0x7f35f806d300 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f36141f6180 tx=0x7f3604008040 comp rx=0 tx=0).stop 2023-12-17T11:50:09.546 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:09.544+0000 7f361b106640 1 -- 172.21.15.40:0/2943581010 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f36140b40d0 msgr2=0x7f36140c9570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:50:09.547 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:09.544+0000 7f361b106640 1 --2- 172.21.15.40:0/2943581010 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f36140b40d0 0x7f36140c9570 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f3610000c00 tx=0x7f36100046c0 comp rx=0 tx=0).stop 2023-12-17T11:50:09.547 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:09.544+0000 7f361b106640 1 -- 172.21.15.40:0/2943581010 shutdown_connections 2023-12-17T11:50:09.547 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:09.544+0000 7f361b106640 1 --2- 172.21.15.40:0/2943581010 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f35f806ae40 0x7f35f806d300 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:50:09.547 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:09.544+0000 7f361b106640 1 --2- 172.21.15.40:0/2943581010 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f361415d370 0x7f36140ccca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:50:09.547 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:09.544+0000 7f361b106640 1 --2- 172.21.15.40:0/2943581010 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f36140d15d0 0x7f36141f2560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:50:09.547 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:09.544+0000 7f361b106640 1 --2- 172.21.15.40:0/2943581010 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f36140b40d0 0x7f36140c9570 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:50:09.547 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:09.544+0000 7f361b106640 1 -- 172.21.15.40:0/2943581010 >> 172.21.15.40:0/2943581010 conn(0x7f36140d2ff0 msgr2=0x7f36140b6e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:50:09.547 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:09.545+0000 7f361b106640 1 -- 172.21.15.40:0/2943581010 shutdown_connections 2023-12-17T11:50:09.547 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:09.545+0000 7f361b106640 1 -- 172.21.15.40:0/2943581010 wait complete. 2023-12-17T11:50:09.564 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-12-17T11:50:09.564 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-17T11:50:09.777 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:09.775+0000 7f1d34a3c640 1 Processor -- start 2023-12-17T11:50:09.777 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:09.775+0000 7f1d34a3c640 1 -- start start 2023-12-17T11:50:09.779 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:09.777+0000 7f1d34a3c640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1d300b1370 0x7f1d300b1a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:50:09.779 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:09.777+0000 7f1d34a3c640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f1d300cea90 0x7f1d300b3b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:50:09.779 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:09.777+0000 7f1d34a3c640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d300cbc10 con 0x7f1d300cf290 2023-12-17T11:50:09.779 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:09.777+0000 7f1d34a3c640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d300b2310 con 0x7f1d300cea90 2023-12-17T11:50:09.779 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:09.777+0000 7f1d34a3c640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d300ceef0 con 0x7f1d300b1370 2023-12-17T11:50:09.780 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:09.778+0000 7f1d2ed9d640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1d300b1370 0x7f1d300b1a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:50:09.780 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:09.778+0000 7f1d2ed9d640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1d300b1370 0x7f1d300b1a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3301/0 says I am v2:172.21.15.40:42490/0 (socket says 172.21.15.40:42490) 2023-12-17T11:50:09.780 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:09.778+0000 7f1d2ed9d640 1 -- 172.21.15.40:0/3104609082 learned_addr learned my addr 172.21.15.40:0/3104609082 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-17T11:50:09.780 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:09.778+0000 7f1d27fff640 1 --2- 172.21.15.40:0/3104609082 >> v2:172.21.15.159:3300/0 conn(0x7f1d300cea90 0x7f1d300b3b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:50:09.781 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:09.779+0000 7f1d2ed9d640 1 -- 172.21.15.40:0/3104609082 >> v2:172.21.15.159:3300/0 conn(0x7f1d300cea90 msgr2=0x7f1d300b3b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:50:09.781 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:09.779+0000 7f1d2ed9d640 1 --2- 172.21.15.40:0/3104609082 >> v2:172.21.15.159:3300/0 conn(0x7f1d300cea90 0x7f1d300b3b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:50:09.781 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:09.779+0000 7f1d2ed9d640 1 -- 172.21.15.40:0/3104609082 >> v1:172.21.15.159:6789/0 conn(0x7f1d300cf290 legacy=0x7f1d300cc0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:50:09.781 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:09.779+0000 7f1d2ed9d640 1 -- 172.21.15.40:0/3104609082 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d300cdf20 con 0x7f1d300b1370 2023-12-17T11:50:09.782 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:09.780+0000 7f1d2ed9d640 1 --2- 172.21.15.40:0/3104609082 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1d300b1370 0x7f1d300b1a10 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f1d20009870 tx=0x7f1d2002b8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a3894baf076d2286 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:50:09.783 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:09.781+0000 7f1d2e59c640 1 -- 172.21.15.40:0/3104609082 <== mon.2 v2:172.21.15.159:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d20031640 con 0x7f1d300b1370 2023-12-17T11:50:09.783 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:09.781+0000 7f1d2e59c640 1 -- 172.21.15.40:0/3104609082 <== mon.2 v2:172.21.15.159:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d200317a0 con 0x7f1d300b1370 2023-12-17T11:50:09.783 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:09.781+0000 7f1d2e59c640 1 -- 172.21.15.40:0/3104609082 <== mon.2 v2:172.21.15.159:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d20031b30 con 0x7f1d300b1370 2023-12-17T11:50:09.783 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:09.782+0000 7f1d34a3c640 1 -- 172.21.15.40:0/3104609082 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1d300b1370 msgr2=0x7f1d300b1a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:50:09.783 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:09.782+0000 7f1d34a3c640 1 --2- 172.21.15.40:0/3104609082 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1d300b1370 0x7f1d300b1a10 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f1d20009870 tx=0x7f1d2002b8f0 comp rx=0 tx=0).stop 2023-12-17T11:50:09.784 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:09.782+0000 7f1d34a3c640 1 -- 172.21.15.40:0/3104609082 shutdown_connections 2023-12-17T11:50:09.784 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:09.782+0000 7f1d34a3c640 1 --2- 172.21.15.40:0/3104609082 >> v2:172.21.15.159:3300/0 conn(0x7f1d300cea90 0x7f1d300b3b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:50:09.784 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:09.782+0000 7f1d34a3c640 1 --2- 172.21.15.40:0/3104609082 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1d300b1370 0x7f1d300b1a10 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:50:09.784 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:09.782+0000 7f1d34a3c640 1 -- 172.21.15.40:0/3104609082 >> 172.21.15.40:0/3104609082 conn(0x7f1d300b2800 msgr2=0x7f1d300b2c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:50:09.784 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:09.782+0000 7f1d34a3c640 1 -- 172.21.15.40:0/3104609082 shutdown_connections 2023-12-17T11:50:09.784 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:09.782+0000 7f1d34a3c640 1 -- 172.21.15.40:0/3104609082 wait complete. 2023-12-17T11:50:09.786 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:09.784+0000 7f1d34a3c640 1 Processor -- start 2023-12-17T11:50:09.786 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:09.784+0000 7f1d34a3c640 1 -- start start 2023-12-17T11:50:09.788 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:09.785+0000 7f1d34a3c640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1d300b1370 0x7f1d30150360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:50:09.788 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:09.785+0000 7f1d34a3c640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1d300cea90 0x7f1d3015e440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:50:09.788 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:09.785+0000 7f1d34a3c640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1d300cf290 0x7f1d300adae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:50:09.788 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:09.785+0000 7f1d34a3c640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d3006c880 con 0x7f1d300cf290 2023-12-17T11:50:09.788 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:09.785+0000 7f1d34a3c640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d301508a0 con 0x7f1d300b1370 2023-12-17T11:50:09.788 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:09.785+0000 7f1d34a3c640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d3015e980 con 0x7f1d300cea90 2023-12-17T11:50:09.788 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:09.786+0000 7f1d2f59e640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1d300cf290 0x7f1d300adae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:50:09.788 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:09.786+0000 7f1d2f59e640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1d300cf290 0x7f1d300adae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:40748/0 (socket says 172.21.15.40:40748) 2023-12-17T11:50:09.788 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:09.786+0000 7f1d2f59e640 1 -- 172.21.15.40:0/3542046123 learned_addr learned my addr 172.21.15.40:0/3542046123 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-17T11:50:09.789 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:09.786+0000 7f1d2ed9d640 1 --2- 172.21.15.40:0/3542046123 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1d300b1370 0x7f1d30150360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:50:09.789 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:09.786+0000 7f1d27fff640 1 --2- 172.21.15.40:0/3542046123 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1d300cea90 0x7f1d3015e440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:50:09.789 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:09.786+0000 7f1d2f59e640 1 -- 172.21.15.40:0/3542046123 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1d300cea90 msgr2=0x7f1d3015e440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:50:09.789 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:09.786+0000 7f1d2f59e640 1 --2- 172.21.15.40:0/3542046123 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1d300cea90 0x7f1d3015e440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:50:09.789 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:09.786+0000 7f1d2f59e640 1 -- 172.21.15.40:0/3542046123 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1d300b1370 msgr2=0x7f1d30150360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:50:09.789 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:09.786+0000 7f1d2f59e640 1 --2- 172.21.15.40:0/3542046123 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1d300b1370 0x7f1d30150360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:50:09.789 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:09.786+0000 7f1d2f59e640 1 -- 172.21.15.40:0/3542046123 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d200094d0 con 0x7f1d300cf290 2023-12-17T11:50:09.789 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:09.786+0000 7f1d2ed9d640 1 --2- 172.21.15.40:0/3542046123 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1d300b1370 0x7f1d30150360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-17T11:50:09.790 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:09.786+0000 7f1d2f59e640 1 --2- 172.21.15.40:0/3542046123 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1d300cf290 0x7f1d300adae0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f1d2800c7a0 tx=0x7f1d2800cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:50:09.790 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:09.787+0000 7f1d277fe640 1 -- 172.21.15.40:0/3542046123 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d28003b70 con 0x7f1d300cf290 2023-12-17T11:50:09.790 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:09.787+0000 7f1d277fe640 1 -- 172.21.15.40:0/3542046123 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d28003cf0 con 0x7f1d300cf290 2023-12-17T11:50:09.790 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:09.787+0000 7f1d34a3c640 1 -- 172.21.15.40:0/3542046123 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d3006bc00 con 0x7f1d300cf290 2023-12-17T11:50:09.790 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:09.787+0000 7f1d277fe640 1 -- 172.21.15.40:0/3542046123 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d28003ea0 con 0x7f1d300cf290 2023-12-17T11:50:09.790 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:09.787+0000 7f1d34a3c640 1 -- 172.21.15.40:0/3542046123 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d3006c1c0 con 0x7f1d300cf290 2023-12-17T11:50:09.790 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:09.788+0000 7f1d34a3c640 1 -- 172.21.15.40:0/3542046123 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d3006c9c0 con 0x7f1d300cf290 2023-12-17T11:50:09.791 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:09.789+0000 7f1d277fe640 1 -- 172.21.15.40:0/3542046123 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f1d2800aa30 con 0x7f1d300cf290 2023-12-17T11:50:09.792 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:09.790+0000 7f1d277fe640 1 --2- 172.21.15.40:0/3542046123 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f1d1006ae40 0x7f1d1006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:50:09.792 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:09.790+0000 7f1d277fe640 1 -- 172.21.15.40:0/3542046123 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f1d28089560 con 0x7f1d300cf290 2023-12-17T11:50:09.792 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:09.791+0000 7f1d2ed9d640 1 --2- 172.21.15.40:0/3542046123 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f1d1006ae40 0x7f1d1006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:50:09.794 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:09.792+0000 7f1d2ed9d640 1 --2- 172.21.15.40:0/3542046123 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f1d1006ae40 0x7f1d1006d300 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f1d20009870 tx=0x7f1d2003c040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:50:09.796 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:09.795+0000 7f1d277fe640 1 -- 172.21.15.40:0/3542046123 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f1d3006c9c0 con 0x7f1d300cf290 2023-12-17T11:50:09.986 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:09.984+0000 7f1d34a3c640 1 -- 172.21.15.40:0/3542046123 --> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f1d300b4040 con 0x7f1d1006ae40 2023-12-17T11:50:10.008 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:10.006+0000 7f1d277fe640 1 -- 172.21.15.40:0/3542046123 <== mgr.4105 v2:172.21.15.159:6832/479465803 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286503 (secure 0 0 0) 0x7f1d20031a10 con 0x7f1d1006ae40 2023-12-17T11:50:10.013 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T11:50:10.014 INFO:teuthology.orchestra.run.smithi040.stderr:dumped all 2023-12-17T11:50:10.016 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:10.011+0000 7f1d34a3c640 1 -- 172.21.15.40:0/3542046123 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f1d1006ae40 msgr2=0x7f1d1006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:50:10.016 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:10.011+0000 7f1d34a3c640 1 --2- 172.21.15.40:0/3542046123 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f1d1006ae40 0x7f1d1006d300 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f1d20009870 tx=0x7f1d2003c040 comp rx=0 tx=0).stop 2023-12-17T11:50:10.016 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:10.012+0000 7f1d34a3c640 1 -- 172.21.15.40:0/3542046123 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1d300cf290 msgr2=0x7f1d300adae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:50:10.016 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:10.012+0000 7f1d34a3c640 1 --2- 172.21.15.40:0/3542046123 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1d300cf290 0x7f1d300adae0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f1d2800c7a0 tx=0x7f1d2800cc60 comp rx=0 tx=0).stop 2023-12-17T11:50:10.016 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:10.012+0000 7f1d34a3c640 1 -- 172.21.15.40:0/3542046123 shutdown_connections 2023-12-17T11:50:10.016 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:10.012+0000 7f1d34a3c640 1 --2- 172.21.15.40:0/3542046123 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f1d1006ae40 0x7f1d1006d300 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:50:10.016 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:10.012+0000 7f1d34a3c640 1 --2- 172.21.15.40:0/3542046123 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1d300cf290 0x7f1d300adae0 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:50:10.016 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:10.012+0000 7f1d34a3c640 1 --2- 172.21.15.40:0/3542046123 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1d300cea90 0x7f1d3015e440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:50:10.016 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:10.012+0000 7f1d34a3c640 1 --2- 172.21.15.40:0/3542046123 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1d300b1370 0x7f1d30150360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:50:10.017 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:10.012+0000 7f1d34a3c640 1 -- 172.21.15.40:0/3542046123 >> 172.21.15.40:0/3542046123 conn(0x7f1d300b2800 msgr2=0x7f1d300b2be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:50:10.017 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:10.012+0000 7f1d34a3c640 1 -- 172.21.15.40:0/3542046123 shutdown_connections 2023-12-17T11:50:10.017 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:10.012+0000 7f1d34a3c640 1 -- 172.21.15.40:0/3542046123 wait complete. 2023-12-17T11:50:10.033 INFO:teuthology.orchestra.run.smithi040.stdout:{"pg_ready":true,"pg_map":{"version":96,"stamp":"2023-12-17T11:50:08.635477+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":225332,"kb_used_data":5000,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754749388,"statfs":{"total":773094113280,"available":772863373312,"internally_reserved":0,"allocated":5120000,"data_stored":2866588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":225496626},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.116250"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-17T11:50:00.525487+0000","last_change":"2023-12-17T11:49:53.251801+0000","last_active":"2023-12-17T11:50:00.525487+0000","last_peered":"2023-12-17T11:50:00.525487+0000","last_clean":"2023-12-17T11:50:00.525487+0000","last_became_active":"2023-12-17T11:49:53.251221+0000","last_became_peered":"2023-12-17T11:49:53.251221+0000","last_unstale":"2023-12-17T11:50:00.525487+0000","last_undegraded":"2023-12-17T11:50:00.525487+0000","last_fullsized":"2023-12-17T11:50:00.525487+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T22:42:15.785143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-17T11:50:00.524627+0000","last_change":"2023-12-17T11:49:53.243478+0000","last_active":"2023-12-17T11:50:00.524627+0000","last_peered":"2023-12-17T11:50:00.524627+0000","last_clean":"2023-12-17T11:50:00.524627+0000","last_became_active":"2023-12-17T11:49:53.243179+0000","last_became_peered":"2023-12-17T11:49:53.243179+0000","last_unstale":"2023-12-17T11:50:00.524627+0000","last_undegraded":"2023-12-17T11:50:00.524627+0000","last_fullsized":"2023-12-17T11:50:00.524627+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T23:49:09.469993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-17T11:50:00.529653+0000","last_change":"2023-12-17T11:49:53.249501+0000","last_active":"2023-12-17T11:50:00.529653+0000","last_peered":"2023-12-17T11:50:00.529653+0000","last_clean":"2023-12-17T11:50:00.529653+0000","last_became_active":"2023-12-17T11:49:53.249212+0000","last_became_peered":"2023-12-17T11:49:53.249212+0000","last_unstale":"2023-12-17T11:50:00.529653+0000","last_undegraded":"2023-12-17T11:50:00.529653+0000","last_fullsized":"2023-12-17T11:50:00.529653+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T22:50:12.261960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-17T11:50:01.303372+0000","last_change":"2023-12-17T11:49:53.237486+0000","last_active":"2023-12-17T11:50:01.303372+0000","last_peered":"2023-12-17T11:50:01.303372+0000","last_clean":"2023-12-17T11:50:01.303372+0000","last_became_active":"2023-12-17T11:49:53.236766+0000","last_became_peered":"2023-12-17T11:49:53.236766+0000","last_unstale":"2023-12-17T11:50:01.303372+0000","last_undegraded":"2023-12-17T11:50:01.303372+0000","last_fullsized":"2023-12-17T11:50:01.303372+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T19:34:01.395947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-17T11:50:01.303292+0000","last_change":"2023-12-17T11:49:53.230175+0000","last_active":"2023-12-17T11:50:01.303292+0000","last_peered":"2023-12-17T11:50:01.303292+0000","last_clean":"2023-12-17T11:50:01.303292+0000","last_became_active":"2023-12-17T11:49:53.229756+0000","last_became_peered":"2023-12-17T11:49:53.229756+0000","last_unstale":"2023-12-17T11:50:01.303292+0000","last_undegraded":"2023-12-17T11:50:01.303292+0000","last_fullsized":"2023-12-17T11:50:01.303292+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T15:43:04.869288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-17T11:50:00.523170+0000","last_change":"2023-12-17T11:49:53.245040+0000","last_active":"2023-12-17T11:50:00.523170+0000","last_peered":"2023-12-17T11:50:00.523170+0000","last_clean":"2023-12-17T11:50:00.523170+0000","last_became_active":"2023-12-17T11:49:53.243989+0000","last_became_peered":"2023-12-17T11:49:53.243989+0000","last_unstale":"2023-12-17T11:50:00.523170+0000","last_undegraded":"2023-12-17T11:50:00.523170+0000","last_fullsized":"2023-12-17T11:50:00.523170+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T16:31:53.964205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-17T11:50:00.528791+0000","last_change":"2023-12-17T11:49:53.244506+0000","last_active":"2023-12-17T11:50:00.528791+0000","last_peered":"2023-12-17T11:50:00.528791+0000","last_clean":"2023-12-17T11:50:00.528791+0000","last_became_active":"2023-12-17T11:49:53.244244+0000","last_became_peered":"2023-12-17T11:49:53.244244+0000","last_unstale":"2023-12-17T11:50:00.528791+0000","last_undegraded":"2023-12-17T11:50:00.528791+0000","last_fullsized":"2023-12-17T11:50:00.528791+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T12:27:38.132749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-17T11:50:00.522397+0000","last_change":"2023-12-17T11:49:53.256713+0000","last_active":"2023-12-17T11:50:00.522397+0000","last_peered":"2023-12-17T11:50:00.522397+0000","last_clean":"2023-12-17T11:50:00.522397+0000","last_became_active":"2023-12-17T11:49:53.255850+0000","last_became_peered":"2023-12-17T11:49:53.255850+0000","last_unstale":"2023-12-17T11:50:00.522397+0000","last_undegraded":"2023-12-17T11:50:00.522397+0000","last_fullsized":"2023-12-17T11:50:00.522397+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T14:00:43.418107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-17T11:50:00.530083+0000","last_change":"2023-12-17T11:49:53.255007+0000","last_active":"2023-12-17T11:50:00.530083+0000","last_peered":"2023-12-17T11:50:00.530083+0000","last_clean":"2023-12-17T11:50:00.530083+0000","last_became_active":"2023-12-17T11:49:53.254750+0000","last_became_peered":"2023-12-17T11:49:53.254750+0000","last_unstale":"2023-12-17T11:50:00.530083+0000","last_undegraded":"2023-12-17T11:50:00.530083+0000","last_fullsized":"2023-12-17T11:50:00.530083+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T19:23:44.505187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-17T11:50:00.529928+0000","last_change":"2023-12-17T11:49:53.243885+0000","last_active":"2023-12-17T11:50:00.529928+0000","last_peered":"2023-12-17T11:50:00.529928+0000","last_clean":"2023-12-17T11:50:00.529928+0000","last_became_active":"2023-12-17T11:49:53.243586+0000","last_became_peered":"2023-12-17T11:49:53.243586+0000","last_unstale":"2023-12-17T11:50:00.529928+0000","last_undegraded":"2023-12-17T11:50:00.529928+0000","last_fullsized":"2023-12-17T11:50:00.529928+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T23:49:09.469993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-17T11:50:00.529560+0000","last_change":"2023-12-17T11:49:53.245071+0000","last_active":"2023-12-17T11:50:00.529560+0000","last_peered":"2023-12-17T11:50:00.529560+0000","last_clean":"2023-12-17T11:50:00.529560+0000","last_became_active":"2023-12-17T11:49:53.244696+0000","last_became_peered":"2023-12-17T11:49:53.244696+0000","last_unstale":"2023-12-17T11:50:00.529560+0000","last_undegraded":"2023-12-17T11:50:00.529560+0000","last_fullsized":"2023-12-17T11:50:00.529560+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T17:56:09.285369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-17T11:50:00.529492+0000","last_change":"2023-12-17T11:49:53.244437+0000","last_active":"2023-12-17T11:50:00.529492+0000","last_peered":"2023-12-17T11:50:00.529492+0000","last_clean":"2023-12-17T11:50:00.529492+0000","last_became_active":"2023-12-17T11:49:53.244158+0000","last_became_peered":"2023-12-17T11:49:53.244158+0000","last_unstale":"2023-12-17T11:50:00.529492+0000","last_undegraded":"2023-12-17T11:50:00.529492+0000","last_fullsized":"2023-12-17T11:50:00.529492+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T12:12:45.651530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-17T11:50:00.529005+0000","last_change":"2023-12-17T11:49:53.259954+0000","last_active":"2023-12-17T11:50:00.529005+0000","last_peered":"2023-12-17T11:50:00.529005+0000","last_clean":"2023-12-17T11:50:00.529005+0000","last_became_active":"2023-12-17T11:49:53.259683+0000","last_became_peered":"2023-12-17T11:49:53.259683+0000","last_unstale":"2023-12-17T11:50:00.529005+0000","last_undegraded":"2023-12-17T11:50:00.529005+0000","last_fullsized":"2023-12-17T11:50:00.529005+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T13:29:29.953615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-17T11:50:00.522506+0000","last_change":"2023-12-17T11:49:53.251388+0000","last_active":"2023-12-17T11:50:00.522506+0000","last_peered":"2023-12-17T11:50:00.522506+0000","last_clean":"2023-12-17T11:50:00.522506+0000","last_became_active":"2023-12-17T11:49:53.251182+0000","last_became_peered":"2023-12-17T11:49:53.251182+0000","last_unstale":"2023-12-17T11:50:00.522506+0000","last_undegraded":"2023-12-17T11:50:00.522506+0000","last_fullsized":"2023-12-17T11:50:00.522506+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T19:39:18.340154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-17T11:50:00.528861+0000","last_change":"2023-12-17T11:49:53.251484+0000","last_active":"2023-12-17T11:50:00.528861+0000","last_peered":"2023-12-17T11:50:00.528861+0000","last_clean":"2023-12-17T11:50:00.528861+0000","last_became_active":"2023-12-17T11:49:53.250825+0000","last_became_peered":"2023-12-17T11:49:53.250825+0000","last_unstale":"2023-12-17T11:50:00.528861+0000","last_undegraded":"2023-12-17T11:50:00.528861+0000","last_fullsized":"2023-12-17T11:50:00.528861+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T12:48:09.865175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:55.795131+0000","last_change":"2023-12-17T11:49:53.256736+0000","last_active":"2023-12-17T11:49:55.795131+0000","last_peered":"2023-12-17T11:49:55.795131+0000","last_clean":"2023-12-17T11:49:55.795131+0000","last_became_active":"2023-12-17T11:49:53.256319+0000","last_became_peered":"2023-12-17T11:49:53.256319+0000","last_unstale":"2023-12-17T11:49:55.795131+0000","last_undegraded":"2023-12-17T11:49:55.795131+0000","last_fullsized":"2023-12-17T11:49:55.795131+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T14:49:05.628056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:55.795758+0000","last_change":"2023-12-17T11:49:53.254466+0000","last_active":"2023-12-17T11:49:55.795758+0000","last_peered":"2023-12-17T11:49:55.795758+0000","last_clean":"2023-12-17T11:49:55.795758+0000","last_became_active":"2023-12-17T11:49:53.254191+0000","last_became_peered":"2023-12-17T11:49:53.254191+0000","last_unstale":"2023-12-17T11:49:55.795758+0000","last_undegraded":"2023-12-17T11:49:55.795758+0000","last_fullsized":"2023-12-17T11:49:55.795758+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T15:34:59.184998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-17T11:50:01.202677+0000","last_change":"2023-12-17T11:49:53.244371+0000","last_active":"2023-12-17T11:50:01.202677+0000","last_peered":"2023-12-17T11:50:01.202677+0000","last_clean":"2023-12-17T11:50:01.202677+0000","last_became_active":"2023-12-17T11:49:53.243288+0000","last_became_peered":"2023-12-17T11:49:53.243288+0000","last_unstale":"2023-12-17T11:50:01.202677+0000","last_undegraded":"2023-12-17T11:50:01.202677+0000","last_fullsized":"2023-12-17T11:50:01.202677+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T22:59:01.401999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-17T11:50:01.303607+0000","last_change":"2023-12-17T11:49:53.247133+0000","last_active":"2023-12-17T11:50:01.303607+0000","last_peered":"2023-12-17T11:50:01.303607+0000","last_clean":"2023-12-17T11:50:01.303607+0000","last_became_active":"2023-12-17T11:49:53.246863+0000","last_became_peered":"2023-12-17T11:49:53.246863+0000","last_unstale":"2023-12-17T11:50:01.303607+0000","last_undegraded":"2023-12-17T11:50:01.303607+0000","last_fullsized":"2023-12-17T11:50:01.303607+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T15:22:56.669665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-17T11:50:01.202405+0000","last_change":"2023-12-17T11:49:53.234246+0000","last_active":"2023-12-17T11:50:01.202405+0000","last_peered":"2023-12-17T11:50:01.202405+0000","last_clean":"2023-12-17T11:50:01.202405+0000","last_became_active":"2023-12-17T11:49:53.233971+0000","last_became_peered":"2023-12-17T11:49:53.233971+0000","last_unstale":"2023-12-17T11:50:01.202405+0000","last_undegraded":"2023-12-17T11:50:01.202405+0000","last_fullsized":"2023-12-17T11:50:01.202405+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T21:22:15.324114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-17T11:50:00.529542+0000","last_change":"2023-12-17T11:49:53.254631+0000","last_active":"2023-12-17T11:50:00.529542+0000","last_peered":"2023-12-17T11:50:00.529542+0000","last_clean":"2023-12-17T11:50:00.529542+0000","last_became_active":"2023-12-17T11:49:53.254246+0000","last_became_peered":"2023-12-17T11:49:53.254246+0000","last_unstale":"2023-12-17T11:50:00.529542+0000","last_undegraded":"2023-12-17T11:50:00.529542+0000","last_fullsized":"2023-12-17T11:50:00.529542+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T15:42:47.132551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-17T11:50:00.523985+0000","last_change":"2023-12-17T11:49:53.233281+0000","last_active":"2023-12-17T11:50:00.523985+0000","last_peered":"2023-12-17T11:50:00.523985+0000","last_clean":"2023-12-17T11:50:00.523985+0000","last_became_active":"2023-12-17T11:49:53.233006+0000","last_became_peered":"2023-12-17T11:49:53.233006+0000","last_unstale":"2023-12-17T11:50:00.523985+0000","last_undegraded":"2023-12-17T11:50:00.523985+0000","last_fullsized":"2023-12-17T11:50:00.523985+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T17:37:46.058341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:55.795311+0000","last_change":"2023-12-17T11:49:53.235006+0000","last_active":"2023-12-17T11:49:55.795311+0000","last_peered":"2023-12-17T11:49:55.795311+0000","last_clean":"2023-12-17T11:49:55.795311+0000","last_became_active":"2023-12-17T11:49:53.232828+0000","last_became_peered":"2023-12-17T11:49:53.232828+0000","last_unstale":"2023-12-17T11:49:55.795311+0000","last_undegraded":"2023-12-17T11:49:55.795311+0000","last_fullsized":"2023-12-17T11:49:55.795311+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T21:34:46.442330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-17T11:50:01.303767+0000","last_change":"2023-12-17T11:49:53.229937+0000","last_active":"2023-12-17T11:50:01.303767+0000","last_peered":"2023-12-17T11:50:01.303767+0000","last_clean":"2023-12-17T11:50:01.303767+0000","last_became_active":"2023-12-17T11:49:53.229360+0000","last_became_peered":"2023-12-17T11:49:53.229360+0000","last_unstale":"2023-12-17T11:50:01.303767+0000","last_undegraded":"2023-12-17T11:50:01.303767+0000","last_fullsized":"2023-12-17T11:50:01.303767+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T13:22:57.464897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-17T11:50:01.202634+0000","last_change":"2023-12-17T11:49:53.248140+0000","last_active":"2023-12-17T11:50:01.202634+0000","last_peered":"2023-12-17T11:50:01.202634+0000","last_clean":"2023-12-17T11:50:01.202634+0000","last_became_active":"2023-12-17T11:49:53.246139+0000","last_became_peered":"2023-12-17T11:49:53.246139+0000","last_unstale":"2023-12-17T11:50:01.202634+0000","last_undegraded":"2023-12-17T11:50:01.202634+0000","last_fullsized":"2023-12-17T11:50:01.202634+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T14:32:00.462222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-17T11:50:00.523471+0000","last_change":"2023-12-17T11:49:53.255892+0000","last_active":"2023-12-17T11:50:00.523471+0000","last_peered":"2023-12-17T11:50:00.523471+0000","last_clean":"2023-12-17T11:50:00.523471+0000","last_became_active":"2023-12-17T11:49:53.255307+0000","last_became_peered":"2023-12-17T11:49:53.255307+0000","last_unstale":"2023-12-17T11:50:00.523471+0000","last_undegraded":"2023-12-17T11:50:00.523471+0000","last_fullsized":"2023-12-17T11:50:00.523471+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T17:37:46.058341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-17T11:50:01.202692+0000","last_change":"2023-12-17T11:49:53.238527+0000","last_active":"2023-12-17T11:50:01.202692+0000","last_peered":"2023-12-17T11:50:01.202692+0000","last_clean":"2023-12-17T11:50:01.202692+0000","last_became_active":"2023-12-17T11:49:53.238260+0000","last_became_peered":"2023-12-17T11:49:53.238260+0000","last_unstale":"2023-12-17T11:50:01.202692+0000","last_undegraded":"2023-12-17T11:50:01.202692+0000","last_fullsized":"2023-12-17T11:50:01.202692+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T14:03:14.332356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-17T11:50:00.529245+0000","last_change":"2023-12-17T11:49:53.247243+0000","last_active":"2023-12-17T11:50:00.529245+0000","last_peered":"2023-12-17T11:50:00.529245+0000","last_clean":"2023-12-17T11:50:00.529245+0000","last_became_active":"2023-12-17T11:49:53.246983+0000","last_became_peered":"2023-12-17T11:49:53.246983+0000","last_unstale":"2023-12-17T11:50:00.529245+0000","last_undegraded":"2023-12-17T11:50:00.529245+0000","last_fullsized":"2023-12-17T11:50:00.529245+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T23:33:06.562683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-17T11:50:01.202387+0000","last_change":"2023-12-17T11:49:53.247287+0000","last_active":"2023-12-17T11:50:01.202387+0000","last_peered":"2023-12-17T11:50:01.202387+0000","last_clean":"2023-12-17T11:50:01.202387+0000","last_became_active":"2023-12-17T11:49:53.246995+0000","last_became_peered":"2023-12-17T11:49:53.246995+0000","last_unstale":"2023-12-17T11:50:01.202387+0000","last_undegraded":"2023-12-17T11:50:01.202387+0000","last_fullsized":"2023-12-17T11:50:01.202387+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T14:03:09.358474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-17T11:50:01.202183+0000","last_change":"2023-12-17T11:49:53.240901+0000","last_active":"2023-12-17T11:50:01.202183+0000","last_peered":"2023-12-17T11:50:01.202183+0000","last_clean":"2023-12-17T11:50:01.202183+0000","last_became_active":"2023-12-17T11:49:53.240589+0000","last_became_peered":"2023-12-17T11:49:53.240589+0000","last_unstale":"2023-12-17T11:50:01.202183+0000","last_undegraded":"2023-12-17T11:50:01.202183+0000","last_fullsized":"2023-12-17T11:50:01.202183+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T19:17:47.294209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:55.795352+0000","last_change":"2023-12-17T11:49:53.239855+0000","last_active":"2023-12-17T11:49:55.795352+0000","last_peered":"2023-12-17T11:49:55.795352+0000","last_clean":"2023-12-17T11:49:55.795352+0000","last_became_active":"2023-12-17T11:49:53.239579+0000","last_became_peered":"2023-12-17T11:49:53.239579+0000","last_unstale":"2023-12-17T11:49:55.795352+0000","last_undegraded":"2023-12-17T11:49:55.795352+0000","last_fullsized":"2023-12-17T11:49:55.795352+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T20:29:09.996550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-17T11:50:00.522960+0000","last_change":"2023-12-17T11:49:53.252543+0000","last_active":"2023-12-17T11:50:00.522960+0000","last_peered":"2023-12-17T11:50:00.522960+0000","last_clean":"2023-12-17T11:50:00.522960+0000","last_became_active":"2023-12-17T11:49:53.250790+0000","last_became_peered":"2023-12-17T11:49:53.250790+0000","last_unstale":"2023-12-17T11:50:00.522960+0000","last_undegraded":"2023-12-17T11:50:00.522960+0000","last_fullsized":"2023-12-17T11:50:00.522960+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T19:00:07.905809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:55.795567+0000","last_change":"2023-12-17T11:49:53.245226+0000","last_active":"2023-12-17T11:49:55.795567+0000","last_peered":"2023-12-17T11:49:55.795567+0000","last_clean":"2023-12-17T11:49:55.795567+0000","last_became_active":"2023-12-17T11:49:53.243115+0000","last_became_peered":"2023-12-17T11:49:53.243115+0000","last_unstale":"2023-12-17T11:49:55.795567+0000","last_undegraded":"2023-12-17T11:49:55.795567+0000","last_fullsized":"2023-12-17T11:49:55.795567+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T15:06:34.831619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"39'4","reported_seq":18,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-17T11:50:01.202725+0000","last_change":"2023-12-17T11:49:52.226944+0000","last_active":"2023-12-17T11:50:01.202725+0000","last_peered":"2023-12-17T11:50:01.202725+0000","last_clean":"2023-12-17T11:50:01.202725+0000","last_became_active":"2023-12-17T11:49:52.226659+0000","last_became_peered":"2023-12-17T11:49:52.226659+0000","last_unstale":"2023-12-17T11:50:01.202725+0000","last_undegraded":"2023-12-17T11:50:01.202725+0000","last_fullsized":"2023-12-17T11:50:01.202725+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_clean_scrub_stamp":"2023-12-17T11:49:51.168108+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T13:22:56.453467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-17T11:50:00.523987+0000","last_change":"2023-12-17T11:49:53.254791+0000","last_active":"2023-12-17T11:50:00.523987+0000","last_peered":"2023-12-17T11:50:00.523987+0000","last_clean":"2023-12-17T11:50:00.523987+0000","last_became_active":"2023-12-17T11:49:53.254496+0000","last_became_peered":"2023-12-17T11:49:53.254496+0000","last_unstale":"2023-12-17T11:50:00.523987+0000","last_undegraded":"2023-12-17T11:50:00.523987+0000","last_fullsized":"2023-12-17T11:50:00.523987+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T14:42:29.543380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"39'1","reported_seq":15,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-17T11:50:00.529763+0000","last_change":"2023-12-17T11:49:52.223256+0000","last_active":"2023-12-17T11:50:00.529763+0000","last_peered":"2023-12-17T11:50:00.529763+0000","last_clean":"2023-12-17T11:50:00.529763+0000","last_became_active":"2023-12-17T11:49:52.222808+0000","last_became_peered":"2023-12-17T11:49:52.222808+0000","last_unstale":"2023-12-17T11:50:00.529763+0000","last_undegraded":"2023-12-17T11:50:00.529763+0000","last_fullsized":"2023-12-17T11:50:00.529763+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_clean_scrub_stamp":"2023-12-17T11:49:51.168108+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T16:31:52.952775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-17T11:50:00.523143+0000","last_change":"2023-12-17T11:49:53.251178+0000","last_active":"2023-12-17T11:50:00.523143+0000","last_peered":"2023-12-17T11:50:00.523143+0000","last_clean":"2023-12-17T11:50:00.523143+0000","last_became_active":"2023-12-17T11:49:53.250223+0000","last_became_peered":"2023-12-17T11:49:53.250223+0000","last_unstale":"2023-12-17T11:50:00.523143+0000","last_undegraded":"2023-12-17T11:50:00.523143+0000","last_fullsized":"2023-12-17T11:50:00.523143+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T23:10:56.100255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"39'2","reported_seq":16,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-17T11:50:00.524369+0000","last_change":"2023-12-17T11:49:52.223879+0000","last_active":"2023-12-17T11:50:00.524369+0000","last_peered":"2023-12-17T11:50:00.524369+0000","last_clean":"2023-12-17T11:50:00.524369+0000","last_became_active":"2023-12-17T11:49:52.223602+0000","last_became_peered":"2023-12-17T11:49:52.223602+0000","last_unstale":"2023-12-17T11:50:00.524369+0000","last_undegraded":"2023-12-17T11:50:00.524369+0000","last_fullsized":"2023-12-17T11:50:00.524369+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_clean_scrub_stamp":"2023-12-17T11:49:51.168108+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T15:25:46.493177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-17T11:50:00.525262+0000","last_change":"2023-12-17T11:49:53.254646+0000","last_active":"2023-12-17T11:50:00.525262+0000","last_peered":"2023-12-17T11:50:00.525262+0000","last_clean":"2023-12-17T11:50:00.525262+0000","last_became_active":"2023-12-17T11:49:53.254368+0000","last_became_peered":"2023-12-17T11:49:53.254368+0000","last_unstale":"2023-12-17T11:50:00.525262+0000","last_undegraded":"2023-12-17T11:50:00.525262+0000","last_fullsized":"2023-12-17T11:50:00.525262+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T15:42:47.132551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"39'2","reported_seq":16,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-17T11:50:00.523260+0000","last_change":"2023-12-17T11:49:52.221006+0000","last_active":"2023-12-17T11:50:00.523260+0000","last_peered":"2023-12-17T11:50:00.523260+0000","last_clean":"2023-12-17T11:50:00.523260+0000","last_became_active":"2023-12-17T11:49:52.220514+0000","last_became_peered":"2023-12-17T11:49:52.220514+0000","last_unstale":"2023-12-17T11:50:00.523260+0000","last_undegraded":"2023-12-17T11:50:00.523260+0000","last_fullsized":"2023-12-17T11:50:00.523260+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_clean_scrub_stamp":"2023-12-17T11:49:51.168108+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T15:25:46.493177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-17T11:50:00.528932+0000","last_change":"2023-12-17T11:49:53.251737+0000","last_active":"2023-12-17T11:50:00.528932+0000","last_peered":"2023-12-17T11:50:00.528932+0000","last_clean":"2023-12-17T11:50:00.528932+0000","last_became_active":"2023-12-17T11:49:53.251458+0000","last_became_peered":"2023-12-17T11:49:53.251458+0000","last_unstale":"2023-12-17T11:50:00.528932+0000","last_undegraded":"2023-12-17T11:50:00.528932+0000","last_fullsized":"2023-12-17T11:50:00.528932+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T17:37:46.058341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"39'1","reported_seq":15,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-17T11:50:00.529332+0000","last_change":"2023-12-17T11:49:52.226918+0000","last_active":"2023-12-17T11:50:00.529332+0000","last_peered":"2023-12-17T11:50:00.529332+0000","last_clean":"2023-12-17T11:50:00.529332+0000","last_became_active":"2023-12-17T11:49:52.226455+0000","last_became_peered":"2023-12-17T11:49:52.226455+0000","last_unstale":"2023-12-17T11:50:00.529332+0000","last_undegraded":"2023-12-17T11:50:00.529332+0000","last_fullsized":"2023-12-17T11:50:00.529332+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_clean_scrub_stamp":"2023-12-17T11:49:51.168108+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T12:12:44.640100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-17T11:50:00.529065+0000","last_change":"2023-12-17T11:49:53.251691+0000","last_active":"2023-12-17T11:50:00.529065+0000","last_peered":"2023-12-17T11:50:00.529065+0000","last_clean":"2023-12-17T11:50:00.529065+0000","last_became_active":"2023-12-17T11:49:53.251175+0000","last_became_peered":"2023-12-17T11:49:53.251175+0000","last_unstale":"2023-12-17T11:50:00.529065+0000","last_undegraded":"2023-12-17T11:50:00.529065+0000","last_fullsized":"2023-12-17T11:50:00.529065+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T14:00:43.418107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"39'1","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:55.795479+0000","last_change":"2023-12-17T11:49:52.225053+0000","last_active":"2023-12-17T11:49:55.795479+0000","last_peered":"2023-12-17T11:49:55.795479+0000","last_clean":"2023-12-17T11:49:55.795479+0000","last_became_active":"2023-12-17T11:49:52.224761+0000","last_became_peered":"2023-12-17T11:49:52.224761+0000","last_unstale":"2023-12-17T11:49:55.795479+0000","last_undegraded":"2023-12-17T11:49:55.795479+0000","last_fullsized":"2023-12-17T11:49:55.795479+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_clean_scrub_stamp":"2023-12-17T11:49:51.168108+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T20:30:07.106128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":20,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-12-17T11:50:02.268429+0000","last_change":"2023-12-17T11:50:02.268429+0000","last_active":"2023-12-17T11:50:02.268429+0000","last_peered":"2023-12-17T11:50:02.268429+0000","last_clean":"2023-12-17T11:50:02.268429+0000","last_became_active":"2023-12-17T11:50:02.267857+0000","last_became_peered":"2023-12-17T11:50:02.267857+0000","last_unstale":"2023-12-17T11:50:02.268429+0000","last_undegraded":"2023-12-17T11:50:02.268429+0000","last_fullsized":"2023-12-17T11:50:02.268429+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T19:23:44.505187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-17T11:50:00.523140+0000","last_change":"2023-12-17T11:49:52.230598+0000","last_active":"2023-12-17T11:50:00.523140+0000","last_peered":"2023-12-17T11:50:00.523140+0000","last_clean":"2023-12-17T11:50:00.523140+0000","last_became_active":"2023-12-17T11:49:52.230298+0000","last_became_peered":"2023-12-17T11:49:52.230298+0000","last_unstale":"2023-12-17T11:50:00.523140+0000","last_undegraded":"2023-12-17T11:50:00.523140+0000","last_fullsized":"2023-12-17T11:50:00.523140+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_clean_scrub_stamp":"2023-12-17T11:49:51.168108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T22:39:30.094160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-17T11:50:00.523881+0000","last_change":"2023-12-17T11:49:53.249431+0000","last_active":"2023-12-17T11:50:00.523881+0000","last_peered":"2023-12-17T11:50:00.523881+0000","last_clean":"2023-12-17T11:50:00.523881+0000","last_became_active":"2023-12-17T11:49:53.248943+0000","last_became_peered":"2023-12-17T11:49:53.248943+0000","last_unstale":"2023-12-17T11:50:00.523881+0000","last_undegraded":"2023-12-17T11:50:00.523881+0000","last_fullsized":"2023-12-17T11:50:00.523881+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T16:21:14.355302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-17T11:50:00.522481+0000","last_change":"2023-12-17T11:49:52.224198+0000","last_active":"2023-12-17T11:50:00.522481+0000","last_peered":"2023-12-17T11:50:00.522481+0000","last_clean":"2023-12-17T11:50:00.522481+0000","last_became_active":"2023-12-17T11:49:52.223829+0000","last_became_peered":"2023-12-17T11:49:52.223829+0000","last_unstale":"2023-12-17T11:50:00.522481+0000","last_undegraded":"2023-12-17T11:50:00.522481+0000","last_fullsized":"2023-12-17T11:50:00.522481+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_clean_scrub_stamp":"2023-12-17T11:49:51.168108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T13:20:29.045455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-17T11:50:01.303367+0000","last_change":"2023-12-17T11:49:53.232883+0000","last_active":"2023-12-17T11:50:01.303367+0000","last_peered":"2023-12-17T11:50:01.303367+0000","last_clean":"2023-12-17T11:50:01.303367+0000","last_became_active":"2023-12-17T11:49:53.232629+0000","last_became_peered":"2023-12-17T11:49:53.232629+0000","last_unstale":"2023-12-17T11:50:01.303367+0000","last_undegraded":"2023-12-17T11:50:01.303367+0000","last_fullsized":"2023-12-17T11:50:01.303367+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T18:07:10.105462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-17T11:50:00.525489+0000","last_change":"2023-12-17T11:49:52.215890+0000","last_active":"2023-12-17T11:50:00.525489+0000","last_peered":"2023-12-17T11:50:00.525489+0000","last_clean":"2023-12-17T11:50:00.525489+0000","last_became_active":"2023-12-17T11:49:52.215576+0000","last_became_peered":"2023-12-17T11:49:52.215576+0000","last_unstale":"2023-12-17T11:50:00.525489+0000","last_undegraded":"2023-12-17T11:50:00.525489+0000","last_fullsized":"2023-12-17T11:50:00.525489+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_clean_scrub_stamp":"2023-12-17T11:49:51.168108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T17:03:59.637357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:55.795673+0000","last_change":"2023-12-17T11:49:53.236661+0000","last_active":"2023-12-17T11:49:55.795673+0000","last_peered":"2023-12-17T11:49:55.795673+0000","last_clean":"2023-12-17T11:49:55.795673+0000","last_became_active":"2023-12-17T11:49:53.236319+0000","last_became_peered":"2023-12-17T11:49:53.236319+0000","last_unstale":"2023-12-17T11:49:55.795673+0000","last_undegraded":"2023-12-17T11:49:55.795673+0000","last_fullsized":"2023-12-17T11:49:55.795673+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T13:29:01.309715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-17T11:50:00.530428+0000","last_change":"2023-12-17T11:49:52.233070+0000","last_active":"2023-12-17T11:50:00.530428+0000","last_peered":"2023-12-17T11:50:00.530428+0000","last_clean":"2023-12-17T11:50:00.530428+0000","last_became_active":"2023-12-17T11:49:52.232635+0000","last_became_peered":"2023-12-17T11:49:52.232635+0000","last_unstale":"2023-12-17T11:50:00.530428+0000","last_undegraded":"2023-12-17T11:50:00.530428+0000","last_fullsized":"2023-12-17T11:50:00.530428+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_clean_scrub_stamp":"2023-12-17T11:49:51.168108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T15:53:07.030004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-17T11:50:00.529654+0000","last_change":"2023-12-17T11:49:53.246755+0000","last_active":"2023-12-17T11:50:00.529654+0000","last_peered":"2023-12-17T11:50:00.529654+0000","last_clean":"2023-12-17T11:50:00.529654+0000","last_became_active":"2023-12-17T11:49:53.245111+0000","last_became_peered":"2023-12-17T11:49:53.245111+0000","last_unstale":"2023-12-17T11:50:00.529654+0000","last_undegraded":"2023-12-17T11:50:00.529654+0000","last_fullsized":"2023-12-17T11:50:00.529654+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T14:59:11.557660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"39'3","reported_seq":17,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-17T11:50:00.529919+0000","last_change":"2023-12-17T11:49:52.231475+0000","last_active":"2023-12-17T11:50:00.529919+0000","last_peered":"2023-12-17T11:50:00.529919+0000","last_clean":"2023-12-17T11:50:00.529919+0000","last_became_active":"2023-12-17T11:49:52.230061+0000","last_became_peered":"2023-12-17T11:49:52.230061+0000","last_unstale":"2023-12-17T11:50:00.529919+0000","last_undegraded":"2023-12-17T11:50:00.529919+0000","last_fullsized":"2023-12-17T11:50:00.529919+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_clean_scrub_stamp":"2023-12-17T11:49:51.168108+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T22:50:11.250530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-17T11:50:00.523324+0000","last_change":"2023-12-17T11:49:53.232224+0000","last_active":"2023-12-17T11:50:00.523324+0000","last_peered":"2023-12-17T11:50:00.523324+0000","last_clean":"2023-12-17T11:50:00.523324+0000","last_became_active":"2023-12-17T11:49:53.231963+0000","last_became_peered":"2023-12-17T11:49:53.231963+0000","last_unstale":"2023-12-17T11:50:00.523324+0000","last_undegraded":"2023-12-17T11:50:00.523324+0000","last_fullsized":"2023-12-17T11:50:00.523324+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T15:14:36.959400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"39'6","reported_seq":20,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-17T11:50:00.524725+0000","last_change":"2023-12-17T11:49:52.220583+0000","last_active":"2023-12-17T11:50:00.524725+0000","last_peered":"2023-12-17T11:50:00.524725+0000","last_clean":"2023-12-17T11:50:00.524725+0000","last_became_active":"2023-12-17T11:49:52.220304+0000","last_became_peered":"2023-12-17T11:49:52.220304+0000","last_unstale":"2023-12-17T11:50:00.524725+0000","last_undegraded":"2023-12-17T11:50:00.524725+0000","last_fullsized":"2023-12-17T11:50:00.524725+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_clean_scrub_stamp":"2023-12-17T11:49:51.168108+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T12:27:37.121319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-17T11:50:00.528938+0000","last_change":"2023-12-17T11:49:53.248442+0000","last_active":"2023-12-17T11:50:00.528938+0000","last_peered":"2023-12-17T11:50:00.528938+0000","last_clean":"2023-12-17T11:50:00.528938+0000","last_became_active":"2023-12-17T11:49:53.248094+0000","last_became_peered":"2023-12-17T11:49:53.248094+0000","last_unstale":"2023-12-17T11:50:00.528938+0000","last_undegraded":"2023-12-17T11:50:00.528938+0000","last_fullsized":"2023-12-17T11:50:00.528938+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T14:42:29.543380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"39'2","reported_seq":16,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-17T11:50:00.524311+0000","last_change":"2023-12-17T11:49:52.213341+0000","last_active":"2023-12-17T11:50:00.524311+0000","last_peered":"2023-12-17T11:50:00.524311+0000","last_clean":"2023-12-17T11:50:00.524311+0000","last_became_active":"2023-12-17T11:49:52.213024+0000","last_became_peered":"2023-12-17T11:49:52.213024+0000","last_unstale":"2023-12-17T11:50:00.524311+0000","last_undegraded":"2023-12-17T11:50:00.524311+0000","last_fullsized":"2023-12-17T11:50:00.524311+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_clean_scrub_stamp":"2023-12-17T11:49:51.168108+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T20:34:24.431589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-17T11:50:00.522731+0000","last_change":"2023-12-17T11:49:53.238931+0000","last_active":"2023-12-17T11:50:00.522731+0000","last_peered":"2023-12-17T11:50:00.522731+0000","last_clean":"2023-12-17T11:50:00.522731+0000","last_became_active":"2023-12-17T11:49:53.238641+0000","last_became_peered":"2023-12-17T11:49:53.238641+0000","last_unstale":"2023-12-17T11:50:00.522731+0000","last_undegraded":"2023-12-17T11:50:00.522731+0000","last_fullsized":"2023-12-17T11:50:00.522731+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T13:29:29.953615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-17T11:50:00.523343+0000","last_change":"2023-12-17T11:49:52.232507+0000","last_active":"2023-12-17T11:50:00.523343+0000","last_peered":"2023-12-17T11:50:00.523343+0000","last_clean":"2023-12-17T11:50:00.523343+0000","last_became_active":"2023-12-17T11:49:52.232308+0000","last_became_peered":"2023-12-17T11:49:52.232308+0000","last_unstale":"2023-12-17T11:50:00.523343+0000","last_undegraded":"2023-12-17T11:50:00.523343+0000","last_fullsized":"2023-12-17T11:50:00.523343+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_clean_scrub_stamp":"2023-12-17T11:49:51.168108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T19:17:46.282779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:55.795434+0000","last_change":"2023-12-17T11:49:53.234701+0000","last_active":"2023-12-17T11:49:55.795434+0000","last_peered":"2023-12-17T11:49:55.795434+0000","last_clean":"2023-12-17T11:49:55.795434+0000","last_became_active":"2023-12-17T11:49:53.234389+0000","last_became_peered":"2023-12-17T11:49:53.234389+0000","last_unstale":"2023-12-17T11:49:55.795434+0000","last_undegraded":"2023-12-17T11:49:55.795434+0000","last_fullsized":"2023-12-17T11:49:55.795434+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T17:54:34.803705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-17T11:50:01.202070+0000","last_change":"2023-12-17T11:49:52.226465+0000","last_active":"2023-12-17T11:50:01.202070+0000","last_peered":"2023-12-17T11:50:01.202070+0000","last_clean":"2023-12-17T11:50:01.202070+0000","last_became_active":"2023-12-17T11:49:52.226191+0000","last_became_peered":"2023-12-17T11:49:52.226191+0000","last_unstale":"2023-12-17T11:50:01.202070+0000","last_undegraded":"2023-12-17T11:50:01.202070+0000","last_fullsized":"2023-12-17T11:50:01.202070+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_clean_scrub_stamp":"2023-12-17T11:49:51.168108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T18:03:39.554935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-17T11:50:00.524016+0000","last_change":"2023-12-17T11:49:53.254934+0000","last_active":"2023-12-17T11:50:00.524016+0000","last_peered":"2023-12-17T11:50:00.524016+0000","last_clean":"2023-12-17T11:50:00.524016+0000","last_became_active":"2023-12-17T11:49:53.254632+0000","last_became_peered":"2023-12-17T11:49:53.254632+0000","last_unstale":"2023-12-17T11:50:00.524016+0000","last_undegraded":"2023-12-17T11:50:00.524016+0000","last_fullsized":"2023-12-17T11:50:00.524016+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T23:33:06.562683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"39'8","reported_seq":21,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:55.795188+0000","last_change":"2023-12-17T11:49:52.226787+0000","last_active":"2023-12-17T11:49:55.795188+0000","last_peered":"2023-12-17T11:49:55.795188+0000","last_clean":"2023-12-17T11:49:55.795188+0000","last_became_active":"2023-12-17T11:49:52.226471+0000","last_became_peered":"2023-12-17T11:49:52.226471+0000","last_unstale":"2023-12-17T11:49:55.795188+0000","last_undegraded":"2023-12-17T11:49:55.795188+0000","last_fullsized":"2023-12-17T11:49:55.795188+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_clean_scrub_stamp":"2023-12-17T11:49:51.168108+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T17:27:58.587187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-17T11:50:00.524643+0000","last_change":"2023-12-17T11:49:53.253979+0000","last_active":"2023-12-17T11:50:00.524643+0000","last_peered":"2023-12-17T11:50:00.524643+0000","last_clean":"2023-12-17T11:50:00.524643+0000","last_became_active":"2023-12-17T11:49:53.253694+0000","last_became_peered":"2023-12-17T11:49:53.253694+0000","last_unstale":"2023-12-17T11:50:00.524643+0000","last_undegraded":"2023-12-17T11:50:00.524643+0000","last_fullsized":"2023-12-17T11:50:00.524643+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T19:26:47.162716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"39'1","reported_seq":15,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-17T11:50:00.530409+0000","last_change":"2023-12-17T11:49:52.231973+0000","last_active":"2023-12-17T11:50:00.530409+0000","last_peered":"2023-12-17T11:50:00.530409+0000","last_clean":"2023-12-17T11:50:00.530409+0000","last_became_active":"2023-12-17T11:49:52.231641+0000","last_became_peered":"2023-12-17T11:49:52.231641+0000","last_unstale":"2023-12-17T11:50:00.530409+0000","last_undegraded":"2023-12-17T11:50:00.530409+0000","last_fullsized":"2023-12-17T11:50:00.530409+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_clean_scrub_stamp":"2023-12-17T11:49:51.168108+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T20:34:24.431589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-17T11:50:00.529892+0000","last_change":"2023-12-17T11:49:53.253141+0000","last_active":"2023-12-17T11:50:00.529892+0000","last_peered":"2023-12-17T11:50:00.529892+0000","last_clean":"2023-12-17T11:50:00.529892+0000","last_became_active":"2023-12-17T11:49:53.252532+0000","last_became_peered":"2023-12-17T11:49:53.252532+0000","last_unstale":"2023-12-17T11:50:00.529892+0000","last_undegraded":"2023-12-17T11:50:00.529892+0000","last_fullsized":"2023-12-17T11:50:00.529892+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T22:42:15.785143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"39'2","reported_seq":16,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-17T11:50:00.523361+0000","last_change":"2023-12-17T11:49:52.230858+0000","last_active":"2023-12-17T11:50:00.523361+0000","last_peered":"2023-12-17T11:50:00.523361+0000","last_clean":"2023-12-17T11:50:00.523361+0000","last_became_active":"2023-12-17T11:49:52.230281+0000","last_became_peered":"2023-12-17T11:49:52.230281+0000","last_unstale":"2023-12-17T11:50:00.523361+0000","last_undegraded":"2023-12-17T11:50:00.523361+0000","last_fullsized":"2023-12-17T11:50:00.523361+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_clean_scrub_stamp":"2023-12-17T11:49:51.168108+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T22:39:30.094160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-17T11:50:00.523134+0000","last_change":"2023-12-17T11:49:53.251192+0000","last_active":"2023-12-17T11:50:00.523134+0000","last_peered":"2023-12-17T11:50:00.523134+0000","last_clean":"2023-12-17T11:50:00.523134+0000","last_became_active":"2023-12-17T11:49:53.250837+0000","last_became_peered":"2023-12-17T11:49:53.250837+0000","last_unstale":"2023-12-17T11:50:00.523134+0000","last_undegraded":"2023-12-17T11:50:00.523134+0000","last_fullsized":"2023-12-17T11:50:00.523134+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T14:42:29.543380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"39'1","reported_seq":15,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-17T11:50:01.305583+0000","last_change":"2023-12-17T11:49:52.222238+0000","last_active":"2023-12-17T11:50:01.305583+0000","last_peered":"2023-12-17T11:50:01.305583+0000","last_clean":"2023-12-17T11:50:01.305583+0000","last_became_active":"2023-12-17T11:49:52.221941+0000","last_became_peered":"2023-12-17T11:49:52.221941+0000","last_unstale":"2023-12-17T11:50:01.305583+0000","last_undegraded":"2023-12-17T11:50:01.305583+0000","last_fullsized":"2023-12-17T11:50:01.305583+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_clean_scrub_stamp":"2023-12-17T11:49:51.168108+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T12:43:47.651883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-17T11:50:01.303648+0000","last_change":"2023-12-17T11:49:53.253162+0000","last_active":"2023-12-17T11:50:01.303648+0000","last_peered":"2023-12-17T11:50:01.303648+0000","last_clean":"2023-12-17T11:50:01.303648+0000","last_became_active":"2023-12-17T11:49:53.252770+0000","last_became_peered":"2023-12-17T11:49:53.252770+0000","last_unstale":"2023-12-17T11:50:01.303648+0000","last_undegraded":"2023-12-17T11:50:01.303648+0000","last_fullsized":"2023-12-17T11:50:01.303648+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T14:03:09.358474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-17T11:50:00.523470+0000","last_change":"2023-12-17T11:49:52.223776+0000","last_active":"2023-12-17T11:50:00.523470+0000","last_peered":"2023-12-17T11:50:00.523470+0000","last_clean":"2023-12-17T11:50:00.523470+0000","last_became_active":"2023-12-17T11:49:52.223571+0000","last_became_peered":"2023-12-17T11:49:52.223571+0000","last_unstale":"2023-12-17T11:50:00.523470+0000","last_undegraded":"2023-12-17T11:50:00.523470+0000","last_fullsized":"2023-12-17T11:50:00.523470+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_clean_scrub_stamp":"2023-12-17T11:49:51.168108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T22:59:00.390569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:55.795237+0000","last_change":"2023-12-17T11:49:53.232411+0000","last_active":"2023-12-17T11:49:55.795237+0000","last_peered":"2023-12-17T11:49:55.795237+0000","last_clean":"2023-12-17T11:49:55.795237+0000","last_became_active":"2023-12-17T11:49:53.232101+0000","last_became_peered":"2023-12-17T11:49:53.232101+0000","last_unstale":"2023-12-17T11:49:55.795237+0000","last_undegraded":"2023-12-17T11:49:55.795237+0000","last_fullsized":"2023-12-17T11:49:55.795237+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T11:57:59.882385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"39'2","reported_seq":16,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-17T11:50:01.305224+0000","last_change":"2023-12-17T11:49:52.210836+0000","last_active":"2023-12-17T11:50:01.305224+0000","last_peered":"2023-12-17T11:50:01.305224+0000","last_clean":"2023-12-17T11:50:01.305224+0000","last_became_active":"2023-12-17T11:49:52.210521+0000","last_became_peered":"2023-12-17T11:49:52.210521+0000","last_unstale":"2023-12-17T11:50:01.305224+0000","last_undegraded":"2023-12-17T11:50:01.305224+0000","last_fullsized":"2023-12-17T11:50:01.305224+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_clean_scrub_stamp":"2023-12-17T11:49:51.168108+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T17:20:36.726376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-17T11:50:00.528978+0000","last_change":"2023-12-17T11:49:53.243230+0000","last_active":"2023-12-17T11:50:00.528978+0000","last_peered":"2023-12-17T11:50:00.528978+0000","last_clean":"2023-12-17T11:50:00.528978+0000","last_became_active":"2023-12-17T11:49:53.242951+0000","last_became_peered":"2023-12-17T11:49:53.242951+0000","last_unstale":"2023-12-17T11:50:00.528978+0000","last_undegraded":"2023-12-17T11:50:00.528978+0000","last_fullsized":"2023-12-17T11:50:00.528978+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T18:42:00.093282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-17T11:50:01.304976+0000","last_change":"2023-12-17T11:49:52.217136+0000","last_active":"2023-12-17T11:50:01.304976+0000","last_peered":"2023-12-17T11:50:01.304976+0000","last_clean":"2023-12-17T11:50:01.304976+0000","last_became_active":"2023-12-17T11:49:52.216921+0000","last_became_peered":"2023-12-17T11:49:52.216921+0000","last_unstale":"2023-12-17T11:50:01.304976+0000","last_undegraded":"2023-12-17T11:50:01.304976+0000","last_fullsized":"2023-12-17T11:50:01.304976+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_clean_scrub_stamp":"2023-12-17T11:49:51.168108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T19:32:12.805680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-17T11:50:00.530083+0000","last_change":"2023-12-17T11:49:53.255643+0000","last_active":"2023-12-17T11:50:00.530083+0000","last_peered":"2023-12-17T11:50:00.530083+0000","last_clean":"2023-12-17T11:50:00.530083+0000","last_became_active":"2023-12-17T11:49:53.255379+0000","last_became_peered":"2023-12-17T11:49:53.255379+0000","last_unstale":"2023-12-17T11:50:00.530083+0000","last_undegraded":"2023-12-17T11:50:00.530083+0000","last_fullsized":"2023-12-17T11:50:00.530083+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T16:21:14.355302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:55.795394+0000","last_change":"2023-12-17T11:49:52.229883+0000","last_active":"2023-12-17T11:49:55.795394+0000","last_peered":"2023-12-17T11:49:55.795394+0000","last_clean":"2023-12-17T11:49:55.795394+0000","last_became_active":"2023-12-17T11:49:52.229372+0000","last_became_peered":"2023-12-17T11:49:52.229372+0000","last_unstale":"2023-12-17T11:49:55.795394+0000","last_undegraded":"2023-12-17T11:49:55.795394+0000","last_fullsized":"2023-12-17T11:49:55.795394+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_clean_scrub_stamp":"2023-12-17T11:49:51.168108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T23:27:59.830582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-17T11:50:00.524144+0000","last_change":"2023-12-17T11:49:53.249227+0000","last_active":"2023-12-17T11:50:00.524144+0000","last_peered":"2023-12-17T11:50:00.524144+0000","last_clean":"2023-12-17T11:50:00.524144+0000","last_became_active":"2023-12-17T11:49:53.248594+0000","last_became_peered":"2023-12-17T11:49:53.248594+0000","last_unstale":"2023-12-17T11:50:00.524144+0000","last_undegraded":"2023-12-17T11:50:00.524144+0000","last_fullsized":"2023-12-17T11:50:00.524144+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T14:31:17.752657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-17T11:50:01.304582+0000","last_change":"2023-12-17T11:49:52.211707+0000","last_active":"2023-12-17T11:50:01.304582+0000","last_peered":"2023-12-17T11:50:01.304582+0000","last_clean":"2023-12-17T11:50:01.304582+0000","last_became_active":"2023-12-17T11:49:52.211283+0000","last_became_peered":"2023-12-17T11:49:52.211283+0000","last_unstale":"2023-12-17T11:50:01.304582+0000","last_undegraded":"2023-12-17T11:50:01.304582+0000","last_fullsized":"2023-12-17T11:50:01.304582+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_clean_scrub_stamp":"2023-12-17T11:49:51.168108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T12:54:05.203029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-17T11:50:00.523128+0000","last_change":"2023-12-17T11:49:53.255235+0000","last_active":"2023-12-17T11:50:00.523128+0000","last_peered":"2023-12-17T11:50:00.523128+0000","last_clean":"2023-12-17T11:50:00.523128+0000","last_became_active":"2023-12-17T11:49:53.254570+0000","last_became_peered":"2023-12-17T11:49:53.254570+0000","last_unstale":"2023-12-17T11:50:00.523128+0000","last_undegraded":"2023-12-17T11:50:00.523128+0000","last_fullsized":"2023-12-17T11:50:00.523128+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T15:14:36.959400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"39'2","reported_seq":16,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-17T11:50:00.530828+0000","last_change":"2023-12-17T11:49:52.229686+0000","last_active":"2023-12-17T11:50:00.530828+0000","last_peered":"2023-12-17T11:50:00.530828+0000","last_clean":"2023-12-17T11:50:00.530828+0000","last_became_active":"2023-12-17T11:49:52.229401+0000","last_became_peered":"2023-12-17T11:49:52.229401+0000","last_unstale":"2023-12-17T11:50:00.530828+0000","last_undegraded":"2023-12-17T11:50:00.530828+0000","last_fullsized":"2023-12-17T11:50:00.530828+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_clean_scrub_stamp":"2023-12-17T11:49:51.168108+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T17:03:59.637357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:55.795716+0000","last_change":"2023-12-17T11:49:53.236908+0000","last_active":"2023-12-17T11:49:55.795716+0000","last_peered":"2023-12-17T11:49:55.795716+0000","last_clean":"2023-12-17T11:49:55.795716+0000","last_became_active":"2023-12-17T11:49:53.236508+0000","last_became_peered":"2023-12-17T11:49:53.236508+0000","last_unstale":"2023-12-17T11:49:55.795716+0000","last_undegraded":"2023-12-17T11:49:55.795716+0000","last_fullsized":"2023-12-17T11:49:55.795716+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T13:59:52.939825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"40'1","reported_seq":15,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-17T11:50:01.305637+0000","last_change":"2023-12-17T11:49:52.229067+0000","last_active":"2023-12-17T11:50:01.305637+0000","last_peered":"2023-12-17T11:50:01.305637+0000","last_clean":"2023-12-17T11:50:01.305637+0000","last_became_active":"2023-12-17T11:49:52.228704+0000","last_became_peered":"2023-12-17T11:49:52.228704+0000","last_unstale":"2023-12-17T11:50:01.305637+0000","last_undegraded":"2023-12-17T11:50:01.305637+0000","last_fullsized":"2023-12-17T11:50:01.305637+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_clean_scrub_stamp":"2023-12-17T11:49:51.168108+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T16:31:06.129915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-17T11:50:00.524876+0000","last_change":"2023-12-17T11:49:53.246415+0000","last_active":"2023-12-17T11:50:00.524876+0000","last_peered":"2023-12-17T11:50:00.524876+0000","last_clean":"2023-12-17T11:50:00.524876+0000","last_became_active":"2023-12-17T11:49:53.246163+0000","last_became_peered":"2023-12-17T11:49:53.246163+0000","last_unstale":"2023-12-17T11:50:00.524876+0000","last_undegraded":"2023-12-17T11:50:00.524876+0000","last_fullsized":"2023-12-17T11:50:00.524876+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T17:56:09.285369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-17T11:50:00.529684+0000","last_change":"2023-12-17T11:49:52.219865+0000","last_active":"2023-12-17T11:50:00.529684+0000","last_peered":"2023-12-17T11:50:00.529684+0000","last_clean":"2023-12-17T11:50:00.529684+0000","last_became_active":"2023-12-17T11:49:52.219593+0000","last_became_peered":"2023-12-17T11:49:52.219593+0000","last_unstale":"2023-12-17T11:50:00.529684+0000","last_undegraded":"2023-12-17T11:50:00.529684+0000","last_fullsized":"2023-12-17T11:50:00.529684+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_clean_scrub_stamp":"2023-12-17T11:49:51.168108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T15:14:35.947970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-17T11:50:00.529332+0000","last_change":"2023-12-17T11:49:53.242876+0000","last_active":"2023-12-17T11:50:00.529332+0000","last_peered":"2023-12-17T11:50:00.529332+0000","last_clean":"2023-12-17T11:50:00.529332+0000","last_became_active":"2023-12-17T11:49:53.242568+0000","last_became_peered":"2023-12-17T11:49:53.242568+0000","last_unstale":"2023-12-17T11:50:00.529332+0000","last_undegraded":"2023-12-17T11:50:00.529332+0000","last_fullsized":"2023-12-17T11:50:00.529332+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T23:10:56.100255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-17T11:50:00.529639+0000","last_change":"2023-12-17T11:49:52.223424+0000","last_active":"2023-12-17T11:50:00.529639+0000","last_peered":"2023-12-17T11:50:00.529639+0000","last_clean":"2023-12-17T11:50:00.529639+0000","last_became_active":"2023-12-17T11:49:52.223126+0000","last_became_peered":"2023-12-17T11:49:52.223126+0000","last_unstale":"2023-12-17T11:50:00.529639+0000","last_undegraded":"2023-12-17T11:50:00.529639+0000","last_fullsized":"2023-12-17T11:50:00.529639+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_clean_scrub_stamp":"2023-12-17T11:49:51.168108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T14:31:59.450792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-17T11:50:00.523009+0000","last_change":"2023-12-17T11:49:53.251516+0000","last_active":"2023-12-17T11:50:00.523009+0000","last_peered":"2023-12-17T11:50:00.523009+0000","last_clean":"2023-12-17T11:50:00.523009+0000","last_became_active":"2023-12-17T11:49:53.251230+0000","last_became_peered":"2023-12-17T11:49:53.251230+0000","last_unstale":"2023-12-17T11:50:00.523009+0000","last_undegraded":"2023-12-17T11:50:00.523009+0000","last_fullsized":"2023-12-17T11:50:00.523009+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T19:39:18.340154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-17T11:50:01.202294+0000","last_change":"2023-12-17T11:49:52.219807+0000","last_active":"2023-12-17T11:50:01.202294+0000","last_peered":"2023-12-17T11:50:01.202294+0000","last_clean":"2023-12-17T11:50:01.202294+0000","last_became_active":"2023-12-17T11:49:52.219503+0000","last_became_peered":"2023-12-17T11:49:52.219503+0000","last_unstale":"2023-12-17T11:50:01.202294+0000","last_undegraded":"2023-12-17T11:50:01.202294+0000","last_fullsized":"2023-12-17T11:50:01.202294+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_clean_scrub_stamp":"2023-12-17T11:49:51.168108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T18:07:09.094032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-17T11:50:00.522740+0000","last_change":"2023-12-17T11:49:53.241750+0000","last_active":"2023-12-17T11:50:00.522740+0000","last_peered":"2023-12-17T11:50:00.522740+0000","last_clean":"2023-12-17T11:50:00.522740+0000","last_became_active":"2023-12-17T11:49:53.241529+0000","last_became_peered":"2023-12-17T11:49:53.241529+0000","last_unstale":"2023-12-17T11:50:00.522740+0000","last_undegraded":"2023-12-17T11:50:00.522740+0000","last_fullsized":"2023-12-17T11:50:00.522740+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T16:31:53.964205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-17T11:50:00.522300+0000","last_change":"2023-12-17T11:49:52.216579+0000","last_active":"2023-12-17T11:50:00.522300+0000","last_peered":"2023-12-17T11:50:00.522300+0000","last_clean":"2023-12-17T11:50:00.522300+0000","last_became_active":"2023-12-17T11:49:52.216265+0000","last_became_peered":"2023-12-17T11:49:52.216265+0000","last_unstale":"2023-12-17T11:50:00.522300+0000","last_undegraded":"2023-12-17T11:50:00.522300+0000","last_fullsized":"2023-12-17T11:50:00.522300+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_clean_scrub_stamp":"2023-12-17T11:49:51.168108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T14:31:59.450792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:55.795525+0000","last_change":"2023-12-17T11:49:53.234303+0000","last_active":"2023-12-17T11:49:55.795525+0000","last_peered":"2023-12-17T11:49:55.795525+0000","last_clean":"2023-12-17T11:49:55.795525+0000","last_became_active":"2023-12-17T11:49:53.233951+0000","last_became_peered":"2023-12-17T11:49:53.233951+0000","last_unstale":"2023-12-17T11:49:55.795525+0000","last_undegraded":"2023-12-17T11:49:55.795525+0000","last_fullsized":"2023-12-17T11:49:55.795525+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T19:17:38.569694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-17T11:50:00.522523+0000","last_change":"2023-12-17T11:49:52.219957+0000","last_active":"2023-12-17T11:50:00.522523+0000","last_peered":"2023-12-17T11:50:00.522523+0000","last_clean":"2023-12-17T11:50:00.522523+0000","last_became_active":"2023-12-17T11:49:52.219626+0000","last_became_peered":"2023-12-17T11:49:52.219626+0000","last_unstale":"2023-12-17T11:50:00.522523+0000","last_undegraded":"2023-12-17T11:50:00.522523+0000","last_fullsized":"2023-12-17T11:50:00.522523+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_clean_scrub_stamp":"2023-12-17T11:49:51.168108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T19:12:11.016281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-17T11:50:00.530565+0000","last_change":"2023-12-17T11:49:53.253151+0000","last_active":"2023-12-17T11:50:00.530565+0000","last_peered":"2023-12-17T11:50:00.530565+0000","last_clean":"2023-12-17T11:50:00.530565+0000","last_became_active":"2023-12-17T11:49:53.252842+0000","last_became_peered":"2023-12-17T11:49:53.252842+0000","last_unstale":"2023-12-17T11:50:00.530565+0000","last_undegraded":"2023-12-17T11:50:00.530565+0000","last_fullsized":"2023-12-17T11:50:00.530565+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T14:31:17.752657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:55.795609+0000","last_change":"2023-12-17T11:49:52.228110+0000","last_active":"2023-12-17T11:49:55.795609+0000","last_peered":"2023-12-17T11:49:55.795609+0000","last_clean":"2023-12-17T11:49:55.795609+0000","last_became_active":"2023-12-17T11:49:52.227851+0000","last_became_peered":"2023-12-17T11:49:52.227851+0000","last_unstale":"2023-12-17T11:49:55.795609+0000","last_undegraded":"2023-12-17T11:49:55.795609+0000","last_fullsized":"2023-12-17T11:49:55.795609+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_clean_scrub_stamp":"2023-12-17T11:49:51.168108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T18:37:20.380970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":181,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:55.301834+0000","last_change":"2023-12-17T11:48:07.952584+0000","last_active":"2023-12-17T11:49:55.301834+0000","last_peered":"2023-12-17T11:49:55.301834+0000","last_clean":"2023-12-17T11:49:55.301834+0000","last_became_active":"2023-12-17T11:48:07.950361+0000","last_became_peered":"2023-12-17T11:48:07.950361+0000","last_unstale":"2023-12-17T11:49:55.301834+0000","last_undegraded":"2023-12-17T11:49:55.301834+0000","last_fullsized":"2023-12-17T11:49:55.301834+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:06.728199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:06.728199+0000","last_clean_scrub_stamp":"2023-12-17T11:48:06.728199+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T12:47:55.048065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542172,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28088,"kb_used_data":1068,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343752,"statfs":{"total":96636764160,"available":96608002048,"internally_reserved":0,"allocated":1093632,"data_stored":802179,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 17 11:49:06 2023","interfaces":[{"interface":"back","average":{"1min":1.407,"5min":1.407,"15min":1.407},"min":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":8.6579999999999995,"5min":8.6579999999999995,"15min":8.6579999999999995},"last":1.0669999999999999},{"interface":"front","average":{"1min":1.339,"5min":1.339,"15min":1.339},"min":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"max":{"1min":4.0830000000000002,"5min":4.0830000000000002,"15min":4.0830000000000002},"last":1.393}]},{"osd":1,"last update":"Sun Dec 17 11:49:06 2023","interfaces":[{"interface":"back","average":{"1min":1.127,"5min":1.127,"15min":1.127},"min":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"max":{"1min":2.1539999999999999,"5min":2.1539999999999999,"15min":2.1539999999999999},"last":0.94899999999999995},{"interface":"front","average":{"1min":1.413,"5min":1.413,"15min":1.413},"min":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"max":{"1min":8.7449999999999992,"5min":8.7449999999999992,"15min":8.7449999999999992},"last":1.181}]},{"osd":2,"last update":"Sun Dec 17 11:49:06 2023","interfaces":[{"interface":"back","average":{"1min":1.4299999999999999,"5min":1.4299999999999999,"15min":1.4299999999999999},"min":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"max":{"1min":4.1239999999999997,"5min":4.1239999999999997,"15min":4.1239999999999997},"last":1.234},{"interface":"front","average":{"1min":1.3720000000000001,"5min":1.3720000000000001,"15min":1.3720000000000001},"min":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"max":{"1min":1.782,"5min":1.782,"15min":1.782},"last":0.80600000000000005}]},{"osd":3,"last update":"Sun Dec 17 11:49:06 2023","interfaces":[{"interface":"back","average":{"1min":1.298,"5min":1.298,"15min":1.298},"min":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"max":{"1min":2.5430000000000001,"5min":2.5430000000000001,"15min":2.5430000000000001},"last":1.04},{"interface":"front","average":{"1min":1.375,"5min":1.375,"15min":1.375},"min":{"1min":1.087,"5min":1.087,"15min":1.087},"max":{"1min":2.5830000000000002,"5min":2.5830000000000002,"15min":2.5830000000000002},"last":1.127}]},{"osd":4,"last update":"Sun Dec 17 11:49:06 2023","interfaces":[{"interface":"back","average":{"1min":1.3859999999999999,"5min":1.3859999999999999,"15min":1.3859999999999999},"min":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":4.0309999999999997,"5min":4.0309999999999997,"15min":4.0309999999999997},"last":1.488},{"interface":"front","average":{"1min":1.5860000000000001,"5min":1.5860000000000001,"15min":1.5860000000000001},"min":{"1min":1.2230000000000001,"5min":1.2230000000000001,"15min":1.2230000000000001},"max":{"1min":3.3220000000000001,"5min":3.3220000000000001,"15min":3.3220000000000001},"last":1.3300000000000001}]},{"osd":5,"last update":"Sun Dec 17 11:49:06 2023","interfaces":[{"interface":"back","average":{"1min":1.6970000000000001,"5min":1.6970000000000001,"15min":1.6970000000000001},"min":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"max":{"1min":8.7929999999999993,"5min":8.7929999999999993,"15min":8.7929999999999993},"last":1.2929999999999999},{"interface":"front","average":{"1min":1.6859999999999999,"5min":1.6859999999999999,"15min":1.6859999999999999},"min":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"max":{"1min":5.1040000000000001,"5min":5.1040000000000001,"15min":5.1040000000000001},"last":1.5700000000000001}]},{"osd":6,"last update":"Sun Dec 17 11:49:06 2023","interfaces":[{"interface":"back","average":{"1min":1.845,"5min":1.845,"15min":1.845},"min":{"1min":1.081,"5min":1.081,"15min":1.081},"max":{"1min":8.8330000000000002,"5min":8.8330000000000002,"15min":8.8330000000000002},"last":1.3720000000000001},{"interface":"front","average":{"1min":1.71,"5min":1.71,"15min":1.71},"min":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"max":{"1min":3.9590000000000001,"5min":3.9590000000000001,"15min":3.9590000000000001},"last":1.679}]}]},{"osd":6,"up_from":14,"seq":60129542172,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27500,"kb_used_data":476,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344340,"statfs":{"total":96636764160,"available":96608604160,"internally_reserved":0,"allocated":487424,"data_stored":210711,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 17 11:49:06 2023","interfaces":[{"interface":"back","average":{"1min":1.0720000000000001,"5min":1.0720000000000001,"15min":1.0720000000000001},"min":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.5840000000000001,"5min":1.5840000000000001,"15min":1.5840000000000001},"last":0.96099999999999997},{"interface":"front","average":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"min":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"max":{"1min":1.429,"5min":1.429,"15min":1.429},"last":1.1659999999999999}]},{"osd":1,"last update":"Sun Dec 17 11:49:06 2023","interfaces":[{"interface":"back","average":{"1min":1.2689999999999999,"5min":1.2689999999999999,"15min":1.2689999999999999},"min":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"max":{"1min":1.5640000000000001,"5min":1.5640000000000001,"15min":1.5640000000000001},"last":1.1299999999999999},{"interface":"front","average":{"1min":1.3169999999999999,"5min":1.3169999999999999,"15min":1.3169999999999999},"min":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"max":{"1min":1.9359999999999999,"5min":1.9359999999999999,"15min":1.9359999999999999},"last":1.3380000000000001}]},{"osd":2,"last update":"Sun Dec 17 11:49:06 2023","interfaces":[{"interface":"back","average":{"1min":1.1970000000000001,"5min":1.1970000000000001,"15min":1.1970000000000001},"min":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":1.8740000000000001,"5min":1.8740000000000001,"15min":1.8740000000000001},"last":1.5},{"interface":"front","average":{"1min":1.296,"5min":1.296,"15min":1.296},"min":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":2.5470000000000002,"5min":2.5470000000000002,"15min":2.5470000000000002},"last":1.25}]},{"osd":3,"last update":"Sun Dec 17 11:49:06 2023","interfaces":[{"interface":"back","average":{"1min":1.508,"5min":1.508,"15min":1.508},"min":{"1min":1.0840000000000001,"5min":1.0840000000000001,"15min":1.0840000000000001},"max":{"1min":2.4689999999999999,"5min":2.4689999999999999,"15min":2.4689999999999999},"last":1.369},{"interface":"front","average":{"1min":1.4390000000000001,"5min":1.4390000000000001,"15min":1.4390000000000001},"min":{"1min":0.88,"5min":0.88,"15min":0.88},"max":{"1min":2.0680000000000001,"5min":2.0680000000000001,"15min":2.0680000000000001},"last":1.284}]},{"osd":4,"last update":"Sun Dec 17 11:49:06 2023","interfaces":[{"interface":"back","average":{"1min":1.522,"5min":1.522,"15min":1.522},"min":{"1min":1.1419999999999999,"5min":1.1419999999999999,"15min":1.1419999999999999},"max":{"1min":2.222,"5min":2.222,"15min":2.222},"last":1.4610000000000001},{"interface":"front","average":{"1min":1.4419999999999999,"5min":1.4419999999999999,"15min":1.4419999999999999},"min":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":0.90700000000000003},"max":{"1min":2.4079999999999999,"5min":2.4079999999999999,"15min":2.4079999999999999},"last":1.401}]},{"osd":5,"last update":"Sun Dec 17 11:49:06 2023","interfaces":[{"interface":"back","average":{"1min":1.548,"5min":1.548,"15min":1.548},"min":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"max":{"1min":2.3319999999999999,"5min":2.3319999999999999,"15min":2.3319999999999999},"last":1.2170000000000001},{"interface":"front","average":{"1min":1.5760000000000001,"5min":1.5760000000000001,"15min":1.5760000000000001},"min":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"max":{"1min":2.6760000000000002,"5min":2.6760000000000002,"15min":2.6760000000000002},"last":1.306}]},{"osd":7,"last update":"Sun Dec 17 11:49:06 2023","interfaces":[{"interface":"back","average":{"1min":1.419,"5min":1.419,"15min":1.419},"min":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"max":{"1min":2.1560000000000001,"5min":2.1560000000000001,"15min":2.1560000000000001},"last":1.022},{"interface":"front","average":{"1min":1.712,"5min":1.712,"15min":1.712},"min":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"max":{"1min":2.6059999999999999,"5min":2.6059999999999999,"15min":2.6059999999999999},"last":1.4319999999999999}]}]},{"osd":5,"up_from":14,"seq":60129542171,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27500,"kb_used_data":480,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344340,"statfs":{"total":96636764160,"available":96608604160,"internally_reserved":0,"allocated":491520,"data_stored":210241,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 17 11:49:09 2023","interfaces":[{"interface":"back","average":{"1min":1.101,"5min":1.101,"15min":1.101},"min":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":1.5860000000000001,"5min":1.5860000000000001,"15min":1.5860000000000001},"last":1.3560000000000001},{"interface":"front","average":{"1min":1.23,"5min":1.23,"15min":1.23},"min":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"max":{"1min":1.9419999999999999,"5min":1.9419999999999999,"15min":1.9419999999999999},"last":1.115}]},{"osd":1,"last update":"Sun Dec 17 11:49:09 2023","interfaces":[{"interface":"back","average":{"1min":1.167,"5min":1.167,"15min":1.167},"min":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"max":{"1min":1.5289999999999999,"5min":1.5289999999999999,"15min":1.5289999999999999},"last":0.91900000000000004},{"interface":"front","average":{"1min":1.216,"5min":1.216,"15min":1.216},"min":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"max":{"1min":1.8660000000000001,"5min":1.8660000000000001,"15min":1.8660000000000001},"last":1.179}]},{"osd":2,"last update":"Sun Dec 17 11:49:09 2023","interfaces":[{"interface":"back","average":{"1min":1.3140000000000001,"5min":1.3140000000000001,"15min":1.3140000000000001},"min":{"1min":0.747,"5min":0.747,"15min":0.747},"max":{"1min":2.1589999999999998,"5min":2.1589999999999998,"15min":2.1589999999999998},"last":0.84499999999999997},{"interface":"front","average":{"1min":1.3919999999999999,"5min":1.3919999999999999,"15min":1.3919999999999999},"min":{"1min":1.0049999999999999,"5min":1.0049999999999999,"15min":1.0049999999999999},"max":{"1min":2.1379999999999999,"5min":2.1379999999999999,"15min":2.1379999999999999},"last":1.048}]},{"osd":3,"last update":"Sun Dec 17 11:49:09 2023","interfaces":[{"interface":"back","average":{"1min":1.337,"5min":1.337,"15min":1.337},"min":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"max":{"1min":2.593,"5min":2.593,"15min":2.593},"last":0.98399999999999999},{"interface":"front","average":{"1min":1.407,"5min":1.407,"15min":1.407},"min":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"max":{"1min":2.3079999999999998,"5min":2.3079999999999998,"15min":2.3079999999999998},"last":1.2849999999999999}]},{"osd":4,"last update":"Sun Dec 17 11:49:09 2023","interfaces":[{"interface":"back","average":{"1min":1.5029999999999999,"5min":1.5029999999999999,"15min":1.5029999999999999},"min":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"max":{"1min":2.5299999999999998,"5min":2.5299999999999998,"15min":2.5299999999999998},"last":1.452},{"interface":"front","average":{"1min":1.6879999999999999,"5min":1.6879999999999999,"15min":1.6879999999999999},"min":{"1min":1.0669999999999999,"5min":1.0669999999999999,"15min":1.0669999999999999},"max":{"1min":3.9569999999999999,"5min":3.9569999999999999,"15min":3.9569999999999999},"last":1.2370000000000001}]},{"osd":6,"last update":"Sun Dec 17 11:49:09 2023","interfaces":[{"interface":"back","average":{"1min":1.6619999999999999,"5min":1.6619999999999999,"15min":1.6619999999999999},"min":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"max":{"1min":2.9849999999999999,"5min":2.9849999999999999,"15min":2.9849999999999999},"last":1.1499999999999999},{"interface":"front","average":{"1min":1.6319999999999999,"5min":1.6319999999999999,"15min":1.6319999999999999},"min":{"1min":1.25,"5min":1.25,"15min":1.25},"max":{"1min":2.641,"5min":2.641,"15min":2.641},"last":1.538}]},{"osd":7,"last update":"Sun Dec 17 11:49:09 2023","interfaces":[{"interface":"back","average":{"1min":1.8080000000000001,"5min":1.8080000000000001,"15min":1.8080000000000001},"min":{"1min":1.232,"5min":1.232,"15min":1.232},"max":{"1min":3.8570000000000002,"5min":3.8570000000000002,"15min":3.8570000000000002},"last":1.415},{"interface":"front","average":{"1min":1.827,"5min":1.827,"15min":1.827},"min":{"1min":1.137,"5min":1.137,"15min":1.137},"max":{"1min":2.8999999999999999,"5min":2.8999999999999999,"15min":2.8999999999999999},"last":1.397}]}]},{"osd":4,"up_from":14,"seq":60129542172,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27500,"kb_used_data":480,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344340,"statfs":{"total":96636764160,"available":96608604160,"internally_reserved":0,"allocated":491520,"data_stored":210733,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 17 11:49:08 2023","interfaces":[{"interface":"back","average":{"1min":1.02,"5min":1.02,"15min":1.02},"min":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"max":{"1min":1.1890000000000001,"5min":1.1890000000000001,"15min":1.1890000000000001},"last":1.024},{"interface":"front","average":{"1min":1.167,"5min":1.167,"15min":1.167},"min":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"max":{"1min":2.6400000000000001,"5min":2.6400000000000001,"15min":2.6400000000000001},"last":1.548}]},{"osd":1,"last update":"Sun Dec 17 11:49:08 2023","interfaces":[{"interface":"back","average":{"1min":1.0960000000000001,"5min":1.0960000000000001,"15min":1.0960000000000001},"min":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"max":{"1min":1.369,"5min":1.369,"15min":1.369},"last":1.4139999999999999},{"interface":"front","average":{"1min":1.2669999999999999,"5min":1.2669999999999999,"15min":1.2669999999999999},"min":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"max":{"1min":1.631,"5min":1.631,"15min":1.631},"last":1.3049999999999999}]},{"osd":2,"last update":"Sun Dec 17 11:49:08 2023","interfaces":[{"interface":"back","average":{"1min":1.393,"5min":1.393,"15min":1.393},"min":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"max":{"1min":1.8660000000000001,"5min":1.8660000000000001,"15min":1.8660000000000001},"last":1.6020000000000001},{"interface":"front","average":{"1min":1.329,"5min":1.329,"15min":1.329},"min":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"max":{"1min":1.968,"5min":1.968,"15min":1.968},"last":0.88100000000000001}]},{"osd":3,"last update":"Sun Dec 17 11:49:08 2023","interfaces":[{"interface":"back","average":{"1min":1.4410000000000001,"5min":1.4410000000000001,"15min":1.4410000000000001},"min":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"max":{"1min":3.2290000000000001,"5min":3.2290000000000001,"15min":3.2290000000000001},"last":1.1910000000000001},{"interface":"front","average":{"1min":1.496,"5min":1.496,"15min":1.496},"min":{"1min":1.1000000000000001,"5min":1.1000000000000001,"15min":1.1000000000000001},"max":{"1min":2.0169999999999999,"5min":2.0169999999999999,"15min":2.0169999999999999},"last":1.5029999999999999}]},{"osd":5,"last update":"Sun Dec 17 11:49:08 2023","interfaces":[{"interface":"back","average":{"1min":1.474,"5min":1.474,"15min":1.474},"min":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"max":{"1min":2.141,"5min":2.141,"15min":2.141},"last":1.466},{"interface":"front","average":{"1min":1.7110000000000001,"5min":1.7110000000000001,"15min":1.7110000000000001},"min":{"1min":1.2390000000000001,"5min":1.2390000000000001,"15min":1.2390000000000001},"max":{"1min":3.8220000000000001,"5min":3.8220000000000001,"15min":3.8220000000000001},"last":1.659}]},{"osd":6,"last update":"Sun Dec 17 11:49:08 2023","interfaces":[{"interface":"back","average":{"1min":1.7370000000000001,"5min":1.7370000000000001,"15min":1.7370000000000001},"min":{"1min":1.212,"5min":1.212,"15min":1.212},"max":{"1min":2.7410000000000001,"5min":2.7410000000000001,"15min":2.7410000000000001},"last":1.702},{"interface":"front","average":{"1min":1.677,"5min":1.677,"15min":1.677},"min":{"1min":1.222,"5min":1.222,"15min":1.222},"max":{"1min":2.2989999999999999,"5min":2.2989999999999999,"15min":2.2989999999999999},"last":1.53}]},{"osd":7,"last update":"Sun Dec 17 11:49:08 2023","interfaces":[{"interface":"back","average":{"1min":1.847,"5min":1.847,"15min":1.847},"min":{"1min":1.2749999999999999,"5min":1.2749999999999999,"15min":1.2749999999999999},"max":{"1min":3.944,"5min":3.944,"15min":3.944},"last":1.3680000000000001},{"interface":"front","average":{"1min":1.8160000000000001,"5min":1.8160000000000001,"15min":1.8160000000000001},"min":{"1min":1.4239999999999999,"5min":1.4239999999999999,"15min":1.4239999999999999},"max":{"1min":2.8809999999999998,"5min":2.8809999999999998,"15min":2.8809999999999998},"last":1.7589999999999999}]}]},{"osd":3,"up_from":14,"seq":60129542171,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27508,"kb_used_data":488,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344332,"statfs":{"total":96636764160,"available":96608595968,"internally_reserved":0,"allocated":499712,"data_stored":211775,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 17 11:49:06 2023","interfaces":[{"interface":"back","average":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.6459999999999999,"5min":1.6459999999999999,"15min":1.6459999999999999},"last":0.94099999999999995},{"interface":"front","average":{"1min":1.0700000000000001,"5min":1.0700000000000001,"15min":1.0700000000000001},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":3.5800000000000001,"5min":3.5800000000000001,"15min":3.5800000000000001},"last":1.387}]},{"osd":1,"last update":"Sun Dec 17 11:49:06 2023","interfaces":[{"interface":"back","average":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":1.4379999999999999,"5min":1.4379999999999999,"15min":1.4379999999999999},"last":1.2529999999999999},{"interface":"front","average":{"1min":1.1519999999999999,"5min":1.1519999999999999,"15min":1.1519999999999999},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":2.085,"5min":2.085,"15min":2.085},"last":1.125}]},{"osd":2,"last update":"Sun Dec 17 11:49:06 2023","interfaces":[{"interface":"back","average":{"1min":1.1659999999999999,"5min":1.1659999999999999,"15min":1.1659999999999999},"min":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":1.651,"5min":1.651,"15min":1.651},"last":1.506},{"interface":"front","average":{"1min":1.2569999999999999,"5min":1.2569999999999999,"15min":1.2569999999999999},"min":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":2.1429999999999998,"5min":2.1429999999999998,"15min":2.1429999999999998},"last":1.7629999999999999}]},{"osd":4,"last update":"Sun Dec 17 11:49:06 2023","interfaces":[{"interface":"back","average":{"1min":1.4330000000000001,"5min":1.4330000000000001,"15min":1.4330000000000001},"min":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"max":{"1min":2.4870000000000001,"5min":2.4870000000000001,"15min":2.4870000000000001},"last":1.6439999999999999},{"interface":"front","average":{"1min":1.476,"5min":1.476,"15min":1.476},"min":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"max":{"1min":2.3460000000000001,"5min":2.3460000000000001,"15min":2.3460000000000001},"last":1.7}]},{"osd":5,"last update":"Sun Dec 17 11:49:06 2023","interfaces":[{"interface":"back","average":{"1min":1.476,"5min":1.476,"15min":1.476},"min":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"max":{"1min":2.5710000000000002,"5min":2.5710000000000002,"15min":2.5710000000000002},"last":1.585},{"interface":"front","average":{"1min":1.5,"5min":1.5,"15min":1.5},"min":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"max":{"1min":2.383,"5min":2.383,"15min":2.383},"last":1.5549999999999999}]},{"osd":6,"last update":"Sun Dec 17 11:49:06 2023","interfaces":[{"interface":"back","average":{"1min":1.474,"5min":1.474,"15min":1.474},"min":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"max":{"1min":2.6179999999999999,"5min":2.6179999999999999,"15min":2.6179999999999999},"last":1.452},{"interface":"front","average":{"1min":1.5149999999999999,"5min":1.5149999999999999,"15min":1.5149999999999999},"min":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"max":{"1min":2.7679999999999998,"5min":2.7679999999999998,"15min":2.7679999999999998},"last":1.6739999999999999}]},{"osd":7,"last update":"Sun Dec 17 11:49:06 2023","interfaces":[{"interface":"back","average":{"1min":1.581,"5min":1.581,"15min":1.581},"min":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"max":{"1min":3.7000000000000002,"5min":3.7000000000000002,"15min":3.7000000000000002},"last":1.7370000000000001},{"interface":"front","average":{"1min":1.579,"5min":1.579,"15min":1.579},"min":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":0.97099999999999997},"max":{"1min":2.427,"5min":2.427,"15min":2.427},"last":1.619}]}]},{"osd":2,"up_from":14,"seq":60129542172,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27500,"kb_used_data":476,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344340,"statfs":{"total":96636764160,"available":96608604160,"internally_reserved":0,"allocated":487424,"data_stored":210199,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 17 11:49:07 2023","interfaces":[{"interface":"back","average":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":1.724,"5min":1.724,"15min":1.724},"last":1.0209999999999999},{"interface":"front","average":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.502,"5min":1.502,"15min":1.502},"last":0.97899999999999998}]},{"osd":1,"last update":"Sun Dec 17 11:49:07 2023","interfaces":[{"interface":"back","average":{"1min":0.995,"5min":0.995,"15min":0.995},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.4790000000000001,"5min":1.4790000000000001,"15min":1.4790000000000001},"last":0.93700000000000006},{"interface":"front","average":{"1min":1.056,"5min":1.056,"15min":1.056},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":2.6280000000000001,"5min":2.6280000000000001,"15min":2.6280000000000001},"last":1.0649999999999999}]},{"osd":3,"last update":"Sun Dec 17 11:49:07 2023","interfaces":[{"interface":"back","average":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.476,"5min":1.476,"15min":1.476},"last":0.89900000000000002},{"interface":"front","average":{"1min":1.214,"5min":1.214,"15min":1.214},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.9670000000000001,"5min":1.9670000000000001,"15min":1.9670000000000001},"last":1.093}]},{"osd":4,"last update":"Sun Dec 17 11:49:07 2023","interfaces":[{"interface":"back","average":{"1min":1.49,"5min":1.49,"15min":1.49},"min":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"max":{"1min":2.5750000000000002,"5min":2.5750000000000002,"15min":2.5750000000000002},"last":1.1519999999999999},{"interface":"front","average":{"1min":1.3879999999999999,"5min":1.3879999999999999,"15min":1.3879999999999999},"min":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"max":{"1min":2.4940000000000002,"5min":2.4940000000000002,"15min":2.4940000000000002},"last":1.173}]},{"osd":5,"last update":"Sun Dec 17 11:49:07 2023","interfaces":[{"interface":"back","average":{"1min":1.3240000000000001,"5min":1.3240000000000001,"15min":1.3240000000000001},"min":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"max":{"1min":2.4289999999999998,"5min":2.4289999999999998,"15min":2.4289999999999998},"last":1.004},{"interface":"front","average":{"1min":1.5489999999999999,"5min":1.5489999999999999,"15min":1.5489999999999999},"min":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"max":{"1min":2.694,"5min":2.694,"15min":2.694},"last":1.2030000000000001}]},{"osd":6,"last update":"Sun Dec 17 11:49:07 2023","interfaces":[{"interface":"back","average":{"1min":1.472,"5min":1.472,"15min":1.472},"min":{"1min":0.748,"5min":0.748,"15min":0.748},"max":{"1min":2.7349999999999999,"5min":2.7349999999999999,"15min":2.7349999999999999},"last":1.1200000000000001},{"interface":"front","average":{"1min":1.4119999999999999,"5min":1.4119999999999999,"15min":1.4119999999999999},"min":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"max":{"1min":2.468,"5min":2.468,"15min":2.468},"last":1.298}]},{"osd":7,"last update":"Sun Dec 17 11:49:07 2023","interfaces":[{"interface":"back","average":{"1min":1.554,"5min":1.554,"15min":1.554},"min":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"max":{"1min":3.379,"5min":3.379,"15min":3.379},"last":1.2270000000000001},{"interface":"front","average":{"1min":1.474,"5min":1.474,"15min":1.474},"min":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"max":{"1min":2.2869999999999999,"5min":2.2869999999999999,"15min":2.2869999999999999},"last":1.369}]}]},{"osd":1,"up_from":14,"seq":60129542171,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27496,"kb_used_data":476,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344344,"statfs":{"total":96636764160,"available":96608608256,"internally_reserved":0,"allocated":487424,"data_stored":210219,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 17 11:49:08 2023","interfaces":[{"interface":"back","average":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.5249999999999999,"5min":1.5249999999999999,"15min":1.5249999999999999},"last":0.76200000000000001},{"interface":"front","average":{"1min":1.113,"5min":1.113,"15min":1.113},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":2.6360000000000001,"5min":2.6360000000000001,"15min":2.6360000000000001},"last":1.0589999999999999}]},{"osd":2,"last update":"Sun Dec 17 11:49:08 2023","interfaces":[{"interface":"back","average":{"1min":1.202,"5min":1.202,"15min":1.202},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":2.8159999999999998,"5min":2.8159999999999998,"15min":2.8159999999999998},"last":1.3899999999999999},{"interface":"front","average":{"1min":1.462,"5min":1.462,"15min":1.462},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":3.101,"5min":3.101,"15min":3.101},"last":0.97199999999999998}]},{"osd":3,"last update":"Sun Dec 17 11:49:08 2023","interfaces":[{"interface":"back","average":{"1min":1.48,"5min":1.48,"15min":1.48},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":2.7890000000000001,"5min":2.7890000000000001,"15min":2.7890000000000001},"last":1.74},{"interface":"front","average":{"1min":1.278,"5min":1.278,"15min":1.278},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":3.1400000000000001,"5min":3.1400000000000001,"15min":3.1400000000000001},"last":1.282}]},{"osd":4,"last update":"Sun Dec 17 11:49:08 2023","interfaces":[{"interface":"back","average":{"1min":1.4350000000000001,"5min":1.4350000000000001,"15min":1.4350000000000001},"min":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":2.5289999999999999,"5min":2.5289999999999999,"15min":2.5289999999999999},"last":1.609},{"interface":"front","average":{"1min":1.363,"5min":1.363,"15min":1.363},"min":{"1min":0.627,"5min":0.627,"15min":0.627},"max":{"1min":2.0819999999999999,"5min":2.0819999999999999,"15min":2.0819999999999999},"last":1.679}]},{"osd":5,"last update":"Sun Dec 17 11:49:08 2023","interfaces":[{"interface":"back","average":{"1min":1.466,"5min":1.466,"15min":1.466},"min":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"max":{"1min":1.96,"5min":1.96,"15min":1.96},"last":1.962},{"interface":"front","average":{"1min":1.573,"5min":1.573,"15min":1.573},"min":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":2.6739999999999999,"5min":2.6739999999999999,"15min":2.6739999999999999},"last":1.4610000000000001}]},{"osd":6,"last update":"Sun Dec 17 11:49:08 2023","interfaces":[{"interface":"back","average":{"1min":1.627,"5min":1.627,"15min":1.627},"min":{"1min":0.754,"5min":0.754,"15min":0.754},"max":{"1min":3.016,"5min":3.016,"15min":3.016},"last":1.8620000000000001},{"interface":"front","average":{"1min":1.5509999999999999,"5min":1.5509999999999999,"15min":1.5509999999999999},"min":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"max":{"1min":2.508,"5min":2.508,"15min":2.508},"last":1.8120000000000001}]},{"osd":7,"last update":"Sun Dec 17 11:49:08 2023","interfaces":[{"interface":"back","average":{"1min":1.6839999999999999,"5min":1.6839999999999999,"15min":1.6839999999999999},"min":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"max":{"1min":2.944,"5min":2.944,"15min":2.944},"last":1.9079999999999999},{"interface":"front","average":{"1min":1.7170000000000001,"5min":1.7170000000000001,"15min":1.7170000000000001},"min":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"max":{"1min":2.7709999999999999,"5min":2.7709999999999999,"15min":2.7709999999999999},"last":2.02}]}]},{"osd":0,"up_from":14,"seq":60129542171,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32240,"kb_used_data":1056,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339600,"statfs":{"total":96636764160,"available":96603750400,"internally_reserved":0,"allocated":1081344,"data_stored":800531,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Dec 17 11:49:06 2023","interfaces":[{"interface":"back","average":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.3899999999999999,"5min":1.3899999999999999,"15min":1.3899999999999999},"last":0.74199999999999999},{"interface":"front","average":{"1min":1.1519999999999999,"5min":1.1519999999999999,"15min":1.1519999999999999},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":1.958,"5min":1.958,"15min":1.958},"last":1.0449999999999999}]},{"osd":2,"last update":"Sun Dec 17 11:49:06 2023","interfaces":[{"interface":"back","average":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.7709999999999999,"5min":1.7709999999999999,"15min":1.7709999999999999},"last":0.86599999999999999},{"interface":"front","average":{"1min":1.2090000000000001,"5min":1.2090000000000001,"15min":1.2090000000000001},"min":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":2.2130000000000001,"5min":2.2130000000000001,"15min":2.2130000000000001},"last":1.1299999999999999}]},{"osd":3,"last update":"Sun Dec 17 11:49:06 2023","interfaces":[{"interface":"back","average":{"1min":1.125,"5min":1.125,"15min":1.125},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.728,"5min":1.728,"15min":1.728},"last":0.81999999999999995},{"interface":"front","average":{"1min":1.4039999999999999,"5min":1.4039999999999999,"15min":1.4039999999999999},"min":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"max":{"1min":2.4809999999999999,"5min":2.4809999999999999,"15min":2.4809999999999999},"last":0.97999999999999998}]},{"osd":4,"last update":"Sun Dec 17 11:49:06 2023","interfaces":[{"interface":"back","average":{"1min":1.518,"5min":1.518,"15min":1.518},"min":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"max":{"1min":4.6710000000000003,"5min":4.6710000000000003,"15min":4.6710000000000003},"last":1.325},{"interface":"front","average":{"1min":1.427,"5min":1.427,"15min":1.427},"min":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"max":{"1min":2.2799999999999998,"5min":2.2799999999999998,"15min":2.2799999999999998},"last":1.4079999999999999}]},{"osd":5,"last update":"Sun Dec 17 11:49:06 2023","interfaces":[{"interface":"back","average":{"1min":1.5069999999999999,"5min":1.5069999999999999,"15min":1.5069999999999999},"min":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"max":{"1min":2.1349999999999998,"5min":2.1349999999999998,"15min":2.1349999999999998},"last":1.5409999999999999},{"interface":"front","average":{"1min":1.6240000000000001,"5min":1.6240000000000001,"15min":1.6240000000000001},"min":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"max":{"1min":2.6080000000000001,"5min":2.6080000000000001,"15min":2.6080000000000001},"last":1.4610000000000001}]},{"osd":6,"last update":"Sun Dec 17 11:49:06 2023","interfaces":[{"interface":"back","average":{"1min":1.5800000000000001,"5min":1.5800000000000001,"15min":1.5800000000000001},"min":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"max":{"1min":2.702,"5min":2.702,"15min":2.702},"last":1.262},{"interface":"front","average":{"1min":1.534,"5min":1.534,"15min":1.534},"min":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"max":{"1min":2.3100000000000001,"5min":2.3100000000000001,"15min":2.3100000000000001},"last":1.6180000000000001}]},{"osd":7,"last update":"Sun Dec 17 11:49:06 2023","interfaces":[{"interface":"back","average":{"1min":1.611,"5min":1.611,"15min":1.611},"min":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"max":{"1min":2.3420000000000001,"5min":2.3420000000000001,"15min":2.3420000000000001},"last":1.504},{"interface":"front","average":{"1min":1.577,"5min":1.577,"15min":1.577},"min":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"max":{"1min":2.4359999999999999,"5min":2.4359999999999999,"15min":2.4359999999999999},"last":1.6699999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-17T11:50:13.042 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-17T11:50:13.280 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:13.278+0000 7ff29c46b640 1 Processor -- start 2023-12-17T11:50:13.280 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:13.278+0000 7ff29c46b640 1 -- start start 2023-12-17T11:50:13.281 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:13.279+0000 7ff29c46b640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff294143e00 0x7ff2940b4040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:50:13.281 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:13.279+0000 7ff29c46b640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff29406c410 0x7ff29415ecb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:50:13.281 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:13.279+0000 7ff29c46b640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2940b3bb0 con 0x7ff294072180 2023-12-17T11:50:13.282 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:13.279+0000 7ff29c46b640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2941441e0 con 0x7ff294143e00 2023-12-17T11:50:13.282 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:13.279+0000 7ff29c46b640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff294072680 con 0x7ff29406c410 2023-12-17T11:50:13.283 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:13.280+0000 7ff29a207640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff294143e00 0x7ff2940b4040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:50:13.283 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:13.280+0000 7ff29a207640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff294143e00 0x7ff2940b4040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:40752/0 (socket says 172.21.15.40:40752) 2023-12-17T11:50:13.283 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:13.280+0000 7ff29a207640 1 -- 172.21.15.40:0/397294212 learned_addr learned my addr 172.21.15.40:0/397294212 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-17T11:50:13.283 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:13.280+0000 7ff29aa08640 1 --2- 172.21.15.40:0/397294212 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff29406c410 0x7ff29415ecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:50:13.283 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:13.280+0000 7ff29a207640 1 -- 172.21.15.40:0/397294212 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff29406c410 msgr2=0x7ff29415ecb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:50:13.283 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:13.280+0000 7ff29a207640 1 --2- 172.21.15.40:0/397294212 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff29406c410 0x7ff29415ecb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:50:13.283 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:13.280+0000 7ff29a207640 1 -- 172.21.15.40:0/397294212 >> v1:172.21.15.40:6789/0 conn(0x7ff294072180 legacy=0x7ff2940b4580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:50:13.283 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:13.280+0000 7ff29a207640 1 -- 172.21.15.40:0/397294212 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2940b1e30 con 0x7ff294143e00 2023-12-17T11:50:13.284 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:13.282+0000 7ff29a207640 1 --2- 172.21.15.40:0/397294212 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff294143e00 0x7ff2940b4040 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7ff290009870 tx=0x7ff29002b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=666bd04046bca3cd server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:50:13.284 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:13.282+0000 7ff299205640 1 -- 172.21.15.40:0/397294212 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff290030840 con 0x7ff294143e00 2023-12-17T11:50:13.284 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:13.282+0000 7ff299205640 1 -- 172.21.15.40:0/397294212 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2900309a0 con 0x7ff294143e00 2023-12-17T11:50:13.284 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:13.282+0000 7ff299205640 1 -- 172.21.15.40:0/397294212 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff290030d30 con 0x7ff294143e00 2023-12-17T11:50:13.284 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:13.282+0000 7ff29c46b640 1 -- 172.21.15.40:0/397294212 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff294143e00 msgr2=0x7ff2940b4040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:50:13.284 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:13.282+0000 7ff29c46b640 1 --2- 172.21.15.40:0/397294212 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff294143e00 0x7ff2940b4040 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7ff290009870 tx=0x7ff29002b980 comp rx=0 tx=0).stop 2023-12-17T11:50:13.285 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:13.283+0000 7ff29c46b640 1 -- 172.21.15.40:0/397294212 shutdown_connections 2023-12-17T11:50:13.285 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:13.283+0000 7ff29c46b640 1 --2- 172.21.15.40:0/397294212 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff29406c410 0x7ff29415ecb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:50:13.285 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:13.283+0000 7ff29c46b640 1 --2- 172.21.15.40:0/397294212 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff294143e00 0x7ff2940b4040 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:50:13.285 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:13.283+0000 7ff29c46b640 1 -- 172.21.15.40:0/397294212 >> 172.21.15.40:0/397294212 conn(0x7ff2940b0a90 msgr2=0x7ff2940b0e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:50:13.285 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:13.283+0000 7ff29c46b640 1 -- 172.21.15.40:0/397294212 shutdown_connections 2023-12-17T11:50:13.285 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:13.283+0000 7ff29c46b640 1 -- 172.21.15.40:0/397294212 wait complete. 2023-12-17T11:50:13.286 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:13.284+0000 7ff29c46b640 1 Processor -- start 2023-12-17T11:50:13.286 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:13.285+0000 7ff29c46b640 1 -- start start 2023-12-17T11:50:13.288 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:13.285+0000 7ff29c46b640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff29406c410 0x7ff29414c770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:50:13.288 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:13.285+0000 7ff29c46b640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff294072180 0x7ff294142bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:50:13.288 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:13.286+0000 7ff29c46b640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff294143e00 0x7ff294143130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:50:13.288 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:13.286+0000 7ff29c46b640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2941f3e50 con 0x7ff294072180 2023-12-17T11:50:13.289 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:13.286+0000 7ff29c46b640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2941f3240 con 0x7ff29406c410 2023-12-17T11:50:13.289 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:13.286+0000 7ff29c46b640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2941f3520 con 0x7ff294143e00 2023-12-17T11:50:13.289 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:13.286+0000 7ff299a06640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff294072180 0x7ff294142bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:50:13.289 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:13.286+0000 7ff299a06640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff294072180 0x7ff294142bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:40766/0 (socket says 172.21.15.40:40766) 2023-12-17T11:50:13.289 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:13.286+0000 7ff299a06640 1 -- 172.21.15.40:0/3812308719 learned_addr learned my addr 172.21.15.40:0/3812308719 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-17T11:50:13.289 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:13.286+0000 7ff29aa08640 1 --2- 172.21.15.40:0/3812308719 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff294143e00 0x7ff294143130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:50:13.289 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:13.286+0000 7ff29a207640 1 --2- 172.21.15.40:0/3812308719 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff29406c410 0x7ff29414c770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:50:13.289 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:13.286+0000 7ff299a06640 1 -- 172.21.15.40:0/3812308719 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff294143e00 msgr2=0x7ff294143130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:50:13.289 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:13.286+0000 7ff299a06640 1 --2- 172.21.15.40:0/3812308719 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff294143e00 0x7ff294143130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:50:13.289 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:13.286+0000 7ff299a06640 1 -- 172.21.15.40:0/3812308719 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff29406c410 msgr2=0x7ff29414c770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:50:13.289 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:13.286+0000 7ff299a06640 1 --2- 172.21.15.40:0/3812308719 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff29406c410 0x7ff29414c770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:50:13.289 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:13.286+0000 7ff299a06640 1 -- 172.21.15.40:0/3812308719 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2900094d0 con 0x7ff294072180 2023-12-17T11:50:13.290 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:13.287+0000 7ff299a06640 1 --2- 172.21.15.40:0/3812308719 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff294072180 0x7ff294142bf0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7ff28400c440 tx=0x7ff284001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:50:13.290 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:13.287+0000 7ff28affd640 1 -- 172.21.15.40:0/3812308719 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2840052d0 con 0x7ff294072180 2023-12-17T11:50:13.291 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:13.287+0000 7ff28affd640 1 -- 172.21.15.40:0/3812308719 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff284005430 con 0x7ff294072180 2023-12-17T11:50:13.291 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:13.287+0000 7ff28affd640 1 -- 172.21.15.40:0/3812308719 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff284007260 con 0x7ff294072180 2023-12-17T11:50:13.291 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:13.287+0000 7ff29c46b640 1 -- 172.21.15.40:0/3812308719 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2941f3800 con 0x7ff294072180 2023-12-17T11:50:13.291 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:13.287+0000 7ff29c46b640 1 -- 172.21.15.40:0/3812308719 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2940abed0 con 0x7ff294072180 2023-12-17T11:50:13.291 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:13.288+0000 7ff29c46b640 1 -- 172.21.15.40:0/3812308719 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2940745d0 con 0x7ff294072180 2023-12-17T11:50:13.292 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:13.289+0000 7ff28affd640 1 -- 172.21.15.40:0/3812308719 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ff2840073c0 con 0x7ff294072180 2023-12-17T11:50:13.292 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:13.290+0000 7ff28affd640 1 --2- 172.21.15.40:0/3812308719 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7ff27806ae40 0x7ff27806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:50:13.292 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:13.290+0000 7ff28affd640 1 -- 172.21.15.40:0/3812308719 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6058+0+0 (secure 0 0 0) 0x7ff284088c30 con 0x7ff294072180 2023-12-17T11:50:13.293 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:13.291+0000 7ff29a207640 1 --2- 172.21.15.40:0/3812308719 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7ff27806ae40 0x7ff27806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:50:13.294 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:13.292+0000 7ff29a207640 1 --2- 172.21.15.40:0/3812308719 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7ff27806ae40 0x7ff27806d300 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7ff290036000 tx=0x7ff29003b040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:50:13.297 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:13.295+0000 7ff28affd640 1 -- 172.21.15.40:0/3812308719 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7ff284053ae0 con 0x7ff294072180 2023-12-17T11:50:13.488 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:13.486+0000 7ff29c46b640 1 -- 172.21.15.40:0/3812308719 --> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ff2940ac090 con 0x7ff27806ae40 2023-12-17T11:50:13.511 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:13.509+0000 7ff28affd640 1 -- 172.21.15.40:0/3812308719 <== mgr.4105 v2:172.21.15.159:6832/479465803 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286515 (secure 0 0 0) 0x7ff2940ac090 con 0x7ff27806ae40 2023-12-17T11:50:13.515 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T11:50:13.517 INFO:teuthology.orchestra.run.smithi040.stderr:dumped all 2023-12-17T11:50:13.519 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:13.514+0000 7ff29c46b640 1 -- 172.21.15.40:0/3812308719 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7ff27806ae40 msgr2=0x7ff27806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:50:13.519 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:13.514+0000 7ff29c46b640 1 --2- 172.21.15.40:0/3812308719 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7ff27806ae40 0x7ff27806d300 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7ff290036000 tx=0x7ff29003b040 comp rx=0 tx=0).stop 2023-12-17T11:50:13.519 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:13.514+0000 7ff29c46b640 1 -- 172.21.15.40:0/3812308719 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff294072180 msgr2=0x7ff294142bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:50:13.519 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:13.514+0000 7ff29c46b640 1 --2- 172.21.15.40:0/3812308719 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff294072180 0x7ff294142bf0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7ff28400c440 tx=0x7ff284001e70 comp rx=0 tx=0).stop 2023-12-17T11:50:13.519 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:13.514+0000 7ff29c46b640 1 -- 172.21.15.40:0/3812308719 shutdown_connections 2023-12-17T11:50:13.519 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:13.514+0000 7ff29c46b640 1 --2- 172.21.15.40:0/3812308719 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7ff27806ae40 0x7ff27806d300 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:50:13.519 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:13.514+0000 7ff29c46b640 1 --2- 172.21.15.40:0/3812308719 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7ff294143e00 0x7ff294143130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:50:13.519 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:13.514+0000 7ff29c46b640 1 --2- 172.21.15.40:0/3812308719 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff294072180 0x7ff294142bf0 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:50:13.519 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:13.514+0000 7ff29c46b640 1 --2- 172.21.15.40:0/3812308719 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff29406c410 0x7ff29414c770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:50:13.519 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:13.514+0000 7ff29c46b640 1 -- 172.21.15.40:0/3812308719 >> 172.21.15.40:0/3812308719 conn(0x7ff2940b0a90 msgr2=0x7ff29413f0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:50:13.520 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:13.515+0000 7ff29c46b640 1 -- 172.21.15.40:0/3812308719 shutdown_connections 2023-12-17T11:50:13.520 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:13.515+0000 7ff29c46b640 1 -- 172.21.15.40:0/3812308719 wait complete. 2023-12-17T11:50:13.536 INFO:teuthology.orchestra.run.smithi040.stdout:{"pg_ready":true,"pg_map":{"version":98,"stamp":"2023-12-17T11:50:12.637089+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":225332,"kb_used_data":5000,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754749388,"statfs":{"total":773094113280,"available":772863373312,"internally_reserved":0,"allocated":5120000,"data_stored":2866588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":225496626},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"11.103602"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-17T11:50:00.525487+0000","last_change":"2023-12-17T11:49:53.251801+0000","last_active":"2023-12-17T11:50:00.525487+0000","last_peered":"2023-12-17T11:50:00.525487+0000","last_clean":"2023-12-17T11:50:00.525487+0000","last_became_active":"2023-12-17T11:49:53.251221+0000","last_became_peered":"2023-12-17T11:49:53.251221+0000","last_unstale":"2023-12-17T11:50:00.525487+0000","last_undegraded":"2023-12-17T11:50:00.525487+0000","last_fullsized":"2023-12-17T11:50:00.525487+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T22:42:15.785143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-17T11:50:00.524627+0000","last_change":"2023-12-17T11:49:53.243478+0000","last_active":"2023-12-17T11:50:00.524627+0000","last_peered":"2023-12-17T11:50:00.524627+0000","last_clean":"2023-12-17T11:50:00.524627+0000","last_became_active":"2023-12-17T11:49:53.243179+0000","last_became_peered":"2023-12-17T11:49:53.243179+0000","last_unstale":"2023-12-17T11:50:00.524627+0000","last_undegraded":"2023-12-17T11:50:00.524627+0000","last_fullsized":"2023-12-17T11:50:00.524627+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T23:49:09.469993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-17T11:50:00.529653+0000","last_change":"2023-12-17T11:49:53.249501+0000","last_active":"2023-12-17T11:50:00.529653+0000","last_peered":"2023-12-17T11:50:00.529653+0000","last_clean":"2023-12-17T11:50:00.529653+0000","last_became_active":"2023-12-17T11:49:53.249212+0000","last_became_peered":"2023-12-17T11:49:53.249212+0000","last_unstale":"2023-12-17T11:50:00.529653+0000","last_undegraded":"2023-12-17T11:50:00.529653+0000","last_fullsized":"2023-12-17T11:50:00.529653+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T22:50:12.261960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-17T11:50:01.303372+0000","last_change":"2023-12-17T11:49:53.237486+0000","last_active":"2023-12-17T11:50:01.303372+0000","last_peered":"2023-12-17T11:50:01.303372+0000","last_clean":"2023-12-17T11:50:01.303372+0000","last_became_active":"2023-12-17T11:49:53.236766+0000","last_became_peered":"2023-12-17T11:49:53.236766+0000","last_unstale":"2023-12-17T11:50:01.303372+0000","last_undegraded":"2023-12-17T11:50:01.303372+0000","last_fullsized":"2023-12-17T11:50:01.303372+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T19:34:01.395947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-17T11:50:01.303292+0000","last_change":"2023-12-17T11:49:53.230175+0000","last_active":"2023-12-17T11:50:01.303292+0000","last_peered":"2023-12-17T11:50:01.303292+0000","last_clean":"2023-12-17T11:50:01.303292+0000","last_became_active":"2023-12-17T11:49:53.229756+0000","last_became_peered":"2023-12-17T11:49:53.229756+0000","last_unstale":"2023-12-17T11:50:01.303292+0000","last_undegraded":"2023-12-17T11:50:01.303292+0000","last_fullsized":"2023-12-17T11:50:01.303292+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T15:43:04.869288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-17T11:50:00.523170+0000","last_change":"2023-12-17T11:49:53.245040+0000","last_active":"2023-12-17T11:50:00.523170+0000","last_peered":"2023-12-17T11:50:00.523170+0000","last_clean":"2023-12-17T11:50:00.523170+0000","last_became_active":"2023-12-17T11:49:53.243989+0000","last_became_peered":"2023-12-17T11:49:53.243989+0000","last_unstale":"2023-12-17T11:50:00.523170+0000","last_undegraded":"2023-12-17T11:50:00.523170+0000","last_fullsized":"2023-12-17T11:50:00.523170+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T16:31:53.964205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-17T11:50:00.528791+0000","last_change":"2023-12-17T11:49:53.244506+0000","last_active":"2023-12-17T11:50:00.528791+0000","last_peered":"2023-12-17T11:50:00.528791+0000","last_clean":"2023-12-17T11:50:00.528791+0000","last_became_active":"2023-12-17T11:49:53.244244+0000","last_became_peered":"2023-12-17T11:49:53.244244+0000","last_unstale":"2023-12-17T11:50:00.528791+0000","last_undegraded":"2023-12-17T11:50:00.528791+0000","last_fullsized":"2023-12-17T11:50:00.528791+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T12:27:38.132749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-17T11:50:00.522397+0000","last_change":"2023-12-17T11:49:53.256713+0000","last_active":"2023-12-17T11:50:00.522397+0000","last_peered":"2023-12-17T11:50:00.522397+0000","last_clean":"2023-12-17T11:50:00.522397+0000","last_became_active":"2023-12-17T11:49:53.255850+0000","last_became_peered":"2023-12-17T11:49:53.255850+0000","last_unstale":"2023-12-17T11:50:00.522397+0000","last_undegraded":"2023-12-17T11:50:00.522397+0000","last_fullsized":"2023-12-17T11:50:00.522397+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T14:00:43.418107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-17T11:50:00.530083+0000","last_change":"2023-12-17T11:49:53.255007+0000","last_active":"2023-12-17T11:50:00.530083+0000","last_peered":"2023-12-17T11:50:00.530083+0000","last_clean":"2023-12-17T11:50:00.530083+0000","last_became_active":"2023-12-17T11:49:53.254750+0000","last_became_peered":"2023-12-17T11:49:53.254750+0000","last_unstale":"2023-12-17T11:50:00.530083+0000","last_undegraded":"2023-12-17T11:50:00.530083+0000","last_fullsized":"2023-12-17T11:50:00.530083+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T19:23:44.505187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-17T11:50:00.529928+0000","last_change":"2023-12-17T11:49:53.243885+0000","last_active":"2023-12-17T11:50:00.529928+0000","last_peered":"2023-12-17T11:50:00.529928+0000","last_clean":"2023-12-17T11:50:00.529928+0000","last_became_active":"2023-12-17T11:49:53.243586+0000","last_became_peered":"2023-12-17T11:49:53.243586+0000","last_unstale":"2023-12-17T11:50:00.529928+0000","last_undegraded":"2023-12-17T11:50:00.529928+0000","last_fullsized":"2023-12-17T11:50:00.529928+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T23:49:09.469993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-17T11:50:00.529560+0000","last_change":"2023-12-17T11:49:53.245071+0000","last_active":"2023-12-17T11:50:00.529560+0000","last_peered":"2023-12-17T11:50:00.529560+0000","last_clean":"2023-12-17T11:50:00.529560+0000","last_became_active":"2023-12-17T11:49:53.244696+0000","last_became_peered":"2023-12-17T11:49:53.244696+0000","last_unstale":"2023-12-17T11:50:00.529560+0000","last_undegraded":"2023-12-17T11:50:00.529560+0000","last_fullsized":"2023-12-17T11:50:00.529560+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T17:56:09.285369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-17T11:50:00.529492+0000","last_change":"2023-12-17T11:49:53.244437+0000","last_active":"2023-12-17T11:50:00.529492+0000","last_peered":"2023-12-17T11:50:00.529492+0000","last_clean":"2023-12-17T11:50:00.529492+0000","last_became_active":"2023-12-17T11:49:53.244158+0000","last_became_peered":"2023-12-17T11:49:53.244158+0000","last_unstale":"2023-12-17T11:50:00.529492+0000","last_undegraded":"2023-12-17T11:50:00.529492+0000","last_fullsized":"2023-12-17T11:50:00.529492+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T12:12:45.651530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-17T11:50:00.529005+0000","last_change":"2023-12-17T11:49:53.259954+0000","last_active":"2023-12-17T11:50:00.529005+0000","last_peered":"2023-12-17T11:50:00.529005+0000","last_clean":"2023-12-17T11:50:00.529005+0000","last_became_active":"2023-12-17T11:49:53.259683+0000","last_became_peered":"2023-12-17T11:49:53.259683+0000","last_unstale":"2023-12-17T11:50:00.529005+0000","last_undegraded":"2023-12-17T11:50:00.529005+0000","last_fullsized":"2023-12-17T11:50:00.529005+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T13:29:29.953615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-17T11:50:00.522506+0000","last_change":"2023-12-17T11:49:53.251388+0000","last_active":"2023-12-17T11:50:00.522506+0000","last_peered":"2023-12-17T11:50:00.522506+0000","last_clean":"2023-12-17T11:50:00.522506+0000","last_became_active":"2023-12-17T11:49:53.251182+0000","last_became_peered":"2023-12-17T11:49:53.251182+0000","last_unstale":"2023-12-17T11:50:00.522506+0000","last_undegraded":"2023-12-17T11:50:00.522506+0000","last_fullsized":"2023-12-17T11:50:00.522506+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T19:39:18.340154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-17T11:50:00.528861+0000","last_change":"2023-12-17T11:49:53.251484+0000","last_active":"2023-12-17T11:50:00.528861+0000","last_peered":"2023-12-17T11:50:00.528861+0000","last_clean":"2023-12-17T11:50:00.528861+0000","last_became_active":"2023-12-17T11:49:53.250825+0000","last_became_peered":"2023-12-17T11:49:53.250825+0000","last_unstale":"2023-12-17T11:50:00.528861+0000","last_undegraded":"2023-12-17T11:50:00.528861+0000","last_fullsized":"2023-12-17T11:50:00.528861+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T12:48:09.865175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:55.795131+0000","last_change":"2023-12-17T11:49:53.256736+0000","last_active":"2023-12-17T11:49:55.795131+0000","last_peered":"2023-12-17T11:49:55.795131+0000","last_clean":"2023-12-17T11:49:55.795131+0000","last_became_active":"2023-12-17T11:49:53.256319+0000","last_became_peered":"2023-12-17T11:49:53.256319+0000","last_unstale":"2023-12-17T11:49:55.795131+0000","last_undegraded":"2023-12-17T11:49:55.795131+0000","last_fullsized":"2023-12-17T11:49:55.795131+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T14:49:05.628056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:55.795758+0000","last_change":"2023-12-17T11:49:53.254466+0000","last_active":"2023-12-17T11:49:55.795758+0000","last_peered":"2023-12-17T11:49:55.795758+0000","last_clean":"2023-12-17T11:49:55.795758+0000","last_became_active":"2023-12-17T11:49:53.254191+0000","last_became_peered":"2023-12-17T11:49:53.254191+0000","last_unstale":"2023-12-17T11:49:55.795758+0000","last_undegraded":"2023-12-17T11:49:55.795758+0000","last_fullsized":"2023-12-17T11:49:55.795758+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T15:34:59.184998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-17T11:50:01.202677+0000","last_change":"2023-12-17T11:49:53.244371+0000","last_active":"2023-12-17T11:50:01.202677+0000","last_peered":"2023-12-17T11:50:01.202677+0000","last_clean":"2023-12-17T11:50:01.202677+0000","last_became_active":"2023-12-17T11:49:53.243288+0000","last_became_peered":"2023-12-17T11:49:53.243288+0000","last_unstale":"2023-12-17T11:50:01.202677+0000","last_undegraded":"2023-12-17T11:50:01.202677+0000","last_fullsized":"2023-12-17T11:50:01.202677+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T22:59:01.401999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-17T11:50:01.303607+0000","last_change":"2023-12-17T11:49:53.247133+0000","last_active":"2023-12-17T11:50:01.303607+0000","last_peered":"2023-12-17T11:50:01.303607+0000","last_clean":"2023-12-17T11:50:01.303607+0000","last_became_active":"2023-12-17T11:49:53.246863+0000","last_became_peered":"2023-12-17T11:49:53.246863+0000","last_unstale":"2023-12-17T11:50:01.303607+0000","last_undegraded":"2023-12-17T11:50:01.303607+0000","last_fullsized":"2023-12-17T11:50:01.303607+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T15:22:56.669665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-17T11:50:01.202405+0000","last_change":"2023-12-17T11:49:53.234246+0000","last_active":"2023-12-17T11:50:01.202405+0000","last_peered":"2023-12-17T11:50:01.202405+0000","last_clean":"2023-12-17T11:50:01.202405+0000","last_became_active":"2023-12-17T11:49:53.233971+0000","last_became_peered":"2023-12-17T11:49:53.233971+0000","last_unstale":"2023-12-17T11:50:01.202405+0000","last_undegraded":"2023-12-17T11:50:01.202405+0000","last_fullsized":"2023-12-17T11:50:01.202405+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T21:22:15.324114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-17T11:50:00.529542+0000","last_change":"2023-12-17T11:49:53.254631+0000","last_active":"2023-12-17T11:50:00.529542+0000","last_peered":"2023-12-17T11:50:00.529542+0000","last_clean":"2023-12-17T11:50:00.529542+0000","last_became_active":"2023-12-17T11:49:53.254246+0000","last_became_peered":"2023-12-17T11:49:53.254246+0000","last_unstale":"2023-12-17T11:50:00.529542+0000","last_undegraded":"2023-12-17T11:50:00.529542+0000","last_fullsized":"2023-12-17T11:50:00.529542+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T15:42:47.132551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-17T11:50:00.523985+0000","last_change":"2023-12-17T11:49:53.233281+0000","last_active":"2023-12-17T11:50:00.523985+0000","last_peered":"2023-12-17T11:50:00.523985+0000","last_clean":"2023-12-17T11:50:00.523985+0000","last_became_active":"2023-12-17T11:49:53.233006+0000","last_became_peered":"2023-12-17T11:49:53.233006+0000","last_unstale":"2023-12-17T11:50:00.523985+0000","last_undegraded":"2023-12-17T11:50:00.523985+0000","last_fullsized":"2023-12-17T11:50:00.523985+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T17:37:46.058341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:55.795311+0000","last_change":"2023-12-17T11:49:53.235006+0000","last_active":"2023-12-17T11:49:55.795311+0000","last_peered":"2023-12-17T11:49:55.795311+0000","last_clean":"2023-12-17T11:49:55.795311+0000","last_became_active":"2023-12-17T11:49:53.232828+0000","last_became_peered":"2023-12-17T11:49:53.232828+0000","last_unstale":"2023-12-17T11:49:55.795311+0000","last_undegraded":"2023-12-17T11:49:55.795311+0000","last_fullsized":"2023-12-17T11:49:55.795311+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T21:34:46.442330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-17T11:50:01.303767+0000","last_change":"2023-12-17T11:49:53.229937+0000","last_active":"2023-12-17T11:50:01.303767+0000","last_peered":"2023-12-17T11:50:01.303767+0000","last_clean":"2023-12-17T11:50:01.303767+0000","last_became_active":"2023-12-17T11:49:53.229360+0000","last_became_peered":"2023-12-17T11:49:53.229360+0000","last_unstale":"2023-12-17T11:50:01.303767+0000","last_undegraded":"2023-12-17T11:50:01.303767+0000","last_fullsized":"2023-12-17T11:50:01.303767+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T13:22:57.464897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-17T11:50:01.202634+0000","last_change":"2023-12-17T11:49:53.248140+0000","last_active":"2023-12-17T11:50:01.202634+0000","last_peered":"2023-12-17T11:50:01.202634+0000","last_clean":"2023-12-17T11:50:01.202634+0000","last_became_active":"2023-12-17T11:49:53.246139+0000","last_became_peered":"2023-12-17T11:49:53.246139+0000","last_unstale":"2023-12-17T11:50:01.202634+0000","last_undegraded":"2023-12-17T11:50:01.202634+0000","last_fullsized":"2023-12-17T11:50:01.202634+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T14:32:00.462222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-17T11:50:00.523471+0000","last_change":"2023-12-17T11:49:53.255892+0000","last_active":"2023-12-17T11:50:00.523471+0000","last_peered":"2023-12-17T11:50:00.523471+0000","last_clean":"2023-12-17T11:50:00.523471+0000","last_became_active":"2023-12-17T11:49:53.255307+0000","last_became_peered":"2023-12-17T11:49:53.255307+0000","last_unstale":"2023-12-17T11:50:00.523471+0000","last_undegraded":"2023-12-17T11:50:00.523471+0000","last_fullsized":"2023-12-17T11:50:00.523471+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T17:37:46.058341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-17T11:50:01.202692+0000","last_change":"2023-12-17T11:49:53.238527+0000","last_active":"2023-12-17T11:50:01.202692+0000","last_peered":"2023-12-17T11:50:01.202692+0000","last_clean":"2023-12-17T11:50:01.202692+0000","last_became_active":"2023-12-17T11:49:53.238260+0000","last_became_peered":"2023-12-17T11:49:53.238260+0000","last_unstale":"2023-12-17T11:50:01.202692+0000","last_undegraded":"2023-12-17T11:50:01.202692+0000","last_fullsized":"2023-12-17T11:50:01.202692+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T14:03:14.332356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-17T11:50:00.529245+0000","last_change":"2023-12-17T11:49:53.247243+0000","last_active":"2023-12-17T11:50:00.529245+0000","last_peered":"2023-12-17T11:50:00.529245+0000","last_clean":"2023-12-17T11:50:00.529245+0000","last_became_active":"2023-12-17T11:49:53.246983+0000","last_became_peered":"2023-12-17T11:49:53.246983+0000","last_unstale":"2023-12-17T11:50:00.529245+0000","last_undegraded":"2023-12-17T11:50:00.529245+0000","last_fullsized":"2023-12-17T11:50:00.529245+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T23:33:06.562683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-17T11:50:01.202387+0000","last_change":"2023-12-17T11:49:53.247287+0000","last_active":"2023-12-17T11:50:01.202387+0000","last_peered":"2023-12-17T11:50:01.202387+0000","last_clean":"2023-12-17T11:50:01.202387+0000","last_became_active":"2023-12-17T11:49:53.246995+0000","last_became_peered":"2023-12-17T11:49:53.246995+0000","last_unstale":"2023-12-17T11:50:01.202387+0000","last_undegraded":"2023-12-17T11:50:01.202387+0000","last_fullsized":"2023-12-17T11:50:01.202387+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T14:03:09.358474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-17T11:50:01.202183+0000","last_change":"2023-12-17T11:49:53.240901+0000","last_active":"2023-12-17T11:50:01.202183+0000","last_peered":"2023-12-17T11:50:01.202183+0000","last_clean":"2023-12-17T11:50:01.202183+0000","last_became_active":"2023-12-17T11:49:53.240589+0000","last_became_peered":"2023-12-17T11:49:53.240589+0000","last_unstale":"2023-12-17T11:50:01.202183+0000","last_undegraded":"2023-12-17T11:50:01.202183+0000","last_fullsized":"2023-12-17T11:50:01.202183+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T19:17:47.294209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:55.795352+0000","last_change":"2023-12-17T11:49:53.239855+0000","last_active":"2023-12-17T11:49:55.795352+0000","last_peered":"2023-12-17T11:49:55.795352+0000","last_clean":"2023-12-17T11:49:55.795352+0000","last_became_active":"2023-12-17T11:49:53.239579+0000","last_became_peered":"2023-12-17T11:49:53.239579+0000","last_unstale":"2023-12-17T11:49:55.795352+0000","last_undegraded":"2023-12-17T11:49:55.795352+0000","last_fullsized":"2023-12-17T11:49:55.795352+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T20:29:09.996550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-17T11:50:00.522960+0000","last_change":"2023-12-17T11:49:53.252543+0000","last_active":"2023-12-17T11:50:00.522960+0000","last_peered":"2023-12-17T11:50:00.522960+0000","last_clean":"2023-12-17T11:50:00.522960+0000","last_became_active":"2023-12-17T11:49:53.250790+0000","last_became_peered":"2023-12-17T11:49:53.250790+0000","last_unstale":"2023-12-17T11:50:00.522960+0000","last_undegraded":"2023-12-17T11:50:00.522960+0000","last_fullsized":"2023-12-17T11:50:00.522960+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T19:00:07.905809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:55.795567+0000","last_change":"2023-12-17T11:49:53.245226+0000","last_active":"2023-12-17T11:49:55.795567+0000","last_peered":"2023-12-17T11:49:55.795567+0000","last_clean":"2023-12-17T11:49:55.795567+0000","last_became_active":"2023-12-17T11:49:53.243115+0000","last_became_peered":"2023-12-17T11:49:53.243115+0000","last_unstale":"2023-12-17T11:49:55.795567+0000","last_undegraded":"2023-12-17T11:49:55.795567+0000","last_fullsized":"2023-12-17T11:49:55.795567+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T15:06:34.831619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"39'4","reported_seq":18,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-17T11:50:01.202725+0000","last_change":"2023-12-17T11:49:52.226944+0000","last_active":"2023-12-17T11:50:01.202725+0000","last_peered":"2023-12-17T11:50:01.202725+0000","last_clean":"2023-12-17T11:50:01.202725+0000","last_became_active":"2023-12-17T11:49:52.226659+0000","last_became_peered":"2023-12-17T11:49:52.226659+0000","last_unstale":"2023-12-17T11:50:01.202725+0000","last_undegraded":"2023-12-17T11:50:01.202725+0000","last_fullsized":"2023-12-17T11:50:01.202725+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_clean_scrub_stamp":"2023-12-17T11:49:51.168108+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T13:22:56.453467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-17T11:50:00.523987+0000","last_change":"2023-12-17T11:49:53.254791+0000","last_active":"2023-12-17T11:50:00.523987+0000","last_peered":"2023-12-17T11:50:00.523987+0000","last_clean":"2023-12-17T11:50:00.523987+0000","last_became_active":"2023-12-17T11:49:53.254496+0000","last_became_peered":"2023-12-17T11:49:53.254496+0000","last_unstale":"2023-12-17T11:50:00.523987+0000","last_undegraded":"2023-12-17T11:50:00.523987+0000","last_fullsized":"2023-12-17T11:50:00.523987+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T14:42:29.543380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"39'1","reported_seq":15,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-17T11:50:00.529763+0000","last_change":"2023-12-17T11:49:52.223256+0000","last_active":"2023-12-17T11:50:00.529763+0000","last_peered":"2023-12-17T11:50:00.529763+0000","last_clean":"2023-12-17T11:50:00.529763+0000","last_became_active":"2023-12-17T11:49:52.222808+0000","last_became_peered":"2023-12-17T11:49:52.222808+0000","last_unstale":"2023-12-17T11:50:00.529763+0000","last_undegraded":"2023-12-17T11:50:00.529763+0000","last_fullsized":"2023-12-17T11:50:00.529763+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_clean_scrub_stamp":"2023-12-17T11:49:51.168108+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T16:31:52.952775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-17T11:50:00.523143+0000","last_change":"2023-12-17T11:49:53.251178+0000","last_active":"2023-12-17T11:50:00.523143+0000","last_peered":"2023-12-17T11:50:00.523143+0000","last_clean":"2023-12-17T11:50:00.523143+0000","last_became_active":"2023-12-17T11:49:53.250223+0000","last_became_peered":"2023-12-17T11:49:53.250223+0000","last_unstale":"2023-12-17T11:50:00.523143+0000","last_undegraded":"2023-12-17T11:50:00.523143+0000","last_fullsized":"2023-12-17T11:50:00.523143+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T23:10:56.100255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"39'2","reported_seq":16,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-17T11:50:00.524369+0000","last_change":"2023-12-17T11:49:52.223879+0000","last_active":"2023-12-17T11:50:00.524369+0000","last_peered":"2023-12-17T11:50:00.524369+0000","last_clean":"2023-12-17T11:50:00.524369+0000","last_became_active":"2023-12-17T11:49:52.223602+0000","last_became_peered":"2023-12-17T11:49:52.223602+0000","last_unstale":"2023-12-17T11:50:00.524369+0000","last_undegraded":"2023-12-17T11:50:00.524369+0000","last_fullsized":"2023-12-17T11:50:00.524369+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_clean_scrub_stamp":"2023-12-17T11:49:51.168108+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T15:25:46.493177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-17T11:50:00.525262+0000","last_change":"2023-12-17T11:49:53.254646+0000","last_active":"2023-12-17T11:50:00.525262+0000","last_peered":"2023-12-17T11:50:00.525262+0000","last_clean":"2023-12-17T11:50:00.525262+0000","last_became_active":"2023-12-17T11:49:53.254368+0000","last_became_peered":"2023-12-17T11:49:53.254368+0000","last_unstale":"2023-12-17T11:50:00.525262+0000","last_undegraded":"2023-12-17T11:50:00.525262+0000","last_fullsized":"2023-12-17T11:50:00.525262+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T15:42:47.132551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"39'2","reported_seq":16,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-17T11:50:00.523260+0000","last_change":"2023-12-17T11:49:52.221006+0000","last_active":"2023-12-17T11:50:00.523260+0000","last_peered":"2023-12-17T11:50:00.523260+0000","last_clean":"2023-12-17T11:50:00.523260+0000","last_became_active":"2023-12-17T11:49:52.220514+0000","last_became_peered":"2023-12-17T11:49:52.220514+0000","last_unstale":"2023-12-17T11:50:00.523260+0000","last_undegraded":"2023-12-17T11:50:00.523260+0000","last_fullsized":"2023-12-17T11:50:00.523260+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_clean_scrub_stamp":"2023-12-17T11:49:51.168108+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T15:25:46.493177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-17T11:50:00.528932+0000","last_change":"2023-12-17T11:49:53.251737+0000","last_active":"2023-12-17T11:50:00.528932+0000","last_peered":"2023-12-17T11:50:00.528932+0000","last_clean":"2023-12-17T11:50:00.528932+0000","last_became_active":"2023-12-17T11:49:53.251458+0000","last_became_peered":"2023-12-17T11:49:53.251458+0000","last_unstale":"2023-12-17T11:50:00.528932+0000","last_undegraded":"2023-12-17T11:50:00.528932+0000","last_fullsized":"2023-12-17T11:50:00.528932+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T17:37:46.058341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"39'1","reported_seq":15,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-17T11:50:00.529332+0000","last_change":"2023-12-17T11:49:52.226918+0000","last_active":"2023-12-17T11:50:00.529332+0000","last_peered":"2023-12-17T11:50:00.529332+0000","last_clean":"2023-12-17T11:50:00.529332+0000","last_became_active":"2023-12-17T11:49:52.226455+0000","last_became_peered":"2023-12-17T11:49:52.226455+0000","last_unstale":"2023-12-17T11:50:00.529332+0000","last_undegraded":"2023-12-17T11:50:00.529332+0000","last_fullsized":"2023-12-17T11:50:00.529332+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_clean_scrub_stamp":"2023-12-17T11:49:51.168108+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T12:12:44.640100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-17T11:50:00.529065+0000","last_change":"2023-12-17T11:49:53.251691+0000","last_active":"2023-12-17T11:50:00.529065+0000","last_peered":"2023-12-17T11:50:00.529065+0000","last_clean":"2023-12-17T11:50:00.529065+0000","last_became_active":"2023-12-17T11:49:53.251175+0000","last_became_peered":"2023-12-17T11:49:53.251175+0000","last_unstale":"2023-12-17T11:50:00.529065+0000","last_undegraded":"2023-12-17T11:50:00.529065+0000","last_fullsized":"2023-12-17T11:50:00.529065+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T14:00:43.418107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"39'1","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:55.795479+0000","last_change":"2023-12-17T11:49:52.225053+0000","last_active":"2023-12-17T11:49:55.795479+0000","last_peered":"2023-12-17T11:49:55.795479+0000","last_clean":"2023-12-17T11:49:55.795479+0000","last_became_active":"2023-12-17T11:49:52.224761+0000","last_became_peered":"2023-12-17T11:49:52.224761+0000","last_unstale":"2023-12-17T11:49:55.795479+0000","last_undegraded":"2023-12-17T11:49:55.795479+0000","last_fullsized":"2023-12-17T11:49:55.795479+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_clean_scrub_stamp":"2023-12-17T11:49:51.168108+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T20:30:07.106128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":20,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-12-17T11:50:02.268429+0000","last_change":"2023-12-17T11:50:02.268429+0000","last_active":"2023-12-17T11:50:02.268429+0000","last_peered":"2023-12-17T11:50:02.268429+0000","last_clean":"2023-12-17T11:50:02.268429+0000","last_became_active":"2023-12-17T11:50:02.267857+0000","last_became_peered":"2023-12-17T11:50:02.267857+0000","last_unstale":"2023-12-17T11:50:02.268429+0000","last_undegraded":"2023-12-17T11:50:02.268429+0000","last_fullsized":"2023-12-17T11:50:02.268429+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T19:23:44.505187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-17T11:50:00.523140+0000","last_change":"2023-12-17T11:49:52.230598+0000","last_active":"2023-12-17T11:50:00.523140+0000","last_peered":"2023-12-17T11:50:00.523140+0000","last_clean":"2023-12-17T11:50:00.523140+0000","last_became_active":"2023-12-17T11:49:52.230298+0000","last_became_peered":"2023-12-17T11:49:52.230298+0000","last_unstale":"2023-12-17T11:50:00.523140+0000","last_undegraded":"2023-12-17T11:50:00.523140+0000","last_fullsized":"2023-12-17T11:50:00.523140+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_clean_scrub_stamp":"2023-12-17T11:49:51.168108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T22:39:30.094160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-17T11:50:00.523881+0000","last_change":"2023-12-17T11:49:53.249431+0000","last_active":"2023-12-17T11:50:00.523881+0000","last_peered":"2023-12-17T11:50:00.523881+0000","last_clean":"2023-12-17T11:50:00.523881+0000","last_became_active":"2023-12-17T11:49:53.248943+0000","last_became_peered":"2023-12-17T11:49:53.248943+0000","last_unstale":"2023-12-17T11:50:00.523881+0000","last_undegraded":"2023-12-17T11:50:00.523881+0000","last_fullsized":"2023-12-17T11:50:00.523881+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T16:21:14.355302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-17T11:50:00.522481+0000","last_change":"2023-12-17T11:49:52.224198+0000","last_active":"2023-12-17T11:50:00.522481+0000","last_peered":"2023-12-17T11:50:00.522481+0000","last_clean":"2023-12-17T11:50:00.522481+0000","last_became_active":"2023-12-17T11:49:52.223829+0000","last_became_peered":"2023-12-17T11:49:52.223829+0000","last_unstale":"2023-12-17T11:50:00.522481+0000","last_undegraded":"2023-12-17T11:50:00.522481+0000","last_fullsized":"2023-12-17T11:50:00.522481+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_clean_scrub_stamp":"2023-12-17T11:49:51.168108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T13:20:29.045455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-17T11:50:01.303367+0000","last_change":"2023-12-17T11:49:53.232883+0000","last_active":"2023-12-17T11:50:01.303367+0000","last_peered":"2023-12-17T11:50:01.303367+0000","last_clean":"2023-12-17T11:50:01.303367+0000","last_became_active":"2023-12-17T11:49:53.232629+0000","last_became_peered":"2023-12-17T11:49:53.232629+0000","last_unstale":"2023-12-17T11:50:01.303367+0000","last_undegraded":"2023-12-17T11:50:01.303367+0000","last_fullsized":"2023-12-17T11:50:01.303367+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T18:07:10.105462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-17T11:50:00.525489+0000","last_change":"2023-12-17T11:49:52.215890+0000","last_active":"2023-12-17T11:50:00.525489+0000","last_peered":"2023-12-17T11:50:00.525489+0000","last_clean":"2023-12-17T11:50:00.525489+0000","last_became_active":"2023-12-17T11:49:52.215576+0000","last_became_peered":"2023-12-17T11:49:52.215576+0000","last_unstale":"2023-12-17T11:50:00.525489+0000","last_undegraded":"2023-12-17T11:50:00.525489+0000","last_fullsized":"2023-12-17T11:50:00.525489+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_clean_scrub_stamp":"2023-12-17T11:49:51.168108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T17:03:59.637357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:55.795673+0000","last_change":"2023-12-17T11:49:53.236661+0000","last_active":"2023-12-17T11:49:55.795673+0000","last_peered":"2023-12-17T11:49:55.795673+0000","last_clean":"2023-12-17T11:49:55.795673+0000","last_became_active":"2023-12-17T11:49:53.236319+0000","last_became_peered":"2023-12-17T11:49:53.236319+0000","last_unstale":"2023-12-17T11:49:55.795673+0000","last_undegraded":"2023-12-17T11:49:55.795673+0000","last_fullsized":"2023-12-17T11:49:55.795673+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T13:29:01.309715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-17T11:50:00.530428+0000","last_change":"2023-12-17T11:49:52.233070+0000","last_active":"2023-12-17T11:50:00.530428+0000","last_peered":"2023-12-17T11:50:00.530428+0000","last_clean":"2023-12-17T11:50:00.530428+0000","last_became_active":"2023-12-17T11:49:52.232635+0000","last_became_peered":"2023-12-17T11:49:52.232635+0000","last_unstale":"2023-12-17T11:50:00.530428+0000","last_undegraded":"2023-12-17T11:50:00.530428+0000","last_fullsized":"2023-12-17T11:50:00.530428+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_clean_scrub_stamp":"2023-12-17T11:49:51.168108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T15:53:07.030004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-17T11:50:00.529654+0000","last_change":"2023-12-17T11:49:53.246755+0000","last_active":"2023-12-17T11:50:00.529654+0000","last_peered":"2023-12-17T11:50:00.529654+0000","last_clean":"2023-12-17T11:50:00.529654+0000","last_became_active":"2023-12-17T11:49:53.245111+0000","last_became_peered":"2023-12-17T11:49:53.245111+0000","last_unstale":"2023-12-17T11:50:00.529654+0000","last_undegraded":"2023-12-17T11:50:00.529654+0000","last_fullsized":"2023-12-17T11:50:00.529654+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T14:59:11.557660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"39'3","reported_seq":17,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-17T11:50:00.529919+0000","last_change":"2023-12-17T11:49:52.231475+0000","last_active":"2023-12-17T11:50:00.529919+0000","last_peered":"2023-12-17T11:50:00.529919+0000","last_clean":"2023-12-17T11:50:00.529919+0000","last_became_active":"2023-12-17T11:49:52.230061+0000","last_became_peered":"2023-12-17T11:49:52.230061+0000","last_unstale":"2023-12-17T11:50:00.529919+0000","last_undegraded":"2023-12-17T11:50:00.529919+0000","last_fullsized":"2023-12-17T11:50:00.529919+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_clean_scrub_stamp":"2023-12-17T11:49:51.168108+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T22:50:11.250530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-17T11:50:00.523324+0000","last_change":"2023-12-17T11:49:53.232224+0000","last_active":"2023-12-17T11:50:00.523324+0000","last_peered":"2023-12-17T11:50:00.523324+0000","last_clean":"2023-12-17T11:50:00.523324+0000","last_became_active":"2023-12-17T11:49:53.231963+0000","last_became_peered":"2023-12-17T11:49:53.231963+0000","last_unstale":"2023-12-17T11:50:00.523324+0000","last_undegraded":"2023-12-17T11:50:00.523324+0000","last_fullsized":"2023-12-17T11:50:00.523324+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T15:14:36.959400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"39'6","reported_seq":20,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-17T11:50:00.524725+0000","last_change":"2023-12-17T11:49:52.220583+0000","last_active":"2023-12-17T11:50:00.524725+0000","last_peered":"2023-12-17T11:50:00.524725+0000","last_clean":"2023-12-17T11:50:00.524725+0000","last_became_active":"2023-12-17T11:49:52.220304+0000","last_became_peered":"2023-12-17T11:49:52.220304+0000","last_unstale":"2023-12-17T11:50:00.524725+0000","last_undegraded":"2023-12-17T11:50:00.524725+0000","last_fullsized":"2023-12-17T11:50:00.524725+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_clean_scrub_stamp":"2023-12-17T11:49:51.168108+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T12:27:37.121319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-17T11:50:00.528938+0000","last_change":"2023-12-17T11:49:53.248442+0000","last_active":"2023-12-17T11:50:00.528938+0000","last_peered":"2023-12-17T11:50:00.528938+0000","last_clean":"2023-12-17T11:50:00.528938+0000","last_became_active":"2023-12-17T11:49:53.248094+0000","last_became_peered":"2023-12-17T11:49:53.248094+0000","last_unstale":"2023-12-17T11:50:00.528938+0000","last_undegraded":"2023-12-17T11:50:00.528938+0000","last_fullsized":"2023-12-17T11:50:00.528938+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T14:42:29.543380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"39'2","reported_seq":16,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-17T11:50:00.524311+0000","last_change":"2023-12-17T11:49:52.213341+0000","last_active":"2023-12-17T11:50:00.524311+0000","last_peered":"2023-12-17T11:50:00.524311+0000","last_clean":"2023-12-17T11:50:00.524311+0000","last_became_active":"2023-12-17T11:49:52.213024+0000","last_became_peered":"2023-12-17T11:49:52.213024+0000","last_unstale":"2023-12-17T11:50:00.524311+0000","last_undegraded":"2023-12-17T11:50:00.524311+0000","last_fullsized":"2023-12-17T11:50:00.524311+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_clean_scrub_stamp":"2023-12-17T11:49:51.168108+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T20:34:24.431589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-17T11:50:00.522731+0000","last_change":"2023-12-17T11:49:53.238931+0000","last_active":"2023-12-17T11:50:00.522731+0000","last_peered":"2023-12-17T11:50:00.522731+0000","last_clean":"2023-12-17T11:50:00.522731+0000","last_became_active":"2023-12-17T11:49:53.238641+0000","last_became_peered":"2023-12-17T11:49:53.238641+0000","last_unstale":"2023-12-17T11:50:00.522731+0000","last_undegraded":"2023-12-17T11:50:00.522731+0000","last_fullsized":"2023-12-17T11:50:00.522731+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T13:29:29.953615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-17T11:50:00.523343+0000","last_change":"2023-12-17T11:49:52.232507+0000","last_active":"2023-12-17T11:50:00.523343+0000","last_peered":"2023-12-17T11:50:00.523343+0000","last_clean":"2023-12-17T11:50:00.523343+0000","last_became_active":"2023-12-17T11:49:52.232308+0000","last_became_peered":"2023-12-17T11:49:52.232308+0000","last_unstale":"2023-12-17T11:50:00.523343+0000","last_undegraded":"2023-12-17T11:50:00.523343+0000","last_fullsized":"2023-12-17T11:50:00.523343+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_clean_scrub_stamp":"2023-12-17T11:49:51.168108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T19:17:46.282779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:55.795434+0000","last_change":"2023-12-17T11:49:53.234701+0000","last_active":"2023-12-17T11:49:55.795434+0000","last_peered":"2023-12-17T11:49:55.795434+0000","last_clean":"2023-12-17T11:49:55.795434+0000","last_became_active":"2023-12-17T11:49:53.234389+0000","last_became_peered":"2023-12-17T11:49:53.234389+0000","last_unstale":"2023-12-17T11:49:55.795434+0000","last_undegraded":"2023-12-17T11:49:55.795434+0000","last_fullsized":"2023-12-17T11:49:55.795434+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T17:54:34.803705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-17T11:50:01.202070+0000","last_change":"2023-12-17T11:49:52.226465+0000","last_active":"2023-12-17T11:50:01.202070+0000","last_peered":"2023-12-17T11:50:01.202070+0000","last_clean":"2023-12-17T11:50:01.202070+0000","last_became_active":"2023-12-17T11:49:52.226191+0000","last_became_peered":"2023-12-17T11:49:52.226191+0000","last_unstale":"2023-12-17T11:50:01.202070+0000","last_undegraded":"2023-12-17T11:50:01.202070+0000","last_fullsized":"2023-12-17T11:50:01.202070+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_clean_scrub_stamp":"2023-12-17T11:49:51.168108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T18:03:39.554935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-17T11:50:00.524016+0000","last_change":"2023-12-17T11:49:53.254934+0000","last_active":"2023-12-17T11:50:00.524016+0000","last_peered":"2023-12-17T11:50:00.524016+0000","last_clean":"2023-12-17T11:50:00.524016+0000","last_became_active":"2023-12-17T11:49:53.254632+0000","last_became_peered":"2023-12-17T11:49:53.254632+0000","last_unstale":"2023-12-17T11:50:00.524016+0000","last_undegraded":"2023-12-17T11:50:00.524016+0000","last_fullsized":"2023-12-17T11:50:00.524016+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T23:33:06.562683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"39'8","reported_seq":21,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:55.795188+0000","last_change":"2023-12-17T11:49:52.226787+0000","last_active":"2023-12-17T11:49:55.795188+0000","last_peered":"2023-12-17T11:49:55.795188+0000","last_clean":"2023-12-17T11:49:55.795188+0000","last_became_active":"2023-12-17T11:49:52.226471+0000","last_became_peered":"2023-12-17T11:49:52.226471+0000","last_unstale":"2023-12-17T11:49:55.795188+0000","last_undegraded":"2023-12-17T11:49:55.795188+0000","last_fullsized":"2023-12-17T11:49:55.795188+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_clean_scrub_stamp":"2023-12-17T11:49:51.168108+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T17:27:58.587187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-17T11:50:00.524643+0000","last_change":"2023-12-17T11:49:53.253979+0000","last_active":"2023-12-17T11:50:00.524643+0000","last_peered":"2023-12-17T11:50:00.524643+0000","last_clean":"2023-12-17T11:50:00.524643+0000","last_became_active":"2023-12-17T11:49:53.253694+0000","last_became_peered":"2023-12-17T11:49:53.253694+0000","last_unstale":"2023-12-17T11:50:00.524643+0000","last_undegraded":"2023-12-17T11:50:00.524643+0000","last_fullsized":"2023-12-17T11:50:00.524643+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T19:26:47.162716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"39'1","reported_seq":15,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-17T11:50:00.530409+0000","last_change":"2023-12-17T11:49:52.231973+0000","last_active":"2023-12-17T11:50:00.530409+0000","last_peered":"2023-12-17T11:50:00.530409+0000","last_clean":"2023-12-17T11:50:00.530409+0000","last_became_active":"2023-12-17T11:49:52.231641+0000","last_became_peered":"2023-12-17T11:49:52.231641+0000","last_unstale":"2023-12-17T11:50:00.530409+0000","last_undegraded":"2023-12-17T11:50:00.530409+0000","last_fullsized":"2023-12-17T11:50:00.530409+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_clean_scrub_stamp":"2023-12-17T11:49:51.168108+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T20:34:24.431589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-17T11:50:00.529892+0000","last_change":"2023-12-17T11:49:53.253141+0000","last_active":"2023-12-17T11:50:00.529892+0000","last_peered":"2023-12-17T11:50:00.529892+0000","last_clean":"2023-12-17T11:50:00.529892+0000","last_became_active":"2023-12-17T11:49:53.252532+0000","last_became_peered":"2023-12-17T11:49:53.252532+0000","last_unstale":"2023-12-17T11:50:00.529892+0000","last_undegraded":"2023-12-17T11:50:00.529892+0000","last_fullsized":"2023-12-17T11:50:00.529892+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T22:42:15.785143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"39'2","reported_seq":16,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-17T11:50:00.523361+0000","last_change":"2023-12-17T11:49:52.230858+0000","last_active":"2023-12-17T11:50:00.523361+0000","last_peered":"2023-12-17T11:50:00.523361+0000","last_clean":"2023-12-17T11:50:00.523361+0000","last_became_active":"2023-12-17T11:49:52.230281+0000","last_became_peered":"2023-12-17T11:49:52.230281+0000","last_unstale":"2023-12-17T11:50:00.523361+0000","last_undegraded":"2023-12-17T11:50:00.523361+0000","last_fullsized":"2023-12-17T11:50:00.523361+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_clean_scrub_stamp":"2023-12-17T11:49:51.168108+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T22:39:30.094160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-17T11:50:00.523134+0000","last_change":"2023-12-17T11:49:53.251192+0000","last_active":"2023-12-17T11:50:00.523134+0000","last_peered":"2023-12-17T11:50:00.523134+0000","last_clean":"2023-12-17T11:50:00.523134+0000","last_became_active":"2023-12-17T11:49:53.250837+0000","last_became_peered":"2023-12-17T11:49:53.250837+0000","last_unstale":"2023-12-17T11:50:00.523134+0000","last_undegraded":"2023-12-17T11:50:00.523134+0000","last_fullsized":"2023-12-17T11:50:00.523134+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T14:42:29.543380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"39'1","reported_seq":15,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-17T11:50:01.305583+0000","last_change":"2023-12-17T11:49:52.222238+0000","last_active":"2023-12-17T11:50:01.305583+0000","last_peered":"2023-12-17T11:50:01.305583+0000","last_clean":"2023-12-17T11:50:01.305583+0000","last_became_active":"2023-12-17T11:49:52.221941+0000","last_became_peered":"2023-12-17T11:49:52.221941+0000","last_unstale":"2023-12-17T11:50:01.305583+0000","last_undegraded":"2023-12-17T11:50:01.305583+0000","last_fullsized":"2023-12-17T11:50:01.305583+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_clean_scrub_stamp":"2023-12-17T11:49:51.168108+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T12:43:47.651883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-17T11:50:01.303648+0000","last_change":"2023-12-17T11:49:53.253162+0000","last_active":"2023-12-17T11:50:01.303648+0000","last_peered":"2023-12-17T11:50:01.303648+0000","last_clean":"2023-12-17T11:50:01.303648+0000","last_became_active":"2023-12-17T11:49:53.252770+0000","last_became_peered":"2023-12-17T11:49:53.252770+0000","last_unstale":"2023-12-17T11:50:01.303648+0000","last_undegraded":"2023-12-17T11:50:01.303648+0000","last_fullsized":"2023-12-17T11:50:01.303648+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T14:03:09.358474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-17T11:50:00.523470+0000","last_change":"2023-12-17T11:49:52.223776+0000","last_active":"2023-12-17T11:50:00.523470+0000","last_peered":"2023-12-17T11:50:00.523470+0000","last_clean":"2023-12-17T11:50:00.523470+0000","last_became_active":"2023-12-17T11:49:52.223571+0000","last_became_peered":"2023-12-17T11:49:52.223571+0000","last_unstale":"2023-12-17T11:50:00.523470+0000","last_undegraded":"2023-12-17T11:50:00.523470+0000","last_fullsized":"2023-12-17T11:50:00.523470+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_clean_scrub_stamp":"2023-12-17T11:49:51.168108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T22:59:00.390569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:55.795237+0000","last_change":"2023-12-17T11:49:53.232411+0000","last_active":"2023-12-17T11:49:55.795237+0000","last_peered":"2023-12-17T11:49:55.795237+0000","last_clean":"2023-12-17T11:49:55.795237+0000","last_became_active":"2023-12-17T11:49:53.232101+0000","last_became_peered":"2023-12-17T11:49:53.232101+0000","last_unstale":"2023-12-17T11:49:55.795237+0000","last_undegraded":"2023-12-17T11:49:55.795237+0000","last_fullsized":"2023-12-17T11:49:55.795237+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T11:57:59.882385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"39'2","reported_seq":16,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-17T11:50:01.305224+0000","last_change":"2023-12-17T11:49:52.210836+0000","last_active":"2023-12-17T11:50:01.305224+0000","last_peered":"2023-12-17T11:50:01.305224+0000","last_clean":"2023-12-17T11:50:01.305224+0000","last_became_active":"2023-12-17T11:49:52.210521+0000","last_became_peered":"2023-12-17T11:49:52.210521+0000","last_unstale":"2023-12-17T11:50:01.305224+0000","last_undegraded":"2023-12-17T11:50:01.305224+0000","last_fullsized":"2023-12-17T11:50:01.305224+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_clean_scrub_stamp":"2023-12-17T11:49:51.168108+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T17:20:36.726376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-17T11:50:00.528978+0000","last_change":"2023-12-17T11:49:53.243230+0000","last_active":"2023-12-17T11:50:00.528978+0000","last_peered":"2023-12-17T11:50:00.528978+0000","last_clean":"2023-12-17T11:50:00.528978+0000","last_became_active":"2023-12-17T11:49:53.242951+0000","last_became_peered":"2023-12-17T11:49:53.242951+0000","last_unstale":"2023-12-17T11:50:00.528978+0000","last_undegraded":"2023-12-17T11:50:00.528978+0000","last_fullsized":"2023-12-17T11:50:00.528978+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T18:42:00.093282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-17T11:50:01.304976+0000","last_change":"2023-12-17T11:49:52.217136+0000","last_active":"2023-12-17T11:50:01.304976+0000","last_peered":"2023-12-17T11:50:01.304976+0000","last_clean":"2023-12-17T11:50:01.304976+0000","last_became_active":"2023-12-17T11:49:52.216921+0000","last_became_peered":"2023-12-17T11:49:52.216921+0000","last_unstale":"2023-12-17T11:50:01.304976+0000","last_undegraded":"2023-12-17T11:50:01.304976+0000","last_fullsized":"2023-12-17T11:50:01.304976+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_clean_scrub_stamp":"2023-12-17T11:49:51.168108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T19:32:12.805680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-17T11:50:00.530083+0000","last_change":"2023-12-17T11:49:53.255643+0000","last_active":"2023-12-17T11:50:00.530083+0000","last_peered":"2023-12-17T11:50:00.530083+0000","last_clean":"2023-12-17T11:50:00.530083+0000","last_became_active":"2023-12-17T11:49:53.255379+0000","last_became_peered":"2023-12-17T11:49:53.255379+0000","last_unstale":"2023-12-17T11:50:00.530083+0000","last_undegraded":"2023-12-17T11:50:00.530083+0000","last_fullsized":"2023-12-17T11:50:00.530083+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T16:21:14.355302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:55.795394+0000","last_change":"2023-12-17T11:49:52.229883+0000","last_active":"2023-12-17T11:49:55.795394+0000","last_peered":"2023-12-17T11:49:55.795394+0000","last_clean":"2023-12-17T11:49:55.795394+0000","last_became_active":"2023-12-17T11:49:52.229372+0000","last_became_peered":"2023-12-17T11:49:52.229372+0000","last_unstale":"2023-12-17T11:49:55.795394+0000","last_undegraded":"2023-12-17T11:49:55.795394+0000","last_fullsized":"2023-12-17T11:49:55.795394+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_clean_scrub_stamp":"2023-12-17T11:49:51.168108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T23:27:59.830582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-17T11:50:00.524144+0000","last_change":"2023-12-17T11:49:53.249227+0000","last_active":"2023-12-17T11:50:00.524144+0000","last_peered":"2023-12-17T11:50:00.524144+0000","last_clean":"2023-12-17T11:50:00.524144+0000","last_became_active":"2023-12-17T11:49:53.248594+0000","last_became_peered":"2023-12-17T11:49:53.248594+0000","last_unstale":"2023-12-17T11:50:00.524144+0000","last_undegraded":"2023-12-17T11:50:00.524144+0000","last_fullsized":"2023-12-17T11:50:00.524144+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T14:31:17.752657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-17T11:50:01.304582+0000","last_change":"2023-12-17T11:49:52.211707+0000","last_active":"2023-12-17T11:50:01.304582+0000","last_peered":"2023-12-17T11:50:01.304582+0000","last_clean":"2023-12-17T11:50:01.304582+0000","last_became_active":"2023-12-17T11:49:52.211283+0000","last_became_peered":"2023-12-17T11:49:52.211283+0000","last_unstale":"2023-12-17T11:50:01.304582+0000","last_undegraded":"2023-12-17T11:50:01.304582+0000","last_fullsized":"2023-12-17T11:50:01.304582+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_clean_scrub_stamp":"2023-12-17T11:49:51.168108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T12:54:05.203029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-17T11:50:00.523128+0000","last_change":"2023-12-17T11:49:53.255235+0000","last_active":"2023-12-17T11:50:00.523128+0000","last_peered":"2023-12-17T11:50:00.523128+0000","last_clean":"2023-12-17T11:50:00.523128+0000","last_became_active":"2023-12-17T11:49:53.254570+0000","last_became_peered":"2023-12-17T11:49:53.254570+0000","last_unstale":"2023-12-17T11:50:00.523128+0000","last_undegraded":"2023-12-17T11:50:00.523128+0000","last_fullsized":"2023-12-17T11:50:00.523128+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T15:14:36.959400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"39'2","reported_seq":16,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-17T11:50:00.530828+0000","last_change":"2023-12-17T11:49:52.229686+0000","last_active":"2023-12-17T11:50:00.530828+0000","last_peered":"2023-12-17T11:50:00.530828+0000","last_clean":"2023-12-17T11:50:00.530828+0000","last_became_active":"2023-12-17T11:49:52.229401+0000","last_became_peered":"2023-12-17T11:49:52.229401+0000","last_unstale":"2023-12-17T11:50:00.530828+0000","last_undegraded":"2023-12-17T11:50:00.530828+0000","last_fullsized":"2023-12-17T11:50:00.530828+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_clean_scrub_stamp":"2023-12-17T11:49:51.168108+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T17:03:59.637357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:55.795716+0000","last_change":"2023-12-17T11:49:53.236908+0000","last_active":"2023-12-17T11:49:55.795716+0000","last_peered":"2023-12-17T11:49:55.795716+0000","last_clean":"2023-12-17T11:49:55.795716+0000","last_became_active":"2023-12-17T11:49:53.236508+0000","last_became_peered":"2023-12-17T11:49:53.236508+0000","last_unstale":"2023-12-17T11:49:55.795716+0000","last_undegraded":"2023-12-17T11:49:55.795716+0000","last_fullsized":"2023-12-17T11:49:55.795716+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T13:59:52.939825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"40'1","reported_seq":15,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-17T11:50:01.305637+0000","last_change":"2023-12-17T11:49:52.229067+0000","last_active":"2023-12-17T11:50:01.305637+0000","last_peered":"2023-12-17T11:50:01.305637+0000","last_clean":"2023-12-17T11:50:01.305637+0000","last_became_active":"2023-12-17T11:49:52.228704+0000","last_became_peered":"2023-12-17T11:49:52.228704+0000","last_unstale":"2023-12-17T11:50:01.305637+0000","last_undegraded":"2023-12-17T11:50:01.305637+0000","last_fullsized":"2023-12-17T11:50:01.305637+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_clean_scrub_stamp":"2023-12-17T11:49:51.168108+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T16:31:06.129915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-17T11:50:00.524876+0000","last_change":"2023-12-17T11:49:53.246415+0000","last_active":"2023-12-17T11:50:00.524876+0000","last_peered":"2023-12-17T11:50:00.524876+0000","last_clean":"2023-12-17T11:50:00.524876+0000","last_became_active":"2023-12-17T11:49:53.246163+0000","last_became_peered":"2023-12-17T11:49:53.246163+0000","last_unstale":"2023-12-17T11:50:00.524876+0000","last_undegraded":"2023-12-17T11:50:00.524876+0000","last_fullsized":"2023-12-17T11:50:00.524876+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T17:56:09.285369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-17T11:50:00.529684+0000","last_change":"2023-12-17T11:49:52.219865+0000","last_active":"2023-12-17T11:50:00.529684+0000","last_peered":"2023-12-17T11:50:00.529684+0000","last_clean":"2023-12-17T11:50:00.529684+0000","last_became_active":"2023-12-17T11:49:52.219593+0000","last_became_peered":"2023-12-17T11:49:52.219593+0000","last_unstale":"2023-12-17T11:50:00.529684+0000","last_undegraded":"2023-12-17T11:50:00.529684+0000","last_fullsized":"2023-12-17T11:50:00.529684+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_clean_scrub_stamp":"2023-12-17T11:49:51.168108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T15:14:35.947970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-17T11:50:00.529332+0000","last_change":"2023-12-17T11:49:53.242876+0000","last_active":"2023-12-17T11:50:00.529332+0000","last_peered":"2023-12-17T11:50:00.529332+0000","last_clean":"2023-12-17T11:50:00.529332+0000","last_became_active":"2023-12-17T11:49:53.242568+0000","last_became_peered":"2023-12-17T11:49:53.242568+0000","last_unstale":"2023-12-17T11:50:00.529332+0000","last_undegraded":"2023-12-17T11:50:00.529332+0000","last_fullsized":"2023-12-17T11:50:00.529332+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T23:10:56.100255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-17T11:50:00.529639+0000","last_change":"2023-12-17T11:49:52.223424+0000","last_active":"2023-12-17T11:50:00.529639+0000","last_peered":"2023-12-17T11:50:00.529639+0000","last_clean":"2023-12-17T11:50:00.529639+0000","last_became_active":"2023-12-17T11:49:52.223126+0000","last_became_peered":"2023-12-17T11:49:52.223126+0000","last_unstale":"2023-12-17T11:50:00.529639+0000","last_undegraded":"2023-12-17T11:50:00.529639+0000","last_fullsized":"2023-12-17T11:50:00.529639+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_clean_scrub_stamp":"2023-12-17T11:49:51.168108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T14:31:59.450792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-17T11:50:00.523009+0000","last_change":"2023-12-17T11:49:53.251516+0000","last_active":"2023-12-17T11:50:00.523009+0000","last_peered":"2023-12-17T11:50:00.523009+0000","last_clean":"2023-12-17T11:50:00.523009+0000","last_became_active":"2023-12-17T11:49:53.251230+0000","last_became_peered":"2023-12-17T11:49:53.251230+0000","last_unstale":"2023-12-17T11:50:00.523009+0000","last_undegraded":"2023-12-17T11:50:00.523009+0000","last_fullsized":"2023-12-17T11:50:00.523009+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T19:39:18.340154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-17T11:50:01.202294+0000","last_change":"2023-12-17T11:49:52.219807+0000","last_active":"2023-12-17T11:50:01.202294+0000","last_peered":"2023-12-17T11:50:01.202294+0000","last_clean":"2023-12-17T11:50:01.202294+0000","last_became_active":"2023-12-17T11:49:52.219503+0000","last_became_peered":"2023-12-17T11:49:52.219503+0000","last_unstale":"2023-12-17T11:50:01.202294+0000","last_undegraded":"2023-12-17T11:50:01.202294+0000","last_fullsized":"2023-12-17T11:50:01.202294+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_clean_scrub_stamp":"2023-12-17T11:49:51.168108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T18:07:09.094032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-17T11:50:00.522740+0000","last_change":"2023-12-17T11:49:53.241750+0000","last_active":"2023-12-17T11:50:00.522740+0000","last_peered":"2023-12-17T11:50:00.522740+0000","last_clean":"2023-12-17T11:50:00.522740+0000","last_became_active":"2023-12-17T11:49:53.241529+0000","last_became_peered":"2023-12-17T11:49:53.241529+0000","last_unstale":"2023-12-17T11:50:00.522740+0000","last_undegraded":"2023-12-17T11:50:00.522740+0000","last_fullsized":"2023-12-17T11:50:00.522740+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T16:31:53.964205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-17T11:50:00.522300+0000","last_change":"2023-12-17T11:49:52.216579+0000","last_active":"2023-12-17T11:50:00.522300+0000","last_peered":"2023-12-17T11:50:00.522300+0000","last_clean":"2023-12-17T11:50:00.522300+0000","last_became_active":"2023-12-17T11:49:52.216265+0000","last_became_peered":"2023-12-17T11:49:52.216265+0000","last_unstale":"2023-12-17T11:50:00.522300+0000","last_undegraded":"2023-12-17T11:50:00.522300+0000","last_fullsized":"2023-12-17T11:50:00.522300+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_clean_scrub_stamp":"2023-12-17T11:49:51.168108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T14:31:59.450792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:55.795525+0000","last_change":"2023-12-17T11:49:53.234303+0000","last_active":"2023-12-17T11:49:55.795525+0000","last_peered":"2023-12-17T11:49:55.795525+0000","last_clean":"2023-12-17T11:49:55.795525+0000","last_became_active":"2023-12-17T11:49:53.233951+0000","last_became_peered":"2023-12-17T11:49:53.233951+0000","last_unstale":"2023-12-17T11:49:55.795525+0000","last_undegraded":"2023-12-17T11:49:55.795525+0000","last_fullsized":"2023-12-17T11:49:55.795525+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T19:17:38.569694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-17T11:50:00.522523+0000","last_change":"2023-12-17T11:49:52.219957+0000","last_active":"2023-12-17T11:50:00.522523+0000","last_peered":"2023-12-17T11:50:00.522523+0000","last_clean":"2023-12-17T11:50:00.522523+0000","last_became_active":"2023-12-17T11:49:52.219626+0000","last_became_peered":"2023-12-17T11:49:52.219626+0000","last_unstale":"2023-12-17T11:50:00.522523+0000","last_undegraded":"2023-12-17T11:50:00.522523+0000","last_fullsized":"2023-12-17T11:50:00.522523+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_clean_scrub_stamp":"2023-12-17T11:49:51.168108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T19:12:11.016281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-17T11:50:00.530565+0000","last_change":"2023-12-17T11:49:53.253151+0000","last_active":"2023-12-17T11:50:00.530565+0000","last_peered":"2023-12-17T11:50:00.530565+0000","last_clean":"2023-12-17T11:50:00.530565+0000","last_became_active":"2023-12-17T11:49:53.252842+0000","last_became_peered":"2023-12-17T11:49:53.252842+0000","last_unstale":"2023-12-17T11:50:00.530565+0000","last_undegraded":"2023-12-17T11:50:00.530565+0000","last_fullsized":"2023-12-17T11:50:00.530565+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:52.179538+0000","last_clean_scrub_stamp":"2023-12-17T11:49:52.179538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T14:31:17.752657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-17T11:49:55.795609+0000","last_change":"2023-12-17T11:49:52.228110+0000","last_active":"2023-12-17T11:49:55.795609+0000","last_peered":"2023-12-17T11:49:55.795609+0000","last_clean":"2023-12-17T11:49:55.795609+0000","last_became_active":"2023-12-17T11:49:52.227851+0000","last_became_peered":"2023-12-17T11:49:52.227851+0000","last_unstale":"2023-12-17T11:49:55.795609+0000","last_undegraded":"2023-12-17T11:49:55.795609+0000","last_fullsized":"2023-12-17T11:49:55.795609+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:49:51.168108+0000","last_clean_scrub_stamp":"2023-12-17T11:49:51.168108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T18:37:20.380970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":182,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-12-17T11:50:01.541219+0000","last_change":"2023-12-17T11:48:07.952584+0000","last_active":"2023-12-17T11:50:01.541219+0000","last_peered":"2023-12-17T11:50:01.541219+0000","last_clean":"2023-12-17T11:50:01.541219+0000","last_became_active":"2023-12-17T11:48:07.950361+0000","last_became_peered":"2023-12-17T11:48:07.950361+0000","last_unstale":"2023-12-17T11:50:01.541219+0000","last_undegraded":"2023-12-17T11:50:01.541219+0000","last_fullsized":"2023-12-17T11:50:01.541219+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:48:06.728199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:48:06.728199+0000","last_clean_scrub_stamp":"2023-12-17T11:48:06.728199+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T12:47:55.048065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542173,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28088,"kb_used_data":1068,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343752,"statfs":{"total":96636764160,"available":96608002048,"internally_reserved":0,"allocated":1093632,"data_stored":802179,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 17 11:50:08 2023","interfaces":[{"interface":"back","average":{"1min":1.139,"5min":1.353,"15min":1.389},"min":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":1.4450000000000001,"5min":8.6579999999999995,"15min":8.6579999999999995},"last":0.872},{"interface":"front","average":{"1min":1.2649999999999999,"5min":1.3240000000000001,"15min":1.3340000000000001},"min":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"max":{"1min":1.597,"5min":4.0830000000000002,"15min":4.0830000000000002},"last":0.77900000000000003}]},{"osd":1,"last update":"Sun Dec 17 11:50:08 2023","interfaces":[{"interface":"back","average":{"1min":1.117,"5min":1.125,"15min":1.1259999999999999},"min":{"1min":0.71599999999999997,"5min":0.66800000000000004,"15min":0.66800000000000004},"max":{"1min":1.6850000000000001,"5min":2.1539999999999999,"15min":2.1539999999999999},"last":0.71599999999999997},{"interface":"front","average":{"1min":1.1000000000000001,"5min":1.3500000000000001,"15min":1.3919999999999999},"min":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"max":{"1min":1.569,"5min":8.7449999999999992,"15min":8.7449999999999992},"last":1.1359999999999999}]},{"osd":2,"last update":"Sun Dec 17 11:50:08 2023","interfaces":[{"interface":"back","average":{"1min":1.1479999999999999,"5min":1.373,"15min":1.411},"min":{"1min":0.73799999999999999,"5min":0.70099999999999996,"15min":0.70099999999999996},"max":{"1min":1.548,"5min":4.1239999999999997,"15min":4.1239999999999997},"last":1.349},{"interface":"front","average":{"1min":1.2490000000000001,"5min":1.347,"15min":1.363},"min":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"max":{"1min":1.7150000000000001,"5min":1.782,"15min":1.782},"last":1.3049999999999999}]},{"osd":3,"last update":"Sun Dec 17 11:50:08 2023","interfaces":[{"interface":"back","average":{"1min":1.218,"5min":1.282,"15min":1.292},"min":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"max":{"1min":1.556,"5min":2.5430000000000001,"15min":2.5430000000000001},"last":0.97299999999999998},{"interface":"front","average":{"1min":1.327,"5min":1.365,"15min":1.371},"min":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"max":{"1min":1.7,"5min":2.5830000000000002,"15min":2.5830000000000002},"last":0.83199999999999996}]},{"osd":4,"last update":"Sun Dec 17 11:50:08 2023","interfaces":[{"interface":"back","average":{"1min":1.28,"5min":1.3640000000000001,"15min":1.3779999999999999},"min":{"1min":0.88800000000000001,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":1.6699999999999999,"5min":4.0309999999999997,"15min":4.0309999999999997},"last":1.204},{"interface":"front","average":{"1min":1.4730000000000001,"5min":1.5629999999999999,"15min":1.5780000000000001},"min":{"1min":1.04,"5min":1.04,"15min":1.04},"max":{"1min":1.8120000000000001,"5min":3.3220000000000001,"15min":3.3220000000000001},"last":1.776}]},{"osd":5,"last update":"Sun Dec 17 11:50:08 2023","interfaces":[{"interface":"back","average":{"1min":1.298,"5min":1.617,"15min":1.6699999999999999},"min":{"1min":0.999,"5min":0.95899999999999996,"15min":0.95899999999999996},"max":{"1min":1.6890000000000001,"5min":8.7929999999999993,"15min":8.7929999999999993},"last":1.2549999999999999},{"interface":"front","average":{"1min":1.468,"5min":1.6419999999999999,"15min":1.671},"min":{"1min":0.96799999999999997,"5min":0.82399999999999995,"15min":0.82399999999999995},"max":{"1min":1.786,"5min":5.1040000000000001,"15min":5.1040000000000001},"last":1.5309999999999999}]},{"osd":6,"last update":"Sun Dec 17 11:50:08 2023","interfaces":[{"interface":"back","average":{"1min":1.425,"5min":1.7609999999999999,"15min":1.8169999999999999},"min":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":0.99399999999999999},"max":{"1min":1.833,"5min":8.8330000000000002,"15min":8.8330000000000002},"last":1.833},{"interface":"front","average":{"1min":1.5660000000000001,"5min":1.681,"15min":1.7},"min":{"1min":1.163,"5min":0.97799999999999998,"15min":0.97799999999999998},"max":{"1min":1.7330000000000001,"5min":3.9590000000000001,"15min":3.9590000000000001},"last":1.647}]}]},{"osd":6,"up_from":14,"seq":60129542173,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27500,"kb_used_data":476,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344340,"statfs":{"total":96636764160,"available":96608604160,"internally_reserved":0,"allocated":487424,"data_stored":210711,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 17 11:50:09 2023","interfaces":[{"interface":"back","average":{"1min":0.997,"5min":1.0569999999999999,"15min":1.0669999999999999},"min":{"1min":0.64200000000000002,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.4039999999999999,"5min":1.5840000000000001,"15min":1.5840000000000001},"last":0.71099999999999997},{"interface":"front","average":{"1min":1.024,"5min":0.96799999999999997,"15min":0.95899999999999996},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.8400000000000001,"5min":1.8400000000000001,"15min":1.8400000000000001},"last":0.91900000000000004}]},{"osd":1,"last update":"Sun Dec 17 11:50:09 2023","interfaces":[{"interface":"back","average":{"1min":1.1719999999999999,"5min":1.2490000000000001,"15min":1.262},"min":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"max":{"1min":1.5189999999999999,"5min":1.5640000000000001,"15min":1.5640000000000001},"last":0.76900000000000002},{"interface":"front","average":{"1min":1.1639999999999999,"5min":1.286,"15min":1.306},"min":{"1min":0.76500000000000001,"5min":0.73399999999999999,"15min":0.73399999999999999},"max":{"1min":1.7809999999999999,"5min":1.9359999999999999,"15min":1.9359999999999999},"last":1.099}]},{"osd":2,"last update":"Sun Dec 17 11:50:09 2023","interfaces":[{"interface":"back","average":{"1min":1.1479999999999999,"5min":1.1870000000000001,"15min":1.1930000000000001},"min":{"1min":0.85999999999999999,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":1.6930000000000001,"5min":1.8740000000000001,"15min":1.8740000000000001},"last":1.0620000000000001},{"interface":"front","average":{"1min":1.149,"5min":1.266,"15min":1.286},"min":{"1min":0.77100000000000002,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":1.5249999999999999,"5min":2.5470000000000002,"15min":2.5470000000000002},"last":1.407}]},{"osd":3,"last update":"Sun Dec 17 11:50:09 2023","interfaces":[{"interface":"back","average":{"1min":1.3680000000000001,"5min":1.48,"15min":1.498},"min":{"1min":0.997,"5min":0.997,"15min":0.997},"max":{"1min":1.9590000000000001,"5min":2.4689999999999999,"15min":2.4689999999999999},"last":1.49},{"interface":"front","average":{"1min":1.2010000000000001,"5min":1.391,"15min":1.423},"min":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"max":{"1min":1.542,"5min":2.0680000000000001,"15min":2.0680000000000001},"last":1.3089999999999999}]},{"osd":4,"last update":"Sun Dec 17 11:50:09 2023","interfaces":[{"interface":"back","average":{"1min":1.4119999999999999,"5min":1.5,"15min":1.514},"min":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"max":{"1min":2.0219999999999998,"5min":2.222,"15min":2.222},"last":1.51},{"interface":"front","average":{"1min":1.4490000000000001,"5min":1.4430000000000001,"15min":1.4419999999999999},"min":{"1min":1.151,"5min":0.90700000000000003,"15min":0.90700000000000003},"max":{"1min":2.129,"5min":2.4079999999999999,"15min":2.4079999999999999},"last":1.151}]},{"osd":5,"last update":"Sun Dec 17 11:50:09 2023","interfaces":[{"interface":"back","average":{"1min":1.474,"5min":1.5329999999999999,"15min":1.5429999999999999},"min":{"1min":1.0449999999999999,"5min":0.85499999999999998,"15min":0.85499999999999998},"max":{"1min":1.9179999999999999,"5min":2.3319999999999999,"15min":2.3319999999999999},"last":1.4590000000000001},{"interface":"front","average":{"1min":1.496,"5min":1.5600000000000001,"15min":1.5700000000000001},"min":{"1min":1.036,"5min":0.77700000000000002,"15min":0.77700000000000002},"max":{"1min":2.7519999999999998,"5min":2.7519999999999998,"15min":2.7519999999999998},"last":1.5529999999999999}]},{"osd":7,"last update":"Sun Dec 17 11:50:09 2023","interfaces":[{"interface":"back","average":{"1min":1.335,"5min":1.4019999999999999,"15min":1.413},"min":{"1min":1.022,"5min":0.91300000000000003,"15min":0.91300000000000003},"max":{"1min":1.6080000000000001,"5min":2.1560000000000001,"15min":2.1560000000000001},"last":1.2509999999999999},{"interface":"front","average":{"1min":1.6619999999999999,"5min":1.702,"15min":1.708},"min":{"1min":1.3029999999999999,"5min":0.95799999999999996,"15min":0.95799999999999996},"max":{"1min":2.8620000000000001,"5min":2.8620000000000001,"15min":2.8620000000000001},"last":1.605}]}]},{"osd":5,"up_from":14,"seq":60129542172,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27500,"kb_used_data":480,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344340,"statfs":{"total":96636764160,"available":96608604160,"internally_reserved":0,"allocated":491520,"data_stored":210241,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 17 11:50:09 2023","interfaces":[{"interface":"back","average":{"1min":1.0289999999999999,"5min":1.0860000000000001,"15min":1.0960000000000001},"min":{"1min":0.68400000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":1.3560000000000001,"5min":1.5860000000000001,"15min":1.5860000000000001},"last":1.1100000000000001},{"interface":"front","average":{"1min":1.085,"5min":1.2010000000000001,"15min":1.22},"min":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"max":{"1min":1.6020000000000001,"5min":1.9419999999999999,"15min":1.9419999999999999},"last":1.5029999999999999}]},{"osd":1,"last update":"Sun Dec 17 11:50:09 2023","interfaces":[{"interface":"back","average":{"1min":1.1779999999999999,"5min":1.169,"15min":1.167},"min":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"max":{"1min":1.722,"5min":1.722,"15min":1.722},"last":1.464},{"interface":"front","average":{"1min":1.171,"5min":1.2070000000000001,"15min":1.2130000000000001},"min":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"max":{"1min":1.587,"5min":1.8660000000000001,"15min":1.8660000000000001},"last":1.2789999999999999}]},{"osd":2,"last update":"Sun Dec 17 11:50:09 2023","interfaces":[{"interface":"back","average":{"1min":1.157,"5min":1.282,"15min":1.3029999999999999},"min":{"1min":0.751,"5min":0.747,"15min":0.747},"max":{"1min":1.7589999999999999,"5min":2.1589999999999998,"15min":2.1589999999999998},"last":1.3420000000000001},{"interface":"front","average":{"1min":1.2809999999999999,"5min":1.369,"15min":1.3839999999999999},"min":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":1.6639999999999999,"5min":2.1379999999999999,"15min":2.1379999999999999},"last":1.5349999999999999}]},{"osd":3,"last update":"Sun Dec 17 11:50:09 2023","interfaces":[{"interface":"back","average":{"1min":1.3109999999999999,"5min":1.331,"15min":1.335},"min":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"max":{"1min":1.73,"5min":2.593,"15min":2.593},"last":1.226},{"interface":"front","average":{"1min":1.27,"5min":1.379,"15min":1.397},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.8009999999999999,"5min":2.3079999999999998,"15min":2.3079999999999998},"last":1.3140000000000001}]},{"osd":4,"last update":"Sun Dec 17 11:50:09 2023","interfaces":[{"interface":"back","average":{"1min":1.2609999999999999,"5min":1.454,"15min":1.486},"min":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":1.7130000000000001,"5min":2.5299999999999998,"15min":2.5299999999999998},"last":1.3799999999999999},{"interface":"front","average":{"1min":1.351,"5min":1.6200000000000001,"15min":1.665},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.839,"5min":3.9569999999999999,"15min":3.9569999999999999},"last":1.421}]},{"osd":6,"last update":"Sun Dec 17 11:50:09 2023","interfaces":[{"interface":"back","average":{"1min":1.431,"5min":1.615,"15min":1.6459999999999999},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.984,"5min":2.9849999999999999,"15min":2.9849999999999999},"last":1.5980000000000001},{"interface":"front","average":{"1min":1.4179999999999999,"5min":1.589,"15min":1.617},"min":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"max":{"1min":1.998,"5min":2.641,"15min":2.641},"last":1.1910000000000001}]},{"osd":7,"last update":"Sun Dec 17 11:50:09 2023","interfaces":[{"interface":"back","average":{"1min":1.53,"5min":1.752,"15min":1.7889999999999999},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":2.0529999999999999,"5min":3.8570000000000002,"15min":3.8570000000000002},"last":1.0469999999999999},{"interface":"front","average":{"1min":1.5549999999999999,"5min":1.772,"15min":1.8080000000000001},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.9239999999999999,"5min":2.8999999999999999,"15min":2.8999999999999999},"last":1.155}]}]},{"osd":4,"up_from":14,"seq":60129542173,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27500,"kb_used_data":480,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344340,"statfs":{"total":96636764160,"available":96608604160,"internally_reserved":0,"allocated":491520,"data_stored":210733,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 17 11:50:09 2023","interfaces":[{"interface":"back","average":{"1min":1.0620000000000001,"5min":1.028,"15min":1.022},"min":{"1min":0.627,"5min":0.627,"15min":0.627},"max":{"1min":1.78,"5min":1.78,"15min":1.78},"last":1.143},{"interface":"front","average":{"1min":1.137,"5min":1.161,"15min":1.165},"min":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"max":{"1min":1.623,"5min":2.6400000000000001,"15min":2.6400000000000001},"last":1.5009999999999999}]},{"osd":1,"last update":"Sun Dec 17 11:50:09 2023","interfaces":[{"interface":"back","average":{"1min":1.177,"5min":1.1120000000000001,"15min":1.101},"min":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"max":{"1min":1.4990000000000001,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":1.0980000000000001},{"interface":"front","average":{"1min":1.2749999999999999,"5min":1.268,"15min":1.2669999999999999},"min":{"1min":0.88600000000000001,"5min":0.78900000000000003,"15min":0.78900000000000003},"max":{"1min":1.704,"5min":1.704,"15min":1.704},"last":1.3029999999999999}]},{"osd":2,"last update":"Sun Dec 17 11:50:09 2023","interfaces":[{"interface":"back","average":{"1min":1.2010000000000001,"5min":1.3540000000000001,"15min":1.3799999999999999},"min":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"max":{"1min":1.6020000000000001,"5min":1.8660000000000001,"15min":1.8660000000000001},"last":1.2649999999999999},{"interface":"front","average":{"1min":1.27,"5min":1.3169999999999999,"15min":1.325},"min":{"1min":0.82299999999999995,"5min":0.80700000000000005,"15min":0.80700000000000005},"max":{"1min":1.8069999999999999,"5min":1.968,"15min":1.968},"last":1.419}]},{"osd":3,"last update":"Sun Dec 17 11:50:09 2023","interfaces":[{"interface":"back","average":{"1min":1.1679999999999999,"5min":1.3859999999999999,"15min":1.4219999999999999},"min":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"max":{"1min":1.468,"5min":3.2290000000000001,"15min":3.2290000000000001},"last":1.6060000000000001},{"interface":"front","average":{"1min":1.379,"5min":1.472,"15min":1.488},"min":{"1min":1.111,"5min":1.1000000000000001,"15min":1.1000000000000001},"max":{"1min":1.7270000000000001,"5min":2.0169999999999999,"15min":2.0169999999999999},"last":1.464}]},{"osd":5,"last update":"Sun Dec 17 11:50:09 2023","interfaces":[{"interface":"back","average":{"1min":1.3740000000000001,"5min":1.454,"15min":1.4670000000000001},"min":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"max":{"1min":1.8660000000000001,"5min":2.141,"15min":2.141},"last":1.5589999999999999},{"interface":"front","average":{"1min":1.351,"5min":1.639,"15min":1.6870000000000001},"min":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"max":{"1min":1.887,"5min":3.8220000000000001,"15min":3.8220000000000001},"last":1.3580000000000001}]},{"osd":6,"last update":"Sun Dec 17 11:50:09 2023","interfaces":[{"interface":"back","average":{"1min":1.431,"5min":1.675,"15min":1.716},"min":{"1min":1.0680000000000001,"5min":1.0680000000000001,"15min":1.0680000000000001},"max":{"1min":1.708,"5min":2.7410000000000001,"15min":2.7410000000000001},"last":1.6499999999999999},{"interface":"front","average":{"1min":1.55,"5min":1.651,"15min":1.6679999999999999},"min":{"1min":1.0640000000000001,"5min":1.0640000000000001,"15min":1.0640000000000001},"max":{"1min":1.923,"5min":2.2989999999999999,"15min":2.2989999999999999},"last":1.6819999999999999}]},{"osd":7,"last update":"Sun Dec 17 11:50:09 2023","interfaces":[{"interface":"back","average":{"1min":1.4510000000000001,"5min":1.7669999999999999,"15min":1.8200000000000001},"min":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"max":{"1min":2.0590000000000002,"5min":3.944,"15min":3.944},"last":1.7549999999999999},{"interface":"front","average":{"1min":1.625,"5min":1.7769999999999999,"15min":1.8029999999999999},"min":{"1min":1.2529999999999999,"5min":1.2529999999999999,"15min":1.2529999999999999},"max":{"1min":1.944,"5min":2.8809999999999998,"15min":2.8809999999999998},"last":1.72}]}]},{"osd":3,"up_from":14,"seq":60129542172,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27508,"kb_used_data":488,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344332,"statfs":{"total":96636764160,"available":96608595968,"internally_reserved":0,"allocated":499712,"data_stored":211775,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 17 11:50:09 2023","interfaces":[{"interface":"back","average":{"1min":0.83399999999999996,"5min":0.879,"15min":0.88700000000000001},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":1.431,"5min":1.6459999999999999,"15min":1.6459999999999999},"last":1.0609999999999999},{"interface":"front","average":{"1min":0.84699999999999998,"5min":1.0249999999999999,"15min":1.0549999999999999},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.6559999999999999,"5min":3.5800000000000001,"15min":3.5800000000000001},"last":0.78700000000000003}]},{"osd":1,"last update":"Sun Dec 17 11:50:09 2023","interfaces":[{"interface":"back","average":{"1min":0.95299999999999996,"5min":0.91700000000000004,"15min":0.91100000000000003},"min":{"1min":0.38400000000000001,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":2.3079999999999998,"5min":2.3079999999999998,"15min":2.3079999999999998},"last":1.534},{"interface":"front","average":{"1min":1.0309999999999999,"5min":1.127,"15min":1.143},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":2.0249999999999999,"5min":2.085,"15min":2.085},"last":1.2170000000000001}]},{"osd":2,"last update":"Sun Dec 17 11:50:09 2023","interfaces":[{"interface":"back","average":{"1min":1.218,"5min":1.1759999999999999,"15min":1.169},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.79,"5min":1.79,"15min":1.79},"last":1.379},{"interface":"front","average":{"1min":1.1539999999999999,"5min":1.236,"15min":1.25},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.7629999999999999,"5min":2.1429999999999998,"15min":2.1429999999999998},"last":1.429}]},{"osd":4,"last update":"Sun Dec 17 11:50:09 2023","interfaces":[{"interface":"back","average":{"1min":1.244,"5min":1.395,"15min":1.4199999999999999},"min":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":1.8879999999999999,"5min":2.4870000000000001,"15min":2.4870000000000001},"last":1.8879999999999999},{"interface":"front","average":{"1min":1.3400000000000001,"5min":1.448,"15min":1.466},"min":{"1min":0.878,"5min":0.878,"15min":0.878},"max":{"1min":2.2130000000000001,"5min":2.3460000000000001,"15min":2.3460000000000001},"last":1.6100000000000001}]},{"osd":5,"last update":"Sun Dec 17 11:50:09 2023","interfaces":[{"interface":"back","average":{"1min":1.415,"5min":1.4630000000000001,"15min":1.4710000000000001},"min":{"1min":0.89000000000000001,"5min":0.80100000000000005,"15min":0.80100000000000005},"max":{"1min":2.452,"5min":2.5710000000000002,"15min":2.5710000000000002},"last":1.4930000000000001},{"interface":"front","average":{"1min":1.3080000000000001,"5min":1.4610000000000001,"15min":1.4870000000000001},"min":{"1min":0.76100000000000001,"5min":0.69099999999999995,"15min":0.69099999999999995},"max":{"1min":1.782,"5min":2.383,"15min":2.383},"last":1.782}]},{"osd":6,"last update":"Sun Dec 17 11:50:09 2023","interfaces":[{"interface":"back","average":{"1min":1.272,"5min":1.4330000000000001,"15min":1.46},"min":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"max":{"1min":2.1280000000000001,"5min":2.6179999999999999,"15min":2.6179999999999999},"last":1.7310000000000001},{"interface":"front","average":{"1min":1.468,"5min":1.5049999999999999,"15min":1.5109999999999999},"min":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"max":{"1min":2.6240000000000001,"5min":2.7679999999999998,"15min":2.7679999999999998},"last":1.5720000000000001}]},{"osd":7,"last update":"Sun Dec 17 11:50:09 2023","interfaces":[{"interface":"back","average":{"1min":1.3959999999999999,"5min":1.544,"15min":1.5680000000000001},"min":{"1min":0.78700000000000003,"5min":0.73899999999999999,"15min":0.73899999999999999},"max":{"1min":1.9790000000000001,"5min":3.7000000000000002,"15min":3.7000000000000002},"last":1.9790000000000001},{"interface":"front","average":{"1min":1.4610000000000001,"5min":1.5549999999999999,"15min":1.571},"min":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"max":{"1min":2.2250000000000001,"5min":2.427,"15min":2.427},"last":1.659}]}]},{"osd":2,"up_from":14,"seq":60129542173,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27500,"kb_used_data":476,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344340,"statfs":{"total":96636764160,"available":96608604160,"internally_reserved":0,"allocated":487424,"data_stored":210199,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 17 11:50:07 2023","interfaces":[{"interface":"back","average":{"1min":0.88400000000000001,"5min":0.91300000000000003,"15min":0.91800000000000004},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":1.659,"5min":1.724,"15min":1.724},"last":0.40300000000000002},{"interface":"front","average":{"1min":1.0289999999999999,"5min":0.94199999999999995,"15min":0.92800000000000005},"min":{"1min":0.52900000000000003,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.7729999999999999,"5min":1.7729999999999999,"15min":1.7729999999999999},"last":0.47099999999999997}]},{"osd":1,"last update":"Sun Dec 17 11:50:07 2023","interfaces":[{"interface":"back","average":{"1min":0.97899999999999998,"5min":0.99099999999999999,"15min":0.99299999999999999},"min":{"1min":0.51400000000000001,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.575,"5min":1.575,"15min":1.575},"last":0.53900000000000003},{"interface":"front","average":{"1min":1.0349999999999999,"5min":1.0509999999999999,"15min":1.054},"min":{"1min":0.5,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.6459999999999999,"5min":2.6280000000000001,"15min":2.6280000000000001},"last":0.59299999999999997}]},{"osd":3,"last update":"Sun Dec 17 11:50:07 2023","interfaces":[{"interface":"back","average":{"1min":0.93000000000000005,"5min":0.92600000000000005,"15min":0.92500000000000004},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.4510000000000001,"5min":1.476,"15min":1.476},"last":0.57199999999999995},{"interface":"front","average":{"1min":1.0660000000000001,"5min":1.1839999999999999,"15min":1.204},"min":{"1min":0.59399999999999997,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.6659999999999999,"5min":1.9670000000000001,"15min":1.9670000000000001},"last":0.61799999999999999}]},{"osd":4,"last update":"Sun Dec 17 11:50:07 2023","interfaces":[{"interface":"back","average":{"1min":1.226,"5min":1.4370000000000001,"15min":1.472},"min":{"1min":0.90000000000000002,"5min":0.79600000000000004,"15min":0.79600000000000004},"max":{"1min":1.9019999999999999,"5min":2.5750000000000002,"15min":2.5750000000000002},"last":1.032},{"interface":"front","average":{"1min":1.296,"5min":1.369,"15min":1.381},"min":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"max":{"1min":1.5800000000000001,"5min":2.4940000000000002,"15min":2.4940000000000002},"last":1.286}]},{"osd":5,"last update":"Sun Dec 17 11:50:07 2023","interfaces":[{"interface":"back","average":{"1min":1.208,"5min":1.3,"15min":1.3160000000000001},"min":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"max":{"1min":1.5880000000000001,"5min":2.4289999999999998,"15min":2.4289999999999998},"last":0.95799999999999996},{"interface":"front","average":{"1min":1.371,"5min":1.5129999999999999,"15min":1.5369999999999999},"min":{"1min":0.96799999999999997,"5min":0.78600000000000003,"15min":0.78600000000000003},"max":{"1min":2.2589999999999999,"5min":2.694,"15min":2.694},"last":1.2270000000000001}]},{"osd":6,"last update":"Sun Dec 17 11:50:07 2023","interfaces":[{"interface":"back","average":{"1min":1.258,"5min":1.429,"15min":1.4570000000000001},"min":{"1min":0.78500000000000003,"5min":0.748,"15min":0.748},"max":{"1min":1.7010000000000001,"5min":2.7349999999999999,"15min":2.7349999999999999},"last":0.97599999999999998},{"interface":"front","average":{"1min":1.4039999999999999,"5min":1.4099999999999999,"15min":1.411},"min":{"1min":0.97799999999999998,"5min":0.81000000000000005,"15min":0.81000000000000005},"max":{"1min":2.0859999999999999,"5min":2.468,"15min":2.468},"last":0.89200000000000002}]},{"osd":7,"last update":"Sun Dec 17 11:50:07 2023","interfaces":[{"interface":"back","average":{"1min":1.3979999999999999,"5min":1.522,"15min":1.5429999999999999},"min":{"1min":0.84399999999999997,"5min":0.78700000000000003,"15min":0.78700000000000003},"max":{"1min":1.958,"5min":3.379,"15min":3.379},"last":1.1020000000000001},{"interface":"front","average":{"1min":1.413,"5min":1.4610000000000001,"15min":1.4690000000000001},"min":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"max":{"1min":1.984,"5min":2.2869999999999999,"15min":2.2869999999999999},"last":0.70399999999999996}]}]},{"osd":1,"up_from":14,"seq":60129542172,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27496,"kb_used_data":476,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344344,"statfs":{"total":96636764160,"available":96608608256,"internally_reserved":0,"allocated":487424,"data_stored":210219,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 17 11:50:08 2023","interfaces":[{"interface":"back","average":{"1min":0.91200000000000003,"5min":0.98399999999999999,"15min":0.996},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.5660000000000001,"5min":1.5660000000000001,"15min":1.5660000000000001},"last":1.3919999999999999},{"interface":"front","average":{"1min":1.0129999999999999,"5min":1.093,"15min":1.1060000000000001},"min":{"1min":0.46999999999999997,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.956,"5min":2.6360000000000001,"15min":2.6360000000000001},"last":0.79900000000000004}]},{"osd":2,"last update":"Sun Dec 17 11:50:08 2023","interfaces":[{"interface":"back","average":{"1min":0.88800000000000001,"5min":1.139,"15min":1.181},"min":{"1min":0.47499999999999998,"5min":0.438,"15min":0.438},"max":{"1min":2.0880000000000001,"5min":2.8159999999999998,"15min":2.8159999999999998},"last":0.73399999999999999},{"interface":"front","average":{"1min":1.0029999999999999,"5min":1.3700000000000001,"15min":1.431},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":1.6180000000000001,"5min":3.101,"15min":3.101},"last":1.042}]},{"osd":3,"last update":"Sun Dec 17 11:50:08 2023","interfaces":[{"interface":"back","average":{"1min":1.1719999999999999,"5min":1.4179999999999999,"15min":1.4590000000000001},"min":{"1min":0.65200000000000002,"5min":0.497,"15min":0.497},"max":{"1min":2.3330000000000002,"5min":2.7890000000000001,"15min":2.7890000000000001},"last":2.1379999999999999},{"interface":"front","average":{"1min":1.113,"5min":1.2450000000000001,"15min":1.2669999999999999},"min":{"1min":0.53700000000000003,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.6719999999999999,"5min":3.1400000000000001,"15min":3.1400000000000001},"last":0.61899999999999999}]},{"osd":4,"last update":"Sun Dec 17 11:50:08 2023","interfaces":[{"interface":"back","average":{"1min":1.3540000000000001,"5min":1.4179999999999999,"15min":1.429},"min":{"1min":0.90300000000000002,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.8440000000000001,"5min":2.5289999999999999,"15min":2.5289999999999999},"last":0.92900000000000005},{"interface":"front","average":{"1min":1.2849999999999999,"5min":1.347,"15min":1.357},"min":{"1min":0.83699999999999997,"5min":0.627,"15min":0.627},"max":{"1min":1.9119999999999999,"5min":2.0819999999999999,"15min":2.0819999999999999},"last":1.0920000000000001}]},{"osd":5,"last update":"Sun Dec 17 11:50:08 2023","interfaces":[{"interface":"back","average":{"1min":1.2849999999999999,"5min":1.429,"15min":1.4530000000000001},"min":{"1min":0.85499999999999998,"5min":0.81699999999999995,"15min":0.81699999999999995},"max":{"1min":1.962,"5min":1.962,"15min":1.962},"last":0.97699999999999998},{"interface":"front","average":{"1min":1.3879999999999999,"5min":1.536,"15min":1.5600000000000001},"min":{"1min":0.86099999999999999,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":1.8500000000000001,"5min":2.6739999999999999,"15min":2.6739999999999999},"last":1.526}]},{"osd":6,"last update":"Sun Dec 17 11:50:08 2023","interfaces":[{"interface":"back","average":{"1min":1.482,"5min":1.5980000000000001,"15min":1.617},"min":{"1min":1.077,"5min":0.754,"15min":0.754},"max":{"1min":2.0179999999999998,"5min":3.016,"15min":3.016},"last":1.78},{"interface":"front","average":{"1min":1.431,"5min":1.5269999999999999,"15min":1.5429999999999999},"min":{"1min":1.0329999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"max":{"1min":2.0289999999999999,"5min":2.508,"15min":2.508},"last":1.431}]},{"osd":7,"last update":"Sun Dec 17 11:50:08 2023","interfaces":[{"interface":"back","average":{"1min":1.5089999999999999,"5min":1.649,"15min":1.6719999999999999},"min":{"1min":0.96499999999999997,"5min":0.72799999999999998,"15min":0.72799999999999998},"max":{"1min":2.262,"5min":2.944,"15min":2.944},"last":1.8360000000000001},{"interface":"front","average":{"1min":1.5389999999999999,"5min":1.681,"15min":1.7050000000000001},"min":{"1min":1.069,"5min":0.66900000000000004,"15min":0.66900000000000004},"max":{"1min":2.02,"5min":2.7709999999999999,"15min":2.7709999999999999},"last":1.593}]}]},{"osd":0,"up_from":14,"seq":60129542172,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32240,"kb_used_data":1056,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339600,"statfs":{"total":96636764160,"available":96603750400,"internally_reserved":0,"allocated":1081344,"data_stored":800531,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Dec 17 11:50:10 2023","interfaces":[{"interface":"back","average":{"1min":0.83699999999999997,"5min":0.89200000000000002,"15min":0.90100000000000002},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.345,"5min":1.3899999999999999,"15min":1.3899999999999999},"last":0.995},{"interface":"front","average":{"1min":0.95099999999999996,"5min":1.111,"15min":1.1379999999999999},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.659,"5min":1.958,"15min":1.958},"last":1.264}]},{"osd":2,"last update":"Sun Dec 17 11:50:10 2023","interfaces":[{"interface":"back","average":{"1min":0.86099999999999999,"5min":1.0029999999999999,"15min":1.0269999999999999},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.3919999999999999,"5min":1.7709999999999999,"15min":1.7709999999999999},"last":0.86399999999999999},{"interface":"front","average":{"1min":0.88300000000000001,"5min":1.143,"15min":1.1870000000000001},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.573,"5min":2.2130000000000001,"15min":2.2130000000000001},"last":1.0489999999999999}]},{"osd":3,"last update":"Sun Dec 17 11:50:10 2023","interfaces":[{"interface":"back","average":{"1min":0.81000000000000005,"5min":1.0620000000000001,"15min":1.1040000000000001},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":1.383,"5min":1.728,"15min":1.728},"last":1.147},{"interface":"front","average":{"1min":0.98199999999999998,"5min":1.319,"15min":1.375},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":1.641,"5min":2.4809999999999999,"15min":2.4809999999999999},"last":1.117}]},{"osd":4,"last update":"Sun Dec 17 11:50:10 2023","interfaces":[{"interface":"back","average":{"1min":1.2050000000000001,"5min":1.4550000000000001,"15min":1.4970000000000001},"min":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"max":{"1min":1.6359999999999999,"5min":4.6710000000000003,"15min":4.6710000000000003},"last":1.4159999999999999},{"interface":"front","average":{"1min":1.1479999999999999,"5min":1.371,"15min":1.4079999999999999},"min":{"1min":0.628,"5min":0.628,"15min":0.628},"max":{"1min":1.556,"5min":2.2799999999999998,"15min":2.2799999999999998},"last":1.466}]},{"osd":5,"last update":"Sun Dec 17 11:50:10 2023","interfaces":[{"interface":"back","average":{"1min":1.23,"5min":1.4510000000000001,"15min":1.488},"min":{"1min":0.78500000000000003,"5min":0.68999999999999995,"15min":0.68999999999999995},"max":{"1min":1.6679999999999999,"5min":2.1349999999999998,"15min":2.1349999999999998},"last":1.643},{"interface":"front","average":{"1min":1.321,"5min":1.5629999999999999,"15min":1.603},"min":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"max":{"1min":1.7789999999999999,"5min":2.6080000000000001,"15min":2.6080000000000001},"last":1.355}]},{"osd":6,"last update":"Sun Dec 17 11:50:10 2023","interfaces":[{"interface":"back","average":{"1min":1.262,"5min":1.516,"15min":1.5580000000000001},"min":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"max":{"1min":1.954,"5min":2.702,"15min":2.702},"last":1.2190000000000001},{"interface":"front","average":{"1min":1.333,"5min":1.4930000000000001,"15min":1.52},"min":{"1min":0.754,"5min":0.754,"15min":0.754},"max":{"1min":1.7829999999999999,"5min":2.3100000000000001,"15min":2.3100000000000001},"last":1.601}]},{"osd":7,"last update":"Sun Dec 17 11:50:10 2023","interfaces":[{"interface":"back","average":{"1min":1.363,"5min":1.5609999999999999,"15min":1.5940000000000001},"min":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"max":{"1min":1.8680000000000001,"5min":2.3420000000000001,"15min":2.3420000000000001},"last":1.532},{"interface":"front","average":{"1min":1.2929999999999999,"5min":1.52,"15min":1.5580000000000001},"min":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"max":{"1min":1.766,"5min":2.4359999999999999,"15min":2.4359999999999999},"last":1.754}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-17T11:50:13.541 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-12-17T11:50:13.541 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-12-17T11:50:13.822 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:13.820+0000 7f390b167640 1 Processor -- start 2023-12-17T11:50:13.822 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:13.820+0000 7f390b167640 1 -- start start 2023-12-17T11:50:13.823 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:13.821+0000 7f390b167640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f390415d210 0x7f39040d3680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:50:13.823 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:13.821+0000 7f390b167640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f39040d3bc0 0x7f39040d1550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:50:13.823 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:13.821+0000 7f390b167640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39040cdb80 con 0x7f390415d5f0 2023-12-17T11:50:13.824 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:13.821+0000 7f390b167640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39040b48e0 con 0x7f390415d210 2023-12-17T11:50:13.824 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:13.821+0000 7f390b167640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39040cddb0 con 0x7f39040d3bc0 2023-12-17T11:50:13.824 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:13.822+0000 7f390a165640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f390415d210 0x7f39040d3680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:50:13.824 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:13.822+0000 7f390a966640 1 --1- >> v1:172.21.15.159:6789/0 conn(0x7f390415d5f0 0x7f3904160fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.159:6789/0 says I am v1:172.21.15.40:43730/0 (socket says 172.21.15.40:43730) 2023-12-17T11:50:13.825 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:13.822+0000 7f390a966640 1 -- 172.21.15.40:0/3981504835 learned_addr learned my addr 172.21.15.40:0/3981504835 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-12-17T11:50:13.825 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:13.822+0000 7f3909964640 1 --2- 172.21.15.40:0/3981504835 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f39040d3bc0 0x7f39040d1550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:50:13.825 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:13.823+0000 7f390a165640 1 -- 172.21.15.40:0/3981504835 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f39040d3bc0 msgr2=0x7f39040d1550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:50:13.825 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:13.823+0000 7f390a165640 1 --2- 172.21.15.40:0/3981504835 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f39040d3bc0 0x7f39040d1550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:50:13.825 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:13.823+0000 7f390a165640 1 -- 172.21.15.40:0/3981504835 >> v1:172.21.15.159:6789/0 conn(0x7f390415d5f0 legacy=0x7f3904160fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:50:13.825 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:13.823+0000 7f390a165640 1 -- 172.21.15.40:0/3981504835 --> v2:172.21.15.159:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39040ce050 con 0x7f390415d210 2023-12-17T11:50:13.826 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:13.825+0000 7f390a165640 1 --2- 172.21.15.40:0/3981504835 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f390415d210 0x7f39040d3680 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f38f8009d90 tx=0x7f38f802bea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fbdf6e8a242aa808 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:50:13.827 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:13.825+0000 7f3909163640 1 -- 172.21.15.40:0/3981504835 <== mon.1 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38f802cc50 con 0x7f390415d210 2023-12-17T11:50:13.827 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:13.825+0000 7f3909163640 1 -- 172.21.15.40:0/3981504835 <== mon.1 v2:172.21.15.159:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38f802cdb0 con 0x7f390415d210 2023-12-17T11:50:13.827 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:13.825+0000 7f3909163640 1 -- 172.21.15.40:0/3981504835 <== mon.1 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38f8034660 con 0x7f390415d210 2023-12-17T11:50:13.828 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:13.826+0000 7f390b167640 1 -- 172.21.15.40:0/3981504835 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f390415d210 msgr2=0x7f39040d3680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:50:13.828 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:13.826+0000 7f390b167640 1 --2- 172.21.15.40:0/3981504835 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f390415d210 0x7f39040d3680 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f38f8009d90 tx=0x7f38f802bea0 comp rx=0 tx=0).stop 2023-12-17T11:50:13.829 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:13.826+0000 7f390b167640 1 -- 172.21.15.40:0/3981504835 shutdown_connections 2023-12-17T11:50:13.829 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:13.826+0000 7f390b167640 1 --2- 172.21.15.40:0/3981504835 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f39040d3bc0 0x7f39040d1550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:50:13.829 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:13.826+0000 7f390b167640 1 --2- 172.21.15.40:0/3981504835 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f390415d210 0x7f39040d3680 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:50:13.829 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:13.826+0000 7f390b167640 1 -- 172.21.15.40:0/3981504835 >> 172.21.15.40:0/3981504835 conn(0x7f390409c250 msgr2=0x7f39040d2f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:50:13.829 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:13.826+0000 7f390b167640 1 -- 172.21.15.40:0/3981504835 shutdown_connections 2023-12-17T11:50:13.829 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:13.826+0000 7f390b167640 1 -- 172.21.15.40:0/3981504835 wait complete. 2023-12-17T11:50:13.830 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:13.828+0000 7f390b167640 1 Processor -- start 2023-12-17T11:50:13.830 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:13.828+0000 7f390b167640 1 -- start start 2023-12-17T11:50:13.831 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:13.829+0000 7f390b167640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f39040d3bc0 0x7f390414bbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:50:13.832 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:13.829+0000 7f390b167640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f390415d210 0x7f390414b320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:50:13.832 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:13.829+0000 7f390b167640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f390415d5f0 0x7f390415fc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:50:13.832 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:13.829+0000 7f390b167640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3904158880 con 0x7f39040d3bc0 2023-12-17T11:50:13.832 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:13.829+0000 7f390b167640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3904157c90 con 0x7f390415d5f0 2023-12-17T11:50:13.832 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:13.829+0000 7f390b167640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f390414c0f0 con 0x7f390415d210 2023-12-17T11:50:13.832 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:13.829+0000 7f390a165640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f39040d3bc0 0x7f390414bbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:50:13.832 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:13.830+0000 7f390a165640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f39040d3bc0 0x7f390414bbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:40778/0 (socket says 172.21.15.40:40778) 2023-12-17T11:50:13.832 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:13.830+0000 7f390a165640 1 -- 172.21.15.40:0/101248504 learned_addr learned my addr 172.21.15.40:0/101248504 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-17T11:50:13.832 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:13.830+0000 7f3909964640 1 --2- 172.21.15.40:0/101248504 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f390415d210 0x7f390414b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:50:13.832 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:13.830+0000 7f390a966640 1 --2- 172.21.15.40:0/101248504 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f390415d5f0 0x7f390415fc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:50:13.833 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:13.830+0000 7f390a165640 1 -- 172.21.15.40:0/101248504 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f390415d210 msgr2=0x7f390414b320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:50:13.833 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:13.830+0000 7f390a165640 1 --2- 172.21.15.40:0/101248504 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f390415d210 0x7f390414b320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:50:13.833 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:13.830+0000 7f390a165640 1 -- 172.21.15.40:0/101248504 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f390415d5f0 msgr2=0x7f390415fc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:50:13.833 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:13.830+0000 7f390a165640 1 --2- 172.21.15.40:0/101248504 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f390415d5f0 0x7f390415fc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:50:13.833 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:13.830+0000 7f390a165640 1 -- 172.21.15.40:0/101248504 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38f8009a70 con 0x7f39040d3bc0 2023-12-17T11:50:13.834 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:13.830+0000 7f390a966640 1 --2- 172.21.15.40:0/101248504 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f390415d5f0 0x7f390415fc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-17T11:50:13.834 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:13.830+0000 7f390a165640 1 --2- 172.21.15.40:0/101248504 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f39040d3bc0 0x7f390414bbb0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f38f8009eb0 tx=0x7f38f8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:50:13.834 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:13.831+0000 7f3902ffd640 1 -- 172.21.15.40:0/101248504 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38f803f420 con 0x7f39040d3bc0 2023-12-17T11:50:13.834 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:13.831+0000 7f3902ffd640 1 -- 172.21.15.40:0/101248504 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38f803f580 con 0x7f39040d3bc0 2023-12-17T11:50:13.834 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:13.831+0000 7f3902ffd640 1 -- 172.21.15.40:0/101248504 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38f803f930 con 0x7f39040d3bc0 2023-12-17T11:50:13.834 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:13.831+0000 7f390b167640 1 -- 172.21.15.40:0/101248504 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3904157ee0 con 0x7f39040d3bc0 2023-12-17T11:50:13.834 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:13.831+0000 7f390b167640 1 -- 172.21.15.40:0/101248504 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39041584a0 con 0x7f39040d3bc0 2023-12-17T11:50:13.835 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:13.832+0000 7f390b167640 1 -- 172.21.15.40:0/101248504 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3904066d20 con 0x7f39040d3bc0 2023-12-17T11:50:13.835 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:13.833+0000 7f3902ffd640 1 -- 172.21.15.40:0/101248504 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f38f803fa90 con 0x7f39040d3bc0 2023-12-17T11:50:13.837 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:13.835+0000 7f3902ffd640 1 --2- 172.21.15.40:0/101248504 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f38e806ae70 0x7f38e806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:50:13.837 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:13.835+0000 7f3902ffd640 1 -- 172.21.15.40:0/101248504 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f38f80abfe0 con 0x7f39040d3bc0 2023-12-17T11:50:13.837 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:13.835+0000 7f3909964640 1 --2- 172.21.15.40:0/101248504 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f38e806ae70 0x7f38e806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:50:13.838 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:13.837+0000 7f3909964640 1 --2- 172.21.15.40:0/101248504 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f38e806ae70 0x7f38e806d330 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f39040c9530 tx=0x7f38f0008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:50:13.841 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:13.840+0000 7f3902ffd640 1 -- 172.21.15.40:0/101248504 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f38f8076eb0 con 0x7f39040d3bc0 2023-12-17T11:50:14.109 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:14.107+0000 7f390b167640 1 -- 172.21.15.40:0/101248504 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f3904074450 con 0x7f39040d3bc0 2023-12-17T11:50:14.113 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:14.111+0000 7f3902ffd640 1 -- 172.21.15.40:0/101248504 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v9) v1 ==== 190+0+147 (secure 0 0 0) 0x7f38f80430b0 con 0x7f39040d3bc0 2023-12-17T11:50:14.113 INFO:teuthology.orchestra.run.smithi040.stdout:[client.0] 2023-12-17T11:50:14.114 INFO:teuthology.orchestra.run.smithi040.stdout: key = AQDA335l6XHnCxAAxjHOSjT8N5JpduZyqQ+KYw== 2023-12-17T11:50:14.114 INFO:teuthology.orchestra.run.smithi040.stdout: caps mds = "allow" 2023-12-17T11:50:14.114 INFO:teuthology.orchestra.run.smithi040.stdout: caps mon = "allow r" 2023-12-17T11:50:14.114 INFO:teuthology.orchestra.run.smithi040.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2023-12-17T11:50:14.114 INFO:teuthology.orchestra.run.smithi040.stderr:updated caps for client.0 2023-12-17T11:50:14.116 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:14.114+0000 7f390b167640 1 -- 172.21.15.40:0/101248504 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f38e806ae70 msgr2=0x7f38e806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:50:14.116 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:14.114+0000 7f390b167640 1 --2- 172.21.15.40:0/101248504 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f38e806ae70 0x7f38e806d330 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f39040c9530 tx=0x7f38f0008040 comp rx=0 tx=0).stop 2023-12-17T11:50:14.116 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:14.114+0000 7f390b167640 1 -- 172.21.15.40:0/101248504 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f39040d3bc0 msgr2=0x7f390414bbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:50:14.116 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:14.114+0000 7f390b167640 1 --2- 172.21.15.40:0/101248504 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f39040d3bc0 0x7f390414bbb0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f38f8009eb0 tx=0x7f38f8004a40 comp rx=0 tx=0).stop 2023-12-17T11:50:14.116 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:14.114+0000 7f390b167640 1 -- 172.21.15.40:0/101248504 shutdown_connections 2023-12-17T11:50:14.116 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:14.114+0000 7f390b167640 1 --2- 172.21.15.40:0/101248504 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f38e806ae70 0x7f38e806d330 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:50:14.116 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:14.114+0000 7f390b167640 1 --2- 172.21.15.40:0/101248504 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f390415d5f0 0x7f390415fc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:50:14.116 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:14.114+0000 7f390b167640 1 --2- 172.21.15.40:0/101248504 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f390415d210 0x7f390414b320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:50:14.117 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:14.114+0000 7f390b167640 1 --2- 172.21.15.40:0/101248504 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f39040d3bc0 0x7f390414bbb0 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:50:14.117 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:14.114+0000 7f390b167640 1 -- 172.21.15.40:0/101248504 >> 172.21.15.40:0/101248504 conn(0x7f390409c250 msgr2=0x7f390406c7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:50:14.117 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:14.114+0000 7f390b167640 1 -- 172.21.15.40:0/101248504 shutdown_connections 2023-12-17T11:50:14.117 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:14.114+0000 7f390b167640 1 -- 172.21.15.40:0/101248504 wait complete. 2023-12-17T11:50:14.134 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-17T11:50:14.360 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:14.358+0000 7fd826b89640 1 Processor -- start 2023-12-17T11:50:14.361 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:14.358+0000 7fd826b89640 1 -- start start 2023-12-17T11:50:14.363 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:14.360+0000 7fd826b89640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd820072180 0x7fd8200b4750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:50:14.363 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:14.360+0000 7fd826b89640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fd82006c410 0x7fd82015ecb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:50:14.363 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:14.361+0000 7fd826b89640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8200b3bb0 con 0x7fd820143e00 2023-12-17T11:50:14.363 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:14.361+0000 7fd826b89640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8201441e0 con 0x7fd82006c410 2023-12-17T11:50:14.363 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:14.361+0000 7fd826b89640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd820072680 con 0x7fd820072180 2023-12-17T11:50:14.363 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:14.361+0000 7fd825126640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fd82006c410 0x7fd82015ecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:50:14.363 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:14.361+0000 7fd825126640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fd82006c410 0x7fd82015ecb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:40784/0 (socket says 172.21.15.40:40784) 2023-12-17T11:50:14.363 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:14.361+0000 7fd825126640 1 -- 172.21.15.40:0/605517275 learned_addr learned my addr 172.21.15.40:0/605517275 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-17T11:50:14.364 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:14.361+0000 7fd81ffff640 1 --2- 172.21.15.40:0/605517275 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd820072180 0x7fd8200b4750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:50:14.364 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:14.361+0000 7fd825126640 1 -- 172.21.15.40:0/605517275 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd820072180 msgr2=0x7fd8200b4750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:50:14.364 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:14.361+0000 7fd825126640 1 --2- 172.21.15.40:0/605517275 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd820072180 0x7fd8200b4750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:50:14.364 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:14.361+0000 7fd825126640 1 -- 172.21.15.40:0/605517275 >> v1:172.21.15.159:6789/0 conn(0x7fd820143e00 legacy=0x7fd8200b4040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:50:14.364 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:14.362+0000 7fd825126640 1 -- 172.21.15.40:0/605517275 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8200b1e30 con 0x7fd82006c410 2023-12-17T11:50:14.364 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:14.362+0000 7fd81ffff640 1 --2- 172.21.15.40:0/605517275 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd820072180 0x7fd8200b4750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-17T11:50:14.365 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:14.363+0000 7fd825126640 1 --2- 172.21.15.40:0/605517275 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd82006c410 0x7fd82015ecb0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7fd818009e50 tx=0x7fd81802bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a0b90b252643c00 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:50:14.365 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:14.363+0000 7fd81f7fe640 1 -- 172.21.15.40:0/605517275 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd81802ca80 con 0x7fd82006c410 2023-12-17T11:50:14.365 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:14.363+0000 7fd81f7fe640 1 -- 172.21.15.40:0/605517275 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd81802cbe0 con 0x7fd82006c410 2023-12-17T11:50:14.365 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:14.363+0000 7fd81f7fe640 1 -- 172.21.15.40:0/605517275 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8180343f0 con 0x7fd82006c410 2023-12-17T11:50:14.366 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:14.364+0000 7fd826b89640 1 -- 172.21.15.40:0/605517275 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd82006c410 msgr2=0x7fd82015ecb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:50:14.366 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:14.364+0000 7fd826b89640 1 --2- 172.21.15.40:0/605517275 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd82006c410 0x7fd82015ecb0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7fd818009e50 tx=0x7fd81802bee0 comp rx=0 tx=0).stop 2023-12-17T11:50:14.366 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:14.364+0000 7fd826b89640 1 -- 172.21.15.40:0/605517275 shutdown_connections 2023-12-17T11:50:14.366 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:14.364+0000 7fd826b89640 1 --2- 172.21.15.40:0/605517275 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd82006c410 0x7fd82015ecb0 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:50:14.366 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:14.364+0000 7fd826b89640 1 --2- 172.21.15.40:0/605517275 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd820072180 0x7fd8200b4750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:50:14.367 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:14.364+0000 7fd826b89640 1 -- 172.21.15.40:0/605517275 >> 172.21.15.40:0/605517275 conn(0x7fd8200b0a90 msgr2=0x7fd8200b0e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:50:14.367 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:14.364+0000 7fd826b89640 1 -- 172.21.15.40:0/605517275 shutdown_connections 2023-12-17T11:50:14.367 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:14.364+0000 7fd826b89640 1 -- 172.21.15.40:0/605517275 wait complete. 2023-12-17T11:50:14.368 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:14.366+0000 7fd826b89640 1 Processor -- start 2023-12-17T11:50:14.368 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:14.366+0000 7fd826b89640 1 -- start start 2023-12-17T11:50:14.370 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:14.367+0000 7fd826b89640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd82006c410 0x7fd82015a9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:50:14.370 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:14.367+0000 7fd826b89640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd820072180 0x7fd820142380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:50:14.370 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:14.367+0000 7fd826b89640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd820143e00 0x7fd8201403f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:50:14.370 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:14.367+0000 7fd826b89640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd820142cd0 con 0x7fd820072180 2023-12-17T11:50:14.370 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:14.367+0000 7fd826b89640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd820142fb0 con 0x7fd82006c410 2023-12-17T11:50:14.370 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:14.367+0000 7fd826b89640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8201399c0 con 0x7fd820143e00 2023-12-17T11:50:14.370 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:14.367+0000 7fd81ffff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd820072180 0x7fd820142380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:50:14.370 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:14.367+0000 7fd81ffff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd820072180 0x7fd820142380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:40790/0 (socket says 172.21.15.40:40790) 2023-12-17T11:50:14.370 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:14.367+0000 7fd81ffff640 1 -- 172.21.15.40:0/3692656606 learned_addr learned my addr 172.21.15.40:0/3692656606 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-17T11:50:14.370 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:14.368+0000 7fd824925640 1 --2- 172.21.15.40:0/3692656606 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd82006c410 0x7fd82015a9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:50:14.370 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:14.368+0000 7fd825126640 1 --2- 172.21.15.40:0/3692656606 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd820143e00 0x7fd8201403f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:50:14.371 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:14.368+0000 7fd81ffff640 1 -- 172.21.15.40:0/3692656606 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd820143e00 msgr2=0x7fd8201403f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:50:14.371 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:14.368+0000 7fd81ffff640 1 --2- 172.21.15.40:0/3692656606 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd820143e00 0x7fd8201403f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:50:14.371 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:14.368+0000 7fd81ffff640 1 -- 172.21.15.40:0/3692656606 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd82006c410 msgr2=0x7fd82015a9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:50:14.372 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:14.368+0000 7fd81ffff640 1 --2- 172.21.15.40:0/3692656606 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd82006c410 0x7fd82015a9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:50:14.372 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:14.368+0000 7fd81ffff640 1 -- 172.21.15.40:0/3692656606 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd818009b30 con 0x7fd820072180 2023-12-17T11:50:14.373 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:14.368+0000 7fd825126640 1 --2- 172.21.15.40:0/3692656606 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd820143e00 0x7fd8201403f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-17T11:50:14.373 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:14.368+0000 7fd81ffff640 1 --2- 172.21.15.40:0/3692656606 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd820072180 0x7fd820142380 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7fd80c00c7f0 tx=0x7fd80c00cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:50:14.374 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:14.368+0000 7fd81d7fa640 1 -- 172.21.15.40:0/3692656606 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd80c007a30 con 0x7fd820072180 2023-12-17T11:50:14.374 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:14.368+0000 7fd81d7fa640 1 -- 172.21.15.40:0/3692656606 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd80c007b90 con 0x7fd820072180 2023-12-17T11:50:14.374 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:14.368+0000 7fd826b89640 1 -- 172.21.15.40:0/3692656606 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd820139ca0 con 0x7fd820072180 2023-12-17T11:50:14.374 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:14.369+0000 7fd81d7fa640 1 -- 172.21.15.40:0/3692656606 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd80c00ce40 con 0x7fd820072180 2023-12-17T11:50:14.374 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:14.369+0000 7fd826b89640 1 -- 172.21.15.40:0/3692656606 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd82015af00 con 0x7fd820072180 2023-12-17T11:50:14.374 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:14.370+0000 7fd826b89640 1 -- 172.21.15.40:0/3692656606 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd82013a1c0 con 0x7fd820072180 2023-12-17T11:50:14.374 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:14.371+0000 7fd81d7fa640 1 -- 172.21.15.40:0/3692656606 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fd80c0113f0 con 0x7fd820072180 2023-12-17T11:50:14.374 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:14.372+0000 7fd81d7fa640 1 --2- 172.21.15.40:0/3692656606 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7fd80406ae40 0x7fd80406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:50:14.374 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:14.372+0000 7fd81d7fa640 1 -- 172.21.15.40:0/3692656606 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fd80c089a70 con 0x7fd820072180 2023-12-17T11:50:14.375 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:14.372+0000 7fd824925640 1 --2- 172.21.15.40:0/3692656606 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7fd80406ae40 0x7fd80406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:50:14.376 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:14.374+0000 7fd824925640 1 --2- 172.21.15.40:0/3692656606 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7fd80406ae40 0x7fd80406d300 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fd814006fd0 tx=0x7fd814008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:50:14.378 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:14.376+0000 7fd81d7fa640 1 -- 172.21.15.40:0/3692656606 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fd82013a1c0 con 0x7fd820072180 2023-12-17T11:50:14.619 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:14.617+0000 7fd826b89640 1 -- 172.21.15.40:0/3692656606 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd82013a1c0 con 0x7fd820072180 2023-12-17T11:50:14.620 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:14.618+0000 7fd81d7fa640 1 -- 172.21.15.40:0/3692656606 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) v1 ==== 94+0+4919 (secure 0 0 0) 0x7fd82013a1c0 con 0x7fd820072180 2023-12-17T11:50:14.620 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T11:50:14.621 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":15,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4667,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6836/2267902252","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6834","nonce":2267902252},{"type":"v1","addr":"172.21.15.159:6836","nonce":2267902252}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":4870,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/1074257695","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":1074257695},{"type":"v1","addr":"172.21.15.40:6835","nonce":1074257695}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":5286,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6833/1416509151","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6832","nonce":1416509151},{"type":"v1","addr":"172.21.15.40:6833","nonce":1416509151}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-17T11:49:52.674879+0000","modified":"2023-12-17T11:49:55.755837+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5304},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5304":{"gid":5304,"name":"d","rank":0,"incarnation":12,"state":"up:active","state_seq":4,"addr":"172.21.15.159:6837/2606646075","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6835","nonce":2606646075},{"type":"v1","addr":"172.21.15.159:6837","nonce":2606646075}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-12-17T11:50:14.621 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 15 2023-12-17T11:50:14.624 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:14.621+0000 7fd826b89640 1 -- 172.21.15.40:0/3692656606 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7fd80406ae40 msgr2=0x7fd80406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:50:14.624 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:14.621+0000 7fd826b89640 1 --2- 172.21.15.40:0/3692656606 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7fd80406ae40 0x7fd80406d300 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fd814006fd0 tx=0x7fd814008040 comp rx=0 tx=0).stop 2023-12-17T11:50:14.624 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:14.621+0000 7fd826b89640 1 -- 172.21.15.40:0/3692656606 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd820072180 msgr2=0x7fd820142380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:50:14.624 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:14.621+0000 7fd826b89640 1 --2- 172.21.15.40:0/3692656606 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd820072180 0x7fd820142380 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7fd80c00c7f0 tx=0x7fd80c00cbf0 comp rx=0 tx=0).stop 2023-12-17T11:50:14.624 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:14.621+0000 7fd826b89640 1 -- 172.21.15.40:0/3692656606 shutdown_connections 2023-12-17T11:50:14.624 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:14.621+0000 7fd826b89640 1 --2- 172.21.15.40:0/3692656606 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7fd80406ae40 0x7fd80406d300 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:50:14.624 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:14.621+0000 7fd826b89640 1 --2- 172.21.15.40:0/3692656606 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fd820143e00 0x7fd8201403f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:50:14.624 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:14.621+0000 7fd826b89640 1 --2- 172.21.15.40:0/3692656606 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd820072180 0x7fd820142380 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:50:14.624 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:14.621+0000 7fd826b89640 1 --2- 172.21.15.40:0/3692656606 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd82006c410 0x7fd82015a9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:50:14.624 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:14.621+0000 7fd826b89640 1 -- 172.21.15.40:0/3692656606 >> 172.21.15.40:0/3692656606 conn(0x7fd8200b0a90 msgr2=0x7fd8200cebf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:50:14.624 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:14.622+0000 7fd826b89640 1 -- 172.21.15.40:0/3692656606 shutdown_connections 2023-12-17T11:50:14.625 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:14.622+0000 7fd826b89640 1 -- 172.21.15.40:0/3692656606 wait complete. 2023-12-17T11:50:15.046 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 15, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-12-17T11:49:52.674879+0000', 'modified': '2023-12-17T11:49:55.755837+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5304}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5304': {'gid': 5304, 'name': 'd', 'rank': 0, 'incarnation': 12, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.159:6837/2606646075', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.159:6835', 'nonce': 2606646075}, {'type': 'v1', 'addr': '172.21.15.159:6837', 'nonce': 2606646075}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [6], 'metadata_pool': 5, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-12-17T11:50:15.047 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-12-17T11:50:15.047 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2023-12-17T11:50:15.282 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:15.280+0000 7fcad6f4c640 1 Processor -- start 2023-12-17T11:50:15.282 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:15.280+0000 7fcad6f4c640 1 -- start start 2023-12-17T11:50:15.284 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:15.282+0000 7fcad6f4c640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fcad015b440 0x7fcad00ce120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:50:15.284 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:15.282+0000 7fcad6f4c640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fcad00d1b40 0x7fcad00cf000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:50:15.284 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:15.282+0000 7fcad6f4c640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcad00aec70 con 0x7fcad00cf540 2023-12-17T11:50:15.284 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:15.282+0000 7fcad6f4c640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcad00cf9f0 con 0x7fcad00d1b40 2023-12-17T11:50:15.284 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:15.282+0000 7fcad6f4c640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcad00cb9a0 con 0x7fcad015b440 2023-12-17T11:50:15.284 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:15.282+0000 7fcacffff640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fcad00d1b40 0x7fcad00cf000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:50:15.284 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:15.282+0000 7fcad54e9640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fcad00cf540 0x7fcad015ede0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:39504/0 (socket says 172.21.15.40:39504) 2023-12-17T11:50:15.284 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:15.282+0000 7fcad54e9640 1 -- 172.21.15.40:0/1884117106 learned_addr learned my addr 172.21.15.40:0/1884117106 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-12-17T11:50:15.285 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:15.282+0000 7fcad4ce8640 1 --2- 172.21.15.40:0/1884117106 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fcad015b440 0x7fcad00ce120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:50:15.285 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:15.283+0000 7fcacffff640 1 -- 172.21.15.40:0/1884117106 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fcad015b440 msgr2=0x7fcad00ce120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:50:15.285 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:15.283+0000 7fcacffff640 1 --2- 172.21.15.40:0/1884117106 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fcad015b440 0x7fcad00ce120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:50:15.285 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:15.283+0000 7fcacffff640 1 -- 172.21.15.40:0/1884117106 >> v1:172.21.15.40:6789/0 conn(0x7fcad00cf540 legacy=0x7fcad015ede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:50:15.285 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:15.283+0000 7fcacffff640 1 -- 172.21.15.40:0/1884117106 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcad00cbc40 con 0x7fcad00d1b40 2023-12-17T11:50:15.286 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:15.283+0000 7fcacf7fe640 1 -- 172.21.15.40:0/1884117106 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1417241932 0 0) 0x7fcad00aec70 con 0x7fcad00cf540 2023-12-17T11:50:15.287 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:15.284+0000 7fcacffff640 1 --2- 172.21.15.40:0/1884117106 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcad00d1b40 0x7fcad00cf000 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7fcac40097a0 tx=0x7fcac402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f60e2aea601235d0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:50:15.287 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:15.284+0000 7fcacf7fe640 1 -- 172.21.15.40:0/1884117106 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcac4031830 con 0x7fcad00d1b40 2023-12-17T11:50:15.287 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:15.284+0000 7fcacf7fe640 1 -- 172.21.15.40:0/1884117106 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcac4031990 con 0x7fcad00d1b40 2023-12-17T11:50:15.287 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:15.284+0000 7fcacf7fe640 1 -- 172.21.15.40:0/1884117106 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcac4031d20 con 0x7fcad00d1b40 2023-12-17T11:50:15.287 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:15.285+0000 7fcad6f4c640 1 -- 172.21.15.40:0/1884117106 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcad00d1b40 msgr2=0x7fcad00cf000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:50:15.287 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:15.285+0000 7fcad6f4c640 1 --2- 172.21.15.40:0/1884117106 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcad00d1b40 0x7fcad00cf000 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7fcac40097a0 tx=0x7fcac402b8d0 comp rx=0 tx=0).stop 2023-12-17T11:50:15.287 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:15.285+0000 7fcad6f4c640 1 -- 172.21.15.40:0/1884117106 shutdown_connections 2023-12-17T11:50:15.287 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:15.285+0000 7fcad6f4c640 1 --2- 172.21.15.40:0/1884117106 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcad00d1b40 0x7fcad00cf000 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:50:15.287 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:15.285+0000 7fcad6f4c640 1 --2- 172.21.15.40:0/1884117106 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fcad015b440 0x7fcad00ce120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:50:15.287 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:15.285+0000 7fcad6f4c640 1 -- 172.21.15.40:0/1884117106 >> 172.21.15.40:0/1884117106 conn(0x7fcad00d0e90 msgr2=0x7fcad00d12a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:50:15.287 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:15.285+0000 7fcad6f4c640 1 -- 172.21.15.40:0/1884117106 shutdown_connections 2023-12-17T11:50:15.287 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:15.285+0000 7fcad6f4c640 1 -- 172.21.15.40:0/1884117106 wait complete. 2023-12-17T11:50:15.288 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:15.287+0000 7fcad6f4c640 1 Processor -- start 2023-12-17T11:50:15.288 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:15.287+0000 7fcad6f4c640 1 -- start start 2023-12-17T11:50:15.290 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:15.288+0000 7fcad6f4c640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcad00cf540 0x7fcad0159110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:50:15.291 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:15.288+0000 7fcad6f4c640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fcad00d1b40 0x7fcad00b63b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:50:15.291 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:15.288+0000 7fcad6f4c640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcad015b440 0x7fcad015c900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:50:15.291 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:15.288+0000 7fcad6f4c640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcad0157480 con 0x7fcad015b440 2023-12-17T11:50:15.291 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:15.288+0000 7fcad6f4c640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcad0150910 con 0x7fcad00cf540 2023-12-17T11:50:15.291 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:15.288+0000 7fcad6f4c640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcad00b3f10 con 0x7fcad00d1b40 2023-12-17T11:50:15.291 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:15.288+0000 7fcad54e9640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcad015b440 0x7fcad015c900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:50:15.291 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:15.288+0000 7fcad54e9640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcad015b440 0x7fcad015c900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:44960/0 (socket says 172.21.15.40:44960) 2023-12-17T11:50:15.291 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:15.288+0000 7fcad54e9640 1 -- 172.21.15.40:0/1426340592 learned_addr learned my addr 172.21.15.40:0/1426340592 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-17T11:50:15.291 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:15.288+0000 7fcacffff640 1 --2- 172.21.15.40:0/1426340592 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fcad00d1b40 0x7fcad00b63b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:50:15.291 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:15.288+0000 7fcad54e9640 1 -- 172.21.15.40:0/1426340592 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fcad00d1b40 msgr2=0x7fcad00b63b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:50:15.291 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:15.288+0000 7fcad4ce8640 1 --2- 172.21.15.40:0/1426340592 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcad00cf540 0x7fcad0159110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:50:15.291 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:15.288+0000 7fcad54e9640 1 --2- 172.21.15.40:0/1426340592 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fcad00d1b40 0x7fcad00b63b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:50:15.291 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:15.288+0000 7fcad54e9640 1 -- 172.21.15.40:0/1426340592 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcad00cf540 msgr2=0x7fcad0159110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:50:15.292 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:15.289+0000 7fcad54e9640 1 --2- 172.21.15.40:0/1426340592 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcad00cf540 0x7fcad0159110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:50:15.292 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:15.289+0000 7fcad54e9640 1 -- 172.21.15.40:0/1426340592 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcac4009400 con 0x7fcad015b440 2023-12-17T11:50:15.292 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:15.289+0000 7fcad4ce8640 1 --2- 172.21.15.40:0/1426340592 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcad00cf540 0x7fcad0159110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-17T11:50:15.292 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:15.289+0000 7fcad54e9640 1 --2- 172.21.15.40:0/1426340592 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcad015b440 0x7fcad015c900 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7fcac800c780 tx=0x7fcac800cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:50:15.292 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:15.289+0000 7fcacd7fa640 1 -- 172.21.15.40:0/1426340592 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcac800ce90 con 0x7fcad015b440 2023-12-17T11:50:15.292 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:15.289+0000 7fcacd7fa640 1 -- 172.21.15.40:0/1426340592 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcac800a640 con 0x7fcad015b440 2023-12-17T11:50:15.293 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:15.289+0000 7fcacd7fa640 1 -- 172.21.15.40:0/1426340592 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcac800a9d0 con 0x7fcad015b440 2023-12-17T11:50:15.293 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:15.289+0000 7fcad6f4c640 1 -- 172.21.15.40:0/1426340592 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcad0156900 con 0x7fcad015b440 2023-12-17T11:50:15.293 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:15.289+0000 7fcad6f4c640 1 -- 172.21.15.40:0/1426340592 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcad0156ec0 con 0x7fcad015b440 2023-12-17T11:50:15.293 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:15.292+0000 7fcacd7fa640 1 -- 172.21.15.40:0/1426340592 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fcac800ab30 con 0x7fcad015b440 2023-12-17T11:50:15.294 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:15.292+0000 7fcacd7fa640 1 --2- 172.21.15.40:0/1426340592 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7fcabc06ae40 0x7fcabc06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:50:15.294 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:15.293+0000 7fcacd7fa640 1 -- 172.21.15.40:0/1426340592 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fcac8088c90 con 0x7fcad015b440 2023-12-17T11:50:15.295 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:15.293+0000 7fcad4ce8640 1 --2- 172.21.15.40:0/1426340592 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7fcabc06ae40 0x7fcabc06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:50:15.296 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:15.293+0000 7fcad9bc3740 1 Processor -- start 2023-12-17T11:50:15.296 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:15.293+0000 7fcad9bc3740 1 -- start start 2023-12-17T11:50:15.297 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:15.294+0000 7fcad9bc3740 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x55b54c982010 0x55b54c9823f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:50:15.297 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:15.294+0000 7fcad9bc3740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55b54c9522c0 0x55b54c97f280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:50:15.298 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:15.295+0000 7fcad9bc3740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55b54c955b90 0x55b54c97f7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:50:15.298 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:15.295+0000 7fcad9bc3740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b54c8c4f40 con 0x55b54c9522c0 2023-12-17T11:50:15.298 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:15.295+0000 7fcad9bc3740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b54c8c2630 con 0x55b54c955b90 2023-12-17T11:50:15.298 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:15.295+0000 7fcad9bc3740 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b54c8bdf20 con 0x55b54c982010 2023-12-17T11:50:15.298 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:15.295+0000 7fcad4ce8640 1 --2- 172.21.15.40:0/1426340592 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7fcabc06ae40 0x7fcabc06d300 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fcac0006fd0 tx=0x7fcac0008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:50:15.298 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:15.295+0000 7fcacffff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55b54c9522c0 0x55b54c97f280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:50:15.298 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:15.295+0000 7fcacffff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55b54c9522c0 0x55b54c97f280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:44970/0 (socket says 172.21.15.40:44970) 2023-12-17T11:50:15.298 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:15.295+0000 7fcacffff640 1 -- 172.21.15.40:0/2737410970 learned_addr learned my addr 172.21.15.40:0/2737410970 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-17T11:50:15.298 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:15.295+0000 7fcad54e9640 1 --2- 172.21.15.40:0/2737410970 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55b54c955b90 0x55b54c97f7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:50:15.298 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:15.295+0000 7fcad4ce8640 1 --2- 172.21.15.40:0/2737410970 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x55b54c982010 0x55b54c9823f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:50:15.298 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:15.295+0000 7fcacffff640 1 -- 172.21.15.40:0/2737410970 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x55b54c982010 msgr2=0x55b54c9823f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:50:15.298 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:15.295+0000 7fcacffff640 1 --2- 172.21.15.40:0/2737410970 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x55b54c982010 0x55b54c9823f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:50:15.298 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:15.295+0000 7fcacffff640 1 -- 172.21.15.40:0/2737410970 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55b54c955b90 msgr2=0x55b54c97f7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:50:15.299 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:15.295+0000 7fcacffff640 1 --2- 172.21.15.40:0/2737410970 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55b54c955b90 0x55b54c97f7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:50:15.299 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:15.295+0000 7fcacffff640 1 -- 172.21.15.40:0/2737410970 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b54c880910 con 0x55b54c9522c0 2023-12-17T11:50:15.299 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:15.295+0000 7fcad4ce8640 1 --2- 172.21.15.40:0/2737410970 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x55b54c982010 0x55b54c9823f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-17T11:50:15.299 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:15.296+0000 7fcacffff640 1 --2- 172.21.15.40:0/2737410970 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55b54c9522c0 0x55b54c97f280 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7fcac40097a0 tx=0x7fcac4008030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4322321d67889ed7 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:50:15.300 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:15.296+0000 7fcab67fc640 1 -- 172.21.15.40:0/2737410970 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcac403f040 con 0x55b54c9522c0 2023-12-17T11:50:15.300 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:15.296+0000 7fcab67fc640 1 -- 172.21.15.40:0/2737410970 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcac4031dc0 con 0x55b54c9522c0 2023-12-17T11:50:15.300 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:15.296+0000 7fcab67fc640 1 -- 172.21.15.40:0/2737410970 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcac4045630 con 0x55b54c9522c0 2023-12-17T11:50:15.300 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:15.297+0000 7fcad9bc3740 1 -- 172.21.15.40:0/2737410970 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55b54c9522c0 msgr2=0x55b54c97f280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:50:15.300 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:15.297+0000 7fcad9bc3740 1 --2- 172.21.15.40:0/2737410970 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55b54c9522c0 0x55b54c97f280 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7fcac40097a0 tx=0x7fcac4008030 comp rx=0 tx=0).stop 2023-12-17T11:50:15.300 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:15.297+0000 7fcad9bc3740 1 -- 172.21.15.40:0/2737410970 shutdown_connections 2023-12-17T11:50:15.300 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:15.297+0000 7fcad9bc3740 1 --2- 172.21.15.40:0/2737410970 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55b54c955b90 0x55b54c97f7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:50:15.300 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:15.297+0000 7fcad9bc3740 1 --2- 172.21.15.40:0/2737410970 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55b54c9522c0 0x55b54c97f280 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:50:15.300 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:15.297+0000 7fcad9bc3740 1 --2- 172.21.15.40:0/2737410970 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x55b54c982010 0x55b54c9823f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:50:15.301 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:15.297+0000 7fcad9bc3740 1 -- 172.21.15.40:0/2737410970 >> 172.21.15.40:0/2737410970 conn(0x55b54c954530 msgr2=0x55b54c99ce20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:50:15.301 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:15.297+0000 7fcad9bc3740 1 -- 172.21.15.40:0/2737410970 shutdown_connections 2023-12-17T11:50:15.301 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:15.297+0000 7fcad9bc3740 1 -- 172.21.15.40:0/2737410970 wait complete. 2023-12-17T11:50:15.301 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:15.298+0000 7fcad9bc3740 1 -- start start 2023-12-17T11:50:15.301 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:15.298+0000 7fcad9bc3740 1 Processor -- start 2023-12-17T11:50:15.303 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:15.299+0000 7fcad9bc3740 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x55b54c955b90 0x55b54c958050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:50:15.303 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:15.299+0000 7fcad9bc3740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55b54c982010 0x55b54c992f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:50:15.303 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:15.299+0000 7fcad9bc3740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55b54c971360 0x55b54c9717e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:50:15.303 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:15.299+0000 7fcad9bc3740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b54c85a2f0 con 0x55b54c971360 2023-12-17T11:50:15.303 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:15.299+0000 7fcad9bc3740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b54c877c70 con 0x55b54c982010 2023-12-17T11:50:15.304 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:15.299+0000 7fcad9bc3740 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b54c620f20 con 0x55b54c955b90 2023-12-17T11:50:15.304 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:15.299+0000 7fcad9bc3740 10 client.0 _ll_register_callbacks cb 0x55b54c87c3b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-17T11:50:15.304 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:15.299+0000 7fcad54e9640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55b54c971360 0x55b54c9717e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:50:15.304 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:15.299+0000 7fcad54e9640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55b54c971360 0x55b54c9717e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:44980/0 (socket says 172.21.15.40:44980) 2023-12-17T11:50:15.304 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:15.299+0000 7fcad54e9640 1 -- 172.21.15.40:0/2981982757 learned_addr learned my addr 172.21.15.40:0/2981982757 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-17T11:50:15.304 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:15.300+0000 7fcad54e9640 1 -- 172.21.15.40:0/2981982757 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x55b54c955b90 msgr2=0x55b54c958050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:50:15.304 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:15.300+0000 7fcad4ce8640 1 --2- 172.21.15.40:0/2981982757 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x55b54c955b90 0x55b54c958050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:50:15.304 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:15.300+0000 7fcacffff640 1 --2- 172.21.15.40:0/2981982757 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55b54c982010 0x55b54c992f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:50:15.304 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:15.300+0000 7fcad54e9640 1 --2- 172.21.15.40:0/2981982757 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x55b54c955b90 0x55b54c958050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:50:15.304 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:15.300+0000 7fcad54e9640 1 -- 172.21.15.40:0/2981982757 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55b54c982010 msgr2=0x55b54c992f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:50:15.304 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:15.300+0000 7fcad54e9640 1 --2- 172.21.15.40:0/2981982757 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55b54c982010 0x55b54c992f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:50:15.304 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:15.300+0000 7fcad54e9640 1 -- 172.21.15.40:0/2981982757 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcad00cbc40 con 0x55b54c971360 2023-12-17T11:50:15.304 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:15.300+0000 7fcacffff640 1 --2- 172.21.15.40:0/2981982757 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55b54c982010 0x55b54c992f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-17T11:50:15.304 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:15.300+0000 7fcad54e9640 1 --2- 172.21.15.40:0/2981982757 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55b54c971360 0x55b54c9717e0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7fcac800a430 tx=0x7fcac8057940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b818fa1c7f37abc4 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:50:15.305 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:15.300+0000 7fcaaf7fe640 10 client.0 ms_handle_connect on v2:172.21.15.40:3300/0 2023-12-17T11:50:15.305 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:15.300+0000 7fcaaf7fe640 1 -- 172.21.15.40:0/2981982757 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcac805f870 con 0x55b54c971360 2023-12-17T11:50:15.305 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:15.301+0000 7fcaaf7fe640 1 -- 172.21.15.40:0/2981982757 <== mon.0 v2:172.21.15.40:3300/0 2 ==== osd_map(42..42 src has 1..42) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fcac806cd60 con 0x55b54c971360 2023-12-17T11:50:15.305 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:15.301+0000 7fcad9bc3740 1 -- 172.21.15.40:0/2981982757 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55b54c8b6db0 con 0x55b54c971360 2023-12-17T11:50:15.305 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:15.301+0000 7fcaaf7fe640 1 -- 172.21.15.40:0/2981982757 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_get_version_reply(handle=1 version=15) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcac8058b30 con 0x55b54c971360 2023-12-17T11:50:15.305 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:15.301+0000 7fcad9bc3740 10 client.5550 fetch_fsmap learned FSMap version 15 2023-12-17T11:50:15.305 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:15.301+0000 7fcad9bc3740 1 -- 172.21.15.40:0/2981982757 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,fsmap=15,monmap=2+}) v3 -- 0x55b54c8bc5a0 con 0x55b54c971360 2023-12-17T11:50:15.305 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:15.301+0000 7fcaaf7fe640 1 -- 172.21.15.40:0/2981982757 <== mon.0 v2:172.21.15.40:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55b54c8b6db0 con 0x55b54c971360 2023-12-17T11:50:15.305 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:15.301+0000 7fcaaf7fe640 1 -- 172.21.15.40:0/2981982757 <== mon.0 v2:172.21.15.40:3300/0 5 ==== fsmap(e 15) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fcac8058c90 con 0x55b54c971360 2023-12-17T11:50:15.305 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:15.301+0000 7fcad9bc3740 10 client.5550 fetch_fsmap finished waiting for FSMap version 15 2023-12-17T11:50:15.305 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:15.301+0000 7fcad9bc3740 10 client.5550 resolve_mds: resolved name 'd' to daemon mds.d 2023-12-17T11:50:15.305 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:15.301+0000 7fcad9bc3740 20 client.5550 populate_metadata read hostname 'smithi040' 2023-12-17T11:50:15.305 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:15.301+0000 7fcad9bc3740 1 --2- 172.21.15.40:0/2981982757 >> [v2:172.21.15.159:6835/2606646075,v1:172.21.15.159:6837/2606646075] conn(0x55b54c973c40 0x55b54c9bee10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:50:15.305 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:15.301+0000 7fcad9bc3740 4 client.5550 mds_command: new command op to 5304 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-12-17T11:50:15.306 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:15.301+0000 7fcad9bc3740 1 -- 172.21.15.40:0/2981982757 --> [v2:172.21.15.159:6835/2606646075,v1:172.21.15.159:6837/2606646075] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55b54c8b6ad0 con 0x55b54c973c40 2023-12-17T11:50:15.306 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:15.302+0000 7fcad4ce8640 1 --2- 172.21.15.40:0/2981982757 >> [v2:172.21.15.159:6835/2606646075,v1:172.21.15.159:6837/2606646075] conn(0x55b54c973c40 0x55b54c9bee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:50:15.306 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:15.303+0000 7fcad4ce8640 1 --2- 172.21.15.40:0/2981982757 >> [v2:172.21.15.159:6835/2606646075,v1:172.21.15.159:6837/2606646075] conn(0x55b54c973c40 0x55b54c9bee10 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bac7a63627c6bc09 server_cookie=73a4a9dc30866c75 in_seq=0 out_seq=0 2023-12-17T11:50:15.306 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:15.303+0000 7fcaaf7fe640 10 client.5550 ms_handle_connect on v2:172.21.15.159:6835/2606646075 2023-12-17T11:50:15.307 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:15.305+0000 7fcaaf7fe640 1 -- 172.21.15.40:0/2981982757 <== mds.0 v2:172.21.15.159:6835/2606646075 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55b54c8b6ad0 con 0x55b54c973c40 2023-12-17T11:50:15.307 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:15.305+0000 7fcaaf7fe640 10 client.5550 handle_command_reply: tid=0 2023-12-17T11:50:15.307 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:15.305+0000 7fcad9bc3740 1 client.5550 shutdown 2023-12-17T11:50:15.308 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:15.305+0000 7fcad9bc3740 1 -- 172.21.15.40:0/2981982757 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55b54c971360 msgr2=0x55b54c9717e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:50:15.308 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:15.305+0000 7fcad9bc3740 1 --2- 172.21.15.40:0/2981982757 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55b54c971360 0x55b54c9717e0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7fcac800a430 tx=0x7fcac8057940 comp rx=0 tx=0).stop 2023-12-17T11:50:15.308 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:15.305+0000 7fcad9bc3740 1 -- 172.21.15.40:0/2981982757 shutdown_connections 2023-12-17T11:50:15.308 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:15.305+0000 7fcad9bc3740 1 --2- 172.21.15.40:0/2981982757 >> [v2:172.21.15.159:6835/2606646075,v1:172.21.15.159:6837/2606646075] conn(0x55b54c973c40 0x55b54c9bee10 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:50:15.308 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:15.305+0000 7fcad9bc3740 1 --2- 172.21.15.40:0/2981982757 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55b54c971360 0x55b54c9717e0 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:50:15.308 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:15.305+0000 7fcad9bc3740 1 --2- 172.21.15.40:0/2981982757 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55b54c982010 0x55b54c992f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:50:15.308 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:15.305+0000 7fcad9bc3740 1 --2- 172.21.15.40:0/2981982757 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x55b54c955b90 0x55b54c958050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:50:15.308 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:15.305+0000 7fcaaf7fe640 0 client.5550 ms_handle_reset on v2:172.21.15.159:6835/2606646075 2023-12-17T11:50:15.308 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:15.305+0000 7fcad9bc3740 1 -- 172.21.15.40:0/2981982757 >> 172.21.15.40:0/2981982757 conn(0x55b54c9522c0 msgr2=0x55b54c9a0330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:50:15.308 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:15.305+0000 7fcad9bc3740 1 -- 172.21.15.40:0/2981982757 shutdown_connections 2023-12-17T11:50:15.308 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:15.305+0000 7fcad9bc3740 1 -- 172.21.15.40:0/2981982757 wait complete. 2023-12-17T11:50:15.308 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:15.305+0000 7fcad9bc3740 20 client.5550 trim_cache size 0 max 16384 2023-12-17T11:50:15.325 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:15.323+0000 7fcad9bc3740 1 Processor -- start 2023-12-17T11:50:15.325 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:15.323+0000 7fcad9bc3740 1 -- start start 2023-12-17T11:50:15.326 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:15.324+0000 7fcad9bc3740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55b54c955b90 0x55b54c974d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:50:15.326 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:15.324+0000 7fcad9bc3740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55b54c971360 0x55b54c99f630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:50:15.326 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:15.324+0000 7fcad9bc3740 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x55b54c982010 0x55b54c99fb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:50:15.326 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:15.324+0000 7fcad9bc3740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b54c9528d0 con 0x55b54c955b90 2023-12-17T11:50:15.326 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:15.324+0000 7fcad9bc3740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b54c984930 con 0x55b54c971360 2023-12-17T11:50:15.326 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:15.324+0000 7fcad9bc3740 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b54c953360 con 0x55b54c982010 2023-12-17T11:50:15.327 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:15.324+0000 7fcad4ce8640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55b54c955b90 0x55b54c974d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:50:15.327 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:15.324+0000 7fcad4ce8640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55b54c955b90 0x55b54c974d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:44990/0 (socket says 172.21.15.40:44990) 2023-12-17T11:50:15.327 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:15.324+0000 7fcad4ce8640 1 -- 172.21.15.40:0/1226986108 learned_addr learned my addr 172.21.15.40:0/1226986108 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-17T11:50:15.327 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:15.324+0000 7fcad54e9640 1 --2- 172.21.15.40:0/1226986108 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x55b54c982010 0x55b54c99fb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:50:15.327 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:15.324+0000 7fcacffff640 1 --2- 172.21.15.40:0/1226986108 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55b54c971360 0x55b54c99f630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:50:15.327 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:15.325+0000 7fcad4ce8640 1 -- 172.21.15.40:0/1226986108 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x55b54c982010 msgr2=0x55b54c99fb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:50:15.327 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:15.325+0000 7fcad4ce8640 1 --2- 172.21.15.40:0/1226986108 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x55b54c982010 0x55b54c99fb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:50:15.328 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:15.325+0000 7fcad4ce8640 1 -- 172.21.15.40:0/1226986108 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55b54c971360 msgr2=0x55b54c99f630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:50:15.328 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:15.325+0000 7fcad4ce8640 1 --2- 172.21.15.40:0/1226986108 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55b54c971360 0x55b54c99f630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:50:15.328 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:15.325+0000 7fcad4ce8640 1 -- 172.21.15.40:0/1226986108 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b54c99e420 con 0x55b54c955b90 2023-12-17T11:50:15.328 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:15.325+0000 7fcad4ce8640 1 --2- 172.21.15.40:0/1226986108 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55b54c955b90 0x55b54c974d20 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x55b54c973bc0 tx=0x7fcac0014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63cc5ba9ebfbea1b server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:50:15.328 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:15.325+0000 7fcab6ffd640 1 -- 172.21.15.40:0/1226986108 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcac00233a0 con 0x55b54c955b90 2023-12-17T11:50:15.328 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:15.325+0000 7fcab6ffd640 1 -- 172.21.15.40:0/1226986108 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcac001c040 con 0x55b54c955b90 2023-12-17T11:50:15.328 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:15.325+0000 7fcab6ffd640 1 -- 172.21.15.40:0/1226986108 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcac0023740 con 0x55b54c955b90 2023-12-17T11:50:15.329 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:15.326+0000 7fcad9bc3740 1 -- 172.21.15.40:0/1226986108 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55b54c955b90 msgr2=0x55b54c974d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:50:15.329 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:15.326+0000 7fcad9bc3740 1 --2- 172.21.15.40:0/1226986108 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55b54c955b90 0x55b54c974d20 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x55b54c973bc0 tx=0x7fcac0014000 comp rx=0 tx=0).stop 2023-12-17T11:50:15.329 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:15.326+0000 7fcad9bc3740 1 -- 172.21.15.40:0/1226986108 shutdown_connections 2023-12-17T11:50:15.329 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:15.326+0000 7fcad9bc3740 1 --2- 172.21.15.40:0/1226986108 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x55b54c982010 0x55b54c99fb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:50:15.329 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:15.326+0000 7fcad9bc3740 1 --2- 172.21.15.40:0/1226986108 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55b54c971360 0x55b54c99f630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:50:15.329 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:15.326+0000 7fcad9bc3740 1 --2- 172.21.15.40:0/1226986108 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55b54c955b90 0x55b54c974d20 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:50:15.330 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:15.326+0000 7fcad9bc3740 1 -- 172.21.15.40:0/1226986108 >> 172.21.15.40:0/1226986108 conn(0x55b54c9522c0 msgr2=0x55b54c96f880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:50:15.330 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:15.326+0000 7fcad9bc3740 1 -- 172.21.15.40:0/1226986108 shutdown_connections 2023-12-17T11:50:15.330 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:15.326+0000 7fcad9bc3740 1 -- 172.21.15.40:0/1226986108 wait complete. 2023-12-17T11:50:15.330 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:15.327+0000 7fcad9bc3740 1 -- start start 2023-12-17T11:50:15.330 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:15.327+0000 7fcad9bc3740 1 Processor -- start 2023-12-17T11:50:15.332 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:15.328+0000 7fcad9bc3740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55b54c955b90 0x55b54ca0e4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:50:15.332 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:15.328+0000 7fcad9bc3740 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x55b54c971360 0x55b54c9c2e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:50:15.332 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:15.328+0000 7fcad9bc3740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55b54c982010 0x55b54c9c3370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:50:15.333 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:15.328+0000 7fcad9bc3740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b54c956a30 con 0x55b54c955b90 2023-12-17T11:50:15.333 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:15.328+0000 7fcad9bc3740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b54c96fbb0 con 0x55b54c982010 2023-12-17T11:50:15.333 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:15.328+0000 7fcad9bc3740 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b54c9567e0 con 0x55b54c971360 2023-12-17T11:50:15.333 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:15.328+0000 7fcad9bc3740 10 client.0 _ll_register_callbacks cb 0x7fcac80575d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-17T11:50:15.333 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:15.328+0000 7fcad4ce8640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55b54c955b90 0x55b54ca0e4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:50:15.333 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:15.328+0000 7fcad4ce8640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55b54c955b90 0x55b54ca0e4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:44996/0 (socket says 172.21.15.40:44996) 2023-12-17T11:50:15.333 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:15.328+0000 7fcad4ce8640 1 -- 172.21.15.40:0/3669114360 learned_addr learned my addr 172.21.15.40:0/3669114360 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-17T11:50:15.333 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:15.329+0000 7fcacffff640 1 --2- 172.21.15.40:0/3669114360 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x55b54c971360 0x55b54c9c2e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:50:15.333 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:15.329+0000 7fcad54e9640 1 --2- 172.21.15.40:0/3669114360 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55b54c982010 0x55b54c9c3370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:50:15.333 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:15.329+0000 7fcad4ce8640 1 -- 172.21.15.40:0/3669114360 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x55b54c971360 msgr2=0x55b54c9c2e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:50:15.333 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:15.329+0000 7fcad4ce8640 1 --2- 172.21.15.40:0/3669114360 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x55b54c971360 0x55b54c9c2e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:50:15.333 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:15.329+0000 7fcad4ce8640 1 -- 172.21.15.40:0/3669114360 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55b54c982010 msgr2=0x55b54c9c3370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:50:15.333 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:15.329+0000 7fcad4ce8640 1 --2- 172.21.15.40:0/3669114360 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55b54c982010 0x55b54c9c3370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:50:15.334 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:15.329+0000 7fcad4ce8640 1 -- 172.21.15.40:0/3669114360 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcac0004330 con 0x55b54c955b90 2023-12-17T11:50:15.334 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:15.329+0000 7fcad4ce8640 1 --2- 172.21.15.40:0/3669114360 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55b54c955b90 0x55b54ca0e4e0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7fcac0008010 tx=0x7fcac0004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8097e1a2645f6e46 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:50:15.334 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:15.329+0000 7fcaaf7fe640 10 client.0 ms_handle_connect on v2:172.21.15.40:3300/0 2023-12-17T11:50:15.334 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:15.329+0000 7fcaaf7fe640 1 -- 172.21.15.40:0/3669114360 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcac0031070 con 0x55b54c955b90 2023-12-17T11:50:15.334 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:15.329+0000 7fcaaf7fe640 1 -- 172.21.15.40:0/3669114360 <== mon.0 v2:172.21.15.40:3300/0 2 ==== osd_map(42..42 src has 1..42) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fcac0039c40 con 0x55b54c955b90 2023-12-17T11:50:15.334 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:15.329+0000 7fcad9bc3740 1 -- 172.21.15.40:0/3669114360 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fcac4031dc0 con 0x55b54c955b90 2023-12-17T11:50:15.334 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:15.330+0000 7fcaaf7fe640 1 -- 172.21.15.40:0/3669114360 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_get_version_reply(handle=1 version=15) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcac0039e00 con 0x55b54c955b90 2023-12-17T11:50:15.334 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:15.330+0000 7fcad9bc3740 10 client.5556 fetch_fsmap learned FSMap version 15 2023-12-17T11:50:15.334 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:15.330+0000 7fcad9bc3740 1 -- 172.21.15.40:0/3669114360 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,fsmap=15,monmap=2+}) v3 -- 0x55b54c859b80 con 0x55b54c955b90 2023-12-17T11:50:15.334 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:15.330+0000 7fcaaf7fe640 1 -- 172.21.15.40:0/3669114360 <== mon.0 v2:172.21.15.40:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcac4031dc0 con 0x55b54c955b90 2023-12-17T11:50:15.334 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:15.330+0000 7fcaaf7fe640 1 -- 172.21.15.40:0/3669114360 <== mon.0 v2:172.21.15.40:3300/0 5 ==== fsmap(e 15) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fcac0021070 con 0x55b54c955b90 2023-12-17T11:50:15.334 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:15.330+0000 7fcad9bc3740 10 client.5556 fetch_fsmap finished waiting for FSMap version 15 2023-12-17T11:50:15.334 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:15.330+0000 7fcad9bc3740 10 client.5556 resolve_mds: resolved name 'd' to daemon mds.d 2023-12-17T11:50:15.334 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:15.330+0000 7fcad9bc3740 20 client.5556 populate_metadata read hostname 'smithi040' 2023-12-17T11:50:15.334 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:15.330+0000 7fcad9bc3740 1 --2- 172.21.15.40:0/3669114360 >> [v2:172.21.15.159:6835/2606646075,v1:172.21.15.159:6837/2606646075] conn(0x55b54c970350 0x55b54c970730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:50:15.335 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:15.330+0000 7fcad9bc3740 4 client.5556 mds_command: new command op to 5304 tid=0 multi_id=0 [{"prefix": "status"}] 2023-12-17T11:50:15.335 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:15.330+0000 7fcad9bc3740 1 -- 172.21.15.40:0/3669114360 --> [v2:172.21.15.159:6835/2606646075,v1:172.21.15.159:6837/2606646075] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55b54c5be6c0 con 0x55b54c970350 2023-12-17T11:50:15.336 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:15.331+0000 7fcacffff640 1 --2- 172.21.15.40:0/3669114360 >> [v2:172.21.15.159:6835/2606646075,v1:172.21.15.159:6837/2606646075] conn(0x55b54c970350 0x55b54c970730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:50:15.336 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:15.332+0000 7fcacffff640 1 --2- 172.21.15.40:0/3669114360 >> [v2:172.21.15.159:6835/2606646075,v1:172.21.15.159:6837/2606646075] conn(0x55b54c970350 0x55b54c970730 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=488c4b67c325136e server_cookie=9e246c915a184451 in_seq=0 out_seq=0 2023-12-17T11:50:15.336 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:15.332+0000 7fcaaf7fe640 10 client.5556 ms_handle_connect on v2:172.21.15.159:6835/2606646075 2023-12-17T11:50:15.336 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:15.332+0000 7fcaaf7fe640 1 -- 172.21.15.40:0/3669114360 <== mds.0 v2:172.21.15.159:6835/2606646075 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+325 (crc 0 0 0) 0x55b54c5be6c0 con 0x55b54c970350 2023-12-17T11:50:15.336 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:15.332+0000 7fcaaf7fe640 10 client.5556 handle_command_reply: tid=0 2023-12-17T11:50:15.336 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:15.333+0000 7fcad9bc3740 1 client.5556 shutdown 2023-12-17T11:50:15.337 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:15.333+0000 7fcad9bc3740 1 -- 172.21.15.40:0/3669114360 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55b54c955b90 msgr2=0x55b54ca0e4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:50:15.337 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:15.333+0000 7fcad9bc3740 1 --2- 172.21.15.40:0/3669114360 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55b54c955b90 0x55b54ca0e4e0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7fcac0008010 tx=0x7fcac0004730 comp rx=0 tx=0).stop 2023-12-17T11:50:15.337 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:15.333+0000 7fcad9bc3740 1 -- 172.21.15.40:0/3669114360 shutdown_connections 2023-12-17T11:50:15.337 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:15.333+0000 7fcad9bc3740 1 --2- 172.21.15.40:0/3669114360 >> [v2:172.21.15.159:6835/2606646075,v1:172.21.15.159:6837/2606646075] conn(0x55b54c970350 0x55b54c970730 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:50:15.337 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:15.333+0000 7fcad9bc3740 1 --2- 172.21.15.40:0/3669114360 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55b54c982010 0x55b54c9c3370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:50:15.337 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:15.333+0000 7fcad9bc3740 1 --2- 172.21.15.40:0/3669114360 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x55b54c971360 0x55b54c9c2e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:50:15.337 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:15.333+0000 7fcad9bc3740 1 --2- 172.21.15.40:0/3669114360 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55b54c955b90 0x55b54ca0e4e0 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:50:15.337 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:15.333+0000 7fcaaf7fe640 0 client.5556 ms_handle_reset on v2:172.21.15.159:6835/2606646075 2023-12-17T11:50:15.337 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:15.333+0000 7fcad9bc3740 1 -- 172.21.15.40:0/3669114360 >> 172.21.15.40:0/3669114360 conn(0x55b54c9522c0 msgr2=0x55b54c985340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:50:15.337 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:15.333+0000 7fcad9bc3740 1 -- 172.21.15.40:0/3669114360 shutdown_connections 2023-12-17T11:50:15.337 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:15.333+0000 7fcad9bc3740 1 -- 172.21.15.40:0/3669114360 wait complete. 2023-12-17T11:50:15.337 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:15.333+0000 7fcad9bc3740 20 client.5556 trim_cache size 0 max 16384 2023-12-17T11:50:15.338 INFO:teuthology.orchestra.run.smithi040.stdout:{ 2023-12-17T11:50:15.338 INFO:teuthology.orchestra.run.smithi040.stdout: "cluster_fsid": "099cd35d-80d9-4ca4-8424-de13b3b03ac7", 2023-12-17T11:50:15.338 INFO:teuthology.orchestra.run.smithi040.stdout: "whoami": 0, 2023-12-17T11:50:15.338 INFO:teuthology.orchestra.run.smithi040.stdout: "id": 5304, 2023-12-17T11:50:15.338 INFO:teuthology.orchestra.run.smithi040.stdout: "want_state": "up:active", 2023-12-17T11:50:15.338 INFO:teuthology.orchestra.run.smithi040.stdout: "state": "up:active", 2023-12-17T11:50:15.338 INFO:teuthology.orchestra.run.smithi040.stdout: "fs_name": "cephfs", 2023-12-17T11:50:15.338 INFO:teuthology.orchestra.run.smithi040.stdout: "rank_uptime": 22.122765848, 2023-12-17T11:50:15.338 INFO:teuthology.orchestra.run.smithi040.stdout: "mdsmap_epoch": 15, 2023-12-17T11:50:15.338 INFO:teuthology.orchestra.run.smithi040.stdout: "osdmap_epoch": 42, 2023-12-17T11:50:15.338 INFO:teuthology.orchestra.run.smithi040.stdout: "osdmap_epoch_barrier": 40, 2023-12-17T11:50:15.338 INFO:teuthology.orchestra.run.smithi040.stdout: "uptime": 32.068385524999997 2023-12-17T11:50:15.339 INFO:teuthology.orchestra.run.smithi040.stdout:} 2023-12-17T11:50:15.339 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:15.334+0000 7fcad6f4c640 1 -- 172.21.15.40:0/1426340592 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7fcabc06ae40 msgr2=0x7fcabc06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:50:15.339 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:15.334+0000 7fcad6f4c640 1 --2- 172.21.15.40:0/1426340592 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7fcabc06ae40 0x7fcabc06d300 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fcac0006fd0 tx=0x7fcac0008040 comp rx=0 tx=0).stop 2023-12-17T11:50:15.339 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:15.334+0000 7fcad6f4c640 1 -- 172.21.15.40:0/1426340592 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcad015b440 msgr2=0x7fcad015c900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:50:15.339 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:15.334+0000 7fcad6f4c640 1 --2- 172.21.15.40:0/1426340592 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcad015b440 0x7fcad015c900 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7fcac800c780 tx=0x7fcac800cc40 comp rx=0 tx=0).stop 2023-12-17T11:50:15.340 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:15.334+0000 7fcad6f4c640 1 -- 172.21.15.40:0/1426340592 shutdown_connections 2023-12-17T11:50:15.340 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:15.334+0000 7fcad6f4c640 1 --2- 172.21.15.40:0/1426340592 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7fcabc06ae40 0x7fcabc06d300 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:50:15.340 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:15.334+0000 7fcad6f4c640 1 --2- 172.21.15.40:0/1426340592 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcad015b440 0x7fcad015c900 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:50:15.340 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:15.334+0000 7fcad6f4c640 1 --2- 172.21.15.40:0/1426340592 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fcad00d1b40 0x7fcad00b63b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:50:15.340 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:15.334+0000 7fcad6f4c640 1 --2- 172.21.15.40:0/1426340592 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcad00cf540 0x7fcad0159110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:50:15.340 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:15.334+0000 7fcad6f4c640 1 -- 172.21.15.40:0/1426340592 >> 172.21.15.40:0/1426340592 conn(0x7fcad00d0e90 msgr2=0x7fcad006f4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:50:15.340 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:15.334+0000 7fcad6f4c640 1 -- 172.21.15.40:0/1426340592 shutdown_connections 2023-12-17T11:50:15.340 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:15.334+0000 7fcad6f4c640 1 -- 172.21.15.40:0/1426340592 wait complete. 2023-12-17T11:50:15.353 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-12-17T11:50:15.563 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:15.561+0000 7fe1d352e640 1 Processor -- start 2023-12-17T11:50:15.563 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:15.561+0000 7fe1d352e640 1 -- start start 2023-12-17T11:50:15.565 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:15.563+0000 7fe1d352e640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe1cc15e5d0 0x7fe1cc06bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:50:15.565 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:15.563+0000 7fe1d352e640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7fe1cc0ae200 0x7fe1cc070b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:50:15.565 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:15.563+0000 7fe1d352e640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1cc071f90 con 0x7fe1cc06c330 2023-12-17T11:50:15.565 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:15.563+0000 7fe1d352e640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1cc072270 con 0x7fe1cc0ae200 2023-12-17T11:50:15.565 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:15.563+0000 7fe1d352e640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1cc070070 con 0x7fe1cc15e5d0 2023-12-17T11:50:15.565 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:15.563+0000 7fe1d2d2d640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fe1cc06c330 0x7fe1cc0cded0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:39514/0 (socket says 172.21.15.40:39514) 2023-12-17T11:50:15.565 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:15.563+0000 7fe1d2d2d640 1 -- 172.21.15.40:0/179733930 learned_addr learned my addr 172.21.15.40:0/179733930 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-12-17T11:50:15.567 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:15.563+0000 7fe1d252c640 1 --2- 172.21.15.40:0/179733930 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe1cc15e5d0 0x7fe1cc06bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:50:15.567 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:15.563+0000 7fe1d1d2b640 1 --2- 172.21.15.40:0/179733930 >> v2:172.21.15.159:3300/0 conn(0x7fe1cc0ae200 0x7fe1cc070b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:50:15.567 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:15.563+0000 7fe1d152a640 1 -- 172.21.15.40:0/179733930 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2037795709 0 0) 0x7fe1cc071f90 con 0x7fe1cc06c330 2023-12-17T11:50:15.567 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:15.564+0000 7fe1d152a640 1 -- 172.21.15.40:0/179733930 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe1b8003520 con 0x7fe1cc06c330 2023-12-17T11:50:15.567 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:15.564+0000 7fe1d152a640 1 -- 172.21.15.40:0/179733930 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3619627498 0 0) 0x7fe1b8003520 con 0x7fe1cc06c330 2023-12-17T11:50:15.568 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:15.564+0000 7fe1d152a640 1 -- 172.21.15.40:0/179733930 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe1cc15e5d0 msgr2=0x7fe1cc06bdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:50:15.568 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:15.564+0000 7fe1d152a640 1 --2- 172.21.15.40:0/179733930 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe1cc15e5d0 0x7fe1cc06bdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:50:15.568 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:15.564+0000 7fe1d152a640 1 -- 172.21.15.40:0/179733930 >> v2:172.21.15.159:3300/0 conn(0x7fe1cc0ae200 msgr2=0x7fe1cc070b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:50:15.568 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:15.564+0000 7fe1d152a640 1 --2- 172.21.15.40:0/179733930 >> v2:172.21.15.159:3300/0 conn(0x7fe1cc0ae200 0x7fe1cc070b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:50:15.568 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:15.564+0000 7fe1d152a640 1 -- 172.21.15.40:0/179733930 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1cc070350 con 0x7fe1cc06c330 2023-12-17T11:50:15.568 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:15.564+0000 7fe1d152a640 1 -- 172.21.15.40:0/179733930 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2643242555 0 0) 0x7fe1c40019f0 con 0x7fe1cc06c330 2023-12-17T11:50:15.568 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:15.564+0000 7fe1d152a640 1 -- 172.21.15.40:0/179733930 >> v1:172.21.15.40:6789/0 conn(0x7fe1cc06c330 legacy=0x7fe1cc0cded0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:50:15.568 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:15.564+0000 7fe1d152a640 1 --2- 172.21.15.40:0/179733930 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe1b8003970 0x7fe1b8003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:50:15.568 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:15.564+0000 7fe1d152a640 1 --2- 172.21.15.40:0/179733930 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe1b80047c0 0x7fe1b8004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:50:15.568 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:15.564+0000 7fe1d152a640 1 --2- 172.21.15.40:0/179733930 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe1cc15e5d0 0x7fe1b8005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:50:15.568 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:15.564+0000 7fe1d152a640 1 -- 172.21.15.40:0/179733930 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1cc072270 con 0x7fe1b80047c0 2023-12-17T11:50:15.568 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:15.564+0000 7fe1d152a640 1 -- 172.21.15.40:0/179733930 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1cc070070 con 0x7fe1b8003970 2023-12-17T11:50:15.568 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:15.564+0000 7fe1d152a640 1 -- 172.21.15.40:0/179733930 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1b800b980 con 0x7fe1cc15e5d0 2023-12-17T11:50:15.568 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:15.564+0000 7fe1d1d2b640 1 --2- 172.21.15.40:0/179733930 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe1b80047c0 0x7fe1b8004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:50:15.569 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:15.565+0000 7fe1d252c640 1 --2- 172.21.15.40:0/179733930 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe1b8003970 0x7fe1b8003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:50:15.569 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:15.565+0000 7fe1d2d2d640 1 --2- 172.21.15.40:0/179733930 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe1cc15e5d0 0x7fe1b8005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:50:15.569 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:15.565+0000 7fe1d1d2b640 1 -- 172.21.15.40:0/179733930 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe1cc15e5d0 msgr2=0x7fe1b8005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:50:15.569 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:15.565+0000 7fe1d1d2b640 1 --2- 172.21.15.40:0/179733930 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe1cc15e5d0 0x7fe1b8005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:50:15.569 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:15.565+0000 7fe1d1d2b640 1 -- 172.21.15.40:0/179733930 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe1b8003970 msgr2=0x7fe1b8003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:50:15.569 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:15.565+0000 7fe1d1d2b640 1 --2- 172.21.15.40:0/179733930 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe1b8003970 0x7fe1b8003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:50:15.569 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:15.565+0000 7fe1d1d2b640 1 -- 172.21.15.40:0/179733930 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1b8003520 con 0x7fe1b80047c0 2023-12-17T11:50:15.569 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:15.565+0000 7fe1d2d2d640 1 --2- 172.21.15.40:0/179733930 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe1cc15e5d0 0x7fe1b8005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-17T11:50:15.570 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:15.566+0000 7fe1d1d2b640 1 --2- 172.21.15.40:0/179733930 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe1b80047c0 0x7fe1b8004c40 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7fe1bc009af0 tx=0x7fe1b80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd4d6ed0d81ad160 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:50:15.570 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:15.566+0000 7fe1d152a640 1 -- 172.21.15.40:0/179733930 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1bc02c710 con 0x7fe1b80047c0 2023-12-17T11:50:15.570 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:15.566+0000 7fe1d152a640 1 -- 172.21.15.40:0/179733930 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1bc02c870 con 0x7fe1b80047c0 2023-12-17T11:50:15.571 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:15.566+0000 7fe1d152a640 1 -- 172.21.15.40:0/179733930 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1bc02cc00 con 0x7fe1b80047c0 2023-12-17T11:50:15.571 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:15.567+0000 7fe1d352e640 1 -- 172.21.15.40:0/179733930 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe1b80047c0 msgr2=0x7fe1b8004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:50:15.571 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:15.567+0000 7fe1d352e640 1 --2- 172.21.15.40:0/179733930 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe1b80047c0 0x7fe1b8004c40 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7fe1bc009af0 tx=0x7fe1b80057f0 comp rx=0 tx=0).stop 2023-12-17T11:50:15.571 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:15.567+0000 7fe1d2d2d640 1 -- 172.21.15.40:0/179733930 reap_dead start 2023-12-17T11:50:15.571 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:15.567+0000 7fe1d352e640 1 -- 172.21.15.40:0/179733930 shutdown_connections 2023-12-17T11:50:15.571 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:15.567+0000 7fe1d352e640 1 -- 172.21.15.40:0/179733930 >> 172.21.15.40:0/179733930 conn(0x7fe1cc0b0860 msgr2=0x7fe1cc0b0c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:50:15.571 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:15.567+0000 7fe1d352e640 1 -- 172.21.15.40:0/179733930 shutdown_connections 2023-12-17T11:50:15.571 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:15.567+0000 7fe1d352e640 1 -- 172.21.15.40:0/179733930 wait complete. 2023-12-17T11:50:15.572 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:15.569+0000 7fe1d352e640 1 Processor -- start 2023-12-17T11:50:15.572 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:15.569+0000 7fe1d352e640 1 -- start start 2023-12-17T11:50:15.572 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:15.570+0000 7fe1d352e640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe1b80047c0 0x7fe1cc14fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:50:15.572 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:15.570+0000 7fe1d352e640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe1cc1506e0 0x7fe1cc15abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:50:15.573 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:15.570+0000 7fe1d352e640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe1cc157b10 0x7fe1cc15b4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:50:15.573 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:15.570+0000 7fe1d352e640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1cc150c50 con 0x7fe1b80047c0 2023-12-17T11:50:15.573 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:15.570+0000 7fe1d352e640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1cc150f30 con 0x7fe1cc1506e0 2023-12-17T11:50:15.573 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:15.570+0000 7fe1d352e640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1cc15a3c0 con 0x7fe1cc157b10 2023-12-17T11:50:15.573 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:15.570+0000 7fe1d252c640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe1b80047c0 0x7fe1cc14fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:50:15.573 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:15.570+0000 7fe1d252c640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe1b80047c0 0x7fe1cc14fd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:45016/0 (socket says 172.21.15.40:45016) 2023-12-17T11:50:15.573 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:15.570+0000 7fe1d252c640 1 -- 172.21.15.40:0/3632460039 learned_addr learned my addr 172.21.15.40:0/3632460039 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-17T11:50:15.574 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:15.571+0000 7fe1d1d2b640 1 --2- 172.21.15.40:0/3632460039 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe1cc1506e0 0x7fe1cc15abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:50:15.574 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:15.571+0000 7fe1d2d2d640 1 --2- 172.21.15.40:0/3632460039 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe1cc157b10 0x7fe1cc15b4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:50:15.574 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:15.571+0000 7fe1d252c640 1 -- 172.21.15.40:0/3632460039 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe1cc157b10 msgr2=0x7fe1cc15b4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:50:15.574 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:15.571+0000 7fe1d252c640 1 --2- 172.21.15.40:0/3632460039 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe1cc157b10 0x7fe1cc15b4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:50:15.574 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:15.571+0000 7fe1d252c640 1 -- 172.21.15.40:0/3632460039 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe1cc1506e0 msgr2=0x7fe1cc15abc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:50:15.575 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:15.571+0000 7fe1d252c640 1 --2- 172.21.15.40:0/3632460039 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe1cc1506e0 0x7fe1cc15abc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:50:15.575 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:15.571+0000 7fe1d252c640 1 -- 172.21.15.40:0/3632460039 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1cc15a6a0 con 0x7fe1b80047c0 2023-12-17T11:50:15.575 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:15.571+0000 7fe1d252c640 1 --2- 172.21.15.40:0/3632460039 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe1b80047c0 0x7fe1cc14fd50 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7fe1c8011600 tx=0x7fe1c8011ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:50:15.575 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:15.571+0000 7fe1c2ffd640 1 -- 172.21.15.40:0/3632460039 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1c800f920 con 0x7fe1b80047c0 2023-12-17T11:50:15.575 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:15.571+0000 7fe1c2ffd640 1 -- 172.21.15.40:0/3632460039 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1c800fa80 con 0x7fe1b80047c0 2023-12-17T11:50:15.575 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:15.571+0000 7fe1d352e640 1 -- 172.21.15.40:0/3632460039 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1cc150290 con 0x7fe1b80047c0 2023-12-17T11:50:15.575 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:15.572+0000 7fe1c2ffd640 1 -- 172.21.15.40:0/3632460039 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1c800fdf0 con 0x7fe1b80047c0 2023-12-17T11:50:15.575 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:15.572+0000 7fe1d352e640 1 -- 172.21.15.40:0/3632460039 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1cc15b100 con 0x7fe1b80047c0 2023-12-17T11:50:15.575 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:15.573+0000 7fe1d352e640 1 -- 172.21.15.40:0/3632460039 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1cc074450 con 0x7fe1b80047c0 2023-12-17T11:50:15.576 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:15.574+0000 7fe1c2ffd640 1 -- 172.21.15.40:0/3632460039 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fe1c8015460 con 0x7fe1b80047c0 2023-12-17T11:50:15.577 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:15.575+0000 7fe1c2ffd640 1 --2- 172.21.15.40:0/3632460039 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7fe1b006ae70 0x7fe1b006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:50:15.577 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:15.575+0000 7fe1c2ffd640 1 -- 172.21.15.40:0/3632460039 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fe1c8089bd0 con 0x7fe1b80047c0 2023-12-17T11:50:15.578 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:15.576+0000 7fe1d1d2b640 1 --2- 172.21.15.40:0/3632460039 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7fe1b006ae70 0x7fe1b006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:50:15.579 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:15.577+0000 7fe1d1d2b640 1 --2- 172.21.15.40:0/3632460039 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7fe1b006ae70 0x7fe1b006d330 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fe1bc036000 tx=0x7fe1bc030000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:50:15.581 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:15.579+0000 7fe1c2ffd640 1 -- 172.21.15.40:0/3632460039 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fe1c8054a80 con 0x7fe1b80047c0 2023-12-17T11:50:15.816 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:15.813+0000 7fe1d352e640 1 -- 172.21.15.40:0/3632460039 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fe1cc15a830 con 0x7fe1b80047c0 2023-12-17T11:50:15.816 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:15.814+0000 7fe1c2ffd640 1 -- 172.21.15.40:0/3632460039 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v15) v1 ==== 53+0+73 (secure 0 0 0) 0x7fe1c8022070 con 0x7fe1b80047c0 2023-12-17T11:50:15.816 INFO:teuthology.orchestra.run.smithi040.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-12-17T11:50:15.819 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:15.817+0000 7fe1d352e640 1 -- 172.21.15.40:0/3632460039 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7fe1b006ae70 msgr2=0x7fe1b006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:50:15.819 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:15.817+0000 7fe1d352e640 1 --2- 172.21.15.40:0/3632460039 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7fe1b006ae70 0x7fe1b006d330 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fe1bc036000 tx=0x7fe1bc030000 comp rx=0 tx=0).stop 2023-12-17T11:50:15.819 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:15.817+0000 7fe1d352e640 1 -- 172.21.15.40:0/3632460039 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe1b80047c0 msgr2=0x7fe1cc14fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:50:15.820 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:15.817+0000 7fe1d352e640 1 --2- 172.21.15.40:0/3632460039 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe1b80047c0 0x7fe1cc14fd50 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7fe1c8011600 tx=0x7fe1c8011ac0 comp rx=0 tx=0).stop 2023-12-17T11:50:15.820 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:15.817+0000 7fe1d352e640 1 -- 172.21.15.40:0/3632460039 shutdown_connections 2023-12-17T11:50:15.820 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:15.817+0000 7fe1d352e640 1 --2- 172.21.15.40:0/3632460039 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7fe1b006ae70 0x7fe1b006d330 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:50:15.820 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:15.817+0000 7fe1d352e640 1 --2- 172.21.15.40:0/3632460039 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fe1cc157b10 0x7fe1cc15b4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:50:15.820 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:15.817+0000 7fe1d352e640 1 --2- 172.21.15.40:0/3632460039 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe1cc1506e0 0x7fe1cc15abc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:50:15.820 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:15.817+0000 7fe1d352e640 1 --2- 172.21.15.40:0/3632460039 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe1b80047c0 0x7fe1cc14fd50 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:50:15.820 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:15.817+0000 7fe1d352e640 1 -- 172.21.15.40:0/3632460039 >> 172.21.15.40:0/3632460039 conn(0x7fe1cc0b0860 msgr2=0x7fe1cc0b0c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:50:15.820 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:15.817+0000 7fe1d352e640 1 -- 172.21.15.40:0/3632460039 shutdown_connections 2023-12-17T11:50:15.821 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:50:15.818+0000 7fe1d352e640 1 -- 172.21.15.40:0/3632460039 wait complete. 2023-12-17T11:50:15.839 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-12-17T11:50:15.839 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-17T11:50:15.839 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi040.front.sepia.ceph.com 2023-12-17T11:50:15.839 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-12-17T11:50:15.839 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-12-17T11:50:15.839 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-12-17T11:50:15.839 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-12-17T11:50:15.839 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-12-17T11:50:15.839 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-12-17T11:50:15.839 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-17T11:50:15.840 DEBUG:teuthology.orchestra.run.smithi040:> ip addr 2023-12-17T11:50:15.895 INFO:teuthology.orchestra.run.smithi040.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-17T11:50:15.895 INFO:teuthology.orchestra.run.smithi040.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-17T11:50:15.896 INFO:teuthology.orchestra.run.smithi040.stdout: inet 127.0.0.1/8 scope host lo 2023-12-17T11:50:15.896 INFO:teuthology.orchestra.run.smithi040.stdout: valid_lft forever preferred_lft forever 2023-12-17T11:50:15.896 INFO:teuthology.orchestra.run.smithi040.stdout: inet6 ::1/128 scope host 2023-12-17T11:50:15.896 INFO:teuthology.orchestra.run.smithi040.stdout: valid_lft forever preferred_lft forever 2023-12-17T11:50:15.896 INFO:teuthology.orchestra.run.smithi040.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-17T11:50:15.896 INFO:teuthology.orchestra.run.smithi040.stdout: link/ether 0c:c4:7a:6b:fd:16 brd ff:ff:ff:ff:ff:ff 2023-12-17T11:50:15.896 INFO:teuthology.orchestra.run.smithi040.stdout: altname enp7s0f0 2023-12-17T11:50:15.896 INFO:teuthology.orchestra.run.smithi040.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-17T11:50:15.896 INFO:teuthology.orchestra.run.smithi040.stdout: link/ether 0c:c4:7a:6b:fd:17 brd ff:ff:ff:ff:ff:ff 2023-12-17T11:50:15.896 INFO:teuthology.orchestra.run.smithi040.stdout: altname enp7s0f1 2023-12-17T11:50:15.896 INFO:teuthology.orchestra.run.smithi040.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-17T11:50:15.896 INFO:teuthology.orchestra.run.smithi040.stdout: link/ether 0c:c4:7a:bd:12:cc brd ff:ff:ff:ff:ff:ff 2023-12-17T11:50:15.897 INFO:teuthology.orchestra.run.smithi040.stdout: altname enp1s0f0 2023-12-17T11:50:15.897 INFO:teuthology.orchestra.run.smithi040.stdout: inet 172.21.15.40/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-12-17T11:50:15.897 INFO:teuthology.orchestra.run.smithi040.stdout: valid_lft 42195sec preferred_lft 42195sec 2023-12-17T11:50:15.897 INFO:teuthology.orchestra.run.smithi040.stdout: inet6 fe80::ec4:7aff:febd:12cc/64 scope link noprefixroute 2023-12-17T11:50:15.897 INFO:teuthology.orchestra.run.smithi040.stdout: valid_lft forever preferred_lft forever 2023-12-17T11:50:15.897 INFO:teuthology.orchestra.run.smithi040.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-17T11:50:15.897 INFO:teuthology.orchestra.run.smithi040.stdout: link/ether 0c:c4:7a:bd:12:cd brd ff:ff:ff:ff:ff:ff 2023-12-17T11:50:15.897 INFO:teuthology.orchestra.run.smithi040.stdout: altname enp1s0f1 2023-12-17T11:50:15.897 INFO:teuthology.orchestra.run.smithi040.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-12-17T11:50:15.897 INFO:teuthology.orchestra.run.smithi040.stdout: link/ether 02:bd:9f:94:fd:1a brd ff:ff:ff:ff:ff:ff 2023-12-17T11:50:15.897 INFO:teuthology.orchestra.run.smithi040.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-12-17T11:50:15.897 INFO:teuthology.orchestra.run.smithi040.stdout: valid_lft forever preferred_lft forever 2023-12-17T11:50:15.897 INFO:teuthology.orchestra.run.smithi040.stdout: inet6 fe80::10c7:cbff:fe6d:4f77/64 scope link 2023-12-17T11:50:15.898 INFO:teuthology.orchestra.run.smithi040.stdout: valid_lft forever preferred_lft forever 2023-12-17T11:50:15.898 INFO:teuthology.orchestra.run.smithi040.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-17T11:50:15.898 INFO:teuthology.orchestra.run.smithi040.stdout: link/ether 02:bd:9f:94:fd:1a brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-17T11:50:15.898 INFO:teuthology.orchestra.run.smithi040.stdout: inet6 fe80::bd:9fff:fe94:fd1a/64 scope link 2023-12-17T11:50:15.898 INFO:teuthology.orchestra.run.smithi040.stdout: valid_lft forever preferred_lft forever 2023-12-17T11:50:15.898 INFO:teuthology.orchestra.run.smithi040.stdout:10: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-17T11:50:15.898 INFO:teuthology.orchestra.run.smithi040.stdout: link/ether 7a:ca:ad:03:7e:f6 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-12-17T11:50:15.898 INFO:teuthology.orchestra.run.smithi040.stdout: inet6 fe80::78ca:adff:fe03:7ef6/64 scope link 2023-12-17T11:50:15.898 INFO:teuthology.orchestra.run.smithi040.stdout: valid_lft forever preferred_lft forever 2023-12-17T11:50:15.899 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-17T11:50:15.899 DEBUG:teuthology.orchestra.run.smithi040:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-17T11:50:16.001 INFO:teuthology.orchestra.run.smithi040.stdout:1 2023-12-17T11:50:16.005 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-17T11:50:16.006 DEBUG:teuthology.orchestra.run.smithi040:> route 2023-12-17T11:50:16.068 INFO:teuthology.orchestra.run.smithi040.stdout:Kernel IP routing table 2023-12-17T11:50:16.068 INFO:teuthology.orchestra.run.smithi040.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-17T11:50:16.068 INFO:teuthology.orchestra.run.smithi040.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-12-17T11:50:16.068 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-12-17T11:50:16.068 INFO:teuthology.orchestra.run.smithi040.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-17T11:50:16.068 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-17T11:50:16.068 DEBUG:teuthology.orchestra.run.smithi040:> (cd / && exec bash -c ' 2023-12-17T11:50:16.068 DEBUG:teuthology.orchestra.run.smithi040:> set -e 2023-12-17T11:50:16.069 DEBUG:teuthology.orchestra.run.smithi040:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-12-17T11:50:16.069 DEBUG:teuthology.orchestra.run.smithi040:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-12-17T11:50:16.069 DEBUG:teuthology.orchestra.run.smithi040:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-12-17T11:50:16.069 DEBUG:teuthology.orchestra.run.smithi040:> ') 2023-12-17T11:50:16.267 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-17T11:50:16.268 DEBUG:teuthology.orchestra.run.smithi040:> ip netns list 2023-12-17T11:50:16.321 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-12-17T11:50:16.321 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-12-17T11:50:16.322 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-12-17T11:50:16.322 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-17T11:50:16.323 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip link set brx.0 up 2023-12-17T11:50:16.423 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-17T11:50:16.423 DEBUG:teuthology.orchestra.run.smithi040:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-12-17T11:50:16.483 INFO:teuthology.orchestra.run.smithi040.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-12-17T11:50:16.483 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-17T11:50:16.483 DEBUG:teuthology.orchestra.run.smithi040:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-12-17T11:50:16.545 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-12-17T11:50:16.545 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-17T11:50:16.546 DEBUG:teuthology.orchestra.run.smithi040:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-12-17T11:50:16.699 INFO:teuthology.orchestra.run.smithi040.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-12-17T11:50:16.699 INFO:teuthology.orchestra.run.smithi040.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-12-17T11:50:16.699 INFO:teuthology.orchestra.run.smithi040.stdout:invalid new device string format 2023-12-17T11:50:16.722 INFO:teuthology.orchestra.run.smithi040.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-12-17T11:50:16.722 INFO:teuthology.orchestra.run.smithi040.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-12-17T11:50:16.723 INFO:teuthology.orchestra.run.smithi040.stdout:invalid new device string format 2023-12-17T11:50:16.723 INFO:teuthology.orchestra.run.smithi040.stdout:mount.ceph: resolved to: "172.21.15.40:3300,172.21.15.159:3300,172.21.15.159:3301" 2023-12-17T11:50:16.723 INFO:teuthology.orchestra.run.smithi040.stdout:mount.ceph: switching to using v1 address with old syntax 2023-12-17T11:50:16.752 INFO:teuthology.orchestra.run.smithi040.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-12-17T11:50:16.752 INFO:teuthology.orchestra.run.smithi040.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-12-17T11:50:16.752 INFO:teuthology.orchestra.run.smithi040.stdout:invalid new device string format 2023-12-17T11:50:16.753 INFO:teuthology.orchestra.run.smithi040.stdout:mount.ceph: resolved to: "172.21.15.40:3300,172.21.15.159:3300,172.21.15.159:3301" 2023-12-17T11:50:16.753 INFO:teuthology.orchestra.run.smithi040.stdout:mount.ceph: switching to using v1 address with old syntax 2023-12-17T11:50:16.753 INFO:teuthology.orchestra.run.smithi040.stdout:mount.ceph: resolved to: "172.21.15.40:6789,172.21.15.159:6789,172.21.15.159:6790" 2023-12-17T11:50:16.753 INFO:teuthology.orchestra.run.smithi040.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.40:6789,172.21.15.159:6789,172.21.15.159:6790:/ 2023-12-17T11:50:16.753 INFO:teuthology.orchestra.run.smithi040.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=099cd35d-80d9-4ca4-8424-de13b3b03ac7" will pass to kernel 2023-12-17T11:50:16.755 INFO:teuthology.orchestra.run.smithi040.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2023-12-17T11:50:16.755 INFO:teuthology.orchestra.run.smithi040.stdout: You just mounted a file system that supports labels which does not 2023-12-17T11:50:16.755 INFO:teuthology.orchestra.run.smithi040.stdout: contain labels, onto an SELinux box. It is likely that confined 2023-12-17T11:50:16.755 INFO:teuthology.orchestra.run.smithi040.stdout: applications will generate AVC messages and not be allowed access to 2023-12-17T11:50:16.755 INFO:teuthology.orchestra.run.smithi040.stdout: this file system. For more details see restorecon(8) and mount(8). 2023-12-17T11:50:16.761 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-12-17T11:50:16.762 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-17T11:50:16.762 DEBUG:teuthology.orchestra.run.smithi040:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-12-17T11:50:16.861 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-17T11:50:16.861 DEBUG:teuthology.orchestra.run.smithi040:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-17T11:50:16.943 INFO:teuthology.orchestra.run.smithi040.stdout:client5032 2023-12-17T11:50:16.944 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2023-12-17T11:50:16.944 DEBUG:teuthology.orchestra.run.smithi040:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-17T11:50:17.003 DEBUG:teuthology.orchestra.run.smithi040:> mktemp -d --suffix=xfstests-dev 2023-12-17T11:50:17.059 INFO:teuthology.orchestra.run.smithi040.stdout:/tmp/tmp.34EJEHEKBdxfstests-dev 2023-12-17T11:50:17.060 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-17T11:50:17.060 DEBUG:teuthology.orchestra.run.smithi040:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo chmod a+rx /tmp/tmp.34EJEHEKBdxfstests-dev) 2023-12-17T11:50:17.166 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-17T11:50:17.166 DEBUG:teuthology.orchestra.run.smithi040:> (cd /home/ubuntu/cephtest/mnt.0 && exec git clone https://git.ceph.com/xfstests-dev.git --depth 1 /tmp/tmp.34EJEHEKBdxfstests-dev) 2023-12-17T11:50:17.237 INFO:teuthology.orchestra.run.smithi040.stderr:Cloning into '/tmp/tmp.34EJEHEKBdxfstests-dev'... 2023-12-17T11:50:18.366 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-17T11:50:18.366 DEBUG:teuthology.orchestra.run.smithi040:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir test) 2023-12-17T11:50:18.438 DEBUG:teuthology.orchestra.run.smithi040:> mktemp -d --suffix=test 2023-12-17T11:50:18.500 INFO:teuthology.orchestra.run.smithi040.stdout:/tmp/tmp.LcXCCPenVTtest 2023-12-17T11:50:18.501 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-17T11:50:18.501 DEBUG:teuthology.orchestra.run.smithi040:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir scratch) 2023-12-17T11:50:18.565 DEBUG:teuthology.orchestra.run.smithi040:> mktemp -d --suffix=scratch 2023-12-17T11:50:18.621 INFO:teuthology.orchestra.run.smithi040.stdout:/tmp/tmp.k3h64vAtcuscratch 2023-12-17T11:50:18.621 INFO:tasks.cephfs.xfstests_dev:distro and version detected is "centos" and "9". 2023-12-17T11:50:18.621 DEBUG:teuthology.orchestra.run.smithi040:> sudo yum install -y acl attr automake bc dbench dump e2fsprogs fio gawk gcc gdbm-devel git indent kernel-devel libacl-devel libaio-devel libcap-devel libtool libuuid-devel lvm2 make psmisc python3 quota sed sqlite udftools xfsprogs 2023-12-17T11:50:19.495 INFO:teuthology.orchestra.run.smithi040.stdout:Last metadata expiration check: 0:05:02 ago on Sun 17 Dec 2023 11:45:17 AM UTC. 2023-12-17T11:50:19.592 INFO:teuthology.orchestra.run.smithi040.stdout:Package acl-2.3.1-4.el9.x86_64 is already installed. 2023-12-17T11:50:19.593 INFO:teuthology.orchestra.run.smithi040.stdout:Package attr-2.5.1-3.el9.x86_64 is already installed. 2023-12-17T11:50:19.594 INFO:teuthology.orchestra.run.smithi040.stdout:Package automake-1.16.2-8.el9.noarch is already installed. 2023-12-17T11:50:19.595 INFO:teuthology.orchestra.run.smithi040.stdout:Package bc-1.07.1-14.el9.x86_64 is already installed. 2023-12-17T11:50:19.596 INFO:teuthology.orchestra.run.smithi040.stdout:Package dbench-4.0-25.el9.x86_64 is already installed. 2023-12-17T11:50:19.598 INFO:teuthology.orchestra.run.smithi040.stdout:Package e2fsprogs-1.46.5-3.el9.x86_64 is already installed. 2023-12-17T11:50:19.600 INFO:teuthology.orchestra.run.smithi040.stdout:Package gawk-5.1.0-6.el9.x86_64 is already installed. 2023-12-17T11:50:19.602 INFO:teuthology.orchestra.run.smithi040.stdout:Package gcc-11.4.1-2.1.el9.x86_64 is already installed. 2023-12-17T11:50:19.604 INFO:teuthology.orchestra.run.smithi040.stdout:Package git-2.39.3-1.el9.x86_64 is already installed. 2023-12-17T11:50:19.607 INFO:teuthology.orchestra.run.smithi040.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2023-12-17T11:50:19.608 INFO:teuthology.orchestra.run.smithi040.stdout:Package libaio-devel-0.3.111-13.el9.x86_64 is already installed. 2023-12-17T11:50:19.610 INFO:teuthology.orchestra.run.smithi040.stdout:Package libtool-2.4.6-45.el9.x86_64 is already installed. 2023-12-17T11:50:19.611 INFO:teuthology.orchestra.run.smithi040.stdout:Package libuuid-devel-2.37.4-15.el9.x86_64 is already installed. 2023-12-17T11:50:19.612 INFO:teuthology.orchestra.run.smithi040.stdout:Package lvm2-9:2.03.21-3.el9.x86_64 is already installed. 2023-12-17T11:50:19.613 INFO:teuthology.orchestra.run.smithi040.stdout:Package make-1:4.3-7.el9.x86_64 is already installed. 2023-12-17T11:50:19.614 INFO:teuthology.orchestra.run.smithi040.stdout:Package psmisc-23.4-3.el9.x86_64 is already installed. 2023-12-17T11:50:19.615 INFO:teuthology.orchestra.run.smithi040.stdout:Package python3-3.9.17-2.el9.x86_64 is already installed. 2023-12-17T11:50:19.616 INFO:teuthology.orchestra.run.smithi040.stdout:Package quota-1:4.06-6.el9.x86_64 is already installed. 2023-12-17T11:50:19.618 INFO:teuthology.orchestra.run.smithi040.stdout:Package sed-4.8-9.el9.x86_64 is already installed. 2023-12-17T11:50:19.620 INFO:teuthology.orchestra.run.smithi040.stdout:Package xfsprogs-5.19.0-4.el9.x86_64 is already installed. 2023-12-17T11:50:19.683 INFO:teuthology.orchestra.run.smithi040.stdout:Dependencies resolved. 2023-12-17T11:50:19.686 INFO:teuthology.orchestra.run.smithi040.stdout:================================================================================ 2023-12-17T11:50:19.686 INFO:teuthology.orchestra.run.smithi040.stdout: Package Arch Version Repository Size 2023-12-17T11:50:19.687 INFO:teuthology.orchestra.run.smithi040.stdout:================================================================================ 2023-12-17T11:50:19.687 INFO:teuthology.orchestra.run.smithi040.stdout:Installing: 2023-12-17T11:50:19.687 INFO:teuthology.orchestra.run.smithi040.stdout: dump x86_64 1:0.4-0.51.b47.el9 epel 88 k 2023-12-17T11:50:19.687 INFO:teuthology.orchestra.run.smithi040.stdout: fio x86_64 3.35-1.el9 CentOS-AppStream 6.2 M 2023-12-17T11:50:19.687 INFO:teuthology.orchestra.run.smithi040.stdout: gdbm-devel x86_64 1:1.19-4.el9 crb 59 k 2023-12-17T11:50:19.687 INFO:teuthology.orchestra.run.smithi040.stdout: indent x86_64 2.2.13-4.el9 epel 179 k 2023-12-17T11:50:19.687 INFO:teuthology.orchestra.run.smithi040.stdout: kernel-devel x86_64 5.14.0-391.el9 appstream 21 M 2023-12-17T11:50:19.687 INFO:teuthology.orchestra.run.smithi040.stdout: libcap-devel x86_64 2.48-9.el9 CentOS-AppStream 33 k 2023-12-17T11:50:19.687 INFO:teuthology.orchestra.run.smithi040.stdout: sqlite x86_64 3.34.1-6.el9 CentOS-AppStream 747 k 2023-12-17T11:50:19.687 INFO:teuthology.orchestra.run.smithi040.stdout: udftools x86_64 2.2-5.el9 CentOS-AppStream 144 k 2023-12-17T11:50:19.687 INFO:teuthology.orchestra.run.smithi040.stdout:Upgrading: 2023-12-17T11:50:19.687 INFO:teuthology.orchestra.run.smithi040.stdout: cpp x86_64 11.4.1-2.3.el9 CentOS-AppStream 11 M 2023-12-17T11:50:19.687 INFO:teuthology.orchestra.run.smithi040.stdout: e2fsprogs x86_64 1.46.5-4.el9 CentOS-BaseOS 1.0 M 2023-12-17T11:50:19.687 INFO:teuthology.orchestra.run.smithi040.stdout: e2fsprogs-libs x86_64 1.46.5-4.el9 CentOS-BaseOS 221 k 2023-12-17T11:50:19.688 INFO:teuthology.orchestra.run.smithi040.stdout: gcc x86_64 11.4.1-2.3.el9 CentOS-AppStream 32 M 2023-12-17T11:50:19.688 INFO:teuthology.orchestra.run.smithi040.stdout: gcc-c++ x86_64 11.4.1-2.3.el9 CentOS-AppStream 13 M 2023-12-17T11:50:19.688 INFO:teuthology.orchestra.run.smithi040.stdout: gcc-plugin-annobin x86_64 11.4.1-2.3.el9 CentOS-AppStream 47 k 2023-12-17T11:50:19.688 INFO:teuthology.orchestra.run.smithi040.stdout: libcom_err x86_64 1.46.5-4.el9 CentOS-BaseOS 25 k 2023-12-17T11:50:19.688 INFO:teuthology.orchestra.run.smithi040.stdout: libgcc x86_64 11.4.1-2.3.el9 CentOS-BaseOS 92 k 2023-12-17T11:50:19.688 INFO:teuthology.orchestra.run.smithi040.stdout: libgomp x86_64 11.4.1-2.3.el9 CentOS-BaseOS 268 k 2023-12-17T11:50:19.688 INFO:teuthology.orchestra.run.smithi040.stdout: libss x86_64 1.46.5-4.el9 CentOS-BaseOS 31 k 2023-12-17T11:50:19.688 INFO:teuthology.orchestra.run.smithi040.stdout: libstdc++ x86_64 11.4.1-2.3.el9 CentOS-BaseOS 735 k 2023-12-17T11:50:19.688 INFO:teuthology.orchestra.run.smithi040.stdout: libstdc++-devel x86_64 11.4.1-2.3.el9 CentOS-AppStream 2.2 M 2023-12-17T11:50:19.688 INFO:teuthology.orchestra.run.smithi040.stdout: python-unversioned-command noarch 3.9.18-1.el9 CentOS-AppStream 8.8 k 2023-12-17T11:50:19.688 INFO:teuthology.orchestra.run.smithi040.stdout: python3 x86_64 3.9.18-1.el9 CentOS-BaseOS 26 k 2023-12-17T11:50:19.688 INFO:teuthology.orchestra.run.smithi040.stdout: python3-devel x86_64 3.9.18-1.el9 CentOS-AppStream 204 k 2023-12-17T11:50:19.688 INFO:teuthology.orchestra.run.smithi040.stdout: python3-libs x86_64 3.9.18-1.el9 CentOS-BaseOS 7.3 M 2023-12-17T11:50:19.688 INFO:teuthology.orchestra.run.smithi040.stdout:Installing dependencies: 2023-12-17T11:50:19.688 INFO:teuthology.orchestra.run.smithi040.stdout: gdbm x86_64 1:1.19-4.el9 crb 132 k 2023-12-17T11:50:19.689 INFO:teuthology.orchestra.run.smithi040.stdout: libnbd x86_64 1.18.1-3.el9 appstream 166 k 2023-12-17T11:50:19.689 INFO:teuthology.orchestra.run.smithi040.stdout: rmt x86_64 2:1.6-6.el9 CentOS-BaseOS 45 k 2023-12-17T11:50:19.689 INFO:teuthology.orchestra.run.smithi040.stdout:Installing weak dependencies: 2023-12-17T11:50:19.689 INFO:teuthology.orchestra.run.smithi040.stdout: fio-engine-http x86_64 3.35-1.el9 CentOS-AppStream 17 k 2023-12-17T11:50:19.689 INFO:teuthology.orchestra.run.smithi040.stdout: fio-engine-libaio x86_64 3.35-1.el9 CentOS-AppStream 14 k 2023-12-17T11:50:19.689 INFO:teuthology.orchestra.run.smithi040.stdout: fio-engine-nbd x86_64 3.35-1.el9 CentOS-AppStream 13 k 2023-12-17T11:50:19.689 INFO:teuthology.orchestra.run.smithi040.stdout: fio-engine-rados x86_64 3.35-1.el9 CentOS-AppStream 15 k 2023-12-17T11:50:19.689 INFO:teuthology.orchestra.run.smithi040.stdout: fio-engine-rbd x86_64 3.35-1.el9 CentOS-AppStream 15 k 2023-12-17T11:50:19.689 INFO:teuthology.orchestra.run.smithi040.stdout: fio-engine-rdma x86_64 3.35-1.el9 CentOS-AppStream 20 k 2023-12-17T11:50:19.689 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T11:50:19.689 INFO:teuthology.orchestra.run.smithi040.stdout:Transaction Summary 2023-12-17T11:50:19.689 INFO:teuthology.orchestra.run.smithi040.stdout:================================================================================ 2023-12-17T11:50:19.689 INFO:teuthology.orchestra.run.smithi040.stdout:Install 17 Packages 2023-12-17T11:50:19.689 INFO:teuthology.orchestra.run.smithi040.stdout:Upgrade 16 Packages 2023-12-17T11:50:19.690 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T11:50:19.690 INFO:teuthology.orchestra.run.smithi040.stdout:Total download size: 97 M 2023-12-17T11:50:19.690 INFO:teuthology.orchestra.run.smithi040.stdout:Downloading Packages: 2023-12-17T11:50:20.867 INFO:teuthology.orchestra.run.smithi040.stdout:(1/33): fio-engine-http-3.35-1.el9.x86_64.rpm 64 kB/s | 17 kB 00:00 2023-12-17T11:50:20.882 INFO:teuthology.orchestra.run.smithi040.stdout:(2/33): fio-engine-libaio-3.35-1.el9.x86_64.rpm 52 kB/s | 14 kB 00:00 2023-12-17T11:50:21.141 INFO:teuthology.orchestra.run.smithi040.stdout:(3/33): fio-engine-nbd-3.35-1.el9.x86_64.rpm 50 kB/s | 13 kB 00:00 2023-12-17T11:50:21.158 INFO:teuthology.orchestra.run.smithi040.stdout:(4/33): fio-engine-rados-3.35-1.el9.x86_64.rpm 53 kB/s | 15 kB 00:00 2023-12-17T11:50:21.449 INFO:teuthology.orchestra.run.smithi040.stdout:(5/33): fio-engine-rbd-3.35-1.el9.x86_64.rpm 52 kB/s | 15 kB 00:00 2023-12-17T11:50:21.475 INFO:teuthology.orchestra.run.smithi040.stdout:(6/33): fio-engine-rdma-3.35-1.el9.x86_64.rpm 62 kB/s | 20 kB 00:00 2023-12-17T11:50:21.817 INFO:teuthology.orchestra.run.smithi040.stdout:(7/33): libcap-devel-2.48-9.el9.x86_64.rpm 90 kB/s | 33 kB 00:00 2023-12-17T11:50:21.925 INFO:teuthology.orchestra.run.smithi040.stdout:(8/33): sqlite-3.34.1-6.el9.x86_64.rpm 1.6 MB/s | 747 kB 00:00 2023-12-17T11:50:22.084 INFO:teuthology.orchestra.run.smithi040.stdout:(9/33): fio-3.35-1.el9.x86_64.rpm 4.2 MB/s | 6.2 MB 00:01 2023-12-17T11:50:22.118 INFO:teuthology.orchestra.run.smithi040.stdout:(10/33): udftools-2.2-5.el9.x86_64.rpm 481 kB/s | 144 kB 00:00 2023-12-17T11:50:22.135 INFO:teuthology.orchestra.run.smithi040.stdout:(11/33): rmt-1.6-6.el9.x86_64.rpm 221 kB/s | 45 kB 00:00 2023-12-17T11:50:22.485 INFO:teuthology.orchestra.run.smithi040.stdout:(12/33): gdbm-1.19-4.el9.x86_64.rpm 379 kB/s | 132 kB 00:00 2023-12-17T11:50:22.560 INFO:teuthology.orchestra.run.smithi040.stdout:(13/33): gdbm-devel-1.19-4.el9.x86_64.rpm 790 kB/s | 59 kB 00:00 2023-12-17T11:50:22.927 INFO:teuthology.orchestra.run.smithi040.stdout:(14/33): libnbd-1.18.1-3.el9.x86_64.rpm 210 kB/s | 166 kB 00:00 2023-12-17T11:50:23.078 INFO:teuthology.orchestra.run.smithi040.stdout:(15/33): dump-0.4-0.51.b47.el9.x86_64.rpm 170 kB/s | 88 kB 00:00 2023-12-17T11:50:23.836 INFO:teuthology.orchestra.run.smithi040.stdout:(16/33): indent-2.2.13-4.el9.x86_64.rpm 198 kB/s | 179 kB 00:00 2023-12-17T11:50:24.128 INFO:teuthology.orchestra.run.smithi040.stdout:(17/33): kernel-devel-5.14.0-391.el9.x86_64.rpm 10 MB/s | 21 MB 00:02 2023-12-17T11:50:24.612 INFO:teuthology.orchestra.run.smithi040.stdout:(18/33): cpp-11.4.1-2.3.el9.x86_64.rpm 6.9 MB/s | 11 MB 00:01 2023-12-17T11:50:24.904 INFO:teuthology.orchestra.run.smithi040.stdout:(19/33): gcc-plugin-annobin-11.4.1-2.3.el9.x86_ 162 kB/s | 47 kB 00:00 2023-12-17T11:50:25.687 INFO:teuthology.orchestra.run.smithi040.stdout:(20/33): libstdc++-devel-11.4.1-2.3.el9.x86_64. 2.9 MB/s | 2.2 MB 00:00 2023-12-17T11:50:25.963 INFO:teuthology.orchestra.run.smithi040.stdout:(21/33): python-unversioned-command-3.9.18-1.el 33 kB/s | 8.8 kB 00:00 2023-12-17T11:50:26.255 INFO:teuthology.orchestra.run.smithi040.stdout:(22/33): python3-devel-3.9.18-1.el9.x86_64.rpm 713 kB/s | 204 kB 00:00 2023-12-17T11:50:26.780 INFO:teuthology.orchestra.run.smithi040.stdout:(23/33): gcc-c++-11.4.1-2.3.el9.x86_64.rpm 4.8 MB/s | 13 MB 00:02 2023-12-17T11:50:26.847 INFO:teuthology.orchestra.run.smithi040.stdout:(24/33): e2fsprogs-1.46.5-4.el9.x86_64.rpm 1.7 MB/s | 1.0 MB 00:00 2023-12-17T11:50:27.164 INFO:teuthology.orchestra.run.smithi040.stdout:(25/33): e2fsprogs-libs-1.46.5-4.el9.x86_64.rpm 590 kB/s | 221 kB 00:00 2023-12-17T11:50:27.256 INFO:teuthology.orchestra.run.smithi040.stdout:(26/33): libcom_err-1.46.5-4.el9.x86_64.rpm 62 kB/s | 25 kB 00:00 2023-12-17T11:50:27.714 INFO:teuthology.orchestra.run.smithi040.stdout:(27/33): gcc-11.4.1-2.3.el9.x86_64.rpm 8.3 MB/s | 32 MB 00:03 2023-12-17T11:50:27.748 INFO:teuthology.orchestra.run.smithi040.stdout:(28/33): libgcc-11.4.1-2.3.el9.x86_64.rpm 160 kB/s | 92 kB 00:00 2023-12-17T11:50:27.773 INFO:teuthology.orchestra.run.smithi040.stdout:(29/33): libgomp-11.4.1-2.3.el9.x86_64.rpm 536 kB/s | 268 kB 00:00 2023-12-17T11:50:27.832 INFO:teuthology.orchestra.run.smithi040.stdout:(30/33): python3-3.9.18-1.el9.x86_64.rpm 449 kB/s | 26 kB 00:00 2023-12-17T11:50:27.885 INFO:teuthology.orchestra.run.smithi040.stdout:(31/33): libstdc++-11.4.1-2.3.el9.x86_64.rpm 6.7 MB/s | 735 kB 00:00 2023-12-17T11:50:27.915 INFO:teuthology.orchestra.run.smithi040.stdout:(32/33): libss-1.46.5-4.el9.x86_64.rpm 156 kB/s | 31 kB 00:00 2023-12-17T11:50:28.232 INFO:teuthology.orchestra.run.smithi040.stdout:(33/33): python3-libs-3.9.18-1.el9.x86_64.rpm 18 MB/s | 7.3 MB 00:00 2023-12-17T11:50:28.241 INFO:teuthology.orchestra.run.smithi040.stdout:-------------------------------------------------------------------------------- 2023-12-17T11:50:28.242 INFO:teuthology.orchestra.run.smithi040.stdout:Total 11 MB/s | 97 MB 00:08 2023-12-17T11:50:28.606 INFO:teuthology.orchestra.run.smithi040.stdout:Running transaction check 2023-12-17T11:50:29.008 INFO:teuthology.orchestra.run.smithi040.stdout:Transaction check succeeded. 2023-12-17T11:50:29.008 INFO:teuthology.orchestra.run.smithi040.stdout:Running transaction test 2023-12-17T11:50:30.393 INFO:teuthology.orchestra.run.smithi040.stdout:Transaction test succeeded. 2023-12-17T11:50:30.393 INFO:teuthology.orchestra.run.smithi040.stdout:Running transaction 2023-12-17T11:50:32.895 INFO:teuthology.orchestra.run.smithi040.stdout: Preparing : 1/1 2023-12-17T11:50:32.972 INFO:teuthology.orchestra.run.smithi040.stdout: Upgrading : libcom_err-1.46.5-4.el9.x86_64 1/49 2023-12-17T11:50:33.017 INFO:teuthology.orchestra.run.smithi040.stdout: Upgrading : libgcc-11.4.1-2.3.el9.x86_64 2/49 2023-12-17T11:50:33.148 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: libgcc-11.4.1-2.3.el9.x86_64 2/49 2023-12-17T11:50:33.234 INFO:teuthology.orchestra.run.smithi040.stdout: Upgrading : libstdc++-11.4.1-2.3.el9.x86_64 3/49 2023-12-17T11:50:34.041 INFO:teuthology.orchestra.run.smithi040.stdout: Upgrading : e2fsprogs-libs-1.46.5-4.el9.x86_64 4/49 2023-12-17T11:50:34.303 INFO:teuthology.orchestra.run.smithi040.stdout: Upgrading : libstdc++-devel-11.4.1-2.3.el9.x86_64 5/49 2023-12-17T11:50:35.978 INFO:teuthology.orchestra.run.smithi040.stdout: Upgrading : libss-1.46.5-4.el9.x86_64 6/49 2023-12-17T11:50:36.190 INFO:teuthology.orchestra.run.smithi040.stdout: Upgrading : python3-libs-3.9.18-1.el9.x86_64 7/49 2023-12-17T11:50:36.218 INFO:teuthology.orchestra.run.smithi040.stdout: Upgrading : python3-3.9.18-1.el9.x86_64 8/49 2023-12-17T11:50:36.258 INFO:teuthology.orchestra.run.smithi040.stdout: Upgrading : python-unversioned-command-3.9.18-1.el9.noarch 9/49 2023-12-17T11:50:36.574 INFO:teuthology.orchestra.run.smithi040.stdout: Upgrading : libgomp-11.4.1-2.3.el9.x86_64 10/49 2023-12-17T11:50:37.588 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T11:50:37.598 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T11:50:37.825 INFO:teuthology.orchestra.run.smithi040.stdout: Upgrading : cpp-11.4.1-2.3.el9.x86_64 11/49 2023-12-17T11:50:38.108 INFO:teuthology.orchestra.run.smithi040.stdout: Upgrading : gcc-11.4.1-2.3.el9.x86_64 12/49 2023-12-17T11:50:38.234 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: gcc-11.4.1-2.3.el9.x86_64 12/49 2023-12-17T11:50:38.304 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : gdbm-1:1.19-4.el9.x86_64 13/49 2023-12-17T11:50:38.339 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : libnbd-1.18.1-3.el9.x86_64 14/49 2023-12-17T11:50:38.389 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : fio-engine-http-3.35-1.el9.x86_64 15/49 2023-12-17T11:50:38.431 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : fio-engine-libaio-3.35-1.el9.x86_64 16/49 2023-12-17T11:50:38.465 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : fio-engine-nbd-3.35-1.el9.x86_64 17/49 2023-12-17T11:50:38.499 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : fio-engine-rados-3.35-1.el9.x86_64 18/49 2023-12-17T11:50:38.533 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : fio-engine-rbd-3.35-1.el9.x86_64 19/49 2023-12-17T11:50:38.799 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : fio-engine-rdma-3.35-1.el9.x86_64 20/49 2023-12-17T11:50:38.844 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : fio-3.35-1.el9.x86_64 21/49 2023-12-17T11:50:38.882 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : rmt-2:1.6-6.el9.x86_64 22/49 2023-12-17T11:50:38.912 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : dump-1:0.4-0.51.b47.el9.x86_64 23/49 2023-12-17T11:50:50.657 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : gdbm-devel-1:1.19-4.el9.x86_64 24/49 2023-12-17T11:50:50.920 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : kernel-devel-5.14.0-391.el9.x86_64 25/49 2023-12-17T11:51:08.094 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T11:51:08.105 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T11:51:38.242 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T11:51:38.249 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T11:51:45.136 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: kernel-devel-5.14.0-391.el9.x86_64 25/49 2023-12-17T11:51:45.247 INFO:teuthology.orchestra.run.smithi040.stdout: Upgrading : gcc-c++-11.4.1-2.3.el9.x86_64 26/49 2023-12-17T11:51:45.286 INFO:teuthology.orchestra.run.smithi040.stdout: Upgrading : gcc-plugin-annobin-11.4.1-2.3.el9.x86_64 27/49 2023-12-17T11:51:45.495 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: gcc-plugin-annobin-11.4.1-2.3.el9.x86_64 27/49 2023-12-17T11:51:45.640 INFO:teuthology.orchestra.run.smithi040.stdout: Upgrading : python3-devel-3.9.18-1.el9.x86_64 28/49 2023-12-17T11:51:45.821 INFO:teuthology.orchestra.run.smithi040.stdout: Upgrading : e2fsprogs-1.46.5-4.el9.x86_64 29/49 2023-12-17T11:51:45.891 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : indent-2.2.13-4.el9.x86_64 30/49 2023-12-17T11:51:45.948 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : udftools-2.2-5.el9.x86_64 31/49 2023-12-17T11:51:46.024 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : sqlite-3.34.1-6.el9.x86_64 32/49 2023-12-17T11:51:46.061 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : libcap-devel-2.48-9.el9.x86_64 33/49 2023-12-17T11:51:46.099 INFO:teuthology.orchestra.run.smithi040.stdout: Cleanup : e2fsprogs-1.46.5-3.el9.x86_64 34/49 2023-12-17T11:51:46.137 INFO:teuthology.orchestra.run.smithi040.stdout: Cleanup : gcc-c++-11.4.1-2.1.el9.x86_64 35/49 2023-12-17T11:51:46.173 INFO:teuthology.orchestra.run.smithi040.stdout: Cleanup : python3-devel-3.9.17-2.el9.x86_64 36/49 2023-12-17T11:51:46.198 INFO:teuthology.orchestra.run.smithi040.stdout: Cleanup : python3-3.9.17-2.el9.x86_64 37/49 2023-12-17T11:51:46.216 INFO:teuthology.orchestra.run.smithi040.stdout: Cleanup : python-unversioned-command-3.9.17-2.el9.noarch 38/49 2023-12-17T11:51:46.217 INFO:teuthology.orchestra.run.smithi040.stdout: Cleanup : gcc-plugin-annobin-11.4.1-2.1.el9.x86_64 39/49 2023-12-17T11:51:46.328 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: gcc-plugin-annobin-11.4.1-2.1.el9.x86_64 39/49 2023-12-17T11:51:46.376 INFO:teuthology.orchestra.run.smithi040.stdout: Cleanup : gcc-11.4.1-2.1.el9.x86_64 40/49 2023-12-17T11:51:46.451 INFO:teuthology.orchestra.run.smithi040.stdout: Cleanup : e2fsprogs-libs-1.46.5-3.el9.x86_64 41/49 2023-12-17T11:51:46.527 INFO:teuthology.orchestra.run.smithi040.stdout: Cleanup : libss-1.46.5-3.el9.x86_64 42/49 2023-12-17T11:51:46.578 INFO:teuthology.orchestra.run.smithi040.stdout: Cleanup : libstdc++-devel-11.4.1-2.1.el9.x86_64 43/49 2023-12-17T11:51:46.610 INFO:teuthology.orchestra.run.smithi040.stdout: Cleanup : libstdc++-11.4.1-2.1.el9.x86_64 44/49 2023-12-17T11:51:46.610 INFO:teuthology.orchestra.run.smithi040.stdout: Cleanup : libgcc-11.4.1-2.1.el9.x86_64 45/49 2023-12-17T11:51:46.739 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: libgcc-11.4.1-2.1.el9.x86_64 45/49 2023-12-17T11:51:46.771 INFO:teuthology.orchestra.run.smithi040.stdout: Cleanup : libcom_err-1.46.5-3.el9.x86_64 46/49 2023-12-17T11:51:46.812 INFO:teuthology.orchestra.run.smithi040.stdout: Cleanup : cpp-11.4.1-2.1.el9.x86_64 47/49 2023-12-17T11:51:46.955 INFO:teuthology.orchestra.run.smithi040.stdout: Cleanup : libgomp-11.4.1-2.1.el9.x86_64 48/49 2023-12-17T11:51:47.093 INFO:teuthology.orchestra.run.smithi040.stdout: Cleanup : python3-libs-3.9.17-2.el9.x86_64 49/49 2023-12-17T11:51:48.623 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: python3-libs-3.9.17-2.el9.x86_64 49/49 2023-12-17T11:51:48.623 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : fio-3.35-1.el9.x86_64 1/49 2023-12-17T11:51:48.623 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : fio-engine-http-3.35-1.el9.x86_64 2/49 2023-12-17T11:51:48.623 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : fio-engine-libaio-3.35-1.el9.x86_64 3/49 2023-12-17T11:51:48.623 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : fio-engine-nbd-3.35-1.el9.x86_64 4/49 2023-12-17T11:51:48.623 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : fio-engine-rados-3.35-1.el9.x86_64 5/49 2023-12-17T11:51:48.623 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : fio-engine-rbd-3.35-1.el9.x86_64 6/49 2023-12-17T11:51:48.623 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : fio-engine-rdma-3.35-1.el9.x86_64 7/49 2023-12-17T11:51:48.623 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : libcap-devel-2.48-9.el9.x86_64 8/49 2023-12-17T11:51:48.623 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : sqlite-3.34.1-6.el9.x86_64 9/49 2023-12-17T11:51:48.624 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : udftools-2.2-5.el9.x86_64 10/49 2023-12-17T11:51:48.624 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : rmt-2:1.6-6.el9.x86_64 11/49 2023-12-17T11:51:48.624 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : kernel-devel-5.14.0-391.el9.x86_64 12/49 2023-12-17T11:51:48.624 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : libnbd-1.18.1-3.el9.x86_64 13/49 2023-12-17T11:51:48.624 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : gdbm-1:1.19-4.el9.x86_64 14/49 2023-12-17T11:51:48.624 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : gdbm-devel-1:1.19-4.el9.x86_64 15/49 2023-12-17T11:51:48.624 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : dump-1:0.4-0.51.b47.el9.x86_64 16/49 2023-12-17T11:51:48.624 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : indent-2.2.13-4.el9.x86_64 17/49 2023-12-17T11:51:48.624 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : cpp-11.4.1-2.3.el9.x86_64 18/49 2023-12-17T11:51:48.624 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : cpp-11.4.1-2.1.el9.x86_64 19/49 2023-12-17T11:51:48.624 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : gcc-11.4.1-2.3.el9.x86_64 20/49 2023-12-17T11:51:48.624 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : gcc-11.4.1-2.1.el9.x86_64 21/49 2023-12-17T11:51:48.624 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : gcc-c++-11.4.1-2.3.el9.x86_64 22/49 2023-12-17T11:51:48.624 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : gcc-c++-11.4.1-2.1.el9.x86_64 23/49 2023-12-17T11:51:48.625 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : gcc-plugin-annobin-11.4.1-2.3.el9.x86_64 24/49 2023-12-17T11:51:48.625 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : gcc-plugin-annobin-11.4.1-2.1.el9.x86_64 25/49 2023-12-17T11:51:48.627 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : libstdc++-devel-11.4.1-2.3.el9.x86_64 26/49 2023-12-17T11:51:48.627 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : libstdc++-devel-11.4.1-2.1.el9.x86_64 27/49 2023-12-17T11:51:48.627 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python-unversioned-command-3.9.18-1.el9.noarch 28/49 2023-12-17T11:51:48.627 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python-unversioned-command-3.9.17-2.el9.noarch 29/49 2023-12-17T11:51:48.627 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-devel-3.9.18-1.el9.x86_64 30/49 2023-12-17T11:51:48.627 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 31/49 2023-12-17T11:51:48.627 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : e2fsprogs-1.46.5-4.el9.x86_64 32/49 2023-12-17T11:51:48.627 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : e2fsprogs-1.46.5-3.el9.x86_64 33/49 2023-12-17T11:51:48.628 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : e2fsprogs-libs-1.46.5-4.el9.x86_64 34/49 2023-12-17T11:51:48.628 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : e2fsprogs-libs-1.46.5-3.el9.x86_64 35/49 2023-12-17T11:51:48.628 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : libcom_err-1.46.5-4.el9.x86_64 36/49 2023-12-17T11:51:48.628 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : libcom_err-1.46.5-3.el9.x86_64 37/49 2023-12-17T11:51:48.628 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : libgcc-11.4.1-2.3.el9.x86_64 38/49 2023-12-17T11:51:48.628 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : libgcc-11.4.1-2.1.el9.x86_64 39/49 2023-12-17T11:51:48.628 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : libgomp-11.4.1-2.3.el9.x86_64 40/49 2023-12-17T11:51:48.628 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : libgomp-11.4.1-2.1.el9.x86_64 41/49 2023-12-17T11:51:48.628 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : libss-1.46.5-4.el9.x86_64 42/49 2023-12-17T11:51:48.628 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : libss-1.46.5-3.el9.x86_64 43/49 2023-12-17T11:51:48.628 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : libstdc++-11.4.1-2.3.el9.x86_64 44/49 2023-12-17T11:51:48.628 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : libstdc++-11.4.1-2.1.el9.x86_64 45/49 2023-12-17T11:51:48.628 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-3.9.18-1.el9.x86_64 46/49 2023-12-17T11:51:48.629 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-3.9.17-2.el9.x86_64 47/49 2023-12-17T11:51:48.629 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-libs-3.9.18-1.el9.x86_64 48/49 2023-12-17T11:51:49.441 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-libs-3.9.17-2.el9.x86_64 49/49 2023-12-17T11:51:49.441 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T11:51:49.441 INFO:teuthology.orchestra.run.smithi040.stdout:Upgraded: 2023-12-17T11:51:49.441 INFO:teuthology.orchestra.run.smithi040.stdout: cpp-11.4.1-2.3.el9.x86_64 2023-12-17T11:51:49.441 INFO:teuthology.orchestra.run.smithi040.stdout: e2fsprogs-1.46.5-4.el9.x86_64 2023-12-17T11:51:49.441 INFO:teuthology.orchestra.run.smithi040.stdout: e2fsprogs-libs-1.46.5-4.el9.x86_64 2023-12-17T11:51:49.441 INFO:teuthology.orchestra.run.smithi040.stdout: gcc-11.4.1-2.3.el9.x86_64 2023-12-17T11:51:49.441 INFO:teuthology.orchestra.run.smithi040.stdout: gcc-c++-11.4.1-2.3.el9.x86_64 2023-12-17T11:51:49.441 INFO:teuthology.orchestra.run.smithi040.stdout: gcc-plugin-annobin-11.4.1-2.3.el9.x86_64 2023-12-17T11:51:49.442 INFO:teuthology.orchestra.run.smithi040.stdout: libcom_err-1.46.5-4.el9.x86_64 2023-12-17T11:51:49.442 INFO:teuthology.orchestra.run.smithi040.stdout: libgcc-11.4.1-2.3.el9.x86_64 2023-12-17T11:51:49.442 INFO:teuthology.orchestra.run.smithi040.stdout: libgomp-11.4.1-2.3.el9.x86_64 2023-12-17T11:51:49.442 INFO:teuthology.orchestra.run.smithi040.stdout: libss-1.46.5-4.el9.x86_64 2023-12-17T11:51:49.442 INFO:teuthology.orchestra.run.smithi040.stdout: libstdc++-11.4.1-2.3.el9.x86_64 2023-12-17T11:51:49.442 INFO:teuthology.orchestra.run.smithi040.stdout: libstdc++-devel-11.4.1-2.3.el9.x86_64 2023-12-17T11:51:49.442 INFO:teuthology.orchestra.run.smithi040.stdout: python-unversioned-command-3.9.18-1.el9.noarch 2023-12-17T11:51:49.442 INFO:teuthology.orchestra.run.smithi040.stdout: python3-3.9.18-1.el9.x86_64 2023-12-17T11:51:49.442 INFO:teuthology.orchestra.run.smithi040.stdout: python3-devel-3.9.18-1.el9.x86_64 2023-12-17T11:51:49.442 INFO:teuthology.orchestra.run.smithi040.stdout: python3-libs-3.9.18-1.el9.x86_64 2023-12-17T11:51:49.442 INFO:teuthology.orchestra.run.smithi040.stdout:Installed: 2023-12-17T11:51:49.443 INFO:teuthology.orchestra.run.smithi040.stdout: dump-1:0.4-0.51.b47.el9.x86_64 fio-3.35-1.el9.x86_64 2023-12-17T11:51:49.443 INFO:teuthology.orchestra.run.smithi040.stdout: fio-engine-http-3.35-1.el9.x86_64 fio-engine-libaio-3.35-1.el9.x86_64 2023-12-17T11:51:49.443 INFO:teuthology.orchestra.run.smithi040.stdout: fio-engine-nbd-3.35-1.el9.x86_64 fio-engine-rados-3.35-1.el9.x86_64 2023-12-17T11:51:49.443 INFO:teuthology.orchestra.run.smithi040.stdout: fio-engine-rbd-3.35-1.el9.x86_64 fio-engine-rdma-3.35-1.el9.x86_64 2023-12-17T11:51:49.443 INFO:teuthology.orchestra.run.smithi040.stdout: gdbm-1:1.19-4.el9.x86_64 gdbm-devel-1:1.19-4.el9.x86_64 2023-12-17T11:51:49.443 INFO:teuthology.orchestra.run.smithi040.stdout: indent-2.2.13-4.el9.x86_64 kernel-devel-5.14.0-391.el9.x86_64 2023-12-17T11:51:49.443 INFO:teuthology.orchestra.run.smithi040.stdout: libcap-devel-2.48-9.el9.x86_64 libnbd-1.18.1-3.el9.x86_64 2023-12-17T11:51:49.443 INFO:teuthology.orchestra.run.smithi040.stdout: rmt-2:1.6-6.el9.x86_64 sqlite-3.34.1-6.el9.x86_64 2023-12-17T11:51:49.443 INFO:teuthology.orchestra.run.smithi040.stdout: udftools-2.2-5.el9.x86_64 2023-12-17T11:51:49.443 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T11:51:49.443 INFO:teuthology.orchestra.run.smithi040.stdout:Complete! 2023-12-17T11:51:49.999 DEBUG:teuthology.orchestra.run.smithi040:> sudo useradd -m fsgqa 2023-12-17T11:51:50.077 INFO:teuthology.orchestra.run.smithi040.stderr:useradd: user 'fsgqa' already exists 2023-12-17T11:51:50.080 DEBUG:teuthology.orchestra.run:got remote process result: 9 2023-12-17T11:51:50.081 DEBUG:teuthology.orchestra.run.smithi040:> sudo groupadd fsgqa 2023-12-17T11:51:50.153 INFO:teuthology.orchestra.run.smithi040.stderr:groupadd: group 'fsgqa' already exists 2023-12-17T11:51:50.156 DEBUG:teuthology.orchestra.run:got remote process result: 9 2023-12-17T11:51:50.156 DEBUG:teuthology.orchestra.run.smithi040:> sudo useradd fsgqa2 2023-12-17T11:51:50.847 DEBUG:teuthology.orchestra.run.smithi040:> sudo useradd 123456-fsgqa 2023-12-17T11:51:51.469 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json mon dump 2023-12-17T11:51:51.657 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:51:51.655+0000 7fa5b162f640 1 Processor -- start 2023-12-17T11:51:51.657 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:51:51.655+0000 7fa5b162f640 1 -- start start 2023-12-17T11:51:51.660 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:51:51.656+0000 7fa5b162f640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa5ac143e00 0x7fa5ac0b4040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:51:51.660 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:51:51.656+0000 7fa5b162f640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fa5ac072180 0x7fa5ac0b4580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:51:51.660 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:51:51.656+0000 7fa5b162f640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7fa5ac06c410 0x7fa5ac0b4ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:51:51.660 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:51:51.656+0000 7fa5b162f640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5ac0b3bb0 con 0x7fa5ac072180 2023-12-17T11:51:51.660 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:51:51.656+0000 7fa5b162f640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5ac1441e0 con 0x7fa5ac06c410 2023-12-17T11:51:51.660 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:51:51.656+0000 7fa5b162f640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5ac072680 con 0x7fa5ac143e00 2023-12-17T11:51:51.660 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:51:51.657+0000 7fa5aa7fc640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fa5ac072180 0x7fa5ac0b4580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:51:51.660 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:51:51.657+0000 7fa5aa7fc640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fa5ac072180 0x7fa5ac0b4580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:42052/0 (socket says 172.21.15.40:42052) 2023-12-17T11:51:51.660 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:51:51.657+0000 7fa5aa7fc640 1 -- 172.21.15.40:0/1748838742 learned_addr learned my addr 172.21.15.40:0/1748838742 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-17T11:51:51.660 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:51:51.657+0000 7fa5ab7fe640 1 --2- 172.21.15.40:0/1748838742 >> v2:172.21.15.159:3300/0 conn(0x7fa5ac06c410 0x7fa5ac0b4ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:51:51.660 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:51:51.657+0000 7fa5aaffd640 1 --2- 172.21.15.40:0/1748838742 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa5ac143e00 0x7fa5ac0b4040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:51:51.661 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:51:51.657+0000 7fa5aa7fc640 1 -- 172.21.15.40:0/1748838742 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa5ac143e00 msgr2=0x7fa5ac0b4040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:51:51.661 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:51:51.657+0000 7fa5aa7fc640 1 --2- 172.21.15.40:0/1748838742 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa5ac143e00 0x7fa5ac0b4040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:51:51.661 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:51:51.657+0000 7fa5aa7fc640 1 -- 172.21.15.40:0/1748838742 >> v2:172.21.15.159:3300/0 conn(0x7fa5ac06c410 msgr2=0x7fa5ac0b4ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:51:51.661 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:51:51.657+0000 7fa5aa7fc640 1 --2- 172.21.15.40:0/1748838742 >> v2:172.21.15.159:3300/0 conn(0x7fa5ac06c410 0x7fa5ac0b4ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:51:51.661 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:51:51.657+0000 7fa5aa7fc640 1 -- 172.21.15.40:0/1748838742 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5ac0b1e30 con 0x7fa5ac072180 2023-12-17T11:51:51.661 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:51:51.657+0000 7fa5ab7fe640 1 --2- 172.21.15.40:0/1748838742 >> v2:172.21.15.159:3300/0 conn(0x7fa5ac06c410 0x7fa5ac0b4ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-17T11:51:51.661 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:51:51.657+0000 7fa5aaffd640 1 --2- 172.21.15.40:0/1748838742 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa5ac143e00 0x7fa5ac0b4040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-17T11:51:51.662 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:51:51.659+0000 7fa5aa7fc640 1 --2- 172.21.15.40:0/1748838742 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa5ac072180 0x7fa5ac0b4580 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7fa5ac06c8a0 tx=0x7fa5a002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8c3bc787209e53a server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:51:51.662 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:51:51.659+0000 7fa5a9ffb640 1 -- 172.21.15.40:0/1748838742 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5a0031870 con 0x7fa5ac072180 2023-12-17T11:51:51.662 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:51:51.659+0000 7fa5a9ffb640 1 -- 172.21.15.40:0/1748838742 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5a00319d0 con 0x7fa5ac072180 2023-12-17T11:51:51.662 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:51:51.659+0000 7fa5a9ffb640 1 -- 172.21.15.40:0/1748838742 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5a0031d60 con 0x7fa5ac072180 2023-12-17T11:51:51.662 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:51:51.660+0000 7fa5b162f640 1 -- 172.21.15.40:0/1748838742 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa5ac072180 msgr2=0x7fa5ac0b4580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:51:51.663 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:51:51.660+0000 7fa5b162f640 1 --2- 172.21.15.40:0/1748838742 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa5ac072180 0x7fa5ac0b4580 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7fa5ac06c8a0 tx=0x7fa5a002b910 comp rx=0 tx=0).stop 2023-12-17T11:51:51.663 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:51:51.660+0000 7fa5b162f640 1 -- 172.21.15.40:0/1748838742 shutdown_connections 2023-12-17T11:51:51.663 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:51:51.660+0000 7fa5b162f640 1 --2- 172.21.15.40:0/1748838742 >> v2:172.21.15.159:3300/0 conn(0x7fa5ac06c410 0x7fa5ac0b4ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:51:51.663 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:51:51.660+0000 7fa5b162f640 1 --2- 172.21.15.40:0/1748838742 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa5ac072180 0x7fa5ac0b4580 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:51:51.663 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:51:51.660+0000 7fa5b162f640 1 --2- 172.21.15.40:0/1748838742 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa5ac143e00 0x7fa5ac0b4040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:51:51.663 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:51:51.660+0000 7fa5b162f640 1 -- 172.21.15.40:0/1748838742 >> 172.21.15.40:0/1748838742 conn(0x7fa5ac0b0a90 msgr2=0x7fa5ac0b0e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:51:51.663 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:51:51.660+0000 7fa5b162f640 1 -- 172.21.15.40:0/1748838742 shutdown_connections 2023-12-17T11:51:51.663 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:51:51.660+0000 7fa5b162f640 1 -- 172.21.15.40:0/1748838742 wait complete. 2023-12-17T11:51:51.664 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:51:51.662+0000 7fa5b162f640 1 Processor -- start 2023-12-17T11:51:51.664 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:51:51.662+0000 7fa5b162f640 1 -- start start 2023-12-17T11:51:51.666 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:51:51.663+0000 7fa5b162f640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa5ac06c410 0x7fa5ac1e5630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:51:51.666 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:51:51.663+0000 7fa5b162f640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa5ac072180 0x7fa5ac1e0480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:51:51.666 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:51:51.663+0000 7fa5b162f640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa5ac143e00 0x7fa5ac1f2ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:51:51.667 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:51:51.663+0000 7fa5b162f640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5ac1f6290 con 0x7fa5ac072180 2023-12-17T11:51:51.667 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:51:51.663+0000 7fa5b162f640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5ac1e5b70 con 0x7fa5ac143e00 2023-12-17T11:51:51.667 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:51:51.663+0000 7fa5b162f640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5ac1e79a0 con 0x7fa5ac06c410 2023-12-17T11:51:51.667 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:51:51.664+0000 7fa5aa7fc640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa5ac072180 0x7fa5ac1e0480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:51:51.667 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:51:51.664+0000 7fa5aa7fc640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa5ac072180 0x7fa5ac1e0480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:42068/0 (socket says 172.21.15.40:42068) 2023-12-17T11:51:51.667 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:51:51.664+0000 7fa5aa7fc640 1 -- 172.21.15.40:0/1202619546 learned_addr learned my addr 172.21.15.40:0/1202619546 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-17T11:51:51.667 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:51:51.664+0000 7fa5aaffd640 1 --2- 172.21.15.40:0/1202619546 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa5ac06c410 0x7fa5ac1e5630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:51:51.667 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:51:51.664+0000 7fa5ab7fe640 1 --2- 172.21.15.40:0/1202619546 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa5ac143e00 0x7fa5ac1f2ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:51:51.667 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:51:51.664+0000 7fa5aa7fc640 1 -- 172.21.15.40:0/1202619546 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa5ac06c410 msgr2=0x7fa5ac1e5630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:51:51.667 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:51:51.664+0000 7fa5aa7fc640 1 --2- 172.21.15.40:0/1202619546 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa5ac06c410 0x7fa5ac1e5630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:51:51.667 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:51:51.664+0000 7fa5aa7fc640 1 -- 172.21.15.40:0/1202619546 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa5ac143e00 msgr2=0x7fa5ac1f2ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:51:51.667 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:51:51.664+0000 7fa5aa7fc640 1 --2- 172.21.15.40:0/1202619546 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa5ac143e00 0x7fa5ac1f2ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:51:51.667 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:51:51.664+0000 7fa5aa7fc640 1 -- 172.21.15.40:0/1202619546 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5a00094d0 con 0x7fa5ac072180 2023-12-17T11:51:51.668 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:51:51.664+0000 7fa5ab7fe640 1 --2- 172.21.15.40:0/1202619546 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa5ac143e00 0x7fa5ac1f2ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-17T11:51:51.668 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:51:51.665+0000 7fa5aa7fc640 1 --2- 172.21.15.40:0/1202619546 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa5ac072180 0x7fa5ac1e0480 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7fa5a0000c00 tx=0x7fa5a00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:51:51.668 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:51:51.665+0000 7fa5937fe640 1 -- 172.21.15.40:0/1202619546 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5a003ad10 con 0x7fa5ac072180 2023-12-17T11:51:51.669 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:51:51.665+0000 7fa5937fe640 1 -- 172.21.15.40:0/1202619546 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5a003ae70 con 0x7fa5ac072180 2023-12-17T11:51:51.669 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:51:51.665+0000 7fa5937fe640 1 -- 172.21.15.40:0/1202619546 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5a0044610 con 0x7fa5ac072180 2023-12-17T11:51:51.669 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:51:51.665+0000 7fa5b162f640 1 -- 172.21.15.40:0/1202619546 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5ac1e7c80 con 0x7fa5ac072180 2023-12-17T11:51:51.669 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:51:51.665+0000 7fa5b162f640 1 -- 172.21.15.40:0/1202619546 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5ac1e8240 con 0x7fa5ac072180 2023-12-17T11:51:51.669 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:51:51.667+0000 7fa5b162f640 1 -- 172.21.15.40:0/1202619546 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5ac0cb5e0 con 0x7fa5ac072180 2023-12-17T11:51:51.669 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:51:51.668+0000 7fa5937fe640 1 -- 172.21.15.40:0/1202619546 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fa5a004d450 con 0x7fa5ac072180 2023-12-17T11:51:51.670 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:51:51.669+0000 7fa5937fe640 1 --2- 172.21.15.40:0/1202619546 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7fa59806ae40 0x7fa59806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:51:51.671 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:51:51.669+0000 7fa5937fe640 1 -- 172.21.15.40:0/1202619546 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fa5a002d040 con 0x7fa5ac072180 2023-12-17T11:51:51.671 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:51:51.669+0000 7fa5aaffd640 1 --2- 172.21.15.40:0/1202619546 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7fa59806ae40 0x7fa59806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:51:51.672 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:51:51.671+0000 7fa5aaffd640 1 --2- 172.21.15.40:0/1202619546 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7fa59806ae40 0x7fa59806d300 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fa59c00a950 tx=0x7fa59c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:51:51.675 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:51:51.673+0000 7fa5937fe640 1 -- 172.21.15.40:0/1202619546 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fa5a0076dd0 con 0x7fa5ac072180 2023-12-17T11:51:51.948 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:51:51.946+0000 7fa5b162f640 1 -- 172.21.15.40:0/1202619546 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fa5ac0745d0 con 0x7fa5ac072180 2023-12-17T11:51:51.948 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:51:51.946+0000 7fa5937fe640 1 -- 172.21.15.40:0/1202619546 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+1276 (secure 0 0 0) 0x7fa5a007a3f0 con 0x7fa5ac072180 2023-12-17T11:51:51.948 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T11:51:51.948 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":1,"fsid":"099cd35d-80d9-4ca4-8424-de13b3b03ac7","modified":"2023-12-17T11:47:09.300751Z","created":"2023-12-17T11:47:09.300751Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:3300","nonce":0},{"type":"v1","addr":"172.21.15.40:6789","nonce":0}]},"addr":"172.21.15.40:6789/0","public_addr":"172.21.15.40:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:3300","nonce":0},{"type":"v1","addr":"172.21.15.159:6789","nonce":0}]},"addr":"172.21.15.159:6789/0","public_addr":"172.21.15.159:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:3301","nonce":0},{"type":"v1","addr":"172.21.15.159:6790","nonce":0}]},"addr":"172.21.15.159:6790/0","public_addr":"172.21.15.159:6790/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1,2]} 2023-12-17T11:51:51.949 INFO:teuthology.orchestra.run.smithi040.stderr:dumped monmap epoch 1 2023-12-17T11:51:51.952 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:51:51.949+0000 7fa5b162f640 1 -- 172.21.15.40:0/1202619546 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7fa59806ae40 msgr2=0x7fa59806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:51:51.952 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:51:51.949+0000 7fa5b162f640 1 --2- 172.21.15.40:0/1202619546 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7fa59806ae40 0x7fa59806d300 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fa59c00a950 tx=0x7fa59c008040 comp rx=0 tx=0).stop 2023-12-17T11:51:51.952 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:51:51.949+0000 7fa5b162f640 1 -- 172.21.15.40:0/1202619546 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa5ac072180 msgr2=0x7fa5ac1e0480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:51:51.952 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:51:51.949+0000 7fa5b162f640 1 --2- 172.21.15.40:0/1202619546 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa5ac072180 0x7fa5ac1e0480 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7fa5a0000c00 tx=0x7fa5a00046c0 comp rx=0 tx=0).stop 2023-12-17T11:51:51.952 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:51:51.950+0000 7fa5b162f640 1 -- 172.21.15.40:0/1202619546 shutdown_connections 2023-12-17T11:51:51.952 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:51:51.950+0000 7fa5b162f640 1 --2- 172.21.15.40:0/1202619546 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7fa59806ae40 0x7fa59806d300 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:51:51.952 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:51:51.950+0000 7fa5b162f640 1 --2- 172.21.15.40:0/1202619546 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa5ac143e00 0x7fa5ac1f2ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:51:51.952 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:51:51.950+0000 7fa5b162f640 1 --2- 172.21.15.40:0/1202619546 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa5ac072180 0x7fa5ac1e0480 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:51:51.952 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:51:51.950+0000 7fa5b162f640 1 --2- 172.21.15.40:0/1202619546 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fa5ac06c410 0x7fa5ac1e5630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:51:51.952 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:51:51.950+0000 7fa5b162f640 1 -- 172.21.15.40:0/1202619546 >> 172.21.15.40:0/1202619546 conn(0x7fa5ac0b0a90 msgr2=0x7fa5ac0ad9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:51:51.952 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:51:51.950+0000 7fa5b162f640 1 -- 172.21.15.40:0/1202619546 shutdown_connections 2023-12-17T11:51:51.953 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:51:51.950+0000 7fa5b162f640 1 -- 172.21.15.40:0/1202619546 wait complete. 2023-12-17T11:51:51.971 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth get-or-create client.admin 2023-12-17T11:51:52.163 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:51:52.161+0000 7f47abf11640 1 Processor -- start 2023-12-17T11:51:52.164 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:51:52.161+0000 7f47abf11640 1 -- start start 2023-12-17T11:51:52.165 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:51:52.163+0000 7f47abf11640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f47a40cdea0 0x7f47a406bf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:51:52.165 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:51:52.163+0000 7f47abf11640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f47a406b780 0x7f47a406c4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:51:52.165 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:51:52.163+0000 7f47abf11640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47a40ce280 con 0x7f47a40d0aa0 2023-12-17T11:51:52.166 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:51:52.163+0000 7f47abf11640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47a40b09b0 con 0x7f47a406b780 2023-12-17T11:51:52.166 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:51:52.163+0000 7f47abf11640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47a40d0090 con 0x7f47a40cdea0 2023-12-17T11:51:52.166 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:51:52.163+0000 7f47a94ac640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f47a40d0aa0 0x7f47a415cb40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:36890/0 (socket says 172.21.15.40:36890) 2023-12-17T11:51:52.166 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:51:52.164+0000 7f47a94ac640 1 -- 172.21.15.40:0/1745678043 learned_addr learned my addr 172.21.15.40:0/1745678043 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-12-17T11:51:52.168 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:51:52.164+0000 7f47a9cad640 1 --2- 172.21.15.40:0/1745678043 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f47a40cdea0 0x7f47a406bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:51:52.168 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:51:52.164+0000 7f47aa4ae640 1 --2- 172.21.15.40:0/1745678043 >> v2:172.21.15.159:3300/0 conn(0x7f47a406b780 0x7f47a406c4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:51:52.168 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:51:52.164+0000 7f47a8cab640 1 -- 172.21.15.40:0/1745678043 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1253007263 0 0) 0x7f47a40ce280 con 0x7f47a40d0aa0 2023-12-17T11:51:52.168 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:51:52.164+0000 7f47a8cab640 1 -- 172.21.15.40:0/1745678043 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4790003520 con 0x7f47a40d0aa0 2023-12-17T11:51:52.168 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:51:52.165+0000 7f47a8cab640 1 -- 172.21.15.40:0/1745678043 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2065252793 0 0) 0x7f4790003520 con 0x7f47a40d0aa0 2023-12-17T11:51:52.168 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:51:52.165+0000 7f47a8cab640 1 -- 172.21.15.40:0/1745678043 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f47a40cdea0 msgr2=0x7f47a406bf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:51:52.168 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:51:52.165+0000 7f47a8cab640 1 --2- 172.21.15.40:0/1745678043 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f47a40cdea0 0x7f47a406bf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:51:52.168 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:51:52.165+0000 7f47a8cab640 1 -- 172.21.15.40:0/1745678043 >> v2:172.21.15.159:3300/0 conn(0x7f47a406b780 msgr2=0x7f47a406c4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:51:52.168 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:51:52.165+0000 7f47a8cab640 1 --2- 172.21.15.40:0/1745678043 >> v2:172.21.15.159:3300/0 conn(0x7f47a406b780 0x7f47a406c4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:51:52.169 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:51:52.165+0000 7f47a8cab640 1 -- 172.21.15.40:0/1745678043 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47a40d0370 con 0x7f47a40d0aa0 2023-12-17T11:51:52.169 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:51:52.165+0000 7f47a8cab640 1 -- 172.21.15.40:0/1745678043 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2643242555 0 0) 0x7f4794001670 con 0x7f47a40d0aa0 2023-12-17T11:51:52.169 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:51:52.165+0000 7f47a8cab640 1 -- 172.21.15.40:0/1745678043 >> v1:172.21.15.40:6789/0 conn(0x7f47a40d0aa0 legacy=0x7f47a415cb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:51:52.169 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:51:52.165+0000 7f47a8cab640 1 --2- 172.21.15.40:0/1745678043 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f47a40cdea0 0x7f4790003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:51:52.169 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:51:52.165+0000 7f47a8cab640 1 --2- 172.21.15.40:0/1745678043 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4790003ef0 0x7f47900047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:51:52.169 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:51:52.165+0000 7f47a8cab640 1 --2- 172.21.15.40:0/1745678043 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4790004d00 0x7f4790005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:51:52.169 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:51:52.165+0000 7f47a8cab640 1 -- 172.21.15.40:0/1745678043 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47a40b09b0 con 0x7f4790004d00 2023-12-17T11:51:52.169 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:51:52.165+0000 7f47a8cab640 1 -- 172.21.15.40:0/1745678043 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47a40d0090 con 0x7f4790003ef0 2023-12-17T11:51:52.169 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:51:52.165+0000 7f47a8cab640 1 -- 172.21.15.40:0/1745678043 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f479000b9d0 con 0x7f47a40cdea0 2023-12-17T11:51:52.169 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:51:52.165+0000 7f47aa4ae640 1 --2- 172.21.15.40:0/1745678043 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4790004d00 0x7f4790005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:51:52.169 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:51:52.166+0000 7f47a9cad640 1 --2- 172.21.15.40:0/1745678043 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f47a40cdea0 0x7f4790003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:51:52.170 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:51:52.166+0000 7f47a94ac640 1 --2- 172.21.15.40:0/1745678043 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4790003ef0 0x7f47900047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:51:52.170 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:51:52.166+0000 7f47aa4ae640 1 -- 172.21.15.40:0/1745678043 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f47a40cdea0 msgr2=0x7f4790003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:51:52.170 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:51:52.166+0000 7f47aa4ae640 1 --2- 172.21.15.40:0/1745678043 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f47a40cdea0 0x7f4790003970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:51:52.170 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:51:52.166+0000 7f47aa4ae640 1 -- 172.21.15.40:0/1745678043 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4790003ef0 msgr2=0x7f47900047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T11:51:52.170 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:51:52.166+0000 7f47aa4ae640 1 --2- 172.21.15.40:0/1745678043 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4790003ef0 0x7f47900047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:51:52.170 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:51:52.166+0000 7f47aa4ae640 1 -- 172.21.15.40:0/1745678043 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4790003520 con 0x7f4790004d00 2023-12-17T11:51:52.170 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:51:52.166+0000 7f47a94ac640 1 --2- 172.21.15.40:0/1745678043 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4790003ef0 0x7f47900047c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-17T11:51:52.171 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:51:52.167+0000 7f47aa4ae640 1 --2- 172.21.15.40:0/1745678043 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4790004d00 0x7f4790005180 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f479c00e170 tx=0x7f47900057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=279fb6adaea64298 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:51:52.171 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:51:52.167+0000 7f47a8cab640 1 -- 172.21.15.40:0/1745678043 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f479c02cc20 con 0x7f4790004d00 2023-12-17T11:51:52.171 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:51:52.167+0000 7f47a8cab640 1 -- 172.21.15.40:0/1745678043 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f479c00f040 con 0x7f4790004d00 2023-12-17T11:51:52.171 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:51:52.167+0000 7f47a8cab640 1 -- 172.21.15.40:0/1745678043 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f479c034440 con 0x7f4790004d00 2023-12-17T11:51:52.171 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:51:52.168+0000 7f47abf11640 1 -- 172.21.15.40:0/1745678043 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4790004d00 msgr2=0x7f4790005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:51:52.171 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:51:52.168+0000 7f47abf11640 1 --2- 172.21.15.40:0/1745678043 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4790004d00 0x7f4790005180 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f479c00e170 tx=0x7f47900057f0 comp rx=0 tx=0).stop 2023-12-17T11:51:52.171 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:51:52.168+0000 7f47aa4ae640 1 -- 172.21.15.40:0/1745678043 reap_dead start 2023-12-17T11:51:52.171 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:51:52.168+0000 7f47abf11640 1 -- 172.21.15.40:0/1745678043 shutdown_connections 2023-12-17T11:51:52.172 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:51:52.168+0000 7f47abf11640 1 -- 172.21.15.40:0/1745678043 >> 172.21.15.40:0/1745678043 conn(0x7f47a40d0ed0 msgr2=0x7f47a40d12e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:51:52.172 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:51:52.168+0000 7f47abf11640 1 -- 172.21.15.40:0/1745678043 shutdown_connections 2023-12-17T11:51:52.172 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:51:52.168+0000 7f47abf11640 1 -- 172.21.15.40:0/1745678043 wait complete. 2023-12-17T11:51:52.173 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:51:52.171+0000 7f47abf11640 1 Processor -- start 2023-12-17T11:51:52.173 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:51:52.171+0000 7f47abf11640 1 -- start start 2023-12-17T11:51:52.175 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:51:52.172+0000 7f47abf11640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4790004d00 0x7f47a40b5fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:51:52.175 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:51:52.172+0000 7f47abf11640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f47a41469e0 0x7f47a41571e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:51:52.176 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:51:52.172+0000 7f47abf11640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f47a4149310 0x7f47a41497c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:51:52.176 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:51:52.172+0000 7f47abf11640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47a40b64e0 con 0x7f4790004d00 2023-12-17T11:51:52.176 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:51:52.172+0000 7f47abf11640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47a4149d00 con 0x7f47a41469e0 2023-12-17T11:51:52.176 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:51:52.172+0000 7f47abf11640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47a4147f10 con 0x7f47a4149310 2023-12-17T11:51:52.176 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:51:52.173+0000 7f47a9cad640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4790004d00 0x7f47a40b5fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:51:52.176 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:51:52.173+0000 7f47a9cad640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4790004d00 0x7f47a40b5fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:42100/0 (socket says 172.21.15.40:42100) 2023-12-17T11:51:52.176 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:51:52.173+0000 7f47a9cad640 1 -- 172.21.15.40:0/3427766447 learned_addr learned my addr 172.21.15.40:0/3427766447 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-17T11:51:52.176 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:51:52.173+0000 7f47aa4ae640 1 --2- 172.21.15.40:0/3427766447 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f47a4149310 0x7f47a41497c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:51:52.176 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:51:52.173+0000 7f47a94ac640 1 --2- 172.21.15.40:0/3427766447 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f47a41469e0 0x7f47a41571e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:51:52.176 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:51:52.173+0000 7f47a9cad640 1 -- 172.21.15.40:0/3427766447 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f47a4149310 msgr2=0x7f47a41497c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:51:52.176 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:51:52.173+0000 7f47a9cad640 1 --2- 172.21.15.40:0/3427766447 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f47a4149310 0x7f47a41497c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:51:52.176 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:51:52.173+0000 7f47a9cad640 1 -- 172.21.15.40:0/3427766447 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f47a41469e0 msgr2=0x7f47a41571e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:51:52.177 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:51:52.173+0000 7f47a9cad640 1 --2- 172.21.15.40:0/3427766447 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f47a41469e0 0x7f47a41571e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:51:52.177 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:51:52.173+0000 7f47a9cad640 1 -- 172.21.15.40:0/3427766447 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47a415a130 con 0x7f4790004d00 2023-12-17T11:51:52.177 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:51:52.174+0000 7f47a9cad640 1 --2- 172.21.15.40:0/3427766447 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4790004d00 0x7f47a40b5fa0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f47a0011600 tx=0x7f47a0011ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:51:52.178 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:51:52.174+0000 7f479a7fc640 1 -- 172.21.15.40:0/3427766447 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47a000f8c0 con 0x7f4790004d00 2023-12-17T11:51:52.178 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:51:52.174+0000 7f479a7fc640 1 -- 172.21.15.40:0/3427766447 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47a000fa20 con 0x7f4790004d00 2023-12-17T11:51:52.178 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:51:52.174+0000 7f47abf11640 1 -- 172.21.15.40:0/3427766447 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47a415a410 con 0x7f4790004d00 2023-12-17T11:51:52.178 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:51:52.174+0000 7f479a7fc640 1 -- 172.21.15.40:0/3427766447 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47a000fd90 con 0x7f4790004d00 2023-12-17T11:51:52.178 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:51:52.174+0000 7f47abf11640 1 -- 172.21.15.40:0/3427766447 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47a40b5a80 con 0x7f4790004d00 2023-12-17T11:51:52.178 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:51:52.176+0000 7f47abf11640 1 -- 172.21.15.40:0/3427766447 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47a40b5c40 con 0x7f4790004d00 2023-12-17T11:51:52.178 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:51:52.176+0000 7f479a7fc640 1 -- 172.21.15.40:0/3427766447 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f47a0015460 con 0x7f4790004d00 2023-12-17T11:51:52.179 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:51:52.177+0000 7f479a7fc640 1 --2- 172.21.15.40:0/3427766447 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f478806ae70 0x7f478806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:51:52.179 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:51:52.177+0000 7f479a7fc640 1 -- 172.21.15.40:0/3427766447 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f47a0089f80 con 0x7f4790004d00 2023-12-17T11:51:52.180 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:51:52.178+0000 7f47a94ac640 1 --2- 172.21.15.40:0/3427766447 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f478806ae70 0x7f478806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:51:52.181 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:51:52.179+0000 7f47a94ac640 1 --2- 172.21.15.40:0/3427766447 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f478806ae70 0x7f478806d330 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f47940017a0 tx=0x7f4794009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:51:52.184 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:51:52.182+0000 7f479a7fc640 1 -- 172.21.15.40:0/3427766447 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f47a0054f70 con 0x7f4790004d00 2023-12-17T11:51:52.451 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:51:52.449+0000 7f47abf11640 1 -- 172.21.15.40:0/3427766447 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.admin"} v 0) v1 -- 0x7f47a406bf00 con 0x7f4790004d00 2023-12-17T11:51:52.451 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:51:52.450+0000 7f479a7fc640 1 -- 172.21.15.40:0/3427766447 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.admin"}]=0 v9) v1 ==== 92+0+63 (secure 0 0 0) 0x7f47a0058590 con 0x7f4790004d00 2023-12-17T11:51:52.452 INFO:teuthology.orchestra.run.smithi040.stdout:[client.admin] 2023-12-17T11:51:52.452 INFO:teuthology.orchestra.run.smithi040.stdout: key = AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== 2023-12-17T11:51:52.454 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:51:52.452+0000 7f47abf11640 1 -- 172.21.15.40:0/3427766447 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f478806ae70 msgr2=0x7f478806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:51:52.454 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:51:52.452+0000 7f47abf11640 1 --2- 172.21.15.40:0/3427766447 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f478806ae70 0x7f478806d330 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f47940017a0 tx=0x7f4794009040 comp rx=0 tx=0).stop 2023-12-17T11:51:52.454 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:51:52.452+0000 7f47abf11640 1 -- 172.21.15.40:0/3427766447 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4790004d00 msgr2=0x7f47a40b5fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:51:52.454 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:51:52.452+0000 7f47abf11640 1 --2- 172.21.15.40:0/3427766447 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4790004d00 0x7f47a40b5fa0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f47a0011600 tx=0x7f47a0011ac0 comp rx=0 tx=0).stop 2023-12-17T11:51:52.455 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:51:52.452+0000 7f47abf11640 1 -- 172.21.15.40:0/3427766447 shutdown_connections 2023-12-17T11:51:52.455 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:51:52.452+0000 7f47abf11640 1 --2- 172.21.15.40:0/3427766447 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f478806ae70 0x7f478806d330 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:51:52.455 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:51:52.452+0000 7f47abf11640 1 --2- 172.21.15.40:0/3427766447 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f47a4149310 0x7f47a41497c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:51:52.455 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:51:52.452+0000 7f47abf11640 1 --2- 172.21.15.40:0/3427766447 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f47a41469e0 0x7f47a41571e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:51:52.455 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:51:52.452+0000 7f47abf11640 1 --2- 172.21.15.40:0/3427766447 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4790004d00 0x7f47a40b5fa0 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:51:52.455 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:51:52.452+0000 7f47abf11640 1 -- 172.21.15.40:0/3427766447 >> 172.21.15.40:0/3427766447 conn(0x7f47a40d0ed0 msgr2=0x7f47a40b1090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:51:52.455 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:51:52.452+0000 7f47abf11640 1 -- 172.21.15.40:0/3427766447 shutdown_connections 2023-12-17T11:51:52.455 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T11:51:52.452+0000 7f47abf11640 1 -- 172.21.15.40:0/3427766447 wait complete. 2023-12-17T11:51:52.473 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2023-12-17T11:51:52.473 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd of=/tmp/tmp.34EJEHEKBdxfstests-dev/local.config 2023-12-17T11:51:52.556 INFO:tasks.cephfs.xfstests_dev:local.config's contents - export FSTYP=ceph export TEST_DEV=172.21.15.40:6789:/test export TEST_DIR=/tmp/tmp.LcXCCPenVTtest export SCRATCH_DEV=172.21.15.40:6789:/scratch export SCRATCH_MNT=/tmp/tmp.k3h64vAtcuscratch export CEPHFS_MOUNT_OPTIONS="-o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA==" 2023-12-17T11:51:52.556 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2023-12-17T11:51:52.556 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd of=/tmp/tmp.34EJEHEKBdxfstests-dev/ceph.exclude 2023-12-17T11:51:52.670 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo make) 2023-12-17T11:51:52.807 INFO:teuthology.orchestra.run.smithi040.stdout:libtoolize -cfi 2023-12-17T11:51:53.507 INFO:teuthology.orchestra.run.smithi040.stdout:libtoolize: putting auxiliary files in '.'. 2023-12-17T11:51:53.507 INFO:teuthology.orchestra.run.smithi040.stdout:libtoolize: copying file './config.guess' 2023-12-17T11:51:53.524 INFO:teuthology.orchestra.run.smithi040.stdout:libtoolize: copying file './config.sub' 2023-12-17T11:51:53.535 INFO:teuthology.orchestra.run.smithi040.stdout:libtoolize: copying file './install-sh' 2023-12-17T11:51:53.547 INFO:teuthology.orchestra.run.smithi040.stdout:libtoolize: copying file './ltmain.sh' 2023-12-17T11:51:53.619 INFO:teuthology.orchestra.run.smithi040.stdout:libtoolize: putting macros in AC_CONFIG_MACRO_DIRS, 'm4'. 2023-12-17T11:51:53.619 INFO:teuthology.orchestra.run.smithi040.stdout:libtoolize: copying file 'm4/libtool.m4' 2023-12-17T11:51:53.632 INFO:teuthology.orchestra.run.smithi040.stdout:libtoolize: copying file 'm4/ltoptions.m4' 2023-12-17T11:51:53.647 INFO:teuthology.orchestra.run.smithi040.stdout:libtoolize: copying file 'm4/ltsugar.m4' 2023-12-17T11:51:53.661 INFO:teuthology.orchestra.run.smithi040.stdout:libtoolize: copying file 'm4/ltversion.m4' 2023-12-17T11:51:53.676 INFO:teuthology.orchestra.run.smithi040.stdout:libtoolize: copying file 'm4/lt~obsolete.m4' 2023-12-17T11:51:53.696 INFO:teuthology.orchestra.run.smithi040.stdout:libtoolize: Consider adding '-I m4' to ACLOCAL_AMFLAGS in Makefile.am. 2023-12-17T11:51:53.701 INFO:teuthology.orchestra.run.smithi040.stdout:cp include/install-sh . 2023-12-17T11:51:53.703 INFO:teuthology.orchestra.run.smithi040.stdout:aclocal -I m4 2023-12-17T11:51:55.492 INFO:teuthology.orchestra.run.smithi040.stdout:autoheader 2023-12-17T11:51:55.923 INFO:teuthology.orchestra.run.smithi040.stdout:autoconf 2023-12-17T11:51:56.190 INFO:teuthology.orchestra.run.smithi040.stdout:./configure \ 2023-12-17T11:51:56.190 INFO:teuthology.orchestra.run.smithi040.stdout: --libexecdir=/usr/lib \ 2023-12-17T11:51:56.190 INFO:teuthology.orchestra.run.smithi040.stdout: --exec_prefix=/var/lib 2023-12-17T11:51:56.669 INFO:teuthology.orchestra.run.smithi040.stdout:checking build system type... x86_64-pc-linux-gnu 2023-12-17T11:51:56.670 INFO:teuthology.orchestra.run.smithi040.stdout:checking host system type... x86_64-pc-linux-gnu 2023-12-17T11:51:56.675 INFO:teuthology.orchestra.run.smithi040.stdout:checking how to print strings... printf 2023-12-17T11:51:56.675 INFO:teuthology.orchestra.run.smithi040.stdout:checking for gcc... gcc 2023-12-17T11:51:56.832 INFO:teuthology.orchestra.run.smithi040.stdout:checking whether the C compiler works... yes 2023-12-17T11:51:56.833 INFO:teuthology.orchestra.run.smithi040.stdout:checking for C compiler default output file name... a.out 2023-12-17T11:51:56.908 INFO:teuthology.orchestra.run.smithi040.stdout:checking for suffix of executables... 2023-12-17T11:51:57.023 INFO:teuthology.orchestra.run.smithi040.stdout:checking whether we are cross compiling... no 2023-12-17T11:51:57.078 INFO:teuthology.orchestra.run.smithi040.stdout:checking for suffix of object files... o 2023-12-17T11:51:57.126 INFO:teuthology.orchestra.run.smithi040.stdout:checking whether we are using the GNU C compiler... yes 2023-12-17T11:51:57.173 INFO:teuthology.orchestra.run.smithi040.stdout:checking whether gcc accepts -g... yes 2023-12-17T11:51:57.242 INFO:teuthology.orchestra.run.smithi040.stdout:checking for gcc option to accept ISO C89... none needed 2023-12-17T11:51:57.252 INFO:teuthology.orchestra.run.smithi040.stdout:checking for a sed that does not truncate output... /bin/sed 2023-12-17T11:51:57.260 INFO:teuthology.orchestra.run.smithi040.stdout:checking for grep that handles long lines and -e... /bin/grep 2023-12-17T11:51:57.265 INFO:teuthology.orchestra.run.smithi040.stdout:checking for egrep... /bin/grep -E 2023-12-17T11:51:57.270 INFO:teuthology.orchestra.run.smithi040.stdout:checking for fgrep... /bin/grep -F 2023-12-17T11:51:57.283 INFO:teuthology.orchestra.run.smithi040.stdout:checking for ld used by gcc... /bin/ld 2023-12-17T11:51:57.290 INFO:teuthology.orchestra.run.smithi040.stdout:checking if the linker (/bin/ld) is GNU ld... yes 2023-12-17T11:51:57.299 INFO:teuthology.orchestra.run.smithi040.stdout:checking for BSD- or MS-compatible name lister (nm)... /bin/nm -B 2023-12-17T11:51:58.305 INFO:teuthology.orchestra.run.smithi040.stdout:checking the name lister (/bin/nm -B) interface... BSD nm 2023-12-17T11:51:58.305 INFO:teuthology.orchestra.run.smithi040.stdout:checking whether ln -s works... yes 2023-12-17T11:51:58.326 INFO:teuthology.orchestra.run.smithi040.stdout:checking the maximum length of command line arguments... 1572864 2023-12-17T11:51:58.337 INFO:teuthology.orchestra.run.smithi040.stdout:checking how to convert x86_64-pc-linux-gnu file names to x86_64-pc-linux-gnu format... func_convert_file_noop 2023-12-17T11:51:58.338 INFO:teuthology.orchestra.run.smithi040.stdout:checking how to convert x86_64-pc-linux-gnu file names to toolchain format... func_convert_file_noop 2023-12-17T11:51:58.338 INFO:teuthology.orchestra.run.smithi040.stdout:checking for /bin/ld option to reload object files... -r 2023-12-17T11:51:58.339 INFO:teuthology.orchestra.run.smithi040.stdout:checking for objdump... objdump 2023-12-17T11:51:58.340 INFO:teuthology.orchestra.run.smithi040.stdout:checking how to recognize dependent libraries... pass_all 2023-12-17T11:51:58.341 INFO:teuthology.orchestra.run.smithi040.stdout:checking for dlltool... no 2023-12-17T11:51:58.342 INFO:teuthology.orchestra.run.smithi040.stdout:checking how to associate runtime and link libraries... printf %s\n 2023-12-17T11:51:58.343 INFO:teuthology.orchestra.run.smithi040.stdout:checking for ar... ar 2023-12-17T11:51:58.463 INFO:teuthology.orchestra.run.smithi040.stdout:checking for archiver @FILE support... @ 2023-12-17T11:51:58.464 INFO:teuthology.orchestra.run.smithi040.stdout:checking for strip... strip 2023-12-17T11:51:58.465 INFO:teuthology.orchestra.run.smithi040.stdout:checking for ranlib... ranlib 2023-12-17T11:51:58.466 INFO:teuthology.orchestra.run.smithi040.stdout:checking for gawk... gawk 2023-12-17T11:51:58.669 INFO:teuthology.orchestra.run.smithi040.stdout:checking command to parse /bin/nm -B output from gcc object... ok 2023-12-17T11:51:58.674 INFO:teuthology.orchestra.run.smithi040.stdout:checking for sysroot... no 2023-12-17T11:51:58.686 INFO:teuthology.orchestra.run.smithi040.stdout:checking for a working dd... /bin/dd 2023-12-17T11:51:58.697 INFO:teuthology.orchestra.run.smithi040.stdout:checking how to truncate binary pipes... /bin/dd bs=4096 count=1 2023-12-17T11:51:58.739 INFO:teuthology.orchestra.run.smithi040.stdout:checking for mt... no 2023-12-17T11:51:58.749 INFO:teuthology.orchestra.run.smithi040.stdout:checking if : is a manifest tool... no 2023-12-17T11:51:58.852 INFO:teuthology.orchestra.run.smithi040.stdout:checking how to run the C preprocessor... gcc -E 2023-12-17T11:51:59.210 INFO:teuthology.orchestra.run.smithi040.stdout:checking for ANSI C header files... yes 2023-12-17T11:51:59.273 INFO:teuthology.orchestra.run.smithi040.stdout:checking for sys/types.h... yes 2023-12-17T11:51:59.354 INFO:teuthology.orchestra.run.smithi040.stdout:checking for sys/stat.h... yes 2023-12-17T11:51:59.433 INFO:teuthology.orchestra.run.smithi040.stdout:checking for stdlib.h... yes 2023-12-17T11:51:59.506 INFO:teuthology.orchestra.run.smithi040.stdout:checking for string.h... yes 2023-12-17T11:51:59.588 INFO:teuthology.orchestra.run.smithi040.stdout:checking for memory.h... yes 2023-12-17T11:51:59.665 INFO:teuthology.orchestra.run.smithi040.stdout:checking for strings.h... yes 2023-12-17T11:51:59.749 INFO:teuthology.orchestra.run.smithi040.stdout:checking for inttypes.h... yes 2023-12-17T11:51:59.830 INFO:teuthology.orchestra.run.smithi040.stdout:checking for stdint.h... yes 2023-12-17T11:51:59.928 INFO:teuthology.orchestra.run.smithi040.stdout:checking for unistd.h... yes 2023-12-17T11:52:00.015 INFO:teuthology.orchestra.run.smithi040.stdout:checking for dlfcn.h... yes 2023-12-17T11:52:00.027 INFO:teuthology.orchestra.run.smithi040.stdout:checking for objdir... .libs 2023-12-17T11:52:00.209 INFO:teuthology.orchestra.run.smithi040.stdout:checking if gcc supports -fno-rtti -fno-exceptions... no 2023-12-17T11:52:00.209 INFO:teuthology.orchestra.run.smithi040.stdout:checking for gcc option to produce PIC... -fPIC -DPIC 2023-12-17T11:52:00.269 INFO:teuthology.orchestra.run.smithi040.stdout:checking if gcc PIC flag -fPIC -DPIC works... yes 2023-12-17T11:52:00.323 INFO:teuthology.orchestra.run.smithi040.stdout:checking if gcc static flag -static works... no 2023-12-17T11:52:00.405 INFO:teuthology.orchestra.run.smithi040.stdout:checking if gcc supports -c -o file.o... yes 2023-12-17T11:52:00.405 INFO:teuthology.orchestra.run.smithi040.stdout:checking if gcc supports -c -o file.o... (cached) yes 2023-12-17T11:52:00.432 INFO:teuthology.orchestra.run.smithi040.stdout:checking whether the gcc linker (/bin/ld -m elf_x86_64) supports shared libraries... yes 2023-12-17T11:52:00.506 INFO:teuthology.orchestra.run.smithi040.stdout:checking whether -lc should be explicitly linked in... no 2023-12-17T11:52:00.665 INFO:teuthology.orchestra.run.smithi040.stdout:checking dynamic linker characteristics... GNU/Linux ld.so 2023-12-17T11:52:00.665 INFO:teuthology.orchestra.run.smithi040.stdout:checking how to hardcode library paths into programs... immediate 2023-12-17T11:52:00.670 INFO:teuthology.orchestra.run.smithi040.stdout:checking whether stripping libraries is possible... yes 2023-12-17T11:52:00.670 INFO:teuthology.orchestra.run.smithi040.stdout:checking if libtool supports shared libraries... yes 2023-12-17T11:52:00.670 INFO:teuthology.orchestra.run.smithi040.stdout:checking whether to build shared libraries... yes 2023-12-17T11:52:00.670 INFO:teuthology.orchestra.run.smithi040.stdout:checking whether to build static libraries... yes 2023-12-17T11:52:00.695 INFO:teuthology.orchestra.run.smithi040.stdout:checking for gcc... (cached) gcc 2023-12-17T11:52:00.768 INFO:teuthology.orchestra.run.smithi040.stdout:checking whether we are using the GNU C compiler... (cached) yes 2023-12-17T11:52:00.768 INFO:teuthology.orchestra.run.smithi040.stdout:checking whether gcc accepts -g... (cached) yes 2023-12-17T11:52:00.770 INFO:teuthology.orchestra.run.smithi040.stdout:checking for gcc option to accept ISO C89... (cached) none needed 2023-12-17T11:52:00.770 INFO:teuthology.orchestra.run.smithi040.stdout:checking for gmake... /usr/bin/gmake 2023-12-17T11:52:00.771 INFO:teuthology.orchestra.run.smithi040.stderr:./configure: line 12083: test: $(SHELL): binary operator expected 2023-12-17T11:52:00.772 INFO:teuthology.orchestra.run.smithi040.stdout:checking for tar... /bin/tar 2023-12-17T11:52:00.772 INFO:teuthology.orchestra.run.smithi040.stdout:checking for gzip... /bin/gzip 2023-12-17T11:52:00.803 INFO:teuthology.orchestra.run.smithi040.stdout:checking whether gcc -MM is supported... yes 2023-12-17T11:52:00.804 INFO:teuthology.orchestra.run.smithi040.stdout:checking for sort... /bin/sort 2023-12-17T11:52:00.804 INFO:teuthology.orchestra.run.smithi040.stdout:checking whether ln -s works... yes 2023-12-17T11:52:00.806 INFO:teuthology.orchestra.run.smithi040.stdout:checking for rpm... /bin/rpm 2023-12-17T11:52:00.818 INFO:teuthology.orchestra.run.smithi040.stdout:checking for rpmbuild... no 2023-12-17T11:52:00.895 INFO:teuthology.orchestra.run.smithi040.stdout:checking assert.h usability... yes 2023-12-17T11:52:00.923 INFO:teuthology.orchestra.run.smithi040.stdout:checking assert.h presence... yes 2023-12-17T11:52:00.923 INFO:teuthology.orchestra.run.smithi040.stdout:checking for assert.h... yes 2023-12-17T11:52:01.009 INFO:teuthology.orchestra.run.smithi040.stdout:checking bstring.h usability... no 2023-12-17T11:52:01.057 INFO:teuthology.orchestra.run.smithi040.stdout:checking bstring.h presence... no 2023-12-17T11:52:01.057 INFO:teuthology.orchestra.run.smithi040.stdout:checking for bstring.h... no 2023-12-17T11:52:01.134 INFO:teuthology.orchestra.run.smithi040.stdout:checking libgen.h usability... yes 2023-12-17T11:52:01.160 INFO:teuthology.orchestra.run.smithi040.stdout:checking libgen.h presence... yes 2023-12-17T11:52:01.161 INFO:teuthology.orchestra.run.smithi040.stdout:checking for libgen.h... yes 2023-12-17T11:52:01.256 INFO:teuthology.orchestra.run.smithi040.stdout:checking dirent.h usability... yes 2023-12-17T11:52:01.285 INFO:teuthology.orchestra.run.smithi040.stdout:checking dirent.h presence... yes 2023-12-17T11:52:01.285 INFO:teuthology.orchestra.run.smithi040.stdout:checking for dirent.h... yes 2023-12-17T11:52:01.393 INFO:teuthology.orchestra.run.smithi040.stdout:checking errno.h usability... yes 2023-12-17T11:52:01.422 INFO:teuthology.orchestra.run.smithi040.stdout:checking errno.h presence... yes 2023-12-17T11:52:01.422 INFO:teuthology.orchestra.run.smithi040.stdout:checking for errno.h... yes 2023-12-17T11:52:01.505 INFO:teuthology.orchestra.run.smithi040.stdout:checking malloc.h usability... yes 2023-12-17T11:52:01.535 INFO:teuthology.orchestra.run.smithi040.stdout:checking malloc.h presence... yes 2023-12-17T11:52:01.535 INFO:teuthology.orchestra.run.smithi040.stdout:checking for malloc.h... yes 2023-12-17T11:52:01.622 INFO:teuthology.orchestra.run.smithi040.stdout:checking uuid.h usability... no 2023-12-17T11:52:01.663 INFO:teuthology.orchestra.run.smithi040.stdout:checking uuid.h presence... no 2023-12-17T11:52:01.664 INFO:teuthology.orchestra.run.smithi040.stdout:checking for uuid.h... no 2023-12-17T11:52:01.757 INFO:teuthology.orchestra.run.smithi040.stdout:checking uuid/uuid.h usability... yes 2023-12-17T11:52:01.785 INFO:teuthology.orchestra.run.smithi040.stdout:checking uuid/uuid.h presence... yes 2023-12-17T11:52:01.785 INFO:teuthology.orchestra.run.smithi040.stdout:checking for uuid/uuid.h... yes 2023-12-17T11:52:01.866 INFO:teuthology.orchestra.run.smithi040.stdout:checking sys/uuid.h usability... no 2023-12-17T11:52:01.910 INFO:teuthology.orchestra.run.smithi040.stdout:checking sys/uuid.h presence... no 2023-12-17T11:52:01.910 INFO:teuthology.orchestra.run.smithi040.stdout:checking for sys/uuid.h... no 2023-12-17T11:52:01.994 INFO:teuthology.orchestra.run.smithi040.stdout:checking sys/file.h usability... yes 2023-12-17T11:52:02.025 INFO:teuthology.orchestra.run.smithi040.stdout:checking sys/file.h presence... yes 2023-12-17T11:52:02.025 INFO:teuthology.orchestra.run.smithi040.stdout:checking for sys/file.h... yes 2023-12-17T11:52:02.121 INFO:teuthology.orchestra.run.smithi040.stdout:checking sys/fcntl.h usability... yes 2023-12-17T11:52:02.150 INFO:teuthology.orchestra.run.smithi040.stdout:checking sys/fcntl.h presence... yes 2023-12-17T11:52:02.150 INFO:teuthology.orchestra.run.smithi040.stdout:checking for sys/fcntl.h... yes 2023-12-17T11:52:02.234 INFO:teuthology.orchestra.run.smithi040.stdout:checking sys/syssgi.h usability... no 2023-12-17T11:52:02.278 INFO:teuthology.orchestra.run.smithi040.stdout:checking sys/syssgi.h presence... no 2023-12-17T11:52:02.278 INFO:teuthology.orchestra.run.smithi040.stdout:checking for sys/syssgi.h... no 2023-12-17T11:52:02.374 INFO:teuthology.orchestra.run.smithi040.stdout:checking sys/param.h usability... yes 2023-12-17T11:52:02.408 INFO:teuthology.orchestra.run.smithi040.stdout:checking sys/param.h presence... yes 2023-12-17T11:52:02.408 INFO:teuthology.orchestra.run.smithi040.stdout:checking for sys/param.h... yes 2023-12-17T11:52:02.429 INFO:teuthology.orchestra.run.smithi040.stdout:checking for sys/stat.h... (cached) yes 2023-12-17T11:52:02.513 INFO:teuthology.orchestra.run.smithi040.stdout:checking sys/statvfs.h usability... yes 2023-12-17T11:52:02.542 INFO:teuthology.orchestra.run.smithi040.stdout:checking sys/statvfs.h presence... yes 2023-12-17T11:52:02.542 INFO:teuthology.orchestra.run.smithi040.stdout:checking for sys/statvfs.h... yes 2023-12-17T11:52:02.624 INFO:teuthology.orchestra.run.smithi040.stdout:checking sys/time.h usability... yes 2023-12-17T11:52:02.654 INFO:teuthology.orchestra.run.smithi040.stdout:checking sys/time.h presence... yes 2023-12-17T11:52:02.654 INFO:teuthology.orchestra.run.smithi040.stdout:checking for sys/time.h... yes 2023-12-17T11:52:02.745 INFO:teuthology.orchestra.run.smithi040.stdout:checking sys/ioctl.h usability... yes 2023-12-17T11:52:02.770 INFO:teuthology.orchestra.run.smithi040.stdout:checking sys/ioctl.h presence... yes 2023-12-17T11:52:02.770 INFO:teuthology.orchestra.run.smithi040.stdout:checking for sys/ioctl.h... yes 2023-12-17T11:52:02.851 INFO:teuthology.orchestra.run.smithi040.stdout:checking sys/wait.h usability... yes 2023-12-17T11:52:02.885 INFO:teuthology.orchestra.run.smithi040.stdout:checking sys/wait.h presence... yes 2023-12-17T11:52:02.885 INFO:teuthology.orchestra.run.smithi040.stdout:checking for sys/wait.h... yes 2023-12-17T11:52:02.907 INFO:teuthology.orchestra.run.smithi040.stdout:checking for sys/types.h... (cached) yes 2023-12-17T11:52:02.930 INFO:teuthology.orchestra.run.smithi040.stdout:checking for strings.h... (cached) yes 2023-12-17T11:52:03.017 INFO:teuthology.orchestra.run.smithi040.stdout:checking err.h usability... yes 2023-12-17T11:52:03.044 INFO:teuthology.orchestra.run.smithi040.stdout:checking err.h presence... yes 2023-12-17T11:52:03.044 INFO:teuthology.orchestra.run.smithi040.stdout:checking for err.h... yes 2023-12-17T11:52:03.135 INFO:teuthology.orchestra.run.smithi040.stdout:checking linux/falloc.h usability... yes 2023-12-17T11:52:03.164 INFO:teuthology.orchestra.run.smithi040.stdout:checking linux/falloc.h presence... yes 2023-12-17T11:52:03.164 INFO:teuthology.orchestra.run.smithi040.stdout:checking for linux/falloc.h... yes 2023-12-17T11:52:03.249 INFO:teuthology.orchestra.run.smithi040.stdout:checking sys/fs/xfs_fsops.h usability... no 2023-12-17T11:52:03.289 INFO:teuthology.orchestra.run.smithi040.stdout:checking sys/fs/xfs_fsops.h presence... no 2023-12-17T11:52:03.289 INFO:teuthology.orchestra.run.smithi040.stdout:checking for sys/fs/xfs_fsops.h... no 2023-12-17T11:52:03.367 INFO:teuthology.orchestra.run.smithi040.stdout:checking sys/fs/xfs_itable.h usability... no 2023-12-17T11:52:03.411 INFO:teuthology.orchestra.run.smithi040.stdout:checking sys/fs/xfs_itable.h presence... no 2023-12-17T11:52:03.411 INFO:teuthology.orchestra.run.smithi040.stdout:checking for sys/fs/xfs_itable.h... no 2023-12-17T11:52:03.488 INFO:teuthology.orchestra.run.smithi040.stdout:checking xfs/platform_defs.h usability... no 2023-12-17T11:52:03.536 INFO:teuthology.orchestra.run.smithi040.stdout:checking xfs/platform_defs.h presence... no 2023-12-17T11:52:03.536 INFO:teuthology.orchestra.run.smithi040.stdout:checking for xfs/platform_defs.h... no 2023-12-17T11:52:03.614 INFO:teuthology.orchestra.run.smithi040.stdout:checking btrfs/ioctl.h usability... no 2023-12-17T11:52:03.659 INFO:teuthology.orchestra.run.smithi040.stdout:checking btrfs/ioctl.h presence... no 2023-12-17T11:52:03.659 INFO:teuthology.orchestra.run.smithi040.stdout:checking for btrfs/ioctl.h... no 2023-12-17T11:52:03.733 INFO:teuthology.orchestra.run.smithi040.stdout:checking cifs/ioctl.h usability... no 2023-12-17T11:52:03.777 INFO:teuthology.orchestra.run.smithi040.stdout:checking cifs/ioctl.h presence... no 2023-12-17T11:52:03.777 INFO:teuthology.orchestra.run.smithi040.stdout:checking for cifs/ioctl.h... no 2023-12-17T11:52:03.858 INFO:teuthology.orchestra.run.smithi040.stdout:checking sys/mman.h usability... yes 2023-12-17T11:52:03.888 INFO:teuthology.orchestra.run.smithi040.stdout:checking sys/mman.h presence... yes 2023-12-17T11:52:03.888 INFO:teuthology.orchestra.run.smithi040.stdout:checking for sys/mman.h... yes 2023-12-17T11:52:03.947 INFO:teuthology.orchestra.run.smithi040.stdout:checking for xfs/xfs_log_format.h... no 2023-12-17T11:52:04.043 INFO:teuthology.orchestra.run.smithi040.stdout:checking for uuid_compare... no 2023-12-17T11:52:04.127 INFO:teuthology.orchestra.run.smithi040.stdout:checking for uuid_compare in -luuid... yes 2023-12-17T11:52:04.256 INFO:teuthology.orchestra.run.smithi040.stdout:checking for xfs/xfs.h... yes 2023-12-17T11:52:04.308 INFO:teuthology.orchestra.run.smithi040.stdout:checking for xfs/libxfs.h... no 2023-12-17T11:52:04.375 INFO:teuthology.orchestra.run.smithi040.stdout:checking whether xlog_assign_lsn is declared... no 2023-12-17T11:52:04.453 INFO:teuthology.orchestra.run.smithi040.stdout:checking for xfs/xqm.h... yes 2023-12-17T11:52:04.572 INFO:teuthology.orchestra.run.smithi040.stdout:checking xfsctl from xfs/xfs.h... ok 2023-12-17T11:52:04.636 INFO:teuthology.orchestra.run.smithi040.stdout:checking xfs/handle.h usability... yes 2023-12-17T11:52:04.664 INFO:teuthology.orchestra.run.smithi040.stdout:checking xfs/handle.h presence... yes 2023-12-17T11:52:04.664 INFO:teuthology.orchestra.run.smithi040.stdout:checking for xfs/handle.h... yes 2023-12-17T11:52:04.761 INFO:teuthology.orchestra.run.smithi040.stdout:checking for attr_list_by_handle in -lhandle... yes 2023-12-17T11:52:04.826 INFO:teuthology.orchestra.run.smithi040.stdout:checking sys/acl.h usability... yes 2023-12-17T11:52:04.858 INFO:teuthology.orchestra.run.smithi040.stdout:checking sys/acl.h presence... yes 2023-12-17T11:52:04.859 INFO:teuthology.orchestra.run.smithi040.stdout:checking for sys/acl.h... yes 2023-12-17T11:52:04.928 INFO:teuthology.orchestra.run.smithi040.stdout:checking acl/libacl.h usability... yes 2023-12-17T11:52:04.955 INFO:teuthology.orchestra.run.smithi040.stdout:checking acl/libacl.h presence... yes 2023-12-17T11:52:04.955 INFO:teuthology.orchestra.run.smithi040.stdout:checking for acl/libacl.h... yes 2023-12-17T11:52:05.041 INFO:teuthology.orchestra.run.smithi040.stdout:checking for acl_init in -lacl... yes 2023-12-17T11:52:05.112 INFO:teuthology.orchestra.run.smithi040.stdout:checking gdbm-ndbm.h usability... no 2023-12-17T11:52:05.157 INFO:teuthology.orchestra.run.smithi040.stdout:checking gdbm-ndbm.h presence... no 2023-12-17T11:52:05.157 INFO:teuthology.orchestra.run.smithi040.stdout:checking for gdbm-ndbm.h... no 2023-12-17T11:52:05.222 INFO:teuthology.orchestra.run.smithi040.stdout:checking gdbm/ndbm.h usability... yes 2023-12-17T11:52:05.257 INFO:teuthology.orchestra.run.smithi040.stdout:checking gdbm/ndbm.h presence... yes 2023-12-17T11:52:05.257 INFO:teuthology.orchestra.run.smithi040.stdout:checking for gdbm/ndbm.h... yes 2023-12-17T11:52:05.357 INFO:teuthology.orchestra.run.smithi040.stdout:checking for dbm_open in -lgdbm... no 2023-12-17T11:52:05.455 INFO:teuthology.orchestra.run.smithi040.stdout:checking for dbm_fetch in -lgdbm... no 2023-12-17T11:52:05.554 INFO:teuthology.orchestra.run.smithi040.stdout:checking for dbm_store in -lgdbm... no 2023-12-17T11:52:05.650 INFO:teuthology.orchestra.run.smithi040.stdout:checking for dbm_close in -lgdbm... no 2023-12-17T11:52:05.747 INFO:teuthology.orchestra.run.smithi040.stdout:checking for dbm_open in -lgdbm_compat... yes 2023-12-17T11:52:05.833 INFO:teuthology.orchestra.run.smithi040.stdout:checking for dbm_fetch in -lgdbm_compat... yes 2023-12-17T11:52:05.924 INFO:teuthology.orchestra.run.smithi040.stdout:checking for dbm_store in -lgdbm_compat... yes 2023-12-17T11:52:06.016 INFO:teuthology.orchestra.run.smithi040.stdout:checking for dbm_close in -lgdbm_compat... yes 2023-12-17T11:52:06.084 INFO:teuthology.orchestra.run.smithi040.stdout:checking libaio.h usability... yes 2023-12-17T11:52:06.116 INFO:teuthology.orchestra.run.smithi040.stdout:checking libaio.h presence... yes 2023-12-17T11:52:06.116 INFO:teuthology.orchestra.run.smithi040.stdout:checking for libaio.h... yes 2023-12-17T11:52:06.187 INFO:teuthology.orchestra.run.smithi040.stdout:checking liburing.h usability... no 2023-12-17T11:52:06.231 INFO:teuthology.orchestra.run.smithi040.stdout:checking liburing.h presence... no 2023-12-17T11:52:06.231 INFO:teuthology.orchestra.run.smithi040.stdout:checking for liburing.h... no 2023-12-17T11:52:06.306 INFO:teuthology.orchestra.run.smithi040.stdout:checking sys/capability.h usability... yes 2023-12-17T11:52:06.336 INFO:teuthology.orchestra.run.smithi040.stdout:checking sys/capability.h presence... yes 2023-12-17T11:52:06.336 INFO:teuthology.orchestra.run.smithi040.stdout:checking for sys/capability.h... yes 2023-12-17T11:52:06.403 INFO:teuthology.orchestra.run.smithi040.stdout:checking linux/fiemap.h usability... yes 2023-12-17T11:52:06.429 INFO:teuthology.orchestra.run.smithi040.stdout:checking linux/fiemap.h presence... yes 2023-12-17T11:52:06.430 INFO:teuthology.orchestra.run.smithi040.stdout:checking for linux/fiemap.h... yes 2023-12-17T11:52:06.517 INFO:teuthology.orchestra.run.smithi040.stdout:checking for fallocate... yes 2023-12-17T11:52:06.608 INFO:teuthology.orchestra.run.smithi040.stdout:checking for open_by_handle_at... yes 2023-12-17T11:52:06.678 INFO:teuthology.orchestra.run.smithi040.stdout:checking sys/prctl.h usability... yes 2023-12-17T11:52:06.710 INFO:teuthology.orchestra.run.smithi040.stdout:checking sys/prctl.h presence... yes 2023-12-17T11:52:06.710 INFO:teuthology.orchestra.run.smithi040.stdout:checking for sys/prctl.h... yes 2023-12-17T11:52:06.780 INFO:teuthology.orchestra.run.smithi040.stdout:checking linux/fs.h usability... yes 2023-12-17T11:52:06.809 INFO:teuthology.orchestra.run.smithi040.stdout:checking linux/fs.h presence... yes 2023-12-17T11:52:06.809 INFO:teuthology.orchestra.run.smithi040.stdout:checking for linux/fs.h... yes 2023-12-17T11:52:06.876 INFO:teuthology.orchestra.run.smithi040.stdout:checking btrfsutil.h usability... no 2023-12-17T11:52:06.923 INFO:teuthology.orchestra.run.smithi040.stdout:checking btrfsutil.h presence... no 2023-12-17T11:52:06.924 INFO:teuthology.orchestra.run.smithi040.stdout:checking for btrfsutil.h... no 2023-12-17T11:52:07.032 INFO:teuthology.orchestra.run.smithi040.stdout:checking for copy_file_range... yes 2023-12-17T11:52:07.127 INFO:teuthology.orchestra.run.smithi040.stdout:checking for SEEK_DATA... yes 2023-12-17T11:52:07.248 INFO:teuthology.orchestra.run.smithi040.stdout:checking for BMV_OF_SHARED... yes 2023-12-17T11:52:07.346 INFO:teuthology.orchestra.run.smithi040.stdout:checking for nftw... yes 2023-12-17T11:52:07.442 INFO:teuthology.orchestra.run.smithi040.stdout:checking for RLIMIT_NOFILE... yes 2023-12-17T11:52:07.532 INFO:teuthology.orchestra.run.smithi040.stdout:checking for XFS_IOC_EXCHANGE_RANGE... no 2023-12-17T11:52:07.628 INFO:teuthology.orchestra.run.smithi040.stdout:checking for FICLONE... yes 2023-12-17T11:52:07.722 INFO:teuthology.orchestra.run.smithi040.stdout:checking for renameat2... yes 2023-12-17T11:52:07.814 INFO:teuthology.orchestra.run.smithi040.stdout:checking for reallocarray... yes 2023-12-17T11:52:07.923 INFO:teuthology.orchestra.run.smithi040.stdout:checking for struct mount_attr... yes 2023-12-17T11:52:08.040 INFO:teuthology.orchestra.run.smithi040.stdout:checking for struct btrfs_qgroup_limit... yes 2023-12-17T11:52:08.152 INFO:teuthology.orchestra.run.smithi040.stdout:checking for struct btrfs_qgroup_inherit... yes 2023-12-17T11:52:08.264 INFO:teuthology.orchestra.run.smithi040.stdout:checking for struct btrfs_ioctl_vol_args... yes 2023-12-17T11:52:08.381 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T11:52:08.382 INFO:teuthology.orchestra.run.smithi040.stdout:checking for struct btrfs_ioctl_vol_args_v2... yes 2023-12-17T11:52:08.387 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T11:52:08.500 INFO:teuthology.orchestra.run.smithi040.stdout:checking for struct btrfs_ioctl_ino_lookup_args... yes 2023-12-17T11:52:08.600 INFO:teuthology.orchestra.run.smithi040.stdout:checking for struct btrfs_ioctl_ino_lookup_user_args... yes 2023-12-17T11:52:08.711 INFO:teuthology.orchestra.run.smithi040.stdout:checking for struct btrfs_ioctl_get_subvol_rootref_args... yes 2023-12-17T11:52:08.788 INFO:teuthology.orchestra.run.smithi040.stdout:checking linux/btrfs.h usability... yes 2023-12-17T11:52:08.818 INFO:teuthology.orchestra.run.smithi040.stdout:checking linux/btrfs.h presence... yes 2023-12-17T11:52:08.818 INFO:teuthology.orchestra.run.smithi040.stdout:checking for linux/btrfs.h... yes 2023-12-17T11:52:08.909 INFO:teuthology.orchestra.run.smithi040.stdout:checking linux/btrfs_tree.h usability... yes 2023-12-17T11:52:08.935 INFO:teuthology.orchestra.run.smithi040.stdout:checking linux/btrfs_tree.h presence... yes 2023-12-17T11:52:08.935 INFO:teuthology.orchestra.run.smithi040.stdout:checking for linux/btrfs_tree.h... yes 2023-12-17T11:52:08.991 INFO:teuthology.orchestra.run.smithi040.stdout:checking for struct btrfs_ioctl_vol_args_v2.subvolid... yes 2023-12-17T11:52:09.027 INFO:teuthology.orchestra.run.smithi040.stdout:configure: creating ./config.status 2023-12-17T11:52:10.151 INFO:teuthology.orchestra.run.smithi040.stdout:config.status: creating include/builddefs 2023-12-17T11:52:10.184 INFO:teuthology.orchestra.run.smithi040.stdout:config.status: creating include/config.h 2023-12-17T11:52:10.209 INFO:teuthology.orchestra.run.smithi040.stdout:config.status: executing libtool commands 2023-12-17T11:52:10.296 INFO:teuthology.orchestra.run.smithi040.stdout:Building include 2023-12-17T11:52:10.305 INFO:teuthology.orchestra.run.smithi040.stdout:Building lib 2023-12-17T11:52:10.313 INFO:teuthology.orchestra.run.smithi040.stdout: [LTDEP] 2023-12-17T11:52:10.618 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] dataascii.lo 2023-12-17T11:52:10.890 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] databin.lo 2023-12-17T11:52:11.194 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] datapid.lo 2023-12-17T11:52:11.491 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] file_lock.lo 2023-12-17T11:52:11.816 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] forker.lo 2023-12-17T11:52:12.141 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] pattern.lo 2023-12-17T11:52:12.425 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] open_flags.lo 2023-12-17T11:52:12.740 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] random_range.lo 2023-12-17T11:52:13.146 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] string_to_tokens.lo 2023-12-17T11:52:13.414 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] str_to_bytes.lo 2023-12-17T11:52:13.730 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] tlibio.lo 2023-12-17T11:52:14.151 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] write_log.lo 2023-12-17T11:52:14.575 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] random.lo 2023-12-17T11:52:14.844 INFO:teuthology.orchestra.run.smithi040.stdout: [LD] 2023-12-17T11:52:15.075 INFO:teuthology.orchestra.run.smithi040.stdout:Building ltp 2023-12-17T11:52:15.085 INFO:teuthology.orchestra.run.smithi040.stdout: [DEP] 2023-12-17T11:52:15.386 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] doio 2023-12-17T11:52:16.374 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] fsstress 2023-12-17T11:52:18.134 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] fsx 2023-12-17T11:52:19.156 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] growfiles 2023-12-17T11:52:19.890 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] iogen 2023-12-17T11:52:20.517 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] aio-stress 2023-12-17T11:52:21.201 INFO:teuthology.orchestra.run.smithi040.stdout:Building src 2023-12-17T11:52:21.214 INFO:teuthology.orchestra.run.smithi040.stdout: [DEP] 2023-12-17T11:52:25.255 INFO:teuthology.orchestra.run.smithi040.stdout: [DEP] 2023-12-17T11:52:25.335 INFO:teuthology.orchestra.run.smithi040.stdout: [DEP] 2023-12-17T11:52:25.360 INFO:teuthology.orchestra.run.smithi040.stdout: [DEP] 2023-12-17T11:52:25.872 INFO:teuthology.orchestra.run.smithi040.stdout: [DEP] 2023-12-17T11:52:25.934 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] dirstress 2023-12-17T11:52:26.397 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] fill 2023-12-17T11:52:26.759 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] fill2 2023-12-17T11:52:27.206 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] getpagesize 2023-12-17T11:52:27.551 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] holes 2023-12-17T11:52:28.000 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] lstat64 2023-12-17T11:52:28.432 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] nametest 2023-12-17T11:52:28.924 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] permname 2023-12-17T11:52:29.382 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] randholes 2023-12-17T11:52:29.877 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] runas 2023-12-17T11:52:30.288 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] truncfile 2023-12-17T11:52:30.700 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] usemem 2023-12-17T11:52:31.065 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] mmapcat 2023-12-17T11:52:31.412 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] append_reader 2023-12-17T11:52:31.750 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] append_writer 2023-12-17T11:52:32.090 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] dirperf 2023-12-17T11:52:32.567 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] metaperf 2023-12-17T11:52:33.080 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] devzero 2023-12-17T11:52:33.499 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] feature 2023-12-17T11:52:33.987 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] alloc 2023-12-17T11:52:34.405 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] fault 2023-12-17T11:52:34.758 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] fstest 2023-12-17T11:52:35.194 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] t_access_root 2023-12-17T11:52:35.580 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] godown 2023-12-17T11:52:35.981 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] resvtest 2023-12-17T11:52:36.381 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] writemod 2023-12-17T11:52:36.712 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] writev_on_pagefault 2023-12-17T11:52:37.092 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] makeextents 2023-12-17T11:52:37.536 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] itrash 2023-12-17T11:52:37.887 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] rename 2023-12-17T11:52:38.264 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] multi_open_unlink 2023-12-17T11:52:38.519 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T11:52:38.526 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T11:52:38.628 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] unwritten_sync 2023-12-17T11:52:39.016 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] genhashnames 2023-12-17T11:52:39.430 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] t_holes 2023-12-17T11:52:39.793 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] t_mmap_writev 2023-12-17T11:52:40.180 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] t_truncate_cmtime 2023-12-17T11:52:40.516 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] dirhash_collide 2023-12-17T11:52:40.925 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] t_rename_overwrite 2023-12-17T11:52:41.277 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] holetest 2023-12-17T11:52:41.726 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] t_truncate_self 2023-12-17T11:52:42.061 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] af_unix 2023-12-17T11:52:42.429 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] t_mmap_stale_pmd 2023-12-17T11:52:42.819 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] t_mmap_cow_race 2023-12-17T11:52:43.196 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] t_mmap_fallocate 2023-12-17T11:52:43.593 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] fsync-err 2023-12-17T11:52:44.001 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] t_mmap_write_ro 2023-12-17T11:52:44.361 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] t_ext4_dax_journal_corruption 2023-12-17T11:52:44.725 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] t_ext4_dax_inline_corruption 2023-12-17T11:52:45.096 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] t_ofd_locks 2023-12-17T11:52:45.528 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] t_mmap_collision 2023-12-17T11:52:45.931 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] mmap-write-concurrent 2023-12-17T11:52:46.340 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] t_get_file_time 2023-12-17T11:52:46.696 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] t_create_short_dirs 2023-12-17T11:52:47.117 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] t_create_long_dirs 2023-12-17T11:52:47.503 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] t_enospc 2023-12-17T11:52:47.902 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] t_mmap_writev_overlap 2023-12-17T11:52:48.292 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] checkpoint_journal 2023-12-17T11:52:48.669 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] mmap-rw-fault 2023-12-17T11:52:49.094 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] allocstale 2023-12-17T11:52:49.505 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] t_mmap_cow_memory_failure 2023-12-17T11:52:49.901 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] fake-dump-rootino 2023-12-17T11:52:50.265 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] dio-buf-fault 2023-12-17T11:52:50.627 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] rewinddir-test 2023-12-17T11:52:50.997 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] xfsctl 2023-12-17T11:52:51.418 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] bstat 2023-12-17T11:52:51.841 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] t_mtab 2023-12-17T11:52:52.236 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] getdevicesize 2023-12-17T11:52:52.591 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] preallo_rw_pattern_reader 2023-12-17T11:52:52.966 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] preallo_rw_pattern_writer 2023-12-17T11:52:53.360 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] ftrunc 2023-12-17T11:52:53.740 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] trunc 2023-12-17T11:52:54.123 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] fs_perms 2023-12-17T11:52:54.500 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] testx 2023-12-17T11:52:54.828 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] looptest 2023-12-17T11:52:55.235 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] locktest 2023-12-17T11:52:55.761 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] unwritten_mmap 2023-12-17T11:52:56.128 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] bulkstat_unlink_test 2023-12-17T11:52:56.552 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] deduperace 2023-12-17T11:52:56.940 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] bulkstat_unlink_test_modified 2023-12-17T11:52:57.365 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] t_dir_offset 2023-12-17T11:52:57.715 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] t_futimens 2023-12-17T11:52:58.035 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] t_immutable 2023-12-17T11:52:58.939 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] stale_handle 2023-12-17T11:52:59.350 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] pwrite_mmap_blocked 2023-12-17T11:52:59.726 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] t_dir_offset2 2023-12-17T11:53:00.145 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] seek_sanity_test 2023-12-17T11:53:00.845 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] seek_copy_test 2023-12-17T11:53:01.248 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] t_readdir_1 2023-12-17T11:53:01.608 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] t_readdir_2 2023-12-17T11:53:02.018 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] fsync-tester 2023-12-17T11:53:02.504 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] nsexec 2023-12-17T11:53:02.859 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] cloner 2023-12-17T11:53:03.283 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] renameat2 2023-12-17T11:53:03.665 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] t_getcwd 2023-12-17T11:53:04.053 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] e4compact 2023-12-17T11:53:04.460 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] test-nextquota 2023-12-17T11:53:04.843 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] punch-alternating 2023-12-17T11:53:05.221 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] attr-list-by-handle-cursor-test 2023-12-17T11:53:05.591 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] listxattr 2023-12-17T11:53:05.946 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] dio-interleaved 2023-12-17T11:53:06.359 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] t_dir_type 2023-12-17T11:53:06.733 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] dio-invalidate-cache 2023-12-17T11:53:07.174 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] stat_test 2023-12-17T11:53:07.732 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] t_encrypted_d_revalidate 2023-12-17T11:53:08.112 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] attr_replace_test 2023-12-17T11:53:08.486 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] swapon 2023-12-17T11:53:08.666 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T11:53:08.674 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T11:53:08.832 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] mkswap 2023-12-17T11:53:09.200 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] t_attr_corruption 2023-12-17T11:53:09.557 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] t_open_tmpfiles 2023-12-17T11:53:09.983 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] fscrypt-crypt-util 2023-12-17T11:53:10.896 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] bulkstat_null_ocount 2023-12-17T11:53:11.270 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] splice-test 2023-12-17T11:53:11.705 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] chprojid_fail 2023-12-17T11:53:12.083 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] detached_mounts_propagation 2023-12-17T11:53:12.527 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] ext4_resize 2023-12-17T11:53:12.875 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] t_readdir_3 2023-12-17T11:53:13.306 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] splice2pipe 2023-12-17T11:53:13.719 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] uuid_ioctl 2023-12-17T11:53:14.102 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] fiemap-tester 2023-12-17T11:53:14.611 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] t_stripealign 2023-12-17T11:53:14.968 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] open_by_handle 2023-12-17T11:53:15.445 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] dbtest 2023-12-17T11:53:15.989 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] t_mmap_dio 2023-12-17T11:53:16.373 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] xfsfind 2023-12-17T11:53:16.757 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] t_reflink_read_race 2023-12-17T11:53:17.156 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] fssum 2023-12-17T11:53:17.864 INFO:teuthology.orchestra.run.smithi040.stdout:Building log-writes 2023-12-17T11:53:17.881 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] replay-log 2023-12-17T11:53:18.430 INFO:teuthology.orchestra.run.smithi040.stdout:Building perf 2023-12-17T11:53:18.440 INFO:teuthology.orchestra.run.smithi040.stdout:Building aio-dio-regress 2023-12-17T11:53:18.456 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] aiocp 2023-12-17T11:53:18.908 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] aio-dio-append-write-fallocate-race 2023-12-17T11:53:19.293 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] aio-dio-append-write-read-race 2023-12-17T11:53:19.662 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] aio-dio-cow-race 2023-12-17T11:53:20.033 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] aio-dio-cycle-write 2023-12-17T11:53:20.429 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] aio-dio-eof-race 2023-12-17T11:53:20.832 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] aio-dio-extend-stat 2023-12-17T11:53:21.235 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] aio-dio-fcntl-race 2023-12-17T11:53:21.608 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] aio-dio-hole-filling-race 2023-12-17T11:53:21.950 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] aio-dio-invalidate-failure 2023-12-17T11:53:22.305 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] aio-dio-invalidate-readahead 2023-12-17T11:53:22.675 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] aiodio_sparse2 2023-12-17T11:53:23.129 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] aio-dio-subblock-eof-read 2023-12-17T11:53:23.478 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] aio-dio-write-verify 2023-12-17T11:53:23.889 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] aio-free-ring-with-bogus-nr-pages 2023-12-17T11:53:24.262 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] aio-io-setup-with-nonwritable-context-pointer 2023-12-17T11:53:24.616 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] aio-last-ref-held-by-io 2023-12-17T11:53:24.990 INFO:teuthology.orchestra.run.smithi040.stdout:Building vfs 2023-12-17T11:53:25.007 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] vfstest 2023-12-17T11:53:29.133 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] mount-idmapped 2023-12-17T11:53:29.798 INFO:teuthology.orchestra.run.smithi040.stdout:Building m4 2023-12-17T11:53:29.810 INFO:teuthology.orchestra.run.smithi040.stdout:Building common 2023-12-17T11:53:29.820 INFO:teuthology.orchestra.run.smithi040.stdout:Building tests 2023-12-17T11:53:29.835 INFO:teuthology.orchestra.run.smithi040.stdout:Building btrfs 2023-12-17T11:53:29.852 INFO:teuthology.orchestra.run.smithi040.stdout: [GROUP] /tmp/tmp.34EJEHEKBdxfstests-dev/tests/btrfs/group.list 2023-12-17T11:53:30.087 INFO:teuthology.orchestra.run.smithi040.stdout:Building ceph 2023-12-17T11:53:30.103 INFO:teuthology.orchestra.run.smithi040.stdout: [GROUP] /tmp/tmp.34EJEHEKBdxfstests-dev/tests/ceph/group.list 2023-12-17T11:53:30.164 INFO:teuthology.orchestra.run.smithi040.stdout:Building cifs 2023-12-17T11:53:30.179 INFO:teuthology.orchestra.run.smithi040.stdout: [GROUP] /tmp/tmp.34EJEHEKBdxfstests-dev/tests/cifs/group.list 2023-12-17T11:53:30.231 INFO:teuthology.orchestra.run.smithi040.stdout:Building ext4 2023-12-17T11:53:30.247 INFO:teuthology.orchestra.run.smithi040.stdout: [GROUP] /tmp/tmp.34EJEHEKBdxfstests-dev/tests/ext4/group.list 2023-12-17T11:53:30.406 INFO:teuthology.orchestra.run.smithi040.stdout:Building f2fs 2023-12-17T11:53:30.422 INFO:teuthology.orchestra.run.smithi040.stdout: [GROUP] /tmp/tmp.34EJEHEKBdxfstests-dev/tests/f2fs/group.list 2023-12-17T11:53:30.493 INFO:teuthology.orchestra.run.smithi040.stdout:Building generic 2023-12-17T11:53:30.512 INFO:teuthology.orchestra.run.smithi040.stdout: [GROUP] /tmp/tmp.34EJEHEKBdxfstests-dev/tests/generic/group.list 2023-12-17T11:53:30.925 INFO:teuthology.orchestra.run.smithi040.stdout:Building nfs 2023-12-17T11:53:30.941 INFO:teuthology.orchestra.run.smithi040.stdout: [GROUP] /tmp/tmp.34EJEHEKBdxfstests-dev/tests/nfs/group.list 2023-12-17T11:53:30.995 INFO:teuthology.orchestra.run.smithi040.stdout:Building ocfs2 2023-12-17T11:53:31.010 INFO:teuthology.orchestra.run.smithi040.stdout: [GROUP] /tmp/tmp.34EJEHEKBdxfstests-dev/tests/ocfs2/group.list 2023-12-17T11:53:31.062 INFO:teuthology.orchestra.run.smithi040.stdout:Building overlay 2023-12-17T11:53:31.078 INFO:teuthology.orchestra.run.smithi040.stdout: [GROUP] /tmp/tmp.34EJEHEKBdxfstests-dev/tests/overlay/group.list 2023-12-17T11:53:31.248 INFO:teuthology.orchestra.run.smithi040.stdout:Building perf 2023-12-17T11:53:31.264 INFO:teuthology.orchestra.run.smithi040.stdout: [GROUP] /tmp/tmp.34EJEHEKBdxfstests-dev/tests/perf/group.list 2023-12-17T11:53:31.311 INFO:teuthology.orchestra.run.smithi040.stdout:Building selftest 2023-12-17T11:53:31.327 INFO:teuthology.orchestra.run.smithi040.stdout: [GROUP] /tmp/tmp.34EJEHEKBdxfstests-dev/tests/selftest/group.list 2023-12-17T11:53:31.377 INFO:teuthology.orchestra.run.smithi040.stdout:Building shared 2023-12-17T11:53:31.393 INFO:teuthology.orchestra.run.smithi040.stdout: [GROUP] /tmp/tmp.34EJEHEKBdxfstests-dev/tests/shared/group.list 2023-12-17T11:53:31.463 INFO:teuthology.orchestra.run.smithi040.stdout:Building tmpfs 2023-12-17T11:53:31.478 INFO:teuthology.orchestra.run.smithi040.stdout: [GROUP] /tmp/tmp.34EJEHEKBdxfstests-dev/tests/tmpfs/group.list 2023-12-17T11:53:31.533 INFO:teuthology.orchestra.run.smithi040.stdout:Building udf 2023-12-17T11:53:31.549 INFO:teuthology.orchestra.run.smithi040.stdout: [GROUP] /tmp/tmp.34EJEHEKBdxfstests-dev/tests/udf/group.list 2023-12-17T11:53:31.596 INFO:teuthology.orchestra.run.smithi040.stdout:Building xfs 2023-12-17T11:53:31.615 INFO:teuthology.orchestra.run.smithi040.stdout: [GROUP] /tmp/tmp.34EJEHEKBdxfstests-dev/tests/xfs/group.list 2023-12-17T11:53:32.049 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo make install) 2023-12-17T11:53:32.187 INFO:teuthology.orchestra.run.smithi040.stdout:Building include 2023-12-17T11:53:32.199 INFO:teuthology.orchestra.run.smithi040.stdout:Building lib 2023-12-17T11:53:32.211 INFO:teuthology.orchestra.run.smithi040.stdout:Building ltp 2023-12-17T11:53:32.223 INFO:teuthology.orchestra.run.smithi040.stdout:Building src 2023-12-17T11:53:32.318 INFO:teuthology.orchestra.run.smithi040.stdout:Building log-writes 2023-12-17T11:53:32.329 INFO:teuthology.orchestra.run.smithi040.stdout:Building perf 2023-12-17T11:53:32.340 INFO:teuthology.orchestra.run.smithi040.stdout:Building aio-dio-regress 2023-12-17T11:53:32.353 INFO:teuthology.orchestra.run.smithi040.stdout:Building vfs 2023-12-17T11:53:32.364 INFO:teuthology.orchestra.run.smithi040.stdout:Building m4 2023-12-17T11:53:32.376 INFO:teuthology.orchestra.run.smithi040.stdout:Building common 2023-12-17T11:53:32.388 INFO:teuthology.orchestra.run.smithi040.stdout:Building tests 2023-12-17T11:53:32.403 INFO:teuthology.orchestra.run.smithi040.stdout:Building btrfs 2023-12-17T11:53:32.420 INFO:teuthology.orchestra.run.smithi040.stdout: [GROUP] /tmp/tmp.34EJEHEKBdxfstests-dev/tests/btrfs/group.list 2023-12-17T11:53:32.665 INFO:teuthology.orchestra.run.smithi040.stdout:Building ceph 2023-12-17T11:53:32.681 INFO:teuthology.orchestra.run.smithi040.stdout: [GROUP] /tmp/tmp.34EJEHEKBdxfstests-dev/tests/ceph/group.list 2023-12-17T11:53:32.740 INFO:teuthology.orchestra.run.smithi040.stdout:Building cifs 2023-12-17T11:53:32.755 INFO:teuthology.orchestra.run.smithi040.stdout: [GROUP] /tmp/tmp.34EJEHEKBdxfstests-dev/tests/cifs/group.list 2023-12-17T11:53:32.807 INFO:teuthology.orchestra.run.smithi040.stdout:Building ext4 2023-12-17T11:53:32.823 INFO:teuthology.orchestra.run.smithi040.stdout: [GROUP] /tmp/tmp.34EJEHEKBdxfstests-dev/tests/ext4/group.list 2023-12-17T11:53:32.980 INFO:teuthology.orchestra.run.smithi040.stdout:Building f2fs 2023-12-17T11:53:32.995 INFO:teuthology.orchestra.run.smithi040.stdout: [GROUP] /tmp/tmp.34EJEHEKBdxfstests-dev/tests/f2fs/group.list 2023-12-17T11:53:33.065 INFO:teuthology.orchestra.run.smithi040.stdout:Building generic 2023-12-17T11:53:33.085 INFO:teuthology.orchestra.run.smithi040.stdout: [GROUP] /tmp/tmp.34EJEHEKBdxfstests-dev/tests/generic/group.list 2023-12-17T11:53:33.466 INFO:teuthology.orchestra.run.smithi040.stdout:Building nfs 2023-12-17T11:53:33.482 INFO:teuthology.orchestra.run.smithi040.stdout: [GROUP] /tmp/tmp.34EJEHEKBdxfstests-dev/tests/nfs/group.list 2023-12-17T11:53:33.542 INFO:teuthology.orchestra.run.smithi040.stdout:Building ocfs2 2023-12-17T11:53:33.558 INFO:teuthology.orchestra.run.smithi040.stdout: [GROUP] /tmp/tmp.34EJEHEKBdxfstests-dev/tests/ocfs2/group.list 2023-12-17T11:53:33.613 INFO:teuthology.orchestra.run.smithi040.stdout:Building overlay 2023-12-17T11:53:33.629 INFO:teuthology.orchestra.run.smithi040.stdout: [GROUP] /tmp/tmp.34EJEHEKBdxfstests-dev/tests/overlay/group.list 2023-12-17T11:53:33.798 INFO:teuthology.orchestra.run.smithi040.stdout:Building perf 2023-12-17T11:53:33.816 INFO:teuthology.orchestra.run.smithi040.stdout: [GROUP] /tmp/tmp.34EJEHEKBdxfstests-dev/tests/perf/group.list 2023-12-17T11:53:33.862 INFO:teuthology.orchestra.run.smithi040.stdout:Building selftest 2023-12-17T11:53:33.876 INFO:teuthology.orchestra.run.smithi040.stdout: [GROUP] /tmp/tmp.34EJEHEKBdxfstests-dev/tests/selftest/group.list 2023-12-17T11:53:33.923 INFO:teuthology.orchestra.run.smithi040.stdout:Building shared 2023-12-17T11:53:33.936 INFO:teuthology.orchestra.run.smithi040.stdout: [GROUP] /tmp/tmp.34EJEHEKBdxfstests-dev/tests/shared/group.list 2023-12-17T11:53:34.007 INFO:teuthology.orchestra.run.smithi040.stdout:Building tmpfs 2023-12-17T11:53:34.023 INFO:teuthology.orchestra.run.smithi040.stdout: [GROUP] /tmp/tmp.34EJEHEKBdxfstests-dev/tests/tmpfs/group.list 2023-12-17T11:53:34.076 INFO:teuthology.orchestra.run.smithi040.stdout:Building udf 2023-12-17T11:53:34.091 INFO:teuthology.orchestra.run.smithi040.stdout: [GROUP] /tmp/tmp.34EJEHEKBdxfstests-dev/tests/udf/group.list 2023-12-17T11:53:34.136 INFO:teuthology.orchestra.run.smithi040.stdout:Building xfs 2023-12-17T11:53:34.155 INFO:teuthology.orchestra.run.smithi040.stdout: [GROUP] /tmp/tmp.34EJEHEKBdxfstests-dev/tests/xfs/group.list 2023-12-17T11:53:34.559 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/gmake --no-print-directory Q=@ -C include install 2023-12-17T11:53:34.563 INFO:teuthology.orchestra.run.smithi040.stdout:gmake[1]: Nothing to be done for 'install'. 2023-12-17T11:53:34.564 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/gmake --no-print-directory Q=@ -C lib install 2023-12-17T11:53:34.569 INFO:teuthology.orchestra.run.smithi040.stdout:gmake[1]: Nothing to be done for 'install'. 2023-12-17T11:53:34.569 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/gmake --no-print-directory Q=@ -C ltp install 2023-12-17T11:53:34.575 INFO:teuthology.orchestra.run.smithi040.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/ltp 2023-12-17T11:53:34.611 INFO:teuthology.orchestra.run.smithi040.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 doio fsstress fsx growfiles iogen aio-stress /var/lib/xfstests/ltp 2023-12-17T11:53:34.868 INFO:teuthology.orchestra.run.smithi040.stdout:../install-sh -o root -g root -m 755 rwtest.sh /var/lib/xfstests/ltp 2023-12-17T11:53:34.905 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/gmake --no-print-directory Q=@ -C src install 2023-12-17T11:53:34.954 INFO:teuthology.orchestra.run.smithi040.stdout:Building log-writes 2023-12-17T11:53:34.966 INFO:teuthology.orchestra.run.smithi040.stdout:Building perf 2023-12-17T11:53:34.978 INFO:teuthology.orchestra.run.smithi040.stdout:Building aio-dio-regress 2023-12-17T11:53:34.991 INFO:teuthology.orchestra.run.smithi040.stdout:Building vfs 2023-12-17T11:53:35.000 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/gmake -C log-writes install 2023-12-17T11:53:35.004 INFO:teuthology.orchestra.run.smithi040.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/log-writes 2023-12-17T11:53:35.040 INFO:teuthology.orchestra.run.smithi040.stdout:../../install-sh -o root -g root -m 755 replay-log /var/lib/xfstests/src/log-writes 2023-12-17T11:53:35.079 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/gmake -C perf install 2023-12-17T11:53:35.083 INFO:teuthology.orchestra.run.smithi040.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/perf 2023-12-17T11:53:35.119 INFO:teuthology.orchestra.run.smithi040.stdout:../../install-sh -o root -g root -m 755 FioCompare.py fio-insert-and-compare.py FioResultDecoder.py generate-schema.py ResultData.py fio-results.sql /var/lib/xfstests/src/perf 2023-12-17T11:53:35.213 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/gmake -C aio-dio-regress install 2023-12-17T11:53:35.218 INFO:teuthology.orchestra.run.smithi040.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/aio-dio-regress 2023-12-17T11:53:35.254 INFO:teuthology.orchestra.run.smithi040.stdout:../../install-sh -o root -g root -m 755 aiocp aio-dio-append-write-fallocate-race aio-dio-append-write-read-race aio-dio-cow-race aio-dio-cycle-write aio-dio-eof-race aio-dio-extend-stat aio-dio-fcntl-race aio-dio-hole-filling-race aio-dio-invalidate-failure aio-dio-invalidate-readahead aiodio_sparse2 aio-dio-subblock-eof-read aio-dio-write-verify aio-free-ring-with-bogus-nr-pages aio-io-setup-with-nonwritable-context-pointer aio-last-ref-held-by-io /var/lib/xfstests/src/aio-dio-regress 2023-12-17T11:53:35.467 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/gmake -C vfs install 2023-12-17T11:53:35.471 INFO:teuthology.orchestra.run.smithi040.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/vfs 2023-12-17T11:53:35.507 INFO:teuthology.orchestra.run.smithi040.stdout:../../install-sh -o root -g root -m 755 vfstest mount-idmapped /var/lib/xfstests/src/vfs 2023-12-17T11:53:35.557 INFO:teuthology.orchestra.run.smithi040.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src 2023-12-17T11:53:35.593 INFO:teuthology.orchestra.run.smithi040.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 dirstress fill fill2 getpagesize holes lstat64 nametest permname randholes runas truncfile usemem mmapcat append_reader append_writer dirperf metaperf devzero feature alloc fault fstest t_access_root godown resvtest writemod writev_on_pagefault makeextents itrash rename multi_open_unlink unwritten_sync genhashnames t_holes t_mmap_writev t_truncate_cmtime dirhash_collide t_rename_overwrite holetest t_truncate_self af_unix t_mmap_stale_pmd t_mmap_cow_race t_mmap_fallocate fsync-err t_mmap_write_ro t_ext4_dax_journal_corruption t_ext4_dax_inline_corruption t_ofd_locks t_mmap_collision mmap-write-concurrent t_get_file_time t_create_short_dirs t_create_long_dirs t_enospc t_mmap_writev_overlap checkpoint_journal mmap-rw-fault allocstale t_mmap_cow_memory_failure fake-dump-rootino dio-buf-fault rewinddir-test xfsctl bstat t_mtab getdevicesize preallo_rw_pattern_reader preallo_rw_pattern_writer ftrunc trunc fs_perms testx looptest locktest unwritten_mmap bulkstat_unlink_test deduperace bulkstat_unlink_test_modified t_dir_offset t_futimens t_immutable stale_handle pwrite_mmap_blocked t_dir_offset2 seek_sanity_test seek_copy_test t_readdir_1 t_readdir_2 fsync-tester nsexec cloner renameat2 t_getcwd e4compact test-nextquota punch-alternating attr-list-by-handle-cursor-test listxattr dio-interleaved t_dir_type dio-invalidate-cache stat_test t_encrypted_d_revalidate attr_replace_test swapon mkswap t_attr_corruption t_open_tmpfiles fscrypt-crypt-util bulkstat_null_ocount splice-test chprojid_fail detached_mounts_propagation ext4_resize t_readdir_3 splice2pipe uuid_ioctl fiemap-tester t_stripealign open_by_handle dbtest t_mmap_dio xfsfind t_reflink_read_race fssum /var/lib/xfstests/src 2023-12-17T11:53:38.805 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T11:53:38.813 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T11:53:40.323 INFO:teuthology.orchestra.run.smithi040.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 dmerror fill2attr fill2fs fill2fs_check scaleread.sh btrfs_crc32c_forged_name.py popdir.pl popattr.py soak_duration.awk /var/lib/xfstests/src 2023-12-17T11:53:40.681 INFO:teuthology.orchestra.run.smithi040.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 644 dumpfile /var/lib/xfstests/src 2023-12-17T11:53:40.758 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/gmake --no-print-directory Q=@ -C m4 install 2023-12-17T11:53:40.763 INFO:teuthology.orchestra.run.smithi040.stdout:gmake[1]: Nothing to be done for 'install'. 2023-12-17T11:53:40.763 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/gmake --no-print-directory Q=@ -C common install 2023-12-17T11:53:40.767 INFO:teuthology.orchestra.run.smithi040.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/common 2023-12-17T11:53:40.805 INFO:teuthology.orchestra.run.smithi040.stdout:../install-sh -o root -g root -m 644 * /var/lib/xfstests/common 2023-12-17T11:53:41.353 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/gmake --no-print-directory Q=@ -C tests install 2023-12-17T11:53:41.357 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.34EJEHEKBdxfstests-dev/tests/btrfs/ install 2023-12-17T11:53:41.364 INFO:teuthology.orchestra.run.smithi040.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/btrfs 2023-12-17T11:53:41.401 INFO:teuthology.orchestra.run.smithi040.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 081 082 083 084 085 086 087 088 089 090 091 092 093 094 095 096 097 098 099 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 237 238 239 240 241 242 243 244 245 246 247 248 249 250 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 301 302 303 /var/lib/xfstests/tests/btrfs 2023-12-17T11:53:44.997 INFO:teuthology.orchestra.run.smithi040.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/btrfs 2023-12-17T11:53:45.034 INFO:teuthology.orchestra.run.smithi040.stdout:../../install-sh -o root -g root -m 644 001.out 002.out 003.out 004.out 005.out 006.out 007.out 008.out 009.out 010.out 011.out 012.out 013.out 014.out 015.out 016.out 017.out 018.out 019.out 020.out 021.out 022.out 023.out 024.out 025.out 026.out 027.out 028.out 029.out 030.out 031.out 032.out 033.out 034.out 035.out 036.out 037.out 038.out 039.out 040.out 041.out 042.out 043.out 044.out 045.out 046.out 047.out 048.out 049.out 050.out 051.out 052.out 053.out 054.out 055.out 056.out 057.out 058.out 059.out 060.out 061.out 062.out 063.out 064.out 065.out 066.out 067.out 068.out 069.out 070.out 071.out 072.out 073.out 074.out 075.out 076.out 077.out 078.out 079.out 080.out 081.out 082.out 083.out 084.out 085.out 086.out 087.out 088.out 089.out 090.out 091.out 092.out 093.out 094.out 095.out 096.out 097.out 098.out 099.out 100.out 101.out 102.out 103.out 104.out 105.out 106.out 107.out 108.out 109.out 110.out 111.out 112.out 113.out 114.out 115.out 116.out 117.out 118.out 119.out 120.out 121.out 122.out 123.out 124.out 125.out 126.out 127.out 128.out 129.out 130.out 131.out 132.out 133.out 134.out 135.out 136.out 137.out 138.out 139.out 140.out 141.out 142.out 143.out 144.out 145.out 146.out 147.out 148.out 149.out 150.out 151.out 152.out 153.out 154.out 155.out 156.out 157.out 158.out 159.out 160.out 161.out 162.out 163.out 164.out 165.out 166.out 167.out 168.out 169.out 170.out 171.out 172.out 173.out 174.out 175.out 176.out 177.out 178.out 179.out 180.out 181.out 182.out 183.out 184.out 185.out 186.out 187.out 188.out 189.out 190.out 191.out 192.out 193.out 194.out 195.out 196.out 197.out 198.out 199.out 200.out 201.out 202.out 203.out 204.out 205.out 206.out 207.out 208.out 209.out 210.out 211.out 212.out 213.out 214.out 215.out 216.out 217.out 218.out 219.out 220.out 221.out 222.out 223.out 224.out 225.out 226.out 227.out 228.out 229.out 230.out 231.out 232.out 233.out 234.out 235.out 236.out 237.out 238.out 239.out 240.out 241.out 242.out 243.out 244.out 245.out 246.out 247.out 248.out 249.out 250.out 251.out 252.out 253.out 254.out 255.out 256.out 257.out 258.out 259.out 260.out 261.out 262.out 263.out 264.out 265.out 266.out 267.out 268.out 269.out 270.out 271.out 272.out 273.out 274.out 275.out 276.out 277.out 278.out 279.out 280.out 281.out 282.out 283.out 284.out 285.out 286.out 287.out 288.out 289.out 290.out 291.out 292.out 293.out 294.out 295.out 296.out 297.out 298.out 299.out 300.out 301.out 302.out 303.out /var/lib/xfstests/tests/btrfs 2023-12-17T11:53:48.676 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.34EJEHEKBdxfstests-dev/tests/ceph/ install 2023-12-17T11:53:48.680 INFO:teuthology.orchestra.run.smithi040.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/ceph 2023-12-17T11:53:48.717 INFO:teuthology.orchestra.run.smithi040.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 /var/lib/xfstests/tests/ceph 2023-12-17T11:53:48.799 INFO:teuthology.orchestra.run.smithi040.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/ceph 2023-12-17T11:53:48.835 INFO:teuthology.orchestra.run.smithi040.stdout:../../install-sh -o root -g root -m 644 001.out 002.out 003.out 004.out 005.out /var/lib/xfstests/tests/ceph 2023-12-17T11:53:48.914 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.34EJEHEKBdxfstests-dev/tests/cifs/ install 2023-12-17T11:53:48.919 INFO:teuthology.orchestra.run.smithi040.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/cifs 2023-12-17T11:53:48.953 INFO:teuthology.orchestra.run.smithi040.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/cifs 2023-12-17T11:53:48.988 INFO:teuthology.orchestra.run.smithi040.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/cifs 2023-12-17T11:53:49.023 INFO:teuthology.orchestra.run.smithi040.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/cifs 2023-12-17T11:53:49.059 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.34EJEHEKBdxfstests-dev/tests/ext4/ install 2023-12-17T11:53:49.064 INFO:teuthology.orchestra.run.smithi040.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/ext4 2023-12-17T11:53:49.101 INFO:teuthology.orchestra.run.smithi040.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 271 301 302 303 304 305 306 307 308 /var/lib/xfstests/tests/ext4 2023-12-17T11:53:49.879 INFO:teuthology.orchestra.run.smithi040.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/ext4 2023-12-17T11:53:49.917 INFO:teuthology.orchestra.run.smithi040.stdout:../../install-sh -o root -g root -m 644 001.out.default 001.out.nodelalloc 001.out.nozero 001.cfg 002.out 003.out 004.out 005.out 006.out 007.out 008.out 009.out 010.out 011.out 012.out 013.out 014.out 015.out 016.out 017.out 018.out 019.out 020.out 021.out 022.out 023.out 024.out 025.out 026.out 027.out 028.out 029.out 030.out 031.out 032.out 033.out 034.out 035.out 036.out 037.out 038.out 039.out 040.out 041.out 042.out 043.out 044.out 045.out 046.out 047.out 048.out 049.out 050.out 051.out 052.out 053.out 054.out 055.out 056.out 057.out 058.out 059.out 271.out 301.out 302.out 303.out 304.out 305.out 306.out 307.out 308.out /var/lib/xfstests/tests/ext4 2023-12-17T11:53:50.762 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.34EJEHEKBdxfstests-dev/tests/f2fs/ install 2023-12-17T11:53:50.767 INFO:teuthology.orchestra.run.smithi040.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/f2fs 2023-12-17T11:53:50.805 INFO:teuthology.orchestra.run.smithi040.stdout:../../install-sh -o root -g root -m 755 001 002 /var/lib/xfstests/tests/f2fs 2023-12-17T11:53:50.853 INFO:teuthology.orchestra.run.smithi040.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/f2fs 2023-12-17T11:53:50.890 INFO:teuthology.orchestra.run.smithi040.stdout:../../install-sh -o root -g root -m 644 001.out 002.out /var/lib/xfstests/tests/f2fs 2023-12-17T11:53:50.938 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.34EJEHEKBdxfstests-dev/tests/generic/ install 2023-12-17T11:53:50.948 INFO:teuthology.orchestra.run.smithi040.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/generic 2023-12-17T11:53:50.988 INFO:teuthology.orchestra.run.smithi040.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 081 082 083 084 085 086 087 088 089 090 091 092 093 094 095 096 097 098 099 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 237 238 239 240 241 242 243 244 245 246 247 248 249 250 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 301 302 303 304 305 306 307 308 309 310 311 312 313 314 315 316 317 318 319 320 321 322 323 324 325 326 327 328 329 330 331 332 333 334 335 336 337 338 339 340 341 342 343 344 345 346 347 348 349 350 351 352 353 354 355 356 357 358 359 360 361 362 363 364 365 366 367 368 369 370 371 372 373 374 375 376 377 378 379 380 381 382 383 384 385 386 387 388 389 390 391 392 393 394 395 396 397 398 399 400 401 402 403 404 405 406 407 408 409 410 411 412 413 414 415 416 417 418 419 420 421 422 423 424 425 426 427 428 429 430 431 432 433 434 435 436 437 438 439 440 441 442 443 444 445 446 447 448 449 450 451 452 453 454 455 456 457 458 459 460 461 462 463 464 465 466 467 468 469 470 471 472 473 474 475 476 477 478 479 480 481 482 483 484 485 486 487 488 489 490 491 492 493 494 495 496 497 498 499 500 501 502 503 504 505 506 507 508 509 510 511 512 513 514 515 516 517 518 519 520 521 522 523 524 525 526 527 528 529 530 531 532 533 534 535 536 537 538 539 540 541 542 543 544 545 546 547 548 549 550 551 552 553 554 555 556 557 558 559 560 561 562 563 564 565 566 567 568 569 570 571 572 573 574 575 576 577 578 579 580 581 582 583 584 585 586 587 588 589 590 591 592 593 594 595 596 597 598 599 600 601 602 603 604 605 606 607 608 609 610 611 612 613 614 615 616 617 618 619 620 621 622 623 624 625 626 627 628 629 630 631 632 633 634 635 636 637 638 639 640 641 642 643 644 645 646 647 648 649 650 651 652 653 654 655 656 657 658 659 660 661 662 663 664 665 666 667 668 669 670 671 672 673 674 675 676 677 678 679 680 681 682 683 684 685 686 687 688 689 690 691 692 693 694 695 696 697 698 699 700 701 702 703 704 705 706 707 708 709 710 711 712 713 714 715 716 717 718 719 720 721 722 723 724 725 726 727 728 729 730 731 732 733 /var/lib/xfstests/tests/generic 2023-12-17T11:53:59.742 INFO:teuthology.orchestra.run.smithi040.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/generic 2023-12-17T11:53:59.778 INFO:teuthology.orchestra.run.smithi040.stdout:../../install-sh -o root -g root -m 644 035.out.default 035.out.nfs 050.out.default 050.out.nojournal 050.out.xfsquota 035.cfg 050.cfg 001.out 002.out 003.out 004.out 005.out 006.out 007.out 008.out 009.out 010.out 011.out 012.out 013.out 014.out 015.out 016.out 017.out 018.out 019.out 020.out 021.out 022.out 023.out 024.out 025.out 026.out 027.out 028.out 029.out 030.out 031.out 032.out 033.out 034.out 036.out 037.out 038.out 039.out 040.out 041.out 042.out 043.out 044.out 045.out 046.out 047.out 048.out 049.out 051.out 052.out 053.out 054.out 055.out 056.out 057.out 058.out 059.out 060.out 061.out 062.out 063.out 064.out 065.out 066.out 067.out 068.out 069.out 070.out 071.out 072.out 073.out 074.out 075.out 076.out 077.out 078.out 079.out 080.out 081.out 082.out 083.out 084.out 085.out 086.out 087.out 088.out 089.out 090.out 091.out 092.out 093.out 094.out 095.out 096.out 097.out 098.out 099.out 100.out 101.out 102.out 103.out 104.out 105.out 106.out 107.out 108.out 109.out 110.out 111.out 112.out 113.out 114.out 115.out 116.out 117.out 118.out 119.out 120.out 121.out 122.out 123.out 124.out 125.out 126.out 127.out 128.out 129.out 130.out 131.out 132.out 133.out 134.out 135.out 136.out 137.out 138.out 139.out 140.out 141.out 142.out 143.out 144.out 145.out 146.out 147.out 148.out 149.out 150.out 151.out 152.out 153.out 154.out 155.out 156.out 157.out 158.out 159.out 160.out 161.out 162.out 163.out 164.out 165.out 166.out 167.out 168.out 169.out 170.out 171.out 172.out 173.out 174.out 175.out 176.out 177.out 178.out 179.out 180.out 181.out 182.out 183.out 184.out 185.out 186.out 187.out 188.out 189.out 190.out 191.out 192.out 193.out 194.out 195.out 196.out 197.out 198.out 199.out 200.out 201.out 202.out 203.out 204.out 205.out 206.out 207.out 208.out 209.out 210.out 211.out 212.out 213.out 214.out 215.out 216.out 217.out 218.out 219.out 220.out 221.out 222.out 223.out 224.out 225.out 226.out 227.out 228.out 229.out 230.out 231.out 232.out 233.out 234.out 235.out 236.out 237.out 238.out 239.out 240.out 241.out 242.out 243.out 244.out 245.out 246.out 247.out 248.out 249.out 250.out 251.out 252.out 253.out 254.out 255.out 256.out 257.out 258.out 259.out 260.out 261.out 262.out 263.out 264.out 265.out 266.out 267.out 268.out 269.out 270.out 271.out 272.out 273.out 274.out 275.out 276.out 277.out 278.out 279.out 280.out 281.out 282.out 283.out 284.out 285.out 286.out 287.out 288.out 289.out 290.out 291.out 292.out 293.out 294.out 295.out 296.out 297.out 298.out 299.out 300.out 301.out 302.out 303.out 304.out 305.out 306.out 307.out 308.out 309.out 310.out 311.out 312.out 313.out 314.out 315.out 316.out 317.out 318.out 319.out 320.out 321.out 322.out 323.out 324.out 325.out 326.out 327.out 328.out 329.out 330.out 331.out 332.out 333.out 334.out 335.out 336.out 337.out 338.out 339.out 340.out 341.out 342.out 343.out 344.out 345.out 346.out 347.out 348.out 349.out 350.out 351.out 352.out 353.out 354.out 355.out 356.out 357.out 358.out 359.out 360.out 361.out 362.out 363.out 364.out 365.out 366.out 367.out 368.out 369.out 370.out 371.out 372.out 373.out 374.out 375.out 376.out 377.out 378.out 379.out 380.out 381.out 382.out 383.out 384.out 385.out 386.out 387.out 388.out 389.out 390.out 391.out 392.out 393.out 394.out 395.out 396.out 397.out 398.out 399.out 400.out 401.out 402.out 403.out 404.out 405.out 406.out 407.out 408.out 409.out 410.out 411.out 412.out 413.out 414.out 415.out 416.out 417.out 418.out 419.out 420.out 421.out 422.out 423.out 424.out 425.out 426.out 427.out 428.out 429.out 430.out 431.out 432.out 433.out 434.out 435.out 436.out 437.out 438.out 439.out 440.out 441.out 442.out 443.out 444.out 445.out 446.out 447.out 448.out 449.out 450.out 451.out 452.out 453.out 454.out 455.out 456.out 457.out 458.out 459.out 460.out 461.out 462.out 463.out 464.out 465.out 466.out 467.out 468.out 469.out 470.out 471.out 472.out 473.out 474.out 475.out 476.out 477.out 478.out 479.out 480.out 481.out 482.out 483.out 484.out 485.out 486.out 487.out 488.out 489.out 490.out 491.out 492.out 493.out 494.out 495.out 496.out 497.out 498.out 499.out 500.out 501.out 502.out 503.out 504.out 505.out 506.out 507.out 508.out 509.out 510.out 511.out 512.out 513.out 514.out 515.out 516.out 517.out 518.out 519.out 520.out 521.out 522.out 523.out 524.out 525.out 526.out 527.out 528.out 529.out 530.out 531.out 532.out 533.out 534.out 535.out 536.out 537.out 538.out 539.out 540.out 541.out 542.out 543.out 544.out 545.out 546.out 547.out 548.out 549.out 550.out 551.out 552.out 553.out 554.out 555.out 556.out 557.out 558.out 559.out 560.out 561.out 562.out 563.out 564.out 565.out 566.out 567.out 568.out 569.out 570.out 571.out 572.out 573.out 574.out 575.out 576.out 577.out 578.out 579.out 580.out 581.out 582.out 583.out 584.out 585.out 586.out 587.out 588.out 589.out 590.out 591.out 592.out 593.out 594.out 595.out 596.out 597.out 598.out 599.out 600.out 601.out 602.out 603.out 604.out 605.out 606.out 607.out 608.out 609.out 610.out 611.out 612.out 613.out 614.out 615.out 616.out 617.out 618.out 619.out 620.out 621.out 622.out 623.out 624.out 625.out 626.out 627.out 628.out 629.out 630.out 631.out 632.out 633.out 634.out 635.out 636.out 637.out 638.out 639.out 640.out 641.out 642.out 643.out 644.out 645.out 646.out 647.out 648.out 649.out 650.out 651.out 652.out 653.out 654.out 655.out 656.out 657.out 658.out 659.out 660.out 661.out 662.out 663.out 664.out 665.out 666.out 667.out 668.out 669.out 670.out 671.out 672.out 673.out 674.out 675.out 676.out 677.out 678.out 679.out 680.out 681.out 682.out 683.out 684.out 685.out 686.out 687.out 688.out 689.out 690.out 691.out 692.out 693.out 694.out 695.out 696.out 697.out 698.out 699.out 700.out 701.out 702.out 703.out 704.out 705.out 706.out 707.out 708.out 709.out 710.out 711.out 712.out 713.out 714.out 715.out 716.out 717.out 718.out 719.out 720.out 721.out 722.out 723.out 724.out 725.out 726.out 727.out 728.out 729.out 730.out 731.out 732.out 733.out /var/lib/xfstests/tests/generic 2023-12-17T11:54:08.669 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.34EJEHEKBdxfstests-dev/tests/nfs/ install 2023-12-17T11:54:08.674 INFO:teuthology.orchestra.run.smithi040.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/nfs 2023-12-17T11:54:08.710 INFO:teuthology.orchestra.run.smithi040.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/nfs 2023-12-17T11:54:08.745 INFO:teuthology.orchestra.run.smithi040.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/nfs 2023-12-17T11:54:08.782 INFO:teuthology.orchestra.run.smithi040.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/nfs 2023-12-17T11:54:08.819 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.34EJEHEKBdxfstests-dev/tests/ocfs2/ install 2023-12-17T11:54:08.822 INFO:teuthology.orchestra.run.smithi040.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/ocfs2 2023-12-17T11:54:08.859 INFO:teuthology.orchestra.run.smithi040.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/ocfs2 2023-12-17T11:54:08.895 INFO:teuthology.orchestra.run.smithi040.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/ocfs2 2023-12-17T11:54:08.932 INFO:teuthology.orchestra.run.smithi040.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/ocfs2 2023-12-17T11:54:08.937 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T11:54:08.946 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T11:54:08.966 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.34EJEHEKBdxfstests-dev/tests/overlay/ install 2023-12-17T11:54:08.970 INFO:teuthology.orchestra.run.smithi040.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/overlay 2023-12-17T11:54:09.000 INFO:teuthology.orchestra.run.smithi040.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 081 082 083 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 /var/lib/xfstests/tests/overlay 2023-12-17T11:54:10.166 INFO:teuthology.orchestra.run.smithi040.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/overlay 2023-12-17T11:54:10.203 INFO:teuthology.orchestra.run.smithi040.stdout:../../install-sh -o root -g root -m 644 001.out 002.out 003.out 004.out 005.out 006.out 007.out 008.out 009.out 010.out 011.out 012.out 013.out 014.out 015.out 016.out 017.out 018.out 019.out 020.out 021.out 022.out 023.out 024.out 025.out 026.out 027.out 028.out 029.out 030.out 031.out 032.out 033.out 034.out 035.out 036.out 037.out 038.out 039.out 040.out 041.out 042.out 043.out 044.out 045.out 046.out 047.out 048.out 049.out 050.out 051.out 052.out 053.out 054.out 055.out 056.out 057.out 058.out 059.out 060.out 061.out 062.out 063.out 064.out 065.out 066.out 067.out 068.out 069.out 070.out 071.out 072.out 073.out 074.out 075.out 076.out 077.out 078.out 079.out 080.out 081.out 082.out 083.out 100.out 101.out 102.out 103.out 104.out 105.out 106.out 107.out 108.out 109.out 110.out 111.out 112.out 113.out 114.out 115.out 116.out 117.out /var/lib/xfstests/tests/overlay 2023-12-17T11:54:11.355 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.34EJEHEKBdxfstests-dev/tests/perf/ install 2023-12-17T11:54:11.360 INFO:teuthology.orchestra.run.smithi040.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/perf 2023-12-17T11:54:11.395 INFO:teuthology.orchestra.run.smithi040.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/perf 2023-12-17T11:54:11.430 INFO:teuthology.orchestra.run.smithi040.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/perf 2023-12-17T11:54:11.466 INFO:teuthology.orchestra.run.smithi040.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/perf 2023-12-17T11:54:11.503 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.34EJEHEKBdxfstests-dev/tests/selftest/ install 2023-12-17T11:54:11.508 INFO:teuthology.orchestra.run.smithi040.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/selftest 2023-12-17T11:54:11.545 INFO:teuthology.orchestra.run.smithi040.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 /var/lib/xfstests/tests/selftest 2023-12-17T11:54:11.627 INFO:teuthology.orchestra.run.smithi040.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/selftest 2023-12-17T11:54:11.661 INFO:teuthology.orchestra.run.smithi040.stdout:../../install-sh -o root -g root -m 644 001.out 002.out 003.out 004.out 005.out 006.out /var/lib/xfstests/tests/selftest 2023-12-17T11:54:11.752 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.34EJEHEKBdxfstests-dev/tests/shared/ install 2023-12-17T11:54:11.756 INFO:teuthology.orchestra.run.smithi040.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/shared 2023-12-17T11:54:11.792 INFO:teuthology.orchestra.run.smithi040.stdout:../../install-sh -o root -g root -m 755 002 032 298 /var/lib/xfstests/tests/shared 2023-12-17T11:54:11.845 INFO:teuthology.orchestra.run.smithi040.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/shared 2023-12-17T11:54:11.878 INFO:teuthology.orchestra.run.smithi040.stdout:../../install-sh -o root -g root -m 644 002.out 032.out 298.out /var/lib/xfstests/tests/shared 2023-12-17T11:54:11.936 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.34EJEHEKBdxfstests-dev/tests/tmpfs/ install 2023-12-17T11:54:11.940 INFO:teuthology.orchestra.run.smithi040.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/tmpfs 2023-12-17T11:54:11.977 INFO:teuthology.orchestra.run.smithi040.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/tmpfs 2023-12-17T11:54:12.013 INFO:teuthology.orchestra.run.smithi040.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/tmpfs 2023-12-17T11:54:12.049 INFO:teuthology.orchestra.run.smithi040.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/tmpfs 2023-12-17T11:54:12.085 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.34EJEHEKBdxfstests-dev/tests/udf/ install 2023-12-17T11:54:12.089 INFO:teuthology.orchestra.run.smithi040.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/udf 2023-12-17T11:54:12.124 INFO:teuthology.orchestra.run.smithi040.stdout:../../install-sh -o root -g root -m 755 102 /var/lib/xfstests/tests/udf 2023-12-17T11:54:12.156 INFO:teuthology.orchestra.run.smithi040.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/udf 2023-12-17T11:54:12.191 INFO:teuthology.orchestra.run.smithi040.stdout:../../install-sh -o root -g root -m 644 102.out /var/lib/xfstests/tests/udf 2023-12-17T11:54:12.227 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.34EJEHEKBdxfstests-dev/tests/xfs/ install 2023-12-17T11:54:12.238 INFO:teuthology.orchestra.run.smithi040.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/xfs 2023-12-17T11:54:12.276 INFO:teuthology.orchestra.run.smithi040.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 081 082 083 084 085 086 087 088 089 090 091 092 093 094 095 096 097 098 099 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 237 238 239 240 241 242 243 244 245 246 247 248 249 250 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 301 302 303 304 305 306 307 308 309 310 311 312 313 314 315 316 317 318 319 320 321 322 323 324 325 326 327 328 329 330 331 332 333 334 335 336 337 338 339 340 341 342 343 344 345 346 347 348 349 350 351 352 353 354 355 356 357 358 359 360 361 362 363 364 365 366 367 368 369 370 371 372 373 374 375 376 377 378 379 380 381 382 383 384 385 386 387 388 389 390 391 392 393 394 395 396 397 398 399 400 401 402 403 404 405 406 407 408 409 410 411 412 413 414 415 416 417 418 419 420 421 422 423 424 425 426 427 428 429 430 431 432 433 434 435 436 437 438 439 440 441 442 443 444 445 446 447 448 449 450 451 452 453 454 455 456 457 458 459 460 461 462 463 464 465 466 467 468 469 470 471 472 473 474 475 476 477 478 479 480 481 482 483 484 485 486 487 488 489 490 491 492 493 494 495 496 497 498 499 500 501 502 503 504 505 506 507 508 509 510 511 512 513 514 515 516 517 518 519 520 521 522 523 524 525 526 527 528 529 530 531 532 533 534 535 536 537 538 539 540 541 542 543 544 545 546 547 548 549 550 551 552 553 554 555 556 557 558 559 560 561 562 563 564 565 566 567 568 569 570 571 572 573 574 575 576 577 578 579 580 581 582 583 584 585 586 587 588 589 590 591 592 593 594 595 596 597 598 599 600 601 602 603 604 708 709 710 711 712 713 714 715 716 717 718 719 720 721 722 723 724 725 726 727 728 729 730 731 732 733 734 735 736 737 738 739 740 741 742 743 744 745 746 747 748 749 750 751 752 753 754 755 756 757 758 759 760 761 762 763 764 765 766 767 768 769 770 771 772 773 774 775 776 777 778 779 780 781 782 783 784 785 786 787 788 789 790 791 792 793 794 795 796 797 798 799 800 /var/lib/xfstests/tests/xfs 2023-12-17T11:54:20.813 INFO:teuthology.orchestra.run.smithi040.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/xfs 2023-12-17T11:54:20.850 INFO:teuthology.orchestra.run.smithi040.stdout:../../install-sh -o root -g root -m 644 033.out.crc 033.out.default 071.out.32 071.out.64 096.out.external 096.out.internal 216.out.64mblog 216.out.classic 033.cfg 216.cfg 001.out 002.out 003.out 004.out 005.out 006.out 007.out 008.out 009.out 010.out 011.out 012.out 013.out 014.out 015.out 016.out 017.out 018.out 019.out 020.out 021.out 022.out 023.out 024.out 025.out 026.out 027.out 028.out 029.out 030.out 031.out 032.out 034.out 035.out 036.out 037.out 038.out 039.out 040.out 041.out 042.out 043.out 044.out 045.out 046.out 047.out 048.out 049.out 050.out 051.out 052.out 053.out 054.out 055.out 056.out 057.out 058.out 059.out 060.out 061.out 062.out 063.out 064.out 065.out 066.out 067.out 068.out 069.out 070.out 072.out 073.out 074.out 075.out 076.out 077.out 078.out 079.out 080.out 081.out 082.out 083.out 084.out 085.out 086.out 087.out 088.out 089.out 090.out 091.out 092.out 093.out 094.out 095.out 097.out 098.out 099.out 100.out 101.out 102.out 103.out 104.out 105.out 106.out 107.out 108.out 109.out 110.out 111.out 112.out 113.out 114.out 115.out 116.out 117.out 118.out 119.out 120.out 121.out 122.out 123.out 124.out 125.out 126.out 127.out 128.out 129.out 130.out 131.out 132.out 133.out 134.out 135.out 136.out 137.out 138.out 139.out 140.out 141.out 142.out 143.out 144.out 145.out 146.out 147.out 148.out 149.out 150.out 151.out 152.out 153.out 154.out 155.out 156.out 157.out 158.out 159.out 160.out 161.out 162.out 163.out 164.out 165.out 166.out 167.out 168.out 169.out 170.out 171.out 172.out 173.out 174.out 175.out 176.out 177.out 178.out 179.out 180.out 181.out 182.out 183.out 184.out 185.out 186.out 187.out 188.out 189.out 190.out 191.out 192.out 193.out 194.out 195.out 196.out 197.out 198.out 199.out 200.out 201.out 202.out 203.out 204.out 205.out 206.out 207.out 208.out 209.out 210.out 211.out 212.out 213.out 214.out 215.out 217.out 218.out 219.out 220.out 221.out 222.out 223.out 224.out 225.out 226.out 227.out 228.out 229.out 230.out 231.out 232.out 233.out 234.out 235.out 236.out 237.out 238.out 239.out 240.out 241.out 242.out 243.out 244.out 245.out 246.out 247.out 248.out 249.out 250.out 251.out 252.out 253.out 254.out 255.out 256.out 257.out 258.out 259.out 260.out 261.out 262.out 263.out 264.out 265.out 266.out 267.out 268.out 269.out 270.out 271.out 272.out 273.out 274.out 275.out 276.out 277.out 278.out 279.out 280.out 281.out 282.out 283.out 284.out 285.out 286.out 287.out 288.out 289.out 290.out 291.out 292.out 293.out 294.out 295.out 296.out 297.out 298.out 299.out 300.out 301.out 302.out 303.out 304.out 305.out 306.out 307.out 308.out 309.out 310.out 311.out 312.out 313.out 314.out 315.out 316.out 317.out 318.out 319.out 320.out 321.out 322.out 323.out 324.out 325.out 326.out 327.out 328.out 329.out 330.out 331.out 332.out 333.out 334.out 335.out 336.out 337.out 338.out 339.out 340.out 341.out 342.out 343.out 344.out 345.out 346.out 347.out 348.out 349.out 350.out 351.out 352.out 353.out 354.out 355.out 356.out 357.out 358.out 359.out 360.out 361.out 362.out 363.out 364.out 365.out 366.out 367.out 368.out 369.out 370.out 371.out 372.out 373.out 374.out 375.out 376.out 377.out 378.out 379.out 380.out 381.out 382.out 383.out 384.out 385.out 386.out 387.out 388.out 389.out 390.out 391.out 392.out 393.out 394.out 395.out 396.out 397.out 398.out 399.out 400.out 401.out 402.out 403.out 404.out 405.out 406.out 407.out 408.out 409.out 410.out 411.out 412.out 413.out 414.out 415.out 416.out 417.out 418.out 419.out 420.out 421.out 422.out 423.out 424.out 425.out 426.out 427.out 428.out 429.out 430.out 431.out 432.out 433.out 434.out 435.out 436.out 437.out 438.out 439.out 440.out 441.out 442.out 443.out 444.out 445.out 446.out 447.out 448.out 449.out 450.out 451.out 452.out 453.out 454.out 455.out 456.out 457.out 458.out 459.out 460.out 461.out 462.out 463.out 464.out 465.out 466.out 467.out 468.out 469.out 470.out 471.out 472.out 473.out 474.out 475.out 476.out 477.out 478.out 479.out 480.out 481.out 482.out 483.out 484.out 485.out 486.out 487.out 488.out 489.out 490.out 491.out 492.out 493.out 494.out 495.out 496.out 497.out 498.out 499.out 500.out 501.out 502.out 503.out 504.out 505.out 506.out 507.out 508.out 509.out 510.out 511.out 512.out 513.out 514.out 515.out 516.out 517.out 518.out 519.out 520.out 521.out 522.out 523.out 524.out 525.out 526.out 527.out 528.out 529.out 530.out 531.out 532.out 533.out 534.out 535.out 536.out 537.out 538.out 539.out 540.out 541.out 542.out 543.out 544.out 545.out 546.out 547.out 548.out 549.out 550.out 551.out 552.out 553.out 554.out 555.out 556.out 557.out 558.out 559.out 560.out 561.out 562.out 563.out 564.out 565.out 566.out 567.out 568.out 569.out 570.out 571.out 572.out 573.out 574.out 575.out 576.out 577.out 578.out 579.out 580.out 581.out 582.out 583.out 584.out 585.out 586.out 587.out 588.out 589.out 590.out 591.out 592.out 593.out 594.out 595.out 596.out 597.out 598.out 599.out 600.out 601.out 602.out 603.out 604.out 708.out 709.out 710.out 711.out 712.out 713.out 714.out 715.out 716.out 717.out 718.out 719.out 720.out 721.out 722.out 723.out 724.out 725.out 726.out 727.out 728.out 729.out 730.out 731.out 732.out 733.out 734.out 735.out 736.out 737.out 738.out 739.out 740.out 741.out 742.out 743.out 744.out 745.out 746.out 747.out 748.out 749.out 750.out 751.out 752.out 753.out 754.out 755.out 756.out 757.out 758.out 759.out 760.out 761.out 762.out 763.out 764.out 765.out 766.out 767.out 768.out 769.out 770.out 771.out 772.out 773.out 774.out 775.out 776.out 777.out 778.out 779.out 780.out 781.out 782.out 783.out 784.out 785.out 786.out 787.out 788.out 789.out 790.out 791.out 792.out 793.out 794.out 795.out 796.out 797.out 798.out 799.out 800.out /var/lib/xfstests/tests/xfs 2023-12-17T11:54:29.534 INFO:teuthology.orchestra.run.smithi040.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests 2023-12-17T11:54:29.572 INFO:teuthology.orchestra.run.smithi040.stdout:./install-sh -o root -g root -m 755 -d /var/lib/xfstests 2023-12-17T11:54:29.610 INFO:teuthology.orchestra.run.smithi040.stdout:./install-sh -o root -g root -m 755 check /var/lib/xfstests 2023-12-17T11:54:29.646 INFO:teuthology.orchestra.run.smithi040.stdout:./install-sh -o root -g root -m 644 randomize.awk /var/lib/xfstests 2023-12-17T11:54:29.688 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-17T11:54:29.688 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec ls tests/generic) 2023-12-17T11:54:29.750 INFO:teuthology.orchestra.run.smithi040.stdout:001 2023-12-17T11:54:29.751 INFO:teuthology.orchestra.run.smithi040.stdout:001.out 2023-12-17T11:54:29.751 INFO:teuthology.orchestra.run.smithi040.stdout:002 2023-12-17T11:54:29.751 INFO:teuthology.orchestra.run.smithi040.stdout:002.out 2023-12-17T11:54:29.751 INFO:teuthology.orchestra.run.smithi040.stdout:003 2023-12-17T11:54:29.751 INFO:teuthology.orchestra.run.smithi040.stdout:003.out 2023-12-17T11:54:29.751 INFO:teuthology.orchestra.run.smithi040.stdout:004 2023-12-17T11:54:29.751 INFO:teuthology.orchestra.run.smithi040.stdout:004.out 2023-12-17T11:54:29.751 INFO:teuthology.orchestra.run.smithi040.stdout:005 2023-12-17T11:54:29.751 INFO:teuthology.orchestra.run.smithi040.stdout:005.out 2023-12-17T11:54:29.751 INFO:teuthology.orchestra.run.smithi040.stdout:006 2023-12-17T11:54:29.751 INFO:teuthology.orchestra.run.smithi040.stdout:006.out 2023-12-17T11:54:29.751 INFO:teuthology.orchestra.run.smithi040.stdout:007 2023-12-17T11:54:29.751 INFO:teuthology.orchestra.run.smithi040.stdout:007.out 2023-12-17T11:54:29.751 INFO:teuthology.orchestra.run.smithi040.stdout:008 2023-12-17T11:54:29.752 INFO:teuthology.orchestra.run.smithi040.stdout:008.out 2023-12-17T11:54:29.752 INFO:teuthology.orchestra.run.smithi040.stdout:009 2023-12-17T11:54:29.752 INFO:teuthology.orchestra.run.smithi040.stdout:009.out 2023-12-17T11:54:29.752 INFO:teuthology.orchestra.run.smithi040.stdout:010 2023-12-17T11:54:29.752 INFO:teuthology.orchestra.run.smithi040.stdout:010.out 2023-12-17T11:54:29.752 INFO:teuthology.orchestra.run.smithi040.stdout:011 2023-12-17T11:54:29.752 INFO:teuthology.orchestra.run.smithi040.stdout:011.out 2023-12-17T11:54:29.752 INFO:teuthology.orchestra.run.smithi040.stdout:012 2023-12-17T11:54:29.752 INFO:teuthology.orchestra.run.smithi040.stdout:012.out 2023-12-17T11:54:29.752 INFO:teuthology.orchestra.run.smithi040.stdout:013 2023-12-17T11:54:29.752 INFO:teuthology.orchestra.run.smithi040.stdout:013.out 2023-12-17T11:54:29.752 INFO:teuthology.orchestra.run.smithi040.stdout:014 2023-12-17T11:54:29.752 INFO:teuthology.orchestra.run.smithi040.stdout:014.out 2023-12-17T11:54:29.752 INFO:teuthology.orchestra.run.smithi040.stdout:015 2023-12-17T11:54:29.752 INFO:teuthology.orchestra.run.smithi040.stdout:015.out 2023-12-17T11:54:29.753 INFO:teuthology.orchestra.run.smithi040.stdout:016 2023-12-17T11:54:29.753 INFO:teuthology.orchestra.run.smithi040.stdout:016.out 2023-12-17T11:54:29.753 INFO:teuthology.orchestra.run.smithi040.stdout:017 2023-12-17T11:54:29.753 INFO:teuthology.orchestra.run.smithi040.stdout:017.out 2023-12-17T11:54:29.753 INFO:teuthology.orchestra.run.smithi040.stdout:018 2023-12-17T11:54:29.753 INFO:teuthology.orchestra.run.smithi040.stdout:018.out 2023-12-17T11:54:29.753 INFO:teuthology.orchestra.run.smithi040.stdout:019 2023-12-17T11:54:29.753 INFO:teuthology.orchestra.run.smithi040.stdout:019.out 2023-12-17T11:54:29.753 INFO:teuthology.orchestra.run.smithi040.stdout:020 2023-12-17T11:54:29.753 INFO:teuthology.orchestra.run.smithi040.stdout:020.out 2023-12-17T11:54:29.753 INFO:teuthology.orchestra.run.smithi040.stdout:021 2023-12-17T11:54:29.753 INFO:teuthology.orchestra.run.smithi040.stdout:021.out 2023-12-17T11:54:29.753 INFO:teuthology.orchestra.run.smithi040.stdout:022 2023-12-17T11:54:29.753 INFO:teuthology.orchestra.run.smithi040.stdout:022.out 2023-12-17T11:54:29.754 INFO:teuthology.orchestra.run.smithi040.stdout:023 2023-12-17T11:54:29.754 INFO:teuthology.orchestra.run.smithi040.stdout:023.out 2023-12-17T11:54:29.754 INFO:teuthology.orchestra.run.smithi040.stdout:024 2023-12-17T11:54:29.754 INFO:teuthology.orchestra.run.smithi040.stdout:024.out 2023-12-17T11:54:29.754 INFO:teuthology.orchestra.run.smithi040.stdout:025 2023-12-17T11:54:29.754 INFO:teuthology.orchestra.run.smithi040.stdout:025.out 2023-12-17T11:54:29.754 INFO:teuthology.orchestra.run.smithi040.stdout:026 2023-12-17T11:54:29.754 INFO:teuthology.orchestra.run.smithi040.stdout:026.out 2023-12-17T11:54:29.754 INFO:teuthology.orchestra.run.smithi040.stdout:027 2023-12-17T11:54:29.754 INFO:teuthology.orchestra.run.smithi040.stdout:027.out 2023-12-17T11:54:29.754 INFO:teuthology.orchestra.run.smithi040.stdout:028 2023-12-17T11:54:29.754 INFO:teuthology.orchestra.run.smithi040.stdout:028.out 2023-12-17T11:54:29.754 INFO:teuthology.orchestra.run.smithi040.stdout:029 2023-12-17T11:54:29.754 INFO:teuthology.orchestra.run.smithi040.stdout:029.out 2023-12-17T11:54:29.754 INFO:teuthology.orchestra.run.smithi040.stdout:030 2023-12-17T11:54:29.755 INFO:teuthology.orchestra.run.smithi040.stdout:030.out 2023-12-17T11:54:29.755 INFO:teuthology.orchestra.run.smithi040.stdout:031 2023-12-17T11:54:29.755 INFO:teuthology.orchestra.run.smithi040.stdout:031.out 2023-12-17T11:54:29.755 INFO:teuthology.orchestra.run.smithi040.stdout:032 2023-12-17T11:54:29.755 INFO:teuthology.orchestra.run.smithi040.stdout:032.out 2023-12-17T11:54:29.755 INFO:teuthology.orchestra.run.smithi040.stdout:033 2023-12-17T11:54:29.755 INFO:teuthology.orchestra.run.smithi040.stdout:033.out 2023-12-17T11:54:29.755 INFO:teuthology.orchestra.run.smithi040.stdout:034 2023-12-17T11:54:29.755 INFO:teuthology.orchestra.run.smithi040.stdout:034.out 2023-12-17T11:54:29.755 INFO:teuthology.orchestra.run.smithi040.stdout:035 2023-12-17T11:54:29.755 INFO:teuthology.orchestra.run.smithi040.stdout:035.cfg 2023-12-17T11:54:29.755 INFO:teuthology.orchestra.run.smithi040.stdout:035.out.default 2023-12-17T11:54:29.755 INFO:teuthology.orchestra.run.smithi040.stdout:035.out.nfs 2023-12-17T11:54:29.755 INFO:teuthology.orchestra.run.smithi040.stdout:036 2023-12-17T11:54:29.756 INFO:teuthology.orchestra.run.smithi040.stdout:036.out 2023-12-17T11:54:29.756 INFO:teuthology.orchestra.run.smithi040.stdout:037 2023-12-17T11:54:29.756 INFO:teuthology.orchestra.run.smithi040.stdout:037.out 2023-12-17T11:54:29.756 INFO:teuthology.orchestra.run.smithi040.stdout:038 2023-12-17T11:54:29.756 INFO:teuthology.orchestra.run.smithi040.stdout:038.out 2023-12-17T11:54:29.756 INFO:teuthology.orchestra.run.smithi040.stdout:039 2023-12-17T11:54:29.756 INFO:teuthology.orchestra.run.smithi040.stdout:039.out 2023-12-17T11:54:29.756 INFO:teuthology.orchestra.run.smithi040.stdout:040 2023-12-17T11:54:29.756 INFO:teuthology.orchestra.run.smithi040.stdout:040.out 2023-12-17T11:54:29.756 INFO:teuthology.orchestra.run.smithi040.stdout:041 2023-12-17T11:54:29.756 INFO:teuthology.orchestra.run.smithi040.stdout:041.out 2023-12-17T11:54:29.756 INFO:teuthology.orchestra.run.smithi040.stdout:042 2023-12-17T11:54:29.756 INFO:teuthology.orchestra.run.smithi040.stdout:042.out 2023-12-17T11:54:29.756 INFO:teuthology.orchestra.run.smithi040.stdout:043 2023-12-17T11:54:29.756 INFO:teuthology.orchestra.run.smithi040.stdout:043.out 2023-12-17T11:54:29.757 INFO:teuthology.orchestra.run.smithi040.stdout:044 2023-12-17T11:54:29.757 INFO:teuthology.orchestra.run.smithi040.stdout:044.out 2023-12-17T11:54:29.757 INFO:teuthology.orchestra.run.smithi040.stdout:045 2023-12-17T11:54:29.757 INFO:teuthology.orchestra.run.smithi040.stdout:045.out 2023-12-17T11:54:29.757 INFO:teuthology.orchestra.run.smithi040.stdout:046 2023-12-17T11:54:29.757 INFO:teuthology.orchestra.run.smithi040.stdout:046.out 2023-12-17T11:54:29.757 INFO:teuthology.orchestra.run.smithi040.stdout:047 2023-12-17T11:54:29.757 INFO:teuthology.orchestra.run.smithi040.stdout:047.out 2023-12-17T11:54:29.757 INFO:teuthology.orchestra.run.smithi040.stdout:048 2023-12-17T11:54:29.757 INFO:teuthology.orchestra.run.smithi040.stdout:048.out 2023-12-17T11:54:29.757 INFO:teuthology.orchestra.run.smithi040.stdout:049 2023-12-17T11:54:29.757 INFO:teuthology.orchestra.run.smithi040.stdout:049.out 2023-12-17T11:54:29.757 INFO:teuthology.orchestra.run.smithi040.stdout:050 2023-12-17T11:54:29.757 INFO:teuthology.orchestra.run.smithi040.stdout:050.cfg 2023-12-17T11:54:29.758 INFO:teuthology.orchestra.run.smithi040.stdout:050.out.default 2023-12-17T11:54:29.758 INFO:teuthology.orchestra.run.smithi040.stdout:050.out.nojournal 2023-12-17T11:54:29.758 INFO:teuthology.orchestra.run.smithi040.stdout:050.out.xfsquota 2023-12-17T11:54:29.758 INFO:teuthology.orchestra.run.smithi040.stdout:051 2023-12-17T11:54:29.758 INFO:teuthology.orchestra.run.smithi040.stdout:051.out 2023-12-17T11:54:29.758 INFO:teuthology.orchestra.run.smithi040.stdout:052 2023-12-17T11:54:29.758 INFO:teuthology.orchestra.run.smithi040.stdout:052.out 2023-12-17T11:54:29.758 INFO:teuthology.orchestra.run.smithi040.stdout:053 2023-12-17T11:54:29.758 INFO:teuthology.orchestra.run.smithi040.stdout:053.out 2023-12-17T11:54:29.758 INFO:teuthology.orchestra.run.smithi040.stdout:054 2023-12-17T11:54:29.758 INFO:teuthology.orchestra.run.smithi040.stdout:054.out 2023-12-17T11:54:29.758 INFO:teuthology.orchestra.run.smithi040.stdout:055 2023-12-17T11:54:29.758 INFO:teuthology.orchestra.run.smithi040.stdout:055.out 2023-12-17T11:54:29.758 INFO:teuthology.orchestra.run.smithi040.stdout:056 2023-12-17T11:54:29.759 INFO:teuthology.orchestra.run.smithi040.stdout:056.out 2023-12-17T11:54:29.759 INFO:teuthology.orchestra.run.smithi040.stdout:057 2023-12-17T11:54:29.759 INFO:teuthology.orchestra.run.smithi040.stdout:057.out 2023-12-17T11:54:29.759 INFO:teuthology.orchestra.run.smithi040.stdout:058 2023-12-17T11:54:29.759 INFO:teuthology.orchestra.run.smithi040.stdout:058.out 2023-12-17T11:54:29.759 INFO:teuthology.orchestra.run.smithi040.stdout:059 2023-12-17T11:54:29.759 INFO:teuthology.orchestra.run.smithi040.stdout:059.out 2023-12-17T11:54:29.759 INFO:teuthology.orchestra.run.smithi040.stdout:060 2023-12-17T11:54:29.759 INFO:teuthology.orchestra.run.smithi040.stdout:060.out 2023-12-17T11:54:29.759 INFO:teuthology.orchestra.run.smithi040.stdout:061 2023-12-17T11:54:29.759 INFO:teuthology.orchestra.run.smithi040.stdout:061.out 2023-12-17T11:54:29.759 INFO:teuthology.orchestra.run.smithi040.stdout:062 2023-12-17T11:54:29.759 INFO:teuthology.orchestra.run.smithi040.stdout:062.out 2023-12-17T11:54:29.759 INFO:teuthology.orchestra.run.smithi040.stdout:063 2023-12-17T11:54:29.759 INFO:teuthology.orchestra.run.smithi040.stdout:063.out 2023-12-17T11:54:29.760 INFO:teuthology.orchestra.run.smithi040.stdout:064 2023-12-17T11:54:29.760 INFO:teuthology.orchestra.run.smithi040.stdout:064.out 2023-12-17T11:54:29.760 INFO:teuthology.orchestra.run.smithi040.stdout:065 2023-12-17T11:54:29.760 INFO:teuthology.orchestra.run.smithi040.stdout:065.out 2023-12-17T11:54:29.760 INFO:teuthology.orchestra.run.smithi040.stdout:066 2023-12-17T11:54:29.760 INFO:teuthology.orchestra.run.smithi040.stdout:066.out 2023-12-17T11:54:29.760 INFO:teuthology.orchestra.run.smithi040.stdout:067 2023-12-17T11:54:29.760 INFO:teuthology.orchestra.run.smithi040.stdout:067.out 2023-12-17T11:54:29.760 INFO:teuthology.orchestra.run.smithi040.stdout:068 2023-12-17T11:54:29.760 INFO:teuthology.orchestra.run.smithi040.stdout:068.out 2023-12-17T11:54:29.760 INFO:teuthology.orchestra.run.smithi040.stdout:069 2023-12-17T11:54:29.761 INFO:teuthology.orchestra.run.smithi040.stdout:069.out 2023-12-17T11:54:29.761 INFO:teuthology.orchestra.run.smithi040.stdout:070 2023-12-17T11:54:29.761 INFO:teuthology.orchestra.run.smithi040.stdout:070.out 2023-12-17T11:54:29.761 INFO:teuthology.orchestra.run.smithi040.stdout:071 2023-12-17T11:54:29.761 INFO:teuthology.orchestra.run.smithi040.stdout:071.out 2023-12-17T11:54:29.761 INFO:teuthology.orchestra.run.smithi040.stdout:072 2023-12-17T11:54:29.761 INFO:teuthology.orchestra.run.smithi040.stdout:072.out 2023-12-17T11:54:29.761 INFO:teuthology.orchestra.run.smithi040.stdout:073 2023-12-17T11:54:29.761 INFO:teuthology.orchestra.run.smithi040.stdout:073.out 2023-12-17T11:54:29.761 INFO:teuthology.orchestra.run.smithi040.stdout:074 2023-12-17T11:54:29.761 INFO:teuthology.orchestra.run.smithi040.stdout:074.out 2023-12-17T11:54:29.761 INFO:teuthology.orchestra.run.smithi040.stdout:075 2023-12-17T11:54:29.761 INFO:teuthology.orchestra.run.smithi040.stdout:075.out 2023-12-17T11:54:29.761 INFO:teuthology.orchestra.run.smithi040.stdout:076 2023-12-17T11:54:29.762 INFO:teuthology.orchestra.run.smithi040.stdout:076.out 2023-12-17T11:54:29.762 INFO:teuthology.orchestra.run.smithi040.stdout:077 2023-12-17T11:54:29.762 INFO:teuthology.orchestra.run.smithi040.stdout:077.out 2023-12-17T11:54:29.762 INFO:teuthology.orchestra.run.smithi040.stdout:078 2023-12-17T11:54:29.762 INFO:teuthology.orchestra.run.smithi040.stdout:078.out 2023-12-17T11:54:29.762 INFO:teuthology.orchestra.run.smithi040.stdout:079 2023-12-17T11:54:29.762 INFO:teuthology.orchestra.run.smithi040.stdout:079.out 2023-12-17T11:54:29.762 INFO:teuthology.orchestra.run.smithi040.stdout:080 2023-12-17T11:54:29.762 INFO:teuthology.orchestra.run.smithi040.stdout:080.out 2023-12-17T11:54:29.762 INFO:teuthology.orchestra.run.smithi040.stdout:081 2023-12-17T11:54:29.762 INFO:teuthology.orchestra.run.smithi040.stdout:081.out 2023-12-17T11:54:29.762 INFO:teuthology.orchestra.run.smithi040.stdout:082 2023-12-17T11:54:29.762 INFO:teuthology.orchestra.run.smithi040.stdout:082.out 2023-12-17T11:54:29.762 INFO:teuthology.orchestra.run.smithi040.stdout:083 2023-12-17T11:54:29.762 INFO:teuthology.orchestra.run.smithi040.stdout:083.out 2023-12-17T11:54:29.763 INFO:teuthology.orchestra.run.smithi040.stdout:084 2023-12-17T11:54:29.763 INFO:teuthology.orchestra.run.smithi040.stdout:084.out 2023-12-17T11:54:29.763 INFO:teuthology.orchestra.run.smithi040.stdout:085 2023-12-17T11:54:29.763 INFO:teuthology.orchestra.run.smithi040.stdout:085.out 2023-12-17T11:54:29.763 INFO:teuthology.orchestra.run.smithi040.stdout:086 2023-12-17T11:54:29.763 INFO:teuthology.orchestra.run.smithi040.stdout:086.out 2023-12-17T11:54:29.763 INFO:teuthology.orchestra.run.smithi040.stdout:087 2023-12-17T11:54:29.763 INFO:teuthology.orchestra.run.smithi040.stdout:087.out 2023-12-17T11:54:29.763 INFO:teuthology.orchestra.run.smithi040.stdout:088 2023-12-17T11:54:29.763 INFO:teuthology.orchestra.run.smithi040.stdout:088.out 2023-12-17T11:54:29.763 INFO:teuthology.orchestra.run.smithi040.stdout:089 2023-12-17T11:54:29.763 INFO:teuthology.orchestra.run.smithi040.stdout:089.out 2023-12-17T11:54:29.763 INFO:teuthology.orchestra.run.smithi040.stdout:090 2023-12-17T11:54:29.763 INFO:teuthology.orchestra.run.smithi040.stdout:090.out 2023-12-17T11:54:29.763 INFO:teuthology.orchestra.run.smithi040.stdout:091 2023-12-17T11:54:29.764 INFO:teuthology.orchestra.run.smithi040.stdout:091.out 2023-12-17T11:54:29.764 INFO:teuthology.orchestra.run.smithi040.stdout:092 2023-12-17T11:54:29.764 INFO:teuthology.orchestra.run.smithi040.stdout:092.out 2023-12-17T11:54:29.764 INFO:teuthology.orchestra.run.smithi040.stdout:093 2023-12-17T11:54:29.764 INFO:teuthology.orchestra.run.smithi040.stdout:093.out 2023-12-17T11:54:29.764 INFO:teuthology.orchestra.run.smithi040.stdout:094 2023-12-17T11:54:29.764 INFO:teuthology.orchestra.run.smithi040.stdout:094.out 2023-12-17T11:54:29.764 INFO:teuthology.orchestra.run.smithi040.stdout:095 2023-12-17T11:54:29.764 INFO:teuthology.orchestra.run.smithi040.stdout:095.out 2023-12-17T11:54:29.764 INFO:teuthology.orchestra.run.smithi040.stdout:096 2023-12-17T11:54:29.764 INFO:teuthology.orchestra.run.smithi040.stdout:096.out 2023-12-17T11:54:29.764 INFO:teuthology.orchestra.run.smithi040.stdout:097 2023-12-17T11:54:29.764 INFO:teuthology.orchestra.run.smithi040.stdout:097.out 2023-12-17T11:54:29.764 INFO:teuthology.orchestra.run.smithi040.stdout:098 2023-12-17T11:54:29.764 INFO:teuthology.orchestra.run.smithi040.stdout:098.out 2023-12-17T11:54:29.765 INFO:teuthology.orchestra.run.smithi040.stdout:099 2023-12-17T11:54:29.765 INFO:teuthology.orchestra.run.smithi040.stdout:099.out 2023-12-17T11:54:29.765 INFO:teuthology.orchestra.run.smithi040.stdout:100 2023-12-17T11:54:29.765 INFO:teuthology.orchestra.run.smithi040.stdout:100.out 2023-12-17T11:54:29.765 INFO:teuthology.orchestra.run.smithi040.stdout:101 2023-12-17T11:54:29.765 INFO:teuthology.orchestra.run.smithi040.stdout:101.out 2023-12-17T11:54:29.765 INFO:teuthology.orchestra.run.smithi040.stdout:102 2023-12-17T11:54:29.765 INFO:teuthology.orchestra.run.smithi040.stdout:102.out 2023-12-17T11:54:29.765 INFO:teuthology.orchestra.run.smithi040.stdout:103 2023-12-17T11:54:29.765 INFO:teuthology.orchestra.run.smithi040.stdout:103.out 2023-12-17T11:54:29.765 INFO:teuthology.orchestra.run.smithi040.stdout:104 2023-12-17T11:54:29.765 INFO:teuthology.orchestra.run.smithi040.stdout:104.out 2023-12-17T11:54:29.765 INFO:teuthology.orchestra.run.smithi040.stdout:105 2023-12-17T11:54:29.765 INFO:teuthology.orchestra.run.smithi040.stdout:105.out 2023-12-17T11:54:29.766 INFO:teuthology.orchestra.run.smithi040.stdout:106 2023-12-17T11:54:29.766 INFO:teuthology.orchestra.run.smithi040.stdout:106.out 2023-12-17T11:54:29.766 INFO:teuthology.orchestra.run.smithi040.stdout:107 2023-12-17T11:54:29.766 INFO:teuthology.orchestra.run.smithi040.stdout:107.out 2023-12-17T11:54:29.766 INFO:teuthology.orchestra.run.smithi040.stdout:108 2023-12-17T11:54:29.766 INFO:teuthology.orchestra.run.smithi040.stdout:108.out 2023-12-17T11:54:29.766 INFO:teuthology.orchestra.run.smithi040.stdout:109 2023-12-17T11:54:29.766 INFO:teuthology.orchestra.run.smithi040.stdout:109.out 2023-12-17T11:54:29.766 INFO:teuthology.orchestra.run.smithi040.stdout:110 2023-12-17T11:54:29.766 INFO:teuthology.orchestra.run.smithi040.stdout:110.out 2023-12-17T11:54:29.766 INFO:teuthology.orchestra.run.smithi040.stdout:111 2023-12-17T11:54:29.767 INFO:teuthology.orchestra.run.smithi040.stdout:111.out 2023-12-17T11:54:29.767 INFO:teuthology.orchestra.run.smithi040.stdout:112 2023-12-17T11:54:29.767 INFO:teuthology.orchestra.run.smithi040.stdout:112.out 2023-12-17T11:54:29.767 INFO:teuthology.orchestra.run.smithi040.stdout:113 2023-12-17T11:54:29.767 INFO:teuthology.orchestra.run.smithi040.stdout:113.out 2023-12-17T11:54:29.767 INFO:teuthology.orchestra.run.smithi040.stdout:114 2023-12-17T11:54:29.767 INFO:teuthology.orchestra.run.smithi040.stdout:114.out 2023-12-17T11:54:29.767 INFO:teuthology.orchestra.run.smithi040.stdout:115 2023-12-17T11:54:29.767 INFO:teuthology.orchestra.run.smithi040.stdout:115.out 2023-12-17T11:54:29.767 INFO:teuthology.orchestra.run.smithi040.stdout:116 2023-12-17T11:54:29.767 INFO:teuthology.orchestra.run.smithi040.stdout:116.out 2023-12-17T11:54:29.767 INFO:teuthology.orchestra.run.smithi040.stdout:117 2023-12-17T11:54:29.767 INFO:teuthology.orchestra.run.smithi040.stdout:117.out 2023-12-17T11:54:29.767 INFO:teuthology.orchestra.run.smithi040.stdout:118 2023-12-17T11:54:29.768 INFO:teuthology.orchestra.run.smithi040.stdout:118.out 2023-12-17T11:54:29.768 INFO:teuthology.orchestra.run.smithi040.stdout:119 2023-12-17T11:54:29.768 INFO:teuthology.orchestra.run.smithi040.stdout:119.out 2023-12-17T11:54:29.768 INFO:teuthology.orchestra.run.smithi040.stdout:120 2023-12-17T11:54:29.768 INFO:teuthology.orchestra.run.smithi040.stdout:120.out 2023-12-17T11:54:29.768 INFO:teuthology.orchestra.run.smithi040.stdout:121 2023-12-17T11:54:29.768 INFO:teuthology.orchestra.run.smithi040.stdout:121.out 2023-12-17T11:54:29.768 INFO:teuthology.orchestra.run.smithi040.stdout:122 2023-12-17T11:54:29.768 INFO:teuthology.orchestra.run.smithi040.stdout:122.out 2023-12-17T11:54:29.768 INFO:teuthology.orchestra.run.smithi040.stdout:123 2023-12-17T11:54:29.768 INFO:teuthology.orchestra.run.smithi040.stdout:123.out 2023-12-17T11:54:29.768 INFO:teuthology.orchestra.run.smithi040.stdout:124 2023-12-17T11:54:29.768 INFO:teuthology.orchestra.run.smithi040.stdout:124.out 2023-12-17T11:54:29.768 INFO:teuthology.orchestra.run.smithi040.stdout:125 2023-12-17T11:54:29.768 INFO:teuthology.orchestra.run.smithi040.stdout:125.out 2023-12-17T11:54:29.769 INFO:teuthology.orchestra.run.smithi040.stdout:126 2023-12-17T11:54:29.769 INFO:teuthology.orchestra.run.smithi040.stdout:126.out 2023-12-17T11:54:29.769 INFO:teuthology.orchestra.run.smithi040.stdout:127 2023-12-17T11:54:29.769 INFO:teuthology.orchestra.run.smithi040.stdout:127.out 2023-12-17T11:54:29.769 INFO:teuthology.orchestra.run.smithi040.stdout:128 2023-12-17T11:54:29.769 INFO:teuthology.orchestra.run.smithi040.stdout:128.out 2023-12-17T11:54:29.769 INFO:teuthology.orchestra.run.smithi040.stdout:129 2023-12-17T11:54:29.769 INFO:teuthology.orchestra.run.smithi040.stdout:129.out 2023-12-17T11:54:29.769 INFO:teuthology.orchestra.run.smithi040.stdout:130 2023-12-17T11:54:29.769 INFO:teuthology.orchestra.run.smithi040.stdout:130.out 2023-12-17T11:54:29.769 INFO:teuthology.orchestra.run.smithi040.stdout:131 2023-12-17T11:54:29.769 INFO:teuthology.orchestra.run.smithi040.stdout:131.out 2023-12-17T11:54:29.770 INFO:teuthology.orchestra.run.smithi040.stdout:132 2023-12-17T11:54:29.770 INFO:teuthology.orchestra.run.smithi040.stdout:132.out 2023-12-17T11:54:29.770 INFO:teuthology.orchestra.run.smithi040.stdout:133 2023-12-17T11:54:29.770 INFO:teuthology.orchestra.run.smithi040.stdout:133.out 2023-12-17T11:54:29.770 INFO:teuthology.orchestra.run.smithi040.stdout:134 2023-12-17T11:54:29.770 INFO:teuthology.orchestra.run.smithi040.stdout:134.out 2023-12-17T11:54:29.770 INFO:teuthology.orchestra.run.smithi040.stdout:135 2023-12-17T11:54:29.770 INFO:teuthology.orchestra.run.smithi040.stdout:135.out 2023-12-17T11:54:29.770 INFO:teuthology.orchestra.run.smithi040.stdout:136 2023-12-17T11:54:29.770 INFO:teuthology.orchestra.run.smithi040.stdout:136.out 2023-12-17T11:54:29.770 INFO:teuthology.orchestra.run.smithi040.stdout:137 2023-12-17T11:54:29.770 INFO:teuthology.orchestra.run.smithi040.stdout:137.out 2023-12-17T11:54:29.770 INFO:teuthology.orchestra.run.smithi040.stdout:138 2023-12-17T11:54:29.770 INFO:teuthology.orchestra.run.smithi040.stdout:138.out 2023-12-17T11:54:29.770 INFO:teuthology.orchestra.run.smithi040.stdout:139 2023-12-17T11:54:29.771 INFO:teuthology.orchestra.run.smithi040.stdout:139.out 2023-12-17T11:54:29.771 INFO:teuthology.orchestra.run.smithi040.stdout:140 2023-12-17T11:54:29.771 INFO:teuthology.orchestra.run.smithi040.stdout:140.out 2023-12-17T11:54:29.771 INFO:teuthology.orchestra.run.smithi040.stdout:141 2023-12-17T11:54:29.771 INFO:teuthology.orchestra.run.smithi040.stdout:141.out 2023-12-17T11:54:29.771 INFO:teuthology.orchestra.run.smithi040.stdout:142 2023-12-17T11:54:29.771 INFO:teuthology.orchestra.run.smithi040.stdout:142.out 2023-12-17T11:54:29.771 INFO:teuthology.orchestra.run.smithi040.stdout:143 2023-12-17T11:54:29.771 INFO:teuthology.orchestra.run.smithi040.stdout:143.out 2023-12-17T11:54:29.771 INFO:teuthology.orchestra.run.smithi040.stdout:144 2023-12-17T11:54:29.771 INFO:teuthology.orchestra.run.smithi040.stdout:144.out 2023-12-17T11:54:29.771 INFO:teuthology.orchestra.run.smithi040.stdout:145 2023-12-17T11:54:29.771 INFO:teuthology.orchestra.run.smithi040.stdout:145.out 2023-12-17T11:54:29.771 INFO:teuthology.orchestra.run.smithi040.stdout:146 2023-12-17T11:54:29.771 INFO:teuthology.orchestra.run.smithi040.stdout:146.out 2023-12-17T11:54:29.772 INFO:teuthology.orchestra.run.smithi040.stdout:147 2023-12-17T11:54:29.772 INFO:teuthology.orchestra.run.smithi040.stdout:147.out 2023-12-17T11:54:29.772 INFO:teuthology.orchestra.run.smithi040.stdout:148 2023-12-17T11:54:29.772 INFO:teuthology.orchestra.run.smithi040.stdout:148.out 2023-12-17T11:54:29.772 INFO:teuthology.orchestra.run.smithi040.stdout:149 2023-12-17T11:54:29.772 INFO:teuthology.orchestra.run.smithi040.stdout:149.out 2023-12-17T11:54:29.772 INFO:teuthology.orchestra.run.smithi040.stdout:150 2023-12-17T11:54:29.772 INFO:teuthology.orchestra.run.smithi040.stdout:150.out 2023-12-17T11:54:29.772 INFO:teuthology.orchestra.run.smithi040.stdout:151 2023-12-17T11:54:29.772 INFO:teuthology.orchestra.run.smithi040.stdout:151.out 2023-12-17T11:54:29.772 INFO:teuthology.orchestra.run.smithi040.stdout:152 2023-12-17T11:54:29.772 INFO:teuthology.orchestra.run.smithi040.stdout:152.out 2023-12-17T11:54:29.772 INFO:teuthology.orchestra.run.smithi040.stdout:153 2023-12-17T11:54:29.772 INFO:teuthology.orchestra.run.smithi040.stdout:153.out 2023-12-17T11:54:29.772 INFO:teuthology.orchestra.run.smithi040.stdout:154 2023-12-17T11:54:29.773 INFO:teuthology.orchestra.run.smithi040.stdout:154.out 2023-12-17T11:54:29.773 INFO:teuthology.orchestra.run.smithi040.stdout:155 2023-12-17T11:54:29.773 INFO:teuthology.orchestra.run.smithi040.stdout:155.out 2023-12-17T11:54:29.773 INFO:teuthology.orchestra.run.smithi040.stdout:156 2023-12-17T11:54:29.773 INFO:teuthology.orchestra.run.smithi040.stdout:156.out 2023-12-17T11:54:29.773 INFO:teuthology.orchestra.run.smithi040.stdout:157 2023-12-17T11:54:29.773 INFO:teuthology.orchestra.run.smithi040.stdout:157.out 2023-12-17T11:54:29.773 INFO:teuthology.orchestra.run.smithi040.stdout:158 2023-12-17T11:54:29.773 INFO:teuthology.orchestra.run.smithi040.stdout:158.out 2023-12-17T11:54:29.773 INFO:teuthology.orchestra.run.smithi040.stdout:159 2023-12-17T11:54:29.773 INFO:teuthology.orchestra.run.smithi040.stdout:159.out 2023-12-17T11:54:29.773 INFO:teuthology.orchestra.run.smithi040.stdout:160 2023-12-17T11:54:29.773 INFO:teuthology.orchestra.run.smithi040.stdout:160.out 2023-12-17T11:54:29.773 INFO:teuthology.orchestra.run.smithi040.stdout:161 2023-12-17T11:54:29.774 INFO:teuthology.orchestra.run.smithi040.stdout:161.out 2023-12-17T11:54:29.774 INFO:teuthology.orchestra.run.smithi040.stdout:162 2023-12-17T11:54:29.774 INFO:teuthology.orchestra.run.smithi040.stdout:162.out 2023-12-17T11:54:29.774 INFO:teuthology.orchestra.run.smithi040.stdout:163 2023-12-17T11:54:29.774 INFO:teuthology.orchestra.run.smithi040.stdout:163.out 2023-12-17T11:54:29.774 INFO:teuthology.orchestra.run.smithi040.stdout:164 2023-12-17T11:54:29.774 INFO:teuthology.orchestra.run.smithi040.stdout:164.out 2023-12-17T11:54:29.774 INFO:teuthology.orchestra.run.smithi040.stdout:165 2023-12-17T11:54:29.774 INFO:teuthology.orchestra.run.smithi040.stdout:165.out 2023-12-17T11:54:29.774 INFO:teuthology.orchestra.run.smithi040.stdout:166 2023-12-17T11:54:29.774 INFO:teuthology.orchestra.run.smithi040.stdout:166.out 2023-12-17T11:54:29.774 INFO:teuthology.orchestra.run.smithi040.stdout:167 2023-12-17T11:54:29.774 INFO:teuthology.orchestra.run.smithi040.stdout:167.out 2023-12-17T11:54:29.774 INFO:teuthology.orchestra.run.smithi040.stdout:168 2023-12-17T11:54:29.774 INFO:teuthology.orchestra.run.smithi040.stdout:168.out 2023-12-17T11:54:29.775 INFO:teuthology.orchestra.run.smithi040.stdout:169 2023-12-17T11:54:29.775 INFO:teuthology.orchestra.run.smithi040.stdout:169.out 2023-12-17T11:54:29.775 INFO:teuthology.orchestra.run.smithi040.stdout:170 2023-12-17T11:54:29.775 INFO:teuthology.orchestra.run.smithi040.stdout:170.out 2023-12-17T11:54:29.775 INFO:teuthology.orchestra.run.smithi040.stdout:171 2023-12-17T11:54:29.775 INFO:teuthology.orchestra.run.smithi040.stdout:171.out 2023-12-17T11:54:29.775 INFO:teuthology.orchestra.run.smithi040.stdout:172 2023-12-17T11:54:29.775 INFO:teuthology.orchestra.run.smithi040.stdout:172.out 2023-12-17T11:54:29.775 INFO:teuthology.orchestra.run.smithi040.stdout:173 2023-12-17T11:54:29.775 INFO:teuthology.orchestra.run.smithi040.stdout:173.out 2023-12-17T11:54:29.775 INFO:teuthology.orchestra.run.smithi040.stdout:174 2023-12-17T11:54:29.775 INFO:teuthology.orchestra.run.smithi040.stdout:174.out 2023-12-17T11:54:29.775 INFO:teuthology.orchestra.run.smithi040.stdout:175 2023-12-17T11:54:29.775 INFO:teuthology.orchestra.run.smithi040.stdout:175.out 2023-12-17T11:54:29.776 INFO:teuthology.orchestra.run.smithi040.stdout:176 2023-12-17T11:54:29.776 INFO:teuthology.orchestra.run.smithi040.stdout:176.out 2023-12-17T11:54:29.776 INFO:teuthology.orchestra.run.smithi040.stdout:177 2023-12-17T11:54:29.776 INFO:teuthology.orchestra.run.smithi040.stdout:177.out 2023-12-17T11:54:29.776 INFO:teuthology.orchestra.run.smithi040.stdout:178 2023-12-17T11:54:29.776 INFO:teuthology.orchestra.run.smithi040.stdout:178.out 2023-12-17T11:54:29.776 INFO:teuthology.orchestra.run.smithi040.stdout:179 2023-12-17T11:54:29.776 INFO:teuthology.orchestra.run.smithi040.stdout:179.out 2023-12-17T11:54:29.776 INFO:teuthology.orchestra.run.smithi040.stdout:180 2023-12-17T11:54:29.776 INFO:teuthology.orchestra.run.smithi040.stdout:180.out 2023-12-17T11:54:29.776 INFO:teuthology.orchestra.run.smithi040.stdout:181 2023-12-17T11:54:29.776 INFO:teuthology.orchestra.run.smithi040.stdout:181.out 2023-12-17T11:54:29.776 INFO:teuthology.orchestra.run.smithi040.stdout:182 2023-12-17T11:54:29.776 INFO:teuthology.orchestra.run.smithi040.stdout:182.out 2023-12-17T11:54:29.776 INFO:teuthology.orchestra.run.smithi040.stdout:183 2023-12-17T11:54:29.777 INFO:teuthology.orchestra.run.smithi040.stdout:183.out 2023-12-17T11:54:29.777 INFO:teuthology.orchestra.run.smithi040.stdout:184 2023-12-17T11:54:29.777 INFO:teuthology.orchestra.run.smithi040.stdout:184.out 2023-12-17T11:54:29.777 INFO:teuthology.orchestra.run.smithi040.stdout:185 2023-12-17T11:54:29.777 INFO:teuthology.orchestra.run.smithi040.stdout:185.out 2023-12-17T11:54:29.777 INFO:teuthology.orchestra.run.smithi040.stdout:186 2023-12-17T11:54:29.777 INFO:teuthology.orchestra.run.smithi040.stdout:186.out 2023-12-17T11:54:29.777 INFO:teuthology.orchestra.run.smithi040.stdout:187 2023-12-17T11:54:29.777 INFO:teuthology.orchestra.run.smithi040.stdout:187.out 2023-12-17T11:54:29.777 INFO:teuthology.orchestra.run.smithi040.stdout:188 2023-12-17T11:54:29.777 INFO:teuthology.orchestra.run.smithi040.stdout:188.out 2023-12-17T11:54:29.777 INFO:teuthology.orchestra.run.smithi040.stdout:189 2023-12-17T11:54:29.777 INFO:teuthology.orchestra.run.smithi040.stdout:189.out 2023-12-17T11:54:29.778 INFO:teuthology.orchestra.run.smithi040.stdout:190 2023-12-17T11:54:29.778 INFO:teuthology.orchestra.run.smithi040.stdout:190.out 2023-12-17T11:54:29.778 INFO:teuthology.orchestra.run.smithi040.stdout:191 2023-12-17T11:54:29.778 INFO:teuthology.orchestra.run.smithi040.stdout:191.out 2023-12-17T11:54:29.778 INFO:teuthology.orchestra.run.smithi040.stdout:192 2023-12-17T11:54:29.778 INFO:teuthology.orchestra.run.smithi040.stdout:192.out 2023-12-17T11:54:29.778 INFO:teuthology.orchestra.run.smithi040.stdout:193 2023-12-17T11:54:29.778 INFO:teuthology.orchestra.run.smithi040.stdout:193.out 2023-12-17T11:54:29.778 INFO:teuthology.orchestra.run.smithi040.stdout:194 2023-12-17T11:54:29.778 INFO:teuthology.orchestra.run.smithi040.stdout:194.out 2023-12-17T11:54:29.778 INFO:teuthology.orchestra.run.smithi040.stdout:195 2023-12-17T11:54:29.778 INFO:teuthology.orchestra.run.smithi040.stdout:195.out 2023-12-17T11:54:29.778 INFO:teuthology.orchestra.run.smithi040.stdout:196 2023-12-17T11:54:29.778 INFO:teuthology.orchestra.run.smithi040.stdout:196.out 2023-12-17T11:54:29.778 INFO:teuthology.orchestra.run.smithi040.stdout:197 2023-12-17T11:54:29.779 INFO:teuthology.orchestra.run.smithi040.stdout:197.out 2023-12-17T11:54:29.779 INFO:teuthology.orchestra.run.smithi040.stdout:198 2023-12-17T11:54:29.779 INFO:teuthology.orchestra.run.smithi040.stdout:198.out 2023-12-17T11:54:29.779 INFO:teuthology.orchestra.run.smithi040.stdout:199 2023-12-17T11:54:29.779 INFO:teuthology.orchestra.run.smithi040.stdout:199.out 2023-12-17T11:54:29.779 INFO:teuthology.orchestra.run.smithi040.stdout:200 2023-12-17T11:54:29.779 INFO:teuthology.orchestra.run.smithi040.stdout:200.out 2023-12-17T11:54:29.779 INFO:teuthology.orchestra.run.smithi040.stdout:201 2023-12-17T11:54:29.779 INFO:teuthology.orchestra.run.smithi040.stdout:201.out 2023-12-17T11:54:29.779 INFO:teuthology.orchestra.run.smithi040.stdout:202 2023-12-17T11:54:29.779 INFO:teuthology.orchestra.run.smithi040.stdout:202.out 2023-12-17T11:54:29.779 INFO:teuthology.orchestra.run.smithi040.stdout:203 2023-12-17T11:54:29.779 INFO:teuthology.orchestra.run.smithi040.stdout:203.out 2023-12-17T11:54:29.779 INFO:teuthology.orchestra.run.smithi040.stdout:204 2023-12-17T11:54:29.779 INFO:teuthology.orchestra.run.smithi040.stdout:204.out 2023-12-17T11:54:29.780 INFO:teuthology.orchestra.run.smithi040.stdout:205 2023-12-17T11:54:29.780 INFO:teuthology.orchestra.run.smithi040.stdout:205.out 2023-12-17T11:54:29.780 INFO:teuthology.orchestra.run.smithi040.stdout:206 2023-12-17T11:54:29.780 INFO:teuthology.orchestra.run.smithi040.stdout:206.out 2023-12-17T11:54:29.780 INFO:teuthology.orchestra.run.smithi040.stdout:207 2023-12-17T11:54:29.780 INFO:teuthology.orchestra.run.smithi040.stdout:207.out 2023-12-17T11:54:29.780 INFO:teuthology.orchestra.run.smithi040.stdout:208 2023-12-17T11:54:29.780 INFO:teuthology.orchestra.run.smithi040.stdout:208.out 2023-12-17T11:54:29.780 INFO:teuthology.orchestra.run.smithi040.stdout:209 2023-12-17T11:54:29.780 INFO:teuthology.orchestra.run.smithi040.stdout:209.out 2023-12-17T11:54:29.780 INFO:teuthology.orchestra.run.smithi040.stdout:210 2023-12-17T11:54:29.780 INFO:teuthology.orchestra.run.smithi040.stdout:210.out 2023-12-17T11:54:29.780 INFO:teuthology.orchestra.run.smithi040.stdout:211 2023-12-17T11:54:29.780 INFO:teuthology.orchestra.run.smithi040.stdout:211.out 2023-12-17T11:54:29.780 INFO:teuthology.orchestra.run.smithi040.stdout:212 2023-12-17T11:54:29.781 INFO:teuthology.orchestra.run.smithi040.stdout:212.out 2023-12-17T11:54:29.781 INFO:teuthology.orchestra.run.smithi040.stdout:213 2023-12-17T11:54:29.781 INFO:teuthology.orchestra.run.smithi040.stdout:213.out 2023-12-17T11:54:29.781 INFO:teuthology.orchestra.run.smithi040.stdout:214 2023-12-17T11:54:29.781 INFO:teuthology.orchestra.run.smithi040.stdout:214.out 2023-12-17T11:54:29.781 INFO:teuthology.orchestra.run.smithi040.stdout:215 2023-12-17T11:54:29.781 INFO:teuthology.orchestra.run.smithi040.stdout:215.out 2023-12-17T11:54:29.781 INFO:teuthology.orchestra.run.smithi040.stdout:216 2023-12-17T11:54:29.781 INFO:teuthology.orchestra.run.smithi040.stdout:216.out 2023-12-17T11:54:29.781 INFO:teuthology.orchestra.run.smithi040.stdout:217 2023-12-17T11:54:29.781 INFO:teuthology.orchestra.run.smithi040.stdout:217.out 2023-12-17T11:54:29.781 INFO:teuthology.orchestra.run.smithi040.stdout:218 2023-12-17T11:54:29.781 INFO:teuthology.orchestra.run.smithi040.stdout:218.out 2023-12-17T11:54:29.781 INFO:teuthology.orchestra.run.smithi040.stdout:219 2023-12-17T11:54:29.781 INFO:teuthology.orchestra.run.smithi040.stdout:219.out 2023-12-17T11:54:29.782 INFO:teuthology.orchestra.run.smithi040.stdout:220 2023-12-17T11:54:29.782 INFO:teuthology.orchestra.run.smithi040.stdout:220.out 2023-12-17T11:54:29.782 INFO:teuthology.orchestra.run.smithi040.stdout:221 2023-12-17T11:54:29.782 INFO:teuthology.orchestra.run.smithi040.stdout:221.out 2023-12-17T11:54:29.782 INFO:teuthology.orchestra.run.smithi040.stdout:222 2023-12-17T11:54:29.782 INFO:teuthology.orchestra.run.smithi040.stdout:222.out 2023-12-17T11:54:29.782 INFO:teuthology.orchestra.run.smithi040.stdout:223 2023-12-17T11:54:29.782 INFO:teuthology.orchestra.run.smithi040.stdout:223.out 2023-12-17T11:54:29.782 INFO:teuthology.orchestra.run.smithi040.stdout:224 2023-12-17T11:54:29.782 INFO:teuthology.orchestra.run.smithi040.stdout:224.out 2023-12-17T11:54:29.782 INFO:teuthology.orchestra.run.smithi040.stdout:225 2023-12-17T11:54:29.782 INFO:teuthology.orchestra.run.smithi040.stdout:225.out 2023-12-17T11:54:29.782 INFO:teuthology.orchestra.run.smithi040.stdout:226 2023-12-17T11:54:29.782 INFO:teuthology.orchestra.run.smithi040.stdout:226.out 2023-12-17T11:54:29.782 INFO:teuthology.orchestra.run.smithi040.stdout:227 2023-12-17T11:54:29.783 INFO:teuthology.orchestra.run.smithi040.stdout:227.out 2023-12-17T11:54:29.783 INFO:teuthology.orchestra.run.smithi040.stdout:228 2023-12-17T11:54:29.783 INFO:teuthology.orchestra.run.smithi040.stdout:228.out 2023-12-17T11:54:29.783 INFO:teuthology.orchestra.run.smithi040.stdout:229 2023-12-17T11:54:29.783 INFO:teuthology.orchestra.run.smithi040.stdout:229.out 2023-12-17T11:54:29.783 INFO:teuthology.orchestra.run.smithi040.stdout:230 2023-12-17T11:54:29.783 INFO:teuthology.orchestra.run.smithi040.stdout:230.out 2023-12-17T11:54:29.783 INFO:teuthology.orchestra.run.smithi040.stdout:231 2023-12-17T11:54:29.783 INFO:teuthology.orchestra.run.smithi040.stdout:231.out 2023-12-17T11:54:29.783 INFO:teuthology.orchestra.run.smithi040.stdout:232 2023-12-17T11:54:29.783 INFO:teuthology.orchestra.run.smithi040.stdout:232.out 2023-12-17T11:54:29.783 INFO:teuthology.orchestra.run.smithi040.stdout:233 2023-12-17T11:54:29.783 INFO:teuthology.orchestra.run.smithi040.stdout:233.out 2023-12-17T11:54:29.783 INFO:teuthology.orchestra.run.smithi040.stdout:234 2023-12-17T11:54:29.783 INFO:teuthology.orchestra.run.smithi040.stdout:234.out 2023-12-17T11:54:29.784 INFO:teuthology.orchestra.run.smithi040.stdout:235 2023-12-17T11:54:29.784 INFO:teuthology.orchestra.run.smithi040.stdout:235.out 2023-12-17T11:54:29.784 INFO:teuthology.orchestra.run.smithi040.stdout:236 2023-12-17T11:54:29.784 INFO:teuthology.orchestra.run.smithi040.stdout:236.out 2023-12-17T11:54:29.784 INFO:teuthology.orchestra.run.smithi040.stdout:237 2023-12-17T11:54:29.784 INFO:teuthology.orchestra.run.smithi040.stdout:237.out 2023-12-17T11:54:29.784 INFO:teuthology.orchestra.run.smithi040.stdout:238 2023-12-17T11:54:29.784 INFO:teuthology.orchestra.run.smithi040.stdout:238.out 2023-12-17T11:54:29.784 INFO:teuthology.orchestra.run.smithi040.stdout:239 2023-12-17T11:54:29.784 INFO:teuthology.orchestra.run.smithi040.stdout:239.out 2023-12-17T11:54:29.784 INFO:teuthology.orchestra.run.smithi040.stdout:240 2023-12-17T11:54:29.784 INFO:teuthology.orchestra.run.smithi040.stdout:240.out 2023-12-17T11:54:29.784 INFO:teuthology.orchestra.run.smithi040.stdout:241 2023-12-17T11:54:29.784 INFO:teuthology.orchestra.run.smithi040.stdout:241.out 2023-12-17T11:54:29.784 INFO:teuthology.orchestra.run.smithi040.stdout:242 2023-12-17T11:54:29.785 INFO:teuthology.orchestra.run.smithi040.stdout:242.out 2023-12-17T11:54:29.785 INFO:teuthology.orchestra.run.smithi040.stdout:243 2023-12-17T11:54:29.785 INFO:teuthology.orchestra.run.smithi040.stdout:243.out 2023-12-17T11:54:29.785 INFO:teuthology.orchestra.run.smithi040.stdout:244 2023-12-17T11:54:29.785 INFO:teuthology.orchestra.run.smithi040.stdout:244.out 2023-12-17T11:54:29.785 INFO:teuthology.orchestra.run.smithi040.stdout:245 2023-12-17T11:54:29.785 INFO:teuthology.orchestra.run.smithi040.stdout:245.out 2023-12-17T11:54:29.785 INFO:teuthology.orchestra.run.smithi040.stdout:246 2023-12-17T11:54:29.785 INFO:teuthology.orchestra.run.smithi040.stdout:246.out 2023-12-17T11:54:29.785 INFO:teuthology.orchestra.run.smithi040.stdout:247 2023-12-17T11:54:29.785 INFO:teuthology.orchestra.run.smithi040.stdout:247.out 2023-12-17T11:54:29.785 INFO:teuthology.orchestra.run.smithi040.stdout:248 2023-12-17T11:54:29.785 INFO:teuthology.orchestra.run.smithi040.stdout:248.out 2023-12-17T11:54:29.785 INFO:teuthology.orchestra.run.smithi040.stdout:249 2023-12-17T11:54:29.785 INFO:teuthology.orchestra.run.smithi040.stdout:249.out 2023-12-17T11:54:29.786 INFO:teuthology.orchestra.run.smithi040.stdout:250 2023-12-17T11:54:29.786 INFO:teuthology.orchestra.run.smithi040.stdout:250.out 2023-12-17T11:54:29.786 INFO:teuthology.orchestra.run.smithi040.stdout:251 2023-12-17T11:54:29.786 INFO:teuthology.orchestra.run.smithi040.stdout:251.out 2023-12-17T11:54:29.786 INFO:teuthology.orchestra.run.smithi040.stdout:252 2023-12-17T11:54:29.786 INFO:teuthology.orchestra.run.smithi040.stdout:252.out 2023-12-17T11:54:29.786 INFO:teuthology.orchestra.run.smithi040.stdout:253 2023-12-17T11:54:29.786 INFO:teuthology.orchestra.run.smithi040.stdout:253.out 2023-12-17T11:54:29.786 INFO:teuthology.orchestra.run.smithi040.stdout:254 2023-12-17T11:54:29.786 INFO:teuthology.orchestra.run.smithi040.stdout:254.out 2023-12-17T11:54:29.786 INFO:teuthology.orchestra.run.smithi040.stdout:255 2023-12-17T11:54:29.786 INFO:teuthology.orchestra.run.smithi040.stdout:255.out 2023-12-17T11:54:29.786 INFO:teuthology.orchestra.run.smithi040.stdout:256 2023-12-17T11:54:29.786 INFO:teuthology.orchestra.run.smithi040.stdout:256.out 2023-12-17T11:54:29.786 INFO:teuthology.orchestra.run.smithi040.stdout:257 2023-12-17T11:54:29.787 INFO:teuthology.orchestra.run.smithi040.stdout:257.out 2023-12-17T11:54:29.787 INFO:teuthology.orchestra.run.smithi040.stdout:258 2023-12-17T11:54:29.787 INFO:teuthology.orchestra.run.smithi040.stdout:258.out 2023-12-17T11:54:29.787 INFO:teuthology.orchestra.run.smithi040.stdout:259 2023-12-17T11:54:29.787 INFO:teuthology.orchestra.run.smithi040.stdout:259.out 2023-12-17T11:54:29.787 INFO:teuthology.orchestra.run.smithi040.stdout:260 2023-12-17T11:54:29.787 INFO:teuthology.orchestra.run.smithi040.stdout:260.out 2023-12-17T11:54:29.787 INFO:teuthology.orchestra.run.smithi040.stdout:261 2023-12-17T11:54:29.787 INFO:teuthology.orchestra.run.smithi040.stdout:261.out 2023-12-17T11:54:29.787 INFO:teuthology.orchestra.run.smithi040.stdout:262 2023-12-17T11:54:29.787 INFO:teuthology.orchestra.run.smithi040.stdout:262.out 2023-12-17T11:54:29.787 INFO:teuthology.orchestra.run.smithi040.stdout:263 2023-12-17T11:54:29.787 INFO:teuthology.orchestra.run.smithi040.stdout:263.out 2023-12-17T11:54:29.787 INFO:teuthology.orchestra.run.smithi040.stdout:264 2023-12-17T11:54:29.787 INFO:teuthology.orchestra.run.smithi040.stdout:264.out 2023-12-17T11:54:29.788 INFO:teuthology.orchestra.run.smithi040.stdout:265 2023-12-17T11:54:29.788 INFO:teuthology.orchestra.run.smithi040.stdout:265.out 2023-12-17T11:54:29.788 INFO:teuthology.orchestra.run.smithi040.stdout:266 2023-12-17T11:54:29.788 INFO:teuthology.orchestra.run.smithi040.stdout:266.out 2023-12-17T11:54:29.788 INFO:teuthology.orchestra.run.smithi040.stdout:267 2023-12-17T11:54:29.788 INFO:teuthology.orchestra.run.smithi040.stdout:267.out 2023-12-17T11:54:29.788 INFO:teuthology.orchestra.run.smithi040.stdout:268 2023-12-17T11:54:29.788 INFO:teuthology.orchestra.run.smithi040.stdout:268.out 2023-12-17T11:54:29.788 INFO:teuthology.orchestra.run.smithi040.stdout:269 2023-12-17T11:54:29.788 INFO:teuthology.orchestra.run.smithi040.stdout:269.out 2023-12-17T11:54:29.788 INFO:teuthology.orchestra.run.smithi040.stdout:270 2023-12-17T11:54:29.788 INFO:teuthology.orchestra.run.smithi040.stdout:270.out 2023-12-17T11:54:29.788 INFO:teuthology.orchestra.run.smithi040.stdout:271 2023-12-17T11:54:29.788 INFO:teuthology.orchestra.run.smithi040.stdout:271.out 2023-12-17T11:54:29.788 INFO:teuthology.orchestra.run.smithi040.stdout:272 2023-12-17T11:54:29.789 INFO:teuthology.orchestra.run.smithi040.stdout:272.out 2023-12-17T11:54:29.789 INFO:teuthology.orchestra.run.smithi040.stdout:273 2023-12-17T11:54:29.789 INFO:teuthology.orchestra.run.smithi040.stdout:273.out 2023-12-17T11:54:29.789 INFO:teuthology.orchestra.run.smithi040.stdout:274 2023-12-17T11:54:29.789 INFO:teuthology.orchestra.run.smithi040.stdout:274.out 2023-12-17T11:54:29.789 INFO:teuthology.orchestra.run.smithi040.stdout:275 2023-12-17T11:54:29.789 INFO:teuthology.orchestra.run.smithi040.stdout:275.out 2023-12-17T11:54:29.789 INFO:teuthology.orchestra.run.smithi040.stdout:276 2023-12-17T11:54:29.789 INFO:teuthology.orchestra.run.smithi040.stdout:276.out 2023-12-17T11:54:29.789 INFO:teuthology.orchestra.run.smithi040.stdout:277 2023-12-17T11:54:29.789 INFO:teuthology.orchestra.run.smithi040.stdout:277.out 2023-12-17T11:54:29.789 INFO:teuthology.orchestra.run.smithi040.stdout:278 2023-12-17T11:54:29.789 INFO:teuthology.orchestra.run.smithi040.stdout:278.out 2023-12-17T11:54:29.789 INFO:teuthology.orchestra.run.smithi040.stdout:279 2023-12-17T11:54:29.790 INFO:teuthology.orchestra.run.smithi040.stdout:279.out 2023-12-17T11:54:29.790 INFO:teuthology.orchestra.run.smithi040.stdout:280 2023-12-17T11:54:29.790 INFO:teuthology.orchestra.run.smithi040.stdout:280.out 2023-12-17T11:54:29.790 INFO:teuthology.orchestra.run.smithi040.stdout:281 2023-12-17T11:54:29.790 INFO:teuthology.orchestra.run.smithi040.stdout:281.out 2023-12-17T11:54:29.790 INFO:teuthology.orchestra.run.smithi040.stdout:282 2023-12-17T11:54:29.790 INFO:teuthology.orchestra.run.smithi040.stdout:282.out 2023-12-17T11:54:29.790 INFO:teuthology.orchestra.run.smithi040.stdout:283 2023-12-17T11:54:29.790 INFO:teuthology.orchestra.run.smithi040.stdout:283.out 2023-12-17T11:54:29.790 INFO:teuthology.orchestra.run.smithi040.stdout:284 2023-12-17T11:54:29.790 INFO:teuthology.orchestra.run.smithi040.stdout:284.out 2023-12-17T11:54:29.790 INFO:teuthology.orchestra.run.smithi040.stdout:285 2023-12-17T11:54:29.791 INFO:teuthology.orchestra.run.smithi040.stdout:285.out 2023-12-17T11:54:29.791 INFO:teuthology.orchestra.run.smithi040.stdout:286 2023-12-17T11:54:29.791 INFO:teuthology.orchestra.run.smithi040.stdout:286.out 2023-12-17T11:54:29.791 INFO:teuthology.orchestra.run.smithi040.stdout:287 2023-12-17T11:54:29.791 INFO:teuthology.orchestra.run.smithi040.stdout:287.out 2023-12-17T11:54:29.791 INFO:teuthology.orchestra.run.smithi040.stdout:288 2023-12-17T11:54:29.791 INFO:teuthology.orchestra.run.smithi040.stdout:288.out 2023-12-17T11:54:29.791 INFO:teuthology.orchestra.run.smithi040.stdout:289 2023-12-17T11:54:29.791 INFO:teuthology.orchestra.run.smithi040.stdout:289.out 2023-12-17T11:54:29.791 INFO:teuthology.orchestra.run.smithi040.stdout:290 2023-12-17T11:54:29.791 INFO:teuthology.orchestra.run.smithi040.stdout:290.out 2023-12-17T11:54:29.791 INFO:teuthology.orchestra.run.smithi040.stdout:291 2023-12-17T11:54:29.791 INFO:teuthology.orchestra.run.smithi040.stdout:291.out 2023-12-17T11:54:29.791 INFO:teuthology.orchestra.run.smithi040.stdout:292 2023-12-17T11:54:29.791 INFO:teuthology.orchestra.run.smithi040.stdout:292.out 2023-12-17T11:54:29.792 INFO:teuthology.orchestra.run.smithi040.stdout:293 2023-12-17T11:54:29.792 INFO:teuthology.orchestra.run.smithi040.stdout:293.out 2023-12-17T11:54:29.792 INFO:teuthology.orchestra.run.smithi040.stdout:294 2023-12-17T11:54:29.792 INFO:teuthology.orchestra.run.smithi040.stdout:294.out 2023-12-17T11:54:29.792 INFO:teuthology.orchestra.run.smithi040.stdout:295 2023-12-17T11:54:29.792 INFO:teuthology.orchestra.run.smithi040.stdout:295.out 2023-12-17T11:54:29.792 INFO:teuthology.orchestra.run.smithi040.stdout:296 2023-12-17T11:54:29.792 INFO:teuthology.orchestra.run.smithi040.stdout:296.out 2023-12-17T11:54:29.792 INFO:teuthology.orchestra.run.smithi040.stdout:297 2023-12-17T11:54:29.792 INFO:teuthology.orchestra.run.smithi040.stdout:297.out 2023-12-17T11:54:29.793 INFO:teuthology.orchestra.run.smithi040.stdout:298 2023-12-17T11:54:29.793 INFO:teuthology.orchestra.run.smithi040.stdout:298.out 2023-12-17T11:54:29.793 INFO:teuthology.orchestra.run.smithi040.stdout:299 2023-12-17T11:54:29.793 INFO:teuthology.orchestra.run.smithi040.stdout:299.out 2023-12-17T11:54:29.793 INFO:teuthology.orchestra.run.smithi040.stdout:300 2023-12-17T11:54:29.793 INFO:teuthology.orchestra.run.smithi040.stdout:300.out 2023-12-17T11:54:29.793 INFO:teuthology.orchestra.run.smithi040.stdout:301 2023-12-17T11:54:29.793 INFO:teuthology.orchestra.run.smithi040.stdout:301.out 2023-12-17T11:54:29.793 INFO:teuthology.orchestra.run.smithi040.stdout:302 2023-12-17T11:54:29.793 INFO:teuthology.orchestra.run.smithi040.stdout:302.out 2023-12-17T11:54:29.793 INFO:teuthology.orchestra.run.smithi040.stdout:303 2023-12-17T11:54:29.794 INFO:teuthology.orchestra.run.smithi040.stdout:303.out 2023-12-17T11:54:29.794 INFO:teuthology.orchestra.run.smithi040.stdout:304 2023-12-17T11:54:29.794 INFO:teuthology.orchestra.run.smithi040.stdout:304.out 2023-12-17T11:54:29.794 INFO:teuthology.orchestra.run.smithi040.stdout:305 2023-12-17T11:54:29.794 INFO:teuthology.orchestra.run.smithi040.stdout:305.out 2023-12-17T11:54:29.794 INFO:teuthology.orchestra.run.smithi040.stdout:306 2023-12-17T11:54:29.794 INFO:teuthology.orchestra.run.smithi040.stdout:306.out 2023-12-17T11:54:29.794 INFO:teuthology.orchestra.run.smithi040.stdout:307 2023-12-17T11:54:29.794 INFO:teuthology.orchestra.run.smithi040.stdout:307.out 2023-12-17T11:54:29.794 INFO:teuthology.orchestra.run.smithi040.stdout:308 2023-12-17T11:54:29.794 INFO:teuthology.orchestra.run.smithi040.stdout:308.out 2023-12-17T11:54:29.794 INFO:teuthology.orchestra.run.smithi040.stdout:309 2023-12-17T11:54:29.795 INFO:teuthology.orchestra.run.smithi040.stdout:309.out 2023-12-17T11:54:29.795 INFO:teuthology.orchestra.run.smithi040.stdout:310 2023-12-17T11:54:29.795 INFO:teuthology.orchestra.run.smithi040.stdout:310.out 2023-12-17T11:54:29.795 INFO:teuthology.orchestra.run.smithi040.stdout:311 2023-12-17T11:54:29.795 INFO:teuthology.orchestra.run.smithi040.stdout:311.out 2023-12-17T11:54:29.795 INFO:teuthology.orchestra.run.smithi040.stdout:312 2023-12-17T11:54:29.795 INFO:teuthology.orchestra.run.smithi040.stdout:312.out 2023-12-17T11:54:29.795 INFO:teuthology.orchestra.run.smithi040.stdout:313 2023-12-17T11:54:29.795 INFO:teuthology.orchestra.run.smithi040.stdout:313.out 2023-12-17T11:54:29.795 INFO:teuthology.orchestra.run.smithi040.stdout:314 2023-12-17T11:54:29.795 INFO:teuthology.orchestra.run.smithi040.stdout:314.out 2023-12-17T11:54:29.795 INFO:teuthology.orchestra.run.smithi040.stdout:315 2023-12-17T11:54:29.795 INFO:teuthology.orchestra.run.smithi040.stdout:315.out 2023-12-17T11:54:29.795 INFO:teuthology.orchestra.run.smithi040.stdout:316 2023-12-17T11:54:29.796 INFO:teuthology.orchestra.run.smithi040.stdout:316.out 2023-12-17T11:54:29.796 INFO:teuthology.orchestra.run.smithi040.stdout:317 2023-12-17T11:54:29.796 INFO:teuthology.orchestra.run.smithi040.stdout:317.out 2023-12-17T11:54:29.796 INFO:teuthology.orchestra.run.smithi040.stdout:318 2023-12-17T11:54:29.796 INFO:teuthology.orchestra.run.smithi040.stdout:318.out 2023-12-17T11:54:29.796 INFO:teuthology.orchestra.run.smithi040.stdout:319 2023-12-17T11:54:29.796 INFO:teuthology.orchestra.run.smithi040.stdout:319.out 2023-12-17T11:54:29.796 INFO:teuthology.orchestra.run.smithi040.stdout:320 2023-12-17T11:54:29.796 INFO:teuthology.orchestra.run.smithi040.stdout:320.out 2023-12-17T11:54:29.796 INFO:teuthology.orchestra.run.smithi040.stdout:321 2023-12-17T11:54:29.796 INFO:teuthology.orchestra.run.smithi040.stdout:321.out 2023-12-17T11:54:29.796 INFO:teuthology.orchestra.run.smithi040.stdout:322 2023-12-17T11:54:29.796 INFO:teuthology.orchestra.run.smithi040.stdout:322.out 2023-12-17T11:54:29.796 INFO:teuthology.orchestra.run.smithi040.stdout:323 2023-12-17T11:54:29.796 INFO:teuthology.orchestra.run.smithi040.stdout:323.out 2023-12-17T11:54:29.797 INFO:teuthology.orchestra.run.smithi040.stdout:324 2023-12-17T11:54:29.797 INFO:teuthology.orchestra.run.smithi040.stdout:324.out 2023-12-17T11:54:29.797 INFO:teuthology.orchestra.run.smithi040.stdout:325 2023-12-17T11:54:29.797 INFO:teuthology.orchestra.run.smithi040.stdout:325.out 2023-12-17T11:54:29.797 INFO:teuthology.orchestra.run.smithi040.stdout:326 2023-12-17T11:54:29.797 INFO:teuthology.orchestra.run.smithi040.stdout:326.out 2023-12-17T11:54:29.797 INFO:teuthology.orchestra.run.smithi040.stdout:327 2023-12-17T11:54:29.797 INFO:teuthology.orchestra.run.smithi040.stdout:327.out 2023-12-17T11:54:29.797 INFO:teuthology.orchestra.run.smithi040.stdout:328 2023-12-17T11:54:29.797 INFO:teuthology.orchestra.run.smithi040.stdout:328.out 2023-12-17T11:54:29.797 INFO:teuthology.orchestra.run.smithi040.stdout:329 2023-12-17T11:54:29.797 INFO:teuthology.orchestra.run.smithi040.stdout:329.out 2023-12-17T11:54:29.797 INFO:teuthology.orchestra.run.smithi040.stdout:330 2023-12-17T11:54:29.797 INFO:teuthology.orchestra.run.smithi040.stdout:330.out 2023-12-17T11:54:29.798 INFO:teuthology.orchestra.run.smithi040.stdout:331 2023-12-17T11:54:29.798 INFO:teuthology.orchestra.run.smithi040.stdout:331.out 2023-12-17T11:54:29.798 INFO:teuthology.orchestra.run.smithi040.stdout:332 2023-12-17T11:54:29.798 INFO:teuthology.orchestra.run.smithi040.stdout:332.out 2023-12-17T11:54:29.798 INFO:teuthology.orchestra.run.smithi040.stdout:333 2023-12-17T11:54:29.798 INFO:teuthology.orchestra.run.smithi040.stdout:333.out 2023-12-17T11:54:29.798 INFO:teuthology.orchestra.run.smithi040.stdout:334 2023-12-17T11:54:29.798 INFO:teuthology.orchestra.run.smithi040.stdout:334.out 2023-12-17T11:54:29.798 INFO:teuthology.orchestra.run.smithi040.stdout:335 2023-12-17T11:54:29.798 INFO:teuthology.orchestra.run.smithi040.stdout:335.out 2023-12-17T11:54:29.798 INFO:teuthology.orchestra.run.smithi040.stdout:336 2023-12-17T11:54:29.798 INFO:teuthology.orchestra.run.smithi040.stdout:336.out 2023-12-17T11:54:29.798 INFO:teuthology.orchestra.run.smithi040.stdout:337 2023-12-17T11:54:29.798 INFO:teuthology.orchestra.run.smithi040.stdout:337.out 2023-12-17T11:54:29.798 INFO:teuthology.orchestra.run.smithi040.stdout:338 2023-12-17T11:54:29.799 INFO:teuthology.orchestra.run.smithi040.stdout:338.out 2023-12-17T11:54:29.799 INFO:teuthology.orchestra.run.smithi040.stdout:339 2023-12-17T11:54:29.799 INFO:teuthology.orchestra.run.smithi040.stdout:339.out 2023-12-17T11:54:29.799 INFO:teuthology.orchestra.run.smithi040.stdout:340 2023-12-17T11:54:29.799 INFO:teuthology.orchestra.run.smithi040.stdout:340.out 2023-12-17T11:54:29.799 INFO:teuthology.orchestra.run.smithi040.stdout:341 2023-12-17T11:54:29.799 INFO:teuthology.orchestra.run.smithi040.stdout:341.out 2023-12-17T11:54:29.799 INFO:teuthology.orchestra.run.smithi040.stdout:342 2023-12-17T11:54:29.799 INFO:teuthology.orchestra.run.smithi040.stdout:342.out 2023-12-17T11:54:29.799 INFO:teuthology.orchestra.run.smithi040.stdout:343 2023-12-17T11:54:29.799 INFO:teuthology.orchestra.run.smithi040.stdout:343.out 2023-12-17T11:54:29.799 INFO:teuthology.orchestra.run.smithi040.stdout:344 2023-12-17T11:54:29.799 INFO:teuthology.orchestra.run.smithi040.stdout:344.out 2023-12-17T11:54:29.799 INFO:teuthology.orchestra.run.smithi040.stdout:345 2023-12-17T11:54:29.799 INFO:teuthology.orchestra.run.smithi040.stdout:345.out 2023-12-17T11:54:29.800 INFO:teuthology.orchestra.run.smithi040.stdout:346 2023-12-17T11:54:29.800 INFO:teuthology.orchestra.run.smithi040.stdout:346.out 2023-12-17T11:54:29.800 INFO:teuthology.orchestra.run.smithi040.stdout:347 2023-12-17T11:54:29.800 INFO:teuthology.orchestra.run.smithi040.stdout:347.out 2023-12-17T11:54:29.800 INFO:teuthology.orchestra.run.smithi040.stdout:348 2023-12-17T11:54:29.800 INFO:teuthology.orchestra.run.smithi040.stdout:348.out 2023-12-17T11:54:29.800 INFO:teuthology.orchestra.run.smithi040.stdout:349 2023-12-17T11:54:29.800 INFO:teuthology.orchestra.run.smithi040.stdout:349.out 2023-12-17T11:54:29.800 INFO:teuthology.orchestra.run.smithi040.stdout:350 2023-12-17T11:54:29.800 INFO:teuthology.orchestra.run.smithi040.stdout:350.out 2023-12-17T11:54:29.800 INFO:teuthology.orchestra.run.smithi040.stdout:351 2023-12-17T11:54:29.800 INFO:teuthology.orchestra.run.smithi040.stdout:351.out 2023-12-17T11:54:29.800 INFO:teuthology.orchestra.run.smithi040.stdout:352 2023-12-17T11:54:29.800 INFO:teuthology.orchestra.run.smithi040.stdout:352.out 2023-12-17T11:54:29.800 INFO:teuthology.orchestra.run.smithi040.stdout:353 2023-12-17T11:54:29.801 INFO:teuthology.orchestra.run.smithi040.stdout:353.out 2023-12-17T11:54:29.801 INFO:teuthology.orchestra.run.smithi040.stdout:354 2023-12-17T11:54:29.801 INFO:teuthology.orchestra.run.smithi040.stdout:354.out 2023-12-17T11:54:29.801 INFO:teuthology.orchestra.run.smithi040.stdout:355 2023-12-17T11:54:29.801 INFO:teuthology.orchestra.run.smithi040.stdout:355.out 2023-12-17T11:54:29.801 INFO:teuthology.orchestra.run.smithi040.stdout:356 2023-12-17T11:54:29.801 INFO:teuthology.orchestra.run.smithi040.stdout:356.out 2023-12-17T11:54:29.801 INFO:teuthology.orchestra.run.smithi040.stdout:357 2023-12-17T11:54:29.801 INFO:teuthology.orchestra.run.smithi040.stdout:357.out 2023-12-17T11:54:29.801 INFO:teuthology.orchestra.run.smithi040.stdout:358 2023-12-17T11:54:29.801 INFO:teuthology.orchestra.run.smithi040.stdout:358.out 2023-12-17T11:54:29.801 INFO:teuthology.orchestra.run.smithi040.stdout:359 2023-12-17T11:54:29.801 INFO:teuthology.orchestra.run.smithi040.stdout:359.out 2023-12-17T11:54:29.801 INFO:teuthology.orchestra.run.smithi040.stdout:360 2023-12-17T11:54:29.801 INFO:teuthology.orchestra.run.smithi040.stdout:360.out 2023-12-17T11:54:29.802 INFO:teuthology.orchestra.run.smithi040.stdout:361 2023-12-17T11:54:29.802 INFO:teuthology.orchestra.run.smithi040.stdout:361.out 2023-12-17T11:54:29.802 INFO:teuthology.orchestra.run.smithi040.stdout:362 2023-12-17T11:54:29.802 INFO:teuthology.orchestra.run.smithi040.stdout:362.out 2023-12-17T11:54:29.802 INFO:teuthology.orchestra.run.smithi040.stdout:363 2023-12-17T11:54:29.802 INFO:teuthology.orchestra.run.smithi040.stdout:363.out 2023-12-17T11:54:29.802 INFO:teuthology.orchestra.run.smithi040.stdout:364 2023-12-17T11:54:29.802 INFO:teuthology.orchestra.run.smithi040.stdout:364.out 2023-12-17T11:54:29.802 INFO:teuthology.orchestra.run.smithi040.stdout:365 2023-12-17T11:54:29.802 INFO:teuthology.orchestra.run.smithi040.stdout:365.out 2023-12-17T11:54:29.802 INFO:teuthology.orchestra.run.smithi040.stdout:366 2023-12-17T11:54:29.803 INFO:teuthology.orchestra.run.smithi040.stdout:366.out 2023-12-17T11:54:29.803 INFO:teuthology.orchestra.run.smithi040.stdout:367 2023-12-17T11:54:29.803 INFO:teuthology.orchestra.run.smithi040.stdout:367.out 2023-12-17T11:54:29.803 INFO:teuthology.orchestra.run.smithi040.stdout:368 2023-12-17T11:54:29.803 INFO:teuthology.orchestra.run.smithi040.stdout:368.out 2023-12-17T11:54:29.803 INFO:teuthology.orchestra.run.smithi040.stdout:369 2023-12-17T11:54:29.803 INFO:teuthology.orchestra.run.smithi040.stdout:369.out 2023-12-17T11:54:29.803 INFO:teuthology.orchestra.run.smithi040.stdout:370 2023-12-17T11:54:29.803 INFO:teuthology.orchestra.run.smithi040.stdout:370.out 2023-12-17T11:54:29.803 INFO:teuthology.orchestra.run.smithi040.stdout:371 2023-12-17T11:54:29.803 INFO:teuthology.orchestra.run.smithi040.stdout:371.out 2023-12-17T11:54:29.803 INFO:teuthology.orchestra.run.smithi040.stdout:372 2023-12-17T11:54:29.803 INFO:teuthology.orchestra.run.smithi040.stdout:372.out 2023-12-17T11:54:29.803 INFO:teuthology.orchestra.run.smithi040.stdout:373 2023-12-17T11:54:29.803 INFO:teuthology.orchestra.run.smithi040.stdout:373.out 2023-12-17T11:54:29.804 INFO:teuthology.orchestra.run.smithi040.stdout:374 2023-12-17T11:54:29.804 INFO:teuthology.orchestra.run.smithi040.stdout:374.out 2023-12-17T11:54:29.804 INFO:teuthology.orchestra.run.smithi040.stdout:375 2023-12-17T11:54:29.804 INFO:teuthology.orchestra.run.smithi040.stdout:375.out 2023-12-17T11:54:29.804 INFO:teuthology.orchestra.run.smithi040.stdout:376 2023-12-17T11:54:29.804 INFO:teuthology.orchestra.run.smithi040.stdout:376.out 2023-12-17T11:54:29.804 INFO:teuthology.orchestra.run.smithi040.stdout:377 2023-12-17T11:54:29.804 INFO:teuthology.orchestra.run.smithi040.stdout:377.out 2023-12-17T11:54:29.804 INFO:teuthology.orchestra.run.smithi040.stdout:378 2023-12-17T11:54:29.804 INFO:teuthology.orchestra.run.smithi040.stdout:378.out 2023-12-17T11:54:29.804 INFO:teuthology.orchestra.run.smithi040.stdout:379 2023-12-17T11:54:29.804 INFO:teuthology.orchestra.run.smithi040.stdout:379.out 2023-12-17T11:54:29.804 INFO:teuthology.orchestra.run.smithi040.stdout:380 2023-12-17T11:54:29.804 INFO:teuthology.orchestra.run.smithi040.stdout:380.out 2023-12-17T11:54:29.804 INFO:teuthology.orchestra.run.smithi040.stdout:381 2023-12-17T11:54:29.805 INFO:teuthology.orchestra.run.smithi040.stdout:381.out 2023-12-17T11:54:29.805 INFO:teuthology.orchestra.run.smithi040.stdout:382 2023-12-17T11:54:29.805 INFO:teuthology.orchestra.run.smithi040.stdout:382.out 2023-12-17T11:54:29.805 INFO:teuthology.orchestra.run.smithi040.stdout:383 2023-12-17T11:54:29.805 INFO:teuthology.orchestra.run.smithi040.stdout:383.out 2023-12-17T11:54:29.805 INFO:teuthology.orchestra.run.smithi040.stdout:384 2023-12-17T11:54:29.805 INFO:teuthology.orchestra.run.smithi040.stdout:384.out 2023-12-17T11:54:29.805 INFO:teuthology.orchestra.run.smithi040.stdout:385 2023-12-17T11:54:29.805 INFO:teuthology.orchestra.run.smithi040.stdout:385.out 2023-12-17T11:54:29.805 INFO:teuthology.orchestra.run.smithi040.stdout:386 2023-12-17T11:54:29.805 INFO:teuthology.orchestra.run.smithi040.stdout:386.out 2023-12-17T11:54:29.805 INFO:teuthology.orchestra.run.smithi040.stdout:387 2023-12-17T11:54:29.805 INFO:teuthology.orchestra.run.smithi040.stdout:387.out 2023-12-17T11:54:29.805 INFO:teuthology.orchestra.run.smithi040.stdout:388 2023-12-17T11:54:29.805 INFO:teuthology.orchestra.run.smithi040.stdout:388.out 2023-12-17T11:54:29.806 INFO:teuthology.orchestra.run.smithi040.stdout:389 2023-12-17T11:54:29.806 INFO:teuthology.orchestra.run.smithi040.stdout:389.out 2023-12-17T11:54:29.806 INFO:teuthology.orchestra.run.smithi040.stdout:390 2023-12-17T11:54:29.806 INFO:teuthology.orchestra.run.smithi040.stdout:390.out 2023-12-17T11:54:29.806 INFO:teuthology.orchestra.run.smithi040.stdout:391 2023-12-17T11:54:29.806 INFO:teuthology.orchestra.run.smithi040.stdout:391.out 2023-12-17T11:54:29.806 INFO:teuthology.orchestra.run.smithi040.stdout:392 2023-12-17T11:54:29.806 INFO:teuthology.orchestra.run.smithi040.stdout:392.out 2023-12-17T11:54:29.806 INFO:teuthology.orchestra.run.smithi040.stdout:393 2023-12-17T11:54:29.806 INFO:teuthology.orchestra.run.smithi040.stdout:393.out 2023-12-17T11:54:29.806 INFO:teuthology.orchestra.run.smithi040.stdout:394 2023-12-17T11:54:29.806 INFO:teuthology.orchestra.run.smithi040.stdout:394.out 2023-12-17T11:54:29.806 INFO:teuthology.orchestra.run.smithi040.stdout:395 2023-12-17T11:54:29.806 INFO:teuthology.orchestra.run.smithi040.stdout:395.out 2023-12-17T11:54:29.806 INFO:teuthology.orchestra.run.smithi040.stdout:396 2023-12-17T11:54:29.807 INFO:teuthology.orchestra.run.smithi040.stdout:396.out 2023-12-17T11:54:29.807 INFO:teuthology.orchestra.run.smithi040.stdout:397 2023-12-17T11:54:29.807 INFO:teuthology.orchestra.run.smithi040.stdout:397.out 2023-12-17T11:54:29.807 INFO:teuthology.orchestra.run.smithi040.stdout:398 2023-12-17T11:54:29.807 INFO:teuthology.orchestra.run.smithi040.stdout:398.out 2023-12-17T11:54:29.807 INFO:teuthology.orchestra.run.smithi040.stdout:399 2023-12-17T11:54:29.807 INFO:teuthology.orchestra.run.smithi040.stdout:399.out 2023-12-17T11:54:29.807 INFO:teuthology.orchestra.run.smithi040.stdout:400 2023-12-17T11:54:29.807 INFO:teuthology.orchestra.run.smithi040.stdout:400.out 2023-12-17T11:54:29.807 INFO:teuthology.orchestra.run.smithi040.stdout:401 2023-12-17T11:54:29.807 INFO:teuthology.orchestra.run.smithi040.stdout:401.out 2023-12-17T11:54:29.807 INFO:teuthology.orchestra.run.smithi040.stdout:402 2023-12-17T11:54:29.807 INFO:teuthology.orchestra.run.smithi040.stdout:402.out 2023-12-17T11:54:29.807 INFO:teuthology.orchestra.run.smithi040.stdout:403 2023-12-17T11:54:29.807 INFO:teuthology.orchestra.run.smithi040.stdout:403.out 2023-12-17T11:54:29.808 INFO:teuthology.orchestra.run.smithi040.stdout:404 2023-12-17T11:54:29.808 INFO:teuthology.orchestra.run.smithi040.stdout:404.out 2023-12-17T11:54:29.808 INFO:teuthology.orchestra.run.smithi040.stdout:405 2023-12-17T11:54:29.808 INFO:teuthology.orchestra.run.smithi040.stdout:405.out 2023-12-17T11:54:29.808 INFO:teuthology.orchestra.run.smithi040.stdout:406 2023-12-17T11:54:29.808 INFO:teuthology.orchestra.run.smithi040.stdout:406.out 2023-12-17T11:54:29.808 INFO:teuthology.orchestra.run.smithi040.stdout:407 2023-12-17T11:54:29.808 INFO:teuthology.orchestra.run.smithi040.stdout:407.out 2023-12-17T11:54:29.808 INFO:teuthology.orchestra.run.smithi040.stdout:408 2023-12-17T11:54:29.808 INFO:teuthology.orchestra.run.smithi040.stdout:408.out 2023-12-17T11:54:29.808 INFO:teuthology.orchestra.run.smithi040.stdout:409 2023-12-17T11:54:29.808 INFO:teuthology.orchestra.run.smithi040.stdout:409.out 2023-12-17T11:54:29.808 INFO:teuthology.orchestra.run.smithi040.stdout:410 2023-12-17T11:54:29.808 INFO:teuthology.orchestra.run.smithi040.stdout:410.out 2023-12-17T11:54:29.809 INFO:teuthology.orchestra.run.smithi040.stdout:411 2023-12-17T11:54:29.809 INFO:teuthology.orchestra.run.smithi040.stdout:411.out 2023-12-17T11:54:29.809 INFO:teuthology.orchestra.run.smithi040.stdout:412 2023-12-17T11:54:29.809 INFO:teuthology.orchestra.run.smithi040.stdout:412.out 2023-12-17T11:54:29.809 INFO:teuthology.orchestra.run.smithi040.stdout:413 2023-12-17T11:54:29.809 INFO:teuthology.orchestra.run.smithi040.stdout:413.out 2023-12-17T11:54:29.809 INFO:teuthology.orchestra.run.smithi040.stdout:414 2023-12-17T11:54:29.809 INFO:teuthology.orchestra.run.smithi040.stdout:414.out 2023-12-17T11:54:29.809 INFO:teuthology.orchestra.run.smithi040.stdout:415 2023-12-17T11:54:29.810 INFO:teuthology.orchestra.run.smithi040.stdout:415.out 2023-12-17T11:54:29.810 INFO:teuthology.orchestra.run.smithi040.stdout:416 2023-12-17T11:54:29.810 INFO:teuthology.orchestra.run.smithi040.stdout:416.out 2023-12-17T11:54:29.810 INFO:teuthology.orchestra.run.smithi040.stdout:417 2023-12-17T11:54:29.810 INFO:teuthology.orchestra.run.smithi040.stdout:417.out 2023-12-17T11:54:29.810 INFO:teuthology.orchestra.run.smithi040.stdout:418 2023-12-17T11:54:29.810 INFO:teuthology.orchestra.run.smithi040.stdout:418.out 2023-12-17T11:54:29.810 INFO:teuthology.orchestra.run.smithi040.stdout:419 2023-12-17T11:54:29.810 INFO:teuthology.orchestra.run.smithi040.stdout:419.out 2023-12-17T11:54:29.810 INFO:teuthology.orchestra.run.smithi040.stdout:420 2023-12-17T11:54:29.810 INFO:teuthology.orchestra.run.smithi040.stdout:420.out 2023-12-17T11:54:29.810 INFO:teuthology.orchestra.run.smithi040.stdout:421 2023-12-17T11:54:29.810 INFO:teuthology.orchestra.run.smithi040.stdout:421.out 2023-12-17T11:54:29.810 INFO:teuthology.orchestra.run.smithi040.stdout:422 2023-12-17T11:54:29.811 INFO:teuthology.orchestra.run.smithi040.stdout:422.out 2023-12-17T11:54:29.811 INFO:teuthology.orchestra.run.smithi040.stdout:423 2023-12-17T11:54:29.811 INFO:teuthology.orchestra.run.smithi040.stdout:423.out 2023-12-17T11:54:29.811 INFO:teuthology.orchestra.run.smithi040.stdout:424 2023-12-17T11:54:29.811 INFO:teuthology.orchestra.run.smithi040.stdout:424.out 2023-12-17T11:54:29.811 INFO:teuthology.orchestra.run.smithi040.stdout:425 2023-12-17T11:54:29.811 INFO:teuthology.orchestra.run.smithi040.stdout:425.out 2023-12-17T11:54:29.811 INFO:teuthology.orchestra.run.smithi040.stdout:426 2023-12-17T11:54:29.811 INFO:teuthology.orchestra.run.smithi040.stdout:426.out 2023-12-17T11:54:29.811 INFO:teuthology.orchestra.run.smithi040.stdout:427 2023-12-17T11:54:29.811 INFO:teuthology.orchestra.run.smithi040.stdout:427.out 2023-12-17T11:54:29.811 INFO:teuthology.orchestra.run.smithi040.stdout:428 2023-12-17T11:54:29.811 INFO:teuthology.orchestra.run.smithi040.stdout:428.out 2023-12-17T11:54:29.811 INFO:teuthology.orchestra.run.smithi040.stdout:429 2023-12-17T11:54:29.811 INFO:teuthology.orchestra.run.smithi040.stdout:429.out 2023-12-17T11:54:29.812 INFO:teuthology.orchestra.run.smithi040.stdout:430 2023-12-17T11:54:29.812 INFO:teuthology.orchestra.run.smithi040.stdout:430.out 2023-12-17T11:54:29.812 INFO:teuthology.orchestra.run.smithi040.stdout:431 2023-12-17T11:54:29.812 INFO:teuthology.orchestra.run.smithi040.stdout:431.out 2023-12-17T11:54:29.812 INFO:teuthology.orchestra.run.smithi040.stdout:432 2023-12-17T11:54:29.812 INFO:teuthology.orchestra.run.smithi040.stdout:432.out 2023-12-17T11:54:29.812 INFO:teuthology.orchestra.run.smithi040.stdout:433 2023-12-17T11:54:29.812 INFO:teuthology.orchestra.run.smithi040.stdout:433.out 2023-12-17T11:54:29.812 INFO:teuthology.orchestra.run.smithi040.stdout:434 2023-12-17T11:54:29.812 INFO:teuthology.orchestra.run.smithi040.stdout:434.out 2023-12-17T11:54:29.812 INFO:teuthology.orchestra.run.smithi040.stdout:435 2023-12-17T11:54:29.812 INFO:teuthology.orchestra.run.smithi040.stdout:435.out 2023-12-17T11:54:29.812 INFO:teuthology.orchestra.run.smithi040.stdout:436 2023-12-17T11:54:29.812 INFO:teuthology.orchestra.run.smithi040.stdout:436.out 2023-12-17T11:54:29.812 INFO:teuthology.orchestra.run.smithi040.stdout:437 2023-12-17T11:54:29.813 INFO:teuthology.orchestra.run.smithi040.stdout:437.out 2023-12-17T11:54:29.813 INFO:teuthology.orchestra.run.smithi040.stdout:438 2023-12-17T11:54:29.813 INFO:teuthology.orchestra.run.smithi040.stdout:438.out 2023-12-17T11:54:29.813 INFO:teuthology.orchestra.run.smithi040.stdout:439 2023-12-17T11:54:29.813 INFO:teuthology.orchestra.run.smithi040.stdout:439.out 2023-12-17T11:54:29.813 INFO:teuthology.orchestra.run.smithi040.stdout:440 2023-12-17T11:54:29.813 INFO:teuthology.orchestra.run.smithi040.stdout:440.out 2023-12-17T11:54:29.813 INFO:teuthology.orchestra.run.smithi040.stdout:441 2023-12-17T11:54:29.813 INFO:teuthology.orchestra.run.smithi040.stdout:441.out 2023-12-17T11:54:29.813 INFO:teuthology.orchestra.run.smithi040.stdout:442 2023-12-17T11:54:29.813 INFO:teuthology.orchestra.run.smithi040.stdout:442.out 2023-12-17T11:54:29.813 INFO:teuthology.orchestra.run.smithi040.stdout:443 2023-12-17T11:54:29.813 INFO:teuthology.orchestra.run.smithi040.stdout:443.out 2023-12-17T11:54:29.813 INFO:teuthology.orchestra.run.smithi040.stdout:444 2023-12-17T11:54:29.813 INFO:teuthology.orchestra.run.smithi040.stdout:444.out 2023-12-17T11:54:29.814 INFO:teuthology.orchestra.run.smithi040.stdout:445 2023-12-17T11:54:29.814 INFO:teuthology.orchestra.run.smithi040.stdout:445.out 2023-12-17T11:54:29.814 INFO:teuthology.orchestra.run.smithi040.stdout:446 2023-12-17T11:54:29.814 INFO:teuthology.orchestra.run.smithi040.stdout:446.out 2023-12-17T11:54:29.814 INFO:teuthology.orchestra.run.smithi040.stdout:447 2023-12-17T11:54:29.814 INFO:teuthology.orchestra.run.smithi040.stdout:447.out 2023-12-17T11:54:29.814 INFO:teuthology.orchestra.run.smithi040.stdout:448 2023-12-17T11:54:29.814 INFO:teuthology.orchestra.run.smithi040.stdout:448.out 2023-12-17T11:54:29.814 INFO:teuthology.orchestra.run.smithi040.stdout:449 2023-12-17T11:54:29.814 INFO:teuthology.orchestra.run.smithi040.stdout:449.out 2023-12-17T11:54:29.814 INFO:teuthology.orchestra.run.smithi040.stdout:450 2023-12-17T11:54:29.814 INFO:teuthology.orchestra.run.smithi040.stdout:450.out 2023-12-17T11:54:29.814 INFO:teuthology.orchestra.run.smithi040.stdout:451 2023-12-17T11:54:29.814 INFO:teuthology.orchestra.run.smithi040.stdout:451.out 2023-12-17T11:54:29.814 INFO:teuthology.orchestra.run.smithi040.stdout:452 2023-12-17T11:54:29.815 INFO:teuthology.orchestra.run.smithi040.stdout:452.out 2023-12-17T11:54:29.815 INFO:teuthology.orchestra.run.smithi040.stdout:453 2023-12-17T11:54:29.815 INFO:teuthology.orchestra.run.smithi040.stdout:453.out 2023-12-17T11:54:29.815 INFO:teuthology.orchestra.run.smithi040.stdout:454 2023-12-17T11:54:29.815 INFO:teuthology.orchestra.run.smithi040.stdout:454.out 2023-12-17T11:54:29.815 INFO:teuthology.orchestra.run.smithi040.stdout:455 2023-12-17T11:54:29.815 INFO:teuthology.orchestra.run.smithi040.stdout:455.out 2023-12-17T11:54:29.815 INFO:teuthology.orchestra.run.smithi040.stdout:456 2023-12-17T11:54:29.815 INFO:teuthology.orchestra.run.smithi040.stdout:456.out 2023-12-17T11:54:29.815 INFO:teuthology.orchestra.run.smithi040.stdout:457 2023-12-17T11:54:29.815 INFO:teuthology.orchestra.run.smithi040.stdout:457.out 2023-12-17T11:54:29.815 INFO:teuthology.orchestra.run.smithi040.stdout:458 2023-12-17T11:54:29.815 INFO:teuthology.orchestra.run.smithi040.stdout:458.out 2023-12-17T11:54:29.815 INFO:teuthology.orchestra.run.smithi040.stdout:459 2023-12-17T11:54:29.815 INFO:teuthology.orchestra.run.smithi040.stdout:459.out 2023-12-17T11:54:29.816 INFO:teuthology.orchestra.run.smithi040.stdout:460 2023-12-17T11:54:29.816 INFO:teuthology.orchestra.run.smithi040.stdout:460.out 2023-12-17T11:54:29.816 INFO:teuthology.orchestra.run.smithi040.stdout:461 2023-12-17T11:54:29.816 INFO:teuthology.orchestra.run.smithi040.stdout:461.out 2023-12-17T11:54:29.816 INFO:teuthology.orchestra.run.smithi040.stdout:462 2023-12-17T11:54:29.816 INFO:teuthology.orchestra.run.smithi040.stdout:462.out 2023-12-17T11:54:29.816 INFO:teuthology.orchestra.run.smithi040.stdout:463 2023-12-17T11:54:29.816 INFO:teuthology.orchestra.run.smithi040.stdout:463.out 2023-12-17T11:54:29.816 INFO:teuthology.orchestra.run.smithi040.stdout:464 2023-12-17T11:54:29.816 INFO:teuthology.orchestra.run.smithi040.stdout:464.out 2023-12-17T11:54:29.816 INFO:teuthology.orchestra.run.smithi040.stdout:465 2023-12-17T11:54:29.816 INFO:teuthology.orchestra.run.smithi040.stdout:465.out 2023-12-17T11:54:29.816 INFO:teuthology.orchestra.run.smithi040.stdout:466 2023-12-17T11:54:29.816 INFO:teuthology.orchestra.run.smithi040.stdout:466.out 2023-12-17T11:54:29.816 INFO:teuthology.orchestra.run.smithi040.stdout:467 2023-12-17T11:54:29.817 INFO:teuthology.orchestra.run.smithi040.stdout:467.out 2023-12-17T11:54:29.817 INFO:teuthology.orchestra.run.smithi040.stdout:468 2023-12-17T11:54:29.817 INFO:teuthology.orchestra.run.smithi040.stdout:468.out 2023-12-17T11:54:29.817 INFO:teuthology.orchestra.run.smithi040.stdout:469 2023-12-17T11:54:29.817 INFO:teuthology.orchestra.run.smithi040.stdout:469.out 2023-12-17T11:54:29.817 INFO:teuthology.orchestra.run.smithi040.stdout:470 2023-12-17T11:54:29.817 INFO:teuthology.orchestra.run.smithi040.stdout:470.out 2023-12-17T11:54:29.817 INFO:teuthology.orchestra.run.smithi040.stdout:471 2023-12-17T11:54:29.817 INFO:teuthology.orchestra.run.smithi040.stdout:471.out 2023-12-17T11:54:29.817 INFO:teuthology.orchestra.run.smithi040.stdout:472 2023-12-17T11:54:29.817 INFO:teuthology.orchestra.run.smithi040.stdout:472.out 2023-12-17T11:54:29.817 INFO:teuthology.orchestra.run.smithi040.stdout:473 2023-12-17T11:54:29.817 INFO:teuthology.orchestra.run.smithi040.stdout:473.out 2023-12-17T11:54:29.817 INFO:teuthology.orchestra.run.smithi040.stdout:474 2023-12-17T11:54:29.818 INFO:teuthology.orchestra.run.smithi040.stdout:474.out 2023-12-17T11:54:29.818 INFO:teuthology.orchestra.run.smithi040.stdout:475 2023-12-17T11:54:29.818 INFO:teuthology.orchestra.run.smithi040.stdout:475.out 2023-12-17T11:54:29.818 INFO:teuthology.orchestra.run.smithi040.stdout:476 2023-12-17T11:54:29.818 INFO:teuthology.orchestra.run.smithi040.stdout:476.out 2023-12-17T11:54:29.818 INFO:teuthology.orchestra.run.smithi040.stdout:477 2023-12-17T11:54:29.818 INFO:teuthology.orchestra.run.smithi040.stdout:477.out 2023-12-17T11:54:29.818 INFO:teuthology.orchestra.run.smithi040.stdout:478 2023-12-17T11:54:29.818 INFO:teuthology.orchestra.run.smithi040.stdout:478.out 2023-12-17T11:54:29.818 INFO:teuthology.orchestra.run.smithi040.stdout:479 2023-12-17T11:54:29.818 INFO:teuthology.orchestra.run.smithi040.stdout:479.out 2023-12-17T11:54:29.818 INFO:teuthology.orchestra.run.smithi040.stdout:480 2023-12-17T11:54:29.818 INFO:teuthology.orchestra.run.smithi040.stdout:480.out 2023-12-17T11:54:29.818 INFO:teuthology.orchestra.run.smithi040.stdout:481 2023-12-17T11:54:29.818 INFO:teuthology.orchestra.run.smithi040.stdout:481.out 2023-12-17T11:54:29.819 INFO:teuthology.orchestra.run.smithi040.stdout:482 2023-12-17T11:54:29.819 INFO:teuthology.orchestra.run.smithi040.stdout:482.out 2023-12-17T11:54:29.819 INFO:teuthology.orchestra.run.smithi040.stdout:483 2023-12-17T11:54:29.819 INFO:teuthology.orchestra.run.smithi040.stdout:483.out 2023-12-17T11:54:29.819 INFO:teuthology.orchestra.run.smithi040.stdout:484 2023-12-17T11:54:29.819 INFO:teuthology.orchestra.run.smithi040.stdout:484.out 2023-12-17T11:54:29.819 INFO:teuthology.orchestra.run.smithi040.stdout:485 2023-12-17T11:54:29.819 INFO:teuthology.orchestra.run.smithi040.stdout:485.out 2023-12-17T11:54:29.819 INFO:teuthology.orchestra.run.smithi040.stdout:486 2023-12-17T11:54:29.819 INFO:teuthology.orchestra.run.smithi040.stdout:486.out 2023-12-17T11:54:29.819 INFO:teuthology.orchestra.run.smithi040.stdout:487 2023-12-17T11:54:29.819 INFO:teuthology.orchestra.run.smithi040.stdout:487.out 2023-12-17T11:54:29.819 INFO:teuthology.orchestra.run.smithi040.stdout:488 2023-12-17T11:54:29.819 INFO:teuthology.orchestra.run.smithi040.stdout:488.out 2023-12-17T11:54:29.820 INFO:teuthology.orchestra.run.smithi040.stdout:489 2023-12-17T11:54:29.820 INFO:teuthology.orchestra.run.smithi040.stdout:489.out 2023-12-17T11:54:29.820 INFO:teuthology.orchestra.run.smithi040.stdout:490 2023-12-17T11:54:29.820 INFO:teuthology.orchestra.run.smithi040.stdout:490.out 2023-12-17T11:54:29.820 INFO:teuthology.orchestra.run.smithi040.stdout:491 2023-12-17T11:54:29.820 INFO:teuthology.orchestra.run.smithi040.stdout:491.out 2023-12-17T11:54:29.820 INFO:teuthology.orchestra.run.smithi040.stdout:492 2023-12-17T11:54:29.820 INFO:teuthology.orchestra.run.smithi040.stdout:492.out 2023-12-17T11:54:29.820 INFO:teuthology.orchestra.run.smithi040.stdout:493 2023-12-17T11:54:29.820 INFO:teuthology.orchestra.run.smithi040.stdout:493.out 2023-12-17T11:54:29.820 INFO:teuthology.orchestra.run.smithi040.stdout:494 2023-12-17T11:54:29.820 INFO:teuthology.orchestra.run.smithi040.stdout:494.out 2023-12-17T11:54:29.820 INFO:teuthology.orchestra.run.smithi040.stdout:495 2023-12-17T11:54:29.820 INFO:teuthology.orchestra.run.smithi040.stdout:495.out 2023-12-17T11:54:29.820 INFO:teuthology.orchestra.run.smithi040.stdout:496 2023-12-17T11:54:29.821 INFO:teuthology.orchestra.run.smithi040.stdout:496.out 2023-12-17T11:54:29.821 INFO:teuthology.orchestra.run.smithi040.stdout:497 2023-12-17T11:54:29.821 INFO:teuthology.orchestra.run.smithi040.stdout:497.out 2023-12-17T11:54:29.821 INFO:teuthology.orchestra.run.smithi040.stdout:498 2023-12-17T11:54:29.821 INFO:teuthology.orchestra.run.smithi040.stdout:498.out 2023-12-17T11:54:29.821 INFO:teuthology.orchestra.run.smithi040.stdout:499 2023-12-17T11:54:29.821 INFO:teuthology.orchestra.run.smithi040.stdout:499.out 2023-12-17T11:54:29.821 INFO:teuthology.orchestra.run.smithi040.stdout:500 2023-12-17T11:54:29.821 INFO:teuthology.orchestra.run.smithi040.stdout:500.out 2023-12-17T11:54:29.821 INFO:teuthology.orchestra.run.smithi040.stdout:501 2023-12-17T11:54:29.821 INFO:teuthology.orchestra.run.smithi040.stdout:501.out 2023-12-17T11:54:29.821 INFO:teuthology.orchestra.run.smithi040.stdout:502 2023-12-17T11:54:29.821 INFO:teuthology.orchestra.run.smithi040.stdout:502.out 2023-12-17T11:54:29.821 INFO:teuthology.orchestra.run.smithi040.stdout:503 2023-12-17T11:54:29.822 INFO:teuthology.orchestra.run.smithi040.stdout:503.out 2023-12-17T11:54:29.822 INFO:teuthology.orchestra.run.smithi040.stdout:504 2023-12-17T11:54:29.822 INFO:teuthology.orchestra.run.smithi040.stdout:504.out 2023-12-17T11:54:29.822 INFO:teuthology.orchestra.run.smithi040.stdout:505 2023-12-17T11:54:29.822 INFO:teuthology.orchestra.run.smithi040.stdout:505.out 2023-12-17T11:54:29.822 INFO:teuthology.orchestra.run.smithi040.stdout:506 2023-12-17T11:54:29.822 INFO:teuthology.orchestra.run.smithi040.stdout:506.out 2023-12-17T11:54:29.822 INFO:teuthology.orchestra.run.smithi040.stdout:507 2023-12-17T11:54:29.822 INFO:teuthology.orchestra.run.smithi040.stdout:507.out 2023-12-17T11:54:29.822 INFO:teuthology.orchestra.run.smithi040.stdout:508 2023-12-17T11:54:29.822 INFO:teuthology.orchestra.run.smithi040.stdout:508.out 2023-12-17T11:54:29.822 INFO:teuthology.orchestra.run.smithi040.stdout:509 2023-12-17T11:54:29.822 INFO:teuthology.orchestra.run.smithi040.stdout:509.out 2023-12-17T11:54:29.822 INFO:teuthology.orchestra.run.smithi040.stdout:510 2023-12-17T11:54:29.822 INFO:teuthology.orchestra.run.smithi040.stdout:510.out 2023-12-17T11:54:29.823 INFO:teuthology.orchestra.run.smithi040.stdout:511 2023-12-17T11:54:29.823 INFO:teuthology.orchestra.run.smithi040.stdout:511.out 2023-12-17T11:54:29.823 INFO:teuthology.orchestra.run.smithi040.stdout:512 2023-12-17T11:54:29.823 INFO:teuthology.orchestra.run.smithi040.stdout:512.out 2023-12-17T11:54:29.823 INFO:teuthology.orchestra.run.smithi040.stdout:513 2023-12-17T11:54:29.823 INFO:teuthology.orchestra.run.smithi040.stdout:513.out 2023-12-17T11:54:29.823 INFO:teuthology.orchestra.run.smithi040.stdout:514 2023-12-17T11:54:29.823 INFO:teuthology.orchestra.run.smithi040.stdout:514.out 2023-12-17T11:54:29.823 INFO:teuthology.orchestra.run.smithi040.stdout:515 2023-12-17T11:54:29.823 INFO:teuthology.orchestra.run.smithi040.stdout:515.out 2023-12-17T11:54:29.823 INFO:teuthology.orchestra.run.smithi040.stdout:516 2023-12-17T11:54:29.823 INFO:teuthology.orchestra.run.smithi040.stdout:516.out 2023-12-17T11:54:29.823 INFO:teuthology.orchestra.run.smithi040.stdout:517 2023-12-17T11:54:29.823 INFO:teuthology.orchestra.run.smithi040.stdout:517.out 2023-12-17T11:54:29.823 INFO:teuthology.orchestra.run.smithi040.stdout:518 2023-12-17T11:54:29.824 INFO:teuthology.orchestra.run.smithi040.stdout:518.out 2023-12-17T11:54:29.824 INFO:teuthology.orchestra.run.smithi040.stdout:519 2023-12-17T11:54:29.824 INFO:teuthology.orchestra.run.smithi040.stdout:519.out 2023-12-17T11:54:29.824 INFO:teuthology.orchestra.run.smithi040.stdout:520 2023-12-17T11:54:29.824 INFO:teuthology.orchestra.run.smithi040.stdout:520.out 2023-12-17T11:54:29.824 INFO:teuthology.orchestra.run.smithi040.stdout:521 2023-12-17T11:54:29.824 INFO:teuthology.orchestra.run.smithi040.stdout:521.out 2023-12-17T11:54:29.824 INFO:teuthology.orchestra.run.smithi040.stdout:522 2023-12-17T11:54:29.824 INFO:teuthology.orchestra.run.smithi040.stdout:522.out 2023-12-17T11:54:29.824 INFO:teuthology.orchestra.run.smithi040.stdout:523 2023-12-17T11:54:29.824 INFO:teuthology.orchestra.run.smithi040.stdout:523.out 2023-12-17T11:54:29.824 INFO:teuthology.orchestra.run.smithi040.stdout:524 2023-12-17T11:54:29.824 INFO:teuthology.orchestra.run.smithi040.stdout:524.out 2023-12-17T11:54:29.824 INFO:teuthology.orchestra.run.smithi040.stdout:525 2023-12-17T11:54:29.824 INFO:teuthology.orchestra.run.smithi040.stdout:525.out 2023-12-17T11:54:29.825 INFO:teuthology.orchestra.run.smithi040.stdout:526 2023-12-17T11:54:29.825 INFO:teuthology.orchestra.run.smithi040.stdout:526.out 2023-12-17T11:54:29.825 INFO:teuthology.orchestra.run.smithi040.stdout:527 2023-12-17T11:54:29.825 INFO:teuthology.orchestra.run.smithi040.stdout:527.out 2023-12-17T11:54:29.825 INFO:teuthology.orchestra.run.smithi040.stdout:528 2023-12-17T11:54:29.825 INFO:teuthology.orchestra.run.smithi040.stdout:528.out 2023-12-17T11:54:29.825 INFO:teuthology.orchestra.run.smithi040.stdout:529 2023-12-17T11:54:29.825 INFO:teuthology.orchestra.run.smithi040.stdout:529.out 2023-12-17T11:54:29.825 INFO:teuthology.orchestra.run.smithi040.stdout:530 2023-12-17T11:54:29.825 INFO:teuthology.orchestra.run.smithi040.stdout:530.out 2023-12-17T11:54:29.825 INFO:teuthology.orchestra.run.smithi040.stdout:531 2023-12-17T11:54:29.825 INFO:teuthology.orchestra.run.smithi040.stdout:531.out 2023-12-17T11:54:29.825 INFO:teuthology.orchestra.run.smithi040.stdout:532 2023-12-17T11:54:29.825 INFO:teuthology.orchestra.run.smithi040.stdout:532.out 2023-12-17T11:54:29.825 INFO:teuthology.orchestra.run.smithi040.stdout:533 2023-12-17T11:54:29.826 INFO:teuthology.orchestra.run.smithi040.stdout:533.out 2023-12-17T11:54:29.826 INFO:teuthology.orchestra.run.smithi040.stdout:534 2023-12-17T11:54:29.826 INFO:teuthology.orchestra.run.smithi040.stdout:534.out 2023-12-17T11:54:29.826 INFO:teuthology.orchestra.run.smithi040.stdout:535 2023-12-17T11:54:29.826 INFO:teuthology.orchestra.run.smithi040.stdout:535.out 2023-12-17T11:54:29.826 INFO:teuthology.orchestra.run.smithi040.stdout:536 2023-12-17T11:54:29.826 INFO:teuthology.orchestra.run.smithi040.stdout:536.out 2023-12-17T11:54:29.826 INFO:teuthology.orchestra.run.smithi040.stdout:537 2023-12-17T11:54:29.826 INFO:teuthology.orchestra.run.smithi040.stdout:537.out 2023-12-17T11:54:29.826 INFO:teuthology.orchestra.run.smithi040.stdout:538 2023-12-17T11:54:29.826 INFO:teuthology.orchestra.run.smithi040.stdout:538.out 2023-12-17T11:54:29.826 INFO:teuthology.orchestra.run.smithi040.stdout:539 2023-12-17T11:54:29.826 INFO:teuthology.orchestra.run.smithi040.stdout:539.out 2023-12-17T11:54:29.826 INFO:teuthology.orchestra.run.smithi040.stdout:540 2023-12-17T11:54:29.826 INFO:teuthology.orchestra.run.smithi040.stdout:540.out 2023-12-17T11:54:29.827 INFO:teuthology.orchestra.run.smithi040.stdout:541 2023-12-17T11:54:29.827 INFO:teuthology.orchestra.run.smithi040.stdout:541.out 2023-12-17T11:54:29.827 INFO:teuthology.orchestra.run.smithi040.stdout:542 2023-12-17T11:54:29.827 INFO:teuthology.orchestra.run.smithi040.stdout:542.out 2023-12-17T11:54:29.827 INFO:teuthology.orchestra.run.smithi040.stdout:543 2023-12-17T11:54:29.827 INFO:teuthology.orchestra.run.smithi040.stdout:543.out 2023-12-17T11:54:29.827 INFO:teuthology.orchestra.run.smithi040.stdout:544 2023-12-17T11:54:29.827 INFO:teuthology.orchestra.run.smithi040.stdout:544.out 2023-12-17T11:54:29.827 INFO:teuthology.orchestra.run.smithi040.stdout:545 2023-12-17T11:54:29.827 INFO:teuthology.orchestra.run.smithi040.stdout:545.out 2023-12-17T11:54:29.827 INFO:teuthology.orchestra.run.smithi040.stdout:546 2023-12-17T11:54:29.827 INFO:teuthology.orchestra.run.smithi040.stdout:546.out 2023-12-17T11:54:29.827 INFO:teuthology.orchestra.run.smithi040.stdout:547 2023-12-17T11:54:29.827 INFO:teuthology.orchestra.run.smithi040.stdout:547.out 2023-12-17T11:54:29.827 INFO:teuthology.orchestra.run.smithi040.stdout:548 2023-12-17T11:54:29.828 INFO:teuthology.orchestra.run.smithi040.stdout:548.out 2023-12-17T11:54:29.828 INFO:teuthology.orchestra.run.smithi040.stdout:549 2023-12-17T11:54:29.828 INFO:teuthology.orchestra.run.smithi040.stdout:549.out 2023-12-17T11:54:29.828 INFO:teuthology.orchestra.run.smithi040.stdout:550 2023-12-17T11:54:29.828 INFO:teuthology.orchestra.run.smithi040.stdout:550.out 2023-12-17T11:54:29.828 INFO:teuthology.orchestra.run.smithi040.stdout:551 2023-12-17T11:54:29.828 INFO:teuthology.orchestra.run.smithi040.stdout:551.out 2023-12-17T11:54:29.828 INFO:teuthology.orchestra.run.smithi040.stdout:552 2023-12-17T11:54:29.828 INFO:teuthology.orchestra.run.smithi040.stdout:552.out 2023-12-17T11:54:29.828 INFO:teuthology.orchestra.run.smithi040.stdout:553 2023-12-17T11:54:29.828 INFO:teuthology.orchestra.run.smithi040.stdout:553.out 2023-12-17T11:54:29.828 INFO:teuthology.orchestra.run.smithi040.stdout:554 2023-12-17T11:54:29.828 INFO:teuthology.orchestra.run.smithi040.stdout:554.out 2023-12-17T11:54:29.828 INFO:teuthology.orchestra.run.smithi040.stdout:555 2023-12-17T11:54:29.828 INFO:teuthology.orchestra.run.smithi040.stdout:555.out 2023-12-17T11:54:29.829 INFO:teuthology.orchestra.run.smithi040.stdout:556 2023-12-17T11:54:29.829 INFO:teuthology.orchestra.run.smithi040.stdout:556.out 2023-12-17T11:54:29.829 INFO:teuthology.orchestra.run.smithi040.stdout:557 2023-12-17T11:54:29.829 INFO:teuthology.orchestra.run.smithi040.stdout:557.out 2023-12-17T11:54:29.829 INFO:teuthology.orchestra.run.smithi040.stdout:558 2023-12-17T11:54:29.829 INFO:teuthology.orchestra.run.smithi040.stdout:558.out 2023-12-17T11:54:29.829 INFO:teuthology.orchestra.run.smithi040.stdout:559 2023-12-17T11:54:29.829 INFO:teuthology.orchestra.run.smithi040.stdout:559.out 2023-12-17T11:54:29.829 INFO:teuthology.orchestra.run.smithi040.stdout:560 2023-12-17T11:54:29.829 INFO:teuthology.orchestra.run.smithi040.stdout:560.out 2023-12-17T11:54:29.829 INFO:teuthology.orchestra.run.smithi040.stdout:561 2023-12-17T11:54:29.829 INFO:teuthology.orchestra.run.smithi040.stdout:561.out 2023-12-17T11:54:29.829 INFO:teuthology.orchestra.run.smithi040.stdout:562 2023-12-17T11:54:29.829 INFO:teuthology.orchestra.run.smithi040.stdout:562.out 2023-12-17T11:54:29.829 INFO:teuthology.orchestra.run.smithi040.stdout:563 2023-12-17T11:54:29.830 INFO:teuthology.orchestra.run.smithi040.stdout:563.out 2023-12-17T11:54:29.830 INFO:teuthology.orchestra.run.smithi040.stdout:564 2023-12-17T11:54:29.830 INFO:teuthology.orchestra.run.smithi040.stdout:564.out 2023-12-17T11:54:29.830 INFO:teuthology.orchestra.run.smithi040.stdout:565 2023-12-17T11:54:29.830 INFO:teuthology.orchestra.run.smithi040.stdout:565.out 2023-12-17T11:54:29.830 INFO:teuthology.orchestra.run.smithi040.stdout:566 2023-12-17T11:54:29.830 INFO:teuthology.orchestra.run.smithi040.stdout:566.out 2023-12-17T11:54:29.830 INFO:teuthology.orchestra.run.smithi040.stdout:567 2023-12-17T11:54:29.830 INFO:teuthology.orchestra.run.smithi040.stdout:567.out 2023-12-17T11:54:29.830 INFO:teuthology.orchestra.run.smithi040.stdout:568 2023-12-17T11:54:29.830 INFO:teuthology.orchestra.run.smithi040.stdout:568.out 2023-12-17T11:54:29.830 INFO:teuthology.orchestra.run.smithi040.stdout:569 2023-12-17T11:54:29.830 INFO:teuthology.orchestra.run.smithi040.stdout:569.out 2023-12-17T11:54:29.830 INFO:teuthology.orchestra.run.smithi040.stdout:570 2023-12-17T11:54:29.830 INFO:teuthology.orchestra.run.smithi040.stdout:570.out 2023-12-17T11:54:29.831 INFO:teuthology.orchestra.run.smithi040.stdout:571 2023-12-17T11:54:29.831 INFO:teuthology.orchestra.run.smithi040.stdout:571.out 2023-12-17T11:54:29.831 INFO:teuthology.orchestra.run.smithi040.stdout:572 2023-12-17T11:54:29.831 INFO:teuthology.orchestra.run.smithi040.stdout:572.out 2023-12-17T11:54:29.831 INFO:teuthology.orchestra.run.smithi040.stdout:573 2023-12-17T11:54:29.831 INFO:teuthology.orchestra.run.smithi040.stdout:573.out 2023-12-17T11:54:29.831 INFO:teuthology.orchestra.run.smithi040.stdout:574 2023-12-17T11:54:29.831 INFO:teuthology.orchestra.run.smithi040.stdout:574.out 2023-12-17T11:54:29.831 INFO:teuthology.orchestra.run.smithi040.stdout:575 2023-12-17T11:54:29.831 INFO:teuthology.orchestra.run.smithi040.stdout:575.out 2023-12-17T11:54:29.831 INFO:teuthology.orchestra.run.smithi040.stdout:576 2023-12-17T11:54:29.831 INFO:teuthology.orchestra.run.smithi040.stdout:576.out 2023-12-17T11:54:29.831 INFO:teuthology.orchestra.run.smithi040.stdout:577 2023-12-17T11:54:29.831 INFO:teuthology.orchestra.run.smithi040.stdout:577.out 2023-12-17T11:54:29.831 INFO:teuthology.orchestra.run.smithi040.stdout:578 2023-12-17T11:54:29.832 INFO:teuthology.orchestra.run.smithi040.stdout:578.out 2023-12-17T11:54:29.832 INFO:teuthology.orchestra.run.smithi040.stdout:579 2023-12-17T11:54:29.832 INFO:teuthology.orchestra.run.smithi040.stdout:579.out 2023-12-17T11:54:29.832 INFO:teuthology.orchestra.run.smithi040.stdout:580 2023-12-17T11:54:29.832 INFO:teuthology.orchestra.run.smithi040.stdout:580.out 2023-12-17T11:54:29.832 INFO:teuthology.orchestra.run.smithi040.stdout:581 2023-12-17T11:54:29.832 INFO:teuthology.orchestra.run.smithi040.stdout:581.out 2023-12-17T11:54:29.832 INFO:teuthology.orchestra.run.smithi040.stdout:582 2023-12-17T11:54:29.832 INFO:teuthology.orchestra.run.smithi040.stdout:582.out 2023-12-17T11:54:29.832 INFO:teuthology.orchestra.run.smithi040.stdout:583 2023-12-17T11:54:29.832 INFO:teuthology.orchestra.run.smithi040.stdout:583.out 2023-12-17T11:54:29.832 INFO:teuthology.orchestra.run.smithi040.stdout:584 2023-12-17T11:54:29.832 INFO:teuthology.orchestra.run.smithi040.stdout:584.out 2023-12-17T11:54:29.832 INFO:teuthology.orchestra.run.smithi040.stdout:585 2023-12-17T11:54:29.832 INFO:teuthology.orchestra.run.smithi040.stdout:585.out 2023-12-17T11:54:29.833 INFO:teuthology.orchestra.run.smithi040.stdout:586 2023-12-17T11:54:29.833 INFO:teuthology.orchestra.run.smithi040.stdout:586.out 2023-12-17T11:54:29.833 INFO:teuthology.orchestra.run.smithi040.stdout:587 2023-12-17T11:54:29.833 INFO:teuthology.orchestra.run.smithi040.stdout:587.out 2023-12-17T11:54:29.833 INFO:teuthology.orchestra.run.smithi040.stdout:588 2023-12-17T11:54:29.833 INFO:teuthology.orchestra.run.smithi040.stdout:588.out 2023-12-17T11:54:29.833 INFO:teuthology.orchestra.run.smithi040.stdout:589 2023-12-17T11:54:29.833 INFO:teuthology.orchestra.run.smithi040.stdout:589.out 2023-12-17T11:54:29.833 INFO:teuthology.orchestra.run.smithi040.stdout:590 2023-12-17T11:54:29.833 INFO:teuthology.orchestra.run.smithi040.stdout:590.out 2023-12-17T11:54:29.833 INFO:teuthology.orchestra.run.smithi040.stdout:591 2023-12-17T11:54:29.833 INFO:teuthology.orchestra.run.smithi040.stdout:591.out 2023-12-17T11:54:29.833 INFO:teuthology.orchestra.run.smithi040.stdout:592 2023-12-17T11:54:29.833 INFO:teuthology.orchestra.run.smithi040.stdout:592.out 2023-12-17T11:54:29.833 INFO:teuthology.orchestra.run.smithi040.stdout:593 2023-12-17T11:54:29.834 INFO:teuthology.orchestra.run.smithi040.stdout:593.out 2023-12-17T11:54:29.834 INFO:teuthology.orchestra.run.smithi040.stdout:594 2023-12-17T11:54:29.834 INFO:teuthology.orchestra.run.smithi040.stdout:594.out 2023-12-17T11:54:29.834 INFO:teuthology.orchestra.run.smithi040.stdout:595 2023-12-17T11:54:29.834 INFO:teuthology.orchestra.run.smithi040.stdout:595.out 2023-12-17T11:54:29.834 INFO:teuthology.orchestra.run.smithi040.stdout:596 2023-12-17T11:54:29.834 INFO:teuthology.orchestra.run.smithi040.stdout:596.out 2023-12-17T11:54:29.834 INFO:teuthology.orchestra.run.smithi040.stdout:597 2023-12-17T11:54:29.834 INFO:teuthology.orchestra.run.smithi040.stdout:597.out 2023-12-17T11:54:29.834 INFO:teuthology.orchestra.run.smithi040.stdout:598 2023-12-17T11:54:29.834 INFO:teuthology.orchestra.run.smithi040.stdout:598.out 2023-12-17T11:54:29.834 INFO:teuthology.orchestra.run.smithi040.stdout:599 2023-12-17T11:54:29.834 INFO:teuthology.orchestra.run.smithi040.stdout:599.out 2023-12-17T11:54:29.834 INFO:teuthology.orchestra.run.smithi040.stdout:600 2023-12-17T11:54:29.834 INFO:teuthology.orchestra.run.smithi040.stdout:600.out 2023-12-17T11:54:29.835 INFO:teuthology.orchestra.run.smithi040.stdout:601 2023-12-17T11:54:29.835 INFO:teuthology.orchestra.run.smithi040.stdout:601.out 2023-12-17T11:54:29.835 INFO:teuthology.orchestra.run.smithi040.stdout:602 2023-12-17T11:54:29.835 INFO:teuthology.orchestra.run.smithi040.stdout:602.out 2023-12-17T11:54:29.835 INFO:teuthology.orchestra.run.smithi040.stdout:603 2023-12-17T11:54:29.835 INFO:teuthology.orchestra.run.smithi040.stdout:603.out 2023-12-17T11:54:29.835 INFO:teuthology.orchestra.run.smithi040.stdout:604 2023-12-17T11:54:29.835 INFO:teuthology.orchestra.run.smithi040.stdout:604.out 2023-12-17T11:54:29.835 INFO:teuthology.orchestra.run.smithi040.stdout:605 2023-12-17T11:54:29.835 INFO:teuthology.orchestra.run.smithi040.stdout:605.out 2023-12-17T11:54:29.835 INFO:teuthology.orchestra.run.smithi040.stdout:606 2023-12-17T11:54:29.835 INFO:teuthology.orchestra.run.smithi040.stdout:606.out 2023-12-17T11:54:29.835 INFO:teuthology.orchestra.run.smithi040.stdout:607 2023-12-17T11:54:29.835 INFO:teuthology.orchestra.run.smithi040.stdout:607.out 2023-12-17T11:54:29.835 INFO:teuthology.orchestra.run.smithi040.stdout:608 2023-12-17T11:54:29.836 INFO:teuthology.orchestra.run.smithi040.stdout:608.out 2023-12-17T11:54:29.836 INFO:teuthology.orchestra.run.smithi040.stdout:609 2023-12-17T11:54:29.836 INFO:teuthology.orchestra.run.smithi040.stdout:609.out 2023-12-17T11:54:29.836 INFO:teuthology.orchestra.run.smithi040.stdout:610 2023-12-17T11:54:29.836 INFO:teuthology.orchestra.run.smithi040.stdout:610.out 2023-12-17T11:54:29.836 INFO:teuthology.orchestra.run.smithi040.stdout:611 2023-12-17T11:54:29.836 INFO:teuthology.orchestra.run.smithi040.stdout:611.out 2023-12-17T11:54:29.836 INFO:teuthology.orchestra.run.smithi040.stdout:612 2023-12-17T11:54:29.836 INFO:teuthology.orchestra.run.smithi040.stdout:612.out 2023-12-17T11:54:29.836 INFO:teuthology.orchestra.run.smithi040.stdout:613 2023-12-17T11:54:29.836 INFO:teuthology.orchestra.run.smithi040.stdout:613.out 2023-12-17T11:54:29.836 INFO:teuthology.orchestra.run.smithi040.stdout:614 2023-12-17T11:54:29.836 INFO:teuthology.orchestra.run.smithi040.stdout:614.out 2023-12-17T11:54:29.836 INFO:teuthology.orchestra.run.smithi040.stdout:615 2023-12-17T11:54:29.836 INFO:teuthology.orchestra.run.smithi040.stdout:615.out 2023-12-17T11:54:29.837 INFO:teuthology.orchestra.run.smithi040.stdout:616 2023-12-17T11:54:29.837 INFO:teuthology.orchestra.run.smithi040.stdout:616.out 2023-12-17T11:54:29.837 INFO:teuthology.orchestra.run.smithi040.stdout:617 2023-12-17T11:54:29.837 INFO:teuthology.orchestra.run.smithi040.stdout:617.out 2023-12-17T11:54:29.837 INFO:teuthology.orchestra.run.smithi040.stdout:618 2023-12-17T11:54:29.837 INFO:teuthology.orchestra.run.smithi040.stdout:618.out 2023-12-17T11:54:29.837 INFO:teuthology.orchestra.run.smithi040.stdout:619 2023-12-17T11:54:29.837 INFO:teuthology.orchestra.run.smithi040.stdout:619.out 2023-12-17T11:54:29.837 INFO:teuthology.orchestra.run.smithi040.stdout:620 2023-12-17T11:54:29.837 INFO:teuthology.orchestra.run.smithi040.stdout:620.out 2023-12-17T11:54:29.837 INFO:teuthology.orchestra.run.smithi040.stdout:621 2023-12-17T11:54:29.837 INFO:teuthology.orchestra.run.smithi040.stdout:621.out 2023-12-17T11:54:29.837 INFO:teuthology.orchestra.run.smithi040.stdout:622 2023-12-17T11:54:29.837 INFO:teuthology.orchestra.run.smithi040.stdout:622.out 2023-12-17T11:54:29.838 INFO:teuthology.orchestra.run.smithi040.stdout:623 2023-12-17T11:54:29.838 INFO:teuthology.orchestra.run.smithi040.stdout:623.out 2023-12-17T11:54:29.838 INFO:teuthology.orchestra.run.smithi040.stdout:624 2023-12-17T11:54:29.838 INFO:teuthology.orchestra.run.smithi040.stdout:624.out 2023-12-17T11:54:29.838 INFO:teuthology.orchestra.run.smithi040.stdout:625 2023-12-17T11:54:29.838 INFO:teuthology.orchestra.run.smithi040.stdout:625.out 2023-12-17T11:54:29.838 INFO:teuthology.orchestra.run.smithi040.stdout:626 2023-12-17T11:54:29.838 INFO:teuthology.orchestra.run.smithi040.stdout:626.out 2023-12-17T11:54:29.838 INFO:teuthology.orchestra.run.smithi040.stdout:627 2023-12-17T11:54:29.838 INFO:teuthology.orchestra.run.smithi040.stdout:627.out 2023-12-17T11:54:29.838 INFO:teuthology.orchestra.run.smithi040.stdout:628 2023-12-17T11:54:29.838 INFO:teuthology.orchestra.run.smithi040.stdout:628.out 2023-12-17T11:54:29.838 INFO:teuthology.orchestra.run.smithi040.stdout:629 2023-12-17T11:54:29.838 INFO:teuthology.orchestra.run.smithi040.stdout:629.out 2023-12-17T11:54:29.838 INFO:teuthology.orchestra.run.smithi040.stdout:630 2023-12-17T11:54:29.839 INFO:teuthology.orchestra.run.smithi040.stdout:630.out 2023-12-17T11:54:29.839 INFO:teuthology.orchestra.run.smithi040.stdout:631 2023-12-17T11:54:29.839 INFO:teuthology.orchestra.run.smithi040.stdout:631.out 2023-12-17T11:54:29.839 INFO:teuthology.orchestra.run.smithi040.stdout:632 2023-12-17T11:54:29.839 INFO:teuthology.orchestra.run.smithi040.stdout:632.out 2023-12-17T11:54:29.839 INFO:teuthology.orchestra.run.smithi040.stdout:633 2023-12-17T11:54:29.839 INFO:teuthology.orchestra.run.smithi040.stdout:633.out 2023-12-17T11:54:29.839 INFO:teuthology.orchestra.run.smithi040.stdout:634 2023-12-17T11:54:29.839 INFO:teuthology.orchestra.run.smithi040.stdout:634.out 2023-12-17T11:54:29.839 INFO:teuthology.orchestra.run.smithi040.stdout:635 2023-12-17T11:54:29.839 INFO:teuthology.orchestra.run.smithi040.stdout:635.out 2023-12-17T11:54:29.839 INFO:teuthology.orchestra.run.smithi040.stdout:636 2023-12-17T11:54:29.839 INFO:teuthology.orchestra.run.smithi040.stdout:636.out 2023-12-17T11:54:29.839 INFO:teuthology.orchestra.run.smithi040.stdout:637 2023-12-17T11:54:29.840 INFO:teuthology.orchestra.run.smithi040.stdout:637.out 2023-12-17T11:54:29.840 INFO:teuthology.orchestra.run.smithi040.stdout:638 2023-12-17T11:54:29.840 INFO:teuthology.orchestra.run.smithi040.stdout:638.out 2023-12-17T11:54:29.840 INFO:teuthology.orchestra.run.smithi040.stdout:639 2023-12-17T11:54:29.840 INFO:teuthology.orchestra.run.smithi040.stdout:639.out 2023-12-17T11:54:29.840 INFO:teuthology.orchestra.run.smithi040.stdout:640 2023-12-17T11:54:29.840 INFO:teuthology.orchestra.run.smithi040.stdout:640.out 2023-12-17T11:54:29.840 INFO:teuthology.orchestra.run.smithi040.stdout:641 2023-12-17T11:54:29.840 INFO:teuthology.orchestra.run.smithi040.stdout:641.out 2023-12-17T11:54:29.840 INFO:teuthology.orchestra.run.smithi040.stdout:642 2023-12-17T11:54:29.840 INFO:teuthology.orchestra.run.smithi040.stdout:642.out 2023-12-17T11:54:29.840 INFO:teuthology.orchestra.run.smithi040.stdout:643 2023-12-17T11:54:29.840 INFO:teuthology.orchestra.run.smithi040.stdout:643.out 2023-12-17T11:54:29.840 INFO:teuthology.orchestra.run.smithi040.stdout:644 2023-12-17T11:54:29.840 INFO:teuthology.orchestra.run.smithi040.stdout:644.out 2023-12-17T11:54:29.841 INFO:teuthology.orchestra.run.smithi040.stdout:645 2023-12-17T11:54:29.841 INFO:teuthology.orchestra.run.smithi040.stdout:645.out 2023-12-17T11:54:29.841 INFO:teuthology.orchestra.run.smithi040.stdout:646 2023-12-17T11:54:29.841 INFO:teuthology.orchestra.run.smithi040.stdout:646.out 2023-12-17T11:54:29.841 INFO:teuthology.orchestra.run.smithi040.stdout:647 2023-12-17T11:54:29.841 INFO:teuthology.orchestra.run.smithi040.stdout:647.out 2023-12-17T11:54:29.841 INFO:teuthology.orchestra.run.smithi040.stdout:648 2023-12-17T11:54:29.841 INFO:teuthology.orchestra.run.smithi040.stdout:648.out 2023-12-17T11:54:29.841 INFO:teuthology.orchestra.run.smithi040.stdout:649 2023-12-17T11:54:29.841 INFO:teuthology.orchestra.run.smithi040.stdout:649.out 2023-12-17T11:54:29.841 INFO:teuthology.orchestra.run.smithi040.stdout:650 2023-12-17T11:54:29.841 INFO:teuthology.orchestra.run.smithi040.stdout:650.out 2023-12-17T11:54:29.841 INFO:teuthology.orchestra.run.smithi040.stdout:651 2023-12-17T11:54:29.841 INFO:teuthology.orchestra.run.smithi040.stdout:651.out 2023-12-17T11:54:29.841 INFO:teuthology.orchestra.run.smithi040.stdout:652 2023-12-17T11:54:29.842 INFO:teuthology.orchestra.run.smithi040.stdout:652.out 2023-12-17T11:54:29.842 INFO:teuthology.orchestra.run.smithi040.stdout:653 2023-12-17T11:54:29.842 INFO:teuthology.orchestra.run.smithi040.stdout:653.out 2023-12-17T11:54:29.842 INFO:teuthology.orchestra.run.smithi040.stdout:654 2023-12-17T11:54:29.842 INFO:teuthology.orchestra.run.smithi040.stdout:654.out 2023-12-17T11:54:29.842 INFO:teuthology.orchestra.run.smithi040.stdout:655 2023-12-17T11:54:29.842 INFO:teuthology.orchestra.run.smithi040.stdout:655.out 2023-12-17T11:54:29.842 INFO:teuthology.orchestra.run.smithi040.stdout:656 2023-12-17T11:54:29.842 INFO:teuthology.orchestra.run.smithi040.stdout:656.out 2023-12-17T11:54:29.842 INFO:teuthology.orchestra.run.smithi040.stdout:657 2023-12-17T11:54:29.842 INFO:teuthology.orchestra.run.smithi040.stdout:657.out 2023-12-17T11:54:29.842 INFO:teuthology.orchestra.run.smithi040.stdout:658 2023-12-17T11:54:29.842 INFO:teuthology.orchestra.run.smithi040.stdout:658.out 2023-12-17T11:54:29.842 INFO:teuthology.orchestra.run.smithi040.stdout:659 2023-12-17T11:54:29.843 INFO:teuthology.orchestra.run.smithi040.stdout:659.out 2023-12-17T11:54:29.843 INFO:teuthology.orchestra.run.smithi040.stdout:660 2023-12-17T11:54:29.843 INFO:teuthology.orchestra.run.smithi040.stdout:660.out 2023-12-17T11:54:29.843 INFO:teuthology.orchestra.run.smithi040.stdout:661 2023-12-17T11:54:29.843 INFO:teuthology.orchestra.run.smithi040.stdout:661.out 2023-12-17T11:54:29.843 INFO:teuthology.orchestra.run.smithi040.stdout:662 2023-12-17T11:54:29.843 INFO:teuthology.orchestra.run.smithi040.stdout:662.out 2023-12-17T11:54:29.843 INFO:teuthology.orchestra.run.smithi040.stdout:663 2023-12-17T11:54:29.843 INFO:teuthology.orchestra.run.smithi040.stdout:663.out 2023-12-17T11:54:29.843 INFO:teuthology.orchestra.run.smithi040.stdout:664 2023-12-17T11:54:29.843 INFO:teuthology.orchestra.run.smithi040.stdout:664.out 2023-12-17T11:54:29.844 INFO:teuthology.orchestra.run.smithi040.stdout:665 2023-12-17T11:54:29.844 INFO:teuthology.orchestra.run.smithi040.stdout:665.out 2023-12-17T11:54:29.844 INFO:teuthology.orchestra.run.smithi040.stdout:666 2023-12-17T11:54:29.844 INFO:teuthology.orchestra.run.smithi040.stdout:666.out 2023-12-17T11:54:29.844 INFO:teuthology.orchestra.run.smithi040.stdout:667 2023-12-17T11:54:29.844 INFO:teuthology.orchestra.run.smithi040.stdout:667.out 2023-12-17T11:54:29.844 INFO:teuthology.orchestra.run.smithi040.stdout:668 2023-12-17T11:54:29.844 INFO:teuthology.orchestra.run.smithi040.stdout:668.out 2023-12-17T11:54:29.845 INFO:teuthology.orchestra.run.smithi040.stdout:669 2023-12-17T11:54:29.845 INFO:teuthology.orchestra.run.smithi040.stdout:669.out 2023-12-17T11:54:29.845 INFO:teuthology.orchestra.run.smithi040.stdout:670 2023-12-17T11:54:29.845 INFO:teuthology.orchestra.run.smithi040.stdout:670.out 2023-12-17T11:54:29.845 INFO:teuthology.orchestra.run.smithi040.stdout:671 2023-12-17T11:54:29.845 INFO:teuthology.orchestra.run.smithi040.stdout:671.out 2023-12-17T11:54:29.845 INFO:teuthology.orchestra.run.smithi040.stdout:672 2023-12-17T11:54:29.845 INFO:teuthology.orchestra.run.smithi040.stdout:672.out 2023-12-17T11:54:29.845 INFO:teuthology.orchestra.run.smithi040.stdout:673 2023-12-17T11:54:29.845 INFO:teuthology.orchestra.run.smithi040.stdout:673.out 2023-12-17T11:54:29.845 INFO:teuthology.orchestra.run.smithi040.stdout:674 2023-12-17T11:54:29.845 INFO:teuthology.orchestra.run.smithi040.stdout:674.out 2023-12-17T11:54:29.845 INFO:teuthology.orchestra.run.smithi040.stdout:675 2023-12-17T11:54:29.845 INFO:teuthology.orchestra.run.smithi040.stdout:675.out 2023-12-17T11:54:29.846 INFO:teuthology.orchestra.run.smithi040.stdout:676 2023-12-17T11:54:29.846 INFO:teuthology.orchestra.run.smithi040.stdout:676.out 2023-12-17T11:54:29.846 INFO:teuthology.orchestra.run.smithi040.stdout:677 2023-12-17T11:54:29.846 INFO:teuthology.orchestra.run.smithi040.stdout:677.out 2023-12-17T11:54:29.846 INFO:teuthology.orchestra.run.smithi040.stdout:678 2023-12-17T11:54:29.846 INFO:teuthology.orchestra.run.smithi040.stdout:678.out 2023-12-17T11:54:29.846 INFO:teuthology.orchestra.run.smithi040.stdout:679 2023-12-17T11:54:29.846 INFO:teuthology.orchestra.run.smithi040.stdout:679.out 2023-12-17T11:54:29.846 INFO:teuthology.orchestra.run.smithi040.stdout:680 2023-12-17T11:54:29.846 INFO:teuthology.orchestra.run.smithi040.stdout:680.out 2023-12-17T11:54:29.846 INFO:teuthology.orchestra.run.smithi040.stdout:681 2023-12-17T11:54:29.846 INFO:teuthology.orchestra.run.smithi040.stdout:681.out 2023-12-17T11:54:29.846 INFO:teuthology.orchestra.run.smithi040.stdout:682 2023-12-17T11:54:29.846 INFO:teuthology.orchestra.run.smithi040.stdout:682.out 2023-12-17T11:54:29.846 INFO:teuthology.orchestra.run.smithi040.stdout:683 2023-12-17T11:54:29.847 INFO:teuthology.orchestra.run.smithi040.stdout:683.out 2023-12-17T11:54:29.847 INFO:teuthology.orchestra.run.smithi040.stdout:684 2023-12-17T11:54:29.847 INFO:teuthology.orchestra.run.smithi040.stdout:684.out 2023-12-17T11:54:29.847 INFO:teuthology.orchestra.run.smithi040.stdout:685 2023-12-17T11:54:29.847 INFO:teuthology.orchestra.run.smithi040.stdout:685.out 2023-12-17T11:54:29.847 INFO:teuthology.orchestra.run.smithi040.stdout:686 2023-12-17T11:54:29.847 INFO:teuthology.orchestra.run.smithi040.stdout:686.out 2023-12-17T11:54:29.847 INFO:teuthology.orchestra.run.smithi040.stdout:687 2023-12-17T11:54:29.847 INFO:teuthology.orchestra.run.smithi040.stdout:687.out 2023-12-17T11:54:29.847 INFO:teuthology.orchestra.run.smithi040.stdout:688 2023-12-17T11:54:29.847 INFO:teuthology.orchestra.run.smithi040.stdout:688.out 2023-12-17T11:54:29.847 INFO:teuthology.orchestra.run.smithi040.stdout:689 2023-12-17T11:54:29.847 INFO:teuthology.orchestra.run.smithi040.stdout:689.out 2023-12-17T11:54:29.847 INFO:teuthology.orchestra.run.smithi040.stdout:690 2023-12-17T11:54:29.848 INFO:teuthology.orchestra.run.smithi040.stdout:690.out 2023-12-17T11:54:29.848 INFO:teuthology.orchestra.run.smithi040.stdout:691 2023-12-17T11:54:29.848 INFO:teuthology.orchestra.run.smithi040.stdout:691.out 2023-12-17T11:54:29.848 INFO:teuthology.orchestra.run.smithi040.stdout:692 2023-12-17T11:54:29.848 INFO:teuthology.orchestra.run.smithi040.stdout:692.out 2023-12-17T11:54:29.848 INFO:teuthology.orchestra.run.smithi040.stdout:693 2023-12-17T11:54:29.848 INFO:teuthology.orchestra.run.smithi040.stdout:693.out 2023-12-17T11:54:29.848 INFO:teuthology.orchestra.run.smithi040.stdout:694 2023-12-17T11:54:29.848 INFO:teuthology.orchestra.run.smithi040.stdout:694.out 2023-12-17T11:54:29.848 INFO:teuthology.orchestra.run.smithi040.stdout:695 2023-12-17T11:54:29.848 INFO:teuthology.orchestra.run.smithi040.stdout:695.out 2023-12-17T11:54:29.848 INFO:teuthology.orchestra.run.smithi040.stdout:696 2023-12-17T11:54:29.848 INFO:teuthology.orchestra.run.smithi040.stdout:696.out 2023-12-17T11:54:29.848 INFO:teuthology.orchestra.run.smithi040.stdout:697 2023-12-17T11:54:29.848 INFO:teuthology.orchestra.run.smithi040.stdout:697.out 2023-12-17T11:54:29.848 INFO:teuthology.orchestra.run.smithi040.stdout:698 2023-12-17T11:54:29.849 INFO:teuthology.orchestra.run.smithi040.stdout:698.out 2023-12-17T11:54:29.849 INFO:teuthology.orchestra.run.smithi040.stdout:699 2023-12-17T11:54:29.849 INFO:teuthology.orchestra.run.smithi040.stdout:699.out 2023-12-17T11:54:29.849 INFO:teuthology.orchestra.run.smithi040.stdout:700 2023-12-17T11:54:29.849 INFO:teuthology.orchestra.run.smithi040.stdout:700.out 2023-12-17T11:54:29.849 INFO:teuthology.orchestra.run.smithi040.stdout:701 2023-12-17T11:54:29.849 INFO:teuthology.orchestra.run.smithi040.stdout:701.out 2023-12-17T11:54:29.849 INFO:teuthology.orchestra.run.smithi040.stdout:702 2023-12-17T11:54:29.849 INFO:teuthology.orchestra.run.smithi040.stdout:702.out 2023-12-17T11:54:29.849 INFO:teuthology.orchestra.run.smithi040.stdout:703 2023-12-17T11:54:29.849 INFO:teuthology.orchestra.run.smithi040.stdout:703.out 2023-12-17T11:54:29.849 INFO:teuthology.orchestra.run.smithi040.stdout:704 2023-12-17T11:54:29.849 INFO:teuthology.orchestra.run.smithi040.stdout:704.out 2023-12-17T11:54:29.849 INFO:teuthology.orchestra.run.smithi040.stdout:705 2023-12-17T11:54:29.850 INFO:teuthology.orchestra.run.smithi040.stdout:705.out 2023-12-17T11:54:29.850 INFO:teuthology.orchestra.run.smithi040.stdout:706 2023-12-17T11:54:29.850 INFO:teuthology.orchestra.run.smithi040.stdout:706.out 2023-12-17T11:54:29.850 INFO:teuthology.orchestra.run.smithi040.stdout:707 2023-12-17T11:54:29.850 INFO:teuthology.orchestra.run.smithi040.stdout:707.out 2023-12-17T11:54:29.850 INFO:teuthology.orchestra.run.smithi040.stdout:708 2023-12-17T11:54:29.850 INFO:teuthology.orchestra.run.smithi040.stdout:708.out 2023-12-17T11:54:29.850 INFO:teuthology.orchestra.run.smithi040.stdout:709 2023-12-17T11:54:29.850 INFO:teuthology.orchestra.run.smithi040.stdout:709.out 2023-12-17T11:54:29.850 INFO:teuthology.orchestra.run.smithi040.stdout:710 2023-12-17T11:54:29.850 INFO:teuthology.orchestra.run.smithi040.stdout:710.out 2023-12-17T11:54:29.850 INFO:teuthology.orchestra.run.smithi040.stdout:711 2023-12-17T11:54:29.850 INFO:teuthology.orchestra.run.smithi040.stdout:711.out 2023-12-17T11:54:29.850 INFO:teuthology.orchestra.run.smithi040.stdout:712 2023-12-17T11:54:29.850 INFO:teuthology.orchestra.run.smithi040.stdout:712.out 2023-12-17T11:54:29.850 INFO:teuthology.orchestra.run.smithi040.stdout:713 2023-12-17T11:54:29.851 INFO:teuthology.orchestra.run.smithi040.stdout:713.out 2023-12-17T11:54:29.851 INFO:teuthology.orchestra.run.smithi040.stdout:714 2023-12-17T11:54:29.851 INFO:teuthology.orchestra.run.smithi040.stdout:714.out 2023-12-17T11:54:29.851 INFO:teuthology.orchestra.run.smithi040.stdout:715 2023-12-17T11:54:29.851 INFO:teuthology.orchestra.run.smithi040.stdout:715.out 2023-12-17T11:54:29.851 INFO:teuthology.orchestra.run.smithi040.stdout:716 2023-12-17T11:54:29.851 INFO:teuthology.orchestra.run.smithi040.stdout:716.out 2023-12-17T11:54:29.851 INFO:teuthology.orchestra.run.smithi040.stdout:717 2023-12-17T11:54:29.851 INFO:teuthology.orchestra.run.smithi040.stdout:717.out 2023-12-17T11:54:29.851 INFO:teuthology.orchestra.run.smithi040.stdout:718 2023-12-17T11:54:29.851 INFO:teuthology.orchestra.run.smithi040.stdout:718.out 2023-12-17T11:54:29.851 INFO:teuthology.orchestra.run.smithi040.stdout:719 2023-12-17T11:54:29.851 INFO:teuthology.orchestra.run.smithi040.stdout:719.out 2023-12-17T11:54:29.851 INFO:teuthology.orchestra.run.smithi040.stdout:720 2023-12-17T11:54:29.852 INFO:teuthology.orchestra.run.smithi040.stdout:720.out 2023-12-17T11:54:29.852 INFO:teuthology.orchestra.run.smithi040.stdout:721 2023-12-17T11:54:29.852 INFO:teuthology.orchestra.run.smithi040.stdout:721.out 2023-12-17T11:54:29.852 INFO:teuthology.orchestra.run.smithi040.stdout:722 2023-12-17T11:54:29.852 INFO:teuthology.orchestra.run.smithi040.stdout:722.out 2023-12-17T11:54:29.852 INFO:teuthology.orchestra.run.smithi040.stdout:723 2023-12-17T11:54:29.852 INFO:teuthology.orchestra.run.smithi040.stdout:723.out 2023-12-17T11:54:29.852 INFO:teuthology.orchestra.run.smithi040.stdout:724 2023-12-17T11:54:29.852 INFO:teuthology.orchestra.run.smithi040.stdout:724.out 2023-12-17T11:54:29.852 INFO:teuthology.orchestra.run.smithi040.stdout:725 2023-12-17T11:54:29.852 INFO:teuthology.orchestra.run.smithi040.stdout:725.out 2023-12-17T11:54:29.852 INFO:teuthology.orchestra.run.smithi040.stdout:726 2023-12-17T11:54:29.852 INFO:teuthology.orchestra.run.smithi040.stdout:726.out 2023-12-17T11:54:29.852 INFO:teuthology.orchestra.run.smithi040.stdout:727 2023-12-17T11:54:29.852 INFO:teuthology.orchestra.run.smithi040.stdout:727.out 2023-12-17T11:54:29.852 INFO:teuthology.orchestra.run.smithi040.stdout:728 2023-12-17T11:54:29.853 INFO:teuthology.orchestra.run.smithi040.stdout:728.out 2023-12-17T11:54:29.853 INFO:teuthology.orchestra.run.smithi040.stdout:729 2023-12-17T11:54:29.853 INFO:teuthology.orchestra.run.smithi040.stdout:729.out 2023-12-17T11:54:29.853 INFO:teuthology.orchestra.run.smithi040.stdout:730 2023-12-17T11:54:29.853 INFO:teuthology.orchestra.run.smithi040.stdout:730.out 2023-12-17T11:54:29.853 INFO:teuthology.orchestra.run.smithi040.stdout:731 2023-12-17T11:54:29.853 INFO:teuthology.orchestra.run.smithi040.stdout:731.out 2023-12-17T11:54:29.853 INFO:teuthology.orchestra.run.smithi040.stdout:732 2023-12-17T11:54:29.853 INFO:teuthology.orchestra.run.smithi040.stdout:732.out 2023-12-17T11:54:29.853 INFO:teuthology.orchestra.run.smithi040.stdout:733 2023-12-17T11:54:29.853 INFO:teuthology.orchestra.run.smithi040.stdout:733.out 2023-12-17T11:54:29.853 INFO:teuthology.orchestra.run.smithi040.stdout:group.list 2023-12-17T11:54:29.853 INFO:teuthology.orchestra.run.smithi040.stdout:Makefile 2023-12-17T11:54:29.855 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/001) 2023-12-17T11:54:30.528 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T11:54:30.542 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T11:54:30.543 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T11:54:30.547 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T11:54:30.547 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T11:54:39.083 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T11:54:39.091 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T11:54:43.040 INFO:teuthology.orchestra.run.smithi040.stdout:generic/001 13s 2023-12-17T11:54:43.057 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/001 2023-12-17T11:54:43.057 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T11:54:43.066 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T11:54:43.394 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T11:54:43.394 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/002) 2023-12-17T11:54:43.996 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T11:54:44.008 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T11:54:44.009 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T11:54:44.011 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T11:54:44.011 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T11:54:45.426 INFO:teuthology.orchestra.run.smithi040.stdout:generic/002 1s 2023-12-17T11:54:45.445 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/002 2023-12-17T11:54:45.445 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T11:54:45.455 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T11:54:45.521 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T11:54:45.521 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/003) 2023-12-17T11:54:46.089 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T11:54:46.104 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T11:54:46.105 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T11:54:46.109 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T11:54:46.109 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T11:54:46.830 INFO:teuthology.orchestra.run.smithi040.stdout:generic/003 [not run] atime not maintained by ceph 2023-12-17T11:54:46.844 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/003 2023-12-17T11:54:46.844 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/003 2023-12-17T11:54:46.844 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T11:54:46.854 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T11:54:46.894 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T11:54:46.894 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/004) 2023-12-17T11:54:47.538 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T11:54:47.553 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T11:54:47.555 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T11:54:47.559 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T11:54:47.559 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T11:54:48.279 INFO:teuthology.orchestra.run.smithi040.stdout:generic/004 [not run] O_TMPFILE is not supported 2023-12-17T11:54:48.298 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/004 2023-12-17T11:54:48.298 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/004 2023-12-17T11:54:48.298 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T11:54:48.310 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T11:54:48.352 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T11:54:48.352 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/005) 2023-12-17T11:54:49.005 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T11:54:49.020 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T11:54:49.022 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T11:54:49.026 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T11:54:49.026 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T11:54:50.320 INFO:teuthology.orchestra.run.smithi040.stdout:generic/005 1s 2023-12-17T11:54:50.338 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/005 2023-12-17T11:54:50.339 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T11:54:50.347 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T11:54:50.412 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T11:54:50.413 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/006) 2023-12-17T11:54:50.978 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T11:54:50.992 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T11:54:50.993 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T11:54:50.996 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T11:54:50.997 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T11:55:09.237 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T11:55:09.248 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T11:55:30.134 INFO:teuthology.orchestra.run.smithi040.stdout:generic/006 39s 2023-12-17T11:55:30.149 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/006 2023-12-17T11:55:30.149 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T11:55:30.157 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T11:55:30.509 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T11:55:30.510 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/007) 2023-12-17T11:55:31.064 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T11:55:31.077 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T11:55:31.078 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T11:55:31.081 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T11:55:31.082 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T11:55:39.408 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T11:55:39.420 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T11:56:09.558 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T11:56:09.569 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T11:56:39.687 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T11:56:39.700 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T11:56:58.055 INFO:teuthology.orchestra.run.smithi040.stdout:generic/007 87s 2023-12-17T11:56:58.074 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/007 2023-12-17T11:56:58.075 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T11:56:58.084 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T11:56:58.154 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T11:56:58.155 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/008) 2023-12-17T11:56:58.787 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T11:56:58.799 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T11:56:58.801 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T11:56:58.804 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T11:56:58.804 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T11:56:59.656 INFO:teuthology.orchestra.run.smithi040.stdout:generic/008 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2023-12-17T11:56:59.672 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/008 2023-12-17T11:56:59.672 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/008 2023-12-17T11:56:59.672 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T11:56:59.684 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T11:56:59.745 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T11:56:59.746 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/009) 2023-12-17T11:57:00.411 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T11:57:00.426 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T11:57:00.428 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T11:57:00.431 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T11:57:00.431 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T11:57:01.241 INFO:teuthology.orchestra.run.smithi040.stdout:generic/009 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2023-12-17T11:57:01.257 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/009 2023-12-17T11:57:01.258 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/009 2023-12-17T11:57:01.258 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T11:57:01.272 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T11:57:01.331 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T11:57:01.331 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/010) 2023-12-17T11:57:01.965 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T11:57:01.979 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T11:57:01.980 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T11:57:01.983 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T11:57:01.984 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T11:57:03.302 INFO:teuthology.orchestra.run.smithi040.stdout:generic/010 1s 2023-12-17T11:57:03.319 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/010 2023-12-17T11:57:03.319 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T11:57:03.330 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T11:57:03.418 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T11:57:03.418 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/011) 2023-12-17T11:57:03.956 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T11:57:03.969 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T11:57:03.971 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T11:57:03.975 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T11:57:03.975 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T11:57:10.745 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T11:57:10.755 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T11:57:40.908 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T11:57:40.918 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T11:57:50.797 INFO:teuthology.orchestra.run.smithi040.stdout:generic/011 46s 2023-12-17T11:57:50.813 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/011 2023-12-17T11:57:50.813 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T11:57:50.823 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T11:57:50.907 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T11:57:50.908 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/012) 2023-12-17T11:57:51.469 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T11:57:51.480 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T11:57:51.481 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T11:57:51.484 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T11:57:51.484 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T11:57:52.480 INFO:teuthology.orchestra.run.smithi040.stdout:generic/012 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-12-17T11:57:52.495 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/012 2023-12-17T11:57:52.495 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/012 2023-12-17T11:57:52.495 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T11:57:52.506 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T11:57:52.596 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T11:57:52.597 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/013) 2023-12-17T11:57:53.157 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T11:57:53.173 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T11:57:53.175 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T11:57:53.178 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T11:57:53.178 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T11:58:11.081 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T11:58:11.088 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T11:58:41.692 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T11:58:41.698 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T11:58:51.553 INFO:teuthology.orchestra.run.smithi040.stdout:generic/013 58s 2023-12-17T11:58:51.876 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/013 2023-12-17T11:58:51.876 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T11:58:51.886 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T11:58:51.945 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T11:58:51.946 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/014) 2023-12-17T11:58:52.536 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T11:58:52.551 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T11:58:52.552 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T11:58:52.557 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T11:58:52.557 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T11:59:11.843 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T11:59:11.850 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T11:59:42.000 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T11:59:42.008 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T12:00:12.158 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T12:00:12.164 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T12:00:42.327 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T12:00:42.336 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T12:01:12.483 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T12:01:12.490 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T12:01:42.639 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T12:01:42.648 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T12:02:12.794 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T12:02:12.801 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T12:02:42.955 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T12:02:42.968 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T12:03:13.119 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T12:03:13.124 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T12:03:23.903 INFO:teuthology.orchestra.run.smithi040.stdout:generic/014 271s 2023-12-17T12:03:23.924 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/014 2023-12-17T12:03:23.924 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T12:03:23.934 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T12:03:23.984 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T12:03:23.984 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/015) 2023-12-17T12:03:24.604 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T12:03:24.617 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T12:03:24.618 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T12:03:24.621 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T12:03:24.621 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T12:03:25.253 INFO:teuthology.orchestra.run.smithi040.stdout:generic/015 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-12-17T12:03:25.266 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/015 2023-12-17T12:03:25.266 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/015 2023-12-17T12:03:25.266 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T12:03:25.275 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T12:03:25.321 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T12:03:25.321 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/016) 2023-12-17T12:03:25.938 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T12:03:25.953 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T12:03:25.954 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T12:03:25.958 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T12:03:25.959 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T12:03:26.849 INFO:teuthology.orchestra.run.smithi040.stdout:generic/016 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-12-17T12:03:26.860 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/016 2023-12-17T12:03:26.860 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/016 2023-12-17T12:03:26.860 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T12:03:26.869 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T12:03:26.947 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T12:03:26.947 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/017) 2023-12-17T12:03:27.690 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T12:03:27.710 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T12:03:27.711 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T12:03:27.715 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T12:03:27.715 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T12:03:28.391 INFO:teuthology.orchestra.run.smithi040.stdout:generic/017 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-12-17T12:03:28.405 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/017 2023-12-17T12:03:28.405 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/017 2023-12-17T12:03:28.405 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T12:03:28.413 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T12:03:28.454 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T12:03:28.454 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/018) 2023-12-17T12:03:29.081 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T12:03:29.097 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T12:03:29.099 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T12:03:29.102 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T12:03:29.103 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T12:03:29.970 INFO:teuthology.orchestra.run.smithi040.stdout:generic/018 [not run] defragmentation not supported for fstype "ceph" 2023-12-17T12:03:29.997 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/018 2023-12-17T12:03:29.998 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/018 2023-12-17T12:03:29.998 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T12:03:30.006 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T12:03:30.045 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T12:03:30.046 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/019) 2023-12-17T12:03:30.664 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T12:03:30.679 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T12:03:30.681 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T12:03:30.686 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T12:03:30.686 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T12:03:31.354 INFO:teuthology.orchestra.run.smithi040.stdout:generic/019 [not run] require 172.21.15.40:6789:/scratch to be valid block disk 2023-12-17T12:03:31.373 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/019 2023-12-17T12:03:31.373 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/019 2023-12-17T12:03:31.373 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T12:03:31.392 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T12:03:31.432 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T12:03:31.433 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/020) 2023-12-17T12:03:32.043 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T12:03:32.058 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T12:03:32.060 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T12:03:32.063 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T12:03:32.063 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T12:03:40.741 INFO:teuthology.orchestra.run.smithi040.stdout:generic/020 8s 2023-12-17T12:03:40.764 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/020 2023-12-17T12:03:40.764 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T12:03:40.775 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T12:03:40.884 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T12:03:40.884 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/021) 2023-12-17T12:03:41.604 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T12:03:41.619 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T12:03:41.620 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T12:03:41.624 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T12:03:41.624 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T12:03:42.529 INFO:teuthology.orchestra.run.smithi040.stdout:generic/021 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-12-17T12:03:42.544 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/021 2023-12-17T12:03:42.544 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/021 2023-12-17T12:03:42.544 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T12:03:42.553 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T12:03:42.636 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T12:03:42.637 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/022) 2023-12-17T12:03:43.385 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T12:03:43.399 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T12:03:43.401 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T12:03:43.406 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T12:03:43.406 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T12:03:44.198 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T12:03:44.204 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T12:03:44.238 INFO:teuthology.orchestra.run.smithi040.stdout:generic/022 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-12-17T12:03:44.253 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/022 2023-12-17T12:03:44.253 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/022 2023-12-17T12:03:44.255 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T12:03:44.263 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T12:03:44.350 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T12:03:44.350 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/023) 2023-12-17T12:03:45.102 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T12:03:45.113 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T12:03:45.114 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T12:03:45.116 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T12:03:45.116 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T12:03:47.467 INFO:teuthology.orchestra.run.smithi040.stdout:generic/023 2s 2023-12-17T12:03:47.485 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/023 2023-12-17T12:03:47.485 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T12:03:47.496 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T12:03:47.649 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T12:03:47.650 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/024) 2023-12-17T12:03:48.372 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T12:03:48.386 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T12:03:48.388 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T12:03:48.392 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T12:03:48.392 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T12:03:49.091 INFO:teuthology.orchestra.run.smithi040.stdout:generic/024 [not run] kernel doesn't support renameat2 syscall 2023-12-17T12:03:49.103 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/024 2023-12-17T12:03:49.103 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/024 2023-12-17T12:03:49.103 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T12:03:49.113 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T12:03:49.213 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T12:03:49.213 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/025) 2023-12-17T12:03:49.932 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T12:03:49.945 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T12:03:49.947 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T12:03:49.950 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T12:03:49.950 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T12:03:50.647 INFO:teuthology.orchestra.run.smithi040.stdout:generic/025 [not run] kernel doesn't support renameat2 syscall 2023-12-17T12:03:50.664 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/025 2023-12-17T12:03:50.664 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/025 2023-12-17T12:03:50.664 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T12:03:50.675 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T12:03:50.760 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T12:03:50.760 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/026) 2023-12-17T12:03:51.509 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T12:03:51.524 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T12:03:51.525 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T12:03:51.529 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T12:03:51.529 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T12:03:52.257 INFO:teuthology.orchestra.run.smithi040.stdout:generic/026 [not run] ceph does not define maximum ACL count 2023-12-17T12:03:52.272 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/026 2023-12-17T12:03:52.272 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/026 2023-12-17T12:03:52.272 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T12:03:52.283 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T12:03:52.329 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T12:03:52.329 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/027) 2023-12-17T12:03:52.978 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T12:03:52.994 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T12:03:53.010 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T12:03:53.011 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T12:03:53.011 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T12:03:53.646 INFO:teuthology.orchestra.run.smithi040.stdout:generic/027 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-12-17T12:03:53.660 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/027 2023-12-17T12:03:53.660 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/027 2023-12-17T12:03:53.661 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T12:03:53.670 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T12:03:53.707 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T12:03:53.707 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/028) 2023-12-17T12:03:54.326 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T12:03:54.339 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T12:03:54.341 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T12:03:54.345 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T12:03:54.345 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T12:04:00.051 INFO:teuthology.orchestra.run.smithi040.stdout:generic/028 6s 2023-12-17T12:04:00.071 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/028 2023-12-17T12:04:00.071 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T12:04:00.080 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T12:04:00.120 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T12:04:00.120 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/029) 2023-12-17T12:04:00.738 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T12:04:00.750 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T12:04:00.752 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T12:04:00.756 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T12:04:00.756 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T12:04:05.404 INFO:teuthology.orchestra.run.smithi040.stdout:generic/029 5s 2023-12-17T12:04:05.426 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/029 2023-12-17T12:04:05.426 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T12:04:05.434 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T12:04:05.466 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T12:04:05.466 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/030) 2023-12-17T12:04:06.089 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T12:04:06.104 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T12:04:06.108 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T12:04:06.117 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T12:04:06.117 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T12:04:08.561 INFO:teuthology.orchestra.run.smithi040.stdout:generic/030 2s 2023-12-17T12:04:08.580 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/030 2023-12-17T12:04:08.580 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T12:04:08.589 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T12:04:08.620 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T12:04:08.620 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/031) 2023-12-17T12:04:09.239 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T12:04:09.255 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T12:04:09.258 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T12:04:09.261 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T12:04:09.261 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T12:04:10.096 INFO:teuthology.orchestra.run.smithi040.stdout:generic/031 [not run] xfs_io fcollapse failed (old kernel/wrong fs?) 2023-12-17T12:04:10.107 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/031 2023-12-17T12:04:10.107 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/031 2023-12-17T12:04:10.107 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T12:04:10.120 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T12:04:10.176 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T12:04:10.176 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/032) 2023-12-17T12:04:10.806 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T12:04:10.823 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T12:04:10.824 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T12:04:10.828 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T12:04:10.828 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T12:04:11.491 INFO:teuthology.orchestra.run.smithi040.stdout:generic/032 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-12-17T12:04:11.503 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/032 2023-12-17T12:04:11.503 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/032 2023-12-17T12:04:11.503 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T12:04:11.516 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T12:04:11.554 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T12:04:11.554 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/033) 2023-12-17T12:04:12.224 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T12:04:12.241 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T12:04:12.243 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T12:04:12.247 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T12:04:12.247 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T12:04:13.064 INFO:teuthology.orchestra.run.smithi040.stdout:generic/033 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2023-12-17T12:04:13.079 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/033 2023-12-17T12:04:13.080 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/033 2023-12-17T12:04:13.080 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T12:04:13.088 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T12:04:13.131 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T12:04:13.132 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/034) 2023-12-17T12:04:13.760 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T12:04:13.775 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T12:04:13.777 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T12:04:13.781 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T12:04:13.781 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T12:04:14.474 INFO:teuthology.orchestra.run.smithi040.stdout:generic/034 [not run] require 172.21.15.40:6789:/scratch to be valid block disk 2023-12-17T12:04:14.488 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/034 2023-12-17T12:04:14.488 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/034 2023-12-17T12:04:14.488 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T12:04:14.496 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T12:04:14.537 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T12:04:14.537 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/035) 2023-12-17T12:04:15.175 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T12:04:15.188 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T12:04:15.189 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T12:04:15.192 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T12:04:15.194 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T12:04:15.510 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T12:04:15.516 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T12:04:16.007 INFO:teuthology.orchestra.run.smithi040.stdout:generic/035 0s 2023-12-17T12:04:16.026 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/035 2023-12-17T12:04:16.026 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T12:04:16.036 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T12:04:16.143 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T12:04:16.143 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/036) 2023-12-17T12:04:16.884 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T12:04:16.898 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T12:04:16.901 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T12:04:16.905 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T12:04:16.905 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T12:04:27.732 INFO:teuthology.orchestra.run.smithi040.stdout:generic/036 10s 2023-12-17T12:04:27.752 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/036 2023-12-17T12:04:27.752 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T12:04:27.765 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T12:04:27.833 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T12:04:27.833 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/037) 2023-12-17T12:04:28.619 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T12:04:28.635 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T12:04:28.636 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T12:04:28.643 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T12:04:28.644 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T12:04:42.064 INFO:teuthology.orchestra.run.smithi040.stdout:generic/037 14s 2023-12-17T12:04:42.079 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/037 2023-12-17T12:04:42.079 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T12:04:42.087 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T12:04:42.114 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T12:04:42.114 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/038) 2023-12-17T12:04:42.740 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T12:04:42.754 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T12:04:42.755 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T12:04:42.758 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T12:04:42.758 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T12:04:43.416 INFO:teuthology.orchestra.run.smithi040.stdout:generic/038 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-12-17T12:04:43.429 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/038 2023-12-17T12:04:43.429 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/038 2023-12-17T12:04:43.429 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T12:04:43.440 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T12:04:43.493 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T12:04:43.494 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/039) 2023-12-17T12:04:44.139 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T12:04:44.154 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T12:04:44.155 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T12:04:44.158 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T12:04:44.158 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T12:04:44.872 INFO:teuthology.orchestra.run.smithi040.stdout:generic/039 [not run] require 172.21.15.40:6789:/scratch to be valid block disk 2023-12-17T12:04:44.886 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/039 2023-12-17T12:04:44.887 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/039 2023-12-17T12:04:44.887 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T12:04:44.895 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T12:04:44.934 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T12:04:44.934 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/040) 2023-12-17T12:04:45.570 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T12:04:45.584 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T12:04:45.585 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T12:04:45.588 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T12:04:45.588 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T12:04:45.652 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T12:04:45.657 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T12:04:46.281 INFO:teuthology.orchestra.run.smithi040.stdout:generic/040 [not run] require 172.21.15.40:6789:/scratch to be valid block disk 2023-12-17T12:04:46.291 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/040 2023-12-17T12:04:46.291 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/040 2023-12-17T12:04:46.291 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T12:04:46.300 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T12:04:46.340 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T12:04:46.340 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/041) 2023-12-17T12:04:47.002 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T12:04:47.015 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T12:04:47.017 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T12:04:47.020 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T12:04:47.020 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T12:04:47.701 INFO:teuthology.orchestra.run.smithi040.stdout:generic/041 [not run] require 172.21.15.40:6789:/scratch to be valid block disk 2023-12-17T12:04:47.718 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/041 2023-12-17T12:04:47.718 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/041 2023-12-17T12:04:47.718 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T12:04:47.727 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T12:04:47.773 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T12:04:47.773 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/042) 2023-12-17T12:04:48.407 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T12:04:48.421 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T12:04:48.422 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T12:04:48.425 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T12:04:48.425 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T12:04:49.256 INFO:teuthology.orchestra.run.smithi040.stdout:generic/042 [not run] ceph does not support shutdown 2023-12-17T12:04:49.271 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/042 2023-12-17T12:04:49.271 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/042 2023-12-17T12:04:49.271 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T12:04:49.282 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T12:04:49.324 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T12:04:49.325 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/043) 2023-12-17T12:04:49.968 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T12:04:49.982 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T12:04:49.984 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T12:04:49.987 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T12:04:49.987 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T12:04:50.807 INFO:teuthology.orchestra.run.smithi040.stdout:generic/043 [not run] ceph does not support shutdown 2023-12-17T12:04:50.827 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/043 2023-12-17T12:04:50.828 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/043 2023-12-17T12:04:50.828 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T12:04:50.838 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T12:04:50.870 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T12:04:50.871 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/044) 2023-12-17T12:04:51.490 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T12:04:51.502 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T12:04:51.504 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T12:04:51.507 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T12:04:51.507 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T12:04:52.325 INFO:teuthology.orchestra.run.smithi040.stdout:generic/044 [not run] ceph does not support shutdown 2023-12-17T12:04:52.344 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/044 2023-12-17T12:04:52.345 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/044 2023-12-17T12:04:52.345 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T12:04:52.357 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T12:04:52.393 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T12:04:52.393 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/045) 2023-12-17T12:04:53.047 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T12:04:53.071 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T12:04:53.073 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T12:04:53.077 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T12:04:53.077 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T12:04:53.867 INFO:teuthology.orchestra.run.smithi040.stdout:generic/045 [not run] ceph does not support shutdown 2023-12-17T12:04:53.902 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/045 2023-12-17T12:04:53.902 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/045 2023-12-17T12:04:53.902 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T12:04:53.913 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T12:04:53.958 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T12:04:53.959 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/046) 2023-12-17T12:04:54.604 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T12:04:54.619 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T12:04:54.620 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T12:04:54.623 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T12:04:54.624 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T12:04:55.485 INFO:teuthology.orchestra.run.smithi040.stdout:generic/046 [not run] ceph does not support shutdown 2023-12-17T12:04:55.509 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/046 2023-12-17T12:04:55.509 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/046 2023-12-17T12:04:55.509 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T12:04:55.523 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T12:04:55.564 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T12:04:55.565 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/047) 2023-12-17T12:04:56.208 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T12:04:56.223 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T12:04:56.224 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T12:04:56.228 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T12:04:56.228 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T12:04:57.086 INFO:teuthology.orchestra.run.smithi040.stdout:generic/047 [not run] ceph does not support shutdown 2023-12-17T12:04:57.131 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/047 2023-12-17T12:04:57.131 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/047 2023-12-17T12:04:57.131 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T12:04:57.142 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T12:04:57.180 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T12:04:57.181 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/048) 2023-12-17T12:04:57.799 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T12:04:57.814 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T12:04:57.816 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T12:04:57.819 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T12:04:57.820 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T12:04:58.710 INFO:teuthology.orchestra.run.smithi040.stdout:generic/048 [not run] ceph does not support shutdown 2023-12-17T12:04:58.752 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/048 2023-12-17T12:04:58.752 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/048 2023-12-17T12:04:58.753 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T12:04:58.764 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T12:04:58.802 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T12:04:58.802 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/049) 2023-12-17T12:04:59.440 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T12:04:59.454 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T12:04:59.456 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T12:04:59.459 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T12:04:59.460 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T12:05:00.328 INFO:teuthology.orchestra.run.smithi040.stdout:generic/049 [not run] ceph does not support shutdown 2023-12-17T12:05:00.350 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/049 2023-12-17T12:05:00.350 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/049 2023-12-17T12:05:00.350 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T12:05:00.359 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T12:05:00.402 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T12:05:00.402 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/050) 2023-12-17T12:05:01.044 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T12:05:01.059 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T12:05:01.060 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T12:05:01.063 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T12:05:01.064 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T12:05:01.962 INFO:teuthology.orchestra.run.smithi040.stdout:generic/050 [not run] ceph does not support shutdown 2023-12-17T12:05:01.988 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/050 2023-12-17T12:05:01.988 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/050 2023-12-17T12:05:01.988 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T12:05:01.998 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T12:05:02.037 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T12:05:02.037 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/051) 2023-12-17T12:05:02.694 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T12:05:02.708 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T12:05:02.710 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T12:05:02.713 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T12:05:02.714 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T12:05:03.537 INFO:teuthology.orchestra.run.smithi040.stdout:generic/051 [not run] ceph does not support shutdown 2023-12-17T12:05:03.549 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/051 2023-12-17T12:05:03.549 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/051 2023-12-17T12:05:03.549 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T12:05:03.558 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T12:05:03.594 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T12:05:03.594 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/052) 2023-12-17T12:05:04.231 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T12:05:04.244 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T12:05:04.246 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T12:05:04.250 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T12:05:04.250 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T12:05:05.138 INFO:teuthology.orchestra.run.smithi040.stdout:generic/052 [not run] ceph does not support shutdown 2023-12-17T12:05:05.159 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/052 2023-12-17T12:05:05.160 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/052 2023-12-17T12:05:05.160 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T12:05:05.169 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T12:05:05.204 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T12:05:05.204 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/053) 2023-12-17T12:05:05.842 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T12:05:05.855 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T12:05:05.857 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T12:05:05.860 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T12:05:05.860 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T12:05:07.381 INFO:teuthology.orchestra.run.smithi040.stdout:generic/053 1s 2023-12-17T12:05:07.409 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/053 2023-12-17T12:05:07.409 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T12:05:07.423 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T12:05:07.463 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T12:05:07.463 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/054) 2023-12-17T12:05:08.080 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T12:05:08.095 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T12:05:08.097 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T12:05:08.101 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T12:05:08.101 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T12:05:09.034 INFO:teuthology.orchestra.run.smithi040.stdout:generic/054 [not run] ceph does not support shutdown 2023-12-17T12:05:09.056 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/054 2023-12-17T12:05:09.057 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/054 2023-12-17T12:05:09.057 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T12:05:09.067 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T12:05:09.104 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T12:05:09.104 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/055) 2023-12-17T12:05:09.695 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T12:05:09.711 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T12:05:09.713 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T12:05:09.717 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T12:05:09.717 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T12:05:10.582 INFO:teuthology.orchestra.run.smithi040.stdout:generic/055 [not run] ceph does not support shutdown 2023-12-17T12:05:10.603 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/055 2023-12-17T12:05:10.604 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/055 2023-12-17T12:05:10.604 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T12:05:10.614 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T12:05:10.651 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T12:05:10.652 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/056) 2023-12-17T12:05:11.303 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T12:05:11.317 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T12:05:11.319 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T12:05:11.323 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T12:05:11.323 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T12:05:12.087 INFO:teuthology.orchestra.run.smithi040.stdout:generic/056 [not run] require 172.21.15.40:6789:/scratch to be valid block disk 2023-12-17T12:05:12.103 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/056 2023-12-17T12:05:12.103 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/056 2023-12-17T12:05:12.104 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T12:05:12.117 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T12:05:12.175 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T12:05:12.175 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/057) 2023-12-17T12:05:12.842 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T12:05:12.857 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T12:05:12.858 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T12:05:12.862 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T12:05:12.862 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T12:05:13.615 INFO:teuthology.orchestra.run.smithi040.stdout:generic/057 [not run] require 172.21.15.40:6789:/scratch to be valid block disk 2023-12-17T12:05:13.629 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/057 2023-12-17T12:05:13.629 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/057 2023-12-17T12:05:13.629 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T12:05:13.638 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T12:05:13.690 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T12:05:13.691 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/058) 2023-12-17T12:05:14.346 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T12:05:14.361 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T12:05:14.363 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T12:05:14.367 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T12:05:14.367 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T12:05:15.375 INFO:teuthology.orchestra.run.smithi040.stdout:generic/058 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-12-17T12:05:15.391 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/058 2023-12-17T12:05:15.392 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/058 2023-12-17T12:05:15.392 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T12:05:15.404 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T12:05:15.534 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T12:05:15.534 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/059) 2023-12-17T12:05:15.805 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T12:05:15.812 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T12:05:16.205 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T12:05:16.220 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T12:05:16.222 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T12:05:16.226 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T12:05:16.226 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T12:05:16.931 INFO:teuthology.orchestra.run.smithi040.stdout:generic/059 [not run] require 172.21.15.40:6789:/scratch to be valid block disk 2023-12-17T12:05:16.948 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/059 2023-12-17T12:05:16.949 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/059 2023-12-17T12:05:16.949 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T12:05:16.961 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T12:05:17.003 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T12:05:17.003 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/060) 2023-12-17T12:05:17.651 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T12:05:17.666 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T12:05:17.668 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T12:05:17.672 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T12:05:17.672 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T12:05:18.698 INFO:teuthology.orchestra.run.smithi040.stdout:generic/060 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-12-17T12:05:18.713 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/060 2023-12-17T12:05:18.713 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/060 2023-12-17T12:05:18.713 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T12:05:18.722 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T12:05:18.843 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T12:05:18.843 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/061) 2023-12-17T12:05:19.486 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T12:05:19.498 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T12:05:19.499 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T12:05:19.502 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T12:05:19.502 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T12:05:20.419 INFO:teuthology.orchestra.run.smithi040.stdout:generic/061 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-12-17T12:05:20.431 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/061 2023-12-17T12:05:20.431 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/061 2023-12-17T12:05:20.431 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T12:05:20.440 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T12:05:20.551 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T12:05:20.552 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/062) 2023-12-17T12:05:21.210 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T12:05:21.222 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T12:05:21.224 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T12:05:21.227 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T12:05:21.228 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T12:05:24.719 INFO:teuthology.orchestra.run.smithi040.stdout:generic/062 3s 2023-12-17T12:05:24.749 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/062 2023-12-17T12:05:24.750 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T12:05:24.761 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T12:05:24.796 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T12:05:24.797 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/063) 2023-12-17T12:05:25.365 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T12:05:25.378 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T12:05:25.379 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T12:05:25.383 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T12:05:25.383 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T12:05:26.505 INFO:teuthology.orchestra.run.smithi040.stdout:generic/063 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-12-17T12:05:26.519 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/063 2023-12-17T12:05:26.519 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/063 2023-12-17T12:05:26.519 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T12:05:26.530 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T12:05:26.630 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T12:05:26.630 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/064) 2023-12-17T12:05:27.294 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T12:05:27.307 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T12:05:27.309 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T12:05:27.313 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T12:05:27.313 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T12:05:28.049 INFO:teuthology.orchestra.run.smithi040.stdout:generic/064 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-12-17T12:05:28.061 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/064 2023-12-17T12:05:28.061 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/064 2023-12-17T12:05:28.061 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T12:05:28.070 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T12:05:28.116 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T12:05:28.116 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/065) 2023-12-17T12:05:28.754 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T12:05:28.767 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T12:05:28.769 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T12:05:28.772 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T12:05:28.772 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T12:05:29.509 INFO:teuthology.orchestra.run.smithi040.stdout:generic/065 [not run] require 172.21.15.40:6789:/scratch to be valid block disk 2023-12-17T12:05:29.521 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/065 2023-12-17T12:05:29.521 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/065 2023-12-17T12:05:29.521 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T12:05:29.531 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T12:05:29.579 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T12:05:29.579 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/066) 2023-12-17T12:05:30.201 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T12:05:30.217 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T12:05:30.219 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T12:05:30.223 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T12:05:30.223 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T12:05:30.961 INFO:teuthology.orchestra.run.smithi040.stdout:generic/066 [not run] require 172.21.15.40:6789:/scratch to be valid block disk 2023-12-17T12:05:30.975 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/066 2023-12-17T12:05:30.975 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/066 2023-12-17T12:05:30.975 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T12:05:30.986 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T12:05:31.027 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T12:05:31.027 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/067) 2023-12-17T12:05:31.673 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T12:05:31.689 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T12:05:31.692 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T12:05:31.696 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T12:05:31.696 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T12:05:32.510 INFO:teuthology.orchestra.run.smithi040.stdout:generic/067 [not run] require 172.21.15.40:6789:/scratch to be valid block disk 2023-12-17T12:05:32.524 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/067 2023-12-17T12:05:32.524 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/067 2023-12-17T12:05:32.524 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T12:05:32.535 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T12:05:32.587 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T12:05:32.587 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/068) 2023-12-17T12:05:33.263 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T12:05:33.280 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T12:05:33.281 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T12:05:33.285 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T12:05:33.286 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T12:05:34.036 INFO:teuthology.orchestra.run.smithi040.stdout:generic/068 [not run] ceph does not support freezing 2023-12-17T12:05:34.050 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/068 2023-12-17T12:05:34.050 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/068 2023-12-17T12:05:34.051 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T12:05:34.063 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T12:05:34.105 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T12:05:34.105 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/069) 2023-12-17T12:05:34.752 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T12:05:34.765 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T12:05:34.767 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T12:05:34.770 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T12:05:34.770 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T12:05:46.064 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T12:05:46.074 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T12:05:55.359 INFO:teuthology.orchestra.run.smithi040.stdout:generic/069 20s 2023-12-17T12:05:55.389 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/069 2023-12-17T12:05:55.389 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T12:05:55.403 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T12:05:55.460 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T12:05:55.461 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/070) 2023-12-17T12:05:56.006 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T12:05:56.020 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T12:05:56.022 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T12:05:56.026 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T12:05:56.026 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T12:06:16.269 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T12:06:16.279 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T12:06:29.008 INFO:teuthology.orchestra.run.smithi040.stdout:generic/070 32s 2023-12-17T12:06:29.026 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/070 2023-12-17T12:06:29.026 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T12:06:29.035 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T12:06:29.161 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T12:06:29.161 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/071) 2023-12-17T12:06:29.878 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T12:06:29.892 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T12:06:29.899 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T12:06:29.899 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T12:06:29.899 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T12:06:30.549 INFO:teuthology.orchestra.run.smithi040.stdout:generic/071 [not run] xfs_io falloc -k failed (old kernel/wrong fs?) 2023-12-17T12:06:30.564 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/071 2023-12-17T12:06:30.564 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/071 2023-12-17T12:06:30.564 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T12:06:30.576 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T12:06:30.622 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T12:06:30.623 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/072) 2023-12-17T12:06:31.237 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T12:06:31.255 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T12:06:31.257 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T12:06:31.260 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T12:06:31.260 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T12:06:32.072 INFO:teuthology.orchestra.run.smithi040.stdout:generic/072 [not run] xfs_io fcollapse failed (old kernel/wrong fs?) 2023-12-17T12:06:32.086 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/072 2023-12-17T12:06:32.086 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/072 2023-12-17T12:06:32.086 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T12:06:32.095 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T12:06:32.145 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T12:06:32.145 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/073) 2023-12-17T12:06:32.748 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T12:06:32.763 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T12:06:32.765 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T12:06:32.768 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T12:06:32.768 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T12:06:33.441 INFO:teuthology.orchestra.run.smithi040.stdout:generic/073 [not run] require 172.21.15.40:6789:/scratch to be valid block disk 2023-12-17T12:06:33.454 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/073 2023-12-17T12:06:33.454 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/073 2023-12-17T12:06:33.454 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T12:06:33.465 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T12:06:33.498 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T12:06:33.498 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/074) 2023-12-17T12:06:34.123 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T12:06:34.138 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T12:06:34.140 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T12:06:34.143 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T12:06:34.143 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T12:06:46.484 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T12:06:46.493 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T12:07:16.678 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T12:07:16.683 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T12:07:21.323 INFO:teuthology.orchestra.run.smithi040.stdout:generic/074 47s 2023-12-17T12:07:21.341 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/074 2023-12-17T12:07:21.341 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T12:07:21.350 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T12:07:22.164 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T12:07:22.164 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/075) 2023-12-17T12:07:22.912 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T12:07:22.927 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T12:07:22.929 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T12:07:22.938 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T12:07:22.938 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T12:07:47.544 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T12:07:47.550 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T12:07:47.705 INFO:tasks.ceph.mds.d.smithi159.stderr:2023-12-17T12:07:47.703+0000 7f1350aab640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 96456) UID: 0 2023-12-17T12:07:47.706 INFO:tasks.ceph.mds.b.smithi159.stderr:2023-12-17T12:07:47.704+0000 7ff8c5a52640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 96456) UID: 0 2023-12-17T12:07:56.444 INFO:teuthology.orchestra.run.smithi040.stdout:generic/075 33s 2023-12-17T12:07:56.464 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/075 2023-12-17T12:07:56.464 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T12:07:56.474 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T12:07:56.593 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T12:07:56.593 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/076) 2023-12-17T12:07:57.316 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T12:07:57.328 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T12:07:57.329 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T12:07:57.332 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T12:07:57.332 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T12:07:58.014 INFO:teuthology.orchestra.run.smithi040.stdout:generic/076 [not run] require 172.21.15.40:6789:/scratch to be local device 2023-12-17T12:07:58.029 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/076 2023-12-17T12:07:58.029 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/076 2023-12-17T12:07:58.029 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T12:07:58.037 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T12:07:58.070 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T12:07:58.071 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/077) 2023-12-17T12:07:58.689 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T12:07:58.708 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T12:07:58.711 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T12:07:58.714 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T12:07:58.714 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T12:08:00.591 INFO:teuthology.orchestra.run.smithi040.stdout:generic/077 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-12-17T12:08:00.603 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/077 2023-12-17T12:08:00.603 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/077 2023-12-17T12:08:00.604 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T12:08:00.612 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T12:08:00.696 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T12:08:00.697 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/078) 2023-12-17T12:08:01.477 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T12:08:01.491 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T12:08:01.493 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T12:08:01.495 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T12:08:01.496 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T12:08:02.505 INFO:teuthology.orchestra.run.smithi040.stdout:generic/078 [not run] kernel doesn't support renameat2 syscall 2023-12-17T12:08:02.519 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/078 2023-12-17T12:08:02.519 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/078 2023-12-17T12:08:02.519 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T12:08:02.528 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T12:08:02.629 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T12:08:02.629 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/079) 2023-12-17T12:08:03.387 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T12:08:03.403 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T12:08:03.405 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T12:08:03.407 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T12:08:03.408 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T12:08:04.051 INFO:teuthology.orchestra.run.smithi040.stdout:generic/079 [not run] file system doesn't support chattr +ia 2023-12-17T12:08:04.061 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/079 2023-12-17T12:08:04.061 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/079 2023-12-17T12:08:04.061 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T12:08:04.071 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T12:08:04.120 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T12:08:04.120 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/080) 2023-12-17T12:08:04.724 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T12:08:04.738 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T12:08:04.739 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T12:08:04.742 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T12:08:04.742 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T12:08:07.519 INFO:teuthology.orchestra.run.smithi040.stdout:generic/080 2s 2023-12-17T12:08:07.536 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/080 2023-12-17T12:08:07.536 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T12:08:07.546 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T12:08:07.598 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T12:08:07.598 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/081) 2023-12-17T12:08:08.248 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T12:08:08.263 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T12:08:08.265 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T12:08:08.268 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T12:08:08.268 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T12:08:08.960 INFO:teuthology.orchestra.run.smithi040.stdout:generic/081 [not run] require 172.21.15.40:6789:/scratch to be valid block disk 2023-12-17T12:08:08.971 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/081 2023-12-17T12:08:08.971 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/081 2023-12-17T12:08:08.971 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T12:08:08.980 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T12:08:09.021 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T12:08:09.021 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/082) 2023-12-17T12:08:09.632 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T12:08:09.646 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T12:08:09.647 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T12:08:09.650 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T12:08:09.650 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T12:08:10.274 INFO:teuthology.orchestra.run.smithi040.stdout:generic/082 [not run] disk quotas not supported by this filesystem type: ceph 2023-12-17T12:08:10.288 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/082 2023-12-17T12:08:10.288 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/082 2023-12-17T12:08:10.288 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T12:08:10.295 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T12:08:10.332 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T12:08:10.332 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/083) 2023-12-17T12:08:10.944 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T12:08:10.963 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T12:08:10.966 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T12:08:10.970 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T12:08:10.970 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T12:08:11.622 INFO:teuthology.orchestra.run.smithi040.stdout:generic/083 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-12-17T12:08:11.635 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/083 2023-12-17T12:08:11.635 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/083 2023-12-17T12:08:11.635 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T12:08:11.647 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T12:08:11.680 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T12:08:11.680 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/084) 2023-12-17T12:08:12.270 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T12:08:12.285 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T12:08:12.288 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T12:08:12.291 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T12:08:12.291 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T12:08:18.585 INFO:teuthology.orchestra.run.smithi040.stdout:generic/084 6s 2023-12-17T12:08:18.634 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/084 2023-12-17T12:08:18.635 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T12:08:18.654 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T12:08:18.698 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T12:08:18.698 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/085) 2023-12-17T12:08:19.388 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T12:08:19.405 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T12:08:19.406 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T12:08:19.409 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T12:08:19.409 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T12:08:20.182 INFO:teuthology.orchestra.run.smithi040.stdout:generic/085 [not run] require 172.21.15.40:6789:/scratch to be valid block disk 2023-12-17T12:08:20.195 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/085 2023-12-17T12:08:20.195 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/085 2023-12-17T12:08:20.195 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T12:08:20.205 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T12:08:20.254 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T12:08:20.255 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/086) 2023-12-17T12:08:20.911 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T12:08:20.928 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T12:08:20.930 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T12:08:20.935 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T12:08:20.935 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T12:08:21.588 INFO:teuthology.orchestra.run.smithi040.stdout:generic/086 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-12-17T12:08:21.602 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/086 2023-12-17T12:08:21.602 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/086 2023-12-17T12:08:21.602 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T12:08:21.611 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T12:08:21.655 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T12:08:21.655 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/087) 2023-12-17T12:08:22.257 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T12:08:22.270 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T12:08:22.272 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T12:08:22.275 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T12:08:22.275 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T12:08:23.060 INFO:teuthology.orchestra.run.smithi040.stdout:generic/087 1s 2023-12-17T12:08:23.078 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/087 2023-12-17T12:08:23.078 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T12:08:23.086 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T12:08:23.226 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T12:08:23.226 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/088) 2023-12-17T12:08:23.945 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T12:08:23.957 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T12:08:23.959 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T12:08:23.962 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T12:08:23.962 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T12:08:24.681 INFO:teuthology.orchestra.run.smithi040.stdout:generic/088 0s 2023-12-17T12:08:24.700 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/088 2023-12-17T12:08:24.701 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T12:08:24.710 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T12:08:24.819 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T12:08:24.819 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/089) 2023-12-17T12:08:25.494 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T12:08:25.509 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T12:08:25.511 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T12:08:25.514 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T12:08:25.514 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T12:11:27.420 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T12:11:27.431 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T12:11:57.584 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T12:11:57.594 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T12:12:27.839 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T12:12:27.849 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T12:12:57.987 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T12:12:57.999 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T12:13:28.135 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T12:13:28.145 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T12:13:58.273 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T12:13:58.284 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T12:14:28.429 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T12:14:28.434 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T12:14:59.486 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T12:14:59.496 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T12:15:29.975 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T12:15:29.981 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T12:16:00.542 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T12:16:00.552 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T12:16:00.646 INFO:tasks.ceph.mds.d.smithi159.stderr:2023-12-17T12:16:00.646+0000 7f1350aab640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 96645) UID: 0 2023-12-17T12:16:00.647 INFO:tasks.ceph.mds.b.smithi159.stderr:2023-12-17T12:16:00.646+0000 7ff8c5a52640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 96645) UID: 0 2023-12-17T12:18:55.257 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T12:18:55.268 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T12:19:25.410 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T12:19:25.417 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T12:19:55.549 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T12:19:55.558 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T12:20:25.696 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T12:20:25.706 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T12:20:55.852 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T12:20:55.862 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T12:21:26.810 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T12:21:26.820 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T12:21:56.945 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T12:21:56.955 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T12:22:27.088 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T12:22:27.098 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T12:22:57.235 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T12:22:57.246 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T12:23:27.508 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T12:23:27.520 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T12:23:57.729 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T12:23:57.735 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T12:23:57.823 INFO:tasks.ceph.mds.b.smithi159.stderr:2023-12-17T12:23:57.822+0000 7ff8c5a52640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 96861) UID: 0 2023-12-17T12:23:57.823 INFO:tasks.ceph.mds.d.smithi159.stderr:2023-12-17T12:23:57.822+0000 7f1350aab640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 96861) UID: 0 2023-12-17T12:25:20.667 INFO:teuthology.orchestra.run.smithi040.stdout:generic/089 1015s 2023-12-17T12:25:20.685 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/089 2023-12-17T12:25:20.685 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T12:25:20.698 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T12:25:20.962 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T12:25:20.962 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/090) 2023-12-17T12:25:21.627 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T12:25:21.638 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T12:25:21.639 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T12:25:21.643 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T12:25:21.643 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T12:25:22.362 INFO:teuthology.orchestra.run.smithi040.stdout:generic/090 [not run] require 172.21.15.40:6789:/scratch to be valid block disk 2023-12-17T12:25:22.377 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/090 2023-12-17T12:25:22.377 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/090 2023-12-17T12:25:22.377 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T12:25:22.389 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T12:25:22.448 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T12:25:22.448 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/091) 2023-12-17T12:25:23.081 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T12:25:23.095 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T12:25:23.097 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T12:25:23.100 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T12:25:23.100 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T12:26:48.592 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T12:26:48.602 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T12:27:18.741 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T12:27:18.768 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T12:27:48.959 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T12:27:48.970 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T12:28:19.100 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T12:28:19.111 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T12:28:49.261 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T12:28:49.275 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T12:29:19.405 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T12:29:19.420 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T12:29:40.382 INFO:teuthology.orchestra.run.smithi040.stdout:generic/091 257s 2023-12-17T12:29:40.398 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/091 2023-12-17T12:29:40.398 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T12:29:40.408 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T12:29:40.546 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T12:29:40.547 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/092) 2023-12-17T12:29:41.224 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T12:29:41.239 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T12:29:41.240 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T12:29:41.243 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T12:29:41.243 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T12:29:41.988 INFO:teuthology.orchestra.run.smithi040.stdout:generic/092 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-12-17T12:29:41.999 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/092 2023-12-17T12:29:41.999 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/092 2023-12-17T12:29:41.999 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T12:29:42.008 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T12:29:42.069 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T12:29:42.069 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/093) 2023-12-17T12:29:42.716 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T12:29:42.730 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T12:29:42.731 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T12:29:42.734 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T12:29:42.735 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T12:29:44.095 INFO:teuthology.orchestra.run.smithi040.stdout:generic/093 2s 2023-12-17T12:29:44.112 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/093 2023-12-17T12:29:44.113 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T12:29:44.122 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T12:29:44.258 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T12:29:44.259 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/094) 2023-12-17T12:29:44.925 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T12:29:44.938 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T12:29:44.945 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T12:29:44.945 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T12:29:44.945 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T12:29:45.765 INFO:teuthology.orchestra.run.smithi040.stdout:generic/094 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-12-17T12:29:45.782 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/094 2023-12-17T12:29:45.782 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/094 2023-12-17T12:29:45.782 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T12:29:45.795 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T12:29:45.899 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T12:29:45.899 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/095) 2023-12-17T12:29:46.573 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T12:29:46.588 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T12:29:46.591 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T12:29:46.593 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T12:29:46.593 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T12:29:49.554 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T12:29:49.566 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T12:30:08.955 INFO:teuthology.orchestra.run.smithi040.stdout:generic/095 22s 2023-12-17T12:30:08.994 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/095 2023-12-17T12:30:08.994 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T12:30:09.012 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T12:30:09.051 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T12:30:09.052 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/096) 2023-12-17T12:30:09.639 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T12:30:09.654 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T12:30:09.657 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T12:30:09.659 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T12:30:09.659 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T12:30:10.613 INFO:teuthology.orchestra.run.smithi040.stdout:generic/096 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2023-12-17T12:30:10.626 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/096 2023-12-17T12:30:10.626 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/096 2023-12-17T12:30:10.626 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T12:30:10.635 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T12:30:10.686 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T12:30:10.686 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/097) 2023-12-17T12:30:11.259 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T12:30:11.274 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T12:30:11.276 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T12:30:11.279 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T12:30:11.279 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T12:30:12.578 INFO:teuthology.orchestra.run.smithi040.stdout:generic/097 1s 2023-12-17T12:30:12.593 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/097 2023-12-17T12:30:12.593 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T12:30:12.601 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T12:30:12.630 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T12:30:12.630 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/098) 2023-12-17T12:30:13.240 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T12:30:13.258 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T12:30:13.258 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T12:30:13.262 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T12:30:13.262 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T12:30:15.241 INFO:teuthology.orchestra.run.smithi040.stdout:generic/098 2s 2023-12-17T12:30:15.261 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/098 2023-12-17T12:30:15.261 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T12:30:15.274 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T12:30:15.303 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T12:30:15.303 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/099) 2023-12-17T12:30:15.954 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T12:30:15.969 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T12:30:15.971 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T12:30:15.975 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T12:30:15.975 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T12:30:18.551 INFO:teuthology.orchestra.run.smithi040.stdout:generic/099 2s 2023-12-17T12:30:18.571 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/099 2023-12-17T12:30:18.571 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T12:30:18.581 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T12:30:18.708 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T12:30:18.709 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/100) 2023-12-17T12:30:19.423 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T12:30:19.435 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T12:30:19.443 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T12:30:19.443 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T12:30:19.443 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T12:30:19.691 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T12:30:19.698 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T12:30:49.884 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T12:30:49.896 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T12:30:55.508 INFO:teuthology.orchestra.run.smithi040.stdout:generic/100 36s 2023-12-17T12:30:55.527 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/100 2023-12-17T12:30:55.528 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T12:30:55.538 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T12:30:57.728 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T12:30:57.728 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/101) 2023-12-17T12:30:58.385 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T12:30:58.397 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T12:30:58.399 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T12:30:58.404 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T12:30:58.405 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T12:30:59.162 INFO:teuthology.orchestra.run.smithi040.stdout:generic/101 [not run] require 172.21.15.40:6789:/scratch to be valid block disk 2023-12-17T12:30:59.179 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/101 2023-12-17T12:30:59.179 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/101 2023-12-17T12:30:59.179 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T12:30:59.192 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T12:30:59.240 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T12:30:59.240 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/102) 2023-12-17T12:30:59.905 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T12:30:59.921 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T12:30:59.921 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T12:30:59.924 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T12:30:59.924 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T12:31:00.601 INFO:teuthology.orchestra.run.smithi040.stdout:generic/102 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-12-17T12:31:00.618 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/102 2023-12-17T12:31:00.618 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/102 2023-12-17T12:31:00.618 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T12:31:00.630 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T12:31:00.672 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T12:31:00.673 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/103) 2023-12-17T12:31:01.330 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T12:31:01.344 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T12:31:01.346 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T12:31:01.351 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T12:31:01.351 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T12:31:02.122 INFO:teuthology.orchestra.run.smithi040.stdout:generic/103 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-12-17T12:31:02.136 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/103 2023-12-17T12:31:02.136 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/103 2023-12-17T12:31:02.136 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T12:31:02.147 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T12:31:02.282 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T12:31:02.282 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/104) 2023-12-17T12:31:02.923 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T12:31:02.936 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T12:31:02.937 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T12:31:02.940 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T12:31:02.940 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T12:31:03.677 INFO:teuthology.orchestra.run.smithi040.stdout:generic/104 [not run] require 172.21.15.40:6789:/scratch to be valid block disk 2023-12-17T12:31:03.694 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/104 2023-12-17T12:31:03.694 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/104 2023-12-17T12:31:03.694 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T12:31:03.707 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T12:31:03.765 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T12:31:03.765 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/105) 2023-12-17T12:31:04.422 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T12:31:04.435 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T12:31:04.436 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T12:31:04.440 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T12:31:04.440 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T12:31:05.712 INFO:teuthology.orchestra.run.smithi040.stdout:generic/105 1s 2023-12-17T12:31:05.754 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/105 2023-12-17T12:31:05.756 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T12:31:05.777 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T12:31:05.817 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T12:31:05.818 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/106) 2023-12-17T12:31:06.439 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T12:31:06.456 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T12:31:06.456 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T12:31:06.460 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T12:31:06.460 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T12:31:07.268 INFO:teuthology.orchestra.run.smithi040.stdout:generic/106 [not run] require 172.21.15.40:6789:/scratch to be valid block disk 2023-12-17T12:31:07.284 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/106 2023-12-17T12:31:07.285 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/106 2023-12-17T12:31:07.285 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T12:31:07.291 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T12:31:07.343 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T12:31:07.344 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/107) 2023-12-17T12:31:07.993 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T12:31:08.005 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T12:31:08.006 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T12:31:08.009 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T12:31:08.010 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T12:31:08.753 INFO:teuthology.orchestra.run.smithi040.stdout:generic/107 [not run] require 172.21.15.40:6789:/scratch to be valid block disk 2023-12-17T12:31:08.766 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/107 2023-12-17T12:31:08.766 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/107 2023-12-17T12:31:08.766 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T12:31:08.778 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T12:31:08.825 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T12:31:08.826 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/108) 2023-12-17T12:31:09.433 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T12:31:09.445 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T12:31:09.447 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T12:31:09.451 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T12:31:09.451 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T12:31:10.307 INFO:teuthology.orchestra.run.smithi040.stdout:generic/108 [not run] require 172.21.15.40:6789:/scratch to be valid block disk 2023-12-17T12:31:10.318 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/108 2023-12-17T12:31:10.318 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/108 2023-12-17T12:31:10.319 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T12:31:10.328 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T12:31:10.375 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T12:31:10.375 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/109) 2023-12-17T12:31:11.053 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T12:31:11.070 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T12:31:11.072 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T12:31:11.077 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T12:31:11.078 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T12:31:20.044 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T12:31:20.072 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T12:31:22.908 INFO:teuthology.orchestra.run.smithi040.stdout:generic/109 11s 2023-12-17T12:31:22.923 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/109 2023-12-17T12:31:22.923 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T12:31:22.933 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T12:31:22.954 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T12:31:22.954 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/110) 2023-12-17T12:31:23.703 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T12:31:23.719 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T12:31:23.721 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T12:31:23.725 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T12:31:23.725 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T12:31:50.200 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T12:31:50.205 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T12:31:58.056 INFO:teuthology.orchestra.run.smithi040.stdout:generic/110 [not run] Reflink not supported by test filesystem type: ceph 2023-12-17T12:31:58.065 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/110 2023-12-17T12:31:58.065 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/110 2023-12-17T12:31:58.066 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T12:31:58.072 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T12:31:58.164 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T12:31:58.164 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/111) 2023-12-17T12:31:58.822 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T12:31:58.834 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T12:31:58.835 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T12:31:58.838 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T12:31:58.838 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T12:31:59.590 INFO:teuthology.orchestra.run.smithi040.stdout:generic/111 [not run] Reflink not supported by test filesystem type: ceph 2023-12-17T12:31:59.606 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/111 2023-12-17T12:31:59.606 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/111 2023-12-17T12:31:59.606 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T12:31:59.621 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T12:31:59.731 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T12:31:59.731 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/112) 2023-12-17T12:32:00.402 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T12:32:00.417 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T12:32:00.419 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T12:32:00.422 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T12:32:00.423 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T12:32:20.305 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T12:32:20.317 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T12:32:43.449 INFO:teuthology.orchestra.run.smithi040.stdout:generic/112 43s 2023-12-17T12:32:43.466 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/112 2023-12-17T12:32:43.466 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T12:32:43.474 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T12:32:43.598 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T12:32:43.599 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/113) 2023-12-17T12:32:44.310 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T12:32:44.327 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T12:32:44.329 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T12:32:44.333 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T12:32:44.333 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T12:32:51.488 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T12:32:51.506 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T12:33:03.263 INFO:teuthology.orchestra.run.smithi040.stdout:generic/113 19s 2023-12-17T12:33:03.291 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/113 2023-12-17T12:33:03.292 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T12:33:03.304 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T12:33:03.454 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T12:33:03.454 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/114) 2023-12-17T12:33:04.518 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T12:33:04.534 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T12:33:04.537 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T12:33:04.541 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T12:33:04.541 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T12:33:05.362 INFO:teuthology.orchestra.run.smithi040.stdout:generic/114 [not run] device block size: 4096 greater than 512 2023-12-17T12:33:05.377 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/114 2023-12-17T12:33:05.377 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/114 2023-12-17T12:33:05.377 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T12:33:05.387 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T12:33:05.436 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T12:33:05.436 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/115) 2023-12-17T12:33:06.071 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T12:33:06.086 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T12:33:06.087 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T12:33:06.091 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T12:33:06.091 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T12:33:06.878 INFO:teuthology.orchestra.run.smithi040.stdout:generic/115 [not run] Reflink not supported by test filesystem type: ceph 2023-12-17T12:33:06.895 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/115 2023-12-17T12:33:06.896 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/115 2023-12-17T12:33:06.896 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T12:33:06.909 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T12:33:07.029 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T12:33:07.029 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/116) 2023-12-17T12:33:07.721 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T12:33:07.734 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T12:33:07.735 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T12:33:07.739 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T12:33:07.739 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T12:33:08.522 INFO:teuthology.orchestra.run.smithi040.stdout:generic/116 [not run] Reflink not supported by test filesystem type: ceph 2023-12-17T12:33:08.536 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/116 2023-12-17T12:33:08.536 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/116 2023-12-17T12:33:08.536 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T12:33:08.545 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T12:33:08.686 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T12:33:08.686 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/117) 2023-12-17T12:33:09.336 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T12:33:09.349 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T12:33:09.350 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T12:33:09.353 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T12:33:09.353 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T12:33:21.697 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T12:33:21.724 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T12:33:33.420 INFO:teuthology.orchestra.run.smithi040.stdout:generic/117 24s 2023-12-17T12:33:33.434 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/117 2023-12-17T12:33:33.434 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T12:33:33.449 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T12:33:33.471 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T12:33:33.471 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/118) 2023-12-17T12:33:34.057 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T12:33:34.072 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T12:33:34.074 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T12:33:34.077 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T12:33:34.077 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T12:33:35.927 INFO:teuthology.orchestra.run.smithi040.stdout:generic/118 [not run] Reflink not supported by test filesystem type: ceph 2023-12-17T12:33:35.936 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/118 2023-12-17T12:33:35.937 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/118 2023-12-17T12:33:35.937 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T12:33:35.943 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T12:33:36.056 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T12:33:36.056 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/119) 2023-12-17T12:33:36.687 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T12:33:36.701 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T12:33:36.703 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T12:33:36.706 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T12:33:36.706 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T12:33:37.486 INFO:teuthology.orchestra.run.smithi040.stdout:generic/119 [not run] Reflink not supported by test filesystem type: ceph 2023-12-17T12:33:37.500 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/119 2023-12-17T12:33:37.500 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/119 2023-12-17T12:33:37.500 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T12:33:37.510 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T12:33:37.642 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T12:33:37.642 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/120) 2023-12-17T12:33:38.318 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T12:33:38.332 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T12:33:38.334 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T12:33:38.337 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T12:33:38.338 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T12:33:38.961 INFO:teuthology.orchestra.run.smithi040.stdout:generic/120 [not run] atime not maintained by ceph 2023-12-17T12:33:38.975 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/120 2023-12-17T12:33:38.975 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/120 2023-12-17T12:33:38.975 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T12:33:38.987 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T12:33:39.037 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T12:33:39.037 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/121) 2023-12-17T12:33:39.692 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T12:33:39.708 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T12:33:39.711 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T12:33:39.714 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T12:33:39.715 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T12:33:40.535 INFO:teuthology.orchestra.run.smithi040.stdout:generic/121 [not run] Dedupe not supported by test filesystem type: ceph 2023-12-17T12:33:40.551 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/121 2023-12-17T12:33:40.552 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/121 2023-12-17T12:33:40.552 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T12:33:40.564 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T12:33:40.698 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T12:33:40.698 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/122) 2023-12-17T12:33:41.359 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T12:33:41.373 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T12:33:41.375 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T12:33:41.378 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T12:33:41.378 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T12:33:42.168 INFO:teuthology.orchestra.run.smithi040.stdout:generic/122 [not run] Dedupe not supported by test filesystem type: ceph 2023-12-17T12:33:42.182 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/122 2023-12-17T12:33:42.182 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/122 2023-12-17T12:33:42.182 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T12:33:42.192 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T12:33:42.309 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T12:33:42.309 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/123) 2023-12-17T12:33:42.982 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T12:33:42.995 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T12:33:42.996 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T12:33:43.001 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T12:33:43.001 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T12:33:44.529 INFO:teuthology.orchestra.run.smithi040.stdout:generic/123 1s 2023-12-17T12:33:44.547 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/123 2023-12-17T12:33:44.548 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T12:33:44.557 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T12:33:44.691 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T12:33:44.691 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/124) 2023-12-17T12:33:45.384 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T12:33:45.396 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T12:33:45.398 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T12:33:45.401 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T12:33:45.401 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T12:33:51.273 INFO:teuthology.orchestra.run.smithi040.stdout:generic/124 6s 2023-12-17T12:33:51.303 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/124 2023-12-17T12:33:51.303 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T12:33:51.317 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T12:33:51.438 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T12:33:51.438 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/125) 2023-12-17T12:33:51.873 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T12:33:51.880 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T12:33:52.250 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T12:33:52.260 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T12:33:52.262 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T12:33:52.264 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T12:33:52.265 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T12:34:22.068 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T12:34:22.078 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T12:34:52.212 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T12:34:52.221 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T12:34:54.410 INFO:teuthology.orchestra.run.smithi040.stdout:generic/125 62s 2023-12-17T12:34:54.431 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/125 2023-12-17T12:34:54.431 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T12:34:54.443 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T12:34:54.546 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T12:34:54.547 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/126) 2023-12-17T12:34:55.232 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T12:34:55.246 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T12:34:55.248 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T12:34:55.252 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T12:34:55.252 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T12:34:56.484 INFO:teuthology.orchestra.run.smithi040.stdout:generic/126 1s 2023-12-17T12:34:56.502 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/126 2023-12-17T12:34:56.502 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T12:34:56.511 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T12:34:56.683 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T12:34:56.683 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/127) 2023-12-17T12:34:57.351 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T12:34:57.363 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T12:34:57.365 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T12:34:57.367 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T12:34:57.367 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T12:35:22.359 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T12:35:22.369 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T12:35:52.508 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T12:35:52.518 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T12:36:22.661 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T12:36:22.673 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T12:36:52.976 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T12:36:52.987 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T12:37:23.116 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T12:37:23.127 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T12:37:53.346 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T12:37:53.356 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T12:38:23.567 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T12:38:23.577 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T12:38:53.708 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T12:38:53.719 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T12:39:23.861 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T12:39:23.870 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T12:39:54.006 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T12:39:54.015 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T12:40:24.168 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T12:40:24.178 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T12:40:54.314 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T12:40:54.325 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T12:41:24.461 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T12:41:24.471 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T12:41:54.630 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T12:41:54.640 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T12:42:24.775 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T12:42:24.785 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T12:42:54.926 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T12:42:54.936 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T12:43:25.097 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T12:43:25.107 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T12:43:55.244 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T12:43:55.258 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T12:44:25.392 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T12:44:25.402 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T12:44:55.532 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T12:44:55.542 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T12:45:25.665 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T12:45:25.676 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T12:45:55.813 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T12:45:55.829 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T12:46:25.981 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T12:46:25.992 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T12:46:56.857 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T12:46:56.868 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T12:47:27.026 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T12:47:27.036 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T12:47:57.186 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T12:47:57.196 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T12:48:27.410 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T12:48:27.420 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T12:48:57.553 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T12:48:57.565 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T12:49:27.749 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T12:49:27.761 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T12:49:57.895 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T12:49:57.906 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T12:50:28.034 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T12:50:28.046 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T12:50:58.180 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T12:50:58.191 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T12:51:28.327 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T12:51:28.338 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T12:51:58.475 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T12:51:58.486 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T12:52:28.632 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T12:52:28.643 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T12:52:58.827 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T12:52:58.837 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T12:53:28.967 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T12:53:28.979 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T12:53:59.109 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T12:53:59.120 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T12:54:29.291 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T12:54:29.304 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T12:54:59.563 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T12:54:59.574 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T12:55:29.708 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T12:55:29.722 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T12:55:59.883 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T12:55:59.892 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T12:56:30.019 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T12:56:30.030 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T12:57:00.658 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T12:57:00.668 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T12:57:30.824 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T12:57:30.835 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T12:58:00.971 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T12:58:00.982 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T12:58:31.117 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T12:58:31.128 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T12:58:54.701 INFO:teuthology.orchestra.run.smithi040.stdout:generic/127 1437s 2023-12-17T12:58:54.728 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/127 2023-12-17T12:58:54.728 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T12:58:54.737 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T12:58:54.873 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T12:58:54.873 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/128) 2023-12-17T12:58:55.659 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T12:58:55.675 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T12:58:55.677 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T12:58:55.681 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T12:58:55.681 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T12:58:57.815 INFO:teuthology.orchestra.run.smithi040.stdout:generic/128 2s 2023-12-17T12:58:57.842 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/128 2023-12-17T12:58:57.842 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T12:58:57.851 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T12:58:57.874 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T12:58:57.875 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/129) 2023-12-17T12:58:58.391 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T12:58:58.404 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T12:58:58.409 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T12:58:58.409 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T12:58:58.410 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T12:59:01.268 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T12:59:01.278 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T12:59:31.451 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T12:59:31.457 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T13:00:01.670 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T13:00:01.676 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T13:00:31.851 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T13:00:31.860 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T13:01:02.706 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T13:01:02.720 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T13:01:32.952 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T13:01:32.958 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T13:01:33.121 INFO:tasks.ceph.osd.4.smithi159.stderr:2023-12-17T13:01:33.129+0000 7f2f7c3d6640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 98828) UID: 0 2023-12-17T13:01:33.121 INFO:tasks.ceph.osd.7.smithi159.stderr:2023-12-17T13:01:33.129+0000 7f2a65aa4640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 98828) UID: 0 2023-12-17T13:01:33.122 INFO:tasks.ceph.osd.5.smithi159.stderr:2023-12-17T13:01:33.129+0000 7fca99737640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 98828) UID: 0 2023-12-17T13:01:33.122 INFO:tasks.ceph.osd.6.smithi159.stderr:2023-12-17T13:01:33.129+0000 7efd98236640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 98828) UID: 0 2023-12-17T13:06:02.407 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T13:06:02.414 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T13:06:02.540 INFO:tasks.ceph.osd.1.smithi040.stderr:2023-12-17T13:06:02.547+0000 7f1055c84640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 258328) UID: 0 2023-12-17T13:06:02.540 INFO:tasks.ceph.osd.0.smithi040.stderr:2023-12-17T13:06:02.547+0000 7fddc7cf4640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 258328) UID: 0 2023-12-17T13:06:02.540 INFO:tasks.ceph.osd.2.smithi040.stderr:2023-12-17T13:06:02.548+0000 7f342b477640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 258328) UID: 0 2023-12-17T13:06:02.540 INFO:tasks.ceph.osd.3.smithi040.stderr:2023-12-17T13:06:02.548+0000 7f5186ef4640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 258328) UID: 0 2023-12-17T13:06:02.574 INFO:tasks.ceph.osd.4.smithi159.stderr:2023-12-17T13:06:02.583+0000 7f2f7c3d6640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 98854) UID: 0 2023-12-17T13:06:02.575 INFO:tasks.ceph.osd.6.smithi159.stderr:2023-12-17T13:06:02.583+0000 7efd98236640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 98854) UID: 0 2023-12-17T13:06:02.575 INFO:tasks.ceph.osd.5.smithi159.stderr:2023-12-17T13:06:02.583+0000 7fca99737640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 98854) UID: 0 2023-12-17T13:06:02.575 INFO:tasks.ceph.osd.7.smithi159.stderr:2023-12-17T13:06:02.583+0000 7f2a65aa4640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 98854) UID: 0 2023-12-17T13:10:43.731 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T13:10:43.736 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T13:10:43.911 INFO:tasks.ceph.osd.4.smithi159.stderr:2023-12-17T13:10:43.920+0000 7f2f7c3d6640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 98878) UID: 0 2023-12-17T13:10:43.912 INFO:tasks.ceph.osd.5.smithi159.stderr:2023-12-17T13:10:43.921+0000 7fca99737640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 98878) UID: 0 2023-12-17T13:10:43.912 INFO:tasks.ceph.osd.7.smithi159.stderr:2023-12-17T13:10:43.921+0000 7f2a65aa4640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 98878) UID: 0 2023-12-17T13:10:43.912 INFO:tasks.ceph.osd.6.smithi159.stderr:2023-12-17T13:10:43.921+0000 7efd98236640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 98878) UID: 0 2023-12-17T13:15:13.022 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T13:15:13.036 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T13:15:13.141 INFO:tasks.ceph.osd.0.smithi040.stderr:2023-12-17T13:15:13.149+0000 7fddc7cf4640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 258377) UID: 0 2023-12-17T13:15:13.142 INFO:tasks.ceph.osd.1.smithi040.stderr:2023-12-17T13:15:13.149+0000 7f1055c84640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 258377) UID: 0 2023-12-17T13:15:13.142 INFO:tasks.ceph.osd.3.smithi040.stderr:2023-12-17T13:15:13.149+0000 7f5186ef4640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 258377) UID: 0 2023-12-17T13:15:13.142 INFO:tasks.ceph.osd.2.smithi040.stderr:2023-12-17T13:15:13.149+0000 7f342b477640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 258377) UID: 0 2023-12-17T13:15:13.441 INFO:tasks.ceph.mds.b.smithi159.stderr:2023-12-17T13:15:13.449+0000 7ff8c5a52640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 98902) UID: 0 2023-12-17T13:15:13.441 INFO:tasks.ceph.mds.d.smithi159.stderr:2023-12-17T13:15:13.449+0000 7f1350aab640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 98902) UID: 0 2023-12-17T13:19:23.257 INFO:tasks.ceph.osd.4.smithi159.stderr:2023-12-17T13:19:23.266+0000 7f2f7c3d6640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 98910) UID: 0 2023-12-17T13:19:23.270 INFO:tasks.ceph.osd.6.smithi159.stderr:2023-12-17T13:19:23.278+0000 7efd98236640 -1 Fail to open '/proc/98910/cmdline' error = (2) No such file or directory 2023-12-17T13:19:23.271 INFO:tasks.ceph.osd.6.smithi159.stderr:2023-12-17T13:19:23.278+0000 7efd98236640 -1 received signal: Hangup from (PID: 98910) UID: 0 2023-12-17T13:19:23.273 INFO:tasks.ceph.osd.7.smithi159.stderr:2023-12-17T13:19:23.282+0000 7f2a65aa4640 -1 Fail to open '/proc/98910/cmdline' error = (2) No such file or directory 2023-12-17T13:19:23.273 INFO:tasks.ceph.osd.7.smithi159.stderr:2023-12-17T13:19:23.282+0000 7f2a65aa4640 -1 received signal: Hangup from (PID: 98910) UID: 0 2023-12-17T13:19:23.274 INFO:tasks.ceph.osd.5.smithi159.stderr:2023-12-17T13:19:23.282+0000 7fca99737640 -1 Fail to open '/proc/98910/cmdline' error = (2) No such file or directory 2023-12-17T13:19:23.274 INFO:tasks.ceph.osd.5.smithi159.stderr:2023-12-17T13:19:23.282+0000 7fca99737640 -1 received signal: Hangup from (PID: 98910) UID: 0 2023-12-17T13:22:01.865 INFO:teuthology.orchestra.run.smithi040.stdout:generic/129 1382s 2023-12-17T13:22:02.093 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/129 2023-12-17T13:22:02.093 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T13:22:02.110 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:22:02.153 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T13:22:02.153 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/130) 2023-12-17T13:22:02.984 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T13:22:03.000 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T13:22:03.002 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T13:22:03.005 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T13:22:03.005 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:22:29.880 INFO:teuthology.orchestra.run.smithi040.stdout:generic/130 26s 2023-12-17T13:22:29.921 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/130 2023-12-17T13:22:29.921 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T13:22:29.946 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:22:30.001 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T13:22:30.002 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/131) 2023-12-17T13:22:30.613 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T13:22:30.627 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T13:22:30.628 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T13:22:30.631 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T13:22:30.631 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:22:32.711 INFO:teuthology.orchestra.run.smithi040.stdout:generic/131 2s 2023-12-17T13:22:32.732 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/131 2023-12-17T13:22:32.732 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T13:22:32.740 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:22:32.914 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T13:22:32.914 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/132) 2023-12-17T13:22:33.780 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T13:22:33.797 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T13:22:33.799 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T13:22:33.802 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T13:22:33.802 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:22:48.229 INFO:teuthology.orchestra.run.smithi040.stdout:generic/132 14s 2023-12-17T13:22:48.251 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/132 2023-12-17T13:22:48.251 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T13:22:48.260 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:22:48.292 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T13:22:48.293 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/133) 2023-12-17T13:22:48.865 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T13:22:48.878 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T13:22:48.880 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T13:22:48.883 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T13:22:48.883 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:24:01.042 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T13:24:01.054 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T13:24:01.173 INFO:tasks.ceph.osd.0.smithi040.stderr:2023-12-17T13:24:01.182+0000 7fddc7cf4640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 260558) UID: 0 2023-12-17T13:24:01.173 INFO:tasks.ceph.osd.1.smithi040.stderr:2023-12-17T13:24:01.182+0000 7f1055c84640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 260558) UID: 0 2023-12-17T13:24:01.174 INFO:tasks.ceph.osd.2.smithi040.stderr:2023-12-17T13:24:01.182+0000 7f342b477640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 260558) UID: 0 2023-12-17T13:24:01.174 INFO:tasks.ceph.osd.3.smithi040.stderr:2023-12-17T13:24:01.182+0000 7f5186ef4640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 260558) UID: 0 2023-12-17T13:27:38.184 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T13:27:38.194 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T13:28:08.329 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T13:28:08.340 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T13:28:38.476 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T13:28:38.489 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T13:29:08.657 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T13:29:08.668 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T13:29:38.806 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T13:29:38.816 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T13:30:08.971 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T13:30:08.981 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T13:30:39.118 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T13:30:39.132 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T13:31:09.275 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T13:31:09.286 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T13:31:39.430 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T13:31:39.441 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T13:32:09.578 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T13:32:09.588 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T13:32:39.851 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T13:32:39.865 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T13:33:10.020 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T13:33:10.033 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T13:33:23.731 INFO:teuthology.orchestra.run.smithi040.stdout:generic/133 634s 2023-12-17T13:33:23.750 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/133 2023-12-17T13:33:23.750 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T13:33:23.763 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:33:23.867 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T13:33:23.867 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/134) 2023-12-17T13:33:24.680 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T13:33:24.691 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T13:33:24.692 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T13:33:24.694 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T13:33:24.695 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:33:25.496 INFO:teuthology.orchestra.run.smithi040.stdout:generic/134 [not run] Reflink not supported by test filesystem type: ceph 2023-12-17T13:33:25.510 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/134 2023-12-17T13:33:25.510 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/134 2023-12-17T13:33:25.511 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T13:33:25.521 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:33:25.649 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T13:33:25.650 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/135) 2023-12-17T13:33:26.372 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T13:33:26.388 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T13:33:26.391 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T13:33:26.395 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T13:33:26.395 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:33:28.063 INFO:teuthology.orchestra.run.smithi040.stdout:generic/135 2s 2023-12-17T13:33:28.077 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/135 2023-12-17T13:33:28.077 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T13:33:28.083 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:33:28.106 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T13:33:28.106 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/136) 2023-12-17T13:33:28.703 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T13:33:28.718 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T13:33:28.720 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T13:33:28.724 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T13:33:28.724 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:33:29.526 INFO:teuthology.orchestra.run.smithi040.stdout:generic/136 [not run] Dedupe not supported by test filesystem type: ceph 2023-12-17T13:33:29.542 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/136 2023-12-17T13:33:29.543 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/136 2023-12-17T13:33:29.543 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T13:33:29.555 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:33:29.677 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T13:33:29.677 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/137) 2023-12-17T13:33:30.355 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T13:33:30.368 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T13:33:30.370 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T13:33:30.373 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T13:33:30.373 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:33:31.130 INFO:teuthology.orchestra.run.smithi040.stdout:generic/137 [not run] Reflink not supported by test filesystem type: ceph 2023-12-17T13:33:31.142 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/137 2023-12-17T13:33:31.142 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/137 2023-12-17T13:33:31.143 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T13:33:31.153 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:33:31.276 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T13:33:31.276 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/138) 2023-12-17T13:33:31.991 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T13:33:32.006 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T13:33:32.008 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T13:33:32.011 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T13:33:32.011 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:33:32.767 INFO:teuthology.orchestra.run.smithi040.stdout:generic/138 [not run] Reflink not supported by test filesystem type: ceph 2023-12-17T13:33:32.780 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/138 2023-12-17T13:33:32.780 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/138 2023-12-17T13:33:32.780 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T13:33:32.790 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:33:32.928 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T13:33:32.928 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/139) 2023-12-17T13:33:33.621 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T13:33:33.636 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T13:33:33.637 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T13:33:33.641 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T13:33:33.641 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:33:34.399 INFO:teuthology.orchestra.run.smithi040.stdout:generic/139 [not run] Reflink not supported by test filesystem type: ceph 2023-12-17T13:33:34.414 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/139 2023-12-17T13:33:34.414 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/139 2023-12-17T13:33:34.414 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T13:33:34.424 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:33:34.559 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T13:33:34.559 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/140) 2023-12-17T13:33:35.237 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T13:33:35.251 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T13:33:35.253 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T13:33:35.257 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T13:33:35.257 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:33:36.032 INFO:teuthology.orchestra.run.smithi040.stdout:generic/140 [not run] Reflink not supported by test filesystem type: ceph 2023-12-17T13:33:36.047 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/140 2023-12-17T13:33:36.047 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/140 2023-12-17T13:33:36.047 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T13:33:36.057 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:33:36.160 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T13:33:36.161 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/141) 2023-12-17T13:33:36.874 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T13:33:36.889 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T13:33:36.891 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T13:33:36.894 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T13:33:36.894 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:33:37.925 INFO:teuthology.orchestra.run.smithi040.stdout:generic/141 0s 2023-12-17T13:33:37.942 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/141 2023-12-17T13:33:37.943 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T13:33:37.952 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:33:37.982 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T13:33:37.982 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/142) 2023-12-17T13:33:38.636 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T13:33:38.652 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T13:33:38.654 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T13:33:38.657 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T13:33:38.657 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:33:39.449 INFO:teuthology.orchestra.run.smithi040.stdout:generic/142 [not run] Reflink not supported by test filesystem type: ceph 2023-12-17T13:33:39.466 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/142 2023-12-17T13:33:39.466 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/142 2023-12-17T13:33:39.466 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T13:33:39.478 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:33:39.597 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T13:33:39.597 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/143) 2023-12-17T13:33:40.175 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T13:33:40.179 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T13:33:40.295 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T13:33:40.306 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T13:33:40.307 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T13:33:40.310 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T13:33:40.310 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:33:40.984 INFO:teuthology.orchestra.run.smithi040.stdout:generic/143 [not run] Reflink not supported by test filesystem type: ceph 2023-12-17T13:33:40.997 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/143 2023-12-17T13:33:40.997 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/143 2023-12-17T13:33:40.997 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T13:33:41.007 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:33:41.126 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T13:33:41.126 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/144) 2023-12-17T13:33:41.838 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T13:33:41.849 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T13:33:41.850 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T13:33:41.853 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T13:33:41.853 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:33:42.511 INFO:teuthology.orchestra.run.smithi040.stdout:generic/144 [not run] Reflink not supported by test filesystem type: ceph 2023-12-17T13:33:42.524 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/144 2023-12-17T13:33:42.524 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/144 2023-12-17T13:33:42.524 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T13:33:42.533 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:33:42.651 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T13:33:42.652 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/145) 2023-12-17T13:33:43.376 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T13:33:43.388 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T13:33:43.389 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T13:33:43.392 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T13:33:43.392 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:33:44.125 INFO:teuthology.orchestra.run.smithi040.stdout:generic/145 [not run] Reflink not supported by test filesystem type: ceph 2023-12-17T13:33:44.141 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/145 2023-12-17T13:33:44.141 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/145 2023-12-17T13:33:44.141 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T13:33:44.153 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:33:44.289 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T13:33:44.290 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/146) 2023-12-17T13:33:44.976 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T13:33:44.992 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T13:33:44.993 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T13:33:44.997 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T13:33:44.997 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:33:45.778 INFO:teuthology.orchestra.run.smithi040.stdout:generic/146 [not run] Reflink not supported by test filesystem type: ceph 2023-12-17T13:33:45.792 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/146 2023-12-17T13:33:45.792 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/146 2023-12-17T13:33:45.792 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T13:33:45.803 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:33:45.927 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T13:33:45.927 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/147) 2023-12-17T13:33:46.630 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T13:33:46.645 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T13:33:46.647 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T13:33:46.650 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T13:33:46.650 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:33:47.422 INFO:teuthology.orchestra.run.smithi040.stdout:generic/147 [not run] Reflink not supported by test filesystem type: ceph 2023-12-17T13:33:47.436 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/147 2023-12-17T13:33:47.436 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/147 2023-12-17T13:33:47.436 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T13:33:47.448 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:33:47.574 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T13:33:47.574 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/148) 2023-12-17T13:33:48.258 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T13:33:48.270 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T13:33:48.272 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T13:33:48.275 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T13:33:48.275 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:33:49.073 INFO:teuthology.orchestra.run.smithi040.stdout:generic/148 [not run] Reflink not supported by test filesystem type: ceph 2023-12-17T13:33:49.086 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/148 2023-12-17T13:33:49.086 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/148 2023-12-17T13:33:49.086 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T13:33:49.097 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:33:49.218 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T13:33:49.218 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/149) 2023-12-17T13:33:49.906 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T13:33:49.920 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T13:33:49.922 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T13:33:49.925 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T13:33:49.925 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:33:50.688 INFO:teuthology.orchestra.run.smithi040.stdout:generic/149 [not run] Reflink not supported by test filesystem type: ceph 2023-12-17T13:33:50.703 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/149 2023-12-17T13:33:50.703 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/149 2023-12-17T13:33:50.703 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T13:33:50.714 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:33:50.825 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T13:33:50.825 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/150) 2023-12-17T13:33:51.531 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T13:33:51.546 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T13:33:51.548 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T13:33:51.552 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T13:33:51.552 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:33:52.363 INFO:teuthology.orchestra.run.smithi040.stdout:generic/150 [not run] Reflink not supported by test filesystem type: ceph 2023-12-17T13:33:52.379 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/150 2023-12-17T13:33:52.380 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/150 2023-12-17T13:33:52.380 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T13:33:52.392 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:33:52.515 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T13:33:52.515 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/151) 2023-12-17T13:33:53.227 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T13:33:53.242 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T13:33:53.243 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T13:33:53.247 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T13:33:53.247 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:33:53.972 INFO:teuthology.orchestra.run.smithi040.stdout:generic/151 [not run] Reflink not supported by test filesystem type: ceph 2023-12-17T13:33:53.987 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/151 2023-12-17T13:33:53.987 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/151 2023-12-17T13:33:53.987 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T13:33:53.999 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:33:54.098 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T13:33:54.098 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/152) 2023-12-17T13:33:54.789 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T13:33:54.803 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T13:33:54.804 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T13:33:54.808 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T13:33:54.808 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:33:55.595 INFO:teuthology.orchestra.run.smithi040.stdout:generic/152 [not run] Reflink not supported by test filesystem type: ceph 2023-12-17T13:33:55.611 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/152 2023-12-17T13:33:55.611 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/152 2023-12-17T13:33:55.611 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T13:33:55.624 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:33:55.757 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T13:33:55.757 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/153) 2023-12-17T13:33:56.451 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T13:33:56.466 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T13:33:56.468 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T13:33:56.472 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T13:33:56.472 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:33:57.256 INFO:teuthology.orchestra.run.smithi040.stdout:generic/153 [not run] Reflink not supported by test filesystem type: ceph 2023-12-17T13:33:57.271 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/153 2023-12-17T13:33:57.271 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/153 2023-12-17T13:33:57.271 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T13:33:57.283 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:33:57.419 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T13:33:57.419 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/154) 2023-12-17T13:33:58.113 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T13:33:58.126 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T13:33:58.128 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T13:33:58.131 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T13:33:58.131 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:33:58.933 INFO:teuthology.orchestra.run.smithi040.stdout:generic/154 [not run] Reflink not supported by test filesystem type: ceph 2023-12-17T13:33:58.948 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/154 2023-12-17T13:33:58.948 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/154 2023-12-17T13:33:58.948 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T13:33:58.959 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:33:59.070 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T13:33:59.070 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/155) 2023-12-17T13:33:59.801 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T13:33:59.813 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T13:33:59.814 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T13:33:59.817 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T13:33:59.818 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:34:00.599 INFO:teuthology.orchestra.run.smithi040.stdout:generic/155 [not run] Reflink not supported by test filesystem type: ceph 2023-12-17T13:34:00.612 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/155 2023-12-17T13:34:00.612 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/155 2023-12-17T13:34:00.612 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T13:34:00.621 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:34:00.719 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T13:34:00.719 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/156) 2023-12-17T13:34:01.414 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T13:34:01.430 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T13:34:01.432 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T13:34:01.435 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T13:34:01.436 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:34:02.222 INFO:teuthology.orchestra.run.smithi040.stdout:generic/156 [not run] Reflink not supported by test filesystem type: ceph 2023-12-17T13:34:02.234 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/156 2023-12-17T13:34:02.234 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/156 2023-12-17T13:34:02.234 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T13:34:02.243 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:34:02.354 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T13:34:02.354 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/157) 2023-12-17T13:34:03.021 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T13:34:03.034 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T13:34:03.036 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T13:34:03.039 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T13:34:03.039 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:34:03.811 INFO:teuthology.orchestra.run.smithi040.stdout:generic/157 [not run] Reflink not supported by test filesystem type: ceph 2023-12-17T13:34:03.826 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/157 2023-12-17T13:34:03.826 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/157 2023-12-17T13:34:03.826 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T13:34:03.838 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:34:03.954 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T13:34:03.954 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/158) 2023-12-17T13:34:04.643 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T13:34:04.655 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T13:34:04.656 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T13:34:04.659 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T13:34:04.659 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:34:05.405 INFO:teuthology.orchestra.run.smithi040.stdout:generic/158 [not run] Dedupe not supported by test filesystem type: ceph 2023-12-17T13:34:05.417 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/158 2023-12-17T13:34:05.417 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/158 2023-12-17T13:34:05.417 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T13:34:05.426 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:34:05.570 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T13:34:05.570 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/159) 2023-12-17T13:34:06.241 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T13:34:06.255 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T13:34:06.256 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T13:34:06.260 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T13:34:06.260 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:34:07.016 INFO:teuthology.orchestra.run.smithi040.stdout:generic/159 [not run] file system doesn't support chattr +i 2023-12-17T13:34:07.029 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/159 2023-12-17T13:34:07.030 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/159 2023-12-17T13:34:07.030 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T13:34:07.039 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:34:07.100 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T13:34:07.101 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/160) 2023-12-17T13:34:07.729 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T13:34:07.745 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T13:34:07.747 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T13:34:07.750 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T13:34:07.750 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:34:08.482 INFO:teuthology.orchestra.run.smithi040.stdout:generic/160 [not run] file system doesn't support chattr +i 2023-12-17T13:34:08.496 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/160 2023-12-17T13:34:08.496 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/160 2023-12-17T13:34:08.496 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T13:34:08.506 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:34:08.564 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T13:34:08.565 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/161) 2023-12-17T13:34:09.186 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T13:34:09.201 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T13:34:09.203 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T13:34:09.207 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T13:34:09.207 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:34:10.295 INFO:teuthology.orchestra.run.smithi040.stdout:generic/161 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-17T13:34:10.315 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/161 2023-12-17T13:34:10.315 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/161 2023-12-17T13:34:10.316 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T13:34:10.329 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:34:10.579 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T13:34:10.579 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/162) 2023-12-17T13:34:10.633 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T13:34:10.638 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T13:34:11.108 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T13:34:11.125 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T13:34:11.128 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T13:34:11.132 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T13:34:11.133 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:34:12.073 INFO:teuthology.orchestra.run.smithi040.stdout:generic/162 [not run] Dedupe not supported by scratch filesystem type: ceph 2023-12-17T13:34:12.161 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/162 2023-12-17T13:34:12.162 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/162 2023-12-17T13:34:12.162 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T13:34:12.181 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:34:12.357 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T13:34:12.357 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/163) 2023-12-17T13:34:12.966 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T13:34:12.980 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T13:34:12.982 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T13:34:12.986 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T13:34:12.987 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:34:14.012 INFO:teuthology.orchestra.run.smithi040.stdout:generic/163 [not run] Dedupe not supported by scratch filesystem type: ceph 2023-12-17T13:34:14.095 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/163 2023-12-17T13:34:14.095 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/163 2023-12-17T13:34:14.096 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T13:34:14.108 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:34:14.454 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T13:34:14.454 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/164) 2023-12-17T13:34:14.968 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T13:34:14.980 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T13:34:14.982 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T13:34:14.984 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T13:34:14.985 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:34:16.011 INFO:teuthology.orchestra.run.smithi040.stdout:generic/164 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-17T13:34:16.035 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/164 2023-12-17T13:34:16.035 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/164 2023-12-17T13:34:16.036 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T13:34:16.048 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:34:16.310 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T13:34:16.310 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/165) 2023-12-17T13:34:16.850 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T13:34:16.865 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T13:34:16.867 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T13:34:16.872 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T13:34:16.872 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:34:17.910 INFO:teuthology.orchestra.run.smithi040.stdout:generic/165 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-17T13:34:17.927 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/165 2023-12-17T13:34:17.927 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/165 2023-12-17T13:34:17.928 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T13:34:17.940 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:34:18.186 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T13:34:18.186 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/166) 2023-12-17T13:34:18.735 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T13:34:18.747 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T13:34:18.749 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T13:34:18.752 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T13:34:18.752 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:34:19.754 INFO:teuthology.orchestra.run.smithi040.stdout:generic/166 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-17T13:34:19.774 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/166 2023-12-17T13:34:19.774 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/166 2023-12-17T13:34:19.774 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T13:34:19.786 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:34:20.047 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T13:34:20.047 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/167) 2023-12-17T13:34:20.601 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T13:34:20.615 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T13:34:20.616 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T13:34:20.619 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T13:34:20.620 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:34:21.635 INFO:teuthology.orchestra.run.smithi040.stdout:generic/167 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-17T13:34:21.655 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/167 2023-12-17T13:34:21.656 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/167 2023-12-17T13:34:21.656 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T13:34:21.668 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:34:21.909 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T13:34:21.910 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/168) 2023-12-17T13:34:22.489 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T13:34:22.504 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T13:34:22.506 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T13:34:22.509 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T13:34:22.509 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:34:23.560 INFO:teuthology.orchestra.run.smithi040.stdout:generic/168 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-17T13:34:23.575 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/168 2023-12-17T13:34:23.575 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/168 2023-12-17T13:34:23.575 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T13:34:23.588 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:34:23.809 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T13:34:23.810 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/169) 2023-12-17T13:34:24.386 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T13:34:24.402 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T13:34:24.404 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T13:34:24.409 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T13:34:24.409 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:34:25.707 INFO:teuthology.orchestra.run.smithi040.stdout:generic/169 1s 2023-12-17T13:34:25.722 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/169 2023-12-17T13:34:25.722 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T13:34:25.730 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:34:25.756 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T13:34:25.756 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/170) 2023-12-17T13:34:26.405 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T13:34:26.420 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T13:34:26.422 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T13:34:26.426 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T13:34:26.426 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:34:27.514 INFO:teuthology.orchestra.run.smithi040.stdout:generic/170 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-17T13:34:27.531 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/170 2023-12-17T13:34:27.531 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/170 2023-12-17T13:34:27.531 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T13:34:27.544 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:34:27.789 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T13:34:27.789 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/171) 2023-12-17T13:34:28.337 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T13:34:28.352 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T13:34:28.354 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T13:34:28.357 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T13:34:28.358 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:34:29.485 INFO:teuthology.orchestra.run.smithi040.stdout:generic/171 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-17T13:34:29.503 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/171 2023-12-17T13:34:29.503 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/171 2023-12-17T13:34:29.503 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T13:34:29.517 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:34:29.727 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T13:34:29.728 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/172) 2023-12-17T13:34:30.294 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T13:34:30.308 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T13:34:30.310 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T13:34:30.314 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T13:34:30.314 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:34:31.394 INFO:teuthology.orchestra.run.smithi040.stdout:generic/172 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-17T13:34:31.413 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/172 2023-12-17T13:34:31.413 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/172 2023-12-17T13:34:31.414 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T13:34:31.426 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:34:31.581 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T13:34:31.581 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/173) 2023-12-17T13:34:32.154 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T13:34:32.170 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T13:34:32.171 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T13:34:32.175 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T13:34:32.175 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:34:33.249 INFO:teuthology.orchestra.run.smithi040.stdout:generic/173 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-17T13:34:33.269 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/173 2023-12-17T13:34:33.269 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/173 2023-12-17T13:34:33.269 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T13:34:33.283 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:34:33.540 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T13:34:33.541 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/174) 2023-12-17T13:34:34.115 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T13:34:34.130 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T13:34:34.132 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T13:34:34.135 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T13:34:34.135 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:34:35.235 INFO:teuthology.orchestra.run.smithi040.stdout:generic/174 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-17T13:34:35.253 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/174 2023-12-17T13:34:35.253 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/174 2023-12-17T13:34:35.253 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T13:34:35.272 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:34:35.527 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T13:34:35.528 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/175) 2023-12-17T13:34:36.064 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T13:34:36.079 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T13:34:36.080 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T13:34:36.084 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T13:34:36.084 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:34:37.168 INFO:teuthology.orchestra.run.smithi040.stdout:generic/175 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-17T13:34:37.185 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/175 2023-12-17T13:34:37.185 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/175 2023-12-17T13:34:37.185 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T13:34:37.198 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:34:37.388 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T13:34:37.388 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/176) 2023-12-17T13:34:37.964 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T13:34:37.978 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T13:34:37.980 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T13:34:37.983 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T13:34:37.984 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:34:39.077 INFO:teuthology.orchestra.run.smithi040.stdout:generic/176 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-17T13:34:39.096 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/176 2023-12-17T13:34:39.096 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/176 2023-12-17T13:34:39.097 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T13:34:39.114 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:34:39.313 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T13:34:39.314 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/177) 2023-12-17T13:34:39.869 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T13:34:39.881 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T13:34:39.884 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T13:34:39.888 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T13:34:39.888 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:34:41.039 INFO:teuthology.orchestra.run.smithi040.stdout:generic/177 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-12-17T13:34:41.054 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/177 2023-12-17T13:34:41.055 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/177 2023-12-17T13:34:41.055 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T13:34:41.069 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:34:41.182 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T13:34:41.182 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/178) 2023-12-17T13:34:41.514 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T13:34:41.525 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T13:34:41.898 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T13:34:41.914 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T13:34:41.916 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T13:34:41.919 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T13:34:41.919 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:34:42.708 INFO:teuthology.orchestra.run.smithi040.stdout:generic/178 [not run] Reflink not supported by test filesystem type: ceph 2023-12-17T13:34:42.721 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/178 2023-12-17T13:34:42.721 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/178 2023-12-17T13:34:42.721 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T13:34:42.730 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:34:42.852 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T13:34:42.852 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/179) 2023-12-17T13:34:43.570 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T13:34:43.585 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T13:34:43.586 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T13:34:43.590 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T13:34:43.590 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:34:44.396 INFO:teuthology.orchestra.run.smithi040.stdout:generic/179 [not run] Reflink not supported by test filesystem type: ceph 2023-12-17T13:34:44.413 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/179 2023-12-17T13:34:44.413 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/179 2023-12-17T13:34:44.413 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T13:34:44.425 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:34:44.555 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T13:34:44.555 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/180) 2023-12-17T13:34:45.242 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T13:34:45.255 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T13:34:45.257 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T13:34:45.260 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T13:34:45.260 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:34:46.010 INFO:teuthology.orchestra.run.smithi040.stdout:generic/180 [not run] Reflink not supported by test filesystem type: ceph 2023-12-17T13:34:46.026 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/180 2023-12-17T13:34:46.026 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/180 2023-12-17T13:34:46.026 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T13:34:46.041 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:34:46.174 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T13:34:46.174 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/181) 2023-12-17T13:34:46.873 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T13:34:46.888 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T13:34:46.890 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T13:34:46.893 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T13:34:46.893 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:34:47.677 INFO:teuthology.orchestra.run.smithi040.stdout:generic/181 [not run] Reflink not supported by test filesystem type: ceph 2023-12-17T13:34:47.694 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/181 2023-12-17T13:34:47.695 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/181 2023-12-17T13:34:47.695 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T13:34:47.707 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:34:47.814 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T13:34:47.814 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/182) 2023-12-17T13:34:48.541 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T13:34:48.554 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T13:34:48.555 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T13:34:48.559 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T13:34:48.559 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:34:49.335 INFO:teuthology.orchestra.run.smithi040.stdout:generic/182 [not run] Dedupe not supported by test filesystem type: ceph 2023-12-17T13:34:49.348 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/182 2023-12-17T13:34:49.349 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/182 2023-12-17T13:34:49.349 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T13:34:49.358 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:34:49.480 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T13:34:49.480 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/183) 2023-12-17T13:34:50.173 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T13:34:50.187 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T13:34:50.189 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T13:34:50.193 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T13:34:50.193 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:34:51.228 INFO:teuthology.orchestra.run.smithi040.stdout:generic/183 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-17T13:34:51.251 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/183 2023-12-17T13:34:51.251 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/183 2023-12-17T13:34:51.251 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T13:34:51.266 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:34:51.488 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T13:34:51.489 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/184) 2023-12-17T13:34:52.035 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T13:34:52.049 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T13:34:52.051 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T13:34:52.054 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T13:34:52.054 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:34:52.855 INFO:teuthology.orchestra.run.smithi040.stdout:generic/184 0s 2023-12-17T13:34:52.876 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/184 2023-12-17T13:34:52.876 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T13:34:52.886 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:34:52.938 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T13:34:52.939 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/185) 2023-12-17T13:34:53.587 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T13:34:53.602 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T13:34:53.604 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T13:34:53.608 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T13:34:53.608 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:34:54.659 INFO:teuthology.orchestra.run.smithi040.stdout:generic/185 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-17T13:34:54.681 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/185 2023-12-17T13:34:54.682 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/185 2023-12-17T13:34:54.683 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T13:34:54.694 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:34:54.915 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T13:34:54.915 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/186) 2023-12-17T13:34:55.492 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T13:34:55.508 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T13:34:55.510 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T13:34:55.514 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T13:34:55.514 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:34:56.598 INFO:teuthology.orchestra.run.smithi040.stdout:generic/186 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-17T13:34:56.627 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/186 2023-12-17T13:34:56.627 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/186 2023-12-17T13:34:56.627 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T13:34:56.641 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:34:56.856 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T13:34:56.857 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/187) 2023-12-17T13:34:57.388 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T13:34:57.403 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T13:34:57.405 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T13:34:57.408 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T13:34:57.409 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:34:58.455 INFO:teuthology.orchestra.run.smithi040.stdout:generic/187 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-17T13:34:58.471 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/187 2023-12-17T13:34:58.472 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/187 2023-12-17T13:34:58.472 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T13:34:58.484 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:34:58.769 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T13:34:58.769 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/188) 2023-12-17T13:34:59.287 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T13:34:59.303 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T13:34:59.305 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T13:34:59.309 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T13:34:59.309 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:35:00.382 INFO:teuthology.orchestra.run.smithi040.stdout:generic/188 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-17T13:35:00.398 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/188 2023-12-17T13:35:00.399 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/188 2023-12-17T13:35:00.399 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T13:35:00.419 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:35:00.636 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T13:35:00.636 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/189) 2023-12-17T13:35:01.212 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T13:35:01.228 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T13:35:01.230 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T13:35:01.234 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T13:35:01.234 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:35:02.315 INFO:teuthology.orchestra.run.smithi040.stdout:generic/189 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-17T13:35:02.345 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/189 2023-12-17T13:35:02.345 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/189 2023-12-17T13:35:02.345 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T13:35:02.366 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:35:02.620 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T13:35:02.620 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/190) 2023-12-17T13:35:03.163 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T13:35:03.178 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T13:35:03.180 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T13:35:03.184 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T13:35:03.184 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:35:04.308 INFO:teuthology.orchestra.run.smithi040.stdout:generic/190 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-17T13:35:04.345 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/190 2023-12-17T13:35:04.346 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/190 2023-12-17T13:35:04.346 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T13:35:04.365 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:35:04.639 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T13:35:04.639 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/191) 2023-12-17T13:35:05.168 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T13:35:05.183 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T13:35:05.185 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T13:35:05.189 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T13:35:05.189 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:35:06.264 INFO:teuthology.orchestra.run.smithi040.stdout:generic/191 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-17T13:35:06.279 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/191 2023-12-17T13:35:06.280 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/191 2023-12-17T13:35:06.280 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T13:35:06.308 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:35:06.498 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T13:35:06.498 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/192) 2023-12-17T13:35:07.070 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T13:35:07.088 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T13:35:07.090 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T13:35:07.095 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T13:35:07.096 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:35:07.837 INFO:teuthology.orchestra.run.smithi040.stdout:generic/192 [not run] atime not maintained by ceph 2023-12-17T13:35:07.849 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/192 2023-12-17T13:35:07.849 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/192 2023-12-17T13:35:07.850 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T13:35:07.859 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:35:07.897 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T13:35:07.898 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/193) 2023-12-17T13:35:08.602 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T13:35:08.617 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T13:35:08.618 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T13:35:08.624 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T13:35:08.625 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:35:11.258 INFO:teuthology.orchestra.run.smithi040.stdout:generic/193 3s 2023-12-17T13:35:11.276 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/193 2023-12-17T13:35:11.276 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T13:35:11.286 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:35:11.426 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T13:35:11.427 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/194) 2023-12-17T13:35:11.656 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T13:35:11.670 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T13:35:12.140 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T13:35:12.153 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T13:35:12.154 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T13:35:12.157 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T13:35:12.158 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:35:13.180 INFO:teuthology.orchestra.run.smithi040.stdout:generic/194 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-17T13:35:13.196 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/194 2023-12-17T13:35:13.197 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/194 2023-12-17T13:35:13.197 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T13:35:13.214 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:35:13.486 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T13:35:13.486 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/195) 2023-12-17T13:35:14.033 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T13:35:14.046 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T13:35:14.048 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T13:35:14.051 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T13:35:14.051 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:35:15.069 INFO:teuthology.orchestra.run.smithi040.stdout:generic/195 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-17T13:35:15.095 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/195 2023-12-17T13:35:15.095 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/195 2023-12-17T13:35:15.095 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T13:35:15.121 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:35:15.374 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T13:35:15.375 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/196) 2023-12-17T13:35:15.931 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T13:35:15.944 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T13:35:15.946 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T13:35:15.949 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T13:35:15.949 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:35:17.066 INFO:teuthology.orchestra.run.smithi040.stdout:generic/196 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-17T13:35:17.090 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/196 2023-12-17T13:35:17.090 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/196 2023-12-17T13:35:17.090 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T13:35:17.118 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:35:17.345 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T13:35:17.345 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/197) 2023-12-17T13:35:17.897 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T13:35:17.912 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T13:35:17.913 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T13:35:17.917 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T13:35:17.918 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:35:19.064 INFO:teuthology.orchestra.run.smithi040.stdout:generic/197 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-17T13:35:19.081 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/197 2023-12-17T13:35:19.081 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/197 2023-12-17T13:35:19.082 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T13:35:19.094 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:35:19.347 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T13:35:19.348 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/198) 2023-12-17T13:35:19.864 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T13:35:19.874 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T13:35:19.875 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T13:35:19.878 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T13:35:19.878 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:35:21.739 INFO:teuthology.orchestra.run.smithi040.stdout:generic/198 1s 2023-12-17T13:35:21.758 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/198 2023-12-17T13:35:21.758 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T13:35:21.767 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:35:21.860 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T13:35:21.860 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/199) 2023-12-17T13:35:22.610 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T13:35:22.624 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T13:35:22.626 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T13:35:22.629 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T13:35:22.629 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:35:23.676 INFO:teuthology.orchestra.run.smithi040.stdout:generic/199 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-17T13:35:23.699 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/199 2023-12-17T13:35:23.699 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/199 2023-12-17T13:35:23.699 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T13:35:23.720 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:35:23.985 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T13:35:23.986 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/200) 2023-12-17T13:35:24.507 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T13:35:24.524 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T13:35:24.526 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T13:35:24.529 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T13:35:24.530 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:35:25.603 INFO:teuthology.orchestra.run.smithi040.stdout:generic/200 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-17T13:35:25.624 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/200 2023-12-17T13:35:25.625 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/200 2023-12-17T13:35:25.625 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T13:35:25.640 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:35:25.898 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T13:35:25.898 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/201) 2023-12-17T13:35:26.450 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T13:35:26.467 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T13:35:26.468 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T13:35:26.472 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T13:35:26.472 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:35:27.556 INFO:teuthology.orchestra.run.smithi040.stdout:generic/201 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-17T13:35:27.577 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/201 2023-12-17T13:35:27.577 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/201 2023-12-17T13:35:27.577 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T13:35:27.593 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:35:27.877 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T13:35:27.877 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/202) 2023-12-17T13:35:28.417 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T13:35:28.432 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T13:35:28.434 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T13:35:28.438 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T13:35:28.438 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:35:29.511 INFO:teuthology.orchestra.run.smithi040.stdout:generic/202 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-17T13:35:29.548 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/202 2023-12-17T13:35:29.548 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/202 2023-12-17T13:35:29.548 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T13:35:29.560 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:35:29.781 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T13:35:29.781 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/203) 2023-12-17T13:35:30.334 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T13:35:30.350 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T13:35:30.353 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T13:35:30.357 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T13:35:30.358 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:35:31.392 INFO:teuthology.orchestra.run.smithi040.stdout:generic/203 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-17T13:35:31.418 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/203 2023-12-17T13:35:31.418 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/203 2023-12-17T13:35:31.419 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T13:35:31.431 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:35:31.667 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T13:35:31.668 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/204) 2023-12-17T13:35:32.226 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T13:35:32.242 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T13:35:32.244 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T13:35:32.248 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T13:35:32.248 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:35:33.968 INFO:teuthology.orchestra.run.smithi040.stdout:generic/204 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-12-17T13:35:33.981 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/204 2023-12-17T13:35:33.981 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/204 2023-12-17T13:35:33.981 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T13:35:33.990 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:35:34.029 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T13:35:34.029 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/205) 2023-12-17T13:35:34.654 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T13:35:34.669 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T13:35:34.671 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T13:35:34.674 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T13:35:34.674 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:35:35.777 INFO:teuthology.orchestra.run.smithi040.stdout:generic/205 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-17T13:35:35.796 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/205 2023-12-17T13:35:35.796 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/205 2023-12-17T13:35:35.797 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T13:35:35.814 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:35:36.019 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T13:35:36.019 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/206) 2023-12-17T13:35:36.556 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T13:35:36.571 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T13:35:36.573 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T13:35:36.576 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T13:35:36.577 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:35:37.642 INFO:teuthology.orchestra.run.smithi040.stdout:generic/206 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-17T13:35:37.659 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/206 2023-12-17T13:35:37.659 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/206 2023-12-17T13:35:37.659 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T13:35:37.672 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:35:37.893 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T13:35:37.893 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/207) 2023-12-17T13:35:38.464 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T13:35:38.480 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T13:35:38.482 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T13:35:38.487 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T13:35:38.487 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:35:41.844 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T13:35:41.851 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T13:35:46.879 INFO:teuthology.orchestra.run.smithi040.stdout:generic/207 8s 2023-12-17T13:35:46.902 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/207 2023-12-17T13:35:46.902 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T13:35:46.914 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:35:47.016 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T13:35:47.016 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/208) 2023-12-17T13:35:47.677 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T13:35:47.688 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T13:35:47.689 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T13:35:47.692 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T13:35:47.692 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:36:11.986 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T13:36:11.996 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T13:36:42.134 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T13:36:42.141 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T13:37:12.263 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T13:37:12.273 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T13:37:12.383 INFO:tasks.ceph.osd.4.smithi159.stderr:2023-12-17T13:37:12.393+0000 7f2f7c3d6640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 100306) UID: 0 2023-12-17T13:37:12.384 INFO:tasks.ceph.osd.5.smithi159.stderr:2023-12-17T13:37:12.393+0000 7fca99737640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 100306) UID: 0 2023-12-17T13:37:12.384 INFO:tasks.ceph.osd.6.smithi159.stderr:2023-12-17T13:37:12.393+0000 7efd98236640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 100306) UID: 0 2023-12-17T13:37:12.385 INFO:tasks.ceph.osd.7.smithi159.stderr:2023-12-17T13:37:12.393+0000 7f2a65aa4640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 100306) UID: 0 2023-12-17T13:39:08.519 INFO:teuthology.orchestra.run.smithi040.stdout:generic/208 201s 2023-12-17T13:39:08.534 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/208 2023-12-17T13:39:08.534 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T13:39:08.542 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:39:08.641 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T13:39:08.642 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/209) 2023-12-17T13:39:09.386 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T13:39:09.401 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T13:39:09.404 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T13:39:09.408 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T13:39:09.408 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:39:48.723 INFO:teuthology.orchestra.run.smithi040.stdout:generic/209 39s 2023-12-17T13:39:48.739 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/209 2023-12-17T13:39:48.739 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T13:39:48.747 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:39:48.874 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T13:39:48.874 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/210) 2023-12-17T13:39:49.533 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T13:39:49.546 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T13:39:49.547 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T13:39:49.550 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T13:39:49.550 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:39:50.500 INFO:teuthology.orchestra.run.smithi040.stdout:generic/210 1s 2023-12-17T13:39:50.521 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/210 2023-12-17T13:39:50.521 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T13:39:50.534 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:39:50.632 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T13:39:50.632 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/211) 2023-12-17T13:39:51.311 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T13:39:51.325 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T13:39:51.327 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T13:39:51.330 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T13:39:51.330 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:39:52.644 INFO:teuthology.orchestra.run.smithi040.stdout:generic/211 1s 2023-12-17T13:39:52.661 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/211 2023-12-17T13:39:52.661 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T13:39:52.670 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:39:52.729 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T13:39:52.729 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/212) 2023-12-17T13:39:53.360 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T13:39:53.372 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T13:39:53.373 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T13:39:53.376 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T13:39:53.376 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:39:54.279 INFO:teuthology.orchestra.run.smithi040.stdout:generic/212 1s 2023-12-17T13:39:54.298 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/212 2023-12-17T13:39:54.298 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T13:39:54.307 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:39:54.353 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T13:39:54.353 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/213) 2023-12-17T13:39:54.990 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T13:39:55.005 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T13:39:55.007 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T13:39:55.011 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T13:39:55.011 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:39:55.763 INFO:teuthology.orchestra.run.smithi040.stdout:generic/213 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-12-17T13:39:55.777 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/213 2023-12-17T13:39:55.778 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/213 2023-12-17T13:39:55.778 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T13:39:55.790 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:39:55.838 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T13:39:55.839 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/214) 2023-12-17T13:39:56.469 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T13:39:56.482 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T13:39:56.483 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T13:39:56.486 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T13:39:56.486 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:39:57.237 INFO:teuthology.orchestra.run.smithi040.stdout:generic/214 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-12-17T13:39:57.252 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/214 2023-12-17T13:39:57.252 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/214 2023-12-17T13:39:57.252 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T13:39:57.261 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:39:57.302 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T13:39:57.302 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/215) 2023-12-17T13:39:57.942 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T13:39:57.958 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T13:39:57.960 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T13:39:57.964 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T13:39:57.964 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:40:00.812 INFO:teuthology.orchestra.run.smithi040.stdout:generic/215 2s 2023-12-17T13:40:00.827 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/215 2023-12-17T13:40:00.827 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T13:40:00.835 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:40:00.935 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T13:40:00.935 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/216) 2023-12-17T13:40:01.592 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T13:40:01.606 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T13:40:01.608 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T13:40:01.612 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T13:40:01.612 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:40:02.637 INFO:teuthology.orchestra.run.smithi040.stdout:generic/216 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-17T13:40:02.659 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/216 2023-12-17T13:40:02.660 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/216 2023-12-17T13:40:02.660 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T13:40:02.679 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:40:02.929 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T13:40:02.929 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/217) 2023-12-17T13:40:03.504 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T13:40:03.520 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T13:40:03.522 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T13:40:03.526 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T13:40:03.526 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:40:04.660 INFO:teuthology.orchestra.run.smithi040.stdout:generic/217 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-17T13:40:04.679 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/217 2023-12-17T13:40:04.679 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/217 2023-12-17T13:40:04.679 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T13:40:04.692 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:40:04.964 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T13:40:04.964 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/218) 2023-12-17T13:40:05.501 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T13:40:05.516 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T13:40:05.518 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T13:40:05.522 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T13:40:05.522 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:40:06.587 INFO:teuthology.orchestra.run.smithi040.stdout:generic/218 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-17T13:40:06.610 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/218 2023-12-17T13:40:06.610 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/218 2023-12-17T13:40:06.611 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T13:40:06.623 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:40:06.944 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T13:40:06.945 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/219) 2023-12-17T13:40:07.464 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T13:40:07.481 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T13:40:07.483 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T13:40:07.486 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T13:40:07.486 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:40:08.164 INFO:teuthology.orchestra.run.smithi040.stdout:generic/219 [not run] disk quotas not supported by this filesystem type: ceph 2023-12-17T13:40:08.178 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/219 2023-12-17T13:40:08.179 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/219 2023-12-17T13:40:08.179 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T13:40:08.191 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:40:08.245 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T13:40:08.246 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/220) 2023-12-17T13:40:08.904 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T13:40:08.920 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T13:40:08.922 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T13:40:08.926 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T13:40:08.926 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:40:09.994 INFO:teuthology.orchestra.run.smithi040.stdout:generic/220 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-17T13:40:10.021 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/220 2023-12-17T13:40:10.022 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/220 2023-12-17T13:40:10.022 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T13:40:10.032 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:40:10.317 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T13:40:10.317 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/221) 2023-12-17T13:40:10.864 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T13:40:10.880 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T13:40:10.882 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T13:40:10.886 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T13:40:10.886 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:40:12.665 INFO:teuthology.orchestra.run.smithi040.stdout:generic/221 1s 2023-12-17T13:40:12.681 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/221 2023-12-17T13:40:12.681 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T13:40:12.689 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:40:12.737 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T13:40:12.737 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/222) 2023-12-17T13:40:13.362 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T13:40:13.377 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T13:40:13.379 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T13:40:13.383 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T13:40:13.384 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:40:14.506 INFO:teuthology.orchestra.run.smithi040.stdout:generic/222 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-17T13:40:14.534 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/222 2023-12-17T13:40:14.534 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/222 2023-12-17T13:40:14.534 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T13:40:14.553 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:40:14.820 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T13:40:14.820 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/223) 2023-12-17T13:40:15.315 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T13:40:15.329 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T13:40:15.331 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T13:40:15.335 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T13:40:15.335 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:40:16.051 INFO:teuthology.orchestra.run.smithi040.stdout:generic/223 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-12-17T13:40:16.062 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/223 2023-12-17T13:40:16.062 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/223 2023-12-17T13:40:16.062 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T13:40:16.070 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:40:16.113 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T13:40:16.113 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/224) 2023-12-17T13:40:16.744 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T13:40:16.759 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T13:40:16.760 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T13:40:16.764 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T13:40:16.764 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:40:17.451 INFO:teuthology.orchestra.run.smithi040.stdout:generic/224 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-12-17T13:40:17.465 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/224 2023-12-17T13:40:17.465 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/224 2023-12-17T13:40:17.465 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T13:40:17.476 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:40:17.519 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T13:40:17.519 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/225) 2023-12-17T13:40:18.152 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T13:40:18.166 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T13:40:18.167 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T13:40:18.171 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T13:40:18.171 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:40:18.999 INFO:teuthology.orchestra.run.smithi040.stdout:generic/225 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-12-17T13:40:19.013 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/225 2023-12-17T13:40:19.014 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/225 2023-12-17T13:40:19.014 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T13:40:19.025 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:40:19.126 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T13:40:19.126 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/226) 2023-12-17T13:40:19.836 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T13:40:19.847 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T13:40:19.848 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T13:40:19.851 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T13:40:19.851 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:40:20.507 INFO:teuthology.orchestra.run.smithi040.stdout:generic/226 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-12-17T13:40:20.522 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/226 2023-12-17T13:40:20.522 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/226 2023-12-17T13:40:20.522 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T13:40:20.534 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:40:20.577 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T13:40:20.577 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/227) 2023-12-17T13:40:21.163 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T13:40:21.181 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T13:40:21.183 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T13:40:21.188 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T13:40:21.188 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:40:22.262 INFO:teuthology.orchestra.run.smithi040.stdout:generic/227 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-17T13:40:22.285 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/227 2023-12-17T13:40:22.286 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/227 2023-12-17T13:40:22.286 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T13:40:22.309 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:40:22.585 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T13:40:22.585 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/228) 2023-12-17T13:40:23.113 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T13:40:23.129 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T13:40:23.131 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T13:40:23.135 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T13:40:23.135 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:40:23.947 INFO:teuthology.orchestra.run.smithi040.stdout:generic/228 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-12-17T13:40:23.966 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/228 2023-12-17T13:40:23.966 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/228 2023-12-17T13:40:23.966 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T13:40:23.979 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:40:24.026 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T13:40:24.026 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/229) 2023-12-17T13:40:24.691 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T13:40:24.706 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T13:40:24.707 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T13:40:24.711 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T13:40:24.711 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:40:25.772 INFO:teuthology.orchestra.run.smithi040.stdout:generic/229 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-17T13:40:25.796 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/229 2023-12-17T13:40:25.797 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/229 2023-12-17T13:40:25.797 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T13:40:25.814 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:40:26.095 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T13:40:26.096 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/230) 2023-12-17T13:40:26.630 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T13:40:26.646 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T13:40:26.649 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T13:40:26.652 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T13:40:26.653 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:40:27.380 INFO:teuthology.orchestra.run.smithi040.stdout:generic/230 [not run] disk quotas not supported by this filesystem type: ceph 2023-12-17T13:40:27.394 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/230 2023-12-17T13:40:27.394 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/230 2023-12-17T13:40:27.394 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T13:40:27.405 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:40:27.448 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T13:40:27.448 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/231) 2023-12-17T13:40:28.119 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T13:40:28.135 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T13:40:28.136 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T13:40:28.137 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T13:40:28.142 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T13:40:28.143 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T13:40:28.143 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:40:28.802 INFO:teuthology.orchestra.run.smithi040.stdout:generic/231 [not run] disk quotas not supported by this filesystem type: ceph 2023-12-17T13:40:28.816 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/231 2023-12-17T13:40:28.816 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/231 2023-12-17T13:40:28.816 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T13:40:28.826 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:40:28.868 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T13:40:28.868 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/232) 2023-12-17T13:40:29.521 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T13:40:29.534 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T13:40:29.536 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T13:40:29.539 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T13:40:29.539 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:40:30.226 INFO:teuthology.orchestra.run.smithi040.stdout:generic/232 [not run] disk quotas not supported by this filesystem type: ceph 2023-12-17T13:40:30.241 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/232 2023-12-17T13:40:30.241 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/232 2023-12-17T13:40:30.241 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T13:40:30.251 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:40:30.294 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T13:40:30.294 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/233) 2023-12-17T13:40:30.921 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T13:40:30.936 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T13:40:30.938 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T13:40:30.941 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T13:40:30.941 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:40:31.603 INFO:teuthology.orchestra.run.smithi040.stdout:generic/233 [not run] disk quotas not supported by this filesystem type: ceph 2023-12-17T13:40:31.617 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/233 2023-12-17T13:40:31.617 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/233 2023-12-17T13:40:31.618 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T13:40:31.628 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:40:31.668 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T13:40:31.668 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/234) 2023-12-17T13:40:32.313 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T13:40:32.329 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T13:40:32.330 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T13:40:32.334 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T13:40:32.334 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:40:33.046 INFO:teuthology.orchestra.run.smithi040.stdout:generic/234 [not run] disk quotas not supported by this filesystem type: ceph 2023-12-17T13:40:33.061 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/234 2023-12-17T13:40:33.061 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/234 2023-12-17T13:40:33.061 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T13:40:33.072 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:40:33.118 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T13:40:33.119 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/235) 2023-12-17T13:40:33.781 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T13:40:33.796 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T13:40:33.798 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T13:40:33.801 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T13:40:33.802 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:40:34.505 INFO:teuthology.orchestra.run.smithi040.stdout:generic/235 [not run] disk quotas not supported by this filesystem type: ceph 2023-12-17T13:40:34.518 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/235 2023-12-17T13:40:34.518 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/235 2023-12-17T13:40:34.519 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T13:40:34.529 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:40:34.571 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T13:40:34.571 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/236) 2023-12-17T13:40:35.194 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T13:40:35.207 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T13:40:35.208 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T13:40:35.211 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T13:40:35.212 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:40:37.106 INFO:teuthology.orchestra.run.smithi040.stdout:generic/236 2s 2023-12-17T13:40:37.125 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/236 2023-12-17T13:40:37.125 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T13:40:37.134 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:40:37.235 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T13:40:37.236 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/237) 2023-12-17T13:40:37.921 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T13:40:37.935 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T13:40:37.936 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T13:40:37.939 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T13:40:37.939 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:40:38.862 INFO:teuthology.orchestra.run.smithi040.stdout:generic/237 0s 2023-12-17T13:40:38.881 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/237 2023-12-17T13:40:38.881 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T13:40:38.890 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:40:38.999 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T13:40:38.999 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/238) 2023-12-17T13:40:39.712 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T13:40:39.724 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T13:40:39.726 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T13:40:39.729 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T13:40:39.730 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:40:40.788 INFO:teuthology.orchestra.run.smithi040.stdout:generic/238 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-17T13:40:40.818 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/238 2023-12-17T13:40:40.818 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/238 2023-12-17T13:40:40.818 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T13:40:40.834 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:40:41.128 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T13:40:41.128 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/239) 2023-12-17T13:40:41.661 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T13:40:41.675 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T13:40:41.678 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T13:40:41.683 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T13:40:41.683 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:40:58.350 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T13:40:58.360 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T13:41:28.516 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T13:41:28.527 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T13:41:58.873 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T13:41:58.879 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T13:42:29.043 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T13:42:29.055 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T13:42:45.743 INFO:teuthology.orchestra.run.smithi040.stdout:generic/239 124s 2023-12-17T13:42:45.755 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/239 2023-12-17T13:42:45.756 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T13:42:45.762 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:42:45.872 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T13:42:45.872 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/240) 2023-12-17T13:42:46.530 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T13:42:46.543 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T13:42:46.545 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T13:42:46.548 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T13:42:46.548 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:42:48.217 INFO:teuthology.orchestra.run.smithi040.stdout:generic/240 2s 2023-12-17T13:42:48.237 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/240 2023-12-17T13:42:48.237 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T13:42:48.247 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:42:48.371 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T13:42:48.371 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/241) 2023-12-17T13:42:49.087 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T13:42:49.098 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T13:42:49.099 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T13:42:49.102 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T13:42:49.102 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:42:59.202 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T13:42:59.212 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T13:43:29.347 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T13:43:29.358 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T13:43:59.482 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T13:43:59.488 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T13:44:05.613 INFO:teuthology.orchestra.run.smithi040.stdout:generic/241 76s 2023-12-17T13:44:05.649 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/241 2023-12-17T13:44:05.649 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T13:44:05.659 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:44:07.390 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T13:44:07.391 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/242) 2023-12-17T13:44:08.347 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T13:44:08.369 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T13:44:08.372 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T13:44:08.378 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T13:44:08.379 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:44:09.350 INFO:teuthology.orchestra.run.smithi040.stdout:generic/242 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-17T13:44:09.366 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/242 2023-12-17T13:44:09.367 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/242 2023-12-17T13:44:09.367 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T13:44:09.382 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:44:09.541 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T13:44:09.541 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/243) 2023-12-17T13:44:10.101 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T13:44:10.114 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T13:44:10.116 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T13:44:10.119 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T13:44:10.119 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:44:11.167 INFO:teuthology.orchestra.run.smithi040.stdout:generic/243 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-17T13:44:11.188 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/243 2023-12-17T13:44:11.189 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/243 2023-12-17T13:44:11.189 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T13:44:11.205 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:44:11.478 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T13:44:11.478 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/244) 2023-12-17T13:44:11.985 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T13:44:11.998 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T13:44:11.999 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T13:44:12.003 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T13:44:12.003 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:44:12.701 INFO:teuthology.orchestra.run.smithi040.stdout:generic/244 [not run] disk quotas not supported by this filesystem type: ceph 2023-12-17T13:44:12.713 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/244 2023-12-17T13:44:12.713 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/244 2023-12-17T13:44:12.713 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T13:44:12.722 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:44:12.770 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T13:44:12.770 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/245) 2023-12-17T13:44:13.406 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T13:44:13.419 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T13:44:13.420 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T13:44:13.424 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T13:44:13.424 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:44:14.296 INFO:teuthology.orchestra.run.smithi040.stdout:generic/245 1s 2023-12-17T13:44:14.318 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/245 2023-12-17T13:44:14.318 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T13:44:14.328 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:44:14.443 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T13:44:14.443 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/246) 2023-12-17T13:44:15.159 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T13:44:15.174 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T13:44:15.176 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T13:44:15.179 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T13:44:15.179 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:44:15.971 INFO:teuthology.orchestra.run.smithi040.stdout:generic/246 0s 2023-12-17T13:44:15.989 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/246 2023-12-17T13:44:15.989 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T13:44:15.997 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:44:16.112 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T13:44:16.112 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/247) 2023-12-17T13:44:16.799 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T13:44:16.810 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T13:44:16.812 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T13:44:16.815 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T13:44:16.815 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:44:28.592 INFO:teuthology.orchestra.run.smithi040.stdout:generic/247 11s 2023-12-17T13:44:28.607 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/247 2023-12-17T13:44:28.607 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T13:44:28.617 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:44:28.640 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T13:44:28.640 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/248) 2023-12-17T13:44:29.259 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T13:44:29.274 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T13:44:29.276 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T13:44:29.279 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T13:44:29.279 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:44:30.062 INFO:teuthology.orchestra.run.smithi040.stdout:generic/248 1s 2023-12-17T13:44:30.081 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/248 2023-12-17T13:44:30.081 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T13:44:30.091 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:44:30.146 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T13:44:30.147 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/249) 2023-12-17T13:44:30.799 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T13:44:30.813 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T13:44:30.815 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T13:44:30.819 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T13:44:30.819 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:44:31.756 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T13:44:31.763 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T13:44:32.023 INFO:teuthology.orchestra.run.smithi040.stdout:generic/249 1s 2023-12-17T13:44:32.043 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/249 2023-12-17T13:44:32.043 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T13:44:32.053 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:44:32.165 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T13:44:32.165 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/250) 2023-12-17T13:44:32.902 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T13:44:32.916 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T13:44:32.918 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T13:44:32.921 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T13:44:32.921 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:44:33.690 INFO:teuthology.orchestra.run.smithi040.stdout:generic/250 [not run] require 172.21.15.40:6789:/scratch to be valid block disk 2023-12-17T13:44:33.703 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/250 2023-12-17T13:44:33.703 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/250 2023-12-17T13:44:33.703 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T13:44:33.713 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:44:33.756 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T13:44:33.756 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/251) 2023-12-17T13:44:34.429 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T13:44:34.444 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T13:44:34.446 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T13:44:34.449 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T13:44:34.449 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:44:35.369 INFO:teuthology.orchestra.run.smithi040.stdout:generic/251 [not run] FITRIM not supported on /tmp/tmp.k3h64vAtcuscratch 2023-12-17T13:44:35.391 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/251 2023-12-17T13:44:35.391 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/251 2023-12-17T13:44:35.392 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T13:44:35.401 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:44:35.438 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T13:44:35.438 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/252) 2023-12-17T13:44:36.099 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T13:44:36.114 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T13:44:36.116 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T13:44:36.119 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T13:44:36.119 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:44:36.867 INFO:teuthology.orchestra.run.smithi040.stdout:generic/252 [not run] require 172.21.15.40:6789:/scratch to be valid block disk 2023-12-17T13:44:36.884 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/252 2023-12-17T13:44:36.884 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/252 2023-12-17T13:44:36.884 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T13:44:36.897 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:44:36.943 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T13:44:36.943 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/253) 2023-12-17T13:44:37.597 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T13:44:37.612 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T13:44:37.614 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T13:44:37.617 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T13:44:37.618 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:44:38.711 INFO:teuthology.orchestra.run.smithi040.stdout:generic/253 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-17T13:44:38.737 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/253 2023-12-17T13:44:38.737 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/253 2023-12-17T13:44:38.737 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T13:44:38.751 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:44:38.977 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T13:44:38.978 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/254) 2023-12-17T13:44:39.533 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T13:44:39.548 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T13:44:39.550 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T13:44:39.553 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T13:44:39.554 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:44:40.598 INFO:teuthology.orchestra.run.smithi040.stdout:generic/254 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-17T13:44:40.623 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/254 2023-12-17T13:44:40.623 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/254 2023-12-17T13:44:40.623 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T13:44:40.643 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:44:40.931 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T13:44:40.931 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/255) 2023-12-17T13:44:41.453 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T13:44:41.468 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T13:44:41.470 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T13:44:41.473 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T13:44:41.473 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:44:42.461 INFO:teuthology.orchestra.run.smithi040.stdout:generic/255 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-12-17T13:44:42.475 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/255 2023-12-17T13:44:42.475 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/255 2023-12-17T13:44:42.475 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T13:44:42.483 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:44:42.586 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T13:44:42.586 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/256) 2023-12-17T13:44:43.315 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T13:44:43.330 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T13:44:43.332 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T13:44:43.335 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T13:44:43.335 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:44:44.695 INFO:teuthology.orchestra.run.smithi040.stdout:generic/256 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-12-17T13:44:44.709 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/256 2023-12-17T13:44:44.709 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/256 2023-12-17T13:44:44.709 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T13:44:44.720 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:44:44.763 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T13:44:44.763 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/257) 2023-12-17T13:44:45.437 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T13:44:45.454 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T13:44:45.456 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T13:44:45.459 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T13:44:45.459 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:44:47.332 INFO:teuthology.orchestra.run.smithi040.stdout:generic/257 2s 2023-12-17T13:44:47.349 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/257 2023-12-17T13:44:47.349 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T13:44:47.359 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:44:47.456 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T13:44:47.456 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/258) 2023-12-17T13:44:48.162 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T13:44:48.174 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T13:44:48.175 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T13:44:48.178 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T13:44:48.178 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:44:48.872 INFO:teuthology.orchestra.run.smithi040.stdout:generic/258 [not run] ceph does not support negative timestamps 2023-12-17T13:44:48.886 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/258 2023-12-17T13:44:48.886 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/258 2023-12-17T13:44:48.886 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T13:44:48.895 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:44:48.936 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T13:44:48.936 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/259) 2023-12-17T13:44:49.539 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T13:44:49.554 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T13:44:49.556 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T13:44:49.560 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T13:44:49.560 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:44:50.618 INFO:teuthology.orchestra.run.smithi040.stdout:generic/259 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-17T13:44:50.638 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/259 2023-12-17T13:44:50.639 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/259 2023-12-17T13:44:50.639 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T13:44:50.655 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:44:50.961 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T13:44:50.962 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/260) 2023-12-17T13:44:51.480 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T13:44:51.497 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T13:44:51.499 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T13:44:51.502 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T13:44:51.502 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:44:52.412 INFO:teuthology.orchestra.run.smithi040.stdout:generic/260 [not run] FITRIM not supported on /tmp/tmp.k3h64vAtcuscratch 2023-12-17T13:44:52.439 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/260 2023-12-17T13:44:52.439 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/260 2023-12-17T13:44:52.439 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T13:44:52.452 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:44:52.491 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T13:44:52.492 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/261) 2023-12-17T13:44:53.171 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T13:44:53.186 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T13:44:53.188 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T13:44:53.192 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T13:44:53.192 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:44:54.313 INFO:teuthology.orchestra.run.smithi040.stdout:generic/261 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-17T13:44:54.329 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/261 2023-12-17T13:44:54.329 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/261 2023-12-17T13:44:54.329 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T13:44:54.342 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:44:54.539 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T13:44:54.539 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/262) 2023-12-17T13:44:55.145 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T13:44:55.160 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T13:44:55.162 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T13:44:55.166 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T13:44:55.166 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:44:56.260 INFO:teuthology.orchestra.run.smithi040.stdout:generic/262 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-17T13:44:56.289 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/262 2023-12-17T13:44:56.289 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/262 2023-12-17T13:44:56.289 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T13:44:56.313 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:44:56.588 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T13:44:56.589 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/263) 2023-12-17T13:44:57.100 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T13:44:57.115 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T13:44:57.117 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T13:44:57.121 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T13:44:57.121 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:45:01.911 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T13:45:01.921 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T13:45:32.352 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T13:45:32.365 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T13:46:02.513 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T13:46:02.526 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T13:46:32.696 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T13:46:32.707 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T13:46:41.142 INFO:teuthology.orchestra.run.smithi040.stdout:generic/263 104s 2023-12-17T13:46:41.159 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/263 2023-12-17T13:46:41.160 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T13:46:41.170 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:46:41.297 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T13:46:41.297 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/264) 2023-12-17T13:46:42.027 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T13:46:42.042 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T13:46:42.043 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T13:46:42.047 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T13:46:42.047 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:46:43.076 INFO:teuthology.orchestra.run.smithi040.stdout:generic/264 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-17T13:46:43.100 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/264 2023-12-17T13:46:43.100 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/264 2023-12-17T13:46:43.100 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T13:46:43.116 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:46:43.386 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T13:46:43.386 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/265) 2023-12-17T13:46:43.934 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T13:46:43.951 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T13:46:43.953 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T13:46:43.958 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T13:46:43.958 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:46:45.057 INFO:teuthology.orchestra.run.smithi040.stdout:generic/265 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-17T13:46:45.074 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/265 2023-12-17T13:46:45.074 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/265 2023-12-17T13:46:45.075 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T13:46:45.087 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:46:45.180 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T13:46:45.180 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/266) 2023-12-17T13:46:45.783 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T13:46:45.796 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T13:46:45.797 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T13:46:45.801 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T13:46:45.801 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:46:46.902 INFO:teuthology.orchestra.run.smithi040.stdout:generic/266 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-17T13:46:46.919 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/266 2023-12-17T13:46:46.920 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/266 2023-12-17T13:46:46.920 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T13:46:46.933 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:46:47.120 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T13:46:47.120 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/267) 2023-12-17T13:46:47.686 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T13:46:47.702 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T13:46:47.704 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T13:46:47.708 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T13:46:47.709 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:46:48.790 INFO:teuthology.orchestra.run.smithi040.stdout:generic/267 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-17T13:46:48.806 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/267 2023-12-17T13:46:48.806 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/267 2023-12-17T13:46:48.806 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T13:46:48.819 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:46:49.053 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T13:46:49.054 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/268) 2023-12-17T13:46:49.593 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T13:46:49.607 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T13:46:49.609 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T13:46:49.612 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T13:46:49.612 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:46:50.738 INFO:teuthology.orchestra.run.smithi040.stdout:generic/268 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-17T13:46:50.756 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/268 2023-12-17T13:46:50.757 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/268 2023-12-17T13:46:50.757 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T13:46:50.771 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:46:50.898 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T13:46:50.898 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/269) 2023-12-17T13:46:51.472 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T13:46:51.487 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T13:46:51.489 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T13:46:51.492 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T13:46:51.492 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:46:52.210 INFO:teuthology.orchestra.run.smithi040.stdout:generic/269 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-12-17T13:46:52.223 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/269 2023-12-17T13:46:52.223 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/269 2023-12-17T13:46:52.224 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T13:46:52.233 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:46:52.276 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T13:46:52.276 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/270) 2023-12-17T13:46:52.934 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T13:46:52.950 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T13:46:52.953 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T13:46:52.957 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T13:46:52.957 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:46:53.649 INFO:teuthology.orchestra.run.smithi040.stdout:generic/270 [not run] disk quotas not supported by this filesystem type: ceph 2023-12-17T13:46:53.663 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/270 2023-12-17T13:46:53.663 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/270 2023-12-17T13:46:53.663 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T13:46:53.674 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:46:53.714 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T13:46:53.715 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/271) 2023-12-17T13:46:54.351 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T13:46:54.367 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T13:46:54.369 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T13:46:54.372 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T13:46:54.373 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:46:55.465 INFO:teuthology.orchestra.run.smithi040.stdout:generic/271 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-17T13:46:55.491 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/271 2023-12-17T13:46:55.493 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/271 2023-12-17T13:46:55.493 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T13:46:55.517 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:46:55.621 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T13:46:55.621 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/272) 2023-12-17T13:46:56.191 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T13:46:56.206 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T13:46:56.208 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T13:46:56.212 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T13:46:56.212 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:46:57.346 INFO:teuthology.orchestra.run.smithi040.stdout:generic/272 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-17T13:46:57.366 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/272 2023-12-17T13:46:57.366 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/272 2023-12-17T13:46:57.366 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T13:46:57.386 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:46:57.591 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T13:46:57.591 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/273) 2023-12-17T13:46:58.135 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T13:46:58.151 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T13:46:58.152 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T13:46:58.156 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T13:46:58.156 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:46:58.886 INFO:teuthology.orchestra.run.smithi040.stdout:generic/273 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-12-17T13:46:58.899 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/273 2023-12-17T13:46:58.899 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/273 2023-12-17T13:46:58.899 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T13:46:58.908 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:46:58.958 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T13:46:58.958 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/274) 2023-12-17T13:46:59.585 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T13:46:59.600 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T13:46:59.601 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T13:46:59.605 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T13:46:59.605 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:47:00.325 INFO:teuthology.orchestra.run.smithi040.stdout:generic/274 [not run] xfs_io falloc -k failed (old kernel/wrong fs?) 2023-12-17T13:47:00.342 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/274 2023-12-17T13:47:00.342 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/274 2023-12-17T13:47:00.342 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T13:47:00.355 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:47:00.410 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T13:47:00.411 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/275) 2023-12-17T13:47:01.029 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T13:47:01.043 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T13:47:01.045 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T13:47:01.049 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T13:47:01.049 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:47:01.774 INFO:teuthology.orchestra.run.smithi040.stdout:generic/275 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-12-17T13:47:01.788 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/275 2023-12-17T13:47:01.788 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/275 2023-12-17T13:47:01.788 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T13:47:01.801 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:47:01.842 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T13:47:01.842 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/276) 2023-12-17T13:47:02.489 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T13:47:02.503 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T13:47:02.504 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T13:47:02.507 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T13:47:02.507 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:47:02.853 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T13:47:02.860 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T13:47:03.571 INFO:teuthology.orchestra.run.smithi040.stdout:generic/276 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-17T13:47:03.589 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/276 2023-12-17T13:47:03.591 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/276 2023-12-17T13:47:03.591 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T13:47:03.609 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:47:03.828 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T13:47:03.829 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/277) 2023-12-17T13:47:04.355 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T13:47:04.367 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T13:47:04.368 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T13:47:04.372 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T13:47:04.372 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:47:05.110 INFO:teuthology.orchestra.run.smithi040.stdout:generic/277 [not run] file system doesn't support chattr +A 2023-12-17T13:47:05.123 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/277 2023-12-17T13:47:05.124 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/277 2023-12-17T13:47:05.124 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T13:47:05.134 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:47:05.195 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T13:47:05.196 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/278) 2023-12-17T13:47:05.830 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T13:47:05.845 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T13:47:05.846 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T13:47:05.850 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T13:47:05.850 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:47:06.990 INFO:teuthology.orchestra.run.smithi040.stdout:generic/278 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-17T13:47:07.009 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/278 2023-12-17T13:47:07.009 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/278 2023-12-17T13:47:07.009 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T13:47:07.024 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:47:07.189 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T13:47:07.189 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/279) 2023-12-17T13:47:07.742 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T13:47:07.756 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T13:47:07.757 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T13:47:07.761 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T13:47:07.761 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:47:08.902 INFO:teuthology.orchestra.run.smithi040.stdout:generic/279 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-17T13:47:08.919 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/279 2023-12-17T13:47:08.919 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/279 2023-12-17T13:47:08.919 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T13:47:08.934 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:47:09.068 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T13:47:09.068 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/280) 2023-12-17T13:47:09.648 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T13:47:09.661 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T13:47:09.662 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T13:47:09.666 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T13:47:09.666 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:47:10.763 INFO:teuthology.orchestra.run.smithi040.stdout:generic/280 [not run] disk quotas not supported by this filesystem type: ceph 2023-12-17T13:47:10.776 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/280 2023-12-17T13:47:10.776 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/280 2023-12-17T13:47:10.777 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T13:47:10.786 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:47:10.836 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T13:47:10.836 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/281) 2023-12-17T13:47:11.504 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T13:47:11.522 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T13:47:11.523 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T13:47:11.527 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T13:47:11.527 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:47:12.676 INFO:teuthology.orchestra.run.smithi040.stdout:generic/281 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-17T13:47:12.701 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/281 2023-12-17T13:47:12.701 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/281 2023-12-17T13:47:12.702 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T13:47:12.710 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:47:12.869 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T13:47:12.869 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/282) 2023-12-17T13:47:13.400 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T13:47:13.414 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T13:47:13.416 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T13:47:13.419 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T13:47:13.419 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:47:14.497 INFO:teuthology.orchestra.run.smithi040.stdout:generic/282 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-17T13:47:14.515 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/282 2023-12-17T13:47:14.515 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/282 2023-12-17T13:47:14.515 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T13:47:14.528 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:47:14.692 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T13:47:14.692 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/283) 2023-12-17T13:47:15.256 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T13:47:15.272 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T13:47:15.273 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T13:47:15.277 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T13:47:15.277 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:47:16.423 INFO:teuthology.orchestra.run.smithi040.stdout:generic/283 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-17T13:47:16.440 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/283 2023-12-17T13:47:16.441 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/283 2023-12-17T13:47:16.441 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T13:47:16.453 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:47:16.688 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T13:47:16.688 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/284) 2023-12-17T13:47:17.209 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T13:47:17.224 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T13:47:17.226 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T13:47:17.230 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T13:47:17.230 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:47:18.328 INFO:teuthology.orchestra.run.smithi040.stdout:generic/284 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-17T13:47:18.350 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/284 2023-12-17T13:47:18.356 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/284 2023-12-17T13:47:18.356 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T13:47:18.363 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:47:18.532 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T13:47:18.533 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/285) 2023-12-17T13:47:19.142 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T13:47:19.157 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T13:47:19.158 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T13:47:19.162 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T13:47:19.162 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:47:22.438 INFO:teuthology.orchestra.run.smithi040.stdout:generic/285 3s 2023-12-17T13:47:22.456 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/285 2023-12-17T13:47:22.456 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T13:47:22.466 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:47:22.982 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T13:47:22.983 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/286) 2023-12-17T13:47:23.676 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T13:47:23.691 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T13:47:23.692 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T13:47:23.696 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T13:47:23.696 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:47:24.386 INFO:teuthology.orchestra.run.smithi040.stdout:generic/286 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-12-17T13:47:24.398 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/286 2023-12-17T13:47:24.398 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/286 2023-12-17T13:47:24.398 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T13:47:24.409 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:47:24.456 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T13:47:24.456 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/287) 2023-12-17T13:47:25.077 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T13:47:25.090 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T13:47:25.091 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T13:47:25.096 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T13:47:25.096 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:47:26.072 INFO:teuthology.orchestra.run.smithi040.stdout:generic/287 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-17T13:47:26.088 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/287 2023-12-17T13:47:26.088 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/287 2023-12-17T13:47:26.089 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T13:47:26.105 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:47:26.282 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T13:47:26.282 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/288) 2023-12-17T13:47:26.962 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T13:47:26.975 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T13:47:26.977 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T13:47:26.980 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T13:47:26.980 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:47:27.833 INFO:teuthology.orchestra.run.smithi040.stdout:generic/288 [not run] FITRIM not supported on /tmp/tmp.k3h64vAtcuscratch 2023-12-17T13:47:27.857 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/288 2023-12-17T13:47:27.857 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/288 2023-12-17T13:47:27.857 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T13:47:27.865 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:47:27.903 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T13:47:27.903 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/289) 2023-12-17T13:47:28.517 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T13:47:28.527 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T13:47:28.528 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T13:47:28.531 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T13:47:28.531 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:47:29.509 INFO:teuthology.orchestra.run.smithi040.stdout:generic/289 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-17T13:47:29.531 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/289 2023-12-17T13:47:29.532 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/289 2023-12-17T13:47:29.532 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T13:47:29.547 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:47:29.800 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T13:47:29.800 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/290) 2023-12-17T13:47:30.356 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T13:47:30.369 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T13:47:30.370 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T13:47:30.373 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T13:47:30.374 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:47:31.579 INFO:teuthology.orchestra.run.smithi040.stdout:generic/290 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-17T13:47:31.604 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/290 2023-12-17T13:47:31.604 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/290 2023-12-17T13:47:31.609 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T13:47:31.632 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:47:31.745 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T13:47:31.746 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/291) 2023-12-17T13:47:32.328 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T13:47:32.344 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T13:47:32.345 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T13:47:32.349 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T13:47:32.349 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:47:32.986 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T13:47:32.991 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T13:47:33.413 INFO:teuthology.orchestra.run.smithi040.stdout:generic/291 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-17T13:47:33.433 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/291 2023-12-17T13:47:33.433 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/291 2023-12-17T13:47:33.433 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T13:47:33.450 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:47:33.573 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T13:47:33.573 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/292) 2023-12-17T13:47:34.163 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T13:47:34.178 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T13:47:34.181 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T13:47:34.185 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T13:47:34.186 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:47:35.227 INFO:teuthology.orchestra.run.smithi040.stdout:generic/292 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-17T13:47:35.244 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/292 2023-12-17T13:47:35.244 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/292 2023-12-17T13:47:35.244 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T13:47:35.257 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:47:35.449 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T13:47:35.449 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/293) 2023-12-17T13:47:36.019 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T13:47:36.032 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T13:47:36.033 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T13:47:36.037 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T13:47:36.037 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:47:37.101 INFO:teuthology.orchestra.run.smithi040.stdout:generic/293 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-17T13:47:37.127 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/293 2023-12-17T13:47:37.127 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/293 2023-12-17T13:47:37.127 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T13:47:37.150 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:47:37.300 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T13:47:37.300 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/294) 2023-12-17T13:47:37.884 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T13:47:37.898 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T13:47:37.900 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T13:47:37.904 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T13:47:37.904 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:47:39.154 INFO:teuthology.orchestra.run.smithi040.stdout:generic/294 1s 2023-12-17T13:47:39.195 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/294 2023-12-17T13:47:39.195 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T13:47:39.210 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:47:39.264 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T13:47:39.264 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/295) 2023-12-17T13:47:39.858 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T13:47:39.873 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T13:47:39.875 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T13:47:39.879 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T13:47:39.879 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:47:40.970 INFO:teuthology.orchestra.run.smithi040.stdout:generic/295 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-17T13:47:40.989 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/295 2023-12-17T13:47:40.989 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/295 2023-12-17T13:47:40.990 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T13:47:41.002 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:47:41.232 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T13:47:41.232 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/296) 2023-12-17T13:47:41.816 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T13:47:41.831 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T13:47:41.833 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T13:47:41.836 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T13:47:41.836 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:47:42.943 INFO:teuthology.orchestra.run.smithi040.stdout:generic/296 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-17T13:47:42.959 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/296 2023-12-17T13:47:42.959 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/296 2023-12-17T13:47:42.960 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T13:47:42.972 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:47:43.134 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T13:47:43.134 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/297) 2023-12-17T13:47:43.702 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T13:47:43.716 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T13:47:43.717 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T13:47:43.720 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T13:47:43.720 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:47:44.771 INFO:teuthology.orchestra.run.smithi040.stdout:generic/297 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-17T13:47:44.787 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/297 2023-12-17T13:47:44.788 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/297 2023-12-17T13:47:44.788 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T13:47:44.800 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:47:44.955 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T13:47:44.956 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/298) 2023-12-17T13:47:45.570 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T13:47:45.583 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T13:47:45.585 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T13:47:45.588 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T13:47:45.589 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:47:46.678 INFO:teuthology.orchestra.run.smithi040.stdout:generic/298 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-17T13:47:46.709 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/298 2023-12-17T13:47:46.709 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/298 2023-12-17T13:47:46.709 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T13:47:46.731 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:47:46.898 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T13:47:46.898 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/299) 2023-12-17T13:47:47.494 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T13:47:47.510 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T13:47:47.512 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T13:47:47.515 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T13:47:47.516 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:47:48.406 INFO:teuthology.orchestra.run.smithi040.stdout:generic/299 [not run] require 172.21.15.40:6789:/scratch to be valid block disk 2023-12-17T13:47:48.420 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/299 2023-12-17T13:47:48.420 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/299 2023-12-17T13:47:48.420 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T13:47:48.431 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:47:48.478 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T13:47:48.478 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/300) 2023-12-17T13:47:49.105 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T13:47:49.119 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T13:47:49.121 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T13:47:49.124 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T13:47:49.124 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:47:49.923 INFO:teuthology.orchestra.run.smithi040.stdout:generic/300 [not run] require 172.21.15.40:6789:/scratch to be valid block disk 2023-12-17T13:47:49.939 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/300 2023-12-17T13:47:49.939 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/300 2023-12-17T13:47:49.939 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T13:47:49.953 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:47:50.000 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T13:47:50.000 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/301) 2023-12-17T13:47:50.679 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T13:47:50.695 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T13:47:50.697 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T13:47:50.700 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T13:47:50.700 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:47:51.787 INFO:teuthology.orchestra.run.smithi040.stdout:generic/301 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-17T13:47:51.804 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/301 2023-12-17T13:47:51.804 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/301 2023-12-17T13:47:51.805 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T13:47:51.817 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:47:52.090 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T13:47:52.090 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/302) 2023-12-17T13:47:52.643 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T13:47:52.656 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T13:47:52.658 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T13:47:52.662 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T13:47:52.662 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:47:53.723 INFO:teuthology.orchestra.run.smithi040.stdout:generic/302 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-17T13:47:53.739 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/302 2023-12-17T13:47:53.739 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/302 2023-12-17T13:47:53.741 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T13:47:53.756 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:47:53.912 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T13:47:53.912 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/303) 2023-12-17T13:47:54.494 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T13:47:54.508 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T13:47:54.509 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T13:47:54.513 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T13:47:54.513 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:47:55.380 INFO:teuthology.orchestra.run.smithi040.stdout:generic/303 [not run] Reflink not supported by test filesystem type: ceph 2023-12-17T13:47:55.397 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/303 2023-12-17T13:47:55.397 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/303 2023-12-17T13:47:55.397 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T13:47:55.407 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:47:55.540 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T13:47:55.541 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/304) 2023-12-17T13:47:56.229 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T13:47:56.242 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T13:47:56.244 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T13:47:56.247 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T13:47:56.247 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:47:56.984 INFO:teuthology.orchestra.run.smithi040.stdout:generic/304 [not run] Dedupe not supported by test filesystem type: ceph 2023-12-17T13:47:56.999 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/304 2023-12-17T13:47:56.999 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/304 2023-12-17T13:47:56.999 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T13:47:57.009 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:47:57.151 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T13:47:57.151 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/305) 2023-12-17T13:47:57.843 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T13:47:57.856 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T13:47:57.858 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T13:47:57.861 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T13:47:57.861 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:47:58.939 INFO:teuthology.orchestra.run.smithi040.stdout:generic/305 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-17T13:47:58.962 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/305 2023-12-17T13:47:58.964 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/305 2023-12-17T13:47:58.964 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T13:47:58.981 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:47:59.217 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T13:47:59.217 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/306) 2023-12-17T13:47:59.771 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T13:47:59.787 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T13:47:59.790 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T13:47:59.795 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T13:47:59.795 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:48:01.262 INFO:teuthology.orchestra.run.smithi040.stdout:generic/306 1s 2023-12-17T13:48:01.297 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/306 2023-12-17T13:48:01.297 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T13:48:01.310 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:48:01.592 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T13:48:01.592 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/307) 2023-12-17T13:48:02.268 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T13:48:02.281 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T13:48:02.283 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T13:48:02.286 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T13:48:02.286 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:48:03.121 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T13:48:03.127 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T13:48:04.591 INFO:teuthology.orchestra.run.smithi040.stdout:generic/307 2s 2023-12-17T13:48:04.610 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/307 2023-12-17T13:48:04.610 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T13:48:04.619 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:48:04.648 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T13:48:04.649 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/308) 2023-12-17T13:48:05.317 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T13:48:05.333 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T13:48:05.335 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T13:48:05.339 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T13:48:05.339 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:48:06.094 INFO:teuthology.orchestra.run.smithi040.stdout:generic/308 1s 2023-12-17T13:48:06.112 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/308 2023-12-17T13:48:06.112 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T13:48:06.121 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:48:06.171 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T13:48:06.172 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/309) 2023-12-17T13:48:06.815 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T13:48:06.828 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T13:48:06.830 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T13:48:06.837 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T13:48:06.837 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:48:08.674 INFO:teuthology.orchestra.run.smithi040.stdout:generic/309 1s 2023-12-17T13:48:08.806 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/309 2023-12-17T13:48:08.806 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T13:48:08.818 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:48:08.944 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T13:48:08.944 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/310) 2023-12-17T13:48:09.637 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T13:48:09.650 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T13:48:09.651 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T13:48:09.655 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T13:48:09.655 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:48:33.808 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T13:48:33.818 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T13:49:03.971 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T13:49:03.981 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T13:49:34.136 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T13:49:34.146 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T13:49:41.006 INFO:teuthology.orchestra.run.smithi040.stdout:generic/310 91s 2023-12-17T13:49:41.026 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/310 2023-12-17T13:49:41.026 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T13:49:41.036 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:49:41.225 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T13:49:41.225 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/311) 2023-12-17T13:49:41.885 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T13:49:41.901 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T13:49:41.903 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T13:49:41.908 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T13:49:41.908 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:49:42.742 INFO:teuthology.orchestra.run.smithi040.stdout:generic/311 [not run] require 172.21.15.40:6789:/scratch to be valid block disk 2023-12-17T13:49:42.756 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/311 2023-12-17T13:49:42.756 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/311 2023-12-17T13:49:42.756 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T13:49:42.766 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:49:42.809 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T13:49:42.809 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/312) 2023-12-17T13:49:43.442 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T13:49:43.458 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T13:49:43.459 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T13:49:43.463 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T13:49:43.463 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:49:44.179 INFO:teuthology.orchestra.run.smithi040.stdout:generic/312 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-12-17T13:49:44.195 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/312 2023-12-17T13:49:44.195 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/312 2023-12-17T13:49:44.196 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T13:49:44.208 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:49:44.265 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T13:49:44.265 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/313) 2023-12-17T13:49:44.959 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T13:49:44.973 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T13:49:44.975 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T13:49:44.979 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T13:49:44.979 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:49:49.862 INFO:teuthology.orchestra.run.smithi040.stdout:generic/313 4s 2023-12-17T13:49:49.882 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/313 2023-12-17T13:49:49.882 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T13:49:49.891 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:49:49.934 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T13:49:49.934 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/314) 2023-12-17T13:49:50.591 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T13:49:50.608 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T13:49:50.610 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T13:49:50.613 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T13:49:50.613 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:49:51.890 INFO:teuthology.orchestra.run.smithi040.stdout:generic/314 1s 2023-12-17T13:49:51.908 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/314 2023-12-17T13:49:51.909 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T13:49:51.918 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:49:51.970 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T13:49:51.970 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/315) 2023-12-17T13:49:52.584 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T13:49:52.599 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T13:49:52.601 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T13:49:52.604 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T13:49:52.604 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:49:53.318 INFO:teuthology.orchestra.run.smithi040.stdout:generic/315 [not run] xfs_io falloc -k failed (old kernel/wrong fs?) 2023-12-17T13:49:53.332 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/315 2023-12-17T13:49:53.332 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/315 2023-12-17T13:49:53.332 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T13:49:53.341 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:49:53.392 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T13:49:53.393 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/316) 2023-12-17T13:49:54.043 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T13:49:54.057 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T13:49:54.059 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T13:49:54.062 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T13:49:54.063 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:49:55.142 INFO:teuthology.orchestra.run.smithi040.stdout:generic/316 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-12-17T13:49:55.157 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/316 2023-12-17T13:49:55.157 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/316 2023-12-17T13:49:55.158 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T13:49:55.169 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:49:55.287 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T13:49:55.287 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/317) 2023-12-17T13:49:55.993 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T13:49:56.005 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T13:49:56.006 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T13:49:56.009 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T13:49:56.009 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:49:57.596 INFO:teuthology.orchestra.run.smithi040.stdout:generic/317 1s 2023-12-17T13:49:57.612 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/317 2023-12-17T13:49:57.612 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T13:49:57.621 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:49:57.650 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T13:49:57.650 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/318) 2023-12-17T13:49:58.318 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T13:49:58.333 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T13:49:58.335 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T13:49:58.338 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T13:49:58.338 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:49:59.719 INFO:teuthology.orchestra.run.smithi040.stdout:generic/318 1s 2023-12-17T13:49:59.735 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/318 2023-12-17T13:49:59.735 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T13:49:59.743 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:49:59.772 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T13:49:59.773 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/319) 2023-12-17T13:50:00.407 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T13:50:00.421 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T13:50:00.423 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T13:50:00.427 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T13:50:00.428 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:50:01.493 INFO:teuthology.orchestra.run.smithi040.stdout:generic/319 1s 2023-12-17T13:50:01.509 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/319 2023-12-17T13:50:01.509 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T13:50:01.517 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:50:01.546 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T13:50:01.546 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/320) 2023-12-17T13:50:02.209 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T13:50:02.225 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T13:50:02.228 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T13:50:02.232 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T13:50:02.232 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:50:02.989 INFO:teuthology.orchestra.run.smithi040.stdout:generic/320 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-12-17T13:50:03.002 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/320 2023-12-17T13:50:03.002 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/320 2023-12-17T13:50:03.002 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T13:50:03.012 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:50:03.055 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T13:50:03.056 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/321) 2023-12-17T13:50:03.683 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T13:50:03.699 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T13:50:03.701 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T13:50:03.705 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T13:50:03.705 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:50:04.310 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T13:50:04.315 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T13:50:04.391 INFO:teuthology.orchestra.run.smithi040.stdout:generic/321 [not run] require 172.21.15.40:6789:/scratch to be valid block disk 2023-12-17T13:50:04.401 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/321 2023-12-17T13:50:04.401 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/321 2023-12-17T13:50:04.401 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T13:50:04.408 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:50:04.445 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T13:50:04.446 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/322) 2023-12-17T13:50:05.022 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T13:50:05.034 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T13:50:05.036 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T13:50:05.039 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T13:50:05.039 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:50:05.672 INFO:teuthology.orchestra.run.smithi040.stdout:generic/322 [not run] require 172.21.15.40:6789:/scratch to be valid block disk 2023-12-17T13:50:05.684 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/322 2023-12-17T13:50:05.684 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/322 2023-12-17T13:50:05.684 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T13:50:05.694 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:50:05.733 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T13:50:05.734 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/323) 2023-12-17T13:50:06.344 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T13:50:06.357 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T13:50:06.358 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T13:50:06.362 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T13:50:06.362 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:50:34.448 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T13:50:34.458 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T13:51:04.572 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T13:51:04.584 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T13:51:04.702 INFO:tasks.ceph.osd.4.smithi159.stderr:2023-12-17T13:51:04.704+0000 7f2f7c3d6640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 100928) UID: 0 2023-12-17T13:51:04.702 INFO:tasks.ceph.osd.5.smithi159.stderr:2023-12-17T13:51:04.704+0000 7fca99737640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 100928) UID: 0 2023-12-17T13:51:04.703 INFO:tasks.ceph.osd.6.smithi159.stderr:2023-12-17T13:51:04.704+0000 7efd98236640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 100928) UID: 0 2023-12-17T13:51:04.703 INFO:tasks.ceph.osd.7.smithi159.stderr:2023-12-17T13:51:04.704+0000 7f2a65aa4640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 100928) UID: 0 2023-12-17T13:52:07.976 INFO:teuthology.orchestra.run.smithi040.stdout:generic/323 121s 2023-12-17T13:52:07.995 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/323 2023-12-17T13:52:07.995 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T13:52:08.005 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:52:08.102 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T13:52:08.102 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/324) 2023-12-17T13:52:08.813 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T13:52:08.825 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T13:52:08.826 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T13:52:08.830 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T13:52:08.830 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:52:09.546 INFO:teuthology.orchestra.run.smithi040.stdout:generic/324 [not run] defragmentation not supported for fstype "ceph" 2023-12-17T13:52:09.561 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/324 2023-12-17T13:52:09.561 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/324 2023-12-17T13:52:09.561 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T13:52:09.574 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:52:09.619 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T13:52:09.620 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/325) 2023-12-17T13:52:10.300 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T13:52:10.314 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T13:52:10.315 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T13:52:10.319 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T13:52:10.319 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:52:11.053 INFO:teuthology.orchestra.run.smithi040.stdout:generic/325 [not run] require 172.21.15.40:6789:/scratch to be valid block disk 2023-12-17T13:52:11.066 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/325 2023-12-17T13:52:11.066 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/325 2023-12-17T13:52:11.066 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T13:52:11.076 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:52:11.123 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T13:52:11.123 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/326) 2023-12-17T13:52:11.771 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T13:52:11.787 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T13:52:11.789 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T13:52:11.794 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T13:52:11.794 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:52:12.841 INFO:teuthology.orchestra.run.smithi040.stdout:generic/326 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-17T13:52:12.852 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/326 2023-12-17T13:52:12.853 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/326 2023-12-17T13:52:12.853 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T13:52:12.865 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:52:13.133 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T13:52:13.134 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/327) 2023-12-17T13:52:13.670 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T13:52:13.684 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T13:52:13.686 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T13:52:13.690 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T13:52:13.690 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:52:14.781 INFO:teuthology.orchestra.run.smithi040.stdout:generic/327 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-17T13:52:14.806 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/327 2023-12-17T13:52:14.806 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/327 2023-12-17T13:52:14.807 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T13:52:14.820 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:52:15.089 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T13:52:15.090 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/328) 2023-12-17T13:52:15.657 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T13:52:15.673 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T13:52:15.674 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T13:52:15.678 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T13:52:15.678 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:52:16.772 INFO:teuthology.orchestra.run.smithi040.stdout:generic/328 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-17T13:52:16.798 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/328 2023-12-17T13:52:16.800 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/328 2023-12-17T13:52:16.800 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T13:52:16.818 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:52:17.022 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T13:52:17.023 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/329) 2023-12-17T13:52:17.588 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T13:52:17.602 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T13:52:17.604 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T13:52:17.607 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T13:52:17.607 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:52:18.766 INFO:teuthology.orchestra.run.smithi040.stdout:generic/329 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-17T13:52:18.789 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/329 2023-12-17T13:52:18.789 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/329 2023-12-17T13:52:18.789 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T13:52:18.821 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:52:19.018 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T13:52:19.019 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/330) 2023-12-17T13:52:19.552 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T13:52:19.567 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T13:52:19.569 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T13:52:19.572 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T13:52:19.573 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:52:20.683 INFO:teuthology.orchestra.run.smithi040.stdout:generic/330 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-17T13:52:20.702 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/330 2023-12-17T13:52:20.702 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/330 2023-12-17T13:52:20.703 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T13:52:20.716 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:52:20.894 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T13:52:20.894 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/331) 2023-12-17T13:52:21.469 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T13:52:21.485 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T13:52:21.486 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T13:52:21.489 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T13:52:21.489 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:52:22.643 INFO:teuthology.orchestra.run.smithi040.stdout:generic/331 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-17T13:52:22.664 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/331 2023-12-17T13:52:22.664 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/331 2023-12-17T13:52:22.664 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T13:52:22.677 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:52:22.896 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T13:52:22.896 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/332) 2023-12-17T13:52:23.455 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T13:52:23.471 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T13:52:23.473 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T13:52:23.477 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T13:52:23.477 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:52:24.618 INFO:teuthology.orchestra.run.smithi040.stdout:generic/332 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-17T13:52:24.631 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/332 2023-12-17T13:52:24.632 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/332 2023-12-17T13:52:24.633 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T13:52:24.645 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:52:24.946 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T13:52:24.948 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/333) 2023-12-17T13:52:25.478 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T13:52:25.493 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T13:52:25.495 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T13:52:25.499 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T13:52:25.499 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:52:26.613 INFO:teuthology.orchestra.run.smithi040.stdout:generic/333 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-17T13:52:26.634 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/333 2023-12-17T13:52:26.634 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/333 2023-12-17T13:52:26.635 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T13:52:26.653 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:52:26.873 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T13:52:26.873 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/334) 2023-12-17T13:52:27.423 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T13:52:27.439 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T13:52:27.441 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T13:52:27.445 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T13:52:27.445 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:52:28.537 INFO:teuthology.orchestra.run.smithi040.stdout:generic/334 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-17T13:52:28.561 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/334 2023-12-17T13:52:28.566 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/334 2023-12-17T13:52:28.566 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T13:52:28.582 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:52:28.792 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T13:52:28.792 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/335) 2023-12-17T13:52:29.324 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T13:52:29.339 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T13:52:29.341 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T13:52:29.344 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T13:52:29.344 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:52:30.153 INFO:teuthology.orchestra.run.smithi040.stdout:generic/335 [not run] require 172.21.15.40:6789:/scratch to be valid block disk 2023-12-17T13:52:30.169 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/335 2023-12-17T13:52:30.170 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/335 2023-12-17T13:52:30.170 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T13:52:30.182 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:52:30.237 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T13:52:30.237 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/336) 2023-12-17T13:52:30.909 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T13:52:30.925 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T13:52:30.927 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T13:52:30.931 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T13:52:30.931 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:52:31.706 INFO:teuthology.orchestra.run.smithi040.stdout:generic/336 [not run] require 172.21.15.40:6789:/scratch to be valid block disk 2023-12-17T13:52:31.721 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/336 2023-12-17T13:52:31.721 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/336 2023-12-17T13:52:31.721 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T13:52:31.733 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:52:31.796 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T13:52:31.796 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/337) 2023-12-17T13:52:32.429 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T13:52:32.444 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T13:52:32.446 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T13:52:32.451 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T13:52:32.451 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:52:33.531 INFO:teuthology.orchestra.run.smithi040.stdout:generic/337 1s 2023-12-17T13:52:33.550 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/337 2023-12-17T13:52:33.550 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T13:52:33.561 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:52:33.592 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T13:52:33.592 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/338) 2023-12-17T13:52:34.245 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T13:52:34.261 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T13:52:34.263 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T13:52:34.268 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T13:52:34.268 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:52:35.055 INFO:teuthology.orchestra.run.smithi040.stdout:generic/338 [not run] require 172.21.15.40:6789:/scratch to be valid block disk 2023-12-17T13:52:35.073 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/338 2023-12-17T13:52:35.073 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/338 2023-12-17T13:52:35.073 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T13:52:35.086 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:52:35.139 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T13:52:35.139 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/339) 2023-12-17T13:52:35.789 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T13:52:35.805 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T13:52:35.807 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T13:52:35.810 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T13:52:35.810 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:54:08.474 INFO:teuthology.orchestra.run.smithi040.stdout:generic/339 92s 2023-12-17T13:54:08.491 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/339 2023-12-17T13:54:08.491 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T13:54:08.501 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:54:08.529 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T13:54:08.530 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/340) 2023-12-17T13:54:09.315 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T13:54:09.326 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T13:54:09.327 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T13:54:09.330 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T13:54:09.330 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:54:14.963 INFO:teuthology.orchestra.run.smithi040.stdout:generic/340 5s 2023-12-17T13:54:14.995 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/340 2023-12-17T13:54:14.995 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T13:54:15.016 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:54:15.056 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T13:54:15.056 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/341) 2023-12-17T13:54:15.807 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T13:54:15.830 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T13:54:15.833 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T13:54:15.840 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T13:54:15.840 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:54:16.491 INFO:teuthology.orchestra.run.smithi040.stdout:generic/341 [not run] require 172.21.15.40:6789:/scratch to be valid block disk 2023-12-17T13:54:16.502 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/341 2023-12-17T13:54:16.503 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/341 2023-12-17T13:54:16.503 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T13:54:16.515 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:54:16.568 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T13:54:16.568 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/342) 2023-12-17T13:54:17.205 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T13:54:17.220 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T13:54:17.222 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T13:54:17.226 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T13:54:17.226 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:54:17.963 INFO:teuthology.orchestra.run.smithi040.stdout:generic/342 [not run] require 172.21.15.40:6789:/scratch to be valid block disk 2023-12-17T13:54:17.979 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/342 2023-12-17T13:54:17.980 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/342 2023-12-17T13:54:17.980 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T13:54:17.993 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:54:18.043 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T13:54:18.044 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/343) 2023-12-17T13:54:18.116 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T13:54:18.125 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T13:54:18.712 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T13:54:18.729 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T13:54:18.731 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T13:54:18.736 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T13:54:18.736 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:54:19.547 INFO:teuthology.orchestra.run.smithi040.stdout:generic/343 [not run] require 172.21.15.40:6789:/scratch to be valid block disk 2023-12-17T13:54:19.560 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/343 2023-12-17T13:54:19.560 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/343 2023-12-17T13:54:19.560 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T13:54:19.570 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:54:19.629 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T13:54:19.630 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/344) 2023-12-17T13:54:20.305 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T13:54:20.320 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T13:54:20.322 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T13:54:20.326 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T13:54:20.326 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:54:31.551 INFO:teuthology.orchestra.run.smithi040.stdout:generic/344 11s 2023-12-17T13:54:31.588 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/344 2023-12-17T13:54:31.588 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T13:54:31.602 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:54:31.638 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T13:54:31.638 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/345) 2023-12-17T13:54:32.365 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T13:54:32.380 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T13:54:32.381 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T13:54:32.385 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T13:54:32.385 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:54:45.045 INFO:teuthology.orchestra.run.smithi040.stdout:generic/345 13s 2023-12-17T13:54:45.075 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/345 2023-12-17T13:54:45.075 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T13:54:45.090 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:54:45.149 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T13:54:45.149 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/346) 2023-12-17T13:54:45.909 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T13:54:45.928 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T13:54:45.929 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T13:54:45.932 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T13:54:45.932 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:54:48.304 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T13:54:48.316 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T13:54:51.713 INFO:teuthology.orchestra.run.smithi040.stdout:generic/346 5s 2023-12-17T13:54:51.748 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/346 2023-12-17T13:54:51.748 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T13:54:51.767 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:54:51.820 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T13:54:51.821 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/347) 2023-12-17T13:54:52.534 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T13:54:52.549 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T13:54:52.551 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T13:54:52.554 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T13:54:52.554 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:54:53.308 INFO:teuthology.orchestra.run.smithi040.stdout:generic/347 [not run] require 172.21.15.40:6789:/scratch to be valid block disk 2023-12-17T13:54:53.324 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/347 2023-12-17T13:54:53.325 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/347 2023-12-17T13:54:53.325 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T13:54:53.338 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:54:53.387 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T13:54:53.388 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/348) 2023-12-17T13:54:54.007 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T13:54:54.022 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T13:54:54.024 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T13:54:54.027 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T13:54:54.027 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:54:54.801 INFO:teuthology.orchestra.run.smithi040.stdout:generic/348 [not run] require 172.21.15.40:6789:/scratch to be valid block disk 2023-12-17T13:54:54.818 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/348 2023-12-17T13:54:54.819 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/348 2023-12-17T13:54:54.819 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T13:54:54.831 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:54:54.895 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T13:54:54.895 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/349) 2023-12-17T13:54:55.563 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T13:54:55.578 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T13:54:55.580 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T13:54:55.584 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T13:54:55.584 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:54:56.577 INFO:teuthology.orchestra.run.smithi040.stdout:generic/349 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2023-12-17T13:54:56.592 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/349 2023-12-17T13:54:56.592 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/349 2023-12-17T13:54:56.592 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T13:54:56.604 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:54:56.676 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T13:54:56.676 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/350) 2023-12-17T13:54:57.330 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T13:54:57.346 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T13:54:57.348 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T13:54:57.351 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T13:54:57.351 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:54:59.109 INFO:teuthology.orchestra.run.smithi040.stdout:generic/350 2s 2023-12-17T13:54:59.126 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/350 2023-12-17T13:54:59.126 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T13:54:59.135 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:54:59.164 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T13:54:59.164 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/351) 2023-12-17T13:54:59.838 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T13:54:59.854 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T13:54:59.856 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T13:54:59.859 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T13:54:59.860 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:55:00.626 INFO:teuthology.orchestra.run.smithi040.stdout:generic/351 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-12-17T13:55:00.642 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/351 2023-12-17T13:55:00.642 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/351 2023-12-17T13:55:00.642 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T13:55:00.652 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:55:00.717 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T13:55:00.717 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/352) 2023-12-17T13:55:01.339 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T13:55:01.353 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T13:55:01.354 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T13:55:01.358 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T13:55:01.358 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:55:02.533 INFO:teuthology.orchestra.run.smithi040.stdout:generic/352 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-17T13:55:02.549 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/352 2023-12-17T13:55:02.549 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/352 2023-12-17T13:55:02.549 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T13:55:02.562 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:55:02.854 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T13:55:02.855 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/353) 2023-12-17T13:55:03.379 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T13:55:03.392 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T13:55:03.394 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T13:55:03.398 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T13:55:03.398 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:55:04.512 INFO:teuthology.orchestra.run.smithi040.stdout:generic/353 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-17T13:55:04.533 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/353 2023-12-17T13:55:04.533 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/353 2023-12-17T13:55:04.533 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T13:55:04.549 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:55:04.837 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T13:55:04.837 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/354) 2023-12-17T13:55:05.344 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T13:55:05.359 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T13:55:05.361 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T13:55:05.365 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T13:55:05.365 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:55:17.597 INFO:teuthology.orchestra.run.smithi040.stdout:generic/354 12s 2023-12-17T13:55:17.631 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/354 2023-12-17T13:55:17.632 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T13:55:17.650 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:55:17.693 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T13:55:17.693 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/355) 2023-12-17T13:55:18.341 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T13:55:18.354 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T13:55:18.357 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T13:55:18.360 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T13:55:18.360 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:55:18.483 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T13:55:18.491 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T13:55:19.882 INFO:teuthology.orchestra.run.smithi040.stdout:generic/355 1s 2023-12-17T13:55:19.903 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/355 2023-12-17T13:55:19.903 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T13:55:19.915 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:55:20.047 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T13:55:20.047 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/356) 2023-12-17T13:55:20.726 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T13:55:20.740 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T13:55:20.741 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T13:55:20.745 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T13:55:20.745 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:55:21.781 INFO:teuthology.orchestra.run.smithi040.stdout:generic/356 [not run] swapfiles are not supported 2023-12-17T13:55:21.795 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/356 2023-12-17T13:55:21.795 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/356 2023-12-17T13:55:21.795 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T13:55:21.805 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:55:21.858 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T13:55:21.858 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/357) 2023-12-17T13:55:22.511 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T13:55:22.528 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T13:55:22.531 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T13:55:22.535 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T13:55:22.536 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:55:23.609 INFO:teuthology.orchestra.run.smithi040.stdout:generic/357 [not run] swapfiles are not supported 2023-12-17T13:55:23.623 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/357 2023-12-17T13:55:23.624 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/357 2023-12-17T13:55:23.624 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T13:55:23.636 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:55:23.689 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T13:55:23.690 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/358) 2023-12-17T13:55:24.338 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T13:55:24.355 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T13:55:24.357 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T13:55:24.360 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T13:55:24.360 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:55:25.469 INFO:teuthology.orchestra.run.smithi040.stdout:generic/358 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-17T13:55:25.488 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/358 2023-12-17T13:55:25.491 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/358 2023-12-17T13:55:25.491 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T13:55:25.506 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:55:25.831 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T13:55:25.831 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/359) 2023-12-17T13:55:26.369 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T13:55:26.385 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T13:55:26.386 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T13:55:26.390 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T13:55:26.390 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:55:27.556 INFO:teuthology.orchestra.run.smithi040.stdout:generic/359 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-17T13:55:27.573 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/359 2023-12-17T13:55:27.573 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/359 2023-12-17T13:55:27.573 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T13:55:27.593 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:55:27.801 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T13:55:27.801 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/360) 2023-12-17T13:55:28.352 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T13:55:28.368 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T13:55:28.369 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T13:55:28.373 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T13:55:28.373 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:55:29.215 INFO:teuthology.orchestra.run.smithi040.stdout:generic/360 1s 2023-12-17T13:55:29.233 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/360 2023-12-17T13:55:29.233 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T13:55:29.242 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:55:29.306 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T13:55:29.306 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/361) 2023-12-17T13:55:29.954 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T13:55:29.968 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T13:55:29.969 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T13:55:29.972 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T13:55:29.972 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:55:30.744 INFO:teuthology.orchestra.run.smithi040.stdout:generic/361 [not run] require 172.21.15.40:6789:/scratch to be valid block disk 2023-12-17T13:55:30.758 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/361 2023-12-17T13:55:30.758 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/361 2023-12-17T13:55:30.758 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T13:55:30.770 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:55:30.826 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T13:55:30.826 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/362) 2023-12-17T13:55:31.502 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T13:55:31.518 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T13:55:31.520 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T13:55:31.524 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T13:55:31.524 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:55:32.230 INFO:teuthology.orchestra.run.smithi040.stdout:generic/362 [not run] this test requires richacl support on $SCRATCH_DEV 2023-12-17T13:55:32.246 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/362 2023-12-17T13:55:32.246 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/362 2023-12-17T13:55:32.246 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T13:55:32.258 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:55:32.306 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T13:55:32.307 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/363) 2023-12-17T13:55:32.938 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T13:55:32.950 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T13:55:32.951 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T13:55:32.955 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T13:55:32.955 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:55:33.678 INFO:teuthology.orchestra.run.smithi040.stdout:generic/363 [not run] this test requires richacl support on $SCRATCH_DEV 2023-12-17T13:55:33.694 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/363 2023-12-17T13:55:33.695 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/363 2023-12-17T13:55:33.695 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T13:55:33.707 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:55:33.755 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T13:55:33.755 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/364) 2023-12-17T13:55:34.445 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T13:55:34.460 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T13:55:34.462 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T13:55:34.466 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T13:55:34.466 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:55:35.169 INFO:teuthology.orchestra.run.smithi040.stdout:generic/364 [not run] this test requires richacl support on $SCRATCH_DEV 2023-12-17T13:55:35.183 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/364 2023-12-17T13:55:35.183 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/364 2023-12-17T13:55:35.183 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T13:55:35.193 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:55:35.240 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T13:55:35.240 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/365) 2023-12-17T13:55:35.920 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T13:55:35.935 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T13:55:35.937 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T13:55:35.941 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T13:55:35.941 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:55:36.632 INFO:teuthology.orchestra.run.smithi040.stdout:generic/365 [not run] this test requires richacl support on $SCRATCH_DEV 2023-12-17T13:55:36.647 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/365 2023-12-17T13:55:36.647 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/365 2023-12-17T13:55:36.648 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T13:55:36.661 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:55:36.711 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T13:55:36.712 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/366) 2023-12-17T13:55:37.399 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T13:55:37.415 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T13:55:37.416 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T13:55:37.420 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T13:55:37.420 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:55:38.143 INFO:teuthology.orchestra.run.smithi040.stdout:generic/366 [not run] this test requires richacl support on $SCRATCH_DEV 2023-12-17T13:55:38.157 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/366 2023-12-17T13:55:38.157 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/366 2023-12-17T13:55:38.157 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T13:55:38.167 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:55:38.221 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T13:55:38.222 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/367) 2023-12-17T13:55:38.939 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T13:55:38.956 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T13:55:38.959 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T13:55:38.963 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T13:55:38.963 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:55:39.689 INFO:teuthology.orchestra.run.smithi040.stdout:generic/367 [not run] this test requires richacl support on $SCRATCH_DEV 2023-12-17T13:55:39.703 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/367 2023-12-17T13:55:39.703 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/367 2023-12-17T13:55:39.704 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T13:55:39.713 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:55:39.761 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T13:55:39.761 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/368) 2023-12-17T13:55:40.421 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T13:55:40.434 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T13:55:40.436 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T13:55:40.439 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T13:55:40.439 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:55:41.149 INFO:teuthology.orchestra.run.smithi040.stdout:generic/368 [not run] this test requires richacl support on $SCRATCH_DEV 2023-12-17T13:55:41.164 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/368 2023-12-17T13:55:41.164 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/368 2023-12-17T13:55:41.164 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T13:55:41.176 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:55:41.225 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T13:55:41.225 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/369) 2023-12-17T13:55:41.886 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T13:55:41.902 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T13:55:41.904 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T13:55:41.907 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T13:55:41.907 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:55:42.589 INFO:teuthology.orchestra.run.smithi040.stdout:generic/369 [not run] this test requires richacl support on $SCRATCH_DEV 2023-12-17T13:55:42.603 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/369 2023-12-17T13:55:42.603 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/369 2023-12-17T13:55:42.603 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T13:55:42.612 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:55:42.656 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T13:55:42.656 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/370) 2023-12-17T13:55:43.295 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T13:55:43.310 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T13:55:43.311 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T13:55:43.315 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T13:55:43.315 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:55:44.009 INFO:teuthology.orchestra.run.smithi040.stdout:generic/370 [not run] this test requires richacl support on $SCRATCH_DEV 2023-12-17T13:55:44.027 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/370 2023-12-17T13:55:44.027 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/370 2023-12-17T13:55:44.027 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T13:55:44.040 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:55:44.096 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T13:55:44.096 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/371) 2023-12-17T13:55:44.766 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T13:55:44.783 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T13:55:44.785 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T13:55:44.790 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T13:55:44.790 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:55:45.526 INFO:teuthology.orchestra.run.smithi040.stdout:generic/371 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-12-17T13:55:45.543 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/371 2023-12-17T13:55:45.543 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/371 2023-12-17T13:55:45.543 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T13:55:45.555 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:55:45.622 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T13:55:45.622 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/372) 2023-12-17T13:55:46.287 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T13:55:46.299 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T13:55:46.302 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T13:55:46.305 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T13:55:46.306 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:55:47.349 INFO:teuthology.orchestra.run.smithi040.stdout:generic/372 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-17T13:55:47.377 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/372 2023-12-17T13:55:47.378 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/372 2023-12-17T13:55:47.378 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T13:55:47.400 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:55:47.620 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T13:55:47.620 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/373) 2023-12-17T13:55:48.223 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T13:55:48.235 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T13:55:48.237 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T13:55:48.240 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T13:55:48.241 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:55:48.631 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T13:55:48.638 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T13:55:49.354 INFO:teuthology.orchestra.run.smithi040.stdout:generic/373 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-17T13:55:49.378 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/373 2023-12-17T13:55:49.380 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/373 2023-12-17T13:55:49.380 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T13:55:49.398 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:55:49.623 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T13:55:49.624 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/374) 2023-12-17T13:55:50.197 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T13:55:50.210 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T13:55:50.212 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T13:55:50.215 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T13:55:50.215 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:55:51.237 INFO:teuthology.orchestra.run.smithi040.stdout:generic/374 [not run] Dedupe not supported by scratch filesystem type: ceph 2023-12-17T13:55:51.336 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/374 2023-12-17T13:55:51.336 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/374 2023-12-17T13:55:51.336 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T13:55:51.356 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:55:51.685 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T13:55:51.685 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/375) 2023-12-17T13:55:52.236 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T13:55:52.252 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T13:55:52.255 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T13:55:52.259 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T13:55:52.259 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:55:53.240 INFO:teuthology.orchestra.run.smithi040.stdout:generic/375 1s 2023-12-17T13:55:53.259 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/375 2023-12-17T13:55:53.259 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T13:55:53.268 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:55:53.379 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T13:55:53.380 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/376) 2023-12-17T13:55:54.089 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T13:55:54.105 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T13:55:54.107 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T13:55:54.111 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T13:55:54.111 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:55:54.871 INFO:teuthology.orchestra.run.smithi040.stdout:generic/376 [not run] require 172.21.15.40:6789:/scratch to be valid block disk 2023-12-17T13:55:54.887 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/376 2023-12-17T13:55:54.887 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/376 2023-12-17T13:55:54.888 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T13:55:54.900 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:55:54.950 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T13:55:54.950 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/377) 2023-12-17T13:55:55.568 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T13:55:55.582 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T13:55:55.584 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T13:55:55.588 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T13:55:55.588 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:55:56.687 INFO:teuthology.orchestra.run.smithi040.stdout:generic/377 1s 2023-12-17T13:55:56.705 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/377 2023-12-17T13:55:56.706 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T13:55:56.715 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:55:56.743 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T13:55:56.743 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/378) 2023-12-17T13:55:57.375 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T13:55:57.391 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T13:55:57.394 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T13:55:57.398 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T13:55:57.398 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:55:58.720 INFO:teuthology.orchestra.run.smithi040.stdout:generic/378 1s 2023-12-17T13:55:58.737 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/378 2023-12-17T13:55:58.737 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T13:55:58.745 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:55:58.889 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T13:55:58.889 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/379) 2023-12-17T13:55:59.623 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T13:55:59.636 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T13:55:59.638 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T13:55:59.641 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T13:55:59.641 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:56:00.382 INFO:teuthology.orchestra.run.smithi040.stdout:generic/379 [not run] disk quotas not supported by this filesystem type: ceph 2023-12-17T13:56:00.396 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/379 2023-12-17T13:56:00.396 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/379 2023-12-17T13:56:00.396 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T13:56:00.407 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:56:00.457 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T13:56:00.457 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/380) 2023-12-17T13:56:01.104 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T13:56:01.120 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T13:56:01.122 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T13:56:01.126 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T13:56:01.127 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:56:01.831 INFO:teuthology.orchestra.run.smithi040.stdout:generic/380 [not run] disk quotas not supported by this filesystem type: ceph 2023-12-17T13:56:01.846 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/380 2023-12-17T13:56:01.846 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/380 2023-12-17T13:56:01.846 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T13:56:01.858 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:56:01.911 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T13:56:01.911 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/381) 2023-12-17T13:56:02.583 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T13:56:02.598 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T13:56:02.600 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T13:56:02.603 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T13:56:02.603 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:56:03.345 INFO:teuthology.orchestra.run.smithi040.stdout:generic/381 [not run] disk quotas not supported by this filesystem type: ceph 2023-12-17T13:56:03.359 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/381 2023-12-17T13:56:03.359 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/381 2023-12-17T13:56:03.359 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T13:56:03.368 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:56:03.414 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T13:56:03.414 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/382) 2023-12-17T13:56:04.086 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T13:56:04.100 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T13:56:04.102 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T13:56:04.105 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T13:56:04.106 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:56:04.808 INFO:teuthology.orchestra.run.smithi040.stdout:generic/382 [not run] disk quotas not supported by this filesystem type: ceph 2023-12-17T13:56:04.821 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/382 2023-12-17T13:56:04.822 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/382 2023-12-17T13:56:04.822 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T13:56:04.831 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:56:04.878 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T13:56:04.879 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/383) 2023-12-17T13:56:05.520 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T13:56:05.535 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T13:56:05.537 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T13:56:05.540 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T13:56:05.540 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:56:06.266 INFO:teuthology.orchestra.run.smithi040.stdout:generic/383 [not run] disk quotas not supported by this filesystem type: ceph 2023-12-17T13:56:06.279 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/383 2023-12-17T13:56:06.279 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/383 2023-12-17T13:56:06.279 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T13:56:06.289 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:56:06.336 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T13:56:06.336 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/384) 2023-12-17T13:56:07.019 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T13:56:07.034 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T13:56:07.036 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T13:56:07.040 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T13:56:07.040 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:56:07.754 INFO:teuthology.orchestra.run.smithi040.stdout:generic/384 [not run] disk quotas not supported by this filesystem type: ceph 2023-12-17T13:56:07.767 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/384 2023-12-17T13:56:07.767 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/384 2023-12-17T13:56:07.767 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T13:56:07.778 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:56:07.826 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T13:56:07.826 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/385) 2023-12-17T13:56:08.508 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T13:56:08.524 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T13:56:08.526 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T13:56:08.530 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T13:56:08.530 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:56:09.218 INFO:teuthology.orchestra.run.smithi040.stdout:generic/385 [not run] disk quotas not supported by this filesystem type: ceph 2023-12-17T13:56:09.232 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/385 2023-12-17T13:56:09.232 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/385 2023-12-17T13:56:09.232 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T13:56:09.244 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:56:09.289 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T13:56:09.289 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/386) 2023-12-17T13:56:09.912 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T13:56:09.926 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T13:56:09.927 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T13:56:09.931 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T13:56:09.931 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:56:10.622 INFO:teuthology.orchestra.run.smithi040.stdout:generic/386 [not run] disk quotas not supported by this filesystem type: ceph 2023-12-17T13:56:10.635 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/386 2023-12-17T13:56:10.635 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/386 2023-12-17T13:56:10.635 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T13:56:10.648 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:56:10.701 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T13:56:10.702 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/387) 2023-12-17T13:56:11.381 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T13:56:11.397 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T13:56:11.398 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T13:56:11.402 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T13:56:11.402 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:56:12.575 INFO:teuthology.orchestra.run.smithi040.stdout:generic/387 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-17T13:56:12.594 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/387 2023-12-17T13:56:12.594 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/387 2023-12-17T13:56:12.594 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T13:56:12.607 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:56:12.922 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T13:56:12.922 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/388) 2023-12-17T13:56:13.465 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T13:56:13.478 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T13:56:13.479 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T13:56:13.482 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T13:56:13.483 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:56:14.254 INFO:teuthology.orchestra.run.smithi040.stdout:generic/388 [not run] require 172.21.15.40:6789:/scratch to be local device 2023-12-17T13:56:14.270 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/388 2023-12-17T13:56:14.270 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/388 2023-12-17T13:56:14.270 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T13:56:14.283 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:56:14.337 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T13:56:14.338 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/389) 2023-12-17T13:56:15.000 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T13:56:15.015 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T13:56:15.017 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T13:56:15.021 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T13:56:15.021 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:56:15.743 INFO:teuthology.orchestra.run.smithi040.stdout:generic/389 [not run] O_TMPFILE is not supported 2023-12-17T13:56:15.760 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/389 2023-12-17T13:56:15.760 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/389 2023-12-17T13:56:15.760 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T13:56:15.773 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:56:15.822 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T13:56:15.822 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/390) 2023-12-17T13:56:16.446 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T13:56:16.460 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T13:56:16.461 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T13:56:16.464 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T13:56:16.464 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:56:17.100 INFO:teuthology.orchestra.run.smithi040.stdout:generic/390 [not run] ceph does not support freezing 2023-12-17T13:56:17.111 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/390 2023-12-17T13:56:17.111 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/390 2023-12-17T13:56:17.111 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T13:56:17.119 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:56:17.164 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T13:56:17.164 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/391) 2023-12-17T13:56:17.718 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T13:56:17.731 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T13:56:17.732 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T13:56:17.735 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T13:56:17.735 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:56:18.478 INFO:teuthology.orchestra.run.smithi040.stdout:generic/391 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-12-17T13:56:18.494 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/391 2023-12-17T13:56:18.494 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/391 2023-12-17T13:56:18.494 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T13:56:18.506 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:56:18.575 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T13:56:18.576 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/392) 2023-12-17T13:56:18.953 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T13:56:18.960 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T13:56:19.222 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T13:56:19.237 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T13:56:19.239 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T13:56:19.243 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T13:56:19.243 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:56:20.232 INFO:teuthology.orchestra.run.smithi040.stdout:generic/392 [not run] ceph does not support shutdown 2023-12-17T13:56:20.262 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/392 2023-12-17T13:56:20.262 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/392 2023-12-17T13:56:20.262 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T13:56:20.271 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:56:20.313 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T13:56:20.314 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/393) 2023-12-17T13:56:20.965 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T13:56:20.982 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T13:56:20.984 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T13:56:20.987 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T13:56:20.987 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:56:23.003 INFO:teuthology.orchestra.run.smithi040.stdout:generic/393 1s 2023-12-17T13:56:23.022 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/393 2023-12-17T13:56:23.023 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T13:56:23.032 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:56:23.062 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T13:56:23.062 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/394) 2023-12-17T13:56:23.721 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T13:56:23.735 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T13:56:23.737 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T13:56:23.741 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T13:56:23.741 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:56:24.590 INFO:teuthology.orchestra.run.smithi040.stdout:generic/394 1s 2023-12-17T13:56:24.610 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/394 2023-12-17T13:56:24.610 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T13:56:24.620 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:56:24.720 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T13:56:24.720 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/395) 2023-12-17T13:56:25.477 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T13:56:25.492 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T13:56:25.493 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T13:56:25.498 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T13:56:25.498 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:56:27.698 INFO:teuthology.orchestra.run.smithi040.stdout:generic/395 2s 2023-12-17T13:56:27.740 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/395 2023-12-17T13:56:27.741 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T13:56:27.756 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:56:27.797 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T13:56:27.798 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/396) 2023-12-17T13:56:28.394 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T13:56:28.411 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T13:56:28.411 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T13:56:28.414 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T13:56:28.415 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:56:30.074 INFO:teuthology.orchestra.run.smithi040.stdout:generic/396 2s 2023-12-17T13:56:30.093 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/396 2023-12-17T13:56:30.093 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T13:56:30.103 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:56:30.134 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T13:56:30.134 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/397) 2023-12-17T13:56:30.783 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T13:56:30.798 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T13:56:30.800 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T13:56:30.804 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T13:56:30.804 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:56:33.586 INFO:teuthology.orchestra.run.smithi040.stdout:generic/397 2s 2023-12-17T13:56:33.604 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/397 2023-12-17T13:56:33.605 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T13:56:33.614 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:56:33.645 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T13:56:33.645 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/398) 2023-12-17T13:56:34.306 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T13:56:34.321 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T13:56:34.322 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T13:56:34.326 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T13:56:34.326 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:56:35.602 INFO:teuthology.orchestra.run.smithi040.stdout:generic/398 [not run] kernel doesn't support renameat2 syscall 2023-12-17T13:56:35.617 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/398 2023-12-17T13:56:35.617 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/398 2023-12-17T13:56:35.617 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T13:56:35.628 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:56:35.725 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T13:56:35.725 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/399) 2023-12-17T13:56:36.428 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T13:56:36.444 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T13:56:36.446 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T13:56:36.449 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T13:56:36.450 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:56:37.691 INFO:teuthology.orchestra.run.smithi040.stdout:generic/399 [not run] Filesystem ceph not supported in _scratch_mkfs_sized_encrypted 2023-12-17T13:56:37.708 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/399 2023-12-17T13:56:37.708 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/399 2023-12-17T13:56:37.708 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T13:56:37.719 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:56:37.783 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T13:56:37.784 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/400) 2023-12-17T13:56:38.444 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T13:56:38.458 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T13:56:38.460 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T13:56:38.464 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T13:56:38.464 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:56:39.143 INFO:teuthology.orchestra.run.smithi040.stdout:generic/400 [not run] disk quotas not supported by this filesystem type: ceph 2023-12-17T13:56:39.158 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/400 2023-12-17T13:56:39.158 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/400 2023-12-17T13:56:39.158 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T13:56:39.171 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:56:39.223 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T13:56:39.223 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/401) 2023-12-17T13:56:39.873 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T13:56:39.888 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T13:56:39.890 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T13:56:39.893 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T13:56:39.893 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:56:41.161 INFO:teuthology.orchestra.run.smithi040.stdout:generic/401 1s 2023-12-17T13:56:41.188 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/401 2023-12-17T13:56:41.188 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T13:56:41.208 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:56:41.267 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T13:56:41.268 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/402) 2023-12-17T13:56:41.905 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T13:56:41.920 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T13:56:41.922 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T13:56:41.925 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T13:56:41.925 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:56:42.952 INFO:teuthology.orchestra.run.smithi040.stdout:generic/402 [not run] filesystem ceph timestamp bounds are unknown 2023-12-17T13:56:42.979 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/402 2023-12-17T13:56:42.979 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/402 2023-12-17T13:56:42.979 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T13:56:42.990 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:56:43.036 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T13:56:43.037 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/403) 2023-12-17T13:56:43.684 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T13:56:43.700 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T13:56:43.702 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T13:56:43.706 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T13:56:43.709 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:56:45.274 INFO:teuthology.orchestra.run.smithi040.stdout:generic/403 2s 2023-12-17T13:56:45.292 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/403 2023-12-17T13:56:45.293 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T13:56:45.301 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:56:45.327 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T13:56:45.327 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/404) 2023-12-17T13:56:45.973 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T13:56:45.989 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T13:56:45.990 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T13:56:45.994 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T13:56:45.994 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:56:46.779 INFO:teuthology.orchestra.run.smithi040.stdout:generic/404 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-12-17T13:56:46.796 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/404 2023-12-17T13:56:46.796 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/404 2023-12-17T13:56:46.796 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T13:56:46.809 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:56:46.870 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T13:56:46.870 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/405) 2023-12-17T13:56:47.500 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T13:56:47.513 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T13:56:47.514 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T13:56:47.518 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T13:56:47.518 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:56:48.382 INFO:teuthology.orchestra.run.smithi040.stdout:generic/405 [not run] require 172.21.15.40:6789:/scratch to be valid block disk 2023-12-17T13:56:48.394 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/405 2023-12-17T13:56:48.394 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/405 2023-12-17T13:56:48.395 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T13:56:48.404 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:56:48.450 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T13:56:48.450 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/406) 2023-12-17T13:56:49.080 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T13:56:49.094 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T13:56:49.096 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T13:56:49.099 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T13:56:49.099 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:56:49.101 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T13:56:49.109 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T13:56:53.660 INFO:teuthology.orchestra.run.smithi040.stdout:generic/406 4s 2023-12-17T13:56:53.678 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/406 2023-12-17T13:56:53.679 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T13:56:53.688 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:56:53.716 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T13:56:53.717 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/407) 2023-12-17T13:56:54.361 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T13:56:54.376 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T13:56:54.378 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T13:56:54.382 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T13:56:54.382 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:56:55.262 INFO:teuthology.orchestra.run.smithi040.stdout:generic/407 [not run] Reflink not supported by test filesystem type: ceph 2023-12-17T13:56:55.282 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/407 2023-12-17T13:56:55.282 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/407 2023-12-17T13:56:55.282 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T13:56:55.295 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:56:55.438 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T13:56:55.439 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/408) 2023-12-17T13:56:56.088 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T13:56:56.103 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T13:56:56.105 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T13:56:56.108 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T13:56:56.108 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:56:56.959 INFO:teuthology.orchestra.run.smithi040.stdout:generic/408 [not run] Dedupe not supported by test filesystem type: ceph 2023-12-17T13:56:56.975 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/408 2023-12-17T13:56:56.975 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/408 2023-12-17T13:56:56.975 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T13:56:56.987 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:56:57.142 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T13:56:57.142 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/409) 2023-12-17T13:56:57.817 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T13:56:57.829 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T13:56:57.831 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T13:56:57.834 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T13:56:57.834 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:56:58.508 INFO:teuthology.orchestra.run.smithi040.stdout:generic/409 [not run] require 172.21.15.40:6789:/scratch to be local device 2023-12-17T13:56:58.520 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/409 2023-12-17T13:56:58.521 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/409 2023-12-17T13:56:58.521 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T13:56:58.530 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:56:58.572 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T13:56:58.572 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/410) 2023-12-17T13:56:59.227 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T13:56:59.241 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T13:56:59.243 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T13:56:59.246 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T13:56:59.247 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:56:59.999 INFO:teuthology.orchestra.run.smithi040.stdout:generic/410 [not run] require 172.21.15.40:6789:/scratch to be local device 2023-12-17T13:57:00.010 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/410 2023-12-17T13:57:00.010 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/410 2023-12-17T13:57:00.011 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T13:57:00.019 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:57:00.062 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T13:57:00.062 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/411) 2023-12-17T13:57:00.715 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T13:57:00.730 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T13:57:00.732 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T13:57:00.735 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T13:57:00.735 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:57:01.491 INFO:teuthology.orchestra.run.smithi040.stdout:generic/411 [not run] require 172.21.15.40:6789:/scratch to be local device 2023-12-17T13:57:01.505 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/411 2023-12-17T13:57:01.505 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/411 2023-12-17T13:57:01.505 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T13:57:01.516 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:57:01.572 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T13:57:01.572 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/412) 2023-12-17T13:57:02.269 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T13:57:02.283 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T13:57:02.284 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T13:57:02.288 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T13:57:02.288 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:57:03.616 INFO:teuthology.orchestra.run.smithi040.stdout:generic/412 1s 2023-12-17T13:57:03.635 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/412 2023-12-17T13:57:03.635 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T13:57:03.645 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:57:03.675 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T13:57:03.675 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/413) 2023-12-17T13:57:04.338 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T13:57:04.354 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T13:57:04.355 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T13:57:04.359 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T13:57:04.360 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:57:05.282 INFO:teuthology.orchestra.run.smithi040.stdout:generic/413 [not run] mount 172.21.15.40:6789:/scratch with dax failed 2023-12-17T13:57:05.294 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/413 2023-12-17T13:57:05.294 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/413 2023-12-17T13:57:05.294 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T13:57:05.304 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:57:05.362 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T13:57:05.362 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/414) 2023-12-17T13:57:06.000 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T13:57:06.014 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T13:57:06.016 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T13:57:06.019 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T13:57:06.020 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:57:07.143 INFO:teuthology.orchestra.run.smithi040.stdout:generic/414 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-17T13:57:07.160 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/414 2023-12-17T13:57:07.160 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/414 2023-12-17T13:57:07.160 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T13:57:07.174 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:57:07.390 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T13:57:07.390 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/415) 2023-12-17T13:57:07.947 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T13:57:07.962 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T13:57:07.964 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T13:57:07.967 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T13:57:07.967 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:57:09.079 INFO:teuthology.orchestra.run.smithi040.stdout:generic/415 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-17T13:57:09.098 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/415 2023-12-17T13:57:09.098 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/415 2023-12-17T13:57:09.098 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T13:57:09.113 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:57:09.418 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T13:57:09.418 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/416) 2023-12-17T13:57:09.964 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T13:57:09.980 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T13:57:09.981 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T13:57:09.985 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T13:57:09.985 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:57:10.719 INFO:teuthology.orchestra.run.smithi040.stdout:generic/416 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-12-17T13:57:10.735 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/416 2023-12-17T13:57:10.735 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/416 2023-12-17T13:57:10.735 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T13:57:10.748 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:57:10.804 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T13:57:10.805 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/417) 2023-12-17T13:57:11.496 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T13:57:11.511 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T13:57:11.513 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T13:57:11.516 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T13:57:11.516 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:57:12.435 INFO:teuthology.orchestra.run.smithi040.stdout:generic/417 [not run] ceph does not support shutdown 2023-12-17T13:57:12.483 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/417 2023-12-17T13:57:12.483 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/417 2023-12-17T13:57:12.484 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T13:57:12.497 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:57:12.541 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T13:57:12.541 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/418) 2023-12-17T13:57:13.203 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T13:57:13.217 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T13:57:13.219 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T13:57:13.222 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T13:57:13.223 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:57:14.038 INFO:teuthology.orchestra.run.smithi040.stdout:generic/418 [not run] require 172.21.15.40:6789:/test to be valid block disk 2023-12-17T13:57:14.054 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/418 2023-12-17T13:57:14.054 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/418 2023-12-17T13:57:14.054 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T13:57:14.067 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:57:14.119 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T13:57:14.119 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/419) 2023-12-17T13:57:14.746 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T13:57:14.762 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T13:57:14.763 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T13:57:14.767 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T13:57:14.767 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:57:16.029 INFO:teuthology.orchestra.run.smithi040.stdout:generic/419 [not run] kernel doesn't support renameat2 syscall 2023-12-17T13:57:16.045 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/419 2023-12-17T13:57:16.045 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/419 2023-12-17T13:57:16.045 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T13:57:16.059 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:57:16.187 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T13:57:16.187 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/420) 2023-12-17T13:57:16.905 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T13:57:16.921 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T13:57:16.924 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T13:57:16.928 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T13:57:16.928 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:57:17.975 INFO:teuthology.orchestra.run.smithi040.stdout:generic/420 0s 2023-12-17T13:57:17.994 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/420 2023-12-17T13:57:17.994 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T13:57:18.003 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:57:18.128 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T13:57:18.129 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/421) 2023-12-17T13:57:18.842 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T13:57:18.855 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T13:57:18.856 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T13:57:18.860 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T13:57:18.860 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:57:19.307 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T13:57:19.314 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T13:57:29.528 INFO:teuthology.orchestra.run.smithi040.stdout:generic/421 10s 2023-12-17T13:57:29.556 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/421 2023-12-17T13:57:29.556 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T13:57:29.567 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:57:29.617 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T13:57:29.618 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/422) 2023-12-17T13:57:30.216 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T13:57:30.230 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T13:57:30.232 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T13:57:30.235 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T13:57:30.236 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:57:31.032 INFO:teuthology.orchestra.run.smithi040.stdout:generic/422 [not run] xfs_io falloc -k failed (old kernel/wrong fs?) 2023-12-17T13:57:31.048 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/422 2023-12-17T13:57:31.048 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/422 2023-12-17T13:57:31.048 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T13:57:31.061 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:57:31.121 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T13:57:31.121 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/423) 2023-12-17T13:57:31.829 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T13:57:31.844 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T13:57:31.846 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T13:57:31.850 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T13:57:31.850 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:57:32.896 INFO:teuthology.orchestra.run.smithi040.stdout:generic/423 0s 2023-12-17T13:57:32.912 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/423 2023-12-17T13:57:32.912 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T13:57:32.920 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:57:33.066 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T13:57:33.067 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/424) 2023-12-17T13:57:33.772 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T13:57:33.787 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T13:57:33.789 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T13:57:33.793 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T13:57:33.793 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:57:34.597 INFO:teuthology.orchestra.run.smithi040.stdout:generic/424 [not run] file system doesn't support any of /bin/chattr +a/+c/+d/+i 2023-12-17T13:57:34.613 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/424 2023-12-17T13:57:34.613 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/424 2023-12-17T13:57:34.613 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T13:57:34.626 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:57:34.679 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T13:57:34.679 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/425) 2023-12-17T13:57:35.366 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T13:57:35.378 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T13:57:35.380 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T13:57:35.383 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T13:57:35.383 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:57:36.241 INFO:teuthology.orchestra.run.smithi040.stdout:generic/425 [not run] xfs_io fiemap -a failed (old kernel/wrong fs?) 2023-12-17T13:57:36.254 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/425 2023-12-17T13:57:36.255 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/425 2023-12-17T13:57:36.255 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T13:57:36.266 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:57:36.399 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T13:57:36.399 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/426) 2023-12-17T13:57:37.116 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T13:57:37.131 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T13:57:37.133 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T13:57:37.137 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T13:57:37.137 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:57:49.904 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T13:57:49.912 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T13:58:20.120 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T13:58:20.131 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T13:58:40.526 INFO:teuthology.orchestra.run.smithi040.stdout:generic/426 63s 2023-12-17T13:58:40.636 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/426 2023-12-17T13:58:40.636 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T13:58:40.650 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:58:40.930 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T13:58:40.932 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/427) 2023-12-17T13:58:42.542 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T13:58:42.556 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T13:58:42.558 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T13:58:42.561 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T13:58:42.561 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:58:43.499 INFO:teuthology.orchestra.run.smithi040.stdout:generic/427 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-12-17T13:58:43.516 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/427 2023-12-17T13:58:43.516 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/427 2023-12-17T13:58:43.517 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T13:58:43.529 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:58:43.581 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T13:58:43.581 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/428) 2023-12-17T13:58:44.227 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T13:58:44.242 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T13:58:44.244 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T13:58:44.248 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T13:58:44.248 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:58:45.044 INFO:teuthology.orchestra.run.smithi040.stdout:generic/428 1s 2023-12-17T13:58:45.075 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/428 2023-12-17T13:58:45.075 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T13:58:45.085 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:58:45.144 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T13:58:45.145 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/429) 2023-12-17T13:58:45.782 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T13:58:45.795 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T13:58:45.797 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T13:58:45.802 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T13:58:45.802 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:58:50.996 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T13:58:51.013 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T13:58:58.261 INFO:teuthology.orchestra.run.smithi040.stdout:generic/429 12s 2023-12-17T13:58:58.274 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/429 2023-12-17T13:58:58.274 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T13:58:58.281 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:58:58.303 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T13:58:58.303 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/430) 2023-12-17T13:58:58.952 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T13:58:58.980 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T13:58:58.983 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T13:58:58.991 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T13:58:58.991 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:59:00.202 INFO:teuthology.orchestra.run.smithi040.stdout:generic/430 1s 2023-12-17T13:59:00.220 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/430 2023-12-17T13:59:00.220 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T13:59:00.229 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:59:00.410 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T13:59:00.411 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/431) 2023-12-17T13:59:01.097 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T13:59:01.112 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T13:59:01.114 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T13:59:01.118 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T13:59:01.118 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:59:02.101 INFO:teuthology.orchestra.run.smithi040.stdout:generic/431 1s 2023-12-17T13:59:02.121 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/431 2023-12-17T13:59:02.121 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T13:59:02.132 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:59:02.330 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T13:59:02.331 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/432) 2023-12-17T13:59:02.990 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T13:59:03.002 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T13:59:03.004 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T13:59:03.009 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T13:59:03.009 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:59:04.143 INFO:teuthology.orchestra.run.smithi040.stdout:generic/432 1s 2023-12-17T13:59:04.163 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/432 2023-12-17T13:59:04.163 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T13:59:04.173 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:59:04.307 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T13:59:04.308 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/433) 2023-12-17T13:59:04.984 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T13:59:04.999 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T13:59:05.001 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T13:59:05.004 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T13:59:05.004 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:59:05.945 INFO:teuthology.orchestra.run.smithi040.stdout:generic/433 0s 2023-12-17T13:59:05.966 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/433 2023-12-17T13:59:05.967 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T13:59:05.979 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:59:06.111 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T13:59:06.111 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/434) 2023-12-17T13:59:06.800 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T13:59:06.815 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T13:59:06.817 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T13:59:06.820 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T13:59:06.821 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:59:07.801 INFO:teuthology.orchestra.run.smithi040.stdout:generic/434 0s 2023-12-17T13:59:07.820 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/434 2023-12-17T13:59:07.820 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T13:59:07.828 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:59:07.988 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T13:59:07.988 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/435) 2023-12-17T13:59:08.671 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T13:59:08.684 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T13:59:08.686 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T13:59:08.690 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T13:59:08.690 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T13:59:21.277 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T13:59:21.291 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T13:59:51.427 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T13:59:51.437 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T13:59:51.543 INFO:tasks.ceph.mds.d.smithi159.stderr:2023-12-17T13:59:51.540+0000 7f1350aab640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 101459) UID: 0 2023-12-17T13:59:51.543 INFO:tasks.ceph.mds.b.smithi159.stderr:2023-12-17T13:59:51.540+0000 7ff8c5a52640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 101459) UID: 0 2023-12-17T14:02:40.578 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T14:02:40.588 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T14:03:10.740 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T14:03:10.750 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T14:03:40.889 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T14:03:40.895 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T14:04:11.829 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T14:04:11.839 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T14:04:41.976 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T14:04:41.986 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T14:05:12.130 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T14:05:12.144 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T14:05:42.329 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T14:05:42.339 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T14:06:12.478 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T14:06:12.488 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T14:06:43.369 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T14:06:43.380 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T14:06:43.475 INFO:tasks.ceph.mds.d.smithi159.stderr:2023-12-17T14:06:43.470+0000 7f1350aab640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 101642) UID: 0 2023-12-17T14:06:43.476 INFO:tasks.ceph.mds.b.smithi159.stderr:2023-12-17T14:06:43.470+0000 7ff8c5a52640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 101642) UID: 0 2023-12-17T14:10:00.245 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T14:10:00.255 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T14:10:30.409 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T14:10:30.419 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T14:11:00.561 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T14:11:00.570 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T14:11:30.699 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T14:11:30.709 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T14:12:00.885 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T14:12:00.896 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T14:12:31.902 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T14:12:31.912 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T14:12:32.039 INFO:tasks.ceph.mds.d.smithi159.stderr:2023-12-17T14:12:32.032+0000 7f1350aab640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 101758) UID: 0 2023-12-17T14:12:32.039 INFO:tasks.ceph.mds.b.smithi159.stderr:2023-12-17T14:12:32.032+0000 7ff8c5a52640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 101758) UID: 0 2023-12-17T14:14:10.904 INFO:teuthology.orchestra.run.smithi040.stdout:generic/435 902s 2023-12-17T14:14:10.923 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/435 2023-12-17T14:14:10.923 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T14:14:10.933 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T14:14:10.964 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T14:14:10.964 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/436) 2023-12-17T14:14:11.669 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T14:14:11.680 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T14:14:11.682 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T14:14:11.685 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T14:14:11.685 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T14:14:13.108 INFO:teuthology.orchestra.run.smithi040.stdout:generic/436 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-12-17T14:14:13.122 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/436 2023-12-17T14:14:13.122 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/436 2023-12-17T14:14:13.122 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T14:14:13.133 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T14:14:13.244 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T14:14:13.245 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/437) 2023-12-17T14:14:13.934 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T14:14:13.947 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T14:14:13.948 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T14:14:13.951 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T14:14:13.952 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T14:14:15.573 INFO:teuthology.orchestra.run.smithi040.stdout:generic/437 1s 2023-12-17T14:14:15.591 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/437 2023-12-17T14:14:15.591 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T14:14:15.601 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T14:14:15.664 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T14:14:15.664 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/438) 2023-12-17T14:14:16.346 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T14:14:16.361 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T14:14:16.363 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T14:14:16.366 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T14:14:16.367 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T14:15:27.091 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T14:15:27.103 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T14:15:57.229 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T14:15:57.238 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T14:16:27.368 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T14:16:27.374 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T14:16:44.931 INFO:teuthology.orchestra.run.smithi040.stdout:generic/438 148s 2023-12-17T14:16:44.951 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/438 2023-12-17T14:16:44.951 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T14:16:44.960 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T14:16:45.022 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T14:16:45.023 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/439) 2023-12-17T14:16:45.670 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T14:16:45.686 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T14:16:45.687 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T14:16:45.691 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T14:16:45.691 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T14:16:47.768 INFO:teuthology.orchestra.run.smithi040.stdout:generic/439 2s 2023-12-17T14:16:47.795 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/439 2023-12-17T14:16:47.795 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T14:16:47.807 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T14:16:47.860 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T14:16:47.860 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/440) 2023-12-17T14:16:48.482 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T14:16:48.498 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T14:16:48.500 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T14:16:48.503 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T14:16:48.504 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T14:16:51.048 INFO:teuthology.orchestra.run.smithi040.stdout:generic/440 3s 2023-12-17T14:16:51.065 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/440 2023-12-17T14:16:51.065 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T14:16:51.073 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T14:16:51.099 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T14:16:51.099 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/441) 2023-12-17T14:16:51.749 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T14:16:51.765 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T14:16:51.767 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T14:16:51.771 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T14:16:51.771 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T14:16:52.691 INFO:teuthology.orchestra.run.smithi040.stdout:generic/441 [not run] require 172.21.15.40:6789:/scratch to be valid block disk 2023-12-17T14:16:52.704 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/441 2023-12-17T14:16:52.705 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/441 2023-12-17T14:16:52.705 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T14:16:52.714 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T14:16:52.773 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T14:16:52.773 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/442) 2023-12-17T14:16:53.423 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T14:16:53.439 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T14:16:53.440 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T14:16:53.444 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T14:16:53.444 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T14:16:54.190 INFO:teuthology.orchestra.run.smithi040.stdout:generic/442 [not run] require 172.21.15.40:6789:/scratch to be valid block disk 2023-12-17T14:16:54.206 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/442 2023-12-17T14:16:54.206 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/442 2023-12-17T14:16:54.207 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T14:16:54.219 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T14:16:54.268 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T14:16:54.268 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/443) 2023-12-17T14:16:54.933 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T14:16:54.949 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T14:16:54.951 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T14:16:54.955 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T14:16:54.955 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T14:16:55.762 INFO:teuthology.orchestra.run.smithi040.stdout:generic/443 0s 2023-12-17T14:16:55.782 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/443 2023-12-17T14:16:55.782 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T14:16:55.792 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T14:16:55.859 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T14:16:55.860 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/444) 2023-12-17T14:16:56.527 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T14:16:56.543 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T14:16:56.545 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T14:16:56.549 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T14:16:56.549 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T14:16:57.498 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T14:16:57.505 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T14:16:57.533 INFO:teuthology.orchestra.run.smithi040.stdout:generic/444 1s 2023-12-17T14:16:57.548 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/444 2023-12-17T14:16:57.548 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T14:16:57.556 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T14:16:57.618 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T14:16:57.618 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/445) 2023-12-17T14:16:58.299 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T14:16:58.314 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T14:16:58.316 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T14:16:58.320 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T14:16:58.320 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T14:16:59.966 INFO:teuthology.orchestra.run.smithi040.stdout:generic/445 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-12-17T14:16:59.982 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/445 2023-12-17T14:16:59.983 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/445 2023-12-17T14:16:59.983 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T14:16:59.994 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T14:17:00.107 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T14:17:00.108 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/446) 2023-12-17T14:17:00.812 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T14:17:00.828 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T14:17:00.830 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T14:17:00.833 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T14:17:00.834 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T14:17:27.638 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T14:17:27.645 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T14:17:31.804 INFO:teuthology.orchestra.run.smithi040.stdout:generic/446 30s 2023-12-17T14:17:31.844 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/446 2023-12-17T14:17:31.850 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T14:17:31.862 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T14:17:31.912 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T14:17:31.912 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/447) 2023-12-17T14:17:32.592 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T14:17:32.607 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T14:17:32.609 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T14:17:32.613 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T14:17:32.613 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T14:17:33.735 INFO:teuthology.orchestra.run.smithi040.stdout:generic/447 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-17T14:17:33.751 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/447 2023-12-17T14:17:33.751 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/447 2023-12-17T14:17:33.751 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T14:17:33.768 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T14:17:34.100 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T14:17:34.101 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/448) 2023-12-17T14:17:34.643 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T14:17:34.659 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T14:17:34.662 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T14:17:34.666 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T14:17:34.666 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T14:17:37.333 INFO:teuthology.orchestra.run.smithi040.stdout:generic/448 3s 2023-12-17T14:17:37.351 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/448 2023-12-17T14:17:37.352 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T14:17:37.361 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T14:17:37.464 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T14:17:37.464 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/449) 2023-12-17T14:17:38.182 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T14:17:38.194 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T14:17:38.195 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T14:17:38.198 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T14:17:38.198 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T14:17:39.077 INFO:teuthology.orchestra.run.smithi040.stdout:generic/449 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-12-17T14:17:39.094 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/449 2023-12-17T14:17:39.095 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/449 2023-12-17T14:17:39.095 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T14:17:39.107 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T14:17:39.231 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T14:17:39.231 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/450) 2023-12-17T14:17:39.964 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T14:17:39.979 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T14:17:39.981 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T14:17:39.985 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T14:17:39.985 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T14:17:42.394 INFO:teuthology.orchestra.run.smithi040.stdout:generic/450 2s 2023-12-17T14:17:42.411 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/450 2023-12-17T14:17:42.411 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T14:17:42.420 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T14:17:42.556 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T14:17:42.557 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/451) 2023-12-17T14:17:43.253 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T14:17:43.267 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T14:17:43.269 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T14:17:43.272 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T14:17:43.272 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T14:17:57.795 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T14:17:57.803 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T14:18:14.222 INFO:teuthology.orchestra.run.smithi040.stdout:generic/451 31s 2023-12-17T14:18:14.241 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/451 2023-12-17T14:18:14.241 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T14:18:14.253 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T14:18:14.372 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T14:18:14.373 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/452) 2023-12-17T14:18:15.127 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T14:18:15.143 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T14:18:15.146 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T14:18:15.151 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T14:18:15.151 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T14:18:16.332 INFO:teuthology.orchestra.run.smithi040.stdout:generic/452 1s 2023-12-17T14:18:16.348 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/452 2023-12-17T14:18:16.348 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T14:18:16.357 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T14:18:16.384 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T14:18:16.384 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/453) 2023-12-17T14:18:17.025 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T14:18:17.042 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T14:18:17.044 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T14:18:17.047 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T14:18:17.047 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T14:18:17.783 INFO:teuthology.orchestra.run.smithi040.stdout:generic/453 [not run] ceph does not allow unrestricted byte streams for names 2023-12-17T14:18:17.796 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/453 2023-12-17T14:18:17.796 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/453 2023-12-17T14:18:17.796 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T14:18:17.806 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T14:18:17.858 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T14:18:17.859 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/454) 2023-12-17T14:18:18.509 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T14:18:18.524 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T14:18:18.525 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T14:18:18.528 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T14:18:18.529 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T14:18:19.328 INFO:teuthology.orchestra.run.smithi040.stdout:generic/454 [not run] ceph does not allow unrestricted byte streams for names 2023-12-17T14:18:19.344 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/454 2023-12-17T14:18:19.344 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/454 2023-12-17T14:18:19.344 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T14:18:19.358 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T14:18:19.433 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T14:18:19.434 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/455) 2023-12-17T14:18:20.116 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T14:18:20.131 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T14:18:20.133 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T14:18:20.137 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T14:18:20.137 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T14:18:21.085 INFO:teuthology.orchestra.run.smithi040.stdout:generic/455 [not run] This test requires a valid $LOGWRITES_DEV 2023-12-17T14:18:21.101 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/455 2023-12-17T14:18:21.101 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/455 2023-12-17T14:18:21.101 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T14:18:21.115 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T14:18:21.166 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T14:18:21.166 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/456) 2023-12-17T14:18:21.809 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T14:18:21.822 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T14:18:21.824 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T14:18:21.827 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T14:18:21.828 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T14:18:22.610 INFO:teuthology.orchestra.run.smithi040.stdout:generic/456 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-12-17T14:18:22.622 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/456 2023-12-17T14:18:22.622 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/456 2023-12-17T14:18:22.622 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T14:18:22.631 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T14:18:22.698 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T14:18:22.699 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/457) 2023-12-17T14:18:23.360 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T14:18:23.376 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T14:18:23.378 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T14:18:23.382 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T14:18:23.382 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T14:18:24.744 INFO:teuthology.orchestra.run.smithi040.stdout:generic/457 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-17T14:18:24.763 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/457 2023-12-17T14:18:24.763 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/457 2023-12-17T14:18:24.763 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T14:18:24.778 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T14:18:24.863 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T14:18:24.863 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/458) 2023-12-17T14:18:25.360 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T14:18:25.374 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T14:18:25.375 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T14:18:25.379 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T14:18:25.379 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T14:18:26.534 INFO:teuthology.orchestra.run.smithi040.stdout:generic/458 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-17T14:18:26.558 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/458 2023-12-17T14:18:26.558 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/458 2023-12-17T14:18:26.558 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T14:18:26.571 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T14:18:26.904 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T14:18:26.904 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/459) 2023-12-17T14:18:27.427 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T14:18:27.443 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T14:18:27.445 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T14:18:27.448 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T14:18:27.448 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T14:18:27.932 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T14:18:27.939 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T14:18:28.443 INFO:teuthology.orchestra.run.smithi040.stdout:generic/459 [not run] require 172.21.15.40:6789:/scratch to be valid block disk 2023-12-17T14:18:28.460 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/459 2023-12-17T14:18:28.461 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/459 2023-12-17T14:18:28.461 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T14:18:28.472 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T14:18:28.522 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T14:18:28.522 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/460) 2023-12-17T14:18:29.188 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T14:18:29.203 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T14:18:29.205 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T14:18:29.209 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T14:18:29.209 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T14:18:32.838 INFO:teuthology.orchestra.run.smithi040.stdout:generic/460 3s 2023-12-17T14:18:32.855 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/460 2023-12-17T14:18:32.856 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T14:18:32.865 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T14:18:32.894 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T14:18:32.894 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/461) 2023-12-17T14:18:33.532 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T14:18:33.547 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T14:18:33.548 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T14:18:33.552 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T14:18:33.553 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T14:18:34.620 INFO:teuthology.orchestra.run.smithi040.stdout:generic/461 [not run] ceph does not support shutdown 2023-12-17T14:18:34.637 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/461 2023-12-17T14:18:34.637 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/461 2023-12-17T14:18:34.637 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T14:18:34.650 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T14:18:34.721 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T14:18:34.721 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/462) 2023-12-17T14:18:35.332 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T14:18:35.346 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T14:18:35.347 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T14:18:35.352 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T14:18:35.352 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T14:18:36.293 INFO:teuthology.orchestra.run.smithi040.stdout:generic/462 [not run] mount 172.21.15.40:6789:/scratch with dax failed 2023-12-17T14:18:36.308 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/462 2023-12-17T14:18:36.308 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/462 2023-12-17T14:18:36.308 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T14:18:36.318 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T14:18:36.368 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T14:18:36.368 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/463) 2023-12-17T14:18:37.023 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T14:18:37.039 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T14:18:37.041 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T14:18:37.045 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T14:18:37.045 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T14:18:37.899 INFO:teuthology.orchestra.run.smithi040.stdout:generic/463 [not run] Reflink not supported by test filesystem type: ceph 2023-12-17T14:18:37.915 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/463 2023-12-17T14:18:37.916 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/463 2023-12-17T14:18:37.916 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T14:18:37.929 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T14:18:38.069 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T14:18:38.069 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/464) 2023-12-17T14:18:38.802 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T14:18:38.814 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T14:18:38.815 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T14:18:38.818 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T14:18:38.818 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T14:18:58.061 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T14:18:58.070 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T14:19:28.267 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T14:19:28.276 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T14:19:39.043 INFO:teuthology.orchestra.run.smithi040.stdout:generic/464 60s 2023-12-17T14:19:39.061 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/464 2023-12-17T14:19:39.061 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T14:19:39.070 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T14:19:39.098 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T14:19:39.099 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/465) 2023-12-17T14:19:39.741 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T14:19:39.757 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T14:19:39.759 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T14:19:39.764 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T14:19:39.764 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T14:19:49.557 INFO:teuthology.orchestra.run.smithi040.stdout:generic/465 8s 2023-12-17T14:19:49.591 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/465 2023-12-17T14:19:49.591 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T14:19:49.608 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T14:19:49.650 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T14:19:49.650 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/466) 2023-12-17T14:19:50.297 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T14:19:50.309 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T14:19:50.311 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T14:19:50.315 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T14:19:50.315 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T14:19:51.020 INFO:teuthology.orchestra.run.smithi040.stdout:generic/466 [not run] require 172.21.15.40:6789:/scratch to be valid block disk 2023-12-17T14:19:51.034 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/466 2023-12-17T14:19:51.034 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/466 2023-12-17T14:19:51.035 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T14:19:51.045 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T14:19:51.086 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T14:19:51.086 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/467) 2023-12-17T14:19:51.738 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T14:19:51.754 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T14:19:51.757 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T14:19:51.761 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T14:19:51.761 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T14:19:58.448 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T14:19:58.458 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T14:20:02.968 INFO:teuthology.orchestra.run.smithi040.stdout:generic/467 11s 2023-12-17T14:20:03.013 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/467 2023-12-17T14:20:03.013 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T14:20:03.021 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T14:20:03.273 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T14:20:03.274 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/468) 2023-12-17T14:20:04.981 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T14:20:04.998 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T14:20:05.000 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T14:20:05.004 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T14:20:05.005 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T14:20:05.975 INFO:teuthology.orchestra.run.smithi040.stdout:generic/468 [not run] ceph does not support shutdown 2023-12-17T14:20:06.003 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/468 2023-12-17T14:20:06.003 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/468 2023-12-17T14:20:06.003 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T14:20:06.013 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T14:20:06.059 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T14:20:06.059 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/469) 2023-12-17T14:20:06.744 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T14:20:06.758 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T14:20:06.760 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T14:20:06.763 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T14:20:06.763 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T14:20:07.494 INFO:teuthology.orchestra.run.smithi040.stdout:generic/469 [not run] xfs_io falloc -k failed (old kernel/wrong fs?) 2023-12-17T14:20:07.510 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/469 2023-12-17T14:20:07.510 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/469 2023-12-17T14:20:07.510 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T14:20:07.520 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T14:20:07.580 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T14:20:07.580 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/470) 2023-12-17T14:20:08.235 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T14:20:08.251 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T14:20:08.253 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T14:20:08.257 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T14:20:08.257 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T14:20:09.053 INFO:teuthology.orchestra.run.smithi040.stdout:generic/470 [not run] This test requires a valid $LOGWRITES_DEV 2023-12-17T14:20:09.068 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/470 2023-12-17T14:20:09.068 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/470 2023-12-17T14:20:09.068 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T14:20:09.078 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T14:20:09.122 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T14:20:09.122 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/471) 2023-12-17T14:20:09.789 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T14:20:09.804 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T14:20:09.806 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T14:20:09.811 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T14:20:09.811 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T14:20:30.965 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T14:20:30.976 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T14:21:03.307 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T14:21:03.324 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T14:21:08.307 INFO:teuthology.orchestra.run.smithi040.stdout:generic/471 58s 2023-12-17T14:21:08.329 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/471 2023-12-17T14:21:08.329 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T14:21:08.339 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T14:21:08.456 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T14:21:08.456 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/472) 2023-12-17T14:21:09.237 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T14:21:09.255 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T14:21:09.258 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T14:21:09.262 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T14:21:09.262 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T14:21:10.332 INFO:teuthology.orchestra.run.smithi040.stdout:generic/472 [not run] swapfiles are not supported 2023-12-17T14:21:10.348 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/472 2023-12-17T14:21:10.348 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/472 2023-12-17T14:21:10.348 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T14:21:10.358 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T14:21:10.419 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T14:21:10.419 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/473) 2023-12-17T14:21:11.086 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T14:21:11.103 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T14:21:11.106 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T14:21:11.110 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T14:21:11.110 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T14:21:11.980 INFO:teuthology.orchestra.run.smithi040.stdout:generic/473 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-12-17T14:21:11.997 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/473 2023-12-17T14:21:11.997 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/473 2023-12-17T14:21:11.997 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T14:21:12.010 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T14:21:12.076 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T14:21:12.076 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/474) 2023-12-17T14:21:12.739 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T14:21:12.754 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T14:21:12.756 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T14:21:12.760 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T14:21:12.760 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T14:21:13.717 INFO:teuthology.orchestra.run.smithi040.stdout:generic/474 [not run] ceph does not support shutdown 2023-12-17T14:21:13.746 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/474 2023-12-17T14:21:13.747 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/474 2023-12-17T14:21:13.747 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T14:21:13.758 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T14:21:13.804 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T14:21:13.804 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/475) 2023-12-17T14:21:14.483 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T14:21:14.500 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T14:21:14.501 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T14:21:14.505 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T14:21:14.505 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T14:21:15.334 INFO:teuthology.orchestra.run.smithi040.stdout:generic/475 [not run] require 172.21.15.40:6789:/scratch to be valid block disk 2023-12-17T14:21:15.349 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/475 2023-12-17T14:21:15.349 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/475 2023-12-17T14:21:15.349 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T14:21:15.361 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T14:21:15.415 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T14:21:15.416 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/476) 2023-12-17T14:21:16.080 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T14:21:16.096 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T14:21:16.097 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T14:21:16.101 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T14:21:16.101 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T14:21:33.458 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T14:21:33.466 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T14:22:03.650 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T14:22:03.659 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T14:22:33.844 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T14:22:33.852 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T14:22:34.021 INFO:tasks.ceph.osd.0.smithi040.stderr:2023-12-17T14:22:34.011+0000 7fddc7cf4640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 539326) UID: 0 2023-12-17T14:22:34.022 INFO:tasks.ceph.osd.1.smithi040.stderr:2023-12-17T14:22:34.013+0000 7f1055c84640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 539326) UID: 0 2023-12-17T14:22:34.027 INFO:tasks.ceph.osd.3.smithi040.stderr:2023-12-17T14:22:34.013+0000 7f5186ef4640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 539326) UID: 0 2023-12-17T14:22:34.031 INFO:tasks.ceph.osd.2.smithi040.stderr:2023-12-17T14:22:34.011+0000 7f342b477640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 539326) UID: 0 2023-12-17T14:28:01.683 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T14:28:01.697 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T14:28:01.985 INFO:tasks.ceph.osd.4.smithi159.stderr:2023-12-17T14:28:01.972+0000 7f2f7c3d6640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 102359) UID: 0 2023-12-17T14:28:01.993 INFO:tasks.ceph.osd.7.smithi159.stderr:2023-12-17T14:28:01.982+0000 7f2a65aa4640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 102359) UID: 0 2023-12-17T14:28:01.994 INFO:tasks.ceph.osd.6.smithi159.stderr:2023-12-17T14:28:01.982+0000 7efd98236640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 102359) UID: 0 2023-12-17T14:28:01.998 INFO:tasks.ceph.osd.5.smithi159.stderr:2023-12-17T14:28:01.983+0000 7fca99737640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 102359) UID: 0 2023-12-17T14:32:38.414 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T14:32:38.426 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T14:32:38.623 INFO:tasks.ceph.mds.b.smithi159.stderr:2023-12-17T14:32:38.611+0000 7ff8c5a52640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 102461) UID: 0 2023-12-17T14:32:38.623 INFO:tasks.ceph.mds.d.smithi159.stderr:2023-12-17T14:32:38.609+0000 7f1350aab640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 102461) UID: 0 2023-12-17T14:32:38.764 INFO:tasks.ceph.osd.0.smithi040.stderr:2023-12-17T14:32:38.753+0000 7fddc7cf4640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 539607) UID: 0 2023-12-17T14:32:38.766 INFO:tasks.ceph.osd.2.smithi040.stderr:2023-12-17T14:32:38.754+0000 7f342b477640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 539607) UID: 0 2023-12-17T14:32:38.766 INFO:tasks.ceph.osd.1.smithi040.stderr:2023-12-17T14:32:38.754+0000 7f1055c84640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 539607) UID: 0 2023-12-17T14:32:38.767 INFO:tasks.ceph.osd.3.smithi040.stderr:2023-12-17T14:32:38.754+0000 7f5186ef4640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 539607) UID: 0 2023-12-17T14:37:41.906 INFO:tasks.ceph.osd.6.smithi159.stderr:2023-12-17T14:37:41.893+0000 7efd98236640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 102506) UID: 0 2023-12-17T14:37:41.907 INFO:tasks.ceph.osd.5.smithi159.stderr:2023-12-17T14:37:41.894+0000 7fca99737640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 102506) UID: 0 2023-12-17T14:37:41.908 INFO:tasks.ceph.osd.4.smithi159.stderr:2023-12-17T14:37:41.894+0000 7f2f7c3d6640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 102506) UID: 0 2023-12-17T14:37:41.909 INFO:tasks.ceph.osd.7.smithi159.stderr:2023-12-17T14:37:41.894+0000 7f2a65aa4640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 102506) UID: 0 2023-12-17T14:47:57.068 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T14:47:57.078 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T14:47:57.284 INFO:tasks.ceph.mds.d.smithi159.stderr:2023-12-17T14:47:57.269+0000 7f1350aab640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 102618) UID: 0 2023-12-17T14:47:57.284 INFO:tasks.ceph.mds.b.smithi159.stderr:2023-12-17T14:47:57.269+0000 7ff8c5a52640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 102618) UID: 0 2023-12-17T14:47:58.783 INFO:tasks.ceph.osd.0.smithi040.stderr:2023-12-17T14:47:58.769+0000 7fddc7cf4640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 539763) UID: 0 2023-12-17T14:47:58.784 INFO:tasks.ceph.osd.1.smithi040.stderr:2023-12-17T14:47:58.769+0000 7f1055c84640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 539763) UID: 0 2023-12-17T14:47:58.786 INFO:tasks.ceph.osd.2.smithi040.stderr:2023-12-17T14:47:58.773+0000 7f342b477640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 539763) UID: 0 2023-12-17T14:47:58.789 INFO:tasks.ceph.osd.3.smithi040.stderr:2023-12-17T14:47:58.776+0000 7f5186ef4640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 539763) UID: 0 2023-12-17T14:51:44.489 INFO:tasks.ceph.osd.6.smithi159.stderr:2023-12-17T14:51:44.475+0000 7efd98236640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 102667) UID: 0 2023-12-17T14:51:44.490 INFO:tasks.ceph.osd.4.smithi159.stderr:2023-12-17T14:51:44.475+0000 7f2f7c3d6640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 102667) UID: 0 2023-12-17T14:51:44.491 INFO:tasks.ceph.osd.5.smithi159.stderr:2023-12-17T14:51:44.475+0000 7fca99737640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 102667) UID: 0 2023-12-17T14:51:44.491 INFO:tasks.ceph.osd.7.smithi159.stderr:2023-12-17T14:51:44.475+0000 7f2a65aa4640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 102667) UID: 0 2023-12-17T15:00:05.151 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T15:00:05.159 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T15:00:05.969 INFO:tasks.ceph.osd.1.smithi040.stderr:2023-12-17T15:00:05.962+0000 7f1055c84640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 539892) UID: 0 2023-12-17T15:00:05.969 INFO:tasks.ceph.osd.3.smithi040.stderr:2023-12-17T15:00:05.962+0000 7f5186ef4640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 539892) UID: 0 2023-12-17T15:00:05.969 INFO:tasks.ceph.osd.0.smithi040.stderr:2023-12-17T15:00:05.962+0000 7fddc7cf4640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 539892) UID: 0 2023-12-17T15:00:05.970 INFO:tasks.ceph.osd.2.smithi040.stderr:2023-12-17T15:00:05.962+0000 7f342b477640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 539892) UID: 0 2023-12-17T15:07:12.295 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T15:07:12.303 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T15:07:12.404 INFO:tasks.ceph.mds.b.smithi159.stderr:2023-12-17T15:07:12.400+0000 7ff8c5a52640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 102813) UID: 0 2023-12-17T15:07:12.404 INFO:tasks.ceph.mds.d.smithi159.stderr:2023-12-17T15:07:12.400+0000 7f1350aab640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 102813) UID: 0 2023-12-17T15:07:13.261 INFO:tasks.ceph.osd.1.smithi040.stderr:2023-12-17T15:07:13.258+0000 7f1055c84640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 539963) UID: 0 2023-12-17T15:07:13.261 INFO:tasks.ceph.osd.3.smithi040.stderr:2023-12-17T15:07:13.258+0000 7f5186ef4640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 539963) UID: 0 2023-12-17T15:07:13.262 INFO:tasks.ceph.osd.2.smithi040.stderr:2023-12-17T15:07:13.258+0000 7f342b477640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 539963) UID: 0 2023-12-17T15:07:13.262 INFO:tasks.ceph.osd.0.smithi040.stderr:2023-12-17T15:07:13.258+0000 7fddc7cf4640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 539963) UID: 0 2023-12-17T15:13:11.886 INFO:tasks.ceph.osd.6.smithi159.stderr:2023-12-17T15:13:11.884+0000 7efd98236640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 102844) UID: 0 2023-12-17T15:13:11.887 INFO:tasks.ceph.osd.4.smithi159.stderr:2023-12-17T15:13:11.884+0000 7f2f7c3d6640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 102844) UID: 0 2023-12-17T15:13:11.888 INFO:tasks.ceph.osd.7.smithi159.stderr:2023-12-17T15:13:11.884+0000 7f2a65aa4640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 102844) UID: 0 2023-12-17T15:13:11.888 INFO:tasks.ceph.osd.5.smithi159.stderr:2023-12-17T15:13:11.885+0000 7fca99737640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 102844) UID: 0 2023-12-17T15:24:54.902 INFO:teuthology.orchestra.run.smithi040.stdout:generic/476 3818s 2023-12-17T15:24:54.945 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/476 2023-12-17T15:24:54.945 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T15:24:54.954 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T15:24:54.982 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T15:24:54.982 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/477) 2023-12-17T15:25:06.999 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T15:25:07.025 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T15:25:07.026 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T15:25:07.032 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T15:25:07.032 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T15:30:12.734 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T15:30:12.742 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T15:30:12.887 INFO:tasks.ceph.osd.0.smithi040.stderr:2023-12-17T15:30:12.886+0000 7fddc7cf4640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 540442) UID: 0 2023-12-17T15:30:12.887 INFO:tasks.ceph.osd.3.smithi040.stderr:2023-12-17T15:30:12.887+0000 7f5186ef4640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 540442) UID: 0 2023-12-17T15:30:12.887 INFO:tasks.ceph.osd.1.smithi040.stderr:2023-12-17T15:30:12.886+0000 7f1055c84640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 540442) UID: 0 2023-12-17T15:30:12.888 INFO:tasks.ceph.osd.2.smithi040.stderr:2023-12-17T15:30:12.886+0000 7f342b477640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 540442) UID: 0 2023-12-17T15:30:13.140 INFO:tasks.ceph.mds.b.smithi159.stderr:2023-12-17T15:30:13.139+0000 7ff8c5a52640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 102989) UID: 0 2023-12-17T15:30:13.141 INFO:tasks.ceph.mds.d.smithi159.stderr:2023-12-17T15:30:13.139+0000 7f1350aab640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 102989) UID: 0 2023-12-17T15:33:28.088 INFO:teuthology.orchestra.run.smithi040.stdout:generic/477 41s 2023-12-17T15:33:28.250 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/477 2023-12-17T15:33:28.250 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T15:33:28.261 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T15:33:28.534 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T15:33:28.535 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/478) 2023-12-17T15:33:32.002 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T15:33:32.019 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T15:33:32.021 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T15:33:32.026 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T15:33:32.026 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T15:33:44.855 INFO:teuthology.orchestra.run.smithi040.stdout:generic/478 12s 2023-12-17T15:33:44.873 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/478 2023-12-17T15:33:44.873 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T15:33:44.885 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T15:33:44.957 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T15:33:44.958 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/479) 2023-12-17T15:33:45.663 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T15:33:45.678 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T15:33:45.680 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T15:33:45.683 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T15:33:45.683 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T15:33:46.873 INFO:teuthology.orchestra.run.smithi040.stdout:generic/479 [not run] require 172.21.15.40:6789:/scratch to be valid block disk 2023-12-17T15:33:46.887 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/479 2023-12-17T15:33:46.887 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/479 2023-12-17T15:33:46.887 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T15:33:46.896 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T15:33:46.948 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T15:33:46.948 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/480) 2023-12-17T15:33:47.594 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T15:33:47.610 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T15:33:47.611 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T15:33:47.617 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T15:33:47.618 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T15:33:48.405 INFO:teuthology.orchestra.run.smithi040.stdout:generic/480 [not run] require 172.21.15.40:6789:/scratch to be valid block disk 2023-12-17T15:33:48.418 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/480 2023-12-17T15:33:48.419 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/480 2023-12-17T15:33:48.419 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T15:33:48.427 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T15:33:48.482 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T15:33:48.483 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/481) 2023-12-17T15:33:49.124 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T15:33:49.137 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T15:33:49.138 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T15:33:49.141 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T15:33:49.142 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T15:33:49.866 INFO:teuthology.orchestra.run.smithi040.stdout:generic/481 [not run] require 172.21.15.40:6789:/scratch to be valid block disk 2023-12-17T15:33:49.880 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/481 2023-12-17T15:33:49.880 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/481 2023-12-17T15:33:49.880 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T15:33:49.888 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T15:33:49.940 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T15:33:49.940 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/482) 2023-12-17T15:33:50.562 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T15:33:50.577 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T15:33:50.579 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T15:33:50.582 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T15:33:50.583 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T15:33:51.502 INFO:teuthology.orchestra.run.smithi040.stdout:generic/482 [not run] This test requires a valid $LOGWRITES_DEV 2023-12-17T15:33:51.516 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/482 2023-12-17T15:33:51.516 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/482 2023-12-17T15:33:51.516 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T15:33:51.523 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T15:33:51.568 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T15:33:51.569 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/483) 2023-12-17T15:33:52.243 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T15:33:52.254 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T15:33:52.256 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T15:33:52.260 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T15:33:52.260 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T15:33:53.091 INFO:teuthology.orchestra.run.smithi040.stdout:generic/483 [not run] require 172.21.15.40:6789:/scratch to be valid block disk 2023-12-17T15:33:53.106 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/483 2023-12-17T15:33:53.106 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/483 2023-12-17T15:33:53.106 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T15:33:53.116 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T15:33:53.155 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T15:33:53.156 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/484) 2023-12-17T15:33:53.890 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T15:33:53.906 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T15:33:53.910 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T15:33:53.914 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T15:33:53.914 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T15:33:55.447 INFO:teuthology.orchestra.run.smithi040.stdout:generic/484 [not run] require 172.21.15.40:6789:/scratch to be valid block disk 2023-12-17T15:33:55.461 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/484 2023-12-17T15:33:55.461 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/484 2023-12-17T15:33:55.461 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T15:33:55.470 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T15:33:55.513 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T15:33:55.513 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/485) 2023-12-17T15:33:56.164 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T15:33:56.179 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T15:33:56.180 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T15:33:56.184 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T15:33:56.184 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T15:33:56.928 INFO:teuthology.orchestra.run.smithi040.stdout:generic/485 [not run] xfs_io falloc -k failed (old kernel/wrong fs?) 2023-12-17T15:33:56.941 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/485 2023-12-17T15:33:56.942 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/485 2023-12-17T15:33:56.942 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T15:33:56.952 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T15:33:57.009 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T15:33:57.009 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/486) 2023-12-17T15:33:57.712 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T15:33:57.732 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T15:33:57.734 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T15:33:57.738 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T15:33:57.738 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T15:33:58.988 INFO:teuthology.orchestra.run.smithi040.stdout:generic/486 0s 2023-12-17T15:33:59.014 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/486 2023-12-17T15:33:59.014 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T15:33:59.026 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T15:33:59.056 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T15:33:59.056 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/487) 2023-12-17T15:33:59.674 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T15:33:59.690 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T15:33:59.692 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T15:33:59.698 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T15:33:59.698 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T15:34:00.432 INFO:teuthology.orchestra.run.smithi040.stdout:generic/487 [not run] This test requires a valid $SCRATCH_LOGDEV 2023-12-17T15:34:00.446 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/487 2023-12-17T15:34:00.446 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/487 2023-12-17T15:34:00.446 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T15:34:00.454 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T15:34:00.499 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T15:34:00.499 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/488) 2023-12-17T15:34:01.242 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T15:34:01.260 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T15:34:01.261 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T15:34:01.269 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T15:34:01.269 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T15:34:02.040 INFO:teuthology.orchestra.run.smithi040.stdout:generic/488 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-12-17T15:34:02.054 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/488 2023-12-17T15:34:02.055 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/488 2023-12-17T15:34:02.055 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T15:34:02.064 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T15:34:02.117 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T15:34:02.118 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/489) 2023-12-17T15:34:02.839 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T15:34:02.856 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T15:34:02.861 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T15:34:02.866 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T15:34:02.866 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T15:34:03.614 INFO:teuthology.orchestra.run.smithi040.stdout:generic/489 [not run] require 172.21.15.40:6789:/scratch to be valid block disk 2023-12-17T15:34:03.628 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/489 2023-12-17T15:34:03.629 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/489 2023-12-17T15:34:03.629 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T15:34:03.638 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T15:34:03.687 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T15:34:03.688 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/490) 2023-12-17T15:34:04.394 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T15:34:04.412 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T15:34:04.414 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T15:34:04.419 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T15:34:04.419 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T15:34:07.040 INFO:teuthology.orchestra.run.smithi040.stdout:generic/490 3s 2023-12-17T15:34:07.063 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/490 2023-12-17T15:34:07.063 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T15:34:07.073 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T15:34:07.251 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T15:34:07.251 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/491) 2023-12-17T15:34:08.123 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T15:34:08.141 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T15:34:08.143 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T15:34:08.148 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T15:34:08.148 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T15:34:08.940 INFO:teuthology.orchestra.run.smithi040.stdout:generic/491 [not run] ceph does not support freezing 2023-12-17T15:34:08.955 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/491 2023-12-17T15:34:08.955 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/491 2023-12-17T15:34:08.956 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T15:34:08.963 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T15:34:09.020 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T15:34:09.021 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/492) 2023-12-17T15:34:09.656 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T15:34:09.673 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T15:34:09.674 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T15:34:09.677 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T15:34:09.677 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T15:34:10.429 INFO:teuthology.orchestra.run.smithi040.stdout:generic/492 [not run] xfs_io label failed (old kernel/wrong fs?) 2023-12-17T15:34:10.442 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/492 2023-12-17T15:34:10.442 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/492 2023-12-17T15:34:10.443 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T15:34:10.457 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T15:34:10.519 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T15:34:10.519 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/493) 2023-12-17T15:34:11.193 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T15:34:11.214 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T15:34:11.218 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T15:34:11.222 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T15:34:11.222 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T15:34:12.404 INFO:teuthology.orchestra.run.smithi040.stdout:generic/493 [not run] swapfiles are not supported 2023-12-17T15:34:12.419 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/493 2023-12-17T15:34:12.419 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/493 2023-12-17T15:34:12.419 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T15:34:12.434 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T15:34:12.478 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T15:34:12.479 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/494) 2023-12-17T15:34:13.205 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T15:34:13.220 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T15:34:13.222 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T15:34:13.225 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T15:34:13.226 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T15:34:14.324 INFO:teuthology.orchestra.run.smithi040.stdout:generic/494 [not run] swapfiles are not supported 2023-12-17T15:34:14.338 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/494 2023-12-17T15:34:14.338 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/494 2023-12-17T15:34:14.338 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T15:34:14.349 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T15:34:14.404 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T15:34:14.405 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/495) 2023-12-17T15:34:15.055 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T15:34:15.067 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T15:34:15.068 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T15:34:15.071 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T15:34:15.071 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T15:34:16.156 INFO:teuthology.orchestra.run.smithi040.stdout:generic/495 [not run] swapfiles are not supported 2023-12-17T15:34:16.169 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/495 2023-12-17T15:34:16.169 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/495 2023-12-17T15:34:16.169 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T15:34:16.178 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T15:34:16.237 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T15:34:16.237 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/496) 2023-12-17T15:34:16.904 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T15:34:16.921 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T15:34:16.923 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T15:34:16.927 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T15:34:16.927 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T15:34:17.975 INFO:teuthology.orchestra.run.smithi040.stdout:generic/496 [not run] swapfiles are not supported 2023-12-17T15:34:17.991 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/496 2023-12-17T15:34:17.991 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/496 2023-12-17T15:34:17.991 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T15:34:18.001 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T15:34:18.058 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T15:34:18.058 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/497) 2023-12-17T15:34:18.721 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T15:34:18.736 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T15:34:18.738 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T15:34:18.742 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T15:34:18.742 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T15:34:19.855 INFO:teuthology.orchestra.run.smithi040.stdout:generic/497 [not run] swapfiles are not supported 2023-12-17T15:34:19.865 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/497 2023-12-17T15:34:19.866 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/497 2023-12-17T15:34:19.866 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T15:34:19.876 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T15:34:19.928 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T15:34:19.928 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/498) 2023-12-17T15:34:20.564 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T15:34:20.578 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T15:34:20.580 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T15:34:20.583 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T15:34:20.583 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T15:34:21.362 INFO:teuthology.orchestra.run.smithi040.stdout:generic/498 [not run] require 172.21.15.40:6789:/scratch to be valid block disk 2023-12-17T15:34:21.376 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/498 2023-12-17T15:34:21.376 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/498 2023-12-17T15:34:21.376 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T15:34:21.387 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T15:34:21.445 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T15:34:21.445 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/499) 2023-12-17T15:34:22.123 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T15:34:22.139 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T15:34:22.142 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T15:34:22.145 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T15:34:22.146 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T15:34:22.930 INFO:teuthology.orchestra.run.smithi040.stdout:generic/499 [not run] xfs_io falloc -k failed (old kernel/wrong fs?) 2023-12-17T15:34:22.943 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/499 2023-12-17T15:34:22.945 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/499 2023-12-17T15:34:22.945 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T15:34:22.956 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T15:34:23.028 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T15:34:23.028 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/500) 2023-12-17T15:34:23.727 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T15:34:23.739 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T15:34:23.740 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T15:34:23.743 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T15:34:23.743 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T15:34:24.537 INFO:teuthology.orchestra.run.smithi040.stdout:generic/500 [not run] require 172.21.15.40:6789:/scratch to be valid block disk 2023-12-17T15:34:24.552 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/500 2023-12-17T15:34:24.552 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/500 2023-12-17T15:34:24.553 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T15:34:24.561 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T15:34:24.610 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T15:34:24.610 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/501) 2023-12-17T15:34:25.268 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T15:34:25.285 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T15:34:25.288 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T15:34:25.291 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T15:34:25.292 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T15:34:26.453 INFO:teuthology.orchestra.run.smithi040.stdout:generic/501 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-17T15:34:26.472 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/501 2023-12-17T15:34:26.472 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/501 2023-12-17T15:34:26.472 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T15:34:26.486 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T15:34:26.712 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T15:34:26.712 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/502) 2023-12-17T15:34:27.341 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T15:34:27.357 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T15:34:27.359 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T15:34:27.363 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T15:34:27.363 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T15:34:28.339 INFO:teuthology.orchestra.run.smithi040.stdout:generic/502 [not run] require 172.21.15.40:6789:/scratch to be valid block disk 2023-12-17T15:34:28.351 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/502 2023-12-17T15:34:28.351 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/502 2023-12-17T15:34:28.352 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T15:34:28.361 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T15:34:28.420 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T15:34:28.421 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/503) 2023-12-17T15:34:29.083 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T15:34:29.098 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T15:34:29.100 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T15:34:29.104 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T15:34:29.105 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T15:34:29.885 INFO:teuthology.orchestra.run.smithi040.stdout:generic/503 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-12-17T15:34:29.900 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/503 2023-12-17T15:34:29.900 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/503 2023-12-17T15:34:29.900 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T15:34:29.910 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T15:34:29.972 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T15:34:29.972 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/504) 2023-12-17T15:34:30.587 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T15:34:30.599 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T15:34:30.600 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T15:34:30.603 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T15:34:30.603 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T15:34:31.408 INFO:teuthology.orchestra.run.smithi040.stdout:generic/504 1s 2023-12-17T15:34:31.428 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/504 2023-12-17T15:34:31.428 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T15:34:31.436 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T15:34:31.500 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T15:34:31.500 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/505) 2023-12-17T15:34:32.230 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T15:34:32.246 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T15:34:32.248 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T15:34:32.251 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T15:34:32.251 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T15:34:33.191 INFO:teuthology.orchestra.run.smithi040.stdout:generic/505 [not run] ceph does not support shutdown 2023-12-17T15:34:33.221 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/505 2023-12-17T15:34:33.222 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/505 2023-12-17T15:34:33.222 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T15:34:33.235 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T15:34:33.290 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T15:34:33.291 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/506) 2023-12-17T15:34:33.958 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T15:34:33.973 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T15:34:33.976 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T15:34:33.979 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T15:34:33.980 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T15:34:34.705 INFO:teuthology.orchestra.run.smithi040.stdout:generic/506 [not run] disk quotas not supported by this filesystem type: ceph 2023-12-17T15:34:34.716 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/506 2023-12-17T15:34:34.716 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/506 2023-12-17T15:34:34.716 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T15:34:34.725 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T15:34:34.769 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T15:34:34.770 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/507) 2023-12-17T15:34:35.434 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T15:34:35.453 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T15:34:35.454 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T15:34:35.457 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T15:34:35.457 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T15:34:36.232 INFO:teuthology.orchestra.run.smithi040.stdout:generic/507 [not run] file system doesn't support chattr +ASai 2023-12-17T15:34:36.244 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/507 2023-12-17T15:34:36.244 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/507 2023-12-17T15:34:36.244 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T15:34:36.258 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T15:34:36.318 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T15:34:36.319 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/508) 2023-12-17T15:34:36.962 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T15:34:36.977 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T15:34:36.978 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T15:34:36.983 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T15:34:36.983 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T15:34:37.664 INFO:teuthology.orchestra.run.smithi040.stdout:generic/508 [not run] lsattr not supported by test filesystem type: ceph 2023-12-17T15:34:37.683 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/508 2023-12-17T15:34:37.683 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/508 2023-12-17T15:34:37.683 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T15:34:37.698 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T15:34:37.747 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T15:34:37.747 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/509) 2023-12-17T15:34:38.427 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T15:34:38.444 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T15:34:38.446 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T15:34:38.448 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T15:34:38.449 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T15:34:39.259 INFO:teuthology.orchestra.run.smithi040.stdout:generic/509 [not run] O_TMPFILE is not supported 2023-12-17T15:34:39.272 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/509 2023-12-17T15:34:39.272 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/509 2023-12-17T15:34:39.272 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T15:34:39.279 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T15:34:39.338 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T15:34:39.338 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/510) 2023-12-17T15:34:40.036 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T15:34:40.055 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T15:34:40.057 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T15:34:40.062 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T15:34:40.063 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T15:34:40.766 INFO:teuthology.orchestra.run.smithi040.stdout:generic/510 [not run] require 172.21.15.40:6789:/scratch to be valid block disk 2023-12-17T15:34:40.779 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/510 2023-12-17T15:34:40.779 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/510 2023-12-17T15:34:40.779 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T15:34:40.787 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T15:34:40.831 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T15:34:40.832 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/511) 2023-12-17T15:34:41.451 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T15:34:41.471 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T15:34:41.473 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T15:34:41.478 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T15:34:41.478 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T15:34:42.207 INFO:teuthology.orchestra.run.smithi040.stdout:generic/511 [not run] xfs_io falloc -k failed (old kernel/wrong fs?) 2023-12-17T15:34:42.219 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/511 2023-12-17T15:34:42.219 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/511 2023-12-17T15:34:42.219 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T15:34:42.228 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T15:34:42.291 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T15:34:42.292 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/512) 2023-12-17T15:34:42.977 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T15:34:42.996 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T15:34:42.999 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T15:34:43.004 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T15:34:43.004 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T15:34:43.930 INFO:teuthology.orchestra.run.smithi040.stdout:generic/512 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-12-17T15:34:43.951 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/512 2023-12-17T15:34:43.951 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/512 2023-12-17T15:34:43.951 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T15:34:43.961 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T15:34:44.033 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T15:34:44.034 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/513) 2023-12-17T15:34:44.831 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T15:34:44.849 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T15:34:44.851 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T15:34:44.856 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T15:34:44.856 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T15:34:45.984 INFO:teuthology.orchestra.run.smithi040.stdout:generic/513 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-17T15:34:46.009 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/513 2023-12-17T15:34:46.009 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/513 2023-12-17T15:34:46.009 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T15:34:46.020 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T15:34:46.271 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T15:34:46.272 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/514) 2023-12-17T15:34:46.972 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T15:34:46.986 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T15:34:46.987 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T15:34:46.995 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T15:34:46.995 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T15:34:48.121 INFO:teuthology.orchestra.run.smithi040.stdout:generic/514 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-17T15:34:48.140 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/514 2023-12-17T15:34:48.140 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/514 2023-12-17T15:34:48.140 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T15:34:48.153 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T15:34:48.296 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T15:34:48.297 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/515) 2023-12-17T15:34:49.073 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T15:34:49.091 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T15:34:49.093 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T15:34:49.096 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T15:34:49.096 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T15:34:50.249 INFO:teuthology.orchestra.run.smithi040.stdout:generic/515 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-17T15:34:50.269 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/515 2023-12-17T15:34:50.269 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/515 2023-12-17T15:34:50.269 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T15:34:50.286 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T15:34:50.492 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T15:34:50.492 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/516) 2023-12-17T15:34:51.203 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T15:34:51.221 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T15:34:51.226 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T15:34:51.233 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T15:34:51.233 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T15:34:52.122 INFO:teuthology.orchestra.run.smithi040.stdout:generic/516 [not run] Dedupe not supported by test filesystem type: ceph 2023-12-17T15:34:52.138 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/516 2023-12-17T15:34:52.138 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/516 2023-12-17T15:34:52.138 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T15:34:52.147 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T15:34:52.273 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T15:34:52.273 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/517) 2023-12-17T15:34:53.125 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T15:34:53.143 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T15:34:53.145 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T15:34:53.149 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T15:34:53.149 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T15:34:54.134 INFO:teuthology.orchestra.run.smithi040.stdout:generic/517 [not run] Dedupe not supported by scratch filesystem type: ceph 2023-12-17T15:34:54.232 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/517 2023-12-17T15:34:54.233 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/517 2023-12-17T15:34:54.233 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T15:34:54.245 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T15:34:54.513 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T15:34:54.514 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/518) 2023-12-17T15:34:55.233 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T15:34:55.245 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T15:34:55.246 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T15:34:55.250 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T15:34:55.250 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T15:34:56.381 INFO:teuthology.orchestra.run.smithi040.stdout:generic/518 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-17T15:34:56.413 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/518 2023-12-17T15:34:56.415 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/518 2023-12-17T15:34:56.415 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T15:34:56.426 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T15:34:56.759 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T15:34:56.759 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/519) 2023-12-17T15:34:57.459 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T15:34:57.475 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T15:34:57.478 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T15:34:57.482 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T15:34:57.482 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T15:34:58.301 INFO:teuthology.orchestra.run.smithi040.stdout:generic/519 [not run] FIBMAP not supported by this filesystem 2023-12-17T15:34:58.315 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/519 2023-12-17T15:34:58.315 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/519 2023-12-17T15:34:58.316 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T15:34:58.328 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T15:34:58.457 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T15:34:58.457 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/520) 2023-12-17T15:34:59.350 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T15:34:59.363 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T15:34:59.365 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T15:34:59.368 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T15:34:59.368 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T15:35:00.154 INFO:teuthology.orchestra.run.smithi040.stdout:generic/520 [not run] require 172.21.15.40:6789:/scratch to be valid block disk 2023-12-17T15:35:00.166 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/520 2023-12-17T15:35:00.166 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/520 2023-12-17T15:35:00.166 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T15:35:00.176 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T15:35:00.218 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T15:35:00.219 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/521) 2023-12-17T15:35:00.852 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T15:35:00.865 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T15:35:00.868 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T15:35:00.872 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T15:35:00.872 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T15:38:57.085 INFO:tasks.ceph.osd.4.smithi159.stderr:2023-12-17T15:38:57.082+0000 7f2f7c3d6640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 103006) UID: 0 2023-12-17T15:38:57.086 INFO:tasks.ceph.osd.7.smithi159.stderr:2023-12-17T15:38:57.083+0000 7f2a65aa4640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 103006) UID: 0 2023-12-17T15:38:57.086 INFO:tasks.ceph.osd.6.smithi159.stderr:2023-12-17T15:38:57.082+0000 7efd98236640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 103006) UID: 0 2023-12-17T15:38:57.086 INFO:tasks.ceph.osd.5.smithi159.stderr:2023-12-17T15:38:57.083+0000 7fca99737640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 103006) UID: 0 2023-12-17T15:44:18.550 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T15:44:18.557 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T15:44:18.692 INFO:tasks.ceph.osd.1.smithi040.stderr:2023-12-17T15:44:18.691+0000 7f1055c84640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 561751) UID: 0 2023-12-17T15:44:18.692 INFO:tasks.ceph.osd.0.smithi040.stderr:2023-12-17T15:44:18.691+0000 7fddc7cf4640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 561751) UID: 0 2023-12-17T15:44:18.692 INFO:tasks.ceph.osd.2.smithi040.stderr:2023-12-17T15:44:18.691+0000 7f342b477640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 561751) UID: 0 2023-12-17T15:44:18.693 INFO:tasks.ceph.osd.3.smithi040.stderr:2023-12-17T15:44:18.691+0000 7f5186ef4640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 561751) UID: 0 2023-12-17T15:44:20.907 INFO:tasks.ceph.osd.6.smithi159.stderr:2023-12-17T15:44:20.907+0000 7efd98236640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 103035) UID: 0 2023-12-17T15:44:20.907 INFO:tasks.ceph.osd.4.smithi159.stderr:2023-12-17T15:44:20.907+0000 7f2f7c3d6640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 103035) UID: 0 2023-12-17T15:44:20.908 INFO:tasks.ceph.osd.5.smithi159.stderr:2023-12-17T15:44:20.907+0000 7fca99737640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 103035) UID: 0 2023-12-17T15:44:20.908 INFO:tasks.ceph.osd.7.smithi159.stderr:2023-12-17T15:44:20.908+0000 7f2a65aa4640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 103035) UID: 0 2023-12-17T15:48:44.603 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T15:48:44.610 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T15:49:15.059 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T15:49:15.066 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T15:49:15.184 INFO:tasks.ceph.osd.6.smithi159.stderr:2023-12-17T15:49:15.184+0000 7efd98236640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 103085) UID: 0 2023-12-17T15:49:15.185 INFO:tasks.ceph.osd.4.smithi159.stderr:2023-12-17T15:49:15.184+0000 7f2f7c3d6640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 103085) UID: 0 2023-12-17T15:49:15.185 INFO:tasks.ceph.osd.5.smithi159.stderr:2023-12-17T15:49:15.184+0000 7fca99737640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 103085) UID: 0 2023-12-17T15:49:15.185 INFO:tasks.ceph.osd.7.smithi159.stderr:2023-12-17T15:49:15.184+0000 7f2a65aa4640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 103085) UID: 0 2023-12-17T15:53:18.705 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T15:53:18.713 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T15:53:48.851 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T15:53:48.858 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T15:54:18.997 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T15:54:19.004 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T15:54:49.704 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T15:54:49.710 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T15:55:19.912 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T15:55:19.918 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T15:55:50.036 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T15:55:50.042 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T15:56:20.182 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T15:56:20.190 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T15:56:50.324 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T15:56:50.330 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T15:57:20.989 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T15:57:20.996 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T15:57:51.185 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T15:57:51.192 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T15:58:21.337 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T15:58:21.346 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T15:58:51.488 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T15:58:51.495 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T15:58:51.608 INFO:tasks.ceph.osd.6.smithi159.stderr:2023-12-17T15:58:51.608+0000 7efd98236640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 103317) UID: 0 2023-12-17T15:58:51.608 INFO:tasks.ceph.osd.4.smithi159.stderr:2023-12-17T15:58:51.608+0000 7f2f7c3d6640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 103317) UID: 0 2023-12-17T15:58:51.609 INFO:tasks.ceph.osd.7.smithi159.stderr:2023-12-17T15:58:51.608+0000 7f2a65aa4640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 103317) UID: 0 2023-12-17T15:58:51.609 INFO:tasks.ceph.osd.5.smithi159.stderr:2023-12-17T15:58:51.608+0000 7fca99737640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 103317) UID: 0 2023-12-17T16:02:51.871 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T16:02:51.877 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T16:03:22.065 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T16:03:22.071 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T16:03:52.905 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T16:03:52.915 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T16:03:53.046 INFO:tasks.ceph.osd.5.smithi159.stderr:2023-12-17T16:03:53.047+0000 7fca99737640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 103393) UID: 0 2023-12-17T16:03:53.046 INFO:tasks.ceph.osd.6.smithi159.stderr:2023-12-17T16:03:53.048+0000 7efd98236640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 103393) UID: 0 2023-12-17T16:03:53.046 INFO:tasks.ceph.osd.4.smithi159.stderr:2023-12-17T16:03:53.048+0000 7f2f7c3d6640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 103393) UID: 0 2023-12-17T16:03:53.047 INFO:tasks.ceph.osd.7.smithi159.stderr:2023-12-17T16:03:53.048+0000 7f2a65aa4640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 103393) UID: 0 2023-12-17T16:07:56.074 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T16:07:56.082 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T16:07:56.223 INFO:tasks.ceph.osd.1.smithi040.stderr:2023-12-17T16:07:56.226+0000 7f1055c84640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 562128) UID: 0 2023-12-17T16:07:56.224 INFO:tasks.ceph.osd.0.smithi040.stderr:2023-12-17T16:07:56.226+0000 7fddc7cf4640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 562128) UID: 0 2023-12-17T16:07:56.224 INFO:tasks.ceph.osd.2.smithi040.stderr:2023-12-17T16:07:56.226+0000 7f342b477640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 562128) UID: 0 2023-12-17T16:07:56.224 INFO:tasks.ceph.osd.3.smithi040.stderr:2023-12-17T16:07:56.226+0000 7f5186ef4640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 562128) UID: 0 2023-12-17T16:12:05.620 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T16:12:05.630 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T16:12:36.064 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T16:12:36.070 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T16:13:06.202 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T16:13:06.209 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T16:13:37.752 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T16:13:37.758 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T16:14:07.894 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T16:14:07.901 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T16:14:38.708 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T16:14:38.715 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T16:14:38.822 INFO:tasks.ceph.osd.0.smithi040.stderr:2023-12-17T16:14:38.827+0000 7fddc7cf4640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 562247) UID: 0 2023-12-17T16:14:38.822 INFO:tasks.ceph.osd.1.smithi040.stderr:2023-12-17T16:14:38.827+0000 7f1055c84640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 562247) UID: 0 2023-12-17T16:14:38.823 INFO:tasks.ceph.osd.2.smithi040.stderr:2023-12-17T16:14:38.827+0000 7f342b477640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 562247) UID: 0 2023-12-17T16:14:38.823 INFO:tasks.ceph.osd.3.smithi040.stderr:2023-12-17T16:14:38.828+0000 7f5186ef4640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 562247) UID: 0 2023-12-17T16:18:37.055 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T16:18:37.063 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T16:18:37.188 INFO:tasks.ceph.osd.1.smithi040.stderr:2023-12-17T16:18:37.195+0000 7f1055c84640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 562269) UID: 0 2023-12-17T16:18:37.188 INFO:tasks.ceph.osd.2.smithi040.stderr:2023-12-17T16:18:37.195+0000 7f342b477640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 562269) UID: 0 2023-12-17T16:18:37.189 INFO:tasks.ceph.osd.3.smithi040.stderr:2023-12-17T16:18:37.195+0000 7f5186ef4640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 562269) UID: 0 2023-12-17T16:18:37.190 INFO:tasks.ceph.osd.0.smithi040.stderr:2023-12-17T16:18:37.197+0000 7fddc7cf4640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 562269) UID: 0 2023-12-17T16:18:37.317 INFO:tasks.ceph.osd.7.smithi159.stderr:2023-12-17T16:18:37.324+0000 7f2a65aa4640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 103566) UID: 0 2023-12-17T16:18:37.318 INFO:tasks.ceph.osd.4.smithi159.stderr:2023-12-17T16:18:37.324+0000 7f2f7c3d6640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 103566) UID: 0 2023-12-17T16:18:37.318 INFO:tasks.ceph.osd.5.smithi159.stderr:2023-12-17T16:18:37.324+0000 7fca99737640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 103566) UID: 0 2023-12-17T16:18:37.318 INFO:tasks.ceph.osd.6.smithi159.stderr:2023-12-17T16:18:37.324+0000 7efd98236640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 103566) UID: 0 2023-12-17T16:23:08.421 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T16:23:08.429 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T16:23:08.552 INFO:tasks.ceph.osd.2.smithi040.stderr:2023-12-17T16:23:08.559+0000 7f342b477640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 562294) UID: 0 2023-12-17T16:23:08.552 INFO:tasks.ceph.osd.1.smithi040.stderr:2023-12-17T16:23:08.559+0000 7f1055c84640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 562294) UID: 0 2023-12-17T16:23:08.553 INFO:tasks.ceph.osd.0.smithi040.stderr:2023-12-17T16:23:08.560+0000 7fddc7cf4640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 562294) UID: 0 2023-12-17T16:23:08.553 INFO:tasks.ceph.osd.3.smithi040.stderr:2023-12-17T16:23:08.559+0000 7f5186ef4640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 562294) UID: 0 2023-12-17T16:23:08.590 INFO:tasks.ceph.mds.d.smithi159.stderr:2023-12-17T16:23:08.598+0000 7f1350aab640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 103595) UID: 0 2023-12-17T16:23:08.591 INFO:tasks.ceph.mds.b.smithi159.stderr:2023-12-17T16:23:08.598+0000 7ff8c5a52640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 103595) UID: 0 2023-12-17T16:26:34.081 INFO:tasks.ceph.osd.4.smithi159.stderr:2023-12-17T16:26:34.089+0000 7f2f7c3d6640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 103602) UID: 0 2023-12-17T16:26:34.081 INFO:tasks.ceph.osd.5.smithi159.stderr:2023-12-17T16:26:34.089+0000 7fca99737640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 103602) UID: 0 2023-12-17T16:26:34.082 INFO:tasks.ceph.osd.6.smithi159.stderr:2023-12-17T16:26:34.089+0000 7efd98236640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 103602) UID: 0 2023-12-17T16:26:34.082 INFO:tasks.ceph.osd.7.smithi159.stderr:2023-12-17T16:26:34.089+0000 7f2a65aa4640 -1 received signal: Hangup from (PID: 103602) UID: 0 2023-12-17T16:30:52.146 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T16:30:52.154 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T16:30:52.264 INFO:tasks.ceph.osd.4.smithi159.stderr:2023-12-17T16:30:52.274+0000 7f2f7c3d6640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 103633) UID: 0 2023-12-17T16:30:52.265 INFO:tasks.ceph.osd.5.smithi159.stderr:2023-12-17T16:30:52.274+0000 7fca99737640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 103633) UID: 0 2023-12-17T16:30:52.265 INFO:tasks.ceph.osd.6.smithi159.stderr:2023-12-17T16:30:52.274+0000 7efd98236640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 103633) UID: 0 2023-12-17T16:30:52.265 INFO:tasks.ceph.osd.7.smithi159.stderr:2023-12-17T16:30:52.275+0000 7f2a65aa4640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 103633) UID: 0 2023-12-17T16:35:27.203 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T16:35:27.210 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T16:35:57.380 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T16:35:57.388 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T16:36:27.520 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T16:36:27.527 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T16:36:57.686 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T16:36:57.693 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T16:37:27.826 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T16:37:27.831 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T16:37:59.744 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T16:37:59.751 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T16:38:29.943 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T16:38:29.952 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T16:39:00.085 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T16:39:00.092 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T16:39:30.225 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T16:39:30.232 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T16:40:00.381 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T16:40:00.387 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T16:40:30.522 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T16:40:30.529 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T16:41:00.662 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T16:41:00.669 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T16:41:30.806 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T16:41:30.812 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T16:42:00.945 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T16:42:00.952 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T16:42:31.737 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T16:42:31.743 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T16:43:03.104 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T16:43:03.112 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T16:43:03.243 INFO:tasks.ceph.osd.0.smithi040.stderr:2023-12-17T16:43:03.250+0000 7fddc7cf4640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 562629) UID: 0 2023-12-17T16:43:03.244 INFO:tasks.ceph.osd.1.smithi040.stderr:2023-12-17T16:43:03.250+0000 7f1055c84640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 562629) UID: 0 2023-12-17T16:43:03.245 INFO:tasks.ceph.osd.2.smithi040.stderr:2023-12-17T16:43:03.250+0000 7f342b477640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 562629) UID: 0 2023-12-17T16:43:03.245 INFO:tasks.ceph.osd.3.smithi040.stderr:2023-12-17T16:43:03.250+0000 7f5186ef4640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 562629) UID: 0 2023-12-17T16:46:51.700 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T16:46:51.707 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T16:46:51.816 INFO:tasks.ceph.osd.5.smithi159.stderr:2023-12-17T16:46:51.821+0000 7fca99737640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 103966) UID: 0 2023-12-17T16:46:51.816 INFO:tasks.ceph.osd.4.smithi159.stderr:2023-12-17T16:46:51.822+0000 7f2f7c3d6640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 103966) UID: 0 2023-12-17T16:46:51.816 INFO:tasks.ceph.osd.6.smithi159.stderr:2023-12-17T16:46:51.822+0000 7efd98236640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 103966) UID: 0 2023-12-17T16:46:51.817 INFO:tasks.ceph.osd.7.smithi159.stderr:2023-12-17T16:46:51.822+0000 7f2a65aa4640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 103966) UID: 0 2023-12-17T16:51:02.224 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T16:51:02.239 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T16:51:02.316 INFO:tasks.ceph.osd.0.smithi040.stderr:2023-12-17T16:51:02.322+0000 7fddc7cf4640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 562678) UID: 0 2023-12-17T16:51:02.317 INFO:tasks.ceph.osd.2.smithi040.stderr:2023-12-17T16:51:02.322+0000 7f342b477640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 562678) UID: 0 2023-12-17T16:51:02.317 INFO:tasks.ceph.osd.1.smithi040.stderr:2023-12-17T16:51:02.322+0000 7f1055c84640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 562678) UID: 0 2023-12-17T16:51:02.318 INFO:tasks.ceph.osd.3.smithi040.stderr:2023-12-17T16:51:02.322+0000 7f5186ef4640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 562678) UID: 0 2023-12-17T16:51:04.196 INFO:tasks.ceph.osd.4.smithi159.stderr:2023-12-17T16:51:04.201+0000 7f2f7c3d6640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 103995) UID: 0 2023-12-17T16:51:04.198 INFO:tasks.ceph.osd.6.smithi159.stderr:2023-12-17T16:51:04.203+0000 7efd98236640 -1 Fail to open '/proc/103995/cmdline' error = (2) No such file or directory 2023-12-17T16:51:04.198 INFO:tasks.ceph.osd.5.smithi159.stderr:2023-12-17T16:51:04.203+0000 7fca99737640 -1 Fail to open '/proc/103995/cmdline' error = (2) No such file or directory 2023-12-17T16:51:04.199 INFO:tasks.ceph.osd.5.smithi159.stderr:2023-12-17T16:51:04.203+0000 7fca99737640 -1 received signal: Hangup from (PID: 103995) UID: 0 2023-12-17T16:51:04.199 INFO:tasks.ceph.osd.7.smithi159.stderr:2023-12-17T16:51:04.201+0000 7f2a65aa4640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 103995) UID: 0 2023-12-17T16:51:04.200 INFO:tasks.ceph.osd.6.smithi159.stderr:2023-12-17T16:51:04.203+0000 7efd98236640 -1 received signal: Hangup from (PID: 103995) UID: 0 2023-12-17T16:55:15.527 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T16:55:15.537 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T16:55:15.664 INFO:tasks.ceph.osd.6.smithi159.stderr:2023-12-17T16:55:15.669+0000 7efd98236640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 104023) UID: 0 2023-12-17T16:55:15.664 INFO:tasks.ceph.osd.4.smithi159.stderr:2023-12-17T16:55:15.669+0000 7f2f7c3d6640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 104023) UID: 0 2023-12-17T16:55:15.665 INFO:tasks.ceph.osd.5.smithi159.stderr:2023-12-17T16:55:15.669+0000 7fca99737640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 104023) UID: 0 2023-12-17T16:55:15.665 INFO:tasks.ceph.osd.7.smithi159.stderr:2023-12-17T16:55:15.669+0000 7f2a65aa4640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 104023) UID: 0 2023-12-17T16:59:26.111 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T16:59:26.118 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T16:59:56.264 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T16:59:56.271 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T17:00:26.403 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T17:00:26.410 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T17:00:26.515 INFO:tasks.ceph.osd.0.smithi040.stderr:2023-12-17T17:00:26.520+0000 7fddc7cf4640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 562757) UID: 0 2023-12-17T17:00:26.515 INFO:tasks.ceph.osd.1.smithi040.stderr:2023-12-17T17:00:26.520+0000 7f1055c84640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 562757) UID: 0 2023-12-17T17:00:26.516 INFO:tasks.ceph.osd.3.smithi040.stderr:2023-12-17T17:00:26.521+0000 7f5186ef4640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 562757) UID: 0 2023-12-17T17:00:26.516 INFO:tasks.ceph.osd.2.smithi040.stderr:2023-12-17T17:00:26.521+0000 7f342b477640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 562757) UID: 0 2023-12-17T17:04:16.621 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T17:04:16.628 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T17:04:16.931 INFO:tasks.ceph.osd.6.smithi159.stderr:2023-12-17T17:04:16.937+0000 7efd98236640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 104122) UID: 0 2023-12-17T17:04:16.931 INFO:tasks.ceph.osd.7.smithi159.stderr:2023-12-17T17:04:16.938+0000 7f2a65aa4640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 104122) UID: 0 2023-12-17T17:04:16.933 INFO:tasks.ceph.osd.5.smithi159.stderr:2023-12-17T17:04:16.939+0000 7fca99737640 -1 received signal: Hangup from (PID: 104122) UID: 0 2023-12-17T17:04:16.933 INFO:tasks.ceph.osd.4.smithi159.stderr:2023-12-17T17:04:16.939+0000 7f2f7c3d6640 -1 received signal: Hangup from (PID: 104122) UID: 0 2023-12-17T17:08:20.434 INFO:teuthology.orchestra.run.smithi040.stdout:generic/521 5599s 2023-12-17T17:08:20.486 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/521 2023-12-17T17:08:20.488 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T17:08:20.495 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T17:08:20.620 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T17:08:20.622 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/522) 2023-12-17T17:08:20.675 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T17:08:20.701 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T17:08:21.842 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T17:08:21.857 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T17:08:21.859 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T17:08:21.863 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T17:08:21.863 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T17:08:50.952 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T17:08:50.961 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T17:09:22.446 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T17:09:22.453 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T17:09:52.688 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T17:09:52.699 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T17:10:22.833 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T17:10:22.844 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T17:10:54.070 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T17:10:54.075 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T17:11:24.209 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T17:11:24.239 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T17:11:54.433 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T17:11:54.440 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T17:11:55.308 INFO:tasks.ceph.osd.0.smithi040.stderr:2023-12-17T17:11:55.312+0000 7fddc7cf4640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 563421) UID: 0 2023-12-17T17:11:55.309 INFO:tasks.ceph.osd.1.smithi040.stderr:2023-12-17T17:11:55.312+0000 7f1055c84640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 563421) UID: 0 2023-12-17T17:11:55.309 INFO:tasks.ceph.osd.3.smithi040.stderr:2023-12-17T17:11:55.312+0000 7f5186ef4640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 563421) UID: 0 2023-12-17T17:11:55.310 INFO:tasks.ceph.osd.2.smithi040.stderr:2023-12-17T17:11:55.312+0000 7f342b477640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 563421) UID: 0 2023-12-17T17:15:51.798 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T17:15:51.805 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T17:16:22.048 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T17:16:22.054 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T17:16:52.209 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T17:16:52.216 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T17:17:22.346 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T17:17:22.353 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T17:17:22.453 INFO:tasks.ceph.osd.0.smithi040.stderr:2023-12-17T17:17:22.453+0000 7fddc7cf4640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 563499) UID: 0 2023-12-17T17:17:22.453 INFO:tasks.ceph.osd.1.smithi040.stderr:2023-12-17T17:17:22.453+0000 7f1055c84640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 563499) UID: 0 2023-12-17T17:17:22.455 INFO:tasks.ceph.osd.2.smithi040.stderr:2023-12-17T17:17:22.453+0000 7f342b477640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 563499) UID: 0 2023-12-17T17:17:22.455 INFO:tasks.ceph.osd.3.smithi040.stderr:2023-12-17T17:17:22.454+0000 7f5186ef4640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 563499) UID: 0 2023-12-17T17:21:06.672 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T17:21:06.678 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T17:21:06.783 INFO:tasks.ceph.osd.6.smithi159.stderr:2023-12-17T17:21:06.782+0000 7efd98236640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 104382) UID: 0 2023-12-17T17:21:06.783 INFO:tasks.ceph.osd.7.smithi159.stderr:2023-12-17T17:21:06.782+0000 7f2a65aa4640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 104382) UID: 0 2023-12-17T17:21:06.783 INFO:tasks.ceph.osd.4.smithi159.stderr:2023-12-17T17:21:06.782+0000 7f2f7c3d6640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 104382) UID: 0 2023-12-17T17:21:06.784 INFO:tasks.ceph.osd.5.smithi159.stderr:2023-12-17T17:21:06.782+0000 7fca99737640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 104382) UID: 0 2023-12-17T17:25:26.428 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T17:25:26.441 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T17:25:26.557 INFO:tasks.ceph.osd.0.smithi040.stderr:2023-12-17T17:25:26.554+0000 7fddc7cf4640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 563548) UID: 0 2023-12-17T17:25:26.557 INFO:tasks.ceph.osd.1.smithi040.stderr:2023-12-17T17:25:26.554+0000 7f1055c84640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 563548) UID: 0 2023-12-17T17:25:26.557 INFO:tasks.ceph.osd.2.smithi040.stderr:2023-12-17T17:25:26.554+0000 7f342b477640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 563548) UID: 0 2023-12-17T17:25:26.558 INFO:tasks.ceph.osd.3.smithi040.stderr:2023-12-17T17:25:26.554+0000 7f5186ef4640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 563548) UID: 0 2023-12-17T17:25:26.605 INFO:tasks.ceph.osd.4.smithi159.stderr:2023-12-17T17:25:26.603+0000 7f2f7c3d6640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 104407) UID: 0 2023-12-17T17:25:26.606 INFO:tasks.ceph.osd.6.smithi159.stderr:2023-12-17T17:25:26.603+0000 7efd98236640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 104407) UID: 0 2023-12-17T17:25:26.606 INFO:tasks.ceph.osd.5.smithi159.stderr:2023-12-17T17:25:26.603+0000 7fca99737640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 104407) UID: 0 2023-12-17T17:25:26.606 INFO:tasks.ceph.osd.7.smithi159.stderr:2023-12-17T17:25:26.603+0000 7f2a65aa4640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 104407) UID: 0 2023-12-17T17:30:01.398 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T17:30:01.405 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T17:30:32.206 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T17:30:32.214 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T17:31:03.129 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T17:31:03.139 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T17:31:33.324 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T17:31:33.332 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T17:32:03.473 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T17:32:03.483 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T17:32:03.597 INFO:tasks.ceph.osd.6.smithi159.stderr:2023-12-17T17:32:03.591+0000 7efd98236640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 104513) UID: 0 2023-12-17T17:32:03.597 INFO:tasks.ceph.osd.4.smithi159.stderr:2023-12-17T17:32:03.592+0000 7f2f7c3d6640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 104513) UID: 0 2023-12-17T17:32:03.598 INFO:tasks.ceph.osd.5.smithi159.stderr:2023-12-17T17:32:03.593+0000 7fca99737640 -1 received signal: Hangup from (PID: 104513) UID: 0 2023-12-17T17:32:03.599 INFO:tasks.ceph.osd.7.smithi159.stderr:2023-12-17T17:32:03.593+0000 7f2a65aa4640 -1 received signal: Hangup from (PID: 104513) UID: 0 2023-12-17T17:36:14.604 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T17:36:14.612 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T17:36:45.406 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T17:36:45.412 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T17:37:15.559 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T17:37:15.566 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T17:37:15.685 INFO:tasks.ceph.mds.d.smithi159.stderr:2023-12-17T17:37:15.680+0000 7f1350aab640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 104585) UID: 0 2023-12-17T17:37:15.685 INFO:tasks.ceph.mds.b.smithi159.stderr:2023-12-17T17:37:15.680+0000 7ff8c5a52640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 104585) UID: 0 2023-12-17T17:40:51.287 INFO:tasks.ceph.osd.5.smithi159.stderr:2023-12-17T17:40:51.281+0000 7fca99737640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 104592) UID: 0 2023-12-17T17:40:51.288 INFO:tasks.ceph.osd.4.smithi159.stderr:2023-12-17T17:40:51.280+0000 7f2f7c3d6640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 104592) UID: 0 2023-12-17T17:40:51.288 INFO:tasks.ceph.osd.7.smithi159.stderr:2023-12-17T17:40:51.281+0000 7f2a65aa4640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 104592) UID: 0 2023-12-17T17:40:51.288 INFO:tasks.ceph.osd.6.smithi159.stderr:2023-12-17T17:40:51.280+0000 7efd98236640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 104592) UID: 0 2023-12-17T17:45:05.419 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T17:45:05.426 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T17:45:05.562 INFO:tasks.ceph.osd.1.smithi040.stderr:2023-12-17T17:45:05.557+0000 7f1055c84640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 563754) UID: 0 2023-12-17T17:45:05.562 INFO:tasks.ceph.osd.0.smithi040.stderr:2023-12-17T17:45:05.557+0000 7fddc7cf4640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 563754) UID: 0 2023-12-17T17:45:05.562 INFO:tasks.ceph.osd.3.smithi040.stderr:2023-12-17T17:45:05.557+0000 7f5186ef4640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 563754) UID: 0 2023-12-17T17:45:05.563 INFO:tasks.ceph.osd.2.smithi040.stderr:2023-12-17T17:45:05.558+0000 7f342b477640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 563754) UID: 0 2023-12-17T17:49:02.745 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T17:49:02.753 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T17:49:02.864 INFO:tasks.ceph.osd.4.smithi159.stderr:2023-12-17T17:49:02.862+0000 7f2f7c3d6640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 104640) UID: 0 2023-12-17T17:49:02.865 INFO:tasks.ceph.osd.6.smithi159.stderr:2023-12-17T17:49:02.861+0000 7efd98236640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 104640) UID: 0 2023-12-17T17:49:02.866 INFO:tasks.ceph.osd.7.smithi159.stderr:2023-12-17T17:49:02.862+0000 7f2a65aa4640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 104640) UID: 0 2023-12-17T17:49:02.866 INFO:tasks.ceph.osd.5.smithi159.stderr:2023-12-17T17:49:02.862+0000 7fca99737640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 104640) UID: 0 2023-12-17T17:53:26.439 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T17:53:26.446 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T17:53:26.548 INFO:tasks.ceph.osd.1.smithi040.stderr:2023-12-17T17:53:26.546+0000 7f1055c84640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 563799) UID: 0 2023-12-17T17:53:26.549 INFO:tasks.ceph.osd.2.smithi040.stderr:2023-12-17T17:53:26.546+0000 7f342b477640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 563799) UID: 0 2023-12-17T17:53:26.549 INFO:tasks.ceph.osd.3.smithi040.stderr:2023-12-17T17:53:26.546+0000 7f5186ef4640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 563799) UID: 0 2023-12-17T17:53:26.550 INFO:tasks.ceph.osd.0.smithi040.stderr:2023-12-17T17:53:26.546+0000 7fddc7cf4640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 563799) UID: 0 2023-12-17T17:57:24.672 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T17:57:24.679 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T17:57:24.766 INFO:tasks.ceph.osd.6.smithi159.stderr:2023-12-17T17:57:24.763+0000 7efd98236640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 104689) UID: 0 2023-12-17T17:57:24.766 INFO:tasks.ceph.osd.4.smithi159.stderr:2023-12-17T17:57:24.763+0000 7f2f7c3d6640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 104689) UID: 0 2023-12-17T17:57:24.766 INFO:tasks.ceph.osd.7.smithi159.stderr:2023-12-17T17:57:24.764+0000 7f2a65aa4640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 104689) UID: 0 2023-12-17T17:57:24.768 INFO:tasks.ceph.osd.5.smithi159.stderr:2023-12-17T17:57:24.766+0000 7fca99737640 -1 Fail to open '/proc/104689/cmdline' error = (2) No such file or directory 2023-12-17T17:57:24.768 INFO:tasks.ceph.osd.5.smithi159.stderr:2023-12-17T17:57:24.766+0000 7fca99737640 -1 received signal: Hangup from (PID: 104689) UID: 0 2023-12-17T18:01:40.407 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T18:01:40.413 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T18:01:40.531 INFO:tasks.ceph.osd.1.smithi040.stderr:2023-12-17T18:01:40.530+0000 7f1055c84640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 563860) UID: 0 2023-12-17T18:01:40.531 INFO:tasks.ceph.osd.0.smithi040.stderr:2023-12-17T18:01:40.530+0000 7fddc7cf4640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 563860) UID: 0 2023-12-17T18:01:40.531 INFO:tasks.ceph.osd.2.smithi040.stderr:2023-12-17T18:01:40.530+0000 7f342b477640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 563860) UID: 0 2023-12-17T18:01:40.531 INFO:tasks.ceph.osd.3.smithi040.stderr:2023-12-17T18:01:40.530+0000 7f5186ef4640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 563860) UID: 0 2023-12-17T18:08:13.440 INFO:teuthology.orchestra.run.smithi040.stdout:generic/522 3591s 2023-12-17T18:08:13.538 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/522 2023-12-17T18:08:13.538 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T18:08:13.551 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T18:08:13.613 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T18:08:13.614 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/523) 2023-12-17T18:08:18.434 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T18:08:18.447 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T18:08:18.449 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T18:08:18.452 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T18:08:18.452 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T18:08:19.686 INFO:teuthology.orchestra.run.smithi040.stdout:generic/523 1s 2023-12-17T18:08:19.707 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/523 2023-12-17T18:08:19.707 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T18:08:19.720 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T18:08:19.755 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T18:08:19.755 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/524) 2023-12-17T18:08:20.410 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T18:08:20.426 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T18:08:20.427 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T18:08:20.434 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T18:08:20.434 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T18:08:28.202 INFO:teuthology.orchestra.run.smithi040.stdout:generic/524 8s 2023-12-17T18:08:28.221 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/524 2023-12-17T18:08:28.221 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T18:08:28.230 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T18:08:28.261 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T18:08:28.261 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/525) 2023-12-17T18:08:28.912 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T18:08:28.928 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T18:08:28.931 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T18:08:28.933 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T18:08:28.933 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T18:08:30.222 INFO:teuthology.orchestra.run.smithi040.stdout:generic/525 [not run] filesystem does not support huge file size 2023-12-17T18:08:30.254 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/525 2023-12-17T18:08:30.254 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/525 2023-12-17T18:08:30.254 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T18:08:30.264 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T18:08:30.316 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T18:08:30.317 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/526) 2023-12-17T18:08:31.020 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T18:08:31.036 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T18:08:31.038 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T18:08:31.043 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T18:08:31.043 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T18:08:31.989 INFO:teuthology.orchestra.run.smithi040.stdout:generic/526 [not run] require 172.21.15.40:6789:/scratch to be valid block disk 2023-12-17T18:08:32.002 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/526 2023-12-17T18:08:32.003 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/526 2023-12-17T18:08:32.003 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T18:08:32.013 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T18:08:32.056 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T18:08:32.056 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/527) 2023-12-17T18:08:32.794 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T18:08:32.807 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T18:08:32.808 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T18:08:32.811 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T18:08:32.811 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T18:08:33.816 INFO:teuthology.orchestra.run.smithi040.stdout:generic/527 [not run] require 172.21.15.40:6789:/scratch to be valid block disk 2023-12-17T18:08:33.833 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/527 2023-12-17T18:08:33.833 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/527 2023-12-17T18:08:33.833 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T18:08:33.845 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T18:08:33.896 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T18:08:33.896 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/528) 2023-12-17T18:08:34.587 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T18:08:34.602 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T18:08:34.604 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T18:08:34.607 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T18:08:34.607 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T18:08:35.765 INFO:teuthology.orchestra.run.smithi040.stdout:generic/528 1s 2023-12-17T18:08:35.784 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/528 2023-12-17T18:08:35.785 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T18:08:35.796 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T18:08:35.903 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T18:08:35.903 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/529) 2023-12-17T18:08:36.781 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T18:08:36.793 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T18:08:36.796 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T18:08:36.799 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T18:08:36.800 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T18:08:37.966 INFO:teuthology.orchestra.run.smithi040.stdout:generic/529 0s 2023-12-17T18:08:37.986 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/529 2023-12-17T18:08:37.987 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T18:08:37.997 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T18:08:38.037 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T18:08:38.038 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/530) 2023-12-17T18:08:38.694 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T18:08:38.710 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T18:08:38.712 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T18:08:38.716 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T18:08:38.716 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T18:08:39.696 INFO:teuthology.orchestra.run.smithi040.stdout:generic/530 [not run] ceph does not support shutdown 2023-12-17T18:08:39.726 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/530 2023-12-17T18:08:39.726 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/530 2023-12-17T18:08:39.726 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T18:08:39.738 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T18:08:39.788 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T18:08:39.788 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/531) 2023-12-17T18:08:40.488 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T18:08:40.502 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T18:08:40.503 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T18:08:40.506 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T18:08:40.506 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T18:08:41.226 INFO:teuthology.orchestra.run.smithi040.stdout:generic/531 [not run] O_TMPFILE is not supported 2023-12-17T18:08:41.240 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/531 2023-12-17T18:08:41.240 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/531 2023-12-17T18:08:41.240 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T18:08:41.252 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T18:08:41.295 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T18:08:41.295 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/532) 2023-12-17T18:08:41.955 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T18:08:41.975 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T18:08:41.978 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T18:08:41.981 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T18:08:41.981 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T18:08:42.824 INFO:teuthology.orchestra.run.smithi040.stdout:generic/532 0s 2023-12-17T18:08:42.845 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/532 2023-12-17T18:08:42.845 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T18:08:42.854 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T18:08:42.908 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T18:08:42.909 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/533) 2023-12-17T18:08:43.555 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T18:08:43.576 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T18:08:43.578 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T18:08:43.581 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T18:08:43.582 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T18:08:45.275 INFO:teuthology.orchestra.run.smithi040.stdout:generic/533 2s 2023-12-17T18:08:45.297 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/533 2023-12-17T18:08:45.297 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T18:08:45.305 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T18:08:45.353 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T18:08:45.354 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/534) 2023-12-17T18:08:46.014 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T18:08:46.032 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T18:08:46.037 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T18:08:46.040 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T18:08:46.040 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T18:08:46.882 INFO:teuthology.orchestra.run.smithi040.stdout:generic/534 [not run] require 172.21.15.40:6789:/scratch to be valid block disk 2023-12-17T18:08:46.898 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/534 2023-12-17T18:08:46.898 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/534 2023-12-17T18:08:46.898 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T18:08:46.909 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T18:08:46.957 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T18:08:46.957 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/535) 2023-12-17T18:08:47.635 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T18:08:47.646 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T18:08:47.647 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T18:08:47.650 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T18:08:47.650 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T18:08:49.140 INFO:teuthology.orchestra.run.smithi040.stdout:generic/535 [not run] require 172.21.15.40:6789:/scratch to be valid block disk 2023-12-17T18:08:49.157 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/535 2023-12-17T18:08:49.157 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/535 2023-12-17T18:08:49.157 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T18:08:49.168 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T18:08:49.211 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T18:08:49.211 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/536) 2023-12-17T18:08:49.872 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T18:08:49.892 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T18:08:49.894 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T18:08:49.902 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T18:08:49.902 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T18:08:50.905 INFO:teuthology.orchestra.run.smithi040.stdout:generic/536 [not run] ceph does not support shutdown 2023-12-17T18:08:50.999 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/536 2023-12-17T18:08:50.999 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/536 2023-12-17T18:08:50.999 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T18:08:51.008 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T18:08:51.058 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T18:08:51.058 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/537) 2023-12-17T18:08:51.758 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T18:08:51.775 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T18:08:51.777 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T18:08:51.781 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T18:08:51.781 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T18:08:52.727 INFO:teuthology.orchestra.run.smithi040.stdout:generic/537 [not run] FSTRIM not supported 2023-12-17T18:08:52.758 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/537 2023-12-17T18:08:52.758 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/537 2023-12-17T18:08:52.758 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T18:08:52.766 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T18:08:52.816 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T18:08:52.816 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/538) 2023-12-17T18:08:53.510 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T18:08:53.526 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T18:08:53.528 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T18:08:53.532 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T18:08:53.532 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T18:10:04.481 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T18:10:04.489 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T18:10:35.167 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T18:10:35.174 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T18:11:05.303 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T18:11:05.316 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T18:11:35.450 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T18:11:35.458 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T18:12:05.614 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T18:12:05.621 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T18:12:35.773 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T18:12:35.779 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T18:13:06.293 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T18:13:06.300 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T18:13:36.451 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T18:13:36.462 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T18:14:06.616 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T18:14:06.623 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T18:14:36.753 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T18:14:36.760 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T18:15:06.913 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T18:15:06.920 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T18:15:37.061 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T18:15:37.069 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T18:15:37.164 INFO:tasks.ceph.osd.4.smithi159.stderr:2023-12-17T18:15:37.164+0000 7f2f7c3d6640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 105405) UID: 0 2023-12-17T18:15:37.165 INFO:tasks.ceph.osd.5.smithi159.stderr:2023-12-17T18:15:37.164+0000 7fca99737640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 105405) UID: 0 2023-12-17T18:15:37.165 INFO:tasks.ceph.osd.6.smithi159.stderr:2023-12-17T18:15:37.164+0000 7efd98236640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 105405) UID: 0 2023-12-17T18:15:37.166 INFO:tasks.ceph.osd.7.smithi159.stderr:2023-12-17T18:15:37.164+0000 7f2a65aa4640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 105405) UID: 0 2023-12-17T18:19:36.607 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T18:19:36.615 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T18:19:36.738 INFO:tasks.ceph.osd.6.smithi159.stderr:2023-12-17T18:19:36.738+0000 7efd98236640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 105487) UID: 0 2023-12-17T18:19:36.739 INFO:tasks.ceph.osd.5.smithi159.stderr:2023-12-17T18:19:36.738+0000 7fca99737640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 105487) UID: 0 2023-12-17T18:19:36.739 INFO:tasks.ceph.osd.4.smithi159.stderr:2023-12-17T18:19:36.739+0000 7f2f7c3d6640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 105487) UID: 0 2023-12-17T18:19:36.740 INFO:tasks.ceph.osd.7.smithi159.stderr:2023-12-17T18:19:36.738+0000 7f2a65aa4640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 105487) UID: 0 2023-12-17T18:21:26.557 INFO:teuthology.orchestra.run.smithi040.stdout:generic/538 753s 2023-12-17T18:21:26.573 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/538 2023-12-17T18:21:26.573 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T18:21:26.581 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T18:21:26.671 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T18:21:26.672 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/539) 2023-12-17T18:21:27.434 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T18:21:27.454 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T18:21:27.456 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T18:21:27.458 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T18:21:27.458 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T18:21:30.330 INFO:teuthology.orchestra.run.smithi040.stdout:generic/539 3s 2023-12-17T18:21:30.358 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/539 2023-12-17T18:21:30.358 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T18:21:30.371 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T18:21:30.481 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T18:21:30.481 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/540) 2023-12-17T18:21:31.284 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T18:21:31.301 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T18:21:31.303 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T18:21:31.306 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T18:21:31.306 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T18:21:32.355 INFO:teuthology.orchestra.run.smithi040.stdout:generic/540 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-17T18:21:32.381 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/540 2023-12-17T18:21:32.381 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/540 2023-12-17T18:21:32.381 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T18:21:32.397 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T18:21:32.626 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T18:21:32.626 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/541) 2023-12-17T18:21:33.265 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T18:21:33.279 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T18:21:33.281 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T18:21:33.285 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T18:21:33.285 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T18:21:34.344 INFO:teuthology.orchestra.run.smithi040.stdout:generic/541 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-17T18:21:34.364 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/541 2023-12-17T18:21:34.364 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/541 2023-12-17T18:21:34.364 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T18:21:34.383 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T18:21:34.829 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T18:21:34.829 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/542) 2023-12-17T18:21:35.449 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T18:21:35.463 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T18:21:35.465 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T18:21:35.469 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T18:21:35.469 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T18:21:36.504 INFO:teuthology.orchestra.run.smithi040.stdout:generic/542 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-17T18:21:36.523 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/542 2023-12-17T18:21:36.523 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/542 2023-12-17T18:21:36.524 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T18:21:36.547 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T18:21:37.034 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T18:21:37.034 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/543) 2023-12-17T18:21:37.634 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T18:21:37.650 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T18:21:37.652 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T18:21:37.655 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T18:21:37.655 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T18:21:38.737 INFO:teuthology.orchestra.run.smithi040.stdout:generic/543 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-17T18:21:38.764 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/543 2023-12-17T18:21:38.764 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/543 2023-12-17T18:21:38.764 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T18:21:38.778 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T18:21:39.099 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T18:21:39.099 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/544) 2023-12-17T18:21:39.711 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T18:21:39.725 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T18:21:39.726 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T18:21:39.728 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T18:21:39.729 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T18:21:41.065 INFO:teuthology.orchestra.run.smithi040.stdout:generic/544 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-17T18:21:41.091 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/544 2023-12-17T18:21:41.091 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/544 2023-12-17T18:21:41.091 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T18:21:41.109 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T18:21:41.538 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T18:21:41.539 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/545) 2023-12-17T18:21:42.175 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T18:21:42.190 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T18:21:42.192 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T18:21:42.195 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T18:21:42.195 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T18:21:43.088 INFO:teuthology.orchestra.run.smithi040.stdout:generic/545 [not run] file system doesn't support chattr +i 2023-12-17T18:21:43.100 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/545 2023-12-17T18:21:43.102 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/545 2023-12-17T18:21:43.102 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T18:21:43.111 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T18:21:43.178 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T18:21:43.179 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/546) 2023-12-17T18:21:43.814 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T18:21:43.826 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T18:21:43.827 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T18:21:43.830 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T18:21:43.830 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T18:21:44.610 INFO:teuthology.orchestra.run.smithi040.stdout:generic/546 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-12-17T18:21:44.623 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/546 2023-12-17T18:21:44.624 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/546 2023-12-17T18:21:44.624 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T18:21:44.634 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T18:21:44.690 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T18:21:44.690 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/547) 2023-12-17T18:21:45.293 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T18:21:45.307 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T18:21:45.309 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T18:21:45.313 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T18:21:45.313 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T18:21:46.043 INFO:teuthology.orchestra.run.smithi040.stdout:generic/547 [not run] require 172.21.15.40:6789:/scratch to be valid block disk 2023-12-17T18:21:46.057 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/547 2023-12-17T18:21:46.057 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/547 2023-12-17T18:21:46.058 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T18:21:46.065 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T18:21:46.106 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T18:21:46.106 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/548) 2023-12-17T18:21:46.797 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T18:21:46.813 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T18:21:46.814 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T18:21:46.817 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T18:21:46.817 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T18:21:48.634 INFO:teuthology.orchestra.run.smithi040.stdout:generic/548 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-12-17T18:21:48.646 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/548 2023-12-17T18:21:48.646 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/548 2023-12-17T18:21:48.646 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T18:21:48.655 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T18:21:48.720 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T18:21:48.720 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/549) 2023-12-17T18:21:49.320 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T18:21:49.333 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T18:21:49.335 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T18:21:49.339 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T18:21:49.339 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T18:21:51.340 INFO:teuthology.orchestra.run.smithi040.stdout:generic/549 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-12-17T18:21:51.355 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/549 2023-12-17T18:21:51.355 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/549 2023-12-17T18:21:51.355 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T18:21:51.366 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T18:21:51.426 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T18:21:51.426 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/550) 2023-12-17T18:21:52.058 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T18:21:52.075 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T18:21:52.077 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T18:21:52.081 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T18:21:52.081 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T18:21:53.346 INFO:teuthology.orchestra.run.smithi040.stdout:generic/550 [not run] encryption policy '-c 9 -n 9 -f 0' is unusable; probably missing kernel crypto API support 2023-12-17T18:21:53.386 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/550 2023-12-17T18:21:53.386 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/550 2023-12-17T18:21:53.386 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T18:21:53.396 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T18:21:53.435 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T18:21:53.436 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/551) 2023-12-17T18:21:54.064 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T18:21:54.080 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T18:21:54.082 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T18:21:54.086 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T18:21:54.086 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T18:27:52.915 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T18:27:52.932 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T18:27:53.265 INFO:tasks.ceph.osd.4.smithi159.stderr:2023-12-17T18:27:53.262+0000 7f2f7c3d6640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 105908) UID: 0 2023-12-17T18:27:53.266 INFO:tasks.ceph.osd.5.smithi159.stderr:2023-12-17T18:27:53.263+0000 7fca99737640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 105908) UID: 0 2023-12-17T18:27:53.266 INFO:tasks.ceph.osd.6.smithi159.stderr:2023-12-17T18:27:53.262+0000 7efd98236640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 105908) UID: 0 2023-12-17T18:27:53.266 INFO:tasks.ceph.osd.7.smithi159.stderr:2023-12-17T18:27:53.264+0000 7f2a65aa4640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 105908) UID: 0 2023-12-17T18:27:53.520 INFO:tasks.ceph.osd.0.smithi040.stderr:2023-12-17T18:27:53.518+0000 7fddc7cf4640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 586081) UID: 0 2023-12-17T18:27:53.524 INFO:tasks.ceph.osd.3.smithi040.stderr:2023-12-17T18:27:53.522+0000 7f5186ef4640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 586081) UID: 0 2023-12-17T18:27:53.529 INFO:tasks.ceph.osd.1.smithi040.stderr:2023-12-17T18:27:53.527+0000 7f1055c84640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 586081) UID: 0 2023-12-17T18:27:53.542 INFO:tasks.ceph.osd.2.smithi040.stderr:2023-12-17T18:27:53.532+0000 7f342b477640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 586081) UID: 0 2023-12-17T18:36:45.226 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T18:36:45.235 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T18:36:45.628 INFO:tasks.ceph.osd.1.smithi040.stderr:2023-12-17T18:36:45.626+0000 7f1055c84640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 587004) UID: 0 2023-12-17T18:36:45.628 INFO:tasks.ceph.osd.0.smithi040.stderr:2023-12-17T18:36:45.626+0000 7fddc7cf4640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 587004) UID: 0 2023-12-17T18:36:45.630 INFO:tasks.ceph.osd.2.smithi040.stderr:2023-12-17T18:36:45.626+0000 7f342b477640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 587004) UID: 0 2023-12-17T18:36:45.630 INFO:tasks.ceph.osd.3.smithi040.stderr:2023-12-17T18:36:45.627+0000 7f5186ef4640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 587004) UID: 0 2023-12-17T18:41:27.251 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T18:41:27.257 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T18:41:57.642 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T18:41:57.649 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T18:41:57.787 INFO:tasks.ceph.osd.1.smithi040.stderr:2023-12-17T18:41:57.785+0000 7f1055c84640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 587934) UID: 0 2023-12-17T18:41:57.788 INFO:tasks.ceph.osd.3.smithi040.stderr:2023-12-17T18:41:57.786+0000 7f5186ef4640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 587934) UID: 0 2023-12-17T18:41:57.788 INFO:tasks.ceph.osd.2.smithi040.stderr:2023-12-17T18:41:57.786+0000 7f342b477640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 587934) UID: 0 2023-12-17T18:41:57.788 INFO:tasks.ceph.osd.0.smithi040.stderr:2023-12-17T18:41:57.786+0000 7fddc7cf4640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 587934) UID: 0 2023-12-17T18:45:42.142 INFO:tasks.ceph.osd.5.smithi159.stderr:2023-12-17T18:45:42.137+0000 7fca8fd48640 -1 bdev(0x561d1cb0ee00 /var/lib/ceph/osd/ceph-5/block) _aio_thread got r=-28 ((28) No space left on device) 2023-12-17T18:45:42.228 INFO:tasks.ceph.osd.5.smithi159.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-119-ga62fda73/rpm/el9/BUILD/ceph-19.0.0-119-ga62fda73/src/blk/kernel/KernelDevice.cc: In function 'void KernelDevice::_aio_thread()' thread 7fca8fd48640 time 2023-12-17T18:45:42.217776+0000 2023-12-17T18:45:42.228 INFO:tasks.ceph.osd.5.smithi159.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-119-ga62fda73/rpm/el9/BUILD/ceph-19.0.0-119-ga62fda73/src/blk/kernel/KernelDevice.cc: 633: ceph_abort_msg("Unexpected IO error. This may suggest a hardware issue. Please check your kernel log!") 2023-12-17T18:45:42.228 INFO:tasks.ceph.osd.5.smithi159.stderr: ceph version 19.0.0-119-ga62fda73 (a62fda73efba5520d409bb5a21bd8373289dda5d) reef (dev) 2023-12-17T18:45:42.228 INFO:tasks.ceph.osd.5.smithi159.stderr: 1: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0xc6) [0x561d19794ee9] 2023-12-17T18:45:42.229 INFO:tasks.ceph.osd.5.smithi159.stderr: 2: (KernelDevice::_aio_thread()+0x10f6) [0x561d1a0e55b6] 2023-12-17T18:45:42.229 INFO:tasks.ceph.osd.5.smithi159.stderr: 3: ceph-osd(+0xda2811) [0x561d1a0c6811] 2023-12-17T18:45:42.229 INFO:tasks.ceph.osd.5.smithi159.stderr: 4: /lib64/libc.so.6(+0x9f802) [0x7fca9cc9f802] 2023-12-17T18:45:42.229 INFO:tasks.ceph.osd.5.smithi159.stderr: 5: /lib64/libc.so.6(+0x3f450) [0x7fca9cc3f450] 2023-12-17T18:45:42.229 INFO:tasks.ceph.osd.5.smithi159.stderr:*** Caught signal (Aborted) ** 2023-12-17T18:45:42.229 INFO:tasks.ceph.osd.5.smithi159.stderr: in thread 7fca8fd48640 thread_name:bstore_aio 2023-12-17T18:45:42.229 INFO:tasks.ceph.osd.5.smithi159.stderr:2023-12-17T18:45:42.225+0000 7fca8fd48640 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-119-ga62fda73/rpm/el9/BUILD/ceph-19.0.0-119-ga62fda73/src/blk/kernel/KernelDevice.cc: In function 'void KernelDevice::_aio_thread()' thread 7fca8fd48640 time 2023-12-17T18:45:42.217776+0000 2023-12-17T18:45:42.229 INFO:tasks.ceph.osd.5.smithi159.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-119-ga62fda73/rpm/el9/BUILD/ceph-19.0.0-119-ga62fda73/src/blk/kernel/KernelDevice.cc: 633: ceph_abort_msg("Unexpected IO error. This may suggest a hardware issue. Please check your kernel log!") 2023-12-17T18:45:42.230 INFO:tasks.ceph.osd.5.smithi159.stderr: 2023-12-17T18:45:42.230 INFO:tasks.ceph.osd.5.smithi159.stderr: ceph version 19.0.0-119-ga62fda73 (a62fda73efba5520d409bb5a21bd8373289dda5d) reef (dev) 2023-12-17T18:45:42.230 INFO:tasks.ceph.osd.5.smithi159.stderr: 1: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0xc6) [0x561d19794ee9] 2023-12-17T18:45:42.230 INFO:tasks.ceph.osd.5.smithi159.stderr: 2: (KernelDevice::_aio_thread()+0x10f6) [0x561d1a0e55b6] 2023-12-17T18:45:42.230 INFO:tasks.ceph.osd.5.smithi159.stderr: 3: ceph-osd(+0xda2811) [0x561d1a0c6811] 2023-12-17T18:45:42.230 INFO:tasks.ceph.osd.5.smithi159.stderr: 4: /lib64/libc.so.6(+0x9f802) [0x7fca9cc9f802] 2023-12-17T18:45:42.230 INFO:tasks.ceph.osd.5.smithi159.stderr: 5: /lib64/libc.so.6(+0x3f450) [0x7fca9cc3f450] 2023-12-17T18:45:42.230 INFO:tasks.ceph.osd.5.smithi159.stderr: 2023-12-17T18:45:42.231 INFO:tasks.ceph.osd.5.smithi159.stderr: ceph version 19.0.0-119-ga62fda73 (a62fda73efba5520d409bb5a21bd8373289dda5d) reef (dev) 2023-12-17T18:45:42.231 INFO:tasks.ceph.osd.5.smithi159.stderr: 1: /lib64/libc.so.6(+0x54db0) [0x7fca9cc54db0] 2023-12-17T18:45:42.231 INFO:tasks.ceph.osd.5.smithi159.stderr: 2: /lib64/libc.so.6(+0xa154c) [0x7fca9cca154c] 2023-12-17T18:45:42.231 INFO:tasks.ceph.osd.5.smithi159.stderr: 3: raise() 2023-12-17T18:45:42.231 INFO:tasks.ceph.osd.5.smithi159.stderr: 4: abort() 2023-12-17T18:45:42.231 INFO:tasks.ceph.osd.5.smithi159.stderr: 5: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0x187) [0x561d19794faa] 2023-12-17T18:45:42.232 INFO:tasks.ceph.osd.5.smithi159.stderr: 6: (KernelDevice::_aio_thread()+0x10f6) [0x561d1a0e55b6] 2023-12-17T18:45:42.232 INFO:tasks.ceph.osd.5.smithi159.stderr: 7: ceph-osd(+0xda2811) [0x561d1a0c6811] 2023-12-17T18:45:42.232 INFO:tasks.ceph.osd.5.smithi159.stderr: 8: /lib64/libc.so.6(+0x9f802) [0x7fca9cc9f802] 2023-12-17T18:45:42.232 INFO:tasks.ceph.osd.5.smithi159.stderr: 9: /lib64/libc.so.6(+0x3f450) [0x7fca9cc3f450] 2023-12-17T18:45:42.232 INFO:tasks.ceph.osd.5.smithi159.stderr:2023-12-17T18:45:42.227+0000 7fca8fd48640 -1 *** Caught signal (Aborted) ** 2023-12-17T18:45:42.232 INFO:tasks.ceph.osd.5.smithi159.stderr: in thread 7fca8fd48640 thread_name:bstore_aio 2023-12-17T18:45:42.232 INFO:tasks.ceph.osd.5.smithi159.stderr: 2023-12-17T18:45:42.232 INFO:tasks.ceph.osd.5.smithi159.stderr: ceph version 19.0.0-119-ga62fda73 (a62fda73efba5520d409bb5a21bd8373289dda5d) reef (dev) 2023-12-17T18:45:42.232 INFO:tasks.ceph.osd.5.smithi159.stderr: 1: /lib64/libc.so.6(+0x54db0) [0x7fca9cc54db0] 2023-12-17T18:45:42.232 INFO:tasks.ceph.osd.5.smithi159.stderr: 2: /lib64/libc.so.6(+0xa154c) [0x7fca9cca154c] 2023-12-17T18:45:42.233 INFO:tasks.ceph.osd.5.smithi159.stderr: 3: raise() 2023-12-17T18:45:42.233 INFO:tasks.ceph.osd.5.smithi159.stderr: 4: abort() 2023-12-17T18:45:42.233 INFO:tasks.ceph.osd.5.smithi159.stderr: 5: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0x187) [0x561d19794faa] 2023-12-17T18:45:42.233 INFO:tasks.ceph.osd.5.smithi159.stderr: 6: (KernelDevice::_aio_thread()+0x10f6) [0x561d1a0e55b6] 2023-12-17T18:45:42.233 INFO:tasks.ceph.osd.5.smithi159.stderr: 7: ceph-osd(+0xda2811) [0x561d1a0c6811] 2023-12-17T18:45:42.233 INFO:tasks.ceph.osd.5.smithi159.stderr: 8: /lib64/libc.so.6(+0x9f802) [0x7fca9cc9f802] 2023-12-17T18:45:42.233 INFO:tasks.ceph.osd.5.smithi159.stderr: 9: /lib64/libc.so.6(+0x3f450) [0x7fca9cc3f450] 2023-12-17T18:45:42.233 INFO:tasks.ceph.osd.5.smithi159.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-12-17T18:45:42.234 INFO:tasks.ceph.osd.5.smithi159.stderr: 2023-12-17T18:45:42.260 INFO:tasks.ceph.osd.5.smithi159.stderr: -1> 2023-12-17T18:45:42.225+0000 7fca8fd48640 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-119-ga62fda73/rpm/el9/BUILD/ceph-19.0.0-119-ga62fda73/src/blk/kernel/KernelDevice.cc: In function 'void KernelDevice::_aio_thread()' thread 7fca8fd48640 time 2023-12-17T18:45:42.217776+0000 2023-12-17T18:45:42.260 INFO:tasks.ceph.osd.5.smithi159.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-119-ga62fda73/rpm/el9/BUILD/ceph-19.0.0-119-ga62fda73/src/blk/kernel/KernelDevice.cc: 633: ceph_abort_msg("Unexpected IO error. This may suggest a hardware issue. Please check your kernel log!") 2023-12-17T18:45:42.260 INFO:tasks.ceph.osd.5.smithi159.stderr: 2023-12-17T18:45:42.260 INFO:tasks.ceph.osd.5.smithi159.stderr: ceph version 19.0.0-119-ga62fda73 (a62fda73efba5520d409bb5a21bd8373289dda5d) reef (dev) 2023-12-17T18:45:42.260 INFO:tasks.ceph.osd.5.smithi159.stderr: 1: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0xc6) [0x561d19794ee9] 2023-12-17T18:45:42.260 INFO:tasks.ceph.osd.5.smithi159.stderr: 2: (KernelDevice::_aio_thread()+0x10f6) [0x561d1a0e55b6] 2023-12-17T18:45:42.260 INFO:tasks.ceph.osd.5.smithi159.stderr: 3: ceph-osd(+0xda2811) [0x561d1a0c6811] 2023-12-17T18:45:42.260 INFO:tasks.ceph.osd.5.smithi159.stderr: 4: /lib64/libc.so.6(+0x9f802) [0x7fca9cc9f802] 2023-12-17T18:45:42.260 INFO:tasks.ceph.osd.5.smithi159.stderr: 5: /lib64/libc.so.6(+0x3f450) [0x7fca9cc3f450] 2023-12-17T18:45:42.260 INFO:tasks.ceph.osd.5.smithi159.stderr: 2023-12-17T18:45:42.261 INFO:tasks.ceph.osd.5.smithi159.stderr: 0> 2023-12-17T18:45:42.227+0000 7fca8fd48640 -1 *** Caught signal (Aborted) ** 2023-12-17T18:45:42.261 INFO:tasks.ceph.osd.5.smithi159.stderr: in thread 7fca8fd48640 thread_name:bstore_aio 2023-12-17T18:45:42.261 INFO:tasks.ceph.osd.5.smithi159.stderr: 2023-12-17T18:45:42.261 INFO:tasks.ceph.osd.5.smithi159.stderr: ceph version 19.0.0-119-ga62fda73 (a62fda73efba5520d409bb5a21bd8373289dda5d) reef (dev) 2023-12-17T18:45:42.261 INFO:tasks.ceph.osd.5.smithi159.stderr: 1: /lib64/libc.so.6(+0x54db0) [0x7fca9cc54db0] 2023-12-17T18:45:42.261 INFO:tasks.ceph.osd.5.smithi159.stderr: 2: /lib64/libc.so.6(+0xa154c) [0x7fca9cca154c] 2023-12-17T18:45:42.261 INFO:tasks.ceph.osd.5.smithi159.stderr: 3: raise() 2023-12-17T18:45:42.261 INFO:tasks.ceph.osd.5.smithi159.stderr: 4: abort() 2023-12-17T18:45:42.261 INFO:tasks.ceph.osd.5.smithi159.stderr: 5: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0x187) [0x561d19794faa] 2023-12-17T18:45:42.261 INFO:tasks.ceph.osd.5.smithi159.stderr: 6: (KernelDevice::_aio_thread()+0x10f6) [0x561d1a0e55b6] 2023-12-17T18:45:42.261 INFO:tasks.ceph.osd.5.smithi159.stderr: 7: ceph-osd(+0xda2811) [0x561d1a0c6811] 2023-12-17T18:45:42.261 INFO:tasks.ceph.osd.5.smithi159.stderr: 8: /lib64/libc.so.6(+0x9f802) [0x7fca9cc9f802] 2023-12-17T18:45:42.262 INFO:tasks.ceph.osd.5.smithi159.stderr: 9: /lib64/libc.so.6(+0x3f450) [0x7fca9cc3f450] 2023-12-17T18:45:42.262 INFO:tasks.ceph.osd.5.smithi159.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-12-17T18:45:42.262 INFO:tasks.ceph.osd.5.smithi159.stderr: 2023-12-17T18:45:42.270 INFO:tasks.ceph.osd.5.smithi159.stderr: -1002> 2023-12-17T18:45:42.225+0000 7fca8fd48640 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-119-ga62fda73/rpm/el9/BUILD/ceph-19.0.0-119-ga62fda73/src/blk/kernel/KernelDevice.cc: In function 'void KernelDevice::_aio_thread()' thread 7fca8fd48640 time 2023-12-17T18:45:42.217776+0000 2023-12-17T18:45:42.270 INFO:tasks.ceph.osd.5.smithi159.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-119-ga62fda73/rpm/el9/BUILD/ceph-19.0.0-119-ga62fda73/src/blk/kernel/KernelDevice.cc: 633: ceph_abort_msg("Unexpected IO error. This may suggest a hardware issue. Please check your kernel log!") 2023-12-17T18:45:42.270 INFO:tasks.ceph.osd.5.smithi159.stderr: 2023-12-17T18:45:42.271 INFO:tasks.ceph.osd.5.smithi159.stderr: ceph version 19.0.0-119-ga62fda73 (a62fda73efba5520d409bb5a21bd8373289dda5d) reef (dev) 2023-12-17T18:45:42.271 INFO:tasks.ceph.osd.5.smithi159.stderr: 1: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0xc6) [0x561d19794ee9] 2023-12-17T18:45:42.271 INFO:tasks.ceph.osd.5.smithi159.stderr: 2: (KernelDevice::_aio_thread()+0x10f6) [0x561d1a0e55b6] 2023-12-17T18:45:42.271 INFO:tasks.ceph.osd.5.smithi159.stderr: 3: ceph-osd(+0xda2811) [0x561d1a0c6811] 2023-12-17T18:45:42.271 INFO:tasks.ceph.osd.5.smithi159.stderr: 4: /lib64/libc.so.6(+0x9f802) [0x7fca9cc9f802] 2023-12-17T18:45:42.271 INFO:tasks.ceph.osd.5.smithi159.stderr: 5: /lib64/libc.so.6(+0x3f450) [0x7fca9cc3f450] 2023-12-17T18:45:42.271 INFO:tasks.ceph.osd.5.smithi159.stderr: 2023-12-17T18:45:42.271 INFO:tasks.ceph.osd.5.smithi159.stderr: -1001> 2023-12-17T18:45:42.227+0000 7fca8fd48640 -1 *** Caught signal (Aborted) ** 2023-12-17T18:45:42.271 INFO:tasks.ceph.osd.5.smithi159.stderr: in thread 7fca8fd48640 thread_name:bstore_aio 2023-12-17T18:45:42.271 INFO:tasks.ceph.osd.5.smithi159.stderr: 2023-12-17T18:45:42.271 INFO:tasks.ceph.osd.5.smithi159.stderr: ceph version 19.0.0-119-ga62fda73 (a62fda73efba5520d409bb5a21bd8373289dda5d) reef (dev) 2023-12-17T18:45:42.271 INFO:tasks.ceph.osd.5.smithi159.stderr: 1: /lib64/libc.so.6(+0x54db0) [0x7fca9cc54db0] 2023-12-17T18:45:42.271 INFO:tasks.ceph.osd.5.smithi159.stderr: 2: /lib64/libc.so.6(+0xa154c) [0x7fca9cca154c] 2023-12-17T18:45:42.272 INFO:tasks.ceph.osd.5.smithi159.stderr: 3: raise() 2023-12-17T18:45:42.272 INFO:tasks.ceph.osd.5.smithi159.stderr: 4: abort() 2023-12-17T18:45:42.272 INFO:tasks.ceph.osd.5.smithi159.stderr: 5: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0x187) [0x561d19794faa] 2023-12-17T18:45:42.272 INFO:tasks.ceph.osd.5.smithi159.stderr: 6: (KernelDevice::_aio_thread()+0x10f6) [0x561d1a0e55b6] 2023-12-17T18:45:42.272 INFO:tasks.ceph.osd.5.smithi159.stderr: 7: ceph-osd(+0xda2811) [0x561d1a0c6811] 2023-12-17T18:45:42.272 INFO:tasks.ceph.osd.5.smithi159.stderr: 8: /lib64/libc.so.6(+0x9f802) [0x7fca9cc9f802] 2023-12-17T18:45:42.272 INFO:tasks.ceph.osd.5.smithi159.stderr: 9: /lib64/libc.so.6(+0x3f450) [0x7fca9cc3f450] 2023-12-17T18:45:42.272 INFO:tasks.ceph.osd.5.smithi159.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-12-17T18:45:42.272 INFO:tasks.ceph.osd.5.smithi159.stderr: 2023-12-17T18:45:42.598 INFO:tasks.ceph.osd.5.smithi159.stderr:daemon-helper: command failed with exit status 5 2023-12-17T18:45:49.335 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~0s 2023-12-17T18:45:55.949 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~7s 2023-12-17T18:46:02.563 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~13s 2023-12-17T18:46:09.177 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~20s 2023-12-17T18:46:12.712 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T18:46:12.724 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T18:46:15.790 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~26s 2023-12-17T18:46:22.401 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~33s 2023-12-17T18:46:29.015 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~40s 2023-12-17T18:46:35.628 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~46s 2023-12-17T18:46:42.243 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~53s 2023-12-17T18:46:42.935 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T18:46:42.948 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T18:46:48.856 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~60s 2023-12-17T18:46:55.467 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~66s 2023-12-17T18:47:02.082 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~73s 2023-12-17T18:47:08.697 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~79s 2023-12-17T18:47:13.119 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T18:47:13.130 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T18:47:15.310 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~86s 2023-12-17T18:47:21.923 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~93s 2023-12-17T18:47:28.537 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~99s 2023-12-17T18:47:35.146 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~106s 2023-12-17T18:47:41.757 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~112s 2023-12-17T18:47:43.277 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T18:47:43.288 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T18:47:48.368 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~119s 2023-12-17T18:47:54.978 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~126s 2023-12-17T18:48:01.589 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~132s 2023-12-17T18:48:08.200 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~139s 2023-12-17T18:48:13.424 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T18:48:13.434 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T18:48:14.812 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~145s 2023-12-17T18:48:21.426 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~152s 2023-12-17T18:48:28.038 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~159s 2023-12-17T18:48:34.652 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~165s 2023-12-17T18:48:41.265 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~172s 2023-12-17T18:48:43.663 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T18:48:43.673 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T18:48:47.880 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~179s 2023-12-17T18:48:54.494 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~185s 2023-12-17T18:49:01.108 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~192s 2023-12-17T18:49:07.722 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~198s 2023-12-17T18:49:14.322 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T18:49:14.334 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T18:49:14.336 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~205s 2023-12-17T18:49:20.950 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~212s 2023-12-17T18:49:27.565 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~218s 2023-12-17T18:49:34.178 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~225s 2023-12-17T18:49:40.793 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~231s 2023-12-17T18:49:44.625 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T18:49:44.637 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T18:49:47.408 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~238s 2023-12-17T18:49:54.021 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~245s 2023-12-17T18:50:00.632 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~251s 2023-12-17T18:50:07.245 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~258s 2023-12-17T18:50:13.860 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~265s 2023-12-17T18:50:14.785 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T18:50:14.796 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T18:50:20.474 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~271s 2023-12-17T18:50:27.085 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~278s 2023-12-17T18:50:33.695 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~284s 2023-12-17T18:50:40.309 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~291s 2023-12-17T18:50:44.979 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T18:50:44.989 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T18:50:46.922 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~298s 2023-12-17T18:50:53.535 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~304s 2023-12-17T18:50:53.536 INFO:tasks.daemonwatchdog.daemon_watchdog:BARK! unmounting mounts and killing all daemons 2023-12-17T18:50:53.536 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2023-12-17T18:50:53.536 DEBUG:teuthology.orchestra.run.smithi040:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-17T18:50:53.611 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2023-12-17T18:50:53.611 DEBUG:teuthology.orchestra.run.smithi040:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-17T18:50:53.663 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-17T18:50:54.470 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:54.468+0000 7fc88bfff640 1 Processor -- start 2023-12-17T18:50:54.471 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:54.468+0000 7fc88bfff640 1 -- start start 2023-12-17T18:50:54.472 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:54.470+0000 7fc88bfff640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc88c0d13c0 0x7fc88c0ce5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T18:50:54.472 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:54.470+0000 7fc88bfff640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7fc88c0b0760 0x7fc88c0b0bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T18:50:54.473 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:54.470+0000 7fc88bfff640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc88c0b2280 con 0x7fc88c0d0d70 2023-12-17T18:50:54.473 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:54.470+0000 7fc88bfff640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc88c0cee70 con 0x7fc88c0b0760 2023-12-17T18:50:54.473 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:54.470+0000 7fc88bfff640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc88c0d1190 con 0x7fc88c0d13c0 2023-12-17T18:50:54.474 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:54.470+0000 7fc88affd640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc88c0d13c0 0x7fc88c0ce5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T18:50:54.474 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:54.471+0000 7fc88affd640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc88c0d13c0 0x7fc88c0ce5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3301/0 says I am v2:172.21.15.40:55818/0 (socket says 172.21.15.40:55818) 2023-12-17T18:50:54.475 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:54.471+0000 7fc88affd640 1 -- 172.21.15.40:0/1610659069 learned_addr learned my addr 172.21.15.40:0/1610659069 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-17T18:50:54.475 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:54.471+0000 7fc883fff640 1 --1- 172.21.15.40:0/1610659069 >> v1:172.21.15.159:6789/0 conn(0x7fc88c0d0d70 0x7fc88c0d17a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.159:6789/0 says I am v1:172.21.15.40:43666/0 (socket says 172.21.15.40:43666) 2023-12-17T18:50:54.475 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:54.471+0000 7fc88b7fe640 1 --2- 172.21.15.40:0/1610659069 >> v2:172.21.15.159:3300/0 conn(0x7fc88c0b0760 0x7fc88c0b0bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T18:50:54.475 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:54.471+0000 7fc88affd640 1 -- 172.21.15.40:0/1610659069 >> v2:172.21.15.159:3300/0 conn(0x7fc88c0b0760 msgr2=0x7fc88c0b0bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T18:50:54.475 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:54.471+0000 7fc88affd640 1 --2- 172.21.15.40:0/1610659069 >> v2:172.21.15.159:3300/0 conn(0x7fc88c0b0760 0x7fc88c0b0bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T18:50:54.475 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:54.471+0000 7fc88affd640 1 -- 172.21.15.40:0/1610659069 >> v1:172.21.15.159:6789/0 conn(0x7fc88c0d0d70 legacy=0x7fc88c0d17a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T18:50:54.475 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:54.471+0000 7fc88affd640 1 -- 172.21.15.40:0/1610659069 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc88c0ceb90 con 0x7fc88c0d13c0 2023-12-17T18:50:54.475 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:54.471+0000 7fc88b7fe640 1 --2- 172.21.15.40:0/1610659069 >> v2:172.21.15.159:3300/0 conn(0x7fc88c0b0760 0x7fc88c0b0bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-17T18:50:54.476 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:54.473+0000 7fc88affd640 1 --2- 172.21.15.40:0/1610659069 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc88c0d13c0 0x7fc88c0ce5b0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fc87c009870 tx=0x7fc87c02b8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=60013e976365075e server_cookie=0 in_seq=0 out_seq=0 2023-12-17T18:50:54.476 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:54.474+0000 7fc88a7fc640 1 -- 172.21.15.40:0/1610659069 <== mon.2 v2:172.21.15.159:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc87c031640 con 0x7fc88c0d13c0 2023-12-17T18:50:54.476 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:54.474+0000 7fc88a7fc640 1 -- 172.21.15.40:0/1610659069 <== mon.2 v2:172.21.15.159:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc87c0317a0 con 0x7fc88c0d13c0 2023-12-17T18:50:54.476 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:54.474+0000 7fc88a7fc640 1 -- 172.21.15.40:0/1610659069 <== mon.2 v2:172.21.15.159:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc87c031b30 con 0x7fc88c0d13c0 2023-12-17T18:50:54.477 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:54.475+0000 7fc88bfff640 1 -- 172.21.15.40:0/1610659069 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc88c0d13c0 msgr2=0x7fc88c0ce5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T18:50:54.478 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:54.475+0000 7fc88bfff640 1 --2- 172.21.15.40:0/1610659069 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc88c0d13c0 0x7fc88c0ce5b0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fc87c009870 tx=0x7fc87c02b8f0 comp rx=0 tx=0).stop 2023-12-17T18:50:54.478 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:54.475+0000 7fc88bfff640 1 -- 172.21.15.40:0/1610659069 shutdown_connections 2023-12-17T18:50:54.478 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:54.475+0000 7fc88bfff640 1 --2- 172.21.15.40:0/1610659069 >> v2:172.21.15.159:3300/0 conn(0x7fc88c0b0760 0x7fc88c0b0bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T18:50:54.478 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:54.475+0000 7fc88bfff640 1 --2- 172.21.15.40:0/1610659069 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc88c0d13c0 0x7fc88c0ce5b0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T18:50:54.478 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:54.475+0000 7fc88bfff640 1 -- 172.21.15.40:0/1610659069 >> 172.21.15.40:0/1610659069 conn(0x7fc88c09c260 msgr2=0x7fc88c0d2f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T18:50:54.478 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:54.475+0000 7fc88bfff640 1 -- 172.21.15.40:0/1610659069 shutdown_connections 2023-12-17T18:50:54.478 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:54.475+0000 7fc88bfff640 1 -- 172.21.15.40:0/1610659069 wait complete. 2023-12-17T18:50:54.480 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:54.478+0000 7fc88bfff640 1 Processor -- start 2023-12-17T18:50:54.480 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:54.478+0000 7fc88bfff640 1 -- start start 2023-12-17T18:50:54.482 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:54.479+0000 7fc88bfff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc88c0b0760 0x7fc88c09ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T18:50:54.482 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:54.479+0000 7fc88bfff640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc88c0d0d70 0x7fc88c09ed00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T18:50:54.482 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:54.479+0000 7fc88bfff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc88c0d13c0 0x7fc88c09f240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T18:50:54.483 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:54.479+0000 7fc88bfff640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc88c0a0420 con 0x7fc88c0b0760 2023-12-17T18:50:54.483 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:54.479+0000 7fc88bfff640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc88c1597f0 con 0x7fc88c0d13c0 2023-12-17T18:50:54.483 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:54.479+0000 7fc88bfff640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc88c09f8a0 con 0x7fc88c0d0d70 2023-12-17T18:50:54.483 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:54.480+0000 7fc88affd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc88c0b0760 0x7fc88c09ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T18:50:54.483 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:54.480+0000 7fc88affd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc88c0b0760 0x7fc88c09ccd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:57098/0 (socket says 172.21.15.40:57098) 2023-12-17T18:50:54.483 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:54.480+0000 7fc88affd640 1 -- 172.21.15.40:0/2459395174 learned_addr learned my addr 172.21.15.40:0/2459395174 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-17T18:50:54.483 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:54.480+0000 7fc883fff640 1 --2- 172.21.15.40:0/2459395174 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc88c0d0d70 0x7fc88c09ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T18:50:54.483 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:54.480+0000 7fc88b7fe640 1 --2- 172.21.15.40:0/2459395174 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc88c0d13c0 0x7fc88c09f240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T18:50:54.485 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:54.480+0000 7fc88affd640 1 -- 172.21.15.40:0/2459395174 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc88c0d0d70 msgr2=0x7fc88c09ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T18:50:54.485 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:54.480+0000 7fc88affd640 1 --2- 172.21.15.40:0/2459395174 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc88c0d0d70 0x7fc88c09ed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T18:50:54.485 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:54.480+0000 7fc88affd640 1 -- 172.21.15.40:0/2459395174 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc88c0d13c0 msgr2=0x7fc88c09f240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T18:50:54.485 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:54.480+0000 7fc88affd640 1 --2- 172.21.15.40:0/2459395174 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc88c0d13c0 0x7fc88c09f240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T18:50:54.485 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:54.481+0000 7fc88affd640 1 -- 172.21.15.40:0/2459395174 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc87c0094d0 con 0x7fc88c0b0760 2023-12-17T18:50:54.485 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:54.481+0000 7fc88b7fe640 1 --2- 172.21.15.40:0/2459395174 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc88c0d13c0 0x7fc88c09f240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-17T18:50:54.485 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:54.481+0000 7fc88affd640 1 --2- 172.21.15.40:0/2459395174 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc88c0b0760 0x7fc88c09ccd0 secure :-1 s=READY pgs=2683 cs=0 l=1 rev1=1 crypto rx=0x7fc87c02b930 tx=0x7fc87c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T18:50:54.485 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:54.481+0000 7fc8837fe640 1 -- 172.21.15.40:0/2459395174 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc87c03ac60 con 0x7fc88c0b0760 2023-12-17T18:50:54.485 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:54.482+0000 7fc88bfff640 1 -- 172.21.15.40:0/2459395174 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc88c09fb80 con 0x7fc88c0b0760 2023-12-17T18:50:54.485 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:54.482+0000 7fc8837fe640 1 -- 172.21.15.40:0/2459395174 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc87c03ade0 con 0x7fc88c0b0760 2023-12-17T18:50:54.486 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:54.482+0000 7fc8837fe640 1 -- 172.21.15.40:0/2459395174 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc87c044630 con 0x7fc88c0b0760 2023-12-17T18:50:54.486 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:54.482+0000 7fc88bfff640 1 -- 172.21.15.40:0/2459395174 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc88c0a0140 con 0x7fc88c0b0760 2023-12-17T18:50:54.487 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:54.485+0000 7fc8837fe640 1 -- 172.21.15.40:0/2459395174 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fc87c02f050 con 0x7fc88c0b0760 2023-12-17T18:50:54.488 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:54.486+0000 7fc8837fe640 1 --2- 172.21.15.40:0/2459395174 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7fc86c06ae40 0x7fc86c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T18:50:54.488 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:54.486+0000 7fc8837fe640 1 -- 172.21.15.40:0/2459395174 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fc87c0ab5c0 con 0x7fc88c0b0760 2023-12-17T18:50:54.489 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:54.486+0000 7fc883fff640 1 --2- 172.21.15.40:0/2459395174 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7fc86c06ae40 0x7fc86c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T18:50:54.495 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:54.484+0000 7fc88bfff640 1 -- 172.21.15.40:0/2459395174 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc88c074450 con 0x7fc88c0b0760 2023-12-17T18:50:54.497 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:54.494+0000 7fc883fff640 1 --2- 172.21.15.40:0/2459395174 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7fc86c06ae40 0x7fc86c06d300 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7fc88c06c380 tx=0x7fc874000ed0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T18:50:54.506 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:54.504+0000 7fc8837fe640 1 -- 172.21.15.40:0/2459395174 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fc87c076490 con 0x7fc88c0b0760 2023-12-17T18:50:54.737 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:54.734+0000 7fc88bfff640 1 -- 172.21.15.40:0/2459395174 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc88c0d2d70 con 0x7fc88c0b0760 2023-12-17T18:50:54.752 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:54.749+0000 7fc8837fe640 1 -- 172.21.15.40:0/2459395174 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v44) v1 ==== 74+0+16886 (secure 0 0 0) 0x7fc87c079ab0 con 0x7fc88c0b0760 2023-12-17T18:50:54.752 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T18:50:54.752 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":44,"fsid":"099cd35d-80d9-4ca4-8424-de13b3b03ac7","created":"2023-12-17T11:47:53.450097+0000","modified":"2023-12-17T18:45:44.164127+0000","last_up_change":"2023-12-17T18:45:43.124463+0000","last_in_change":"2023-12-17T11:47:56.956499+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-17T11:48:06.668943+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-12-17T11:49:50.228316+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.4900000095367432,"score_stable":1.4900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.309999942779541,"raw_score_stable":1.309999942779541,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-12-17T11:49:51.700776+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6100000143051147,"score_stable":1.6100000143051147,"optimal_score":0.87999999523162842,"raw_score_acting":1.4199999570846558,"raw_score_stable":1.4199999570846558,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a88bfd46-63b8-48b1-9c0e-5c9cdc31bd38","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":555204741},{"type":"v1","addr":"172.21.15.40:6802","nonce":555204741}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":555204741},{"type":"v1","addr":"172.21.15.40:6807","nonce":555204741}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":555204741},{"type":"v1","addr":"172.21.15.40:6815","nonce":555204741}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6809","nonce":555204741},{"type":"v1","addr":"172.21.15.40:6812","nonce":555204741}]},"public_addr":"172.21.15.40:6802/555204741","cluster_addr":"172.21.15.40:6807/555204741","heartbeat_back_addr":"172.21.15.40:6815/555204741","heartbeat_front_addr":"172.21.15.40:6812/555204741","state":["exists","up"]},{"osd":1,"uuid":"c5d628ae-36f4-4866-802c-b162f0e90add","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6801","nonce":1221318112},{"type":"v1","addr":"172.21.15.40:6803","nonce":1221318112}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6805","nonce":1221318112},{"type":"v1","addr":"172.21.15.40:6806","nonce":1221318112}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6811","nonce":1221318112},{"type":"v1","addr":"172.21.15.40:6813","nonce":1221318112}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":1221318112},{"type":"v1","addr":"172.21.15.40:6810","nonce":1221318112}]},"public_addr":"172.21.15.40:6803/1221318112","cluster_addr":"172.21.15.40:6806/1221318112","heartbeat_back_addr":"172.21.15.40:6813/1221318112","heartbeat_front_addr":"172.21.15.40:6810/1221318112","state":["exists","up"]},{"osd":2,"uuid":"d986ad6a-af2f-47fc-9c3b-fbda27b82b73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":1959000265},{"type":"v1","addr":"172.21.15.40:6817","nonce":1959000265}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6818","nonce":1959000265},{"type":"v1","addr":"172.21.15.40:6819","nonce":1959000265}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":1959000265},{"type":"v1","addr":"172.21.15.40:6827","nonce":1959000265}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":1959000265},{"type":"v1","addr":"172.21.15.40:6822","nonce":1959000265}]},"public_addr":"172.21.15.40:6817/1959000265","cluster_addr":"172.21.15.40:6819/1959000265","heartbeat_back_addr":"172.21.15.40:6827/1959000265","heartbeat_front_addr":"172.21.15.40:6822/1959000265","state":["exists","up"]},{"osd":3,"uuid":"d79d22b7-be05-41b2-b95d-697db677fd02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6821","nonce":974040287},{"type":"v1","addr":"172.21.15.40:6823","nonce":974040287}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6825","nonce":974040287},{"type":"v1","addr":"172.21.15.40:6826","nonce":974040287}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":974040287},{"type":"v1","addr":"172.21.15.40:6831","nonce":974040287}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":974040287},{"type":"v1","addr":"172.21.15.40:6829","nonce":974040287}]},"public_addr":"172.21.15.40:6823/974040287","cluster_addr":"172.21.15.40:6826/974040287","heartbeat_back_addr":"172.21.15.40:6831/974040287","heartbeat_front_addr":"172.21.15.40:6829/974040287","state":["exists","up"]},{"osd":4,"uuid":"62a7a233-d3ea-40be-91de-180c0208d639","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6808","nonce":3937787733},{"type":"v1","addr":"172.21.15.159:6809","nonce":3937787733}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6810","nonce":3937787733},{"type":"v1","addr":"172.21.15.159:6811","nonce":3937787733}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6814","nonce":3937787733},{"type":"v1","addr":"172.21.15.159:6815","nonce":3937787733}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6812","nonce":3937787733},{"type":"v1","addr":"172.21.15.159:6813","nonce":3937787733}]},"public_addr":"172.21.15.159:6809/3937787733","cluster_addr":"172.21.15.159:6811/3937787733","heartbeat_back_addr":"172.21.15.159:6815/3937787733","heartbeat_front_addr":"172.21.15.159:6813/3937787733","state":["exists","up"]},{"osd":5,"uuid":"84629cea-dc0e-4b5e-b203-5ea963839281","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":38,"down_at":43,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6816","nonce":3032505240},{"type":"v1","addr":"172.21.15.159:6817","nonce":3032505240}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6818","nonce":3032505240},{"type":"v1","addr":"172.21.15.159:6819","nonce":3032505240}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6822","nonce":3032505240},{"type":"v1","addr":"172.21.15.159:6823","nonce":3032505240}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6820","nonce":3032505240},{"type":"v1","addr":"172.21.15.159:6821","nonce":3032505240}]},"public_addr":"172.21.15.159:6817/3032505240","cluster_addr":"172.21.15.159:6819/3032505240","heartbeat_back_addr":"172.21.15.159:6823/3032505240","heartbeat_front_addr":"172.21.15.159:6821/3032505240","state":["exists"]},{"osd":6,"uuid":"4ae3af3a-1743-4070-a91d-8be5c31cdb04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6800","nonce":2411788597},{"type":"v1","addr":"172.21.15.159:6801","nonce":2411788597}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6802","nonce":2411788597},{"type":"v1","addr":"172.21.15.159:6803","nonce":2411788597}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6806","nonce":2411788597},{"type":"v1","addr":"172.21.15.159:6807","nonce":2411788597}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6804","nonce":2411788597},{"type":"v1","addr":"172.21.15.159:6805","nonce":2411788597}]},"public_addr":"172.21.15.159:6801/2411788597","cluster_addr":"172.21.15.159:6803/2411788597","heartbeat_back_addr":"172.21.15.159:6807/2411788597","heartbeat_front_addr":"172.21.15.159:6805/2411788597","state":["exists","up"]},{"osd":7,"uuid":"c1f4c7f2-8f75-4f95-bc63-a332773e3b8e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6824","nonce":478953349},{"type":"v1","addr":"172.21.15.159:6825","nonce":478953349}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6826","nonce":478953349},{"type":"v1","addr":"172.21.15.159:6827","nonce":478953349}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6830","nonce":478953349},{"type":"v1","addr":"172.21.15.159:6831","nonce":478953349}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6828","nonce":478953349},{"type":"v1","addr":"172.21.15.159:6829","nonce":478953349}]},"public_addr":"172.21.15.159:6825/478953349","cluster_addr":"172.21.15.159:6827/478953349","heartbeat_back_addr":"172.21.15.159:6831/478953349","heartbeat_front_addr":"172.21.15.159:6829/478953349","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T11:48:02.023567+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T11:48:02.278216+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T11:48:02.311843+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T11:48:01.773372+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T11:48:02.618910+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T11:48:02.361559+0000","dead_epoch":43},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T11:48:02.223997+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T11:48:02.604403+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"6.1a","mappings":[{"from":5,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-17T18:50:54.754 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:54.752+0000 7fc88bfff640 1 -- 172.21.15.40:0/2459395174 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7fc86c06ae40 msgr2=0x7fc86c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T18:50:54.755 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:54.752+0000 7fc88bfff640 1 --2- 172.21.15.40:0/2459395174 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7fc86c06ae40 0x7fc86c06d300 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7fc88c06c380 tx=0x7fc874000ed0 comp rx=0 tx=0).stop 2023-12-17T18:50:54.755 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:54.752+0000 7fc88bfff640 1 -- 172.21.15.40:0/2459395174 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc88c0b0760 msgr2=0x7fc88c09ccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T18:50:54.755 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:54.752+0000 7fc88bfff640 1 --2- 172.21.15.40:0/2459395174 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc88c0b0760 0x7fc88c09ccd0 secure :-1 s=READY pgs=2683 cs=0 l=1 rev1=1 crypto rx=0x7fc87c02b930 tx=0x7fc87c0046c0 comp rx=0 tx=0).stop 2023-12-17T18:50:54.755 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:54.752+0000 7fc88bfff640 1 -- 172.21.15.40:0/2459395174 shutdown_connections 2023-12-17T18:50:54.756 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:54.752+0000 7fc88bfff640 1 --2- 172.21.15.40:0/2459395174 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7fc86c06ae40 0x7fc86c06d300 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T18:50:54.756 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:54.752+0000 7fc88bfff640 1 --2- 172.21.15.40:0/2459395174 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc88c0d13c0 0x7fc88c09f240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T18:50:54.756 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:54.752+0000 7fc88bfff640 1 --2- 172.21.15.40:0/2459395174 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fc88c0d0d70 0x7fc88c09ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T18:50:54.756 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:54.752+0000 7fc88bfff640 1 --2- 172.21.15.40:0/2459395174 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc88c0b0760 0x7fc88c09ccd0 unknown :-1 s=CLOSED pgs=2683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T18:50:54.756 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:54.752+0000 7fc88bfff640 1 -- 172.21.15.40:0/2459395174 >> 172.21.15.40:0/2459395174 conn(0x7fc88c09c260 msgr2=0x7fc88c0cf370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T18:50:54.756 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:54.753+0000 7fc88bfff640 1 -- 172.21.15.40:0/2459395174 shutdown_connections 2023-12-17T18:50:54.756 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:54.753+0000 7fc88bfff640 1 -- 172.21.15.40:0/2459395174 wait complete. 2023-12-17T18:50:54.776 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-17T11:48:06.668943+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-17T11:49:50.228316+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '39', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.4900000095367432, 'score_stable': 1.4900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.309999942779541, 'raw_score_stable': 1.309999942779541, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_data', 'create_time': '2023-12-17T11:49:51.700776+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '40', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.6100000143051147, 'score_stable': 1.6100000143051147, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.4199999570846558, 'raw_score_stable': 1.4199999570846558, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-17T18:50:54.777 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-17T18:50:55.014 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:55.011+0000 7fdda3cca640 1 Processor -- start 2023-12-17T18:50:55.014 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:55.011+0000 7fdda3cca640 1 -- start start 2023-12-17T18:50:55.015 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:55.013+0000 7fdda3cca640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fdd9c06ab70 0x7fdd9c06ca10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T18:50:55.015 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:55.013+0000 7fdda3cca640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd9c0cdaa0 con 0x7fdd9c0ae300 2023-12-17T18:50:55.015 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:55.013+0000 7fdda3cca640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd9c0cdd80 con 0x7fdd9c15a1e0 2023-12-17T18:50:55.015 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:55.013+0000 7fdda3cca640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd9c0ce060 con 0x7fdd9c06ab70 2023-12-17T18:50:55.015 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:55.013+0000 7fdda2267640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fdd9c0ae300 0x7fdd9c15dc60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:50294/0 (socket says 172.21.15.40:50294) 2023-12-17T18:50:55.016 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:55.013+0000 7fdda2267640 1 -- 172.21.15.40:0/210974645 learned_addr learned my addr 172.21.15.40:0/210974645 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-12-17T18:50:55.017 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:55.014+0000 7fdda1265640 1 --2- 172.21.15.40:0/210974645 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fdd9c06ab70 0x7fdd9c06ca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T18:50:55.017 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:55.014+0000 7fdda0a64640 1 -- 172.21.15.40:0/210974645 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2543846026 0 0) 0x7fdd9c0cdaa0 con 0x7fdd9c0ae300 2023-12-17T18:50:55.017 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:55.014+0000 7fdda0a64640 1 -- 172.21.15.40:0/210974645 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdd84003520 con 0x7fdd9c0ae300 2023-12-17T18:50:55.017 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:55.014+0000 7fdda0a64640 1 -- 172.21.15.40:0/210974645 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1213295283 0 0) 0x7fdd84003520 con 0x7fdd9c0ae300 2023-12-17T18:50:55.017 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:55.014+0000 7fdda0a64640 1 -- 172.21.15.40:0/210974645 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fdd9c06ab70 msgr2=0x7fdd9c06ca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T18:50:55.017 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:55.014+0000 7fdda0a64640 1 --2- 172.21.15.40:0/210974645 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fdd9c06ab70 0x7fdd9c06ca10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T18:50:55.017 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:55.014+0000 7fdda0a64640 1 -- 172.21.15.40:0/210974645 >> v1:172.21.15.159:6789/0 conn(0x7fdd9c15a1e0 legacy=0x7fdd9c06a460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T18:50:55.017 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:55.014+0000 7fdda0a64640 1 -- 172.21.15.40:0/210974645 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd9c0ce340 con 0x7fdd9c0ae300 2023-12-17T18:50:55.018 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:55.014+0000 7fdda0a64640 1 -- 172.21.15.40:0/210974645 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2643242555 0 0) 0x7fdd94001670 con 0x7fdd9c0ae300 2023-12-17T18:50:55.018 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:55.014+0000 7fdda0a64640 1 -- 172.21.15.40:0/210974645 >> v1:172.21.15.40:6789/0 conn(0x7fdd9c0ae300 legacy=0x7fdd9c15dc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T18:50:55.018 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:55.014+0000 7fdda0a64640 1 --2- 172.21.15.40:0/210974645 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fdd9c06ab70 0x7fdd840039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T18:50:55.018 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:55.014+0000 7fdda0a64640 1 --2- 172.21.15.40:0/210974645 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdd84003f20 0x7fdd840047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T18:50:55.018 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:55.014+0000 7fdda0a64640 1 --2- 172.21.15.40:0/210974645 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdd84004d00 0x7fdd84005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T18:50:55.018 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:55.014+0000 7fdda0a64640 1 -- 172.21.15.40:0/210974645 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd9c0ce060 con 0x7fdd84003f20 2023-12-17T18:50:55.018 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:55.014+0000 7fdda0a64640 1 -- 172.21.15.40:0/210974645 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd8400bb10 con 0x7fdd84004d00 2023-12-17T18:50:55.018 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:55.015+0000 7fdda0a64640 1 -- 172.21.15.40:0/210974645 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd8400dee0 con 0x7fdd9c06ab70 2023-12-17T18:50:55.018 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:55.015+0000 7fdda1265640 1 --2- 172.21.15.40:0/210974645 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdd84003f20 0x7fdd840047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T18:50:55.018 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:55.015+0000 7fdda1a66640 1 --2- 172.21.15.40:0/210974645 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fdd9c06ab70 0x7fdd840039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T18:50:55.019 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:55.015+0000 7fdda2267640 1 --2- 172.21.15.40:0/210974645 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdd84004d00 0x7fdd84005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T18:50:55.019 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:55.015+0000 7fdda1265640 1 -- 172.21.15.40:0/210974645 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fdd9c06ab70 msgr2=0x7fdd840039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T18:50:55.019 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:55.015+0000 7fdda1265640 1 --2- 172.21.15.40:0/210974645 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fdd9c06ab70 0x7fdd840039a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T18:50:55.019 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:55.015+0000 7fdda1265640 1 -- 172.21.15.40:0/210974645 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdd84004d00 msgr2=0x7fdd84005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T18:50:55.020 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:55.015+0000 7fdda1265640 1 --2- 172.21.15.40:0/210974645 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdd84004d00 0x7fdd84005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T18:50:55.020 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:55.015+0000 7fdda1265640 1 -- 172.21.15.40:0/210974645 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd84003520 con 0x7fdd84003f20 2023-12-17T18:50:55.020 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:55.015+0000 7fdda1a66640 1 --2- 172.21.15.40:0/210974645 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fdd9c06ab70 0x7fdd840039a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-17T18:50:55.020 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:55.015+0000 7fdda2267640 1 --2- 172.21.15.40:0/210974645 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdd84004d00 0x7fdd84005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-17T18:50:55.020 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:55.017+0000 7fdda1265640 1 --2- 172.21.15.40:0/210974645 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdd84003f20 0x7fdd840047c0 secure :-1 s=READY pgs=2685 cs=0 l=1 rev1=1 crypto rx=0x7fdd90009ac0 tx=0x7fdd840057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8247b97f5ca9ece3 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T18:50:55.020 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:55.017+0000 7fdda0a64640 1 -- 172.21.15.40:0/210974645 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd9002c6b0 con 0x7fdd84003f20 2023-12-17T18:50:55.020 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:55.017+0000 7fdda0a64640 1 -- 172.21.15.40:0/210974645 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd9002c810 con 0x7fdd84003f20 2023-12-17T18:50:55.020 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:55.017+0000 7fdda0a64640 1 -- 172.21.15.40:0/210974645 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd9002cba0 con 0x7fdd84003f20 2023-12-17T18:50:55.021 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:55.018+0000 7fdda3cca640 1 -- 172.21.15.40:0/210974645 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdd84003f20 msgr2=0x7fdd840047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T18:50:55.021 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:55.018+0000 7fdda3cca640 1 --2- 172.21.15.40:0/210974645 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdd84003f20 0x7fdd840047c0 secure :-1 s=READY pgs=2685 cs=0 l=1 rev1=1 crypto rx=0x7fdd90009ac0 tx=0x7fdd840057f0 comp rx=0 tx=0).stop 2023-12-17T18:50:55.021 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:55.018+0000 7fdda2267640 1 -- 172.21.15.40:0/210974645 reap_dead start 2023-12-17T18:50:55.021 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:55.018+0000 7fdda3cca640 1 -- 172.21.15.40:0/210974645 shutdown_connections 2023-12-17T18:50:55.021 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:55.018+0000 7fdda3cca640 1 -- 172.21.15.40:0/210974645 >> 172.21.15.40:0/210974645 conn(0x7fdd9c0cee70 msgr2=0x7fdd9c0cf280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T18:50:55.021 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:55.018+0000 7fdda3cca640 1 -- 172.21.15.40:0/210974645 shutdown_connections 2023-12-17T18:50:55.021 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:55.018+0000 7fdda3cca640 1 -- 172.21.15.40:0/210974645 wait complete. 2023-12-17T18:50:55.022 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:55.020+0000 7fdda3cca640 1 Processor -- start 2023-12-17T18:50:55.022 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:55.020+0000 7fdda3cca640 1 -- start start 2023-12-17T18:50:55.024 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:55.021+0000 7fdda3cca640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fdd84003f20 0x7fdd9c1470b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T18:50:55.024 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:55.021+0000 7fdda3cca640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdd9c0b3240 0x7fdd9c143d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T18:50:55.024 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:55.021+0000 7fdda3cca640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdd9c06ca10 0x7fdd9c06ce90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T18:50:55.024 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:55.021+0000 7fdda3cca640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd9c0b4830 con 0x7fdd9c06ca10 2023-12-17T18:50:55.024 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:55.021+0000 7fdda3cca640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd9c1f30c0 con 0x7fdd9c0b3240 2023-12-17T18:50:55.024 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:55.021+0000 7fdda3cca640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd9c06d3d0 con 0x7fdd84003f20 2023-12-17T18:50:55.024 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:55.022+0000 7fdda2267640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdd9c06ca10 0x7fdd9c06ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T18:50:55.025 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:55.022+0000 7fdda2267640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdd9c06ca10 0x7fdd9c06ce90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:58420/0 (socket says 172.21.15.40:58420) 2023-12-17T18:50:55.025 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:55.022+0000 7fdda2267640 1 -- 172.21.15.40:0/3838280353 learned_addr learned my addr 172.21.15.40:0/3838280353 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-17T18:50:55.025 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:55.022+0000 7fdda1265640 1 --2- 172.21.15.40:0/3838280353 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdd9c0b3240 0x7fdd9c143d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T18:50:55.025 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:55.022+0000 7fdda1a66640 1 --2- 172.21.15.40:0/3838280353 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fdd84003f20 0x7fdd9c1470b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T18:50:55.026 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:55.022+0000 7fdda2267640 1 -- 172.21.15.40:0/3838280353 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fdd84003f20 msgr2=0x7fdd9c1470b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T18:50:55.026 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:55.022+0000 7fdda2267640 1 --2- 172.21.15.40:0/3838280353 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fdd84003f20 0x7fdd9c1470b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T18:50:55.026 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:55.022+0000 7fdda2267640 1 -- 172.21.15.40:0/3838280353 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdd9c0b3240 msgr2=0x7fdd9c143d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T18:50:55.026 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:55.022+0000 7fdda2267640 1 --2- 172.21.15.40:0/3838280353 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdd9c0b3240 0x7fdd9c143d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T18:50:55.026 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:55.022+0000 7fdda2267640 1 -- 172.21.15.40:0/3838280353 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd9c1475f0 con 0x7fdd9c06ca10 2023-12-17T18:50:55.026 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:55.023+0000 7fdda2267640 1 --2- 172.21.15.40:0/3838280353 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdd9c06ca10 0x7fdd9c06ce90 secure :-1 s=READY pgs=2686 cs=0 l=1 rev1=1 crypto rx=0x7fdd9c09d070 tx=0x7fdd9400d930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T18:50:55.026 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:55.023+0000 7fdd9a7fc640 1 -- 172.21.15.40:0/3838280353 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd94007500 con 0x7fdd9c06ca10 2023-12-17T18:50:55.026 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:55.023+0000 7fdd9a7fc640 1 -- 172.21.15.40:0/3838280353 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd94007660 con 0x7fdd9c06ca10 2023-12-17T18:50:55.026 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:55.023+0000 7fdda3cca640 1 -- 172.21.15.40:0/3838280353 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd9c0b1b90 con 0x7fdd9c06ca10 2023-12-17T18:50:55.026 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:55.023+0000 7fdd9a7fc640 1 -- 172.21.15.40:0/3838280353 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd94004a20 con 0x7fdd9c06ca10 2023-12-17T18:50:55.026 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:55.023+0000 7fdda3cca640 1 -- 172.21.15.40:0/3838280353 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd9c0b3a70 con 0x7fdd9c06ca10 2023-12-17T18:50:55.027 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:55.024+0000 7fdda3cca640 1 -- 172.21.15.40:0/3838280353 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd9c074450 con 0x7fdd9c06ca10 2023-12-17T18:50:55.027 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:55.025+0000 7fdd9a7fc640 1 -- 172.21.15.40:0/3838280353 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fdd94004b80 con 0x7fdd9c06ca10 2023-12-17T18:50:55.028 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:55.026+0000 7fdd9a7fc640 1 --2- 172.21.15.40:0/3838280353 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7fdd8806ae40 0x7fdd8806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T18:50:55.028 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:55.027+0000 7fdd9a7fc640 1 -- 172.21.15.40:0/3838280353 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fdd94088e40 con 0x7fdd9c06ca10 2023-12-17T18:50:55.029 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:55.027+0000 7fdda1a66640 1 --2- 172.21.15.40:0/3838280353 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7fdd8806ae40 0x7fdd8806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T18:50:55.030 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:55.028+0000 7fdda1a66640 1 --2- 172.21.15.40:0/3838280353 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7fdd8806ae40 0x7fdd8806d300 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7fdd9c0cca60 tx=0x7fdd8c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T18:50:55.034 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:55.032+0000 7fdd9a7fc640 1 -- 172.21.15.40:0/3838280353 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fdd94053da0 con 0x7fdd9c06ca10 2023-12-17T18:50:55.294 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:55.291+0000 7fdda3cca640 1 -- 172.21.15.40:0/3838280353 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fdd9c0cca90 con 0x7fdd9c06ca10 2023-12-17T18:50:55.294 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:55.292+0000 7fdd9a7fc640 1 -- 172.21.15.40:0/3838280353 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v44) v1 ==== 93+0+10 (secure 0 0 0) 0x7fdd940573c0 con 0x7fdd9c06ca10 2023-12-17T18:50:55.294 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 1 2023-12-17T18:50:55.298 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:55.295+0000 7fdda3cca640 1 -- 172.21.15.40:0/3838280353 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7fdd8806ae40 msgr2=0x7fdd8806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T18:50:55.298 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:55.295+0000 7fdda3cca640 1 --2- 172.21.15.40:0/3838280353 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7fdd8806ae40 0x7fdd8806d300 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7fdd9c0cca60 tx=0x7fdd8c009040 comp rx=0 tx=0).stop 2023-12-17T18:50:55.298 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:55.295+0000 7fdda3cca640 1 -- 172.21.15.40:0/3838280353 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdd9c06ca10 msgr2=0x7fdd9c06ce90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T18:50:55.298 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:55.295+0000 7fdda3cca640 1 --2- 172.21.15.40:0/3838280353 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdd9c06ca10 0x7fdd9c06ce90 secure :-1 s=READY pgs=2686 cs=0 l=1 rev1=1 crypto rx=0x7fdd9c09d070 tx=0x7fdd9400d930 comp rx=0 tx=0).stop 2023-12-17T18:50:55.298 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:55.295+0000 7fdda3cca640 1 -- 172.21.15.40:0/3838280353 shutdown_connections 2023-12-17T18:50:55.298 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:55.295+0000 7fdda3cca640 1 --2- 172.21.15.40:0/3838280353 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7fdd8806ae40 0x7fdd8806d300 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T18:50:55.298 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:55.295+0000 7fdda3cca640 1 --2- 172.21.15.40:0/3838280353 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdd9c06ca10 0x7fdd9c06ce90 unknown :-1 s=CLOSED pgs=2686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T18:50:55.298 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:55.295+0000 7fdda3cca640 1 --2- 172.21.15.40:0/3838280353 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdd9c0b3240 0x7fdd9c143d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T18:50:55.298 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:55.295+0000 7fdda3cca640 1 --2- 172.21.15.40:0/3838280353 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fdd84003f20 0x7fdd9c1470b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T18:50:55.298 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:55.295+0000 7fdda3cca640 1 -- 172.21.15.40:0/3838280353 >> 172.21.15.40:0/3838280353 conn(0x7fdd9c0cee70 msgr2=0x7fdd9c0ccfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T18:50:55.298 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:55.295+0000 7fdda3cca640 1 -- 172.21.15.40:0/3838280353 shutdown_connections 2023-12-17T18:50:55.298 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:55.295+0000 7fdda3cca640 1 -- 172.21.15.40:0/3838280353 wait complete. 2023-12-17T18:50:55.320 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-17T18:50:55.564 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:55.561+0000 7f1eb54d5640 1 Processor -- start 2023-12-17T18:50:55.564 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:55.562+0000 7f1eb54d5640 1 -- start start 2023-12-17T18:50:55.566 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:55.563+0000 7f1eb54d5640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f1eb0141960 0x7f1eb0166100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T18:50:55.566 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:55.563+0000 7f1eb54d5640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1eb015b780 con 0x7f1eb006d770 2023-12-17T18:50:55.566 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:55.563+0000 7f1eb54d5640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1eb00b2510 con 0x7f1eb006db50 2023-12-17T18:50:55.566 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:55.563+0000 7f1eb54d5640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1eb015b9d0 con 0x7f1eb0141960 2023-12-17T18:50:55.567 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:55.564+0000 7f1eaf7fe640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f1eb0141960 0x7f1eb0166100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T18:50:55.567 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:55.564+0000 7f1eaf7fe640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f1eb0141960 0x7f1eb0166100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:58426/0 (socket says 172.21.15.40:58426) 2023-12-17T18:50:55.567 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:55.564+0000 7f1eaf7fe640 1 -- 172.21.15.40:0/1988510653 learned_addr learned my addr 172.21.15.40:0/1988510653 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-17T18:50:55.567 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:55.564+0000 7f1ea67fc640 1 --1- >> v1:172.21.15.159:6789/0 conn(0x7f1eb006db50 0x7f1eb0141250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.159:6789/0 says I am v1:172.21.15.40:40426/0 (socket says 172.21.15.40:40426) 2023-12-17T18:50:55.568 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:55.565+0000 7f1eaf7fe640 1 -- 172.21.15.40:0/1988510653 >> v1:172.21.15.159:6789/0 conn(0x7f1eb006db50 legacy=0x7f1eb0141250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T18:50:55.568 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:55.565+0000 7f1eaf7fe640 1 -- 172.21.15.40:0/1988510653 >> v1:172.21.15.40:6789/0 conn(0x7f1eb006d770 legacy=0x7f1eb00b1e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T18:50:55.568 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:55.565+0000 7f1eaf7fe640 1 -- 172.21.15.40:0/1988510653 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1eb015bcb0 con 0x7f1eb0141960 2023-12-17T18:50:55.569 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:55.566+0000 7f1eaf7fe640 1 --2- 172.21.15.40:0/1988510653 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1eb0141960 0x7f1eb0166100 secure :-1 s=READY pgs=2688 cs=0 l=1 rev1=1 crypto rx=0x7f1ea8009e50 tx=0x7f1ea802be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ce0a40b4ce2b3b1 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T18:50:55.569 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:55.566+0000 7f1eae7fc640 1 -- 172.21.15.40:0/1988510653 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ea802c960 con 0x7f1eb0141960 2023-12-17T18:50:55.569 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:55.567+0000 7f1eae7fc640 1 -- 172.21.15.40:0/1988510653 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ea802cac0 con 0x7f1eb0141960 2023-12-17T18:50:55.569 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:55.567+0000 7f1eae7fc640 1 -- 172.21.15.40:0/1988510653 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ea802ce50 con 0x7f1eb0141960 2023-12-17T18:50:55.570 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:55.567+0000 7f1eb54d5640 1 -- 172.21.15.40:0/1988510653 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1eb0141960 msgr2=0x7f1eb0166100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T18:50:55.570 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:55.567+0000 7f1eb54d5640 1 --2- 172.21.15.40:0/1988510653 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1eb0141960 0x7f1eb0166100 secure :-1 s=READY pgs=2688 cs=0 l=1 rev1=1 crypto rx=0x7f1ea8009e50 tx=0x7f1ea802be40 comp rx=0 tx=0).stop 2023-12-17T18:50:55.570 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:55.568+0000 7f1eb54d5640 1 -- 172.21.15.40:0/1988510653 shutdown_connections 2023-12-17T18:50:55.570 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:55.568+0000 7f1eb54d5640 1 --2- 172.21.15.40:0/1988510653 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1eb0141960 0x7f1eb0166100 unknown :-1 s=CLOSED pgs=2688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T18:50:55.571 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:55.568+0000 7f1eb54d5640 1 -- 172.21.15.40:0/1988510653 >> 172.21.15.40:0/1988510653 conn(0x7f1eb00cb850 msgr2=0x7f1eb00cbc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T18:50:55.571 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:55.568+0000 7f1eb54d5640 1 -- 172.21.15.40:0/1988510653 shutdown_connections 2023-12-17T18:50:55.571 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:55.568+0000 7f1eb54d5640 1 -- 172.21.15.40:0/1988510653 wait complete. 2023-12-17T18:50:55.572 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:55.570+0000 7f1eb54d5640 1 Processor -- start 2023-12-17T18:50:55.572 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:55.570+0000 7f1eb54d5640 1 -- start start 2023-12-17T18:50:55.575 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:55.571+0000 7f1eb54d5640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1eb006d770 0x7f1eb015cce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T18:50:55.575 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:55.571+0000 7f1eb54d5640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1eb006db50 0x7f1eb013e480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T18:50:55.575 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:55.571+0000 7f1eb54d5640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1eb0141960 0x7f1eb015a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T18:50:55.575 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:55.571+0000 7f1eb54d5640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1eb0143220 con 0x7f1eb006d770 2023-12-17T18:50:55.575 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:55.571+0000 7f1eb54d5640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1eb013ec70 con 0x7f1eb006db50 2023-12-17T18:50:55.576 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:55.571+0000 7f1eb54d5640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1eb013e9c0 con 0x7f1eb0141960 2023-12-17T18:50:55.576 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:55.572+0000 7f1eaeffd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1eb006d770 0x7f1eb015cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T18:50:55.576 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:55.572+0000 7f1eaeffd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1eb006d770 0x7f1eb015cce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:58428/0 (socket says 172.21.15.40:58428) 2023-12-17T18:50:55.576 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:55.572+0000 7f1eaeffd640 1 -- 172.21.15.40:0/771126295 learned_addr learned my addr 172.21.15.40:0/771126295 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-17T18:50:55.576 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:55.572+0000 7f1ea67fc640 1 --2- 172.21.15.40:0/771126295 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1eb006db50 0x7f1eb013e480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T18:50:55.576 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:55.572+0000 7f1eaf7fe640 1 --2- 172.21.15.40:0/771126295 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1eb0141960 0x7f1eb015a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T18:50:55.576 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:55.572+0000 7f1eaeffd640 1 -- 172.21.15.40:0/771126295 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1eb0141960 msgr2=0x7f1eb015a9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T18:50:55.576 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:55.572+0000 7f1eaeffd640 1 --2- 172.21.15.40:0/771126295 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1eb0141960 0x7f1eb015a9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T18:50:55.576 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:55.572+0000 7f1eaeffd640 1 -- 172.21.15.40:0/771126295 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1eb006db50 msgr2=0x7f1eb013e480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T18:50:55.576 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:55.572+0000 7f1eaeffd640 1 --2- 172.21.15.40:0/771126295 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1eb006db50 0x7f1eb013e480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T18:50:55.576 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:55.572+0000 7f1eaeffd640 1 -- 172.21.15.40:0/771126295 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ea8009b30 con 0x7f1eb006d770 2023-12-17T18:50:55.577 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:55.572+0000 7f1ea67fc640 1 --2- 172.21.15.40:0/771126295 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1eb006db50 0x7f1eb013e480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-17T18:50:55.577 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:55.573+0000 7f1eaeffd640 1 --2- 172.21.15.40:0/771126295 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1eb006d770 0x7f1eb015cce0 secure :-1 s=READY pgs=2689 cs=0 l=1 rev1=1 crypto rx=0x7f1ea000c5a0 tx=0x7f1ea000ca60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T18:50:55.581 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:55.579+0000 7f1ea7fff640 1 -- 172.21.15.40:0/771126295 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ea0005480 con 0x7f1eb006d770 2023-12-17T18:50:55.582 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:55.579+0000 7f1ea7fff640 1 -- 172.21.15.40:0/771126295 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ea00035f0 con 0x7f1eb006d770 2023-12-17T18:50:55.582 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:55.579+0000 7f1eb54d5640 1 -- 172.21.15.40:0/771126295 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1eb0142880 con 0x7f1eb006d770 2023-12-17T18:50:55.582 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:55.579+0000 7f1ea7fff640 1 -- 172.21.15.40:0/771126295 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ea00039a0 con 0x7f1eb006d770 2023-12-17T18:50:55.582 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:55.579+0000 7f1eb54d5640 1 -- 172.21.15.40:0/771126295 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1eb0142e40 con 0x7f1eb006d770 2023-12-17T18:50:55.583 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:55.581+0000 7f1eb54d5640 1 -- 172.21.15.40:0/771126295 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1eb0067910 con 0x7f1eb006d770 2023-12-17T18:50:55.584 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:55.582+0000 7f1ea7fff640 1 -- 172.21.15.40:0/771126295 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f1ea0003b00 con 0x7f1eb006d770 2023-12-17T18:50:55.585 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:55.583+0000 7f1ea7fff640 1 --2- 172.21.15.40:0/771126295 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f1e9006ae40 0x7f1e9006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T18:50:55.585 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:55.583+0000 7f1ea7fff640 1 -- 172.21.15.40:0/771126295 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f1ea0088e60 con 0x7f1eb006d770 2023-12-17T18:50:55.586 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:55.584+0000 7f1ea67fc640 1 --2- 172.21.15.40:0/771126295 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f1e9006ae40 0x7f1e9006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T18:50:55.587 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:55.585+0000 7f1ea67fc640 1 --2- 172.21.15.40:0/771126295 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f1e9006ae40 0x7f1e9006d300 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f1eb01f67a0 tx=0x7f1e98009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T18:50:55.589 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:55.587+0000 7f1ea7fff640 1 -- 172.21.15.40:0/771126295 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f1ea00577a0 con 0x7f1eb006d770 2023-12-17T18:50:55.797 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:55.795+0000 7f1eb54d5640 1 -- 172.21.15.40:0/771126295 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f1eb00745d0 con 0x7f1eb006d770 2023-12-17T18:50:55.798 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:55.795+0000 7f1ea7fff640 1 -- 172.21.15.40:0/771126295 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v44) v1 ==== 104+0+11 (secure 0 0 0) 0x7f1ea0017020 con 0x7f1eb006d770 2023-12-17T18:50:55.798 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 32 2023-12-17T18:50:55.802 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:55.798+0000 7f1eb54d5640 1 -- 172.21.15.40:0/771126295 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f1e9006ae40 msgr2=0x7f1e9006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T18:50:55.802 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:55.798+0000 7f1eb54d5640 1 --2- 172.21.15.40:0/771126295 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f1e9006ae40 0x7f1e9006d300 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f1eb01f67a0 tx=0x7f1e98009040 comp rx=0 tx=0).stop 2023-12-17T18:50:55.802 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:55.798+0000 7f1eb54d5640 1 -- 172.21.15.40:0/771126295 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1eb006d770 msgr2=0x7f1eb015cce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T18:50:55.802 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:55.798+0000 7f1eb54d5640 1 --2- 172.21.15.40:0/771126295 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1eb006d770 0x7f1eb015cce0 secure :-1 s=READY pgs=2689 cs=0 l=1 rev1=1 crypto rx=0x7f1ea000c5a0 tx=0x7f1ea000ca60 comp rx=0 tx=0).stop 2023-12-17T18:50:55.802 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:55.798+0000 7f1eb54d5640 1 -- 172.21.15.40:0/771126295 shutdown_connections 2023-12-17T18:50:55.802 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:55.798+0000 7f1eb54d5640 1 --2- 172.21.15.40:0/771126295 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f1e9006ae40 0x7f1e9006d300 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T18:50:55.802 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:55.798+0000 7f1eb54d5640 1 --2- 172.21.15.40:0/771126295 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f1eb0141960 0x7f1eb015a9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T18:50:55.802 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:55.798+0000 7f1eb54d5640 1 --2- 172.21.15.40:0/771126295 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1eb006db50 0x7f1eb013e480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T18:50:55.802 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:55.798+0000 7f1eb54d5640 1 --2- 172.21.15.40:0/771126295 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1eb006d770 0x7f1eb015cce0 unknown :-1 s=CLOSED pgs=2689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T18:50:55.803 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:55.798+0000 7f1eb54d5640 1 -- 172.21.15.40:0/771126295 >> 172.21.15.40:0/771126295 conn(0x7f1eb00cb850 msgr2=0x7f1eb00cdd60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T18:50:55.803 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:55.799+0000 7f1eb54d5640 1 -- 172.21.15.40:0/771126295 shutdown_connections 2023-12-17T18:50:55.803 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:55.799+0000 7f1eb54d5640 1 -- 172.21.15.40:0/771126295 wait complete. 2023-12-17T18:50:55.824 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-17T18:50:56.044 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:56.042+0000 7f89effff640 1 Processor -- start 2023-12-17T18:50:56.044 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:56.042+0000 7f89effff640 1 -- start start 2023-12-17T18:50:56.046 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:56.043+0000 7f89effff640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7f89f01543f0 0x7f89f015a590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T18:50:56.046 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:56.044+0000 7f89effff640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89f015ae30 con 0x7f89f01547d0 2023-12-17T18:50:56.046 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:56.044+0000 7f89effff640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89f015b110 con 0x7f89f00b3810 2023-12-17T18:50:56.046 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:56.044+0000 7f89effff640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89f0070780 con 0x7f89f01543f0 2023-12-17T18:50:56.047 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:56.044+0000 7f89ee7fc640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f89f01547d0 0x7f89f0070070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:50316/0 (socket says 172.21.15.40:50316) 2023-12-17T18:50:56.047 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:56.044+0000 7f89ee7fc640 1 -- 172.21.15.40:0/2800626897 learned_addr learned my addr 172.21.15.40:0/2800626897 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-12-17T18:50:56.049 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:56.044+0000 7f89eeffd640 1 --2- 172.21.15.40:0/2800626897 >> v2:172.21.15.159:3300/0 conn(0x7f89f01543f0 0x7f89f015a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T18:50:56.049 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:56.045+0000 7f89edffb640 1 -- 172.21.15.40:0/2800626897 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 389702077 0 0) 0x7f89f015ae30 con 0x7f89f01547d0 2023-12-17T18:50:56.049 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:56.045+0000 7f89edffb640 1 -- 172.21.15.40:0/2800626897 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f89dc003520 con 0x7f89f01547d0 2023-12-17T18:50:56.049 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:56.045+0000 7f89edffb640 1 -- 172.21.15.40:0/2800626897 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 251024665 0 0) 0x7f89dc003520 con 0x7f89f01547d0 2023-12-17T18:50:56.049 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:56.045+0000 7f89edffb640 1 -- 172.21.15.40:0/2800626897 >> v2:172.21.15.159:3300/0 conn(0x7f89f01543f0 msgr2=0x7f89f015a590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T18:50:56.050 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:56.045+0000 7f89edffb640 1 --2- 172.21.15.40:0/2800626897 >> v2:172.21.15.159:3300/0 conn(0x7f89f01543f0 0x7f89f015a590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T18:50:56.050 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:56.045+0000 7f89edffb640 1 -- 172.21.15.40:0/2800626897 >> v1:172.21.15.159:6789/0 conn(0x7f89f00b3810 legacy=0x7f89f00cedf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T18:50:56.050 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:56.045+0000 7f89edffb640 1 -- 172.21.15.40:0/2800626897 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89f015b3f0 con 0x7f89f01547d0 2023-12-17T18:50:56.050 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:56.045+0000 7f89edffb640 1 -- 172.21.15.40:0/2800626897 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2643242555 0 0) 0x7f89d8001670 con 0x7f89f01547d0 2023-12-17T18:50:56.050 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:56.045+0000 7f89edffb640 1 -- 172.21.15.40:0/2800626897 >> v1:172.21.15.40:6789/0 conn(0x7f89f01547d0 legacy=0x7f89f0070070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T18:50:56.050 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:56.045+0000 7f89edffb640 1 --2- 172.21.15.40:0/2800626897 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f89dc0039c0 0x7f89dc003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T18:50:56.050 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:56.045+0000 7f89edffb640 1 --2- 172.21.15.40:0/2800626897 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f89dc0047c0 0x7f89dc004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T18:50:56.050 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:56.045+0000 7f89edffb640 1 --2- 172.21.15.40:0/2800626897 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f89dc005180 0x7f89dc00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T18:50:56.050 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:56.045+0000 7f89edffb640 1 -- 172.21.15.40:0/2800626897 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89f0070780 con 0x7f89dc005180 2023-12-17T18:50:56.050 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:56.045+0000 7f89edffb640 1 -- 172.21.15.40:0/2800626897 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89dc00c080 con 0x7f89dc0039c0 2023-12-17T18:50:56.051 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:56.045+0000 7f89edffb640 1 -- 172.21.15.40:0/2800626897 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89dc00c240 con 0x7f89dc0047c0 2023-12-17T18:50:56.051 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:56.046+0000 7f89ef7fe640 1 --2- 172.21.15.40:0/2800626897 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f89dc005180 0x7f89dc00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T18:50:56.051 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:56.046+0000 7f89eeffd640 1 --2- 172.21.15.40:0/2800626897 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f89dc0039c0 0x7f89dc003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T18:50:56.051 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:56.046+0000 7f89ee7fc640 1 --2- 172.21.15.40:0/2800626897 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f89dc0047c0 0x7f89dc004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T18:50:56.051 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:56.046+0000 7f89ef7fe640 1 -- 172.21.15.40:0/2800626897 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f89dc0047c0 msgr2=0x7f89dc004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T18:50:56.051 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:56.046+0000 7f89ef7fe640 1 --2- 172.21.15.40:0/2800626897 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f89dc0047c0 0x7f89dc004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T18:50:56.051 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:56.046+0000 7f89ef7fe640 1 -- 172.21.15.40:0/2800626897 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f89dc0039c0 msgr2=0x7f89dc003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T18:50:56.051 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:56.046+0000 7f89ef7fe640 1 --2- 172.21.15.40:0/2800626897 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f89dc0039c0 0x7f89dc003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T18:50:56.051 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:56.046+0000 7f89ef7fe640 1 -- 172.21.15.40:0/2800626897 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89dc003520 con 0x7f89dc005180 2023-12-17T18:50:56.053 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:56.048+0000 7f89ef7fe640 1 -- 172.21.15.40:0/2800626897 reap_dead start 2023-12-17T18:50:56.053 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:56.048+0000 7f89ef7fe640 1 --2- 172.21.15.40:0/2800626897 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f89dc005180 0x7f89dc00b980 secure :-1 s=READY pgs=2691 cs=0 l=1 rev1=1 crypto rx=0x7f89e8001750 tx=0x7f89dc0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4bb34a86a0f7b2a0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T18:50:56.053 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:56.048+0000 7f89edffb640 1 -- 172.21.15.40:0/2800626897 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89e80052d0 con 0x7f89dc005180 2023-12-17T18:50:56.053 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:56.048+0000 7f89edffb640 1 -- 172.21.15.40:0/2800626897 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89e802e050 con 0x7f89dc005180 2023-12-17T18:50:56.053 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:56.048+0000 7f89edffb640 1 -- 172.21.15.40:0/2800626897 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89e8003830 con 0x7f89dc005180 2023-12-17T18:50:56.053 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:56.049+0000 7f89effff640 1 -- 172.21.15.40:0/2800626897 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f89dc005180 msgr2=0x7f89dc00b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T18:50:56.053 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:56.049+0000 7f89effff640 1 --2- 172.21.15.40:0/2800626897 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f89dc005180 0x7f89dc00b980 secure :-1 s=READY pgs=2691 cs=0 l=1 rev1=1 crypto rx=0x7f89e8001750 tx=0x7f89dc0057f0 comp rx=0 tx=0).stop 2023-12-17T18:50:56.053 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:56.049+0000 7f89effff640 1 -- 172.21.15.40:0/2800626897 shutdown_connections 2023-12-17T18:50:56.054 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:56.049+0000 7f89effff640 1 --2- 172.21.15.40:0/2800626897 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f89dc005180 0x7f89dc00b980 unknown :-1 s=CLOSED pgs=2691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T18:50:56.054 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:56.049+0000 7f89effff640 1 -- 172.21.15.40:0/2800626897 >> 172.21.15.40:0/2800626897 conn(0x7f89f006a640 msgr2=0x7f89f006aa50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T18:50:56.054 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:56.049+0000 7f89effff640 1 -- 172.21.15.40:0/2800626897 shutdown_connections 2023-12-17T18:50:56.054 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:56.049+0000 7f89effff640 1 -- 172.21.15.40:0/2800626897 wait complete. 2023-12-17T18:50:56.056 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:56.051+0000 7f89effff640 1 Processor -- start 2023-12-17T18:50:56.056 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:56.051+0000 7f89effff640 1 -- start start 2023-12-17T18:50:56.056 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:56.052+0000 7f89effff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f89dc005180 0x7f89f0149640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T18:50:56.057 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:56.052+0000 7f89effff640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f89f0148a10 0x7f89f0156dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T18:50:56.057 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:56.052+0000 7f89effff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f89f006cf70 0x7f89f006d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T18:50:56.057 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:56.052+0000 7f89effff640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89f006d910 con 0x7f89f006cf70 2023-12-17T18:50:56.057 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:56.052+0000 7f89effff640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89f009a0a0 con 0x7f89dc005180 2023-12-17T18:50:56.057 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:56.052+0000 7f89effff640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89f0157620 con 0x7f89f0148a10 2023-12-17T18:50:56.057 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:56.052+0000 7f89ef7fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f89f006cf70 0x7f89f006d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T18:50:56.057 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:56.052+0000 7f89ef7fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f89f006cf70 0x7f89f006d3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:58452/0 (socket says 172.21.15.40:58452) 2023-12-17T18:50:56.057 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:56.052+0000 7f89ef7fe640 1 -- 172.21.15.40:0/739916548 learned_addr learned my addr 172.21.15.40:0/739916548 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-17T18:50:56.057 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:56.053+0000 7f89eeffd640 1 --2- 172.21.15.40:0/739916548 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f89dc005180 0x7f89f0149640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T18:50:56.057 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:56.053+0000 7f89ef7fe640 1 -- 172.21.15.40:0/739916548 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f89f0148a10 msgr2=0x7f89f0156dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T18:50:56.058 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:56.053+0000 7f89ef7fe640 1 --2- 172.21.15.40:0/739916548 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f89f0148a10 0x7f89f0156dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T18:50:56.058 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:56.053+0000 7f89ef7fe640 1 -- 172.21.15.40:0/739916548 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f89dc005180 msgr2=0x7f89f0149640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T18:50:56.058 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:56.053+0000 7f89ef7fe640 1 --2- 172.21.15.40:0/739916548 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f89dc005180 0x7f89f0149640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T18:50:56.058 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:56.053+0000 7f89ef7fe640 1 -- 172.21.15.40:0/739916548 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89f0157900 con 0x7f89f006cf70 2023-12-17T18:50:56.058 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:56.053+0000 7f89ef7fe640 1 --2- 172.21.15.40:0/739916548 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f89f006cf70 0x7f89f006d3d0 secure :-1 s=READY pgs=2692 cs=0 l=1 rev1=1 crypto rx=0x7f89e8001870 tx=0x7f89e8001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T18:50:56.058 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:56.053+0000 7f89e7fff640 1 -- 172.21.15.40:0/739916548 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89e8039070 con 0x7f89f006cf70 2023-12-17T18:50:56.058 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:56.053+0000 7f89e7fff640 1 -- 172.21.15.40:0/739916548 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89e8005450 con 0x7f89f006cf70 2023-12-17T18:50:56.058 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:56.053+0000 7f89e7fff640 1 -- 172.21.15.40:0/739916548 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89e8007230 con 0x7f89f006cf70 2023-12-17T18:50:56.058 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:56.053+0000 7f89effff640 1 -- 172.21.15.40:0/739916548 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89f009a2f0 con 0x7f89f006cf70 2023-12-17T18:50:56.058 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:56.054+0000 7f89effff640 1 -- 172.21.15.40:0/739916548 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89f0157310 con 0x7f89f006cf70 2023-12-17T18:50:56.059 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:56.054+0000 7f89effff640 1 -- 172.21.15.40:0/739916548 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89f0157a90 con 0x7f89f006cf70 2023-12-17T18:50:56.059 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:56.057+0000 7f89e7fff640 1 -- 172.21.15.40:0/739916548 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f89e803c020 con 0x7f89f006cf70 2023-12-17T18:50:56.059 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:56.057+0000 7f89e7fff640 1 --2- 172.21.15.40:0/739916548 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f89d006ae40 0x7f89d006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T18:50:56.060 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:56.057+0000 7f89e7fff640 1 -- 172.21.15.40:0/739916548 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f89e80a9b80 con 0x7f89f006cf70 2023-12-17T18:50:56.060 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:56.058+0000 7f89eeffd640 1 --2- 172.21.15.40:0/739916548 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f89d006ae40 0x7f89d006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T18:50:56.061 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:56.058+0000 7f89eeffd640 1 --2- 172.21.15.40:0/739916548 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f89d006ae40 0x7f89d006d300 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f89e0007330 tx=0x7f89e000b040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T18:50:56.064 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:56.061+0000 7f89e7fff640 1 -- 172.21.15.40:0/739916548 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f89e8074ac0 con 0x7f89f006cf70 2023-12-17T18:50:56.264 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:56.262+0000 7f89effff640 1 -- 172.21.15.40:0/739916548 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f89f00b2a30 con 0x7f89f006cf70 2023-12-17T18:50:56.266 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:56.263+0000 7f89e7fff640 1 -- 172.21.15.40:0/739916548 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v44) v1 ==== 100+0+11 (secure 0 0 0) 0x7f89e80780e0 con 0x7f89f006cf70 2023-12-17T18:50:56.266 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 64 2023-12-17T18:50:56.269 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:56.266+0000 7f89effff640 1 -- 172.21.15.40:0/739916548 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f89d006ae40 msgr2=0x7f89d006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T18:50:56.269 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:56.266+0000 7f89effff640 1 --2- 172.21.15.40:0/739916548 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f89d006ae40 0x7f89d006d300 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f89e0007330 tx=0x7f89e000b040 comp rx=0 tx=0).stop 2023-12-17T18:50:56.269 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:56.266+0000 7f89effff640 1 -- 172.21.15.40:0/739916548 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f89f006cf70 msgr2=0x7f89f006d3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T18:50:56.269 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:56.266+0000 7f89effff640 1 --2- 172.21.15.40:0/739916548 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f89f006cf70 0x7f89f006d3d0 secure :-1 s=READY pgs=2692 cs=0 l=1 rev1=1 crypto rx=0x7f89e8001870 tx=0x7f89e8001120 comp rx=0 tx=0).stop 2023-12-17T18:50:56.269 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:56.266+0000 7f89effff640 1 -- 172.21.15.40:0/739916548 shutdown_connections 2023-12-17T18:50:56.270 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:56.266+0000 7f89effff640 1 --2- 172.21.15.40:0/739916548 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7f89d006ae40 0x7f89d006d300 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T18:50:56.270 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:56.266+0000 7f89effff640 1 --2- 172.21.15.40:0/739916548 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f89f006cf70 0x7f89f006d3d0 unknown :-1 s=CLOSED pgs=2692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T18:50:56.270 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:56.266+0000 7f89effff640 1 --2- 172.21.15.40:0/739916548 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7f89f0148a10 0x7f89f0156dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T18:50:56.270 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:56.266+0000 7f89effff640 1 --2- 172.21.15.40:0/739916548 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f89dc005180 0x7f89f0149640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T18:50:56.270 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:56.266+0000 7f89effff640 1 -- 172.21.15.40:0/739916548 >> 172.21.15.40:0/739916548 conn(0x7f89f006a640 msgr2=0x7f89f0071360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T18:50:56.270 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:56.266+0000 7f89effff640 1 -- 172.21.15.40:0/739916548 shutdown_connections 2023-12-17T18:50:56.270 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:56.267+0000 7f89effff640 1 -- 172.21.15.40:0/739916548 wait complete. 2023-12-17T18:50:56.289 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-17T18:50:56.483 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:56.481+0000 7fead6810640 1 Processor -- start 2023-12-17T18:50:56.484 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:56.481+0000 7fead6810640 1 -- start start 2023-12-17T18:50:56.488 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:56.483+0000 7fead6810640 1 --2- >> v2:172.21.15.159:3300/0 conn(0x7fead0143e00 0x7fead00b4040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T18:50:56.488 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:56.483+0000 7fead6810640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fead00b3bb0 con 0x7fead0072180 2023-12-17T18:50:56.488 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:56.483+0000 7fead6810640 1 -- --> v1:172.21.15.159:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fead01441e0 con 0x7fead006c410 2023-12-17T18:50:56.488 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:56.483+0000 7fead6810640 1 -- --> v2:172.21.15.159:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fead0072680 con 0x7fead0143e00 2023-12-17T18:50:56.488 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:56.483+0000 7feac7fff640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fead0072180 0x7fead00b4580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:50326/0 (socket says 172.21.15.40:50326) 2023-12-17T18:50:56.488 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:56.483+0000 7feac7fff640 1 -- 172.21.15.40:0/3399870796 learned_addr learned my addr 172.21.15.40:0/3399870796 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-12-17T18:50:56.488 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:56.483+0000 7feacf7fe640 1 -- 172.21.15.40:0/3399870796 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2370873603 0 0) 0x7fead00b3bb0 con 0x7fead0072180 2023-12-17T18:50:56.488 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:56.483+0000 7feacf7fe640 1 -- 172.21.15.40:0/3399870796 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feabc003520 con 0x7fead0072180 2023-12-17T18:50:56.488 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:56.483+0000 7feacffff640 1 --2- 172.21.15.40:0/3399870796 >> v2:172.21.15.159:3300/0 conn(0x7fead0143e00 0x7fead00b4040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T18:50:56.489 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:56.484+0000 7feacf7fe640 1 -- 172.21.15.40:0/3399870796 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4061145466 0 0) 0x7feabc003520 con 0x7fead0072180 2023-12-17T18:50:56.489 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:56.484+0000 7feacf7fe640 1 -- 172.21.15.40:0/3399870796 >> v2:172.21.15.159:3300/0 conn(0x7fead0143e00 msgr2=0x7fead00b4040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T18:50:56.489 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:56.484+0000 7feacf7fe640 1 --2- 172.21.15.40:0/3399870796 >> v2:172.21.15.159:3300/0 conn(0x7fead0143e00 0x7fead00b4040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T18:50:56.489 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:56.484+0000 7feacf7fe640 1 -- 172.21.15.40:0/3399870796 >> v1:172.21.15.159:6789/0 conn(0x7fead006c410 legacy=0x7fead015ecb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T18:50:56.489 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:56.484+0000 7feacf7fe640 1 -- 172.21.15.40:0/3399870796 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fead00b1e30 con 0x7fead0072180 2023-12-17T18:50:56.489 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:56.484+0000 7feacf7fe640 1 -- 172.21.15.40:0/3399870796 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2643242555 0 0) 0x7feab8001670 con 0x7fead0072180 2023-12-17T18:50:56.489 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:56.484+0000 7feacf7fe640 1 -- 172.21.15.40:0/3399870796 >> v1:172.21.15.40:6789/0 conn(0x7fead0072180 legacy=0x7fead00b4580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T18:50:56.489 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:56.484+0000 7feacf7fe640 1 --2- 172.21.15.40:0/3399870796 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7feabc0039c0 0x7feabc003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T18:50:56.489 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:56.484+0000 7feacf7fe640 1 --2- 172.21.15.40:0/3399870796 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7feabc0047c0 0x7feabc004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T18:50:56.489 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:56.484+0000 7feacf7fe640 1 --2- 172.21.15.40:0/3399870796 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7feabc0051d0 0x7feabc00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T18:50:56.490 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:56.484+0000 7feacf7fe640 1 -- 172.21.15.40:0/3399870796 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fead0072680 con 0x7feabc0039c0 2023-12-17T18:50:56.490 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:56.484+0000 7feacf7fe640 1 -- 172.21.15.40:0/3399870796 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feabc00c100 con 0x7feabc0047c0 2023-12-17T18:50:56.490 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:56.484+0000 7feacf7fe640 1 -- 172.21.15.40:0/3399870796 --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feabc00c2c0 con 0x7feabc0051d0 2023-12-17T18:50:56.490 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:56.484+0000 7feacffff640 1 --2- 172.21.15.40:0/3399870796 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7feabc0039c0 0x7feabc003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T18:50:56.490 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:56.485+0000 7feac7fff640 1 --2- 172.21.15.40:0/3399870796 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7feabc0047c0 0x7feabc004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T18:50:56.490 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:56.485+0000 7fead4dad640 1 --2- 172.21.15.40:0/3399870796 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7feabc0051d0 0x7feabc00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T18:50:56.490 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:56.485+0000 7feacffff640 1 -- 172.21.15.40:0/3399870796 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7feabc0051d0 msgr2=0x7feabc00b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T18:50:56.490 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:56.485+0000 7feacffff640 1 --2- 172.21.15.40:0/3399870796 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7feabc0051d0 0x7feabc00b980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T18:50:56.490 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:56.485+0000 7feacffff640 1 -- 172.21.15.40:0/3399870796 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7feabc0047c0 msgr2=0x7feabc004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T18:50:56.490 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:56.485+0000 7feacffff640 1 --2- 172.21.15.40:0/3399870796 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7feabc0047c0 0x7feabc004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T18:50:56.490 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:56.485+0000 7feacffff640 1 -- 172.21.15.40:0/3399870796 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feabc003520 con 0x7feabc0039c0 2023-12-17T18:50:56.491 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:56.485+0000 7feac7fff640 1 --2- 172.21.15.40:0/3399870796 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7feabc0047c0 0x7feabc004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-17T18:50:56.491 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:56.485+0000 7fead4dad640 1 -- 172.21.15.40:0/3399870796 reap_dead start 2023-12-17T18:50:56.494 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:56.486+0000 7feacffff640 1 --2- 172.21.15.40:0/3399870796 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7feabc0039c0 0x7feabc003dc0 secure :-1 s=READY pgs=2694 cs=0 l=1 rev1=1 crypto rx=0x7feac000ba00 tx=0x7feabc0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67bc0b6db63608cd server_cookie=0 in_seq=0 out_seq=0 2023-12-17T18:50:56.494 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:56.486+0000 7feacf7fe640 1 -- 172.21.15.40:0/3399870796 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feac0032620 con 0x7feabc0039c0 2023-12-17T18:50:56.495 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:56.486+0000 7feacf7fe640 1 -- 172.21.15.40:0/3399870796 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feac0032780 con 0x7feabc0039c0 2023-12-17T18:50:56.495 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:56.486+0000 7feacf7fe640 1 -- 172.21.15.40:0/3399870796 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feac0032b10 con 0x7feabc0039c0 2023-12-17T18:50:56.495 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:56.487+0000 7fead6810640 1 -- 172.21.15.40:0/3399870796 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7feabc0039c0 msgr2=0x7feabc003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T18:50:56.495 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:56.487+0000 7fead6810640 1 --2- 172.21.15.40:0/3399870796 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7feabc0039c0 0x7feabc003dc0 secure :-1 s=READY pgs=2694 cs=0 l=1 rev1=1 crypto rx=0x7feac000ba00 tx=0x7feabc0057f0 comp rx=0 tx=0).stop 2023-12-17T18:50:56.495 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:56.487+0000 7fead6810640 1 -- 172.21.15.40:0/3399870796 shutdown_connections 2023-12-17T18:50:56.495 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:56.487+0000 7fead6810640 1 --2- 172.21.15.40:0/3399870796 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7feabc0039c0 0x7feabc003dc0 unknown :-1 s=CLOSED pgs=2694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T18:50:56.495 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:56.487+0000 7fead6810640 1 -- 172.21.15.40:0/3399870796 >> 172.21.15.40:0/3399870796 conn(0x7fead00b0a90 msgr2=0x7fead00b0e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T18:50:56.495 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:56.487+0000 7fead6810640 1 -- 172.21.15.40:0/3399870796 shutdown_connections 2023-12-17T18:50:56.495 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:56.487+0000 7fead6810640 1 -- 172.21.15.40:0/3399870796 wait complete. 2023-12-17T18:50:56.495 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:56.489+0000 7fead6810640 1 Processor -- start 2023-12-17T18:50:56.495 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:56.489+0000 7fead6810640 1 -- start start 2023-12-17T18:50:56.496 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:56.490+0000 7fead6810640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7feabc0039c0 0x7fead00ce100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T18:50:56.496 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:56.490+0000 7fead6810640 1 --2- >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fead015a600 0x7fead013d610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T18:50:56.496 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:56.490+0000 7fead6810640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fead015aa80 0x7fead013db50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T18:50:56.496 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:56.490+0000 7fead6810640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fead00ce640 con 0x7feabc0039c0 2023-12-17T18:50:56.496 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:56.490+0000 7fead6810640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fead00ce870 con 0x7fead015aa80 2023-12-17T18:50:56.496 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:56.490+0000 7fead6810640 1 -- --> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fead0141bf0 con 0x7fead015a600 2023-12-17T18:50:56.496 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:56.490+0000 7feacffff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7feabc0039c0 0x7fead00ce100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T18:50:56.496 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:56.490+0000 7feacffff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7feabc0039c0 0x7fead00ce100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:58464/0 (socket says 172.21.15.40:58464) 2023-12-17T18:50:56.496 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:56.491+0000 7feacffff640 1 -- 172.21.15.40:0/3173332879 learned_addr learned my addr 172.21.15.40:0/3173332879 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-17T18:50:56.496 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:56.491+0000 7feac7fff640 1 --2- 172.21.15.40:0/3173332879 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fead015a600 0x7fead013d610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T18:50:56.496 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:56.491+0000 7feacffff640 1 -- 172.21.15.40:0/3173332879 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fead015a600 msgr2=0x7fead013d610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T18:50:56.497 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:56.491+0000 7fead4dad640 1 --2- 172.21.15.40:0/3173332879 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fead015aa80 0x7fead013db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T18:50:56.497 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:56.491+0000 7feacffff640 1 --2- 172.21.15.40:0/3173332879 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fead015a600 0x7fead013d610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T18:50:56.497 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:56.491+0000 7feacffff640 1 -- 172.21.15.40:0/3173332879 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fead015aa80 msgr2=0x7fead013db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T18:50:56.497 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:56.491+0000 7feacffff640 1 --2- 172.21.15.40:0/3173332879 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fead015aa80 0x7fead013db50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T18:50:56.497 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:56.491+0000 7feacffff640 1 -- 172.21.15.40:0/3173332879 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fead0141ed0 con 0x7feabc0039c0 2023-12-17T18:50:56.497 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:56.491+0000 7feacffff640 1 --2- 172.21.15.40:0/3173332879 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7feabc0039c0 0x7fead00ce100 secure :-1 s=READY pgs=2695 cs=0 l=1 rev1=1 crypto rx=0x7feac0035040 tx=0x7feac0004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T18:50:56.497 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:56.492+0000 7feacd7fa640 1 -- 172.21.15.40:0/3173332879 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feac003b620 con 0x7feabc0039c0 2023-12-17T18:50:56.497 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:56.492+0000 7feacd7fa640 1 -- 172.21.15.40:0/3173332879 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feac003b7a0 con 0x7feabc0039c0 2023-12-17T18:50:56.497 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:56.492+0000 7feacd7fa640 1 -- 172.21.15.40:0/3173332879 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feac003bb50 con 0x7feabc0039c0 2023-12-17T18:50:56.498 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:56.492+0000 7fead6810640 1 -- 172.21.15.40:0/3173332879 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fead01421b0 con 0x7feabc0039c0 2023-12-17T18:50:56.498 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:56.492+0000 7fead6810640 1 -- 172.21.15.40:0/3173332879 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fead0138c00 con 0x7feabc0039c0 2023-12-17T18:50:56.499 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:56.493+0000 7fead6810640 1 -- 172.21.15.40:0/3173332879 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fead0142800 con 0x7feabc0039c0 2023-12-17T18:50:56.499 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:56.494+0000 7feacd7fa640 1 -- 172.21.15.40:0/3173332879 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7feac003bcb0 con 0x7feabc0039c0 2023-12-17T18:50:56.499 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:56.495+0000 7feacd7fa640 1 --2- 172.21.15.40:0/3173332879 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7feab006ae40 0x7feab006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T18:50:56.499 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:56.495+0000 7feacd7fa640 1 -- 172.21.15.40:0/3173332879 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6058+0+0 (secure 0 0 0) 0x7feac00ab910 con 0x7feabc0039c0 2023-12-17T18:50:56.499 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:56.495+0000 7feac7fff640 1 --2- 172.21.15.40:0/3173332879 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7feab006ae40 0x7feab006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T18:50:56.499 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:56.497+0000 7feac7fff640 1 --2- 172.21.15.40:0/3173332879 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7feab006ae40 0x7feab006d300 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7fead00ae660 tx=0x7feab8009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T18:50:56.502 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:56.499+0000 7feacd7fa640 1 -- 172.21.15.40:0/3173332879 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7feac0076850 con 0x7feabc0039c0 2023-12-17T18:50:56.539 INFO:teuthology.orchestra.run.smithi040.stdout:generic/551 1742s 2023-12-17T18:50:56.575 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/551 2023-12-17T18:50:56.575 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T18:50:56.587 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T18:50:56.616 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T18:50:56.616 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/552) 2023-12-17T18:50:56.707 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:56.705+0000 7fead6810640 1 -- 172.21.15.40:0/3173332879 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fead00745d0 con 0x7feabc0039c0 2023-12-17T18:50:56.707 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:56.705+0000 7feacd7fa640 1 -- 172.21.15.40:0/3173332879 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v44) v1 ==== 80+0+0 (secure 0 0 0) 0x7feac0036020 con 0x7feabc0039c0 2023-12-17T18:50:56.707 INFO:teuthology.orchestra.run.smithi040.stderr:listed 0 entries 2023-12-17T18:50:56.711 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:56.708+0000 7fead6810640 1 -- 172.21.15.40:0/3173332879 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7feab006ae40 msgr2=0x7feab006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T18:50:56.711 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:56.708+0000 7fead6810640 1 --2- 172.21.15.40:0/3173332879 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7feab006ae40 0x7feab006d300 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7fead00ae660 tx=0x7feab8009040 comp rx=0 tx=0).stop 2023-12-17T18:50:56.711 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:56.708+0000 7fead6810640 1 -- 172.21.15.40:0/3173332879 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7feabc0039c0 msgr2=0x7fead00ce100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T18:50:56.711 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:56.708+0000 7fead6810640 1 --2- 172.21.15.40:0/3173332879 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7feabc0039c0 0x7fead00ce100 secure :-1 s=READY pgs=2695 cs=0 l=1 rev1=1 crypto rx=0x7feac0035040 tx=0x7feac0004730 comp rx=0 tx=0).stop 2023-12-17T18:50:56.711 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:56.708+0000 7fead6810640 1 -- 172.21.15.40:0/3173332879 shutdown_connections 2023-12-17T18:50:56.711 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:56.708+0000 7fead6810640 1 --2- 172.21.15.40:0/3173332879 >> [v2:172.21.15.159:6832/479465803,v1:172.21.15.159:6833/479465803] conn(0x7feab006ae40 0x7feab006d300 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T18:50:56.711 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:56.708+0000 7fead6810640 1 --2- 172.21.15.40:0/3173332879 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fead015aa80 0x7fead013db50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T18:50:56.711 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:56.708+0000 7fead6810640 1 --2- 172.21.15.40:0/3173332879 >> [v2:172.21.15.159:3301/0,v1:172.21.15.159:6790/0] conn(0x7fead015a600 0x7fead013d610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T18:50:56.711 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:56.708+0000 7fead6810640 1 --2- 172.21.15.40:0/3173332879 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7feabc0039c0 0x7fead00ce100 unknown :-1 s=CLOSED pgs=2695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T18:50:56.711 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:56.708+0000 7fead6810640 1 -- 172.21.15.40:0/3173332879 >> 172.21.15.40:0/3173332879 conn(0x7fead00b0a90 msgr2=0x7fead0070f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T18:50:56.711 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:56.708+0000 7fead6810640 1 -- 172.21.15.40:0/3173332879 shutdown_connections 2023-12-17T18:50:56.711 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-17T18:50:56.708+0000 7fead6810640 1 -- 172.21.15.40:0/3173332879 wait complete. 2023-12-17T18:50:56.728 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-12-17T18:50:56.728 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-17T18:50:56.728 DEBUG:teuthology.orchestra.run.smithi040:> sudo umount /home/ubuntu/cephtest/mnt.0 -f 2023-12-17T18:50:56.806 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi040.front.sepia.ceph.com 2023-12-17T18:50:56.806 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-17T18:50:56.806 DEBUG:teuthology.orchestra.run.smithi040:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-12-17T18:50:56.874 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2023-12-17T18:50:56.875 DEBUG:teuthology.orchestra.run.smithi040:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-17T18:50:56.916 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4055074,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6500064k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3250028k,nr_inodes=812507,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6500064k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-12-17T18:50:56.916 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi040.front.sepia.ceph.com 2023-12-17T18:50:56.916 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-17T18:50:56.917 DEBUG:teuthology.orchestra.run.smithi040:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-12-17T18:50:57.001 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-17T18:50:57.002 INFO:teuthology.orchestra.run.smithi040.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2023-12-17T18:50:57.002 DEBUG:teuthology.orchestra.run.smithi159:> set -ex 2023-12-17T18:50:57.002 DEBUG:teuthology.orchestra.run.smithi159:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-17T18:50:57.141 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054301,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498828k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249412k,nr_inodes=812353,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498828k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-12-17T18:50:57.141 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi159.front.sepia.ceph.com 2023-12-17T18:50:57.142 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-17T18:50:57.142 DEBUG:teuthology.orchestra.run.smithi159:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-12-17T18:50:57.220 INFO:teuthology.orchestra.run.smithi159.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.1': No such file or directory 2023-12-17T18:50:57.222 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-17T18:50:57.222 DEBUG:teuthology.orchestra.run.smithi159:> set -ex 2023-12-17T18:50:57.222 DEBUG:teuthology.orchestra.run.smithi159:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-17T18:50:57.238 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-12-17T18:50:57.254 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-17T18:50:57.257 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-17T18:50:57.260 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC9335lFtVKLBAAH3JieNvzBP2lfhcU1GlfiA== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.k3h64vAtcuscratch 2023-12-17T18:50:57.260 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T18:50:57.283 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054301,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498828k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249412k,nr_inodes=812353,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498828k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-12-17T18:50:57.283 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi159.front.sepia.ceph.com 2023-12-17T18:50:57.283 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-17T18:50:57.284 DEBUG:teuthology.orchestra.run.smithi159:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-12-17T18:50:57.336 INFO:teuthology.orchestra.run.smithi159.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2023-12-17T18:50:57.337 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-17T18:50:58.284 INFO:teuthology.orchestra.run.smithi040.stdout:generic/552 [not run] require 172.21.15.40:6789:/scratch to be valid block disk 2023-12-17T18:50:58.299 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/552 2023-12-17T18:50:58.299 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/552 2023-12-17T18:50:58.299 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-12-17T18:50:58.311 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-17T18:50:58.369 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-17T18:50:58.370 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.34EJEHEKBdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/553) 2023-12-17T18:50:58.948 INFO:tasks.ceph.osd.0:Sent signal 15 2023-12-17T18:50:58.949 INFO:tasks.ceph.osd.1:Sent signal 15 2023-12-17T18:50:58.949 INFO:tasks.ceph.osd.2:Sent signal 15 2023-12-17T18:50:58.950 INFO:tasks.ceph.osd.3:Sent signal 15 2023-12-17T18:50:58.950 INFO:tasks.ceph.osd.4:Sent signal 15 2023-12-17T18:50:58.950 INFO:tasks.ceph.osd.6:Sent signal 15 2023-12-17T18:50:58.951 INFO:tasks.ceph.osd.7:Sent signal 15 2023-12-17T18:50:58.951 INFO:tasks.ceph.mds.a:Sent signal 15 2023-12-17T18:50:58.951 INFO:tasks.ceph.mds.c:Sent signal 15 2023-12-17T18:50:58.951 INFO:tasks.ceph.mds.b:Sent signal 15 2023-12-17T18:50:58.952 INFO:tasks.ceph.mds.d:Sent signal 15 2023-12-17T18:50:58.952 INFO:tasks.ceph.mon.a:Sent signal 15 2023-12-17T18:50:58.952 INFO:tasks.ceph.mon.b:Sent signal 15 2023-12-17T18:50:58.952 INFO:tasks.ceph.mon.c:Sent signal 15 2023-12-17T18:50:58.953 INFO:tasks.ceph.mgr.y:Sent signal 15 2023-12-17T18:50:58.953 INFO:tasks.ceph.mgr.x:Sent signal 15 2023-12-17T18:50:58.954 INFO:tasks.ceph.osd.4.smithi159.stderr:2023-12-17T18:50:58.949+0000 7f2f7c3d6640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 88621) UID: 0 2023-12-17T18:50:58.954 INFO:tasks.ceph.osd.4.smithi159.stderr:2023-12-17T18:50:58.949+0000 7f2f7c3d6640 -1 osd.4 44 *** Got signal Terminated *** 2023-12-17T18:50:58.954 INFO:tasks.ceph.osd.4.smithi159.stderr:2023-12-17T18:50:58.949+0000 7f2f7c3d6640 -1 osd.4 44 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-12-17T18:50:58.954 INFO:tasks.ceph.osd.6.smithi159.stderr:2023-12-17T18:50:58.949+0000 7efd98236640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 88617) UID: 0 2023-12-17T18:50:58.955 INFO:tasks.ceph.osd.6.smithi159.stderr:2023-12-17T18:50:58.949+0000 7efd98236640 -1 osd.6 44 *** Got signal Terminated *** 2023-12-17T18:50:58.955 INFO:tasks.ceph.osd.6.smithi159.stderr:2023-12-17T18:50:58.949+0000 7efd98236640 -1 osd.6 44 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-12-17T18:50:58.955 INFO:tasks.ceph.osd.7.smithi159.stderr:2023-12-17T18:50:58.949+0000 7f2a65aa4640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 88623) UID: 0 2023-12-17T18:50:58.955 INFO:tasks.ceph.osd.7.smithi159.stderr:2023-12-17T18:50:58.949+0000 7f2a65aa4640 -1 osd.7 44 *** Got signal Terminated *** 2023-12-17T18:50:58.955 INFO:tasks.ceph.osd.7.smithi159.stderr:2023-12-17T18:50:58.949+0000 7f2a65aa4640 -1 osd.7 44 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-12-17T18:50:58.956 INFO:tasks.ceph.mds.b.smithi159.stderr:2023-12-17T18:50:58.950+0000 7ff8c5a52640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mds -f --cluster ceph -i b (PID: 94912) UID: 0 2023-12-17T18:50:58.956 INFO:tasks.ceph.mds.b.smithi159.stderr:2023-12-17T18:50:58.950+0000 7ff8c5a52640 -1 mds.b *** got signal Terminated *** 2023-12-17T18:50:58.956 INFO:tasks.ceph.mds.d.smithi159.stderr:2023-12-17T18:50:58.950+0000 7f1350aab640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mds -f --cluster ceph -i d (PID: 94910) UID: 0 2023-12-17T18:50:58.956 INFO:tasks.ceph.mds.d.smithi159.stderr:2023-12-17T18:50:58.950+0000 7f1350aab640 -1 mds.d *** got signal Terminated *** 2023-12-17T18:50:58.957 INFO:tasks.ceph.mon.b.smithi159.stderr:2023-12-17T18:50:58.951+0000 7f4ae51e4640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mon -f --cluster ceph -i b (PID: 88048) UID: 0 2023-12-17T18:50:58.957 INFO:tasks.ceph.mon.b.smithi159.stderr:2023-12-17T18:50:58.952+0000 7f4ae51e4640 -1 mon.b@1(peon) e1 *** Got Signal Terminated *** 2023-12-17T18:50:58.957 INFO:tasks.ceph.mon.c.smithi159.stderr:2023-12-17T18:50:58.952+0000 7feffa210640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mon -f --cluster ceph -i c (PID: 88049) UID: 0 2023-12-17T18:50:58.958 INFO:tasks.ceph.mon.c.smithi159.stderr:2023-12-17T18:50:58.952+0000 7feffa210640 -1 mon.c@2(peon) e1 *** Got Signal Terminated *** 2023-12-17T18:50:58.958 INFO:tasks.ceph.mgr.x.smithi159.stderr:2023-12-17T18:50:58.953+0000 7fc2fbecc640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mgr -f --cluster ceph -i x (PID: 88052) UID: 0 2023-12-17T18:50:58.958 INFO:tasks.ceph.mgr.x.smithi159.stderr:2023-12-17T18:50:58.953+0000 7fc2fbecc640 -1 mgr handle_mgr_signal *** Got signal Terminated *** 2023-12-17T18:50:58.958 INFO:tasks.ceph.osd.0.smithi040.stderr:2023-12-17T18:50:58.947+0000 7fddc7cf4640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 88635) UID: 0 2023-12-17T18:50:58.959 INFO:tasks.ceph.osd.0.smithi040.stderr:2023-12-17T18:50:58.947+0000 7fddc7cf4640 -1 osd.0 44 *** Got signal Terminated *** 2023-12-17T18:50:58.959 INFO:tasks.ceph.osd.0.smithi040.stderr:2023-12-17T18:50:58.947+0000 7fddc7cf4640 -1 osd.0 44 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-12-17T18:50:58.959 INFO:tasks.ceph.osd.1.smithi040.stderr:2023-12-17T18:50:58.948+0000 7f1055c84640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 88638) UID: 0 2023-12-17T18:50:58.959 INFO:tasks.ceph.osd.1.smithi040.stderr:2023-12-17T18:50:58.948+0000 7f1055c84640 -1 osd.1 44 *** Got signal Terminated *** 2023-12-17T18:50:58.959 INFO:tasks.ceph.osd.1.smithi040.stderr:2023-12-17T18:50:58.948+0000 7f1055c84640 -1 osd.1 44 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-12-17T18:50:58.960 INFO:tasks.ceph.osd.2.smithi040.stderr:2023-12-17T18:50:58.949+0000 7f342b477640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 88644) UID: 0 2023-12-17T18:50:58.960 INFO:tasks.ceph.osd.2.smithi040.stderr:2023-12-17T18:50:58.949+0000 7f342b477640 -1 osd.2 44 *** Got signal Terminated *** 2023-12-17T18:50:58.960 INFO:tasks.ceph.osd.2.smithi040.stderr:2023-12-17T18:50:58.949+0000 7f342b477640 -1 osd.2 44 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-12-17T18:50:58.960 INFO:tasks.ceph.osd.3.smithi040.stderr:2023-12-17T18:50:58.949+0000 7f5186ef4640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 88648) UID: 0 2023-12-17T18:50:58.960 INFO:tasks.ceph.osd.3.smithi040.stderr:2023-12-17T18:50:58.949+0000 7f5186ef4640 -1 osd.3 44 *** Got signal Terminated *** 2023-12-17T18:50:58.960 INFO:tasks.ceph.osd.3.smithi040.stderr:2023-12-17T18:50:58.949+0000 7f5186ef4640 -1 osd.3 44 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-12-17T18:50:58.961 INFO:tasks.ceph.mds.c.smithi040.stderr:2023-12-17T18:50:58.950+0000 7f145b3f3640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mds -f --cluster ceph -i c (PID: 101998) UID: 0 2023-12-17T18:50:58.961 INFO:tasks.ceph.mds.c.smithi040.stderr:2023-12-17T18:50:58.950+0000 7f145b3f3640 -1 mds.c *** got signal Terminated *** 2023-12-17T18:50:58.961 INFO:tasks.ceph.mds.a.smithi040.stderr:2023-12-17T18:50:58.950+0000 7f6d5cbf3640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mds -f --cluster ceph -i a (PID: 101996) UID: 0 2023-12-17T18:50:58.961 INFO:tasks.ceph.mds.a.smithi040.stderr:2023-12-17T18:50:58.950+0000 7f6d5cbf3640 -1 mds.a *** got signal Terminated *** 2023-12-17T18:50:58.966 INFO:tasks.ceph.mon.a.smithi040.stderr:2023-12-17T18:50:58.963+0000 7fed44623640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mon -f --cluster ceph -i a (PID: 88394) UID: 0 2023-12-17T18:50:58.966 INFO:tasks.ceph.mon.a.smithi040.stderr:2023-12-17T18:50:58.963+0000 7fed44623640 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2023-12-17T18:50:59.167 INFO:tasks.ceph.mgr.y.smithi040.stderr:daemon-helper: command crashed with signal 15 2023-12-17T18:51:15.158 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T18:51:15.169 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T18:51:45.307 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T18:51:45.317 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T18:52:15.577 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T18:52:15.587 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T18:52:45.849 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T18:52:45.859 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T18:53:15.997 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T18:53:16.009 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T18:53:46.402 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T18:53:46.413 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T18:54:16.548 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T18:54:16.558 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T18:54:46.695 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T18:54:46.706 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T18:55:16.917 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T18:55:16.927 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T18:55:47.164 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T18:55:47.174 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T18:56:17.319 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T18:56:17.330 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T18:56:47.549 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T18:56:47.559 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T18:57:17.762 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T18:57:17.774 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T18:57:47.992 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T18:57:48.003 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T18:58:18.222 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T18:58:18.232 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T18:58:48.427 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T18:58:48.437 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T18:59:18.640 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T18:59:18.650 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T18:59:48.846 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T18:59:48.856 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T19:00:18.993 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T19:00:19.002 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T19:00:49.205 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T19:00:49.215 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T19:01:19.419 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T19:01:19.429 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T19:01:49.657 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T19:01:49.667 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T19:02:19.880 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T19:02:19.890 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T19:02:50.111 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T19:02:50.122 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T19:03:20.265 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T19:03:20.276 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T19:03:50.497 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T19:03:50.510 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T19:04:20.717 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T19:04:20.729 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T19:04:50.953 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T19:04:50.964 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T19:05:21.100 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T19:05:21.112 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T19:05:51.369 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T19:05:51.380 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T19:06:21.643 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T19:06:21.652 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T19:06:51.875 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T19:06:51.886 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T19:07:22.086 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T19:07:22.096 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T19:07:52.307 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T19:07:52.317 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T19:08:22.545 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T19:08:22.556 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T19:08:52.785 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T19:08:52.795 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T19:09:23.005 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T19:09:23.015 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T19:09:53.234 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T19:09:53.244 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T19:10:23.472 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T19:10:23.483 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T19:10:53.686 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T19:10:53.696 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T19:11:23.915 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T19:11:23.924 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T19:11:54.119 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T19:11:54.129 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T19:12:24.337 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T19:12:24.353 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T19:12:54.546 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T19:12:54.556 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T19:13:24.759 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T19:13:24.770 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T19:13:54.956 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T19:13:54.966 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T19:14:25.177 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T19:14:25.187 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T19:14:55.392 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T19:14:55.402 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T19:15:25.781 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T19:15:25.791 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T19:15:56.022 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T19:15:56.032 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T19:16:26.224 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T19:16:26.235 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T19:16:56.436 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T19:16:56.446 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T19:17:26.582 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T19:17:26.593 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T19:17:56.803 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T19:17:56.812 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T19:18:27.033 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T19:18:27.043 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T19:18:57.192 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T19:18:57.202 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T19:19:27.340 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T19:19:27.350 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T19:19:57.486 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T19:19:57.496 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T19:20:27.661 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T19:20:27.671 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T19:20:57.822 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T19:20:57.833 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T19:21:27.986 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T19:21:27.997 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T19:21:58.140 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T19:21:58.150 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T19:22:28.422 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T19:22:28.432 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T19:22:58.651 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T19:22:58.661 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T19:23:28.882 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T19:23:28.897 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T19:23:59.177 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T19:23:59.188 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T19:24:29.398 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T19:24:29.409 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T19:24:59.611 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T19:24:59.621 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T19:25:29.841 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T19:25:29.851 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T19:26:00.063 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T19:26:00.073 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T19:26:30.267 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T19:26:30.277 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T19:27:00.425 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T19:27:00.436 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T19:27:30.661 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T19:27:30.671 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T19:28:00.882 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T19:28:00.892 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T19:28:31.028 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T19:28:31.038 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T19:29:01.250 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T19:29:01.260 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T19:29:31.487 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T19:29:31.498 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T19:30:01.700 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T19:30:01.710 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T19:30:31.930 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T19:30:31.940 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T19:31:02.185 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T19:31:02.195 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T19:31:32.398 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T19:31:32.409 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T19:32:02.559 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T19:32:02.569 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T19:32:32.708 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T19:32:32.718 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T19:33:02.879 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T19:33:02.889 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T19:33:33.033 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T19:33:33.044 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T19:34:03.197 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T19:34:03.206 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T19:34:33.344 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T19:34:33.355 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T19:35:03.507 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T19:35:03.516 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T19:35:33.654 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T19:35:33.663 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T19:36:03.809 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T19:36:03.819 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T19:36:33.962 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T19:36:33.972 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T19:37:04.199 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T19:37:04.210 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T19:37:34.396 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T19:37:34.407 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T19:38:04.556 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T19:38:04.566 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T19:38:34.790 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T19:38:34.800 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T19:39:04.994 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T19:39:05.005 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T19:39:35.199 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T19:39:35.209 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T19:40:05.375 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T19:40:05.385 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T19:40:35.593 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T19:40:35.603 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T19:41:05.747 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T19:41:05.758 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T19:41:35.894 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T19:41:35.904 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T19:42:06.054 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T19:42:06.065 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T19:42:36.411 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T19:42:36.421 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T19:43:06.624 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T19:43:06.634 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T19:43:36.854 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T19:43:36.864 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T19:44:07.068 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T19:44:07.079 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T19:44:37.280 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T19:44:37.291 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T19:45:07.501 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T19:45:07.512 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T19:45:37.715 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T19:45:37.726 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T19:46:07.927 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T19:46:07.938 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T19:46:38.149 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T19:46:38.160 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T19:47:08.379 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T19:47:08.389 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T19:47:38.526 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T19:47:38.536 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T19:48:08.739 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T19:48:08.748 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T19:48:38.943 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T19:48:38.953 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T19:49:09.099 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T19:49:09.109 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T19:49:39.254 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T19:49:39.264 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T19:50:09.409 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T19:50:09.419 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T19:50:39.672 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T19:50:39.682 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T19:51:09.910 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T19:51:09.920 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T19:51:40.065 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T19:51:40.075 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T19:52:10.287 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T19:52:10.297 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T19:52:40.542 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T19:52:40.551 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T19:53:10.688 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T19:53:10.698 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T19:53:40.844 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T19:53:40.854 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T19:54:11.074 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T19:54:11.085 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T19:54:41.229 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T19:54:41.239 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T19:55:11.500 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T19:55:11.510 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T19:55:41.746 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T19:55:41.756 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T19:56:11.901 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T19:56:11.911 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T19:56:42.166 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T19:56:42.176 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T19:57:12.395 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T19:57:12.406 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T19:57:42.609 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T19:57:42.619 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T19:58:12.804 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T19:58:12.815 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T19:58:43.035 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T19:58:43.045 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T19:59:13.274 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T19:59:13.284 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T19:59:43.511 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T19:59:43.522 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T20:00:13.716 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T20:00:13.726 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T20:00:43.946 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T20:00:43.956 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T20:01:14.159 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T20:01:14.169 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T20:01:44.380 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T20:01:44.390 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T20:02:14.611 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T20:02:14.621 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T20:02:44.831 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T20:02:44.840 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T20:03:14.986 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T20:03:14.996 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T20:03:45.199 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T20:03:45.209 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T20:04:15.404 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T20:04:15.415 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T20:04:45.619 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T20:04:45.630 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T20:05:15.790 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T20:05:15.802 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T20:05:45.954 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T20:05:45.965 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T20:06:16.118 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T20:06:16.128 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T20:06:46.329 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T20:06:46.340 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T20:07:16.542 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T20:07:16.553 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T20:07:46.763 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T20:07:46.773 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T20:08:16.921 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T20:08:16.931 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T20:08:47.074 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T20:08:47.084 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T20:09:17.412 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T20:09:17.423 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T20:09:47.569 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T20:09:47.580 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T20:10:17.797 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T20:10:17.807 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T20:10:48.027 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T20:10:48.037 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T20:11:18.239 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T20:11:18.249 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T20:11:48.453 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T20:11:48.463 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T20:12:18.649 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T20:12:18.659 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T20:12:48.845 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T20:12:48.855 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T20:13:19.005 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T20:13:19.015 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T20:13:49.231 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T20:13:49.241 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T20:14:19.435 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T20:14:19.446 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T20:14:49.675 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T20:14:49.687 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T20:15:19.833 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T20:15:19.843 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T20:15:50.059 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T20:15:50.072 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T20:16:20.347 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T20:16:20.358 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T20:16:50.499 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T20:16:50.510 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T20:17:20.723 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T20:17:20.733 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T20:17:50.946 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T20:17:50.956 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T20:18:21.166 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T20:18:21.176 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T20:18:51.320 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T20:18:51.331 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T20:19:21.468 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T20:19:21.479 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T20:19:51.614 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T20:19:51.624 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T20:20:21.836 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T20:20:21.845 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T20:20:52.075 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T20:20:52.085 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T20:21:22.346 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T20:21:22.355 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T20:21:52.551 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T20:21:52.561 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T20:22:22.791 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T20:22:22.801 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T20:22:52.986 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T20:22:52.995 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T20:23:23.165 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T20:23:23.175 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T20:23:53.388 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T20:23:53.399 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T20:24:23.593 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T20:24:23.603 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T20:24:53.814 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T20:24:53.824 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T20:25:24.044 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T20:25:24.054 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T20:25:54.257 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T20:25:54.268 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T20:26:24.463 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T20:26:24.473 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T20:26:54.667 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T20:26:54.678 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T20:27:24.822 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T20:27:24.832 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T20:27:55.036 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T20:27:55.046 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T20:28:25.257 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T20:28:25.267 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T20:28:55.437 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T20:28:55.448 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T20:29:25.650 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T20:29:25.660 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T20:29:55.897 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T20:29:55.907 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T20:30:26.051 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T20:30:26.062 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T20:30:56.378 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T20:30:56.388 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T20:31:26.537 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T20:31:26.546 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T20:31:56.774 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T20:31:56.784 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T20:32:27.045 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T20:32:27.055 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T20:32:57.209 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T20:32:57.220 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T20:33:27.365 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T20:33:27.375 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T20:33:57.594 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T20:33:57.604 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T20:34:27.758 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T20:34:27.768 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T20:34:57.988 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T20:34:57.998 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T20:35:28.209 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T20:35:28.219 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T20:35:58.490 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T20:35:58.500 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T20:36:28.720 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T20:36:28.730 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T20:36:59.006 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T20:36:59.016 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T20:37:29.229 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T20:37:29.239 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T20:37:59.500 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T20:37:59.510 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T20:38:29.707 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T20:38:29.717 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T20:38:59.928 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T20:38:59.938 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T20:39:30.176 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T20:39:30.186 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T20:40:00.379 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T20:40:00.389 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T20:40:30.610 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T20:40:30.620 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T20:41:00.814 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T20:41:00.824 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T20:41:30.970 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T20:41:30.982 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T20:42:01.182 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T20:42:01.193 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T20:42:31.354 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T20:42:31.363 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T20:43:01.657 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T20:43:01.666 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T20:43:31.862 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T20:43:31.872 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T20:44:02.084 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T20:44:02.094 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T20:44:32.288 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T20:44:32.298 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T20:45:02.628 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T20:45:02.639 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T20:45:32.840 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T20:45:32.850 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T20:46:03.085 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T20:46:03.096 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T20:46:33.370 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T20:46:33.380 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T20:47:03.603 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T20:47:03.614 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T20:47:33.808 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T20:47:33.818 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T20:48:04.038 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T20:48:04.048 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T20:48:34.215 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T20:48:34.226 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T20:49:04.370 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T20:49:04.381 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T20:49:34.527 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T20:49:34.538 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T20:50:04.679 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T20:50:04.689 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T20:50:34.836 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T20:50:34.846 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T20:51:04.990 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T20:51:05.000 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T20:51:35.196 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T20:51:35.206 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T20:52:05.342 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T20:52:05.353 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T20:52:35.539 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T20:52:35.549 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T20:53:05.692 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T20:53:05.702 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T20:53:35.840 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T20:53:35.850 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T20:54:05.994 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T20:54:06.004 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T20:54:36.190 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T20:54:36.200 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T20:55:06.396 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T20:55:06.406 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T20:55:36.609 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T20:55:36.619 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T20:56:06.871 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T20:56:06.882 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T20:56:37.085 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T20:56:37.095 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T20:57:07.239 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T20:57:07.249 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T20:57:37.453 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T20:57:37.462 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T20:58:07.674 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T20:58:07.684 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T20:58:37.878 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T20:58:37.888 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T20:59:08.084 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T20:59:08.095 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T20:59:38.304 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T20:59:38.315 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T21:00:08.510 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T21:00:08.520 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T21:00:38.731 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T21:00:38.741 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T21:01:08.961 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T21:01:08.971 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T21:01:39.199 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T21:01:39.210 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T21:02:09.353 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T21:02:09.363 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T21:02:39.591 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T21:02:39.602 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T21:03:09.812 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T21:03:09.821 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T21:03:40.033 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T21:03:40.043 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T21:04:10.264 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T21:04:10.274 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T21:04:40.486 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T21:04:40.498 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T21:05:10.698 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T21:05:10.708 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T21:05:40.910 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T21:05:40.921 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T21:06:11.109 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T21:06:11.119 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T21:06:41.371 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T21:06:41.381 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T21:07:11.568 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T21:07:11.578 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T21:07:41.814 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T21:07:41.825 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T21:08:11.961 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T21:08:11.971 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T21:08:42.209 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T21:08:42.219 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T21:09:12.436 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T21:09:12.446 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T21:09:42.658 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T21:09:42.667 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T21:10:12.871 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T21:10:12.881 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T21:10:43.292 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T21:10:43.303 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T21:11:13.450 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T21:11:13.459 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T21:11:43.605 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T21:11:43.617 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T21:12:13.830 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T21:12:13.841 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T21:12:44.044 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T21:12:44.054 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T21:13:14.248 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T21:13:14.259 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T21:13:44.479 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T21:13:44.489 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T21:14:14.716 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T21:14:14.726 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T21:14:44.875 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T21:14:44.884 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T21:15:15.109 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T21:15:15.120 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T21:15:45.330 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T21:15:45.340 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T21:16:15.551 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T21:16:15.561 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T21:16:45.747 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T21:16:45.758 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T21:17:15.894 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T21:17:15.904 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T21:17:46.108 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T21:17:46.118 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T21:18:16.255 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T21:18:16.265 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T21:18:46.475 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T21:18:46.486 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T21:19:16.690 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T21:19:16.702 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T21:19:46.857 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T21:19:46.867 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T21:20:17.023 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T21:20:17.033 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T21:20:47.229 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T21:20:47.239 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T21:21:17.372 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T21:21:17.382 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T21:21:47.772 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T21:21:47.782 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T21:22:17.993 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T21:22:18.003 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T21:22:48.440 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T21:22:48.450 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T21:23:18.584 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T21:23:18.593 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T21:23:48.800 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T21:23:48.810 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T21:24:19.021 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T21:24:19.032 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T21:24:49.181 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T21:24:49.192 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T21:25:19.407 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T21:25:19.417 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T21:25:49.619 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T21:25:49.630 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T21:26:19.766 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T21:26:19.777 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T21:26:49.970 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T21:26:49.980 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T21:27:20.209 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T21:27:20.219 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T21:27:50.414 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T21:27:50.424 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T21:28:20.636 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T21:28:20.647 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T21:28:50.857 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T21:28:50.868 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T21:29:21.012 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T21:29:21.023 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T21:29:51.209 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T21:29:51.219 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T21:30:21.430 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T21:30:21.441 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T21:30:51.592 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T21:30:51.602 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T21:31:21.815 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T21:31:21.826 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T21:31:52.020 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T21:31:52.029 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T21:32:22.183 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T21:32:22.193 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T21:32:52.339 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T21:32:52.348 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T21:33:22.560 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T21:33:22.570 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T21:33:52.764 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T21:33:52.774 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T21:34:22.910 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T21:34:22.920 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T21:34:53.125 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T21:34:53.137 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T21:35:23.280 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T21:35:23.290 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T21:35:53.432 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T21:35:53.442 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T21:36:23.598 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T21:36:23.607 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T21:36:53.753 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T21:36:53.763 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T21:37:23.966 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T21:37:23.975 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T21:37:54.121 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T21:37:54.131 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T21:38:24.376 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T21:38:24.386 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T21:38:54.598 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T21:38:54.608 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T21:39:24.837 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T21:39:24.847 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T21:39:55.041 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T21:39:55.051 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T21:40:25.254 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T21:40:25.264 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T21:40:55.418 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T21:40:55.429 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T21:41:25.572 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T21:41:25.582 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T21:41:55.811 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T21:41:55.821 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T21:42:26.016 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T21:42:26.027 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T21:42:56.229 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T21:42:56.239 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T21:43:26.372 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T21:43:26.383 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T21:43:56.573 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T21:43:56.583 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T21:44:26.724 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T21:44:26.734 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T21:44:56.883 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T21:44:56.893 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T21:45:27.112 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T21:45:27.122 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T21:45:57.342 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T21:45:57.352 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T21:46:27.555 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T21:46:27.565 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T21:46:57.776 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T21:46:57.786 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T21:47:27.990 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T21:47:28.001 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T21:47:58.219 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T21:47:58.230 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T21:48:28.449 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T21:48:28.459 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T21:48:58.610 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T21:48:58.620 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T21:49:28.824 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T21:49:28.835 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T21:49:59.046 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T21:49:59.056 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T21:50:29.251 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T21:50:29.262 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T21:50:59.514 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T21:50:59.524 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T21:51:29.749 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T21:51:29.759 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T21:51:59.979 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T21:51:59.989 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T21:52:30.200 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T21:52:30.210 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T21:53:00.357 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T21:53:00.367 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T21:53:30.584 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T21:53:30.593 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T21:54:00.755 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T21:54:00.765 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T21:54:31.013 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T21:54:31.023 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T21:55:01.169 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T21:55:01.179 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T21:55:31.323 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T21:55:31.333 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T21:56:01.542 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T21:56:01.552 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T21:56:31.763 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T21:56:31.773 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T21:57:01.976 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T21:57:01.986 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T21:57:32.181 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T21:57:32.191 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T21:58:02.411 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T21:58:02.422 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T21:58:32.569 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T21:58:32.580 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T21:59:02.787 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T21:59:02.797 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T21:59:32.940 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T21:59:32.950 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T22:00:03.218 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T22:00:03.228 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T22:00:33.365 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T22:00:33.375 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T22:01:03.581 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T22:01:03.590 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T22:01:33.826 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T22:01:33.837 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T22:02:04.049 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T22:02:04.059 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T22:02:34.262 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T22:02:34.272 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T22:03:04.483 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T22:03:04.493 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T22:03:34.629 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T22:03:34.640 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T22:04:04.785 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T22:04:04.795 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T22:04:34.989 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T22:04:34.999 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T22:05:05.228 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T22:05:05.238 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T22:05:35.458 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T22:05:35.467 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T22:06:05.695 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T22:06:05.704 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T22:06:35.909 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T22:06:35.919 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T22:07:06.121 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T22:07:06.132 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T22:07:36.293 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T22:07:36.303 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T22:08:06.449 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T22:08:06.460 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T22:08:36.596 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T22:08:36.606 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T22:09:06.998 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T22:09:07.009 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T22:09:37.245 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T22:09:37.254 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T22:10:07.402 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T22:10:07.411 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T22:10:37.554 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T22:10:37.564 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T22:11:07.768 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T22:11:07.778 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T22:11:37.997 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T22:11:38.007 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T22:12:08.210 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T22:12:08.220 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T22:12:38.448 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T22:12:38.459 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T22:13:08.687 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T22:13:08.696 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T22:13:38.882 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T22:13:38.892 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T22:14:09.079 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T22:14:09.089 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T22:14:39.283 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T22:14:39.294 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T22:15:09.489 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T22:15:09.499 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T22:15:39.717 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T22:15:39.727 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T22:16:09.947 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T22:16:09.957 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T22:16:40.152 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T22:16:40.161 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T22:17:10.357 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T22:17:10.367 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T22:17:40.596 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T22:17:40.606 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T22:18:10.785 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T22:18:10.795 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T22:18:40.982 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T22:18:40.992 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T22:19:11.135 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T22:19:11.146 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T22:19:41.285 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T22:19:41.295 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T22:20:11.430 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T22:20:11.439 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T22:20:41.568 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T22:20:41.577 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T22:21:11.725 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T22:21:11.736 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T22:21:42.091 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T22:21:42.102 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T22:22:12.254 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T22:22:12.265 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T22:22:42.400 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T22:22:42.410 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T22:23:12.598 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T22:23:12.609 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T22:23:42.837 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T22:23:42.847 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T22:24:12.999 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T22:24:13.009 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T22:24:43.231 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T22:24:43.242 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T22:25:13.495 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T22:25:13.505 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T22:25:43.640 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T22:25:43.650 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T22:26:13.846 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T22:26:13.857 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T22:26:44.059 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T22:26:44.070 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T22:27:14.255 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T22:27:14.266 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T22:27:44.477 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T22:27:44.488 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T22:28:14.717 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T22:28:14.727 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T22:28:44.946 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T22:28:44.956 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T22:29:15.151 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T22:29:15.160 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T22:29:45.340 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T22:29:45.350 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T22:30:15.495 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T22:30:15.506 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T22:30:45.741 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T22:30:45.751 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T22:31:15.979 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T22:31:15.990 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T22:31:46.192 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T22:31:46.202 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T22:32:16.351 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T22:32:16.361 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T22:32:46.569 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T22:32:46.579 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T22:33:16.782 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T22:33:16.792 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T22:33:46.993 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T22:33:47.003 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T22:34:17.198 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T22:34:17.207 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T22:34:47.420 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T22:34:47.429 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T22:35:17.565 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T22:35:17.575 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T22:35:47.712 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T22:35:47.722 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T22:36:17.867 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T22:36:17.878 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T22:36:48.014 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T22:36:48.024 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T22:37:18.178 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T22:37:18.188 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T22:37:48.324 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T22:37:48.334 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T22:38:18.478 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T22:38:18.489 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T22:38:48.628 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T22:38:48.638 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T22:39:18.782 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T22:39:18.793 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T22:39:48.929 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T22:39:48.939 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T22:40:19.099 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T22:40:19.109 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T22:40:49.431 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T22:40:49.442 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T22:41:19.585 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T22:41:19.594 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T22:41:49.806 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T22:41:49.817 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T22:42:20.044 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T22:42:20.054 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T22:42:50.284 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T22:42:50.295 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T22:43:20.488 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T22:43:20.498 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T22:43:50.710 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T22:43:50.720 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T22:44:20.866 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T22:44:20.876 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T22:44:51.020 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T22:44:51.031 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T22:45:21.458 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T22:45:21.468 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T22:45:51.662 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T22:45:51.674 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T22:46:21.883 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T22:46:21.893 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T22:46:52.114 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T22:46:52.124 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T22:47:22.335 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T22:47:22.345 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T22:47:52.548 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T22:47:52.558 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T22:48:22.769 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T22:48:22.779 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T22:48:52.999 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T22:48:53.009 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T22:49:23.221 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T22:49:23.231 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T22:49:53.425 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T22:49:53.436 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T22:50:23.582 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T22:50:23.592 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T22:50:53.803 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T22:50:53.813 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T22:51:24.016 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T22:51:24.027 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T22:51:54.180 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T22:51:54.189 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T22:52:24.401 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T22:52:24.411 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T22:52:54.622 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T22:52:54.633 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T22:53:24.827 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T22:53:24.838 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T22:53:55.050 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T22:53:55.060 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T22:54:25.414 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T22:54:25.424 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T22:54:55.625 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T22:54:55.635 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T22:55:25.846 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T22:55:25.857 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T22:55:56.068 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T22:55:56.078 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T22:56:26.227 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T22:56:26.236 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T22:56:56.379 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T22:56:56.393 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T22:57:26.536 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T22:57:26.546 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T22:57:56.745 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T22:57:56.756 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T22:58:26.943 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T22:58:26.953 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T22:58:57.181 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T22:58:57.191 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T22:59:27.402 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T22:59:27.413 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T22:59:57.632 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T22:59:57.643 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T23:00:27.854 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T23:00:27.868 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T23:00:58.015 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T23:00:58.025 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T23:01:28.220 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T23:01:28.235 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T23:01:58.383 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T23:01:58.393 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T23:02:28.631 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T23:02:28.641 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T23:02:58.844 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T23:02:58.856 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T23:03:29.064 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T23:03:29.075 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T23:03:59.287 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T23:03:59.296 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T23:04:29.501 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T23:04:29.511 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T23:04:59.706 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T23:04:59.716 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T23:05:29.952 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T23:05:29.962 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T23:06:00.165 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T23:06:00.175 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T23:06:30.329 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T23:06:30.339 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T23:07:00.474 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T23:07:00.484 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T23:07:30.629 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T23:07:30.639 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T23:08:00.810 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T23:08:00.821 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T23:08:31.031 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T23:08:31.042 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T23:09:01.181 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T23:09:01.191 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T23:09:31.409 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T23:09:31.418 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T23:10:01.629 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T23:10:01.639 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T23:10:31.869 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T23:10:31.878 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T23:11:02.082 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T23:11:02.092 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T23:11:32.296 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T23:11:32.307 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T23:12:02.475 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T23:12:02.485 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T23:12:32.690 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T23:12:32.700 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T23:13:02.911 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T23:13:02.921 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T23:13:33.132 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T23:13:33.143 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T23:14:03.337 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T23:14:03.349 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T23:14:33.570 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T23:14:33.580 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T23:15:03.729 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T23:15:03.740 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T23:15:33.952 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T23:15:33.962 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T23:16:04.106 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T23:16:04.117 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T23:16:34.321 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T23:16:34.331 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T23:17:04.557 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T23:17:04.567 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T23:17:34.778 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T23:17:34.789 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T23:18:04.933 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T23:18:04.943 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T23:18:35.086 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T23:18:35.096 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T23:19:05.318 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T23:19:05.328 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T23:19:35.556 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T23:19:35.566 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T23:20:05.770 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T23:20:05.781 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T23:20:36.000 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T23:20:36.010 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T23:21:06.162 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T23:21:06.173 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T23:21:36.326 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T23:21:36.335 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T23:22:06.471 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T23:22:06.480 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T23:22:36.701 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T23:22:36.710 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T23:23:07.140 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T23:23:07.151 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T23:23:37.362 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T23:23:37.373 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T23:24:07.574 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T23:24:07.585 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T23:24:37.779 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T23:24:37.789 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T23:25:07.936 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T23:25:07.946 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T23:25:38.172 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T23:25:38.181 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T23:26:08.377 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T23:26:08.387 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T23:26:38.590 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T23:26:38.599 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T23:27:08.803 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T23:27:08.814 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T23:27:38.955 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T23:27:38.964 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T23:28:09.172 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T23:28:09.182 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T23:28:39.326 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T23:28:39.335 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T23:29:09.547 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T23:29:09.557 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T23:29:39.761 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T23:29:39.771 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T23:30:09.965 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T23:30:09.976 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T23:30:40.118 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T23:30:40.128 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-17T23:30:55.544 DEBUG:teuthology.exit:Got signal 15; running 1 handler... 2023-12-17T23:30:55.545 DEBUG:teuthology.task.console_log:Killing console logger for smithi040 2023-12-17T23:30:55.546 DEBUG:teuthology.task.console_log:Killing console logger for smithi159 2023-12-17T23:30:55.546 DEBUG:teuthology.exit:Finished running handlers